-- Logs begin at Thu 2022-08-04 13:03:04 UTC, end at Thu 2022-08-04 15:48:40 UTC. -- Aug 04 13:42:31.798874 n-d-844627-10 systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 13:42:31.808265 n-d-844627-10 devstack@n-api.service[115642]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 13:42:31 2022] *** Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: nodename: n-d-844627-10 Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: machine: x86_64 Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: clock source: unix Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: pcre jit disabled Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: detected number of CPU cores: 4 Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: current working directory: / Aug 04 13:42:31.810343 n-d-844627-10 devstack@n-api.service[115642]: detected binary path: /usr/bin/uwsgi-core Aug 04 13:42:31.811060 n-d-844627-10 devstack@n-api.service[115642]: your processes number limit is 47680 Aug 04 13:42:31.811060 n-d-844627-10 devstack@n-api.service[115642]: your memory page size is 4096 bytes Aug 04 13:42:31.811060 n-d-844627-10 devstack@n-api.service[115642]: detected max file descriptor number: 2048 Aug 04 13:42:31.811060 n-d-844627-10 devstack@n-api.service[115642]: lock engine: pthread robust mutexes Aug 04 13:42:31.811060 n-d-844627-10 devstack@n-api.service[115642]: thunder lock: enabled Aug 04 13:42:31.811060 n-d-844627-10 devstack@n-api.service[115642]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 13:42:31.811060 n-d-844627-10 devstack@n-api.service[115642]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 13:42:31.849003 n-d-844627-10 devstack@n-api.service[115642]: Python main interpreter initialized at 0x555fcbe269c0 Aug 04 13:42:31.849003 n-d-844627-10 devstack@n-api.service[115642]: python threads support enabled Aug 04 13:42:31.849003 n-d-844627-10 devstack@n-api.service[115642]: your server socket listen backlog is limited to 100 connections Aug 04 13:42:31.849003 n-d-844627-10 devstack@n-api.service[115642]: your mercy for graceful operations on workers is 90 seconds Aug 04 13:42:31.849382 n-d-844627-10 devstack@n-api.service[115642]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 13:42:31.849458 n-d-844627-10 devstack@n-api.service[115642]: *** Operational MODE: preforking *** Aug 04 13:42:31.849667 n-d-844627-10 devstack@n-api.service[115642]: *** uWSGI is running in multiple interpreter mode *** Aug 04 13:42:31.849667 n-d-844627-10 devstack@n-api.service[115642]: spawned uWSGI master process (pid: 115642) Aug 04 13:42:31.849866 n-d-844627-10 systemd[1]: Started Devstack devstack@n-api.service. Aug 04 13:42:31.850417 n-d-844627-10 devstack@n-api.service[115642]: spawned uWSGI worker 1 (pid: 115643, cores: 1) Aug 04 13:42:31.850758 n-d-844627-10 devstack@n-api.service[115642]: spawned uWSGI worker 2 (pid: 115644, cores: 1) Aug 04 13:42:31.851255 n-d-844627-10 devstack@n-api.service[115642]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 13:42:32.519587 n-d-844627-10 devstack@n-api.service[115643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 13:42:32.522638 n-d-844627-10 devstack@n-api.service[115644]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 13:42:33.602303 n-d-844627-10 devstack@n-api.service[115643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:42:33.602303 n-d-844627-10 devstack@n-api.service[115643]: from cryptography.utils import int_from_bytes Aug 04 13:42:33.602945 n-d-844627-10 devstack@n-api.service[115643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:42:33.602945 n-d-844627-10 devstack@n-api.service[115643]: from cryptography.utils import int_from_bytes Aug 04 13:42:33.607288 n-d-844627-10 devstack@n-api.service[115644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:42:33.607288 n-d-844627-10 devstack@n-api.service[115644]: from cryptography.utils import int_from_bytes Aug 04 13:42:33.607719 n-d-844627-10 devstack@n-api.service[115644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:42:33.607719 n-d-844627-10 devstack@n-api.service[115644]: from cryptography.utils import int_from_bytes Aug 04 13:42:36.176171 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 13:42:36.176708 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 13:42:36.176977 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 13:42:36.177339 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 13:42:36.177599 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 13:42:36.177764 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 13:42:36.178167 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.178259 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 13:42:36.178350 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.178563 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 13:42:36.178660 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.178892 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.178987 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 13:42:36.179173 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 13:42:36.179262 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.179505 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.179707 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.179860 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.180084 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.180191 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.180458 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.180549 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.180733 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.180840 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.181070 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.181211 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.181394 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844627-10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.181540 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.181716 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.182119 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.182281 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.182492 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.182622 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.182832 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.182942 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.183098 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.183201 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.183418 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.183513 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.183758 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844627-10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.183854 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.184067 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.184276 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.184397 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.184719 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.184901 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.185065 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.185150 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.185375 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.185458 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.185716 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.185974 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.185974 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.186131 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.186299 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.186544 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.186634 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.186805 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.187023 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.187147 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.187275 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.187400 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.187530 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.187737 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.187893 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844627-10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.188101 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.188781 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.189009 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.189194 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.189322 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.189511 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.189663 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.189921 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.190118 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.190248 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.190372 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.190562 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.190686 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844627-10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.190884 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.191117 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.191260 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.191433 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.191556 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.191700 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.191937 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.192256 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.192390 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.192513 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.192640 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.192793 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.192951 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.193077 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.193320 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.193459 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.193582 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.193743 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.193878 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.193999 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.194240 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.194411 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.194655 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.194796 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.194935 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.195179 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.195304 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.195431 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.195610 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.195750 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.195954 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.196116 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.196232 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.196352 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.196479 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.196674 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.196825 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.196825 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.197205 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.197205 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.197449 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.197573 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.197802 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.197971 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.198102 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.198334 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.198469 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.198599 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.198723 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.198844 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.198973 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.199103 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.199226 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.199355 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.199477 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.199596 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.199740 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.199862 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.199981 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.200115 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.200235 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.200356 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.200489 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.200618 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.200744 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.200883 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.201007 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.201138 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.201283 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.201415 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.201650 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.201774 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.201893 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.202017 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.202190 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.202315 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.202553 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.202681 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.202869 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.203062 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.203199 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.203305 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.203545 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.203675 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.204408 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.204671 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.204804 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.204967 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.205116 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.205246 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.205369 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.205501 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.205680 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.205806 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.206013 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.206173 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.206305 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.206435 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.206560 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.206682 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.206831 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.207076 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.207222 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.207432 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.207557 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.207679 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.207808 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.207911 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.208063 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.208230 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.208491 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.208665 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.208796 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.208993 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.209115 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.209204 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.209344 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.209428 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.209701 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.209821 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.210000 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.210100 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.210296 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.210384 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.210603 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.210710 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.210907 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.211040 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.211210 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.211335 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.211511 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.211635 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.211825 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.212006 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.212214 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.212333 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.212523 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.212656 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.212826 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.212972 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.213156 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.213300 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.213459 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.213583 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.213774 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.213926 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.214060 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.214255 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.214380 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.214570 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.214814 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.214949 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.215073 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.215223 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.215358 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.215516 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.215651 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.215843 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.215991 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.216155 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.216302 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.216468 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.216597 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.216765 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.216910 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.217094 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.217220 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.217409 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.217536 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.217743 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.217909 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.218054 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.218181 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.218356 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.218489 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.218660 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.218785 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.218963 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.219095 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.219265 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.219406 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.219593 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.219733 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.219893 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.220028 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.220192 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.220319 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.220507 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.220633 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.220832 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.221105 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.221229 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.221351 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.221479 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.221607 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.221729 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.221861 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.222047 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.222172 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.222348 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.222465 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.222676 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.222809 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.223004 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.223129 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.223319 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.223452 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.223632 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.223758 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.223928 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.224087 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.224254 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:42:36.224380 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.224561 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.224685 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.224887 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.225026 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.225215 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.225340 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.225524 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.225651 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.225834 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.225968 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.226142 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.226280 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.226458 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.226590 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.226774 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.226906 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.227101 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.227272 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.227417 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.227666 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.227798 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.227917 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.228062 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.228291 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.228426 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.228548 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.228779 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.228925 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.229074 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.229215 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.229397 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.229523 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.229708 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.229835 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.230028 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.230161 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.230352 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.230478 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.230670 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.230804 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.230989 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.231121 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.231308 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.231433 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.231618 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.231750 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.231925 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.232059 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.232231 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.232356 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.232549 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.232674 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.232928 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.233069 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.233222 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.233348 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.233538 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.233663 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.233848 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.233982 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.234159 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.234295 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.234464 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.234588 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.234772 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.234898 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.235112 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.235264 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.235434 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.235558 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.235744 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.235869 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.236055 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.236179 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.236361 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.236496 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.236671 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.236795 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.237002 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.237127 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.237316 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.237452 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.237622 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.237752 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.237924 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.238055 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.238225 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.238359 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.238526 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.238650 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.238832 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.238957 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.239130 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.239265 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.239446 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.239575 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.239757 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.239880 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.240062 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.240196 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.240365 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.240489 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.240669 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.240795 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.241006 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.241134 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.241312 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.241436 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.241619 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.241744 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.241923 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.242042 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.242232 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.242357 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.242538 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.242659 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.242840 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.242973 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.243179 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.243308 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.243455 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.243588 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.243758 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.243895 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.244062 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.244193 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.244364 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.244498 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.244664 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.244789 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.244992 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.245118 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.245299 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.245434 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.245605 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.245738 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.245910 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.246034 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.246216 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.246350 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.246526 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.246650 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.246833 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.246957 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.247137 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.247262 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.247447 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.247581 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.247759 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.247884 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.248068 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.248192 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.248384 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.248508 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.248702 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.248834 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.249028 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.249152 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.249334 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.249466 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.249642 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.249768 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.249945 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.250071 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.250247 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.250372 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.250551 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.251200 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.251375 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.251501 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.251677 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.251796 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.251979 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.252117 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.252281 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.252414 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.252582 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.252707 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.252903 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.253045 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.253217 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.253341 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.253521 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.253638 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.253821 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.253964 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.254122 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.254247 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.254422 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.254548 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.254726 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.254852 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.255033 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.255165 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.255356 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.255481 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.255670 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.255797 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.255978 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.256103 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.256286 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.256412 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.256592 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.256717 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.256926 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.257052 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.257240 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.257364 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.257582 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.257714 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.257837 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.257964 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.258139 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.258343 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.258470 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.258599 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.258750 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.258874 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.259066 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.259202 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.259373 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.259499 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.259692 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.259817 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.259999 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.260134 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.260314 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.260438 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.260619 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.260725 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.260954 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.261077 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.261295 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.261398 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.261618 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.261722 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.261930 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.262043 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.262242 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.262352 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.262548 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.262649 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.262856 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.262968 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.263164 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.263268 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.263472 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.263574 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.263783 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.263950 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.264129 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.264273 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.264401 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.264523 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.264699 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.264844 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.265046 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.265170 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.265334 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.265467 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.265651 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.265786 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.265958 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.266088 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.266296 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.266463 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.266624 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.266754 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.266935 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.267076 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.267258 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.267402 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.267580 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.267719 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.267882 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.268537 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.268707 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.268845 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.269096 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.269293 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.269485 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.269698 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.269894 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.270107 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.270315 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.270515 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.270725 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.270921 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.271108 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.271323 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.271518 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.271716 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.271846 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.271990 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.272124 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.272321 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.272471 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.272629 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.272765 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.272956 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.273094 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.273231 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.273352 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.273518 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.273661 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.273807 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.273807 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.274135 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.274135 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.274365 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.274494 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.274615 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.274615 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.274856 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.274986 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.275107 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.275107 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.275344 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.275467 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.275616 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.275616 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.275898 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.275898 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.276114 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.276247 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.276369 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.276490 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.276619 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.276774 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.276992 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.277118 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.277239 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.277438 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.277564 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.277744 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.277877 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.278045 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.278169 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.278360 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.278494 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.278665 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.278790 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.278972 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.279104 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.279275 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.279398 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.279583 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.279708 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.279888 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.280015 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.280207 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.280333 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.280520 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.280646 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.280825 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.281054 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.281212 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.281439 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.281593 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.281719 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.281841 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.281978 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.282110 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.282242 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.282404 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.282524 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.282706 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.282831 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.283014 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.283150 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.283321 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.283447 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.283622 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.283748 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.283932 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.284082 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.284245 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.284370 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.284570 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.284829 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.285028 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.285172 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.285304 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.285487 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.285613 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.285797 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.285931 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.286110 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.286237 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.286423 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.286548 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.286751 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.287001 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.287123 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.287341 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.287470 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.287658 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.287794 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.287979 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.288114 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.288277 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.288402 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.288579 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.288704 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.288908 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.289050 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.289215 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.289351 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.289517 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.289642 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.289817 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.289952 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.290125 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.290259 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.290425 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.290553 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.290726 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.290852 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.291027 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.291154 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.291334 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.291514 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.291643 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.291777 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.291937 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.292063 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.292248 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.292372 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.292548 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.292683 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.292850 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.292990 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.293187 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.293326 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.293487 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.293621 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.293789 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.293925 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.294090 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.294210 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.294402 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.294545 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.294709 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.294844 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.295041 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.295168 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.295353 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.295489 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.295659 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.295786 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.295967 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.296100 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.296266 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.296385 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.296590 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.296717 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.296907 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.297029 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.297217 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.297338 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.297547 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.297683 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.297859 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.297986 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.298165 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.298291 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.298465 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.298598 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.298774 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.298910 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.299079 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.299205 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.299387 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.299513 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.299692 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.299832 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.299992 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.300125 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.300297 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.300439 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.300595 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.300730 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.300932 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.301061 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.301247 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.301372 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.301546 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.301741 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.301864 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.301985 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.302141 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.302279 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.302444 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.302584 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.302743 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.302878 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.303048 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.303175 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.303347 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.303474 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.303653 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.303778 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.303951 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.304076 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.304251 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.304371 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.304552 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.304678 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.304855 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.305005 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.305187 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.305321 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.305489 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.305614 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.305805 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.305930 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.306113 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.306246 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.306416 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.306535 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.306716 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.307104 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.307278 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.307404 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.307576 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.307664 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.307876 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.307971 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.308182 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.308284 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.308497 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.308590 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.308806 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.308939 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.309133 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.309235 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.309439 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.309525 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.309737 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.309832 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.310037 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.310122 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.310334 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.310422 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.310638 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.310726 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.310937 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.311030 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.311239 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.311325 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.311537 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.311632 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.311835 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.311921 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.312137 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.312227 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.312442 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.312529 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.312745 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.312829 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.313072 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.313666 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.313909 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.313996 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.314209 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.314294 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.314511 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.314653 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.314817 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.314944 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.315146 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.315271 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.315457 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.315586 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.315763 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.315889 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.316070 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.316196 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.316374 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.316509 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.316727 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.317061 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.317221 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.317346 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.317541 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.317682 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.317816 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.317938 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.318059 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.318180 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.318310 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.318434 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.318563 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.318692 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.318816 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.318937 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.319066 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.319189 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.319358 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.319484 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.319665 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.319798 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.319981 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.320108 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.320298 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.320424 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.320618 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.320744 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.320940 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.321086 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.321251 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.321376 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.321562 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.321687 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.321885 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.322012 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.322157 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.322282 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.322461 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.322595 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.322769 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.322896 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.323076 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.323211 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.323385 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.323520 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.323696 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.323819 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.323999 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.324124 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.324301 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.324436 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.324607 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.324725 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.324937 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.325067 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.325242 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.325378 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.325553 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.325678 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.325856 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.325987 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.326156 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.326283 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.326460 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.326594 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.326759 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.326885 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.327067 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.327192 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.327363 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.327490 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.327687 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.327810 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.327999 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.328124 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.328304 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.328430 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.328613 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.328752 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.329518 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.329651 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.329798 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.329925 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.330103 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.330246 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.330440 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.330564 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.330742 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.330867 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.331141 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.331275 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.331448 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.331571 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.331757 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.331937 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.332063 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.332192 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.332344 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.332471 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.332643 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.332778 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.333007 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.333142 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.333265 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.333386 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.333564 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.333689 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.333862 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.333989 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.334161 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.334286 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.334477 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.334604 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.334779 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.334899 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.335094 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.335219 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.335468 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.335592 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.335774 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.335908 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.336078 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.336203 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.336381 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.336507 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.336703 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.336829 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.337035 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.337169 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.337359 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.337493 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.337698 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.337824 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.338018 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.338143 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.338320 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.338454 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.338635 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.338769 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.338942 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.339067 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.339263 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.339397 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.339581 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.339719 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.339887 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.340013 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.340197 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.340322 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.340498 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.340636 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.340814 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.341018 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.341141 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.341262 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.341451 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.341590 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.341774 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.341908 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.342121 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.342247 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.342439 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.342575 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.342747 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.342873 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.343074 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.343200 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.343399 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.343526 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.343697 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.343836 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.344001 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.344148 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.344307 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.344455 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.344644 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.344771 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.344975 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.345110 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.345295 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.345421 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.345598 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.345724 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.345907 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.346042 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.346213 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.346349 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.346517 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.346642 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.346815 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.346953 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.347115 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.347249 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.347431 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.347557 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.347730 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.347863 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.348046 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.348173 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.348357 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.348482 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.348665 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.348790 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.348993 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.349132 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.349295 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.349419 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.349612 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.349738 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.349915 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.350040 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.350212 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.350337 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.350509 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.350632 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.350793 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.350918 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.351131 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.351265 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.351435 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.351561 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.351752 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.351876 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.352113 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.352259 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.352384 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.352506 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.352658 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.352783 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.352985 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.353122 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.353328 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.353463 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.353636 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.353762 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.353948 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.354081 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.354273 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.354398 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.354577 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.354702 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.354880 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.355014 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.355187 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.355312 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.355489 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.355615 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.355790 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.355916 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.356090 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.356224 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.356394 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.356520 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.356694 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.356820 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.357004 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.357128 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.357304 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.357430 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.357630 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.357763 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.357913 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.358038 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.358220 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.358408 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.358542 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.358666 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.358810 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.358936 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.359110 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.359248 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.359409 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.359542 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.359736 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.359869 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.360071 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.360211 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.360433 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.360566 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.360687 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.360809 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.361021 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.361162 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.361332 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.361459 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.361637 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.361771 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.361960 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.362093 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.362276 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.362400 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.362575 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.362712 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.362887 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.363015 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.363199 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.363325 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.363505 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.363631 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.363816 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.363944 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.364129 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.364255 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.364442 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.364568 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.364769 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.365038 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.365168 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.365365 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.365492 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.365676 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.365812 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.365985 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.366113 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.366294 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.366421 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.366606 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.366733 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.366913 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.367171 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.367297 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.367510 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.367647 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.367812 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.367936 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.368118 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.368238 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.368440 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.368574 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.368757 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.368989 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.369103 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.369225 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.369406 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.369534 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.369731 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.369858 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.370049 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.370184 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.370366 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.370494 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.370677 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.370813 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.371020 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.371144 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.371334 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.371460 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.371641 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.371774 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.371949 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.372085 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.372311 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.372443 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.372565 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.372686 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.372862 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.373065 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.373190 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.373319 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.373491 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.373617 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.373799 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.373926 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.374108 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.374244 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.374413 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.374547 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.374721 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.374857 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.375030 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.375157 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.375352 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.375472 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.376213 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.376351 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.376535 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.376661 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.376853 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.377012 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.377190 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.377314 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.377504 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.377631 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.377817 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.378076 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.378219 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.378384 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.378519 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.378715 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.378841 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.379036 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.379165 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.379357 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.379498 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.379670 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.379806 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.379986 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.380251 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.380385 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.380572 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.380699 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.380916 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.381045 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.381226 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.381343 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.381530 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.381627 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.381835 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.381933 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.382154 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.382260 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.382458 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.382554 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.382757 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.382862 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.383071 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.383175 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.383378 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.383484 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.383688 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.383949 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.384047 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.384298 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.384395 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.384609 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.384712 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.384943 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.385044 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.385268 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.385373 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.385576 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.385671 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.385876 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.386144 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.386247 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.386482 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.386586 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.386780 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.386876 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.387094 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.387189 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.387402 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.387497 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.387701 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.387797 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.388001 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.388104 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.388308 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.388432 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.388614 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.388712 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.388938 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.389039 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.389246 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.389343 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.389547 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.389643 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.389857 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.389952 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.390153 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.390248 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.390452 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.390553 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.390751 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.390856 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.391070 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.391167 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.391408 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.391992 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.392209 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.392362 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.392499 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.392632 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.392785 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.392935 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.393126 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.393274 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.393418 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.393551 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.393718 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.393853 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.394016 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.394166 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.394302 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.394437 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.394605 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.394755 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.394968 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.395103 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.395237 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.395371 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.395518 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.395658 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.395802 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.395938 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.396081 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.396169 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.396395 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.396482 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.396700 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.396795 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.397035 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.397125 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.397345 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.397516 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.397665 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.397810 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.397966 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.398093 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.398280 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.398433 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.398631 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.398863 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.398998 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.399191 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.399324 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.399511 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.399656 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.399845 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.399977 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.400171 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.400303 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.400472 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.400609 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.400814 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.401099 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.401190 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.401422 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.401519 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.401728 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.401817 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.402040 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.402126 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.402346 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.402434 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.402654 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.402748 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.402959 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.403054 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.403265 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.403351 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.403567 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.403653 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.403872 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.403959 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.404178 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.404266 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.404483 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.404569 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.404789 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.404922 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.405123 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.405211 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.405428 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.405517 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.405732 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.405828 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.406041 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.406127 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.406355 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.406450 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.406667 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.406763 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.407028 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.407139 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.407323 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.407412 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.407634 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.407721 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.407944 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.408108 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.408249 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.408394 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.408548 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.408698 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.408835 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.409008 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.409146 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.409283 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.409456 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.409603 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.409818 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.409977 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.410118 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.410254 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.410442 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.410596 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.410735 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.411006 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.411151 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.411302 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.411440 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.411576 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.411713 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.411851 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.411987 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.412142 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.412280 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.412432 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.412571 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.412773 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.412947 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.413090 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.413228 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.413363 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.413499 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.413634 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.413837 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.413981 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.414160 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.414312 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.414482 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.414625 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.414772 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.414916 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.415074 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.415216 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.415375 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.415519 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.415665 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.415802 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.415982 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.416125 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.416272 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.416418 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.416555 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.416693 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.416852 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.417019 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.417190 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.417344 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.417483 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.417618 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.417775 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.417918 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.418055 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.418214 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.418352 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.418488 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.418625 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.418760 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.418925 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.419069 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.419213 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.419350 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.419487 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.419652 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.419804 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.419942 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.420094 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.420254 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.420396 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.420559 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.420711 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.420903 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.421184 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.421329 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.421464 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.421601 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.421746 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.421889 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.422045 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.422196 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.422344 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.422491 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.422637 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.422831 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.422979 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.423116 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.423259 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.423482 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.423622 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.423767 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.423904 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.424051 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.424196 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.424343 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.424489 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.424626 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.424763 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.424917 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.425059 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.425217 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.425363 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.425501 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.425637 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.425774 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.425929 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.426066 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.426203 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.426340 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.426476 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.426612 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.426756 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.426939 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.427083 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.427221 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.427356 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.427528 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.427691 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.427837 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.427975 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.428159 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.428303 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.428461 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.428613 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.428774 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.428938 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.429110 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.429253 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.429408 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.429545 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.429722 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.429866 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.430025 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.430174 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.430349 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.430493 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.430657 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.430801 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.430962 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.431105 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.431377 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.431520 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.431667 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.431811 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.432232 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.432386 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.432527 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.432663 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.432800 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.433018 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.433156 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.433305 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.433443 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.433586 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.433741 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.433879 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.434015 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.434160 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.434298 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.434434 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.434570 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.434706 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.434850 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.434988 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.435124 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.435260 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.435457 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.435610 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.435756 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.435894 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.436075 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.436216 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.436399 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.436540 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.436711 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.436855 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.437087 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.437234 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.437381 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.437517 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.437683 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 13:42:36.437823 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.438008 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.438850 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.439198 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.439532 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.439852 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.440168 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.440475 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:42:36.440721 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 13:42:36.594168 n-d-844627-10 devstack@n-api.service[115643]: INFO dbcounter [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Registered counter for database nova_api Aug 04 13:42:36.596601 n-d-844627-10 devstack@n-api.service[115644]: INFO dbcounter [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Registered counter for database nova_api Aug 04 13:42:36.616850 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_db.sqlalchemy.engines [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:42:36.618574 n-d-844627-10 devstack@n-api.service[115644]: DEBUG oslo_db.sqlalchemy.engines [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:42:36.623833 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writer thread running {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:42:36.625286 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writer thread running {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:42:36.681672 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.context [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) {{(pid=115643) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 13:42:36.683311 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.context [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) {{(pid=115644) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 13:42:36.685853 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:42:36.687392 n-d-844627-10 devstack@n-api.service[115644]: DEBUG oslo_concurrency.lockutils [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:42:36.687502 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:42:36.688314 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:42:36.689287 n-d-844627-10 devstack@n-api.service[115644]: DEBUG oslo_concurrency.lockutils [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:42:36.690239 n-d-844627-10 devstack@n-api.service[115644]: DEBUG oslo_concurrency.lockutils [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:42:36.690365 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:42:36.692366 n-d-844627-10 devstack@n-api.service[115643]: INFO dbcounter [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Registered counter for database nova_cell0 Aug 04 13:42:36.692485 n-d-844627-10 devstack@n-api.service[115644]: DEBUG oslo_concurrency.lockutils [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:42:36.694653 n-d-844627-10 devstack@n-api.service[115644]: INFO dbcounter [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Registered counter for database nova_cell0 Aug 04 13:42:36.698145 n-d-844627-10 devstack@n-api.service[115643]: INFO dbcounter [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Registered counter for database nova_cell1 Aug 04 13:42:36.700267 n-d-844627-10 devstack@n-api.service[115644]: INFO dbcounter [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Registered counter for database nova_cell1 Aug 04 13:42:36.706753 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_db.sqlalchemy.engines [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:42:36.709879 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_db.sqlalchemy.engines [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:42:36.711836 n-d-844627-10 devstack@n-api.service[115644]: DEBUG oslo_db.sqlalchemy.engines [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:42:36.713439 n-d-844627-10 devstack@n-api.service[115644]: DEBUG oslo_db.sqlalchemy.engines [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:42:36.716542 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writer thread running {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:42:36.718039 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writer thread running {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:42:36.720497 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writer thread running {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:42:36.722282 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writer thread running {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:42:36.861589 n-d-844627-10 devstack@n-api.service[115643]: INFO dbcounter [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Registered counter for database nova_cell0 Aug 04 13:42:36.864171 n-d-844627-10 devstack@n-api.service[115644]: INFO dbcounter [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Registered counter for database nova_cell0 Aug 04 13:42:36.870785 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_db.sqlalchemy.engines [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:42:36.873937 n-d-844627-10 devstack@n-api.service[115644]: DEBUG oslo_db.sqlalchemy.engines [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:42:36.875373 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writer thread running {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:42:36.879257 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writer thread running {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:42:37.213379 n-d-844627-10 devstack@n-api.service[115643]: WARNING keystonemiddleware.auth_token [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:42:37.213919 n-d-844627-10 devstack@n-api.service[115644]: WARNING keystonemiddleware.auth_token [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:42:37.221286 n-d-844627-10 devstack@n-api.service[115643]: WARNING keystonemiddleware.auth_token [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:42:37.221406 n-d-844627-10 devstack@n-api.service[115644]: WARNING keystonemiddleware.auth_token [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:42:37.561996 n-d-844627-10 devstack@n-api.service[115644]: WARNING keystonemiddleware.auth_token [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:42:37.564902 n-d-844627-10 devstack@n-api.service[115643]: WARNING keystonemiddleware.auth_token [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:42:37.568029 n-d-844627-10 devstack@n-api.service[115644]: WARNING keystonemiddleware.auth_token [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:42:37.570791 n-d-844627-10 devstack@n-api.service[115643]: WARNING keystonemiddleware.auth_token [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:42:37.573304 n-d-844627-10 devstack@n-api.service[115644]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555fcbe269c0 pid: 115644 (default app) Aug 04 13:42:37.575373 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:42:37.576089 n-d-844627-10 devstack@n-api.service[115643]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555fcbe269c0 pid: 115643 (default app) Aug 04 13:42:37.576548 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-8db09a88-9bcc-4b05-97b1-3294b554cd1f None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Aug 04 13:42:37.576980 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Thu Aug 4 13:42:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:02.954728 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:02.958927 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005069 Aug 04 13:44:02.959951 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:02.990040 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writing DB stats nova_api:SELECT=3 {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:02.992616 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writing DB stats nova_cell1:SELECT=3 {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:02.995736 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writing DB stats nova_cell0:SELECT=3 {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:02.998234 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:04.152777 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-d6d3bf59-c791-43a3-a7d4-60d76e533bb9 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:04.191913 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-d6d3bf59-c791-43a3-a7d4-60d76e533bb9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.222340 Aug 04 13:44:04.192453 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 13:44:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:44:07.101915 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:07.102915 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-35e38de3-a379-45eb-8610-756e36794ab0 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 04 13:44:07.109566 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 2/4] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:07 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:07.819785 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-27f251a8-ae32-4a01-b16f-6ca7e1617614 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "name": "cirros256"}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:07.865437 n-d-844627-10 devstack@n-api.service[115644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:44:07.865437 n-d-844627-10 devstack@n-api.service[115644]: warnings.warn(msg) Aug 04 13:44:07.904350 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-27f251a8-ae32-4a01-b16f-6ca7e1617614 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.792715 Aug 04 13:44:07.912927 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 3/5] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:44:07.926271 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writing DB stats nova_api:SELECT=3 {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:07.929394 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writing DB stats nova_cell0:SELECT=3 {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:07.930789 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writing DB stats nova_cell1:SELECT=3 {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:07.933068 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:08.178254 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-beaf8478-53a9-4e91-b98d-ee5bd2198760 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:08.183223 n-d-844627-10 devstack@n-api.service[115643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:44:08.183223 n-d-844627-10 devstack@n-api.service[115643]: warnings.warn(msg) Aug 04 13:44:08.252675 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-beaf8478-53a9-4e91-b98d-ee5bd2198760 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.333594 Aug 04 13:44:08.253659 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 3/6] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 13:44:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:44:11.152028 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-27f251a8-ae32-4a01-b16f-6ca7e1617614 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:11.156314 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-27f251a8-ae32-4a01-b16f-6ca7e1617614 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004832 Aug 04 13:44:11.158375 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 4/7] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:11 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:12.440517 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-c291e1d8-720f-42d8-b11d-bf909df344de admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:12.487932 n-d-844627-10 devstack@n-api.service[115643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:44:12.487932 n-d-844627-10 devstack@n-api.service[115643]: warnings.warn(msg) Aug 04 13:44:12.512483 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-c291e1d8-720f-42d8-b11d-bf909df344de admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.343273 Aug 04 13:44:12.513626 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 4/8] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:44:12.539871 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-46cfce2d-8c8d-4594-bc0e-a614e8311ddc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:12.548285 n-d-844627-10 devstack@n-api.service[115644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:44:12.548285 n-d-844627-10 devstack@n-api.service[115644]: warnings.warn(msg) Aug 04 13:44:12.609361 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-46cfce2d-8c8d-4594-bc0e-a614e8311ddc admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083088 Aug 04 13:44:12.610324 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 5/9] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 13:44:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:44:16.025474 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-c291e1d8-720f-42d8-b11d-bf909df344de admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:16.030883 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-c291e1d8-720f-42d8-b11d-bf909df344de admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003838 Aug 04 13:44:16.036491 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:16 2022] GET /compute/v2.1 => generated 388 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:16.593711 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-cf2cd398-b17d-4b92-afb1-f310578543eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "name": "ds1G"}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:16.619290 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-cf2cd398-b17d-4b92-afb1-f310578543eb admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.572440 Aug 04 13:44:16.627633 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 6/11] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:44:16.633074 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-d534fd7b-6e8f-47dc-9dca-f804886d475f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:16.661696 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-d534fd7b-6e8f-47dc-9dca-f804886d475f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032220 Aug 04 13:44:16.671758 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 6/12] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 13:44:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:44:19.138787 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-cf2cd398-b17d-4b92-afb1-f310578543eb admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:19.139801 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-cf2cd398-b17d-4b92-afb1-f310578543eb admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 04 13:44:19.140208 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 7/13] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:19.839983 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-00c61c1b-b69b-45c7-a231-5dba37263b0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:19.863151 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-00c61c1b-b69b-45c7-a231-5dba37263b0a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.716485 Aug 04 13:44:19.863713 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 7/14] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:44:19.876556 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-5a30795f-5043-4b2c-86ea-67a05795cc10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:19.903751 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-5a30795f-5043-4b2c-86ea-67a05795cc10 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030855 Aug 04 13:44:19.909298 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 8/15] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 13:44:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:44:22.442021 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-00c61c1b-b69b-45c7-a231-5dba37263b0a admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:22.443774 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-00c61c1b-b69b-45c7-a231-5dba37263b0a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002521 Aug 04 13:44:22.444480 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 8/16] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:44:23.193480 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-8f5d9eb2-deb9-45d8-84c0-4382d4c22e8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:23.219063 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-8f5d9eb2-deb9-45d8-84c0-4382d4c22e8f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.763105 Aug 04 13:44:23.219842 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 9/17] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:44:23.239637 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-094161c8-a893-49e3-a005-b9d10ac9a1cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:23.278134 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-094161c8-a893-49e3-a005-b9d10ac9a1cd admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043288 Aug 04 13:44:23.289829 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 9/18] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 13:44:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:44:26.082960 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-8f5d9eb2-deb9-45d8-84c0-4382d4c22e8f admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:26.084566 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-8f5d9eb2-deb9-45d8-84c0-4382d4c22e8f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Aug 04 13:44:26.085525 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 10/19] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:26.731776 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-d912c62f-fa7e-4008-ab21-01eec432bbfb admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:26.758205 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-d912c62f-fa7e-4008-ab21-01eec432bbfb admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.664645 Aug 04 13:44:26.759258 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 10/20] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 13:44:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:44:29.732372 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-8f5d9eb2-deb9-45d8-84c0-4382d4c22e8f admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:29.733805 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-8f5d9eb2-deb9-45d8-84c0-4382d4c22e8f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001901 Aug 04 13:44:29.734733 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 11/21] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:30.503709 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-c67177a0-32e4-469b-ace1-3d09832988c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1"}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:30.540135 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-c67177a0-32e4-469b-ace1-3d09832988c4 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.796212 Aug 04 13:44:30.541058 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 11/22] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:44:30.556984 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-679a8a78-555c-48a8-8e2f-1f06ca44f8d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:30.588018 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-679a8a78-555c-48a8-8e2f-1f06ca44f8d2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035046 Aug 04 13:44:30.589052 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 12/23] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 13:44:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:44:33.001018 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-c67177a0-32e4-469b-ace1-3d09832988c4 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:33.002434 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-c67177a0-32e4-469b-ace1-3d09832988c4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002411 Aug 04 13:44:33.003018 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 12/24] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:33.665031 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-b737f7ad-8c71-48ca-b52b-453874150fa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:33.672392 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:33.698830 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-b737f7ad-8c71-48ca-b52b-453874150fa1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.688411 Aug 04 13:44:33.699837 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 13/25] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:44:33.719838 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-817bbfcc-712b-4853-9ddc-43e262f97231 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:33.760697 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-817bbfcc-712b-4853-9ddc-43e262f97231 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048397 Aug 04 13:44:33.761339 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 13/26] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 13:44:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:44:36.096582 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-b737f7ad-8c71-48ca-b52b-453874150fa1 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:36.097568 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-b737f7ad-8c71-48ca-b52b-453874150fa1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 04 13:44:36.097973 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 14/27] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:36.688622 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-b5c928e6-2f8c-488d-a658-953c31717de7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:36.711310 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-b5c928e6-2f8c-488d-a658-953c31717de7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.605355 Aug 04 13:44:36.711876 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 14/28] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:44:36.734499 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-351cf4d1-28ce-40fa-a776-245b082001a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:36.769173 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-351cf4d1-28ce-40fa-a776-245b082001a6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041224 Aug 04 13:44:36.770115 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 15/29] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 13:44:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:44:39.099642 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-b5c928e6-2f8c-488d-a658-953c31717de7 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:39.100772 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-b5c928e6-2f8c-488d-a658-953c31717de7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 04 13:44:39.101286 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 15/30] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:44:39.713300 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-398740d0-e7aa-42f6-9c33-d8b138b65565 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "vcpus": 4}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:39.749995 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-398740d0-e7aa-42f6-9c33-d8b138b65565 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.637805 Aug 04 13:44:39.751126 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 16/31] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:44:39.767359 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-c426a5bc-0d46-421c-8d6e-f1cf94c65554 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:39.776093 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:44:39.818979 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-c426a5bc-0d46-421c-8d6e-f1cf94c65554 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056749 Aug 04 13:44:39.820002 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 16/32] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 13:44:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:44:42.188680 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-398740d0-e7aa-42f6-9c33-d8b138b65565 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:44:42.190492 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-398740d0-e7aa-42f6-9c33-d8b138b65565 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002229 Aug 04 13:44:42.190909 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 17/33] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:44:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:44:42.756570 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-b3a2a48b-ad17-4d3e-b08a-cd28a2cb5b3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "id": "5", "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:42.784507 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-b3a2a48b-ad17-4d3e-b08a-cd28a2cb5b3d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.586781 Aug 04 13:44:42.785493 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 17/34] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 13:44:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:44:42.797717 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-1227a040-872f-4abc-a804-3a9a6d6c50e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:44:42.841057 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-1227a040-872f-4abc-a804-3a9a6d6c50e1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046902 Aug 04 13:44:42.842493 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 18/35] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 13:44:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:45:07.749967 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-b3a2a48b-ad17-4d3e-b08a-cd28a2cb5b3d admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:07.752263 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-b3a2a48b-ad17-4d3e-b08a-cd28a2cb5b3d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 04 13:45:07.752263 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 18/36] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:45:07.767909 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:45:08.224908 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-40fbe301-5035-4fea-86a7-917722b8c5f3 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:08.244684 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-40fbe301-5035-4fea-86a7-917722b8c5f3 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.484808 Aug 04 13:45:08.245315 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 19/37] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 13:45:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:45:09.397300 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-b3a2a48b-ad17-4d3e-b08a-cd28a2cb5b3d admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:09.398374 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-b3a2a48b-ad17-4d3e-b08a-cd28a2cb5b3d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Aug 04 13:45:09.398830 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 19/38] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:45:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:45:10.169625 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-bed2b203-e69f-4270-9bf1-23f6475e4a69 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:10.178248 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.wsgi [None req-bed2b203-e69f-4270-9bf1-23f6475e4a69 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-bed2b203-e69f-4270-9bf1-23f6475e4a69 admin admin] Request method failure captured: Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: Accept: application/json Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: Accept-Encoding: gzip, deflate Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: Connection: keep-alive Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: Content-Length: 0 Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: Host: 10.222.0.66 Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: Openstack-Api-Version: compute 2.90 Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: Openstack-System-Scope: None Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: User-Agent: python-novaclient Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Auth-Token: gAAAAABi681ln24IgUMQ_BnSyiNf8yzflQovfSYrjKLHNphgYdeOEhDlFwFUnTS_DHCv4-qifuImRM5u5GACtK0KfObVVfXNgPDPV34FV8-LhE1eQdRVllzeE6FKAZz_Z58G7MRjD63oDTIkQn-fyVGgO8Ihi04DYLpdza78UApRyX9NE1Bl8Cg Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Domain-Id: None Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Domain-Name: None Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Identity-Status: Confirmed Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Is-Admin-Project: True Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Domain-Id: default Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Domain-Name: Default Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Name: admin Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Role: admin,reader,member Aug 04 13:45:10.182417 n-d-844627-10 devstack@n-api.service[115644]: X-Roles: admin,reader,member Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}] Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: X-Tenant: admin Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: X-Tenant-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: X-Tenant-Name: admin Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: X-User: admin Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: X-User-Domain-Id: default Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: X-User-Domain-Name: Default Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: X-User-Id: a0417702351748b0b8e14b9e8676f3df Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: X-User-Name: admin Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: method: > Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: exception: Flavor 42 could not be found. Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: action_args: {'id': '42'} Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:45:10.184966 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:10.186985 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.188920 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-bed2b203-e69f-4270-9bf1-23f6475e4a69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:45:10.191190 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-bed2b203-e69f-4270-9bf1-23f6475e4a69 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.622345 Aug 04 13:45:10.191190 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 20/39] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 13:45:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 624 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 13:45:10.195471 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:45:10.201753 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-7c77a637-7346-4764-b78b-7cc6dfa8b2ad admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:10.225780 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-7c77a637-7346-4764-b78b-7cc6dfa8b2ad admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031310 Aug 04 13:45:10.226685 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 20/40] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 13:45:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:45:10.243203 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-80c947cb-f0c2-4e26-9963-d0ae8bef8e60 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:10.272531 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-80c947cb-f0c2-4e26-9963-d0ae8bef8e60 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033172 Aug 04 13:45:10.273143 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 21/41] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 13:45:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:45:10.283293 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-9374c348-5b7f-4416-af95-2eee769a1ed9 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:10.289630 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.wsgi [None req-9374c348-5b7f-4416-af95-2eee769a1ed9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-9374c348-5b7f-4416-af95-2eee769a1ed9 admin admin] Request method failure captured: Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: Accept: application/json Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: Accept-Encoding: gzip, deflate Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: Connection: keep-alive Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: Content-Length: 0 Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: Host: 10.222.0.66 Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: Openstack-Api-Version: compute 2.90 Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: Openstack-System-Scope: None Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: User-Agent: python-novaclient Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Auth-Token: gAAAAABi681ln24IgUMQ_BnSyiNf8yzflQovfSYrjKLHNphgYdeOEhDlFwFUnTS_DHCv4-qifuImRM5u5GACtK0KfObVVfXNgPDPV34FV8-LhE1eQdRVllzeE6FKAZz_Z58G7MRjD63oDTIkQn-fyVGgO8Ihi04DYLpdza78UApRyX9NE1Bl8Cg Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Domain-Id: None Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Domain-Name: None Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Identity-Status: Confirmed Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Is-Admin-Project: True Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Domain-Id: default Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Domain-Name: Default Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Name: admin Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Role: admin,reader,member Aug 04 13:45:10.292992 n-d-844627-10 devstack@n-api.service[115643]: X-Roles: admin,reader,member Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}] Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: X-Tenant: admin Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: X-Tenant-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: X-Tenant-Name: admin Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: X-User: admin Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: X-User-Domain-Id: default Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: X-User-Domain-Name: Default Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: X-User-Id: a0417702351748b0b8e14b9e8676f3df Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: X-User-Name: admin Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: method: > Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: exception: Flavor 42 could not be found. Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: action_args: {'id': '42'} Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:45:10.294530 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:10.295747 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:10.300119 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-9374c348-5b7f-4416-af95-2eee769a1ed9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:45:10.302556 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-9374c348-5b7f-4416-af95-2eee769a1ed9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015109 Aug 04 13:45:10.302556 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 21/42] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 13:45:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 13:45:11.331987 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-80c947cb-f0c2-4e26-9963-d0ae8bef8e60 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:11.333084 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-80c947cb-f0c2-4e26-9963-d0ae8bef8e60 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 04 13:45:11.333570 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 22/43] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:45:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:45:11.967788 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-aeaae0c4-70ba-4c33-81d0-aec4c803d5be admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:11.974725 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.wsgi [None req-aeaae0c4-70ba-4c33-81d0-aec4c803d5be admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-aeaae0c4-70ba-4c33-81d0-aec4c803d5be admin admin] Request method failure captured: Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: Accept: application/json Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: Accept-Encoding: gzip, deflate Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: Connection: keep-alive Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: Content-Length: 0 Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: Host: 10.222.0.66 Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: Openstack-Api-Version: compute 2.90 Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: Openstack-System-Scope: None Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: User-Agent: python-novaclient Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Auth-Token: gAAAAABi681n6_01EvnyBhVfQuDKhY8w9nyf_IgZ_NXSvISSWzSZgrbi1DK5D5Iwk8ngTQCQ4NxTZXXM-B-6tNriW-wqTMFWsAchrou3ruWVBphiWTnAannnjmM2rvN5PiTF2VWfgkxxWbQWvsTbazrZEHGQuuZpSkNBkVrytXpAW-QT4uP29dc Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Domain-Id: None Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Domain-Name: None Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Identity-Status: Confirmed Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Is-Admin-Project: True Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Domain-Id: default Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Domain-Name: Default Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Name: admin Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Role: admin,reader,member Aug 04 13:45:11.976225 n-d-844627-10 devstack@n-api.service[115643]: X-Roles: admin,reader,member Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}] Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: X-Tenant: admin Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: X-Tenant-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: X-Tenant-Name: admin Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: X-User: admin Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: X-User-Domain-Id: default Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: X-User-Domain-Name: Default Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: X-User-Id: a0417702351748b0b8e14b9e8676f3df Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: X-User-Name: admin Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: method: > Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: exception: Flavor 84 could not be found. Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: action_args: {'id': '84'} Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:45:11.978324 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:11.979742 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:11.981866 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-aeaae0c4-70ba-4c33-81d0-aec4c803d5be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:45:11.984015 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-aeaae0c4-70ba-4c33-81d0-aec4c803d5be admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.501826 Aug 04 13:45:11.984015 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 22/44] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 13:45:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 503 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:45:11.990620 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-79826957-eb97-4e25-84cb-b340947673f4 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:12.008050 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-79826957-eb97-4e25-84cb-b340947673f4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021028 Aug 04 13:45:12.008637 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 23/45] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 13:45:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:45:12.019581 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-b3258fdb-d36b-479f-9eb2-cef1e6a4bfc4 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:12.037937 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-b3258fdb-d36b-479f-9eb2-cef1e6a4bfc4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022541 Aug 04 13:45:12.038440 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 13:45:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:45:12.055038 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-2f7c6d52-57b7-4bc4-9e5d-3e11626a0b39 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:12.065300 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.wsgi [None req-2f7c6d52-57b7-4bc4-9e5d-3e11626a0b39 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-2f7c6d52-57b7-4bc4-9e5d-3e11626a0b39 admin admin] Request method failure captured: Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: Accept: application/json Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: Accept-Encoding: gzip, deflate Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: Connection: keep-alive Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: Content-Length: 0 Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: Host: 10.222.0.66 Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: Openstack-Api-Version: compute 2.90 Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: Openstack-System-Scope: None Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: User-Agent: python-novaclient Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Auth-Token: gAAAAABi681n6_01EvnyBhVfQuDKhY8w9nyf_IgZ_NXSvISSWzSZgrbi1DK5D5Iwk8ngTQCQ4NxTZXXM-B-6tNriW-wqTMFWsAchrou3ruWVBphiWTnAannnjmM2rvN5PiTF2VWfgkxxWbQWvsTbazrZEHGQuuZpSkNBkVrytXpAW-QT4uP29dc Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Domain-Id: None Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Domain-Name: None Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Identity-Status: Confirmed Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Is-Admin-Project: True Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Domain-Id: default Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Domain-Name: Default Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Name: admin Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Role: admin,reader,member Aug 04 13:45:12.068369 n-d-844627-10 devstack@n-api.service[115644]: X-Roles: admin,reader,member Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}] Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: X-Tenant: admin Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: X-Tenant-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: X-Tenant-Name: admin Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: X-User: admin Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: X-User-Domain-Id: default Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: X-User-Domain-Name: Default Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: X-User-Id: a0417702351748b0b8e14b9e8676f3df Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: X-User-Name: admin Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: method: > Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: exception: Flavor 84 could not be found. Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: action_args: {'id': '84'} Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:45:12.069834 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:12.070684 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:12.071878 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-2f7c6d52-57b7-4bc4-9e5d-3e11626a0b39 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:45:12.073154 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-2f7c6d52-57b7-4bc4-9e5d-3e11626a0b39 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.022563 Aug 04 13:45:12.073154 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 24/47] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 13:45:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:45:13.096426 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-b3258fdb-d36b-479f-9eb2-cef1e6a4bfc4 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:13.097869 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-b3258fdb-d36b-479f-9eb2-cef1e6a4bfc4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Aug 04 13:45:13.098382 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 24/48] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:45:13.712979 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0038a85a-8288-40f3-9bde-785775be1fc6 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:13.719463 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.wsgi [None req-0038a85a-8288-40f3-9bde-785775be1fc6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0038a85a-8288-40f3-9bde-785775be1fc6 admin admin] Request method failure captured: Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: Accept: application/json Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: Accept-Encoding: gzip, deflate Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: Connection: keep-alive Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: Content-Length: 0 Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: Host: 10.222.0.66 Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: Openstack-Api-Version: compute 2.90 Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: Openstack-System-Scope: None Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: User-Agent: python-novaclient Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Auth-Token: gAAAAABi681oqv-sFesgWgs3rSYSdyV7fAZF7V0oRbLL8VG1wqzG9bl7GXZQPXGAB6nYOLWSF1hA7m8qZ2jmY7Rv1Bb-f4SR_wsE6hk8dZ6TaFLrNRlqeBcldZkApWstdv9WY20vQvvgY2caf3vKm4Gi6TJ5aGV9hjpoWxtWWrE5MbuqKLhU_TI Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Domain-Id: None Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Domain-Name: None Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Identity-Status: Confirmed Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Is-Admin-Project: True Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Domain-Id: default Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Domain-Name: Default Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Project-Name: admin Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Role: admin,reader,member Aug 04 13:45:13.721322 n-d-844627-10 devstack@n-api.service[115644]: X-Roles: admin,reader,member Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}] Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: X-Tenant: admin Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: X-Tenant-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: X-Tenant-Name: admin Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: X-User: admin Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: X-User-Domain-Id: default Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: X-User-Domain-Name: Default Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: X-User-Id: a0417702351748b0b8e14b9e8676f3df Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: X-User-Name: admin Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: method: > Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: exception: Flavor 451 could not be found. Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: action_args: {'id': '451'} Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:45:13.723179 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:13.724478 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.726853 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0038a85a-8288-40f3-9bde-785775be1fc6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:45:13.728483 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-0038a85a-8288-40f3-9bde-785775be1fc6 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.487762 Aug 04 13:45:13.728483 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 25/49] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 13:45:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 489 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 13:45:13.735267 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-6075a501-60cd-458d-b983-8130b9d61907 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:13.752034 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-6075a501-60cd-458d-b983-8130b9d61907 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019909 Aug 04 13:45:13.752679 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 25/50] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 13:45:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:45:13.762757 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:13.778792 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019515 Aug 04 13:45:13.779429 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 26/51] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 13:45:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:45:13.793572 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-85cb84ef-e0ae-43a2-887c-fee86480e869 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:13.803329 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.wsgi [None req-85cb84ef-e0ae-43a2-887c-fee86480e869 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-85cb84ef-e0ae-43a2-887c-fee86480e869 admin admin] Request method failure captured: Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: Accept: application/json Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: Accept-Encoding: gzip, deflate Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: Connection: keep-alive Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: Content-Length: 0 Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: Host: 10.222.0.66 Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: Openstack-Api-Version: compute 2.90 Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: Openstack-System-Scope: None Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: User-Agent: python-novaclient Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Auth-Token: gAAAAABi681oqv-sFesgWgs3rSYSdyV7fAZF7V0oRbLL8VG1wqzG9bl7GXZQPXGAB6nYOLWSF1hA7m8qZ2jmY7Rv1Bb-f4SR_wsE6hk8dZ6TaFLrNRlqeBcldZkApWstdv9WY20vQvvgY2caf3vKm4Gi6TJ5aGV9hjpoWxtWWrE5MbuqKLhU_TI Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Domain-Id: None Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Domain-Name: None Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Identity-Status: Confirmed Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Is-Admin-Project: True Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Domain-Id: default Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Domain-Name: Default Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Project-Name: admin Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Role: admin,reader,member Aug 04 13:45:13.806308 n-d-844627-10 devstack@n-api.service[115643]: X-Roles: admin,reader,member Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e06f952587174f5f92dddfe2fe6b2690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e06f952587174f5f92dddfe2fe6b2690"}]}] Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: X-Tenant: admin Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: X-Tenant-Id: e06f952587174f5f92dddfe2fe6b2690 Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: X-Tenant-Name: admin Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: X-User: admin Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: X-User-Domain-Id: default Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: X-User-Domain-Name: Default Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: X-User-Id: a0417702351748b0b8e14b9e8676f3df Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: X-User-Name: admin Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: method: > Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: exception: Flavor 451 could not be found. Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: action_args: {'id': '451'} Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:45:13.807788 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:13.808597 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: ERROR nova.api.openstack.wsgi Aug 04 13:45:13.809719 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-85cb84ef-e0ae-43a2-887c-fee86480e869 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:45:13.810839 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-85cb84ef-e0ae-43a2-887c-fee86480e869 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.021928 Aug 04 13:45:13.810839 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 26/52] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 13:45:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:45:14.887070 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:14.888136 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 04 13:45:14.888545 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 27/53] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:45:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:45:15.613620 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-cd9246db-6b20-4d58-b3f9-101cc3c3ac04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:45:15.634937 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-cd9246db-6b20-4d58-b3f9-101cc3c3ac04 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.600449 Aug 04 13:45:15.635502 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 27/54] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Aug 4 13:45:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:45:16.676926 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:16.678029 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Aug 04 13:45:16.678568 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 28/55] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:45:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:45:17.317604 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-581cbf74-d676-4b34-bfc9-9c58c7f26549 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:45:17.339469 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-581cbf74-d676-4b34-bfc9-9c58c7f26549 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.518149 Aug 04 13:45:17.340311 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 28/56] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Aug 4 13:45:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:45:18.363269 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:18.364316 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 04 13:45:18.364731 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 29/57] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:45:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:45:18.934709 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-8c0d101c-e90d-45a4-bc9a-da1c59b253f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:45:18.956714 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-8c0d101c-e90d-45a4-bc9a-da1c59b253f8 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.450228 Aug 04 13:45:18.957310 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 29/58] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Aug 4 13:45:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:45:20.015160 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:20.016345 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 04 13:45:20.016805 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 30/59] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:45:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:45:20.766112 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-1d6222a3-06ea-4f8b-8736-9778f6d3e0b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:45:20.797106 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-1d6222a3-06ea-4f8b-8736-9778f6d3e0b9 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.642383 Aug 04 13:45:20.797681 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 30/60] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Aug 4 13:45:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:45:21.827627 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:21.828627 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 04 13:45:21.829091 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 31/61] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:45:22.430591 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-17b064b2-c154-4c1f-9897-35040d6718e0 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:45:22.451944 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-17b064b2-c154-4c1f-9897-35040d6718e0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.476139 Aug 04 13:45:22.452492 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 31/62] 10.222.0.66 () {60 vars in 1202 bytes} [Thu Aug 4 13:45:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:46:15.337791 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:46:15.338814 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-0ff2d519-2862-40e5-8d9d-f39ae766a85d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001744 Aug 04 13:46:15.339211 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 32/63] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 13:46:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:46:15.350092 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:46:15.739874 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-e545091b-dadd-4a2d-9e3b-b45ffd43e536 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:46:15.760826 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-e545091b-dadd-4a2d-9e3b-b45ffd43e536 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415239 Aug 04 13:46:15.761411 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 32/64] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 13:46:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:46:15.790005 n-d-844627-10 devstack@n-api.service[115644]: DEBUG dbcounter [-] [115644] Writing DB stats nova_api:SELECT=14 {{(pid=115644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:46:15.793699 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-36b5b562-8b98-4c7b-8fad-1b06bf0826df admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:46:15.801366 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-36b5b562-8b98-4c7b-8fad-1b06bf0826df admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013256 Aug 04 13:46:15.801904 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 33/65] 10.222.0.66 () {60 vars in 1283 bytes} [Thu Aug 4 13:46:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:46:15.814329 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-2524985d-3884-4758-ade9-7a29883c17f3 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:46:15.822145 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-2524985d-3884-4758-ade9-7a29883c17f3 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011457 Aug 04 13:46:15.822682 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 33/66] 10.222.0.66 () {60 vars in 1286 bytes} [Thu Aug 4 13:46:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:46:15.834329 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-c7a12ff3-0a1f-44e5-8928-156d8b3481a6 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:46:15.842198 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-c7a12ff3-0a1f-44e5-8928-156d8b3481a6 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011493 Aug 04 13:46:15.842721 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 34/67] 10.222.0.66 () {60 vars in 1286 bytes} [Thu Aug 4 13:46:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:46:15.854760 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-25628f7e-de53-458c-bd94-544c535bd9a0 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:46:15.862432 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-25628f7e-de53-458c-bd94-544c535bd9a0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011810 Aug 04 13:46:15.862954 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 34/68] 10.222.0.66 () {60 vars in 1283 bytes} [Thu Aug 4 13:46:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:51:45.291130 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-c7a12ff3-0a1f-44e5-8928-156d8b3481a6 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:45.292125 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-c7a12ff3-0a1f-44e5-8928-156d8b3481a6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 04 13:51:45.292520 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 35/69] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:51:45.432959 n-d-844627-10 devstack@n-api.service[115643]: DEBUG dbcounter [-] [115643] Writing DB stats nova_api:SELECT=6 {{(pid=115643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:51:45.581595 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-49c9c0b7-f89c-47a2-abc6-4fa3ee0408c8 admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:45.583954 n-d-844627-10 devstack@n-api.service[115643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:51:45.583954 n-d-844627-10 devstack@n-api.service[115643]: warnings.warn(msg) Aug 04 13:51:45.585196 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-49c9c0b7-f89c-47a2-abc6-4fa3ee0408c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:51:45.585667 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-49c9c0b7-f89c-47a2-abc6-4fa3ee0408c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:51:45.586458 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-49c9c0b7-f89c-47a2-abc6-4fa3ee0408c8 admin admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:51:45.586883 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-49c9c0b7-f89c-47a2-abc6-4fa3ee0408c8 admin admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:51:45.627816 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-49c9c0b7-f89c-47a2-abc6-4fa3ee0408c8 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.196423 Aug 04 13:51:45.628397 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 35/70] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 13:51:45 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:51:46.474119 n-d-844627-10 devstack@n-api.service[115644]: DEBUG nova.api.openstack.wsgi [None req-c7a12ff3-0a1f-44e5-8928-156d8b3481a6 admin admin] Calling method '>' {{(pid=115644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:46.475107 n-d-844627-10 devstack@n-api.service[115644]: INFO nova.api.openstack.requestlog [None req-c7a12ff3-0a1f-44e5-8928-156d8b3481a6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 04 13:51:46.475503 n-d-844627-10 devstack@n-api.service[115644]: [pid: 115644|app: 0|req: 36/71] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 13:51:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:51:46.664996 n-d-844627-10 devstack@n-api.service[115643]: DEBUG nova.api.openstack.wsgi [None req-77ef670b-cefe-46eb-b51c-5ce79b717c3f admin admin] Calling method '>' {{(pid=115643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:51:46.667353 n-d-844627-10 devstack@n-api.service[115643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:51:46.667353 n-d-844627-10 devstack@n-api.service[115643]: warnings.warn(msg) Aug 04 13:51:46.668546 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-77ef670b-cefe-46eb-b51c-5ce79b717c3f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:51:46.669072 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-77ef670b-cefe-46eb-b51c-5ce79b717c3f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:51:46.669824 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-77ef670b-cefe-46eb-b51c-5ce79b717c3f admin admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:51:46.670250 n-d-844627-10 devstack@n-api.service[115643]: DEBUG oslo_concurrency.lockutils [None req-77ef670b-cefe-46eb-b51c-5ce79b717c3f admin admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:51:46.694225 n-d-844627-10 devstack@n-api.service[115643]: INFO nova.api.openstack.requestlog [None req-77ef670b-cefe-46eb-b51c-5ce79b717c3f admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.081831 Aug 04 13:51:46.694712 n-d-844627-10 devstack@n-api.service[115643]: [pid: 115643|app: 0|req: 36/72] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 13:51:46 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:52:31.283941 n-d-844627-10 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 13:52:31.285115 n-d-844627-10 devstack@n-api.service[115642]: Thu Aug 4 13:52:31 2022 - graceful shutdown triggered... Aug 04 13:52:31.285789 n-d-844627-10 devstack@n-api.service[115643]: Gracefully killing worker 1 (pid: 115643)... Aug 04 13:52:31.286241 n-d-844627-10 devstack@n-api.service[115644]: Gracefully killing worker 2 (pid: 115644)... Aug 04 13:52:32.286263 n-d-844627-10 devstack@n-api.service[115642]: worker 1 buried after 1 seconds Aug 04 13:52:32.286263 n-d-844627-10 devstack@n-api.service[115642]: worker 2 buried after 1 seconds Aug 04 13:52:32.286263 n-d-844627-10 devstack@n-api.service[115642]: goodbye to uWSGI. Aug 04 13:52:32.287865 n-d-844627-10 systemd[1]: devstack@n-api.service: Succeeded. Aug 04 13:52:32.288731 n-d-844627-10 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 13:52:32.291843 n-d-844627-10 systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 13:52:32.311997 n-d-844627-10 devstack@n-api.service[130944]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 13:52:32 2022] *** Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: nodename: n-d-844627-10 Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: machine: x86_64 Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: clock source: unix Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: pcre jit disabled Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: detected number of CPU cores: 4 Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: current working directory: / Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: detected binary path: /usr/bin/uwsgi-core Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: your processes number limit is 47680 Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: your memory page size is 4096 bytes Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: detected max file descriptor number: 2048 Aug 04 13:52:32.330331 n-d-844627-10 devstack@n-api.service[130944]: lock engine: pthread robust mutexes Aug 04 13:52:32.331627 n-d-844627-10 devstack@n-api.service[130944]: thunder lock: enabled Aug 04 13:52:32.331627 n-d-844627-10 devstack@n-api.service[130944]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 13:52:32.331627 n-d-844627-10 devstack@n-api.service[130944]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 13:52:32.377998 n-d-844627-10 devstack@n-api.service[130944]: Python main interpreter initialized at 0x55e6596269c0 Aug 04 13:52:32.377998 n-d-844627-10 devstack@n-api.service[130944]: python threads support enabled Aug 04 13:52:32.377998 n-d-844627-10 devstack@n-api.service[130944]: your server socket listen backlog is limited to 100 connections Aug 04 13:52:32.377998 n-d-844627-10 devstack@n-api.service[130944]: your mercy for graceful operations on workers is 90 seconds Aug 04 13:52:32.378435 n-d-844627-10 devstack@n-api.service[130944]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 13:52:32.378435 n-d-844627-10 devstack@n-api.service[130944]: *** Operational MODE: preforking *** Aug 04 13:52:32.378657 n-d-844627-10 devstack@n-api.service[130944]: *** uWSGI is running in multiple interpreter mode *** Aug 04 13:52:32.378657 n-d-844627-10 devstack@n-api.service[130944]: spawned uWSGI master process (pid: 130944) Aug 04 13:52:32.378881 n-d-844627-10 systemd[1]: Started Devstack devstack@n-api.service. Aug 04 13:52:32.396953 n-d-844627-10 devstack@n-api.service[130944]: spawned uWSGI worker 1 (pid: 130960, cores: 1) Aug 04 13:52:32.396953 n-d-844627-10 devstack@n-api.service[130944]: spawned uWSGI worker 2 (pid: 130961, cores: 1) Aug 04 13:52:32.396953 n-d-844627-10 devstack@n-api.service[130944]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 13:52:33.063986 n-d-844627-10 devstack@n-api.service[130960]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 13:52:33.065486 n-d-844627-10 devstack@n-api.service[130961]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 13:52:34.240760 n-d-844627-10 devstack@n-api.service[130960]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:52:34.240760 n-d-844627-10 devstack@n-api.service[130960]: from cryptography.utils import int_from_bytes Aug 04 13:52:34.241477 n-d-844627-10 devstack@n-api.service[130960]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:52:34.241477 n-d-844627-10 devstack@n-api.service[130960]: from cryptography.utils import int_from_bytes Aug 04 13:52:34.281291 n-d-844627-10 devstack@n-api.service[130961]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:52:34.281291 n-d-844627-10 devstack@n-api.service[130961]: from cryptography.utils import int_from_bytes Aug 04 13:52:34.281949 n-d-844627-10 devstack@n-api.service[130961]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 13:52:34.281949 n-d-844627-10 devstack@n-api.service[130961]: from cryptography.utils import int_from_bytes Aug 04 13:52:36.598674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 13:52:36.598674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 13:52:36.603071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 13:52:36.603071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 13:52:36.603071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 13:52:36.603071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.603609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844627-10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.604073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.604073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.604275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.604741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.604955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.605754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.606062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.606569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.607850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.608401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.608949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.609368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.609674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.610153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.610370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.610683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.611036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.611372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.611851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844627-10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.612103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.612439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.612756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.613222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.613546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.613866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.614207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.614541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.614852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.615191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.615520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.615860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.616180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.616489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.616807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.617208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.617785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.618133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.618425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.618671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.618986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.619316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.619647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.619980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.620237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.620495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.620988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.621813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.622132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.622443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.622836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.623123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.623368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.623678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.623987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.624298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.624626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.624964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.625296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.625608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.625935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.626342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.626595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.626909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.627294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.627735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.628052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.628379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.628735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.629146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.629462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.629775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.630104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.630454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.630764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.631020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.631328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.631643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.631968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.632286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.632588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.632953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.633230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.633526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.633837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.634147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.634457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.634768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.635076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.635385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.635695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.636004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.636366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.636655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.636989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.637304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.637833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.638052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.638389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.638773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.639107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.639321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.639723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.639941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.641228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.641228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.641228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.641228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.641820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.641820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.642096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.642415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.642728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.643114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.643476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.643716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.644012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.644317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.644629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.644964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.645294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.645623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.645939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.646251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.646558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.646889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.647228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.647568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.648042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.648365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.648706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.649166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.649416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.649734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.650053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.650384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.650701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.651241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.651604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.651929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.652254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.652590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.652944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.653279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.653663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.653985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.654364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.655700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.655700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.655700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.655700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.657549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 13:52:36.657549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 13:52:36.658358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.658358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.658875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 13:52:36.659218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.659452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 13:52:36.659615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.659777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 13:52:36.659964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.660133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.660285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.660434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.660589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.660738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.660972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.661167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.661403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.661557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.661713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.661867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.662017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.662168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.662343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.662550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.663051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.663200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.663476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.663645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.663881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.664039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.664183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.664325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844627-10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.664465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.664614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.664764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.664949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.665104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.665254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.665403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.665555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.665702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.665868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.666011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.666151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.666151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.666426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.666426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.666716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.666877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.667029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.667182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.667324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.668000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.668152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.668313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.668556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.668812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.669070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.669387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.669632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.669780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.669929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.669929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.670206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.670356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.670517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.670666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.670815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.670965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844627-10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.671114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.671265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.671423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.671649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.671795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.671951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.672092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.672241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.672401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.672543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.672693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.672848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.673040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.673184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.673335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.673592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.673743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.673916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.674152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.674300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.674442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.674602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.674761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.674761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.675036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.675189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.675341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.675493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.675648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.675792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.675931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.676078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.676228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.676368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.676526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.676676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.676820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.676820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.677128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.677283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.677425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.677571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.677719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.677861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.678008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.678168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.678329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.678470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.678734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.678987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.679227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.679555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.679796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.679957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.680101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.680242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.680400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.680553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.680713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.680855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.681072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.681227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.681378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.681519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.681688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.681909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.681909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.682199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.682350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.682493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.682633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.682792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.682942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.683175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.683933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.684090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.684344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.684512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.684672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.684814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.684978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.685134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.685134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.685413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.685413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.685715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.685866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.686007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.686159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.686316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.686467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.686616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.686766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.686916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.687058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.687206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.687360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.687509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.687658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.687800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.687800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.688076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.688225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.688225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.688513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.688655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.688655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.689265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.689699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.689991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.690141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.690284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.690431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.690431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.690741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.690903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.691052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.691052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.691052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.691052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.691630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.691848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.691848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.691848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.691848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.691848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.692791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.692980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.693143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.693143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.693447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.693597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.693745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.694058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.694231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.694231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.694231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.694231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.694937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.695094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.695242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.695396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.695552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.695709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.695867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.696016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.696171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.696337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.696487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.696644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.696795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.696992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.697152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.697314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.697314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.697596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.697743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.697891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.698046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.698208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.698374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.698532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.698779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.698967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.699254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.699551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.699987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.700237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.700400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.700400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.700706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.700882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.701054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.701222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.701378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.701525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.701683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.701840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.702000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.702168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.702404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.702557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.702714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.702871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.703022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.703168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.703168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.703475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.703633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.703789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.703937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.704232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.704397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.704397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.704802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.705030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.705195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.705353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.705502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.705675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.705825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.705972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 13:52:36.706133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.706283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.706431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.706586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.706743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.706891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.707046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.707194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.707343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.707515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.707673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.707829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.707978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.708131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.708295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.708451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.708599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.708752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.708919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.709073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.709256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.709537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.709821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.710230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.710474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.710636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.710794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.710958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.710958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.711248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.711248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.711537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.711695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.711844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.711990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.712155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.712304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.712579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.712743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.712941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.713097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.713256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.713413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.713571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.713720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.713867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.714022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.714263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.714556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.714880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.715047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.715206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.715355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.715510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.715678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.715828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.715984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.716144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.716303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.716452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.716625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.716774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.716952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.717120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.717269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.717417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.717579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.717729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.717876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.718023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.718170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.718317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.718479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.718644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.718793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.718948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.719097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.719251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.719408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.719692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.719982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.720403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.720403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.720823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.721027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.721186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.721354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.721503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.721657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.721819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.721977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.722133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.722283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.722441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.722696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.722865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.723024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.723180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.723346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.723503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.723652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.723809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.723959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.724116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.724328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.724490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.724740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.724963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.725198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.725351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.725512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.725678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.725827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.725981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.726139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.726294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.726455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.726610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.726764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.726918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.727066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.727228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.727384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.727539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.727698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.727846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.728003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.728161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.728311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.728465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.728613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.728760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.728924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.729089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.729249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.729397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.729551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.729733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.730843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.731019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.731177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.731335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.731485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.731632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.731793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.731942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.732098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.732247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.732395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.732561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.732743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.732994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.733150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.733310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.733472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.733629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.733788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.733945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.734451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.735712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.735712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.735712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.735712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.735712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.735712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.735712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.735712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.736962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.736962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.736962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.736962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.736962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.736962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.737797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.737797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.738082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.738300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.738627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.738972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.739278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.739669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.739915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.740234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.740969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.741196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.741528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.741851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.742023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.742175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.742324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.742479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.742807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.743129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.743310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.743470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.743627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.743775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.743923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.744070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.744226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.744404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.744610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.744760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.744941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.745221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.746444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.746444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.746757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.746907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.747064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.747229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.747379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.747527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.747674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.747821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.747976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.748135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.748303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.748459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.748607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.748755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.748970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.749250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.749413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.749568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.749717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.749864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.750019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.750183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.750334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.750494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.750665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.751286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.751458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.751609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.751763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.751912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.752067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.752215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.752383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.752541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.752689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.752848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.753031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.753284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.753284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.753284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.753284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.753930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.753930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.754223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.754477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.754792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.755108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.755429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.755601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.755783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.755948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.756159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.756324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.756474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.756636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.756804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.756986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.757204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.757532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.757697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.757971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.758209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.758557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.758718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.758896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.759057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.759234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.759486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.759642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.759791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.759947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.760096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.760252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.760403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.760561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.760710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.760890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.761603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.761778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.761930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.762079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.762236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.762385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.762385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.762385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.762896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.763044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.763512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.763733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.763935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.764249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.764572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.764848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.765082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.765241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.765514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.765677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.765833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.765983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.766142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.766298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.766485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.766649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.766827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.766991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.767183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.767352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.767517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.767671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.767827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.767975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.768130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.768298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.768447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.768595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.768894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.769053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.769233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.769399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.769659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.769814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.769962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.770116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.770273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.770430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.770597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.770746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.770894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.771041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.771202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.771920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.772081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.772240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.772389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.772547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.772704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.772853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.773028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.773190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.773362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.773538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.773781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.773943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.773943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.774240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.774404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.774553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.774701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.774901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.775063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.775224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.775383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.775383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.775759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.775917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.776073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.776236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.776385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.776385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.776673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.776940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.777097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.777262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.777430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.777585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.777742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.777891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.778047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.778206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.778356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.778503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.778652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.778652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.778948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.779115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.779265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.779265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.779572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.779836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.780005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.780161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.780309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.780458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.780625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.780781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.780964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.781126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.781283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.781432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.782083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.782244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.782408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.782567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.782718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.782866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.783022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.783184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.783342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.783491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.783639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.783814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.784075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.784075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.784387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.784537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.784684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.784833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.785067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.785237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.785395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.785551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.785801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.785965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.786115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.786289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.786446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.786594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.786741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.786888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.787036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.787191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.787347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.787504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.787907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.788065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.788222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.788371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.788529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.788685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.788840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.789012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.789173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.789322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.789469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.789623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.789772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.790023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.790186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.790336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.790491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.790651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.790808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.790970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.791128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.791277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.791424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.791570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.791735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.792304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.792997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.793149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.793310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.793472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.793621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.793783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.793939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.794180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.794347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.794505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.794654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.794820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.794970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.795718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.795960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.796118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.796294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.796447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.797224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.797391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.797544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.797702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.797858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.798025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.798181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.798339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.798497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.798659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.798808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.798956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.799118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.799267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.799415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.799572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.799723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.799880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.800061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.800316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.800472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.800630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.800814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.801092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.801092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.801401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.801558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.801708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.801863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.802020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.802564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.802838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.802995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.803153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.803302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.803546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.803700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.803857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.803857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.804172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.804416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.804584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.804736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.804904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.805117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.805291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.805441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.805615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.805778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.805945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.806189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.806345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.806500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.806658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.806658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.806658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.806658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.807231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.807392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.807541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.807707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.807864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.808087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.808750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.808934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.809091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.809248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.809397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.809546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.809702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.809859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.810017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.810173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.810448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.810588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.810751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.810914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.811065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.811214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.811370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.811519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.811663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.811825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.811982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.812132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.812281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.812768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.813106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.813262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.813399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.813541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.813682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.813830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.813985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.814134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.814275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.814434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.814580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.814671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.814671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.814832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.814924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.815904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.816996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.817984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.818075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.818166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.818257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.818629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.819311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.819516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.819603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.819696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.819791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.819883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.819975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.820067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.820159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.820245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.820336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.820600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.820707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.820800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.820908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.821945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.822036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.822121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.822293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.822428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.822609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.822727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.823386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.823479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.823556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.823689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.823768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.824028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.824313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.824423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.824631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.824731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.824924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.825041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.825251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.825356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.825565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.825675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.825884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.825987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.826193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.826287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.826515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.826635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.826834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.826945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.827151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.827247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.827471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.827575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.827884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.827990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.828824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.828963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.829902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.830176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.830287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.830421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.830548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.830742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.830897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.831073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.831177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.831389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.831493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.831707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.831802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.832024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.832126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.832981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.832981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.833178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.833446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.833706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.833811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.834057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.834174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.834376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.834510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.834744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.834899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.835043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.835184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.835316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.835444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.835651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.835786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.835968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.836110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.836279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.836406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.836593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.836736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.837039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.837166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.837293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.837407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.837566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.837696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.837894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.838026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.838236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.838481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.838625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.838819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.838947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.839216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.839527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.839679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.840338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.840551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.840745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.841120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.841277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.841419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.841551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.841696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.841696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.841969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.842101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.842229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.842387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.842586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.842719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.842834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.842960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.843099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.843226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.843387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.843561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.843697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.843827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.843958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.844099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.844256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.844396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.844528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.844709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.845072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.845283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.845283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.845579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.845721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.845853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.845992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.846125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.846254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.846383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.846502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.846629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.846752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.846923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.847070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.847204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.847343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.847473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.847612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.847806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.847943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.848080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.848218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.848349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.848495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.848627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.848810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.848967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.848967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.849236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.849377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.849492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.849604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.849723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.849876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.850025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.850191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.850325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.850536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.850616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.850819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.850916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.851132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.851395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.851494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.851784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.851888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.852079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.852170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.852389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.852510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.852698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.852888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.853046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.853176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.853371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.853490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.853773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.853958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.854075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.854225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.854345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.854428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.854617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.854757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.855488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.855617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.855811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.855943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.856133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.856278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.856443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.856584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.856775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.857018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.857170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.857312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.857453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.857589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.857727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.857857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.858073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.858214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.858403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.858536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.858718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.858859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.859033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.859166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.859360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.859499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.859684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.859827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.860004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.860234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.860369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.860581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.860724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.860952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.861100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.861274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.861416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.861592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.861725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.861914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.862048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.862229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.862361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.862542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.862684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.862875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.863016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.863193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.863327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.863511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.863663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.863839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.863968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.864145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.864278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.864489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.864676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.864818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.865025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.865161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.865371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.865539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.865732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.865858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.866027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.866171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.866354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.866506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.866668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.866809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.867004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.867139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.867320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.867463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.867636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.867770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.867954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.868088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.868269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.868413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.868581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.868716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.868931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.869082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.869255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.869390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.869568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.869967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.870103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.870233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.870373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.870608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.871256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.871388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.871519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.871664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.871805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.871981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.872116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.872318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.872460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.872654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.893676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.893957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.893957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.894501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.894766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.898074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.898074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.898587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.898926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.899342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.903605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.903843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.904065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.904501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.906389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.906622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.906622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.906994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.907159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.907242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.907314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.907396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.907469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.907550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.907662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.907820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.908392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.908493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.908562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.908619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.908674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.908817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.908915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.909218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.909296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.909381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.909503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.909606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.909672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.909809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.909899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.910978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.911876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.912274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.912348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.912416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.912536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.912954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.913937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.914962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.915976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.916929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.917000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.917000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.917000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.917000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.917000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.917000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.917000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.917000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.918905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.919965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.920942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.921939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.922952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130960) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 13:52:36.923708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.923708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.924826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.925625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.925625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.925625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.925625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.925625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.925625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.925625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.925625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.926144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.926144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.926144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.926144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.926144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.926443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.926513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.926795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.927112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.927431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.927757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.928083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.928445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.928769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.929265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.929609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.929951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.930324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.930647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.931006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.931346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.931673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.931993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.932310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 13:52:36.932563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130961) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 13:52:37.068843 n-d-844627-10 devstack@n-api.service[130960]: INFO dbcounter [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Registered counter for database nova_api Aug 04 13:52:37.087740 n-d-844627-10 devstack@n-api.service[130961]: INFO dbcounter [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Registered counter for database nova_api Aug 04 13:52:37.088832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_db.sqlalchemy.engines [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130960) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:52:37.096178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writer thread running {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:52:37.108775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_db.sqlalchemy.engines [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130961) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:52:37.115478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writer thread running {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:52:37.154144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.context [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) {{(pid=130960) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 13:52:37.158615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:52:37.160252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:52:37.161109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:52:37.163428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:52:37.165506 n-d-844627-10 devstack@n-api.service[130960]: INFO dbcounter [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Registered counter for database nova_cell0 Aug 04 13:52:37.170423 n-d-844627-10 devstack@n-api.service[130960]: INFO dbcounter [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Registered counter for database nova_cell1 Aug 04 13:52:37.173679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.context [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) {{(pid=130961) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 13:52:37.177753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_db.sqlalchemy.engines [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130960) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:52:37.178088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:52:37.180040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:52:37.180314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_db.sqlalchemy.engines [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130960) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:52:37.180785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:52:37.182876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:52:37.184904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writer thread running {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:52:37.185059 n-d-844627-10 devstack@n-api.service[130961]: INFO dbcounter [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Registered counter for database nova_cell0 Aug 04 13:52:37.189261 n-d-844627-10 devstack@n-api.service[130961]: INFO dbcounter [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Registered counter for database nova_cell1 Aug 04 13:52:37.198176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_db.sqlalchemy.engines [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130961) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:52:37.199282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_db.sqlalchemy.engines [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130961) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:52:37.206809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writer thread running {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:52:37.208153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writer thread running {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:52:37.325413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writer thread running {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:52:37.335559 n-d-844627-10 devstack@n-api.service[130960]: INFO dbcounter [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Registered counter for database nova_cell0 Aug 04 13:52:37.342905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_db.sqlalchemy.engines [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130960) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:52:37.347856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writer thread running {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:52:37.357146 n-d-844627-10 devstack@n-api.service[130961]: INFO dbcounter [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Registered counter for database nova_cell0 Aug 04 13:52:37.363987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_db.sqlalchemy.engines [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130961) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 13:52:37.371488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writer thread running {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 13:52:37.669056 n-d-844627-10 devstack@n-api.service[130960]: WARNING keystonemiddleware.auth_token [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:52:37.676360 n-d-844627-10 devstack@n-api.service[130960]: WARNING keystonemiddleware.auth_token [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:52:37.703757 n-d-844627-10 devstack@n-api.service[130961]: WARNING keystonemiddleware.auth_token [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:52:37.711455 n-d-844627-10 devstack@n-api.service[130961]: WARNING keystonemiddleware.auth_token [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:52:38.017508 n-d-844627-10 devstack@n-api.service[130960]: WARNING keystonemiddleware.auth_token [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:52:38.023656 n-d-844627-10 devstack@n-api.service[130960]: WARNING keystonemiddleware.auth_token [None req-145a87c4-5eb4-4fda-a7e3-08b7ab5bb7ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:52:38.030049 n-d-844627-10 devstack@n-api.service[130960]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6596269c0 pid: 130960 (default app) Aug 04 13:52:38.055981 n-d-844627-10 devstack@n-api.service[130961]: WARNING keystonemiddleware.auth_token [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 13:52:38.062634 n-d-844627-10 devstack@n-api.service[130961]: WARNING keystonemiddleware.auth_token [None req-6628305e-d946-45e9-bab6-c04dded3f519 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 13:52:38.069791 n-d-844627-10 devstack@n-api.service[130961]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6596269c0 pid: 130961 (default app) Aug 04 13:53:19.313213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:19.314686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:19.315825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:19.316923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:20.791485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2090176-a57a-4146-8ade-8545d5689ff8 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:20.793375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2090176-a57a-4146-8ade-8545d5689ff8 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:20.793829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2090176-a57a-4146-8ade-8545d5689ff8 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:20.794774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2090176-a57a-4146-8ade-8545d5689ff8 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:20.795220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2090176-a57a-4146-8ade-8545d5689ff8 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:20.845090 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e2090176-a57a-4146-8ade-8545d5689ff8 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] 10.222.0.66 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.541172 Aug 04 13:53:20.847081 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1/1] 10.222.0.66 () {58 vars in 1164 bytes} [Thu Aug 4 13:53:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:21.174950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5c673b05-35c1-4a05-92a0-35531dc3ab26 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:21.178614 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:21.178614 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:21.184830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c673b05-35c1-4a05-92a0-35531dc3ab26 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:21.185321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c673b05-35c1-4a05-92a0-35531dc3ab26 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:21.198445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c673b05-35c1-4a05-92a0-35531dc3ab26 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:21.199232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c673b05-35c1-4a05-92a0-35531dc3ab26 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:21.199847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:21.200690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:21.201412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:21.202100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:21.348485 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5c673b05-35c1-4a05-92a0-35531dc3ab26 tempest-AZAdminV2TestJSON-198695224 tempest-AZAdminV2TestJSON-198695224-project-admin] 10.222.0.66 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.485274 Aug 04 13:53:21.351177 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1/2] 10.222.0.66 () {58 vars in 1185 bytes} [Thu Aug 4 13:53:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:21.783786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-417596d1-f9e6-4c35-9e51-b59fdccd3791 tempest-AZAdminNegativeTestJSON-1624058900 tempest-AZAdminNegativeTestJSON-1624058900-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:21.785470 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:21.785470 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:21.786949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-417596d1-f9e6-4c35-9e51-b59fdccd3791 tempest-AZAdminNegativeTestJSON-1624058900 tempest-AZAdminNegativeTestJSON-1624058900-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'd7b0bab9e6f44325a1951435461add48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54b915fcdcc484fb153bad8d1cdfe82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-417596d1-f9e6-4c35-9e51-b59fdccd3791 tempest-AZAdminNegativeTestJSON-1624058900 tempest-AZAdminNegativeTestJSON-1624058900-project] Request method failure captured: Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689N55zNZh4wFhzniGC4NJWvHT9G_Pk_E285b5GQu_oGe4fnGA74pH4a-rEza_Ra31aBOCpkCR1UIxDknuZLOAxDCUVY6k7Clb8OHBwUIpP897khiYHLaIh4_yMCZqIyAsqVn2Ph9a8QL3C8fsZPR4v_h3tcMWhhYXwq8n0cwpwIvrU Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c54b915fcdcc484fb153bad8d1cdfe82 Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1624058900 Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:53:21.800569 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c54b915fcdcc484fb153bad8d1cdfe82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c54b915fcdcc484fb153bad8d1cdfe82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c54b915fcdcc484fb153bad8d1cdfe82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c54b915fcdcc484fb153bad8d1cdfe82"}]}] Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AZAdminNegativeTestJSON-1624058900 Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c54b915fcdcc484fb153bad8d1cdfe82 Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1624058900 Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AZAdminNegativeTestJSON-1624058900-project Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d7b0bab9e6f44325a1951435461add48 Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AZAdminNegativeTestJSON-1624058900-project Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 13:53:21.802901 n-d-844627-10 devstack@n-api.service[130960]: action_args: {} Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:21.803518 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:21.805262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-417596d1-f9e6-4c35-9e51-b59fdccd3791 tempest-AZAdminNegativeTestJSON-1624058900 tempest-AZAdminNegativeTestJSON-1624058900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:21.806950 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-417596d1-f9e6-4c35-9e51-b59fdccd3791 tempest-AZAdminNegativeTestJSON-1624058900 tempest-AZAdminNegativeTestJSON-1624058900-project] 10.222.0.66 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.578527 Aug 04 13:53:21.817548 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1185 bytes} [Thu Aug 4 13:53:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 586 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:53:22.526598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4fcb5bd6-d83d-4555-b74d-d7172fc7ac2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '.version_select at 0x7f470361cf70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:22.527338 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:22.527338 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:22.547536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4fcb5bd6-d83d-4555-b74d-d7172fc7ac2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) {{(pid=130960) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 13:53:22.561350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fcb5bd6-d83d-4555-b74d-d7172fc7ac2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:22.562496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fcb5bd6-d83d-4555-b74d-d7172fc7ac2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:22.643474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fcb5bd6-d83d-4555-b74d-d7172fc7ac2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:22.645254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fcb5bd6-d83d-4555-b74d-d7172fc7ac2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:22.681702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fcb5bd6-d83d-4555-b74d-d7172fc7ac2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:22.682381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fcb5bd6-d83d-4555-b74d-d7172fc7ac2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:22.691849 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4fcb5bd6-d83d-4555-b74d-d7172fc7ac2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.878743 Aug 04 13:53:22.693600 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1167 bytes} [Thu Aug 4 13:53:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:22.848311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-943049ba-12e5-414e-874e-cb28c3e8b039 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-485332843", "ram": 512, "vcpus": 1, "disk": 10, "id": 1345892778, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:22.890408 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:22.890408 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:22.948295 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-943049ba-12e5-414e-874e-cb28c3e8b039 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.595475 Aug 04 13:53:22.949285 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2/5] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:21 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:23.348525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c25f14f-731e-4b91-b88a-36d873dde029 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Calling method '.version_select at 0x7f4702c8d670>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:23.352886 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:23.352886 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:23.364526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c25f14f-731e-4b91-b88a-36d873dde029 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.364938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c25f14f-731e-4b91-b88a-36d873dde029 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.401475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c25f14f-731e-4b91-b88a-36d873dde029 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.401924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c25f14f-731e-4b91-b88a-36d873dde029 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.413812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c25f14f-731e-4b91-b88a-36d873dde029 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.414193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c25f14f-731e-4b91-b88a-36d873dde029 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.423648 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c25f14f-731e-4b91-b88a-36d873dde029 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.728733 Aug 04 13:53:23.424763 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 4/6] 10.222.0.66 () {60 vars in 1208 bytes} [Thu Aug 4 13:53:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:53:23.430087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-46fa1a17-893e-48da-bca6-4034c09f34b3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-390818974", "name": "tempest-test_aggregate-1456339708"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:23.468454 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:23.468454 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:23.469857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.aggregate [None req-46fa1a17-893e-48da-bca6-4034c09f34b3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Generated uuid 2e5d930d-c79a-4700-ad4c-29e51c0e4d27 for aggregate {{(pid=130960) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:53:23.540172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ced1ae36-eb8a-4e91-8e3f-01dc93365864 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Calling method '.version_select at 0x7f4702dbb700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:23.545686 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:23.545686 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:23.550503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ced1ae36-eb8a-4e91-8e3f-01dc93365864 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.552619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ced1ae36-eb8a-4e91-8e3f-01dc93365864 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.553683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ced1ae36-eb8a-4e91-8e3f-01dc93365864 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.560822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ced1ae36-eb8a-4e91-8e3f-01dc93365864 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.610308 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-46fa1a17-893e-48da-bca6-4034c09f34b3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.183620 Aug 04 13:53:23.611186 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 5/7] 10.222.0.66 () {60 vars in 1165 bytes} [Thu Aug 4 13:53:23 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:23.621584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62eb99d1-88ca-439e-b253-0adc7a2a6c1f tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:23.625778 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ced1ae36-eb8a-4e91-8e3f-01dc93365864 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.675054 Aug 04 13:53:23.625968 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:23.625968 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:23.626806 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3/8] 10.222.0.66 () {58 vars in 1128 bytes} [Thu Aug 4 13:53:22 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:23.639883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a2c8d51-777b-4d7c-a6e6-bc8ce9fbf585 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:23.640952 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:23.640952 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:23.656385 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a2c8d51-777b-4d7c-a6e6-bc8ce9fbf585 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.019899 Aug 04 13:53:23.664147 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 4/9] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 13:53:23 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:23.669326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8b15e9f-0972-460c-8198-19bf242d1d80 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Calling method '.version_select at 0x7f4702dbb820>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:23.672127 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:23.672127 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:23.673581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8b15e9f-0972-460c-8198-19bf242d1d80 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.674231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8b15e9f-0972-460c-8198-19bf242d1d80 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.675326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8b15e9f-0972-460c-8198-19bf242d1d80 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.676113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8b15e9f-0972-460c-8198-19bf242d1d80 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.717999 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e8b15e9f-0972-460c-8198-19bf242d1d80 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.052638 Aug 04 13:53:23.731581 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 5/10] 10.222.0.66 () {58 vars in 1139 bytes} [Thu Aug 4 13:53:23 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:23.746592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3e6961b-4027-4f81-b08c-8272bb0500f3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:23.749643 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:23.749643 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:23.753107 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62eb99d1-88ca-439e-b253-0adc7a2a6c1f tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/1345892778/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.135987 Aug 04 13:53:23.759421 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 6/11] 10.222.0.66 () {60 vars in 1224 bytes} [Thu Aug 4 13:53:23 2022] POST /compute/v2.1/flavors/1345892778/os-extra_specs => generated 66 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:23.771355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-31c98880-4fb9-4b66-92f4-fc1bf83a8441 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Calling method '.version_select at 0x7f47023b03a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:23.775098 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:23.775098 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:23.777045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31c98880-4fb9-4b66-92f4-fc1bf83a8441 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.778071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31c98880-4fb9-4b66-92f4-fc1bf83a8441 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.779490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31c98880-4fb9-4b66-92f4-fc1bf83a8441 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.780936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31c98880-4fb9-4b66-92f4-fc1bf83a8441 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.816775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3e6961b-4027-4f81-b08c-8272bb0500f3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:23.817783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3e6961b-4027-4f81-b08c-8272bb0500f3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:23.819693 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-31c98880-4fb9-4b66-92f4-fc1bf83a8441 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.059112 Aug 04 13:53:23.820979 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 7/12] 10.222.0.66 () {58 vars in 1145 bytes} [Thu Aug 4 13:53:23 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:24.084121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a92fc62d-1918-4bf4-882c-03b1caab4e0d tempest-FlavorsExtraSpecsTestJSON-2135268429 tempest-FlavorsExtraSpecsTestJSON-2135268429-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:24.103078 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a92fc62d-1918-4bf4-882c-03b1caab4e0d tempest-FlavorsExtraSpecsTestJSON-2135268429 tempest-FlavorsExtraSpecsTestJSON-2135268429-project] 10.222.0.66 "GET /compute/v2.1/flavors/1345892778/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.280812 Aug 04 13:53:24.111576 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 8/13] 10.222.0.66 () {58 vars in 1203 bytes} [Thu Aug 4 13:53:23 2022] GET /compute/v2.1/flavors/1345892778/os-extra_specs => generated 66 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:24.119771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18fc20cc-9c40-4bb0-bd08-4989e90853a7 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:24.123574 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:24.123574 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:24.151770 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18fc20cc-9c40-4bb0-bd08-4989e90853a7 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/1345892778/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035985 Aug 04 13:53:24.152434 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 9/14] 10.222.0.66 () {60 vars in 1224 bytes} [Thu Aug 4 13:53:24 2022] POST /compute/v2.1/flavors/1345892778/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:24.166629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-861af7bd-1c90-4d04-b5f4-bfa44fdb0117 tempest-FlavorsExtraSpecsTestJSON-2135268429 tempest-FlavorsExtraSpecsTestJSON-2135268429-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:24.183982 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-861af7bd-1c90-4d04-b5f4-bfa44fdb0117 tempest-FlavorsExtraSpecsTestJSON-2135268429 tempest-FlavorsExtraSpecsTestJSON-2135268429-project] 10.222.0.66 "GET /compute/v2.1/flavors/1345892778/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.024443 Aug 04 13:53:24.187888 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 10/15] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 13:53:24 2022] GET /compute/v2.1/flavors/1345892778/os-extra_specs/hw:numa_nodes => generated 22 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:24.203226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4177dc3a-e28a-4cbd-af5f-a222be890507 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:24.245754 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4177dc3a-e28a-4cbd-af5f-a222be890507 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/1345892778/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048918 Aug 04 13:53:24.247019 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 11/16] 10.222.0.66 () {60 vars in 1224 bytes} [Thu Aug 4 13:53:24 2022] POST /compute/v2.1/flavors/1345892778/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:24.258350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6db92dce-536a-4655-b170-5b586b093ecb tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:24.267632 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6db92dce-536a-4655-b170-5b586b093ecb tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/1345892778/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014367 Aug 04 13:53:24.268912 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 12/17] 10.222.0.66 () {58 vars in 1203 bytes} [Thu Aug 4 13:53:24 2022] GET /compute/v2.1/flavors/1345892778/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:24.278416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e68f55f6-6772-4301-b7d0-f7497a80d2ab tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:24.281119 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:24.281119 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:24.321136 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e68f55f6-6772-4301-b7d0-f7497a80d2ab tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/1345892778/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.046909 Aug 04 13:53:24.326755 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 13/18] 10.222.0.66 () {60 vars in 1265 bytes} [Thu Aug 4 13:53:24 2022] PUT /compute/v2.1/flavors/1345892778/os-extra_specs/hw:numa_nodes => generated 22 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:53:24.332166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bcfa1e88-43dc-4c5d-96ae-2582880acb85 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:24.343379 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bcfa1e88-43dc-4c5d-96ae-2582880acb85 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/1345892778/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015020 Aug 04 13:53:24.344083 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 14/19] 10.222.0.66 () {58 vars in 1203 bytes} [Thu Aug 4 13:53:24 2022] GET /compute/v2.1/flavors/1345892778/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:24.355181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-69fdc0fd-1da1-450e-9a46-b5eaad3f4ba4 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:24.356070 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:24.356070 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:24.393858 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-69fdc0fd-1da1-450e-9a46-b5eaad3f4ba4 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1345892778/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.042938 Aug 04 13:53:24.395555 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 15/20] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 13:53:24 2022] DELETE /compute/v2.1/flavors/1345892778/os-extra_specs/hw:numa_nodes => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:53:24.405477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b5fd57b5-f3e5-48fa-9b07-d6a87a511b34 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:24.457566 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b5fd57b5-f3e5-48fa-9b07-d6a87a511b34 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1345892778/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.048979 Aug 04 13:53:24.459741 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 16/21] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 13:53:24 2022] DELETE /compute/v2.1/flavors/1345892778/os-extra_specs/hw:cpu_policy => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:53:24.475049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-39ebfb5e-5380-4596-8ae6-b1eefa30914d tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:24.497001 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-39ebfb5e-5380-4596-8ae6-b1eefa30914d tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/1345892778/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031674 Aug 04 13:53:24.498801 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 17/22] 10.222.0.66 () {58 vars in 1203 bytes} [Thu Aug 4 13:53:24 2022] GET /compute/v2.1/flavors/1345892778/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:24.515787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-72690417-d9af-4624-b8d6-795937dcc867 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:24.517548 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:24.517548 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:24.550328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:24.582389 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-72690417-d9af-4624-b8d6-795937dcc867 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1345892778" status: 202 len: 0 microversion: 2.1 time: 0.075429 Aug 04 13:53:24.584167 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 18/23] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:53:24 2022] DELETE /compute/v2.1/flavors/1345892778 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:53:24.597417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2da1590b-26e1-4986-8b00-63baf89f1919 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:24.639685 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2da1590b-26e1-4986-8b00-63baf89f1919 tempest-FlavorsExtraSpecsTestJSON-1355490322 tempest-FlavorsExtraSpecsTestJSON-1355490322-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050104 Aug 04 13:53:24.641362 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 19/24] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:26.125434 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c3e6961b-4027-4f81-b08c-8272bb0500f3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 2.390861 Aug 04 13:53:26.127323 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 6/25] 10.222.0.66 () {60 vars in 1191 bytes} [Thu Aug 4 13:53:23 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 2395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:27.037570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1030002646", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "availability_zone": "tempest-test_az-390818974"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:27.087988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:27.088945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:27.092838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:27.095339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:28.708167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:53:29.251650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:53:29.252316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:53:29.253082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:53:29.253633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:53:29.254183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:53:29.290658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:29.292005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:29.294326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:29.294923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:29.386162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Getting quotas for project 2e9804746bd04ab4a79fb9e54e805f60. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:53:29.407642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Getting quotas for user 0ad0fed28b4f40b49915d01ded853db9 and project 2e9804746bd04ab4a79fb9e54e805f60. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:53:29.445657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:53:29.452640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:53:29.619670 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d7b4592c-d946-42e1-9c40-4c3f5cadbd09 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.177565 Aug 04 13:53:29.624313 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 20/26] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:53:29.634371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-db00c49a-f1e3-4dbd-9cbb-dc26b641d605 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:29.635661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-db00c49a-f1e3-4dbd-9cbb-dc26b641d605 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:31.062383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-db00c49a-f1e3-4dbd-9cbb-dc26b641d605 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:31.093045 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-db00c49a-f1e3-4dbd-9cbb-dc26b641d605 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1242 microversion: 2.1 time: 1.464651 Aug 04 13:53:31.094395 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 7/27] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:29 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1242 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:31.914776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7413dcfc-7db9-4a39-b567-1468981a3226 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1958255331", "id": 324555905, "os-flavor-access:is_public": "False"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:31.919395 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:31.919395 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:31.956743 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7413dcfc-7db9-4a39-b567-1468981a3226 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.751234 Aug 04 13:53:31.959241 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 21/28] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:31 2022] POST /compute/v2.1/flavors => generated 436 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:31.989726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-edce6337-a922-46fb-b52c-60abfbdbb480 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:31.998565 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:31.998565 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:32.346521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-28a6d69b-06c6-4e05-90ef-9025fd9549b9 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1351772562", "id": 1422282581, "os-flavor-access:is_public": "False"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:32.350522 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:32.350522 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:32.393695 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-28a6d69b-06c6-4e05-90ef-9025fd9549b9 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.585525 Aug 04 13:53:32.394875 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 8/29] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:31 2022] POST /compute/v2.1/flavors => generated 431 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:53:32.401627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64a5ca80-f6cb-4b1a-b605-760cd2ad5896 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:32.403185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-64a5ca80-f6cb-4b1a-b605-760cd2ad5896 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:32.412773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64a5ca80-f6cb-4b1a-b605-760cd2ad5896 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:32.413561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64a5ca80-f6cb-4b1a-b605-760cd2ad5896 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:32.414592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64a5ca80-f6cb-4b1a-b605-760cd2ad5896 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:32.415926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64a5ca80-f6cb-4b1a-b605-760cd2ad5896 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:32.623524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-64a5ca80-f6cb-4b1a-b605-760cd2ad5896 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:32.649594 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-64a5ca80-f6cb-4b1a-b605-760cd2ad5896 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1290 microversion: 2.1 time: 0.252883 Aug 04 13:53:32.652215 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 9/30] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:32 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1290 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:32.751390 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-edce6337-a922-46fb-b52c-60abfbdbb480 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/324555905/action" status: 200 len: 96 microversion: 2.1 time: 0.774009 Aug 04 13:53:32.754498 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 22/31] 10.222.0.66 () {60 vars in 1197 bytes} [Thu Aug 4 13:53:31 2022] POST /compute/v2.1/flavors/324555905/action => generated 96 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:53:32.764784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3ceb7602-863e-4090-937a-59cb726bde8d tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "59b11a202d314c278710717abaf8e520"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:33.196699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-77996cbb-cff4-4da4-81d4-7cf4e5e6b9ef tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:33.236383 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-77996cbb-cff4-4da4-81d4-7cf4e5e6b9ef tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.582747 Aug 04 13:53:33.237248 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 10/32] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:53:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:33.251891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ede95955-fbff-47e1-b8cd-ccc41d2586da tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:33.255603 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:33.255603 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:33.321331 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3ceb7602-863e-4090-937a-59cb726bde8d tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/1422282581/action" status: 200 len: 97 microversion: 2.1 time: 0.563603 Aug 04 13:53:33.322278 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 23/33] 10.222.0.66 () {60 vars in 1200 bytes} [Thu Aug 4 13:53:32 2022] POST /compute/v2.1/flavors/1422282581/action => generated 97 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:33.580077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-05cf19d2-fece-45f1-8e27-4ba50a8de057 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Calling method '.version_select at 0x7f4701251700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:33.692400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:33.708734 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-ede95955-fbff-47e1-b8cd-ccc41d2586da tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 0ec8be8e906a4ff69ecad6d43d690955 combination. Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ede95955-fbff-47e1-b8cd-ccc41d2586da tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Request method failure captured: Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/flavors/324555905/action HTTP/1.1 Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 67 Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689YZjAFCpRLVGzKDSskuT93BfZJgAs7aMKSQhjGpnCpD9BWJNaREWCgnFQyuZsUfuaxQN3oOFIZiP0eb3g-XApACymo5jDQ0tvPOk5G-gX0GtoQRDDCGOK5EGh3MbabUkK7BjTamyAsxIcvflpm68KQBQZMqVcoFqofd4v3pXTpzbY Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: baaa7de6855e4945bc5f2a896605adc9 Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-16611529 Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:53:33.731223 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/baaa7de6855e4945bc5f2a896605adc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_baaa7de6855e4945bc5f2a896605adc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/baaa7de6855e4945bc5f2a896605adc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/baaa7de6855e4945bc5f2a896605adc9"}]}] Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-16611529 Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: baaa7de6855e4945bc5f2a896605adc9 Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-16611529 Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: a8a0ac00d8254ca1a45e6b013909ede9 Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: {"addTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} Aug 04 13:53:33.732404 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: exception: Flavor access already exists for flavor 16 and project 0ec8be8e906a4ff69ecad6d43d690955 combination. Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '324555905', 'body': {'addTenantAccess': {'tenant': '0ec8be8e906a4ff69ecad6d43d690955'}}} Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result.read() Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 13:53:33.733043 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-0ec8be8e906a4ff69ecad6d43d690955' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 13:53:33.733912 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 13:53:33.735344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 13:53:33.736344 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result.read() Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-0ec8be8e906a4ff69ecad6d43d690955' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 13, 53, 33, 699741), 'updated_at': None, 'flavor_id': 16, 'project_id': '0ec8be8e906a4ff69ecad6d43d690955'}] Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:33.737273 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 0ec8be8e906a4ff69ecad6d43d690955 combination. Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:33.738164 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 0ec8be8e906a4ff69ecad6d43d690955 combination. Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:53:33.739685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:53:33.740757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 0ec8be8e906a4ff69ecad6d43d690955 combination. Aug 04 13:53:33.740757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:33.740757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ede95955-fbff-47e1-b8cd-ccc41d2586da tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 0ec8be8e906a4ff69ecad6d43d690955 combination. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:33.740757 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ede95955-fbff-47e1-b8cd-ccc41d2586da tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/324555905/action" status: 409 len: 152 microversion: 2.1 time: 0.491962 Aug 04 13:53:33.740757 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 11/34] 10.222.0.66 () {60 vars in 1197 bytes} [Thu Aug 4 13:53:33 2022] POST /compute/v2.1/flavors/324555905/action => generated 152 bytes in 500 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:53:34.062186 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-05cf19d2-fece-45f1-8e27-4ba50a8de057 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/e32a8da0feb944fa856c71d506d67bfc" status: 200 len: 371 microversion: 2.1 time: 0.738324 Aug 04 13:53:34.063944 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 24/35] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 13:53:33 2022] GET /compute/v2.1/os-quota-sets/e32a8da0feb944fa856c71d506d67bfc => generated 371 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:34.306995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a681a43b-21be-43f0-926e-35567dbc6394 tempest-FlavorsAccessTestJSON-765914000 tempest-FlavorsAccessTestJSON-765914000-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:34.328000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4b43d48-d074-495f-bc94-2a4b75725385 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2085990947", "id": 492327838, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:34.338891 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:34.338891 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:34.361784 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a681a43b-21be-43f0-926e-35567dbc6394 tempest-FlavorsAccessTestJSON-765914000 tempest-FlavorsAccessTestJSON-765914000-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.294903 Aug 04 13:53:34.362993 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 25/36] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:34 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:34.365240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4b43d48-d074-495f-bc94-2a4b75725385 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.625460 Aug 04 13:53:34.368399 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 12/37] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:33 2022] POST /compute/v2.1/flavors => generated 422 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:34.370166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-87fe4b7e-ace9-4c21-8725-94646a81e549 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:34.371120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-87fe4b7e-ace9-4c21-8725-94646a81e549 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:34.382889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0b6903df-d867-4d3d-952b-99a63c601cb0 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:34.385998 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:34.385998 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:34.388026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87fe4b7e-ace9-4c21-8725-94646a81e549 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:34.388485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87fe4b7e-ace9-4c21-8725-94646a81e549 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:34.389297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87fe4b7e-ace9-4c21-8725-94646a81e549 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:34.389951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87fe4b7e-ace9-4c21-8725-94646a81e549 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:34.743631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-87fe4b7e-ace9-4c21-8725-94646a81e549 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:34.781663 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-87fe4b7e-ace9-4c21-8725-94646a81e549 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.415576 Aug 04 13:53:34.803817 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 26/38] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:34 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:34.836438 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0b6903df-d867-4d3d-952b-99a63c601cb0 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/324555905/action" status: 200 len: 21 microversion: 2.1 time: 0.466019 Aug 04 13:53:34.845240 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 13/39] 10.222.0.66 () {60 vars in 1197 bytes} [Thu Aug 4 13:53:34 2022] POST /compute/v2.1/flavors/324555905/action => generated 21 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:34.869404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a90d823-b546-46e8-a2ca-f6eac5845476 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Action: 'update', calling method: .version_select at 0x7f470103b160>, body: {"quota_set": {"ram": "5120"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:34.959550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62b55fe1-df41-40ad-a8d4-699d8b701736 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Calling method '.version_select at 0x7f4701332940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:34.960620 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:34.960620 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:34.962602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b55fe1-df41-40ad-a8d4-699d8b701736 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:34.964036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b55fe1-df41-40ad-a8d4-699d8b701736 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.002544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a90d823-b546-46e8-a2ca-f6eac5845476 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.002928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a90d823-b546-46e8-a2ca-f6eac5845476 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.003757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a90d823-b546-46e8-a2ca-f6eac5845476 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.004309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a90d823-b546-46e8-a2ca-f6eac5845476 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.018247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b55fe1-df41-40ad-a8d4-699d8b701736 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.018780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b55fe1-df41-40ad-a8d4-699d8b701736 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.048144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b55fe1-df41-40ad-a8d4-699d8b701736 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.048641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b55fe1-df41-40ad-a8d4-699d8b701736 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.066820 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62b55fe1-df41-40ad-a8d4-699d8b701736 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.261555 Aug 04 13:53:35.071216 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 27/40] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:35.076980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1bcebcf2-2cd7-48f6-bc05-67f6fd0f0ca8 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.093407 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1bcebcf2-2cd7-48f6-bc05-67f6fd0f0ca8 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020710 Aug 04 13:53:35.095207 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 28/41] 10.222.0.66 () {58 vars in 1182 bytes} [Thu Aug 4 13:53:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:35.102128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1e9f841e-024c-4eae-9062-754b7ad58261 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "59b11a202d314c278710717abaf8e520"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:35.105830 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:35.105830 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:35.125555 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a90d823-b546-46e8-a2ca-f6eac5845476 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/e32a8da0feb944fa856c71d506d67bfc" status: 200 len: 328 microversion: 2.1 time: 0.273198 Aug 04 13:53:35.126190 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 14/42] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 13:53:34 2022] PUT /compute/v2.1/os-quota-sets/e32a8da0feb944fa856c71d506d67bfc => generated 328 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:35.139017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-845c8082-6dd7-463d-afa3-faeb23e6844a tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.139712 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:35.139712 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:35.199815 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-845c8082-6dd7-463d-afa3-faeb23e6844a tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/324555905" status: 202 len: 0 microversion: 2.1 time: 0.064517 Aug 04 13:53:35.201263 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 15/43] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:53:35 2022] DELETE /compute/v2.1/flavors/324555905 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:53:35.210305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-63d89da5-a8f1-463d-91d0-ecfea3b05054 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Calling method '.version_select at 0x7f4700fc8f70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.211574 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:35.211574 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:35.220928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-63d89da5-a8f1-463d-91d0-ecfea3b05054 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) {{(pid=130961) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 13:53:35.221767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63d89da5-a8f1-463d-91d0-ecfea3b05054 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.222214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63d89da5-a8f1-463d-91d0-ecfea3b05054 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.284362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63d89da5-a8f1-463d-91d0-ecfea3b05054 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.285234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63d89da5-a8f1-463d-91d0-ecfea3b05054 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.374921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63d89da5-a8f1-463d-91d0-ecfea3b05054 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.376255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63d89da5-a8f1-463d-91d0-ecfea3b05054 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.387457 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-63d89da5-a8f1-463d-91d0-ecfea3b05054 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/n-h2-844627-10/servers" status: 200 len: 197 microversion: 2.1 time: 0.184919 Aug 04 13:53:35.388653 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 16/44] 10.222.0.66 () {58 vars in 1215 bytes} [Thu Aug 4 13:53:35 2022] GET /compute/v2.1/os-hypervisors/n-h2-844627-10/servers => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:35.405967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7832e56c-eb43-41f1-91a2-dde9c5a7ef84 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1682856824", "id": 618218615, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:35.409807 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:35.409807 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:35.441143 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7832e56c-eb43-41f1-91a2-dde9c5a7ef84 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.051083 Aug 04 13:53:35.442794 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 17/45] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:35 2022] POST /compute/v2.1/flavors => generated 422 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:35.447542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9b348b79-a771-4e5a-baa9-7ab15ab8dbec tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.475363 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9b348b79-a771-4e5a-baa9-7ab15ab8dbec tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-quota-sets/e32a8da0feb944fa856c71d506d67bfc" status: 202 len: 0 microversion: 2.1 time: 0.031203 Aug 04 13:53:35.476242 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 18/46] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 13:53:35 2022] DELETE /compute/v2.1/os-quota-sets/e32a8da0feb944fa856c71d506d67bfc => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:53:35.485248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d59bcc4-1d09-47e4-a00b-1a09b5111409 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.500450 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1e9f841e-024c-4eae-9062-754b7ad58261 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/1422282581/action" status: 200 len: 21 microversion: 2.1 time: 0.403935 Aug 04 13:53:35.514012 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 29/47] 10.222.0.66 () {60 vars in 1200 bytes} [Thu Aug 4 13:53:35 2022] POST /compute/v2.1/flavors/1422282581/action => generated 21 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:35.526023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1f85b20-c83d-4b80-bce2-b56af919b498 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Calling method '.version_select at 0x7f47011bbe50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.530141 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:35.530141 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:35.531696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f85b20-c83d-4b80-bce2-b56af919b498 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.532148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f85b20-c83d-4b80-bce2-b56af919b498 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.548579 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d59bcc4-1d09-47e4-a00b-1a09b5111409 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.070873 Aug 04 13:53:35.554146 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 19/48] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:35 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:35.558877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-92b3f9fe-cdb5-4f00-9326-eb3cd578b1c2 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.577322 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-92b3f9fe-cdb5-4f00-9326-eb3cd578b1c2 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021868 Aug 04 13:53:35.583485 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 20/49] 10.222.0.66 () {58 vars in 1182 bytes} [Thu Aug 4 13:53:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:35.592614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac0225a8-1e0b-4ab9-ad1c-5a9cdde1d46b tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Calling method '.version_select at 0x7f4700f10550>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.596938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f85b20-c83d-4b80-bce2-b56af919b498 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.599344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f85b20-c83d-4b80-bce2-b56af919b498 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.646223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f85b20-c83d-4b80-bce2-b56af919b498 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.646716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f85b20-c83d-4b80-bce2-b56af919b498 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.671320 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1f85b20-c83d-4b80-bce2-b56af919b498 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.155755 Aug 04 13:53:35.684215 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 30/50] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:35 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:35.693678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b728587e-0fd2-4e7b-9a5d-7f05519fee3e tempest-FlavorsAccessTestJSON-765914000 tempest-FlavorsAccessTestJSON-765914000-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.745564 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b728587e-0fd2-4e7b-9a5d-7f05519fee3e tempest-FlavorsAccessTestJSON-765914000 tempest-FlavorsAccessTestJSON-765914000-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.060017 Aug 04 13:53:35.755462 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 31/51] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:35 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:35.755665 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac0225a8-1e0b-4ab9-ad1c-5a9cdde1d46b tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/e32a8da0feb944fa856c71d506d67bfc" status: 200 len: 371 microversion: 2.1 time: 0.161049 Aug 04 13:53:35.755665 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 21/52] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 13:53:35 2022] GET /compute/v2.1/os-quota-sets/e32a8da0feb944fa856c71d506d67bfc => generated 371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:35.763469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3b9cfb0d-a3d1-4848-aaf9-232129f11137 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-307435513", "id": 1285924309, "os-flavor-access:is_public": "True"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:35.763669 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:35.763669 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:35.765325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-834c88f9-29f8-4916-a299-6a03d9fa1a95 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Action: 'create', calling method: .version_select at 0x7f4700f17700>, body: {"keypair": {"name": "tempest-keypair-1562324001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK90iM60ZaDyKQe9GPrOF2u062vsw0HyrbLkad7Z+Ubjd3xtXs8svCI7xEmYHk7ITyR87FYFfGIsPwhNMV8xEX9oMIJhmHmNmv529Rjo++3si9ZgPzBfore3aR8ApSEyhg=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:35.816570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:35.818664 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3b9cfb0d-a3d1-4848-aaf9-232129f11137 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.062042 Aug 04 13:53:35.829182 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 32/53] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:35 2022] POST /compute/v2.1/flavors => generated 437 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:35.842185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9a69b24-87bb-419b-9676-52ed55c95af0 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Calling method '.version_select at 0x7f47011bbd30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.843047 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:35.843047 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:35.852800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9a69b24-87bb-419b-9676-52ed55c95af0 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.853279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9a69b24-87bb-419b-9676-52ed55c95af0 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.855366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-834c88f9-29f8-4916-a299-6a03d9fa1a95 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Getting quotas for project dc689abcb1e94127aa8838ecb76ea9d9. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:53:35.874998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-834c88f9-29f8-4916-a299-6a03d9fa1a95 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Getting quotas for user 3bb6f86c5d0642f689d50d86dd8ec82e and project dc689abcb1e94127aa8838ecb76ea9d9. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:53:35.924667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9a69b24-87bb-419b-9676-52ed55c95af0 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.925522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9a69b24-87bb-419b-9676-52ed55c95af0 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.943955 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a9a69b24-87bb-419b-9676-52ed55c95af0 tempest-HypervisorAdminUnderV252Test-1422556651 tempest-HypervisorAdminUnderV252Test-1422556651-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/n-h2-844627-10/search" status: 200 len: 105 microversion: 2.1 time: 0.113581 Aug 04 13:53:35.946407 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-834c88f9-29f8-4916-a299-6a03d9fa1a95 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.195140 Aug 04 13:53:35.947002 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 22/54] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:53:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:35.947735 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 33/55] 10.222.0.66 () {58 vars in 1212 bytes} [Thu Aug 4 13:53:35 2022] GET /compute/v2.1/os-hypervisors/n-h2-844627-10/search => generated 105 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:35.963022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba8c1f40-181b-47ef-ac96-b0ee6caf404e tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.964324 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:35.964324 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:35.967028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-53fb435c-8770-4d87-ad69-a4b2f03d32ed tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:35.969482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-53fb435c-8770-4d87-ad69-a4b2f03d32ed tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:35.994349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53fb435c-8770-4d87-ad69-a4b2f03d32ed tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.995121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53fb435c-8770-4d87-ad69-a4b2f03d32ed tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:35.996186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53fb435c-8770-4d87-ad69-a4b2f03d32ed tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:35.998544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53fb435c-8770-4d87-ad69-a4b2f03d32ed tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:36.044908 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba8c1f40-181b-47ef-ac96-b0ee6caf404e tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1422282581" status: 202 len: 0 microversion: 2.1 time: 0.095152 Aug 04 13:53:36.052575 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 34/56] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:53:35 2022] DELETE /compute/v2.1/flavors/1422282581 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:53:36.063567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ffdf1fd-ea25-4017-87d2-687d3f620f35 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:36.065682 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:36.065682 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:36.081407 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7ffdf1fd-ea25-4017-87d2-687d3f620f35 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ffdf1fd-ea25-4017-87d2-687d3f620f35 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Request method failure captured: Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/flavors/1285924309/os-flavor-access HTTP/1.1 Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689YZjAFCpRLVGzKDSskuT93BfZJgAs7aMKSQhjGpnCpD9BWJNaREWCgnFQyuZsUfuaxQN3oOFIZiP0eb3g-XApACymo5jDQ0tvPOk5G-gX0GtoQRDDCGOK5EGh3MbabUkK7BjTamyAsxIcvflpm68KQBQZMqVcoFqofd4v3pXTpzbY Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: baaa7de6855e4945bc5f2a896605adc9 Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-16611529 Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:53:36.086589 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/baaa7de6855e4945bc5f2a896605adc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_baaa7de6855e4945bc5f2a896605adc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/baaa7de6855e4945bc5f2a896605adc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/baaa7de6855e4945bc5f2a896605adc9"}]}] Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-16611529 Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: baaa7de6855e4945bc5f2a896605adc9 Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-16611529 Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a8a0ac00d8254ca1a45e6b013909ede9 Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: exception: Access list not available for public flavors. Aug 04 13:53:36.088262 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'flavor_id': '1285924309'} Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 04 13:53:36.089273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:36.092344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ffdf1fd-ea25-4017-87d2-687d3f620f35 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:36.093835 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ffdf1fd-ea25-4017-87d2-687d3f620f35 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/1285924309/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.039821 Aug 04 13:53:36.098702 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 35/57] 10.222.0.66 () {58 vars in 1209 bytes} [Thu Aug 4 13:53:36 2022] GET /compute/v2.1/flavors/1285924309/os-flavor-access => generated 91 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:53:36.105974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc51c429-f93c-4a08-b3bf-566878e25f2b tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:36.190549 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc51c429-f93c-4a08-b3bf-566878e25f2b tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6242 microversion: 2.1 time: 0.093451 Aug 04 13:53:36.191871 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 36/58] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:36 2022] GET /compute/v2.1/flavors/detail => generated 6242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:36.195936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-92b2918a-1495-4899-b4a8-64cc9a8d942e tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:36.243747 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-92b2918a-1495-4899-b4a8-64cc9a8d942e tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1285924309" status: 202 len: 0 microversion: 2.1 time: 0.050882 Aug 04 13:53:36.245310 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 37/59] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:53:36 2022] DELETE /compute/v2.1/flavors/1285924309 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:53:36.264743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dafe0ecf-7c63-4e9f-aeba-53fe8e60a8fc tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Calling method '.version_select at 0x7f47011bb550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:36.770014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-53fb435c-8770-4d87-ad69-a4b2f03d32ed tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:36.779736 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-53fb435c-8770-4d87-ad69-a4b2f03d32ed tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.827804 Aug 04 13:53:36.794806 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 23/60] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:35 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:36.800445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf22e05b-ddbc-4e5d-b498-aff6c043e774 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1652286152", "id": 1146547819, "os-flavor-access:is_public": "False"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:36.808782 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:36.808782 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:36.864840 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf22e05b-ddbc-4e5d-b498-aff6c043e774 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.065684 Aug 04 13:53:36.865865 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 24/61] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:36 2022] POST /compute/v2.1/flavors => generated 431 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:36.880261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-273145fb-65da-480c-9836-70ecad951947 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:36.963522 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-273145fb-65da-480c-9836-70ecad951947 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.090497 Aug 04 13:53:36.964273 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 25/62] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:36 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:36.981543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e75afa2e-cc48-42b6-b72c-5f5778853b46 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:36.989644 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:36.989644 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:37.000629 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dafe0ecf-7c63-4e9f-aeba-53fe8e60a8fc tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/bebbefeaf94c4300b678f317806c9144/defaults" status: 200 len: 371 microversion: 2.1 time: 0.752235 Aug 04 13:53:37.006459 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 38/63] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 13:53:36 2022] GET /compute/v2.1/os-quota-sets/bebbefeaf94c4300b678f317806c9144/defaults => generated 371 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:37.034370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a55b0cd7-4c6e-4317-9987-8975a89d4b12 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-293961615", "id": 1557223988, "os-flavor-access:is_public": "False"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:37.048302 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:37.048302 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:37.060611 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e75afa2e-cc48-42b6-b72c-5f5778853b46 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/1146547819/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.092354 Aug 04 13:53:37.063666 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 26/64] 10.222.0.66 () {58 vars in 1209 bytes} [Thu Aug 4 13:53:36 2022] GET /compute/v2.1/flavors/1146547819/os-flavor-access => generated 21 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:37.083745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-73bcf367-7cc0-4ec4-8ec1-dc1cca4f1063 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:37.088258 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:37.088258 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:37.095972 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a55b0cd7-4c6e-4317-9987-8975a89d4b12 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.088157 Aug 04 13:53:37.100099 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 39/65] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:37 2022] POST /compute/v2.1/flavors => generated 438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:37.121850 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-73bcf367-7cc0-4ec4-8ec1-dc1cca4f1063 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1146547819" status: 202 len: 0 microversion: 2.1 time: 0.050503 Aug 04 13:53:37.122967 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 27/66] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:53:37 2022] DELETE /compute/v2.1/flavors/1146547819 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:53:37.131075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-562c3059-3992-4815-8e80-7bdb8ca517a1 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:37.182877 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-562c3059-3992-4815-8e80-7bdb8ca517a1 tempest-FlavorsAccessTestJSON-767936906 tempest-FlavorsAccessTestJSON-767936906-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.055562 Aug 04 13:53:37.199901 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 28/67] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:37 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:37.719866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-201f70a2-99b6-436b-97f8-27836ca2cbad tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:37.722672 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:37.722672 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:37.725974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-201f70a2-99b6-436b-97f8-27836ca2cbad tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'c74a62d43a1f4cbabe62f48845c3dddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec8be8e906a4ff69ecad6d43d690955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-201f70a2-99b6-436b-97f8-27836ca2cbad tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] Request method failure captured: Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/flavors/1557223988/action HTTP/1.1 Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 67 Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689V2v6CtJAs36EevC6dBCm1WeXe89fuYHLTcHMxI_Mbjf9WeUJfo2DtRvTnnWMOtHq52IjRYSIakcQi-f67pdPYk6CdIgMmGl4N_WOW0bCaSlj9lGSQ6d0U9lXTf8TQc9qYyWnLMoUBxEUS08u21VboXDJnOGiy29BLCkcdh6dKkCA Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 0ec8be8e906a4ff69ecad6d43d690955 Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-72322708 Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:53:37.727947 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ec8be8e906a4ff69ecad6d43d690955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ec8be8e906a4ff69ecad6d43d690955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ec8be8e906a4ff69ecad6d43d690955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ec8be8e906a4ff69ecad6d43d690955"}]}] Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-72322708 Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 0ec8be8e906a4ff69ecad6d43d690955 Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-72322708 Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FlavorsAccessNegativeTestJSON-72322708-project Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c74a62d43a1f4cbabe62f48845c3dddf Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-72322708-project Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: {"addTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} Aug 04 13:53:37.729087 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '1557223988', 'body': {'addTenantAccess': {'tenant': '0ec8be8e906a4ff69ecad6d43d690955'}}} Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:37.729722 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 13:53:37.730662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:37.731790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-201f70a2-99b6-436b-97f8-27836ca2cbad tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:37.731790 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-201f70a2-99b6-436b-97f8-27836ca2cbad tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] 10.222.0.66 "POST /compute/v2.1/flavors/1557223988/action" status: 403 len: 130 microversion: 2.1 time: 0.621632 Aug 04 13:53:37.737393 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 40/68] 10.222.0.66 () {60 vars in 1200 bytes} [Thu Aug 4 13:53:37 2022] POST /compute/v2.1/flavors/1557223988/action => generated 130 bytes in 630 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:53:37.738601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3de7468-a533-49c4-9e66-518bf3f389ff tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:37.786821 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3de7468-a533-49c4-9e66-518bf3f389ff tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1557223988" status: 202 len: 0 microversion: 2.1 time: 0.052335 Aug 04 13:53:37.792277 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 29/69] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:53:37 2022] DELETE /compute/v2.1/flavors/1557223988 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:53:37.797546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-97912530-a714-449e-ad9b-6cba97f0632d tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:37.808620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f10ab37-1869-4efc-980a-309e5f007902 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:37.810309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8f10ab37-1869-4efc-980a-309e5f007902 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:37.847884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f10ab37-1869-4efc-980a-309e5f007902 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:37.848733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f10ab37-1869-4efc-980a-309e5f007902 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:37.849972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f10ab37-1869-4efc-980a-309e5f007902 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:37.851426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f10ab37-1869-4efc-980a-309e5f007902 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:37.870128 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-97912530-a714-449e-ad9b-6cba97f0632d tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.077677 Aug 04 13:53:37.871090 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 41/70] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:37 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:37.894049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4e7382ce-eb76-40ab-9dd7-59cab5126078 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1747207086", "id": 925323965, "os-flavor-access:is_public": "False"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:37.917288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=8,nova_api:INSERT=9 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:37.955676 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4e7382ce-eb76-40ab-9dd7-59cab5126078 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.065967 Aug 04 13:53:37.973650 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 42/71] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:37 2022] POST /compute/v2.1/flavors => generated 436 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:53:37.985397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9e8d2c14-51fb-48bd-becb-a1c84c9bee38 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Action: 'update', calling method: .version_select at 0x7f4701167b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:38.167821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e8d2c14-51fb-48bd-becb-a1c84c9bee38 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:38.168453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e8d2c14-51fb-48bd-becb-a1c84c9bee38 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:38.169138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e8d2c14-51fb-48bd-becb-a1c84c9bee38 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:38.169531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e8d2c14-51fb-48bd-becb-a1c84c9bee38 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:38.352423 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9e8d2c14-51fb-48bd-becb-a1c84c9bee38 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/25e7e2a178cd4e2ab5c6d58e69352b6d" status: 200 len: 328 microversion: 2.1 time: 0.373734 Aug 04 13:53:38.355117 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 43/72] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 13:53:37 2022] PUT /compute/v2.1/os-quota-sets/25e7e2a178cd4e2ab5c6d58e69352b6d => generated 328 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:38.381912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df7c7a30-9118-499e-b575-27973d6ca4f4 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:38.679548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8f10ab37-1869-4efc-980a-309e5f007902 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:38.696933 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f10ab37-1869-4efc-980a-309e5f007902 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.888553 Aug 04 13:53:38.698304 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 30/73] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:37 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:38.700294 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df7c7a30-9118-499e-b575-27973d6ca4f4 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/925323965/action" status: 200 len: 96 microversion: 2.1 time: 0.333199 Aug 04 13:53:38.701218 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 44/74] 10.222.0.66 () {60 vars in 1197 bytes} [Thu Aug 4 13:53:38 2022] POST /compute/v2.1/flavors/925323965/action => generated 96 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:38.711395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1f7dca7-4828-4937-8411-538ba8a21d75 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Calling method '.version_select at 0x7f4702cb3940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:38.810941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-59958a01-95af-40c3-a088-984f7668bc31 req-e89a8e27-0594-4d3e-aa33-0d6c32212c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6e7e50-fdd7-4395-ab38-d439c6747103", "tag": "18367270-b495-4f90-90ae-4137701c1b40"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:38.855917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-59958a01-95af-40c3-a088-984f7668bc31 req-e89a8e27-0594-4d3e-aa33-0d6c32212c82 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:38.856405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-59958a01-95af-40c3-a088-984f7668bc31 req-e89a8e27-0594-4d3e-aa33-0d6c32212c82 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:38.885810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f7dca7-4828-4937-8411-538ba8a21d75 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:38.886881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f7dca7-4828-4937-8411-538ba8a21d75 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:38.891746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f7dca7-4828-4937-8411-538ba8a21d75 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:38.892862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f7dca7-4828-4937-8411-538ba8a21d75 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:38.925048 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1f7dca7-4828-4937-8411-538ba8a21d75 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/25e7e2a178cd4e2ab5c6d58e69352b6d/detail" status: 200 len: 916 microversion: 2.1 time: 0.222651 Aug 04 13:53:38.926647 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-59958a01-95af-40c3-a088-984f7668bc31 req-e89a8e27-0594-4d3e-aa33-0d6c32212c82 service nova] Creating event network-changed:18367270-b495-4f90-90ae-4137701c1b40 for instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 on n-h2-844627-10 Aug 04 13:53:38.929751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-59958a01-95af-40c3-a088-984f7668bc31 req-e89a8e27-0594-4d3e-aa33-0d6c32212c82 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:53:38.931008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8b28360-e5ea-453a-8d8c-b6f078a1947e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:38.931459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8b28360-e5ea-453a-8d8c-b6f078a1947e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:38.936945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8b28360-e5ea-453a-8d8c-b6f078a1947e None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:38.937819 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 45/75] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 13:53:38 2022] GET /compute/v2.1/os-quota-sets/25e7e2a178cd4e2ab5c6d58e69352b6d/detail => generated 916 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:38.938254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8b28360-e5ea-453a-8d8c-b6f078a1947e None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:38.945253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2143c2d-ec00-4026-9c34-353d340e87b9 tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:38.948136 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:38.948136 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:38.949391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e2143c2d-ec00-4026-9c34-353d340e87b9 tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'c74a62d43a1f4cbabe62f48845c3dddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec8be8e906a4ff69ecad6d43d690955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2143c2d-ec00-4026-9c34-353d340e87b9 tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] Request method failure captured: Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/flavors/925323965/action HTTP/1.1 Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 70 Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689V2v6CtJAs36EevC6dBCm1WeXe89fuYHLTcHMxI_Mbjf9WeUJfo2DtRvTnnWMOtHq52IjRYSIakcQi-f67pdPYk6CdIgMmGl4N_WOW0bCaSlj9lGSQ6d0U9lXTf8TQc9qYyWnLMoUBxEUS08u21VboXDJnOGiy29BLCkcdh6dKkCA Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 0ec8be8e906a4ff69ecad6d43d690955 Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-72322708 Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:53:38.951233 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ec8be8e906a4ff69ecad6d43d690955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ec8be8e906a4ff69ecad6d43d690955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ec8be8e906a4ff69ecad6d43d690955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ec8be8e906a4ff69ecad6d43d690955"}]}] Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-72322708 Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 0ec8be8e906a4ff69ecad6d43d690955 Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-72322708 Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FlavorsAccessNegativeTestJSON-72322708-project Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c74a62d43a1f4cbabe62f48845c3dddf Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-72322708-project Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: {"removeTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} Aug 04 13:53:38.952322 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '925323965', 'body': {'removeTenantAccess': {'tenant': '0ec8be8e906a4ff69ecad6d43d690955'}}} Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can( Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:38.952983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 13:53:38.953985 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:38.961117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2143c2d-ec00-4026-9c34-353d340e87b9 tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:38.962208 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e2143c2d-ec00-4026-9c34-353d340e87b9 tempest-FlavorsAccessNegativeTestJSON-72322708 tempest-FlavorsAccessNegativeTestJSON-72322708-project] 10.222.0.66 "POST /compute/v2.1/flavors/925323965/action" status: 403 len: 133 microversion: 2.1 time: 0.021757 Aug 04 13:53:38.963320 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 46/76] 10.222.0.66 () {60 vars in 1197 bytes} [Thu Aug 4 13:53:38 2022] POST /compute/v2.1/flavors/925323965/action => generated 133 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:53:38.966421 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.rpcapi [None req-c8b28360-e5ea-453a-8d8c-b6f078a1947e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 13:53:38.967454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8b28360-e5ea-453a-8d8c-b6f078a1947e None None] Releasing lock "compute-rpcapi-router" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:53:38.988518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a88d1cb6-0d99-4af6-b810-c402a06a3d8f tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0ec8be8e906a4ff69ecad6d43d690955"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:39.024105 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c8b28360-e5ea-453a-8d8c-b6f078a1947e None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324318 Aug 04 13:53:39.033207 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 31/77] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:39.134469 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a88d1cb6-0d99-4af6-b810-c402a06a3d8f tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/925323965/action" status: 200 len: 21 microversion: 2.1 time: 0.166444 Aug 04 13:53:39.168027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fced9cf4-63d2-4aa8-944c-e9957e74cfac tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:39.170462 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:39.170462 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:39.173484 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 47/78] 10.222.0.66 () {60 vars in 1197 bytes} [Thu Aug 4 13:53:38 2022] POST /compute/v2.1/flavors/925323965/action => generated 21 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:53:39.197147 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fced9cf4-63d2-4aa8-944c-e9957e74cfac tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/925323965" status: 202 len: 0 microversion: 2.1 time: 0.048437 Aug 04 13:53:39.201399 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 32/79] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:53:39 2022] DELETE /compute/v2.1/flavors/925323965 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:53:39.213723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5b500d1-5067-475f-9094-5d553ef01342 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:39.246145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Action: 'update', calling method: .version_select at 0x7f4700f10b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:39.255029 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5b500d1-5067-475f-9094-5d553ef01342 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.050950 Aug 04 13:53:39.256534 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 48/80] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:39 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:39.284985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e74e760b-b4ce-4458-ada2-4b85fff49f07 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-293886594", "id": 696905935, "os-flavor-access:is_public": "False"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:39.344619 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e74e760b-b4ce-4458-ada2-4b85fff49f07 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.066309 Aug 04 13:53:39.346069 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 49/81] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:39 2022] POST /compute/v2.1/flavors => generated 435 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:39.358270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3771893c-c268-4c4c-b67d-6e612746e885 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "769921b5ba214fb8b7b3a32c88dc1ef7"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:39.473848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:39.474278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:39.483230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:39.484891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:39.492029 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-3771893c-c268-4c4c-b67d-6e612746e885 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] HTTP exception thrown: Flavor access not found for 24 / 769921b5ba214fb8b7b3a32c88dc1ef7 combination. Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3771893c-c268-4c4c-b67d-6e612746e885 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Request method failure captured: Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/flavors/696905935/action HTTP/1.1 Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 70 Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689YZjAFCpRLVGzKDSskuT93BfZJgAs7aMKSQhjGpnCpD9BWJNaREWCgnFQyuZsUfuaxQN3oOFIZiP0eb3g-XApACymo5jDQ0tvPOk5G-gX0GtoQRDDCGOK5EGh3MbabUkK7BjTamyAsxIcvflpm68KQBQZMqVcoFqofd4v3pXTpzbY Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: baaa7de6855e4945bc5f2a896605adc9 Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-16611529 Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:53:39.507689 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/baaa7de6855e4945bc5f2a896605adc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_baaa7de6855e4945bc5f2a896605adc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/baaa7de6855e4945bc5f2a896605adc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/baaa7de6855e4945bc5f2a896605adc9"}]}] Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-16611529 Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: baaa7de6855e4945bc5f2a896605adc9 Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-16611529 Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a8a0ac00d8254ca1a45e6b013909ede9 Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: {"removeTenantAccess": {"tenant": "769921b5ba214fb8b7b3a32c88dc1ef7"}} Aug 04 13:53:39.509229 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: exception: Flavor access not found for 24 / 769921b5ba214fb8b7b3a32c88dc1ef7 combination. Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '696905935', 'body': {'removeTenantAccess': {'tenant': '769921b5ba214fb8b7b3a32c88dc1ef7'}}} Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 04 13:53:39.509993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 769921b5ba214fb8b7b3a32c88dc1ef7 combination. Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 769921b5ba214fb8b7b3a32c88dc1ef7 combination. Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:39.511116 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:39.512299 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:39.512299 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:39.512299 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:53:39.512299 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:53:39.512299 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 769921b5ba214fb8b7b3a32c88dc1ef7 combination. Aug 04 13:53:39.512299 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:39.512299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3771893c-c268-4c4c-b67d-6e612746e885 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Returning 404 to user: Flavor access not found for 24 / 769921b5ba214fb8b7b3a32c88dc1ef7 combination. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:39.512299 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3771893c-c268-4c4c-b67d-6e612746e885 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/696905935/action" status: 404 len: 124 microversion: 2.1 time: 0.157193 Aug 04 13:53:39.520822 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 50/82] 10.222.0.66 () {60 vars in 1197 bytes} [Thu Aug 4 13:53:39 2022] POST /compute/v2.1/flavors/696905935/action => generated 124 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:53:39.530192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae22e18e-f49e-49eb-8282-7a85031e8d37 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:39.588045 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae22e18e-f49e-49eb-8282-7a85031e8d37 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/696905935" status: 202 len: 0 microversion: 2.1 time: 0.065478 Aug 04 13:53:39.588499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:39.589268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:39.590132 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 51/83] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:53:39 2022] DELETE /compute/v2.1/flavors/696905935 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:53:39.590913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:39.592263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:39.609794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6ace314f-cc60-4007-bde6-193a78fe9ec7 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:39.659360 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6ace314f-cc60-4007-bde6-193a78fe9ec7 tempest-FlavorsAccessNegativeTestJSON-16611529 tempest-FlavorsAccessNegativeTestJSON-16611529-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.064093 Aug 04 13:53:39.663527 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 52/84] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:39 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:39.729481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d85ee348-2273-43db-9ccf-47a65af440e4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:39.730500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d85ee348-2273-43db-9ccf-47a65af440e4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:39.758981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d85ee348-2273-43db-9ccf-47a65af440e4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:39.759439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d85ee348-2273-43db-9ccf-47a65af440e4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:39.760229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d85ee348-2273-43db-9ccf-47a65af440e4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:39.763541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d85ee348-2273-43db-9ccf-47a65af440e4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:39.771542 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-91d392e9-9d8a-46d4-b069-21403d61aa1a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/25e7e2a178cd4e2ab5c6d58e69352b6d?user_id=d3e11f126f3847899c0a45ef55ec0dbe" status: 200 len: 328 microversion: 2.1 time: 0.529417 Aug 04 13:53:39.776223 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 33/85] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 13:53:39 2022] PUT /compute/v2.1/os-quota-sets/25e7e2a178cd4e2ab5c6d58e69352b6d?user_id=d3e11f126f3847899c0a45ef55ec0dbe => generated 328 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:39.802009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3ba42bd-b737-472c-9b60-9aa59ae0adaf tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Calling method '.version_select at 0x7f4700eee160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:40.265390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d85ee348-2273-43db-9ccf-47a65af440e4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:40.279612 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d85ee348-2273-43db-9ccf-47a65af440e4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.561988 Aug 04 13:53:40.280287 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 53/86] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:39 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:40.302155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-764084506", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "618218615", "adminPass": "***", "networks": [{"uuid": "3039de0c-849f-4290-b9b8-50645f6d6d1c"}], "security_groups": [{"name": "tempest-securitygroup--1634228691"}], "key_name": "tempest-keypair-1562324001", "user_data": "}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:40.658097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] validate_networks() for [('3039de0c-849f-4290-b9b8-50645f6d6d1c', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:53:40.763815 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3ba42bd-b737-472c-9b60-9aa59ae0adaf tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/25e7e2a178cd4e2ab5c6d58e69352b6d?user_id=d3e11f126f3847899c0a45ef55ec0dbe" status: 200 len: 370 microversion: 2.1 time: 0.972649 Aug 04 13:53:40.770979 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 34/87] 10.222.0.66 () {58 vars in 1323 bytes} [Thu Aug 4 13:53:39 2022] GET /compute/v2.1/os-quota-sets/25e7e2a178cd4e2ab5c6d58e69352b6d?user_id=d3e11f126f3847899c0a45ef55ec0dbe => generated 370 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:41.304053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-150b4101-5928-45dd-86e8-27df56518b9d tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:41.305481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-150b4101-5928-45dd-86e8-27df56518b9d tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:41.321561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-150b4101-5928-45dd-86e8-27df56518b9d tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:41.322594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-150b4101-5928-45dd-86e8-27df56518b9d tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:41.323582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-150b4101-5928-45dd-86e8-27df56518b9d tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:41.326669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-150b4101-5928-45dd-86e8-27df56518b9d tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:42.114420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-150b4101-5928-45dd-86e8-27df56518b9d tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:42.149651 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-150b4101-5928-45dd-86e8-27df56518b9d tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.851532 Aug 04 13:53:42.151314 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 35/88] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:41 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:42.182612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df48a432-6526-4d80-9738-b6ec5d633db7 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Calling method '.version_select at 0x7f4700efb430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:42.780376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:53:42.781756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:53:42.783040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:53:42.783746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:53:42.784802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:53:42.812808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:42.820184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:42.822661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:42.827010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:42.886284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Getting quotas for project dc689abcb1e94127aa8838ecb76ea9d9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:53:42.896443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Getting quotas for user 3bb6f86c5d0642f689d50d86dd8ec82e and project dc689abcb1e94127aa8838ecb76ea9d9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:53:42.920740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:53:42.924170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:53:43.017113 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aea8139a-4ed0-4809-9a62-b109ab674715 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.735249 Aug 04 13:53:43.017825 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 54/89] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:53:43.030610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6e56fa2d-bd40-4f4a-9acf-32f4dbe0171f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:43.031479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6e56fa2d-bd40-4f4a-9acf-32f4dbe0171f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:43.223746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6e56fa2d-bd40-4f4a-9acf-32f4dbe0171f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:43.245182 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-df48a432-6526-4d80-9738-b6ec5d633db7 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/bebbefeaf94c4300b678f317806c9144/defaults" status: 200 len: 371 microversion: 2.1 time: 1.067680 Aug 04 13:53:43.246182 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 36/90] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 13:53:42 2022] GET /compute/v2.1/os-quota-sets/bebbefeaf94c4300b678f317806c9144/defaults => generated 371 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:53:43.254377 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6e56fa2d-bd40-4f4a-9acf-32f4dbe0171f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1262 microversion: 2.1 time: 0.228634 Aug 04 13:53:43.255250 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 55/91] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:43 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1262 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:43.258999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9b853729-ce18-4a88-8b7a-67638ac07996 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:43.259641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9b853729-ce18-4a88-8b7a-67638ac07996 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:43.260767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e40f148-e5d9-4ebe-9d5a-88989f086e5a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Action: 'update', calling method: .version_select at 0x7f4701167f70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:43.283951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b853729-ce18-4a88-8b7a-67638ac07996 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:43.285490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b853729-ce18-4a88-8b7a-67638ac07996 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:43.288164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b853729-ce18-4a88-8b7a-67638ac07996 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:43.289393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b853729-ce18-4a88-8b7a-67638ac07996 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:43.600469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9b853729-ce18-4a88-8b7a-67638ac07996 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:43.663120 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9b853729-ce18-4a88-8b7a-67638ac07996 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.406075 Aug 04 13:53:43.665222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e40f148-e5d9-4ebe-9d5a-88989f086e5a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:43.665570 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 37/92] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:43 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:43.666651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e40f148-e5d9-4ebe-9d5a-88989f086e5a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:43.668838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e40f148-e5d9-4ebe-9d5a-88989f086e5a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:43.669678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e40f148-e5d9-4ebe-9d5a-88989f086e5a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:44.059503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=13,nova_api:DELETE=5 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:44.291835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-54c82e50-9818-4512-84cd-5796ef52ab50 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:44.293655 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e40f148-e5d9-4ebe-9d5a-88989f086e5a tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/bebbefeaf94c4300b678f317806c9144" status: 200 len: 329 microversion: 2.1 time: 1.036139 Aug 04 13:53:44.293655 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 56/93] 10.222.0.66 () {60 vars in 1263 bytes} [Thu Aug 4 13:53:43 2022] PUT /compute/v2.1/os-quota-sets/bebbefeaf94c4300b678f317806c9144 => generated 329 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:44.296259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-54c82e50-9818-4512-84cd-5796ef52ab50 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:44.308378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4034ff64-4a28-4afe-935b-5ce4f43bdf08 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Action: 'update', calling method: .version_select at 0x7f470108b940>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:44.417354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-54c82e50-9818-4512-84cd-5796ef52ab50 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:44.429442 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-54c82e50-9818-4512-84cd-5796ef52ab50 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1262 microversion: 2.1 time: 0.155288 Aug 04 13:53:44.431069 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 38/94] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:44 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:44.689567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4fb1a735-fcef-4f20-9827-a31f3d78e1de tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:44.690548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4fb1a735-fcef-4f20-9827-a31f3d78e1de tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:44.699457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fb1a735-fcef-4f20-9827-a31f3d78e1de tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:44.700641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fb1a735-fcef-4f20-9827-a31f3d78e1de tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:44.702413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fb1a735-fcef-4f20-9827-a31f3d78e1de tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:44.703499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fb1a735-fcef-4f20-9827-a31f3d78e1de tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:44.884358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4fb1a735-fcef-4f20-9827-a31f3d78e1de tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:44.894725 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4fb1a735-fcef-4f20-9827-a31f3d78e1de tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.208210 Aug 04 13:53:44.896035 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 39/95] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:44 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:45.048289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4034ff64-4a28-4afe-935b-5ce4f43bdf08 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:45.049799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4034ff64-4a28-4afe-935b-5ce4f43bdf08 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:45.051437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4034ff64-4a28-4afe-935b-5ce4f43bdf08 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:45.052226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4034ff64-4a28-4afe-935b-5ce4f43bdf08 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:45.413820 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4034ff64-4a28-4afe-935b-5ce4f43bdf08 tempest-QuotasAdminTestJSON-1463617973 tempest-QuotasAdminTestJSON-1463617973-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/bebbefeaf94c4300b678f317806c9144" status: 200 len: 329 microversion: 2.1 time: 1.109322 Aug 04 13:53:45.421502 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 57/96] 10.222.0.66 () {60 vars in 1263 bytes} [Thu Aug 4 13:53:44 2022] PUT /compute/v2.1/os-quota-sets/bebbefeaf94c4300b678f317806c9144 => generated 329 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:45.451516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef1a2d55-a675-4eba-bc7c-874dbe34795c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:45.452953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ef1a2d55-a675-4eba-bc7c-874dbe34795c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:45.474709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef1a2d55-a675-4eba-bc7c-874dbe34795c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:45.475263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef1a2d55-a675-4eba-bc7c-874dbe34795c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:45.476120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef1a2d55-a675-4eba-bc7c-874dbe34795c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:45.476620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef1a2d55-a675-4eba-bc7c-874dbe34795c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:45.584335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ef1a2d55-a675-4eba-bc7c-874dbe34795c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:45.592829 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ef1a2d55-a675-4eba-bc7c-874dbe34795c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1322 microversion: 2.1 time: 0.144928 Aug 04 13:53:45.593495 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 40/97] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:45 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:45.916661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e289ad0f-8515-4437-b9b1-e4c8e7d1f3ad tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:45.917334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e289ad0f-8515-4437-b9b1-e4c8e7d1f3ad tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:45.923593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e289ad0f-8515-4437-b9b1-e4c8e7d1f3ad tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:45.924058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e289ad0f-8515-4437-b9b1-e4c8e7d1f3ad tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:45.925009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e289ad0f-8515-4437-b9b1-e4c8e7d1f3ad tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:45.925440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e289ad0f-8515-4437-b9b1-e4c8e7d1f3ad tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:46.085717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e289ad0f-8515-4437-b9b1-e4c8e7d1f3ad tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:46.095776 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e289ad0f-8515-4437-b9b1-e4c8e7d1f3ad tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.183703 Aug 04 13:53:46.097202 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 58/98] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:45 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:46.616110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-76438749-c89c-44c4-a1e6-110c433618db tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:46.616811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-76438749-c89c-44c4-a1e6-110c433618db tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:46.623650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76438749-c89c-44c4-a1e6-110c433618db tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:46.624172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76438749-c89c-44c4-a1e6-110c433618db tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:46.625101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76438749-c89c-44c4-a1e6-110c433618db tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:46.625950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76438749-c89c-44c4-a1e6-110c433618db tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:46.651066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c813881-d79e-45e1-920f-13ab3cde88d0 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:46.651748 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:46.651748 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:46.654303 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8c813881-d79e-45e1-920f-13ab3cde88d0 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c813881-d79e-45e1-920f-13ab3cde88d0 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012-project-admin] Request method failure captured: Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689q13zwc9hxhRT3x7Mk-AWbrK3B2xyiX-bBQwypHZGsfhgDWdoXS66qERKVrMPKr4Idu5a3Zrrqu4bJIkR2gzHWGBa_gJ677TY1a_Ptz_hZ80wNrB6BV__UcXitdO68hNQOsj3iIBMoBGUu6oeuxfc8bjlMFvj0Vz5G-APL0tC-dFw Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b89291992f6c41068e8a3f22b8d67820 Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-776537012 Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:53:46.666320 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b89291992f6c41068e8a3f22b8d67820"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b89291992f6c41068e8a3f22b8d67820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b89291992f6c41068e8a3f22b8d67820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b89291992f6c41068e8a3f22b8d67820"}]}] Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-776537012 Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b89291992f6c41068e8a3f22b8d67820 Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-776537012 Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-776537012-project-admin Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 72e8f2ad2c804215948cf15540e4d8a8 Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-776537012-project-admin Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:53:46.667551 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid timestamp for date invalid_time Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'invalid_time'} Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:46.668283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.669422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c813881-d79e-45e1-920f-13ab3cde88d0 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:46.670295 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8c813881-d79e-45e1-920f-13ab3cde88d0 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012 tempest-InstanceUsageAuditLogNegativeTestJSON-776537012-project-admin] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.201524 Aug 04 13:53:46.670295 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 41/99] 10.222.0.66 () {58 vars in 1224 bytes} [Thu Aug 4 13:53:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:53:46.715744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-76438749-c89c-44c4-a1e6-110c433618db tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:46.723349 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-76438749-c89c-44c4-a1e6-110c433618db tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1320 microversion: 2.1 time: 0.111574 Aug 04 13:53:46.724259 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 59/100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:46 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1320 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:46.916297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf0f69dc-eac4-4bd2-95aa-6aebcebe1e6b tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Calling method '.version_select at 0x7f4700e605e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:46.917278 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:46.917278 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:46.926648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bf0f69dc-eac4-4bd2-95aa-6aebcebe1e6b tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '7731977436e64f09bae7c1932e40535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a350c0175d264a16a5ca05a683d17609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf0f69dc-eac4-4bd2-95aa-6aebcebe1e6b tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Request method failure captured: Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689oMt5qbatzWSsKsO9fhbdPgvKvjvXw_dmT8zI3mucGY8MPphm2KeoyxvMHVSKFdmfL-7UBlV6yrK66e9pRc7-vMxQIw0W_JATNMWx2d9NZ8fEMNMKd74nvrUIw4KJN7iRdJ4zNu36sbYYdYcPXTI4HS1kE-3ckk2CD4NRM_nRcR2M Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:53:46.929882 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a350c0175d264a16a5ca05a683d17609"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}] Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7731977436e64f09bae7c1932e40535f Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: action_args: {} Aug 04 13:53:46.931163 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:46.931957 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 13:53:46.933042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.934074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf0f69dc-eac4-4bd2-95aa-6aebcebe1e6b tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:46.934074 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf0f69dc-eac4-4bd2-95aa-6aebcebe1e6b tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.257529 Aug 04 13:53:46.934074 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 42/101] 10.222.0.66 () {58 vars in 1167 bytes} [Thu Aug 4 13:53:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:53:46.946143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3da6350-8c61-434f-ae08-faed4ef97fe9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Calling method '.version_select at 0x7f4700f3e160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:46.947230 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:46.947230 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:46.948354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c3da6350-8c61-434f-ae08-faed4ef97fe9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '7731977436e64f09bae7c1932e40535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a350c0175d264a16a5ca05a683d17609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3da6350-8c61-434f-ae08-faed4ef97fe9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Request method failure captured: Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689oMt5qbatzWSsKsO9fhbdPgvKvjvXw_dmT8zI3mucGY8MPphm2KeoyxvMHVSKFdmfL-7UBlV6yrK66e9pRc7-vMxQIw0W_JATNMWx2d9NZ8fEMNMKd74nvrUIw4KJN7iRdJ4zNu36sbYYdYcPXTI4HS1kE-3ckk2CD4NRM_nRcR2M Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:53:46.950273 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a350c0175d264a16a5ca05a683d17609"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}] Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7731977436e64f09bae7c1932e40535f Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: action_args: {} Aug 04 13:53:46.951902 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:46.952695 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 13:53:46.957993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.959167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3da6350-8c61-434f-ae08-faed4ef97fe9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:46.959167 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c3da6350-8c61-434f-ae08-faed4ef97fe9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.011601 Aug 04 13:53:46.959167 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 43/102] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:46 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:53:46.961757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-009e0b7c-9f8e-4636-a4b8-1b35c33542f9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Calling method '.version_select at 0x7f4700f104c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:46.962818 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:46.962818 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:46.964412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-009e0b7c-9f8e-4636-a4b8-1b35c33542f9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '7731977436e64f09bae7c1932e40535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a350c0175d264a16a5ca05a683d17609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-009e0b7c-9f8e-4636-a4b8-1b35c33542f9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Request method failure captured: Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689oMt5qbatzWSsKsO9fhbdPgvKvjvXw_dmT8zI3mucGY8MPphm2KeoyxvMHVSKFdmfL-7UBlV6yrK66e9pRc7-vMxQIw0W_JATNMWx2d9NZ8fEMNMKd74nvrUIw4KJN7iRdJ4zNu36sbYYdYcPXTI4HS1kE-3ckk2CD4NRM_nRcR2M Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:53:46.966446 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a350c0175d264a16a5ca05a683d17609"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}] Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7731977436e64f09bae7c1932e40535f Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: action_args: {} Aug 04 13:53:46.967932 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:46.968707 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 13:53:46.969860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:46.971741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-009e0b7c-9f8e-4636-a4b8-1b35c33542f9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:46.972592 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-009e0b7c-9f8e-4636-a4b8-1b35c33542f9 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.014704 Aug 04 13:53:46.977537 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 44/103] 10.222.0.66 () {58 vars in 1179 bytes} [Thu Aug 4 13:53:46 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:53:47.122450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1552692-687b-4dcd-a5df-941dda1f16c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.123608 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:47.123608 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:47.124967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1552692-687b-4dcd-a5df-941dda1f16c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f671f6ed4e5342978cd1be211ca9360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5d8a388f2422caa6e1627807863d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1552692-687b-4dcd-a5df-941dda1f16c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] Request method failure captured: Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689pxpEWpGZnURSrurS0-7CGTOeTTOLq5EIhvMaAkEzxM1XKueyjZfqp5Nq8Hm-mF5Gy3MnIq_MvLj08jvsH4T0H-TCzvgm2IDONXuGc5cD0h4tBH1aQ8G8pv_OVUqspv33UWHJ7qQbeFkK48C36_VGxvBfzVbO3bH6nMyPeIZvkhDU Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c9d5d8a388f2422caa6e1627807863d2 Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:53:47.128572 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9d5d8a388f2422caa6e1627807863d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9d5d8a388f2422caa6e1627807863d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9d5d8a388f2422caa6e1627807863d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9d5d8a388f2422caa6e1627807863d2"}]}] Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c9d5d8a388f2422caa6e1627807863d2 Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f671f6ed4e5342978cd1be211ca9360a Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project Aug 04 13:53:47.130600 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: action_args: {} Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:47.132656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 13:53:47.139996 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.142071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1552692-687b-4dcd-a5df-941dda1f16c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:47.143077 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1552692-687b-4dcd-a5df-941dda1f16c8 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.417755 Aug 04 13:53:47.148513 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 60/104] 10.222.0.66 () {58 vars in 1185 bytes} [Thu Aug 4 13:53:46 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:53:47.157892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6654bcb4-ea5c-454d-8d6d-3bc52d16ccd6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.158918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6654bcb4-ea5c-454d-8d6d-3bc52d16ccd6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:47.178678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6654bcb4-ea5c-454d-8d6d-3bc52d16ccd6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.179540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6654bcb4-ea5c-454d-8d6d-3bc52d16ccd6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.180563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6654bcb4-ea5c-454d-8d6d-3bc52d16ccd6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.182203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6654bcb4-ea5c-454d-8d6d-3bc52d16ccd6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.413335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c0813a2-3270-48ef-89b7-00730df72617 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Calling method '.version_select at 0x7f4700e60430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.415882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c0813a2-3270-48ef-89b7-00730df72617 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.416260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c0813a2-3270-48ef-89b7-00730df72617 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.434790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c0813a2-3270-48ef-89b7-00730df72617 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.435466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c0813a2-3270-48ef-89b7-00730df72617 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.447589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6654bcb4-ea5c-454d-8d6d-3bc52d16ccd6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:47.453644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c0813a2-3270-48ef-89b7-00730df72617 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.457884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c0813a2-3270-48ef-89b7-00730df72617 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.459032 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6654bcb4-ea5c-454d-8d6d-3bc52d16ccd6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.305313 Aug 04 13:53:47.460166 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 61/105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:47 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:47.465943 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8c0813a2-3270-48ef-89b7-00730df72617 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.487009 Aug 04 13:53:47.467642 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 45/106] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:47.472559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7562c0b7-16a0-40ce-bb45-ab6c57e28ea4 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.473376 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:47.473376 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:47.481840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84902a4f-2dee-4da5-abd3-237e48b47857 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Calling method '.version_select at 0x7f4700e60310>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.482311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7562c0b7-16a0-40ce-bb45-ab6c57e28ea4 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f671f6ed4e5342978cd1be211ca9360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5d8a388f2422caa6e1627807863d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:47.482905 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:47.482905 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:47.483998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84902a4f-2dee-4da5-abd3-237e48b47857 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '7731977436e64f09bae7c1932e40535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a350c0175d264a16a5ca05a683d17609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7562c0b7-16a0-40ce-bb45-ab6c57e28ea4 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] Request method failure captured: Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2013:53:47 HTTP/1.1 Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689pxpEWpGZnURSrurS0-7CGTOeTTOLq5EIhvMaAkEzxM1XKueyjZfqp5Nq8Hm-mF5Gy3MnIq_MvLj08jvsH4T0H-TCzvgm2IDONXuGc5cD0h4tBH1aQ8G8pv_OVUqspv33UWHJ7qQbeFkK48C36_VGxvBfzVbO3bH6nMyPeIZvkhDU Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c9d5d8a388f2422caa6e1627807863d2 Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:53:47.484285 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9d5d8a388f2422caa6e1627807863d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9d5d8a388f2422caa6e1627807863d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9d5d8a388f2422caa6e1627807863d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9d5d8a388f2422caa6e1627807863d2"}]}] Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c9d5d8a388f2422caa6e1627807863d2 Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f671f6ed4e5342978cd1be211ca9360a Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project Aug 04 13:53:47.485869 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '2022-08-04 13:53:47'} Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:47.486734 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 13:53:47.489392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.490715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7562c0b7-16a0-40ce-bb45-ab6c57e28ea4 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:47.490715 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7562c0b7-16a0-40ce-bb45-ab6c57e28ea4 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944 tempest-InstanceUsageAuditLogNegativeTestJSON-1225163944-project] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04 13:53:47" status: 403 len: 128 microversion: 2.1 time: 0.024301 Aug 04 13:53:47.490715 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 62/107] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 13:53:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2013%3A53%3A47 => generated 128 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84902a4f-2dee-4da5-abd3-237e48b47857 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Request method failure captured: Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689oMt5qbatzWSsKsO9fhbdPgvKvjvXw_dmT8zI3mucGY8MPphm2KeoyxvMHVSKFdmfL-7UBlV6yrK66e9pRc7-vMxQIw0W_JATNMWx2d9NZ8fEMNMKd74nvrUIw4KJN7iRdJ4zNu36sbYYdYcPXTI4HS1kE-3ckk2CD4NRM_nRcR2M Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:53:47.493177 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a350c0175d264a16a5ca05a683d17609"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}] Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7731977436e64f09bae7c1932e40535f Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '1'} Aug 04 13:53:47.494587 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:47.495347 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 13:53:47.496314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.497241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84902a4f-2dee-4da5-abd3-237e48b47857 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:47.497241 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84902a4f-2dee-4da5-abd3-237e48b47857 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.019897 Aug 04 13:53:47.500117 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 46/108] 10.222.0.66 () {58 vars in 1173 bytes} [Thu Aug 4 13:53:47 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:53:47.508404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-273d5102-9b95-45f2-87ac-4af56c3237bb tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Calling method '.version_select at 0x7f470100b040>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.509740 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:47.509740 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:47.510910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-273d5102-9b95-45f2-87ac-4af56c3237bb tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] HTTP exception thrown: Hypervisor with ID '9df342f9-de28-4c11-80d4-7112e1982d70' could not be found. Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-273d5102-9b95-45f2-87ac-4af56c3237bb tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Request method failure captured: Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-hypervisors/9df342f9-de28-4c11-80d4-7112e1982d70/uptime HTTP/1.1 Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689q1pyXpFmbjQi82ik9_8BCj-vWrOULJ3Q2pwMxVf5qrIJo37kh5wjZEDe4XRXaht66x7AJ9YyVaCgCW-RIPb3z_EXIFOX7lIcfGTlE-Ojn4crXXgJYx7PvJd8GXMaTW4samj4Tx8q6TOp7BfcJxa-G2AfWadKC87bR4Cs6mx0QRrE Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3d81b4024ca54cf58b02dcc758810453 Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1595200812 Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:53:47.532135 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d81b4024ca54cf58b02dcc758810453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3d81b4024ca54cf58b02dcc758810453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3d81b4024ca54cf58b02dcc758810453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d81b4024ca54cf58b02dcc758810453"}]}] Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1595200812 Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3d81b4024ca54cf58b02dcc758810453 Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1595200812 Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 47ff9c3242c14f35ab01dc15b3f8a938 Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: exception: Hypervisor with ID '9df342f9-de28-4c11-80d4-7112e1982d70' could not be found. Aug 04 13:53:47.533630 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9df342f9-de28-4c11-80d4-7112e1982d70'} Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9df342f9-de28-4c11-80d4-7112e1982d70' Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 04 13:53:47.534394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9df342f9-de28-4c11-80d4-7112e1982d70' could not be found. Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.535569 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9df342f9-de28-4c11-80d4-7112e1982d70' could not be found. Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-273d5102-9b95-45f2-87ac-4af56c3237bb tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Returning 404 to user: Hypervisor with ID '9df342f9-de28-4c11-80d4-7112e1982d70' could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-273d5102-9b95-45f2-87ac-4af56c3237bb tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/9df342f9-de28-4c11-80d4-7112e1982d70/uptime" status: 404 len: 123 microversion: 2.1 time: 0.030965 Aug 04 13:53:47.536657 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 63/109] 10.222.0.66 () {58 vars in 1278 bytes} [Thu Aug 4 13:53:47 2022] GET /compute/v2.1/os-hypervisors/9df342f9-de28-4c11-80d4-7112e1982d70/uptime => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:53:47.543311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bfc93bc5-21e2-4c6e-9bb6-a5d4cf1060f5 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Calling method '.version_select at 0x7f4700e48160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.544893 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:47.544893 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:47.546929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc93bc5-21e2-4c6e-9bb6-a5d4cf1060f5 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.547627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc93bc5-21e2-4c6e-9bb6-a5d4cf1060f5 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.568358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc93bc5-21e2-4c6e-9bb6-a5d4cf1060f5 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.568909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc93bc5-21e2-4c6e-9bb6-a5d4cf1060f5 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.584614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc93bc5-21e2-4c6e-9bb6-a5d4cf1060f5 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.585564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc93bc5-21e2-4c6e-9bb6-a5d4cf1060f5 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.594687 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bfc93bc5-21e2-4c6e-9bb6-a5d4cf1060f5 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.054913 Aug 04 13:53:47.595562 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 47/110] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:53:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:53:47.609194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b21b9f9-920c-419b-b12c-bdea07abd813 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Calling method '.version_select at 0x7f470108b5e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.613908 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:47.613908 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:47.613908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b21b9f9-920c-419b-b12c-bdea07abd813 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '7731977436e64f09bae7c1932e40535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a350c0175d264a16a5ca05a683d17609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b21b9f9-920c-419b-b12c-bdea07abd813 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Request method failure captured: Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689oMt5qbatzWSsKsO9fhbdPgvKvjvXw_dmT8zI3mucGY8MPphm2KeoyxvMHVSKFdmfL-7UBlV6yrK66e9pRc7-vMxQIw0W_JATNMWx2d9NZ8fEMNMKd74nvrUIw4KJN7iRdJ4zNu36sbYYdYcPXTI4HS1kE-3ckk2CD4NRM_nRcR2M Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:53:47.620778 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a350c0175d264a16a5ca05a683d17609"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a350c0175d264a16a5ca05a683d17609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a350c0175d264a16a5ca05a683d17609"}]}] Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: a350c0175d264a16a5ca05a683d17609 Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946 Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 7731977436e64f09bae7c1932e40535f Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1712425946-project Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '1'} Aug 04 13:53:47.622442 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:53:47.623207 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 13:53:47.624173 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.625213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b21b9f9-920c-419b-b12c-bdea07abd813 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:47.625213 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b21b9f9-920c-419b-b12c-bdea07abd813 tempest-HypervisorAdminNegativeTestJSON-1712425946 tempest-HypervisorAdminNegativeTestJSON-1712425946-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017205 Aug 04 13:53:47.625213 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 64/111] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:53:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:53:47.639194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a0b43dec-62b5-4836-85b0-4225202d7959 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Calling method '.version_select at 0x7f4700e488b0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.640598 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:47.640598 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:47.642186 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a0b43dec-62b5-4836-85b0-4225202d7959 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] HTTP exception thrown: Hypervisor with ID '61b70416-5ce8-4ab4-922d-03d276bd144e' could not be found. Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a0b43dec-62b5-4836-85b0-4225202d7959 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Request method failure captured: Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hypervisors/61b70416-5ce8-4ab4-922d-03d276bd144e HTTP/1.1 Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689q1pyXpFmbjQi82ik9_8BCj-vWrOULJ3Q2pwMxVf5qrIJo37kh5wjZEDe4XRXaht66x7AJ9YyVaCgCW-RIPb3z_EXIFOX7lIcfGTlE-Ojn4crXXgJYx7PvJd8GXMaTW4samj4Tx8q6TOp7BfcJxa-G2AfWadKC87bR4Cs6mx0QRrE Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3d81b4024ca54cf58b02dcc758810453 Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1595200812 Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:53:47.645875 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d81b4024ca54cf58b02dcc758810453"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3d81b4024ca54cf58b02dcc758810453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3d81b4024ca54cf58b02dcc758810453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d81b4024ca54cf58b02dcc758810453"}]}] Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1595200812 Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3d81b4024ca54cf58b02dcc758810453 Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1595200812 Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 47ff9c3242c14f35ab01dc15b3f8a938 Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: exception: Hypervisor with ID '61b70416-5ce8-4ab4-922d-03d276bd144e' could not be found. Aug 04 13:53:47.647049 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '61b70416-5ce8-4ab4-922d-03d276bd144e'} Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '61b70416-5ce8-4ab4-922d-03d276bd144e' Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 04 13:53:47.647677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 13:53:47.649125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '61b70416-5ce8-4ab4-922d-03d276bd144e' could not be found. Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '61b70416-5ce8-4ab4-922d-03d276bd144e' could not be found. Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a0b43dec-62b5-4836-85b0-4225202d7959 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] Returning 404 to user: Hypervisor with ID '61b70416-5ce8-4ab4-922d-03d276bd144e' could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a0b43dec-62b5-4836-85b0-4225202d7959 tempest-HypervisorAdminNegativeTestJSON-1595200812 tempest-HypervisorAdminNegativeTestJSON-1595200812-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/61b70416-5ce8-4ab4-922d-03d276bd144e" status: 404 len: 123 microversion: 2.1 time: 0.018688 Aug 04 13:53:47.650269 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 48/112] 10.222.0.66 () {58 vars in 1257 bytes} [Thu Aug 4 13:53:47 2022] GET /compute/v2.1/os-hypervisors/61b70416-5ce8-4ab4-922d-03d276bd144e => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:53:47.745743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fd37b689-96d3-4be3-8764-f6e117617702 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:47.746370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fd37b689-96d3-4be3-8764-f6e117617702 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:47.757287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd37b689-96d3-4be3-8764-f6e117617702 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.758198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd37b689-96d3-4be3-8764-f6e117617702 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.759923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd37b689-96d3-4be3-8764-f6e117617702 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:47.760714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd37b689-96d3-4be3-8764-f6e117617702 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:47.865445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fd37b689-96d3-4be3-8764-f6e117617702 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:47.876078 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fd37b689-96d3-4be3-8764-f6e117617702 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1320 microversion: 2.1 time: 0.134660 Aug 04 13:53:47.876783 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 65/113] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:47 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1320 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:48.494709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f281ac0-8898-418b-b9a1-cd12d519eb00 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:48.495344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f281ac0-8898-418b-b9a1-cd12d519eb00 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:48.499585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=9 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:48.513020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f281ac0-8898-418b-b9a1-cd12d519eb00 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:48.515453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f281ac0-8898-418b-b9a1-cd12d519eb00 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:48.516487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f281ac0-8898-418b-b9a1-cd12d519eb00 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:48.516961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f281ac0-8898-418b-b9a1-cd12d519eb00 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:48.780786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f281ac0-8898-418b-b9a1-cd12d519eb00 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:48.803415 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f281ac0-8898-418b-b9a1-cd12d519eb00 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.321126 Aug 04 13:53:48.804493 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 49/114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:48 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:48.898315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a7baa398-aa0c-456a-924f-e0c32983d629 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:48.899105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a7baa398-aa0c-456a-924f-e0c32983d629 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:48.920085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7baa398-aa0c-456a-924f-e0c32983d629 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:48.923618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7baa398-aa0c-456a-924f-e0c32983d629 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:48.924677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7baa398-aa0c-456a-924f-e0c32983d629 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:48.926485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7baa398-aa0c-456a-924f-e0c32983d629 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:49.060688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a7baa398-aa0c-456a-924f-e0c32983d629 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:49.080623 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a7baa398-aa0c-456a-924f-e0c32983d629 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1320 microversion: 2.1 time: 0.186457 Aug 04 13:53:49.082057 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 50/115] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:48 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:49.326493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62ee4902-441c-4e9c-88bd-4ac2a79e3b27 tempest-FlavorsV261TestJSON-1519793098 tempest-FlavorsV261TestJSON-1519793098-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1651486729", "id": 434369133, "os-flavor-access:is_public": "True"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:49.337902 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:49.337902 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:49.372558 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62ee4902-441c-4e9c-88bd-4ac2a79e3b27 tempest-FlavorsV261TestJSON-1519793098 tempest-FlavorsV261TestJSON-1519793098-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.509838 Aug 04 13:53:49.373180 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 66/116] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 13:53:48 2022] POST /compute/v2.1/flavors => generated 465 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:53:49.621175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=9 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:49.763766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c202484f-6305-4176-892b-43ad79a1248b tempest-FlavorsV261TestJSON-402164735 tempest-FlavorsV261TestJSON-402164735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:49.789288 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c202484f-6305-4176-892b-43ad79a1248b tempest-FlavorsV261TestJSON-402164735 tempest-FlavorsV261TestJSON-402164735-project] 10.222.0.66 "GET /compute/v2.1/flavors/434369133" status: 200 len: 465 microversion: 2.61 time: 0.400041 Aug 04 13:53:49.790781 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 51/117] 10.222.0.66 () {60 vars in 1196 bytes} [Thu Aug 4 13:53:49 2022] GET /compute/v2.1/flavors/434369133 => generated 465 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:53:49.806789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1d1f170-ae70-4dce-9557-353fdfe183ce tempest-FlavorsV261TestJSON-1519793098 tempest-FlavorsV261TestJSON-1519793098-project-admin] Action: 'update', calling method: .version_select at 0x7f47031ba430>, body: {"flavor": {"description": "new"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:49.825762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-981d81d6-c334-4042-9f3e-17abe8b0484e tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:49.827247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-981d81d6-c334-4042-9f3e-17abe8b0484e tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:49.832311 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:49.832311 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:49.838964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-981d81d6-c334-4042-9f3e-17abe8b0484e tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:49.839635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-981d81d6-c334-4042-9f3e-17abe8b0484e tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:49.840682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-981d81d6-c334-4042-9f3e-17abe8b0484e tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:49.841312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-981d81d6-c334-4042-9f3e-17abe8b0484e tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:49.849741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:INSERT=22,nova_api:SELECT=64,nova_api:UPDATE=14 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:49.895336 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1d1f170-ae70-4dce-9557-353fdfe183ce tempest-FlavorsV261TestJSON-1519793098 tempest-FlavorsV261TestJSON-1519793098-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/434369133" status: 200 len: 466 microversion: 2.61 time: 0.092495 Aug 04 13:53:49.898095 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 67/118] 10.222.0.66 () {62 vars in 1216 bytes} [Thu Aug 4 13:53:49 2022] PUT /compute/v2.1/flavors/434369133 => generated 466 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:53:49.911528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-78e8fb36-e028-4418-ab05-b1dba54cabfb tempest-FlavorsV261TestJSON-402164735 tempest-FlavorsV261TestJSON-402164735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:49.945541 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-78e8fb36-e028-4418-ab05-b1dba54cabfb tempest-FlavorsV261TestJSON-402164735 tempest-FlavorsV261TestJSON-402164735-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 7151 microversion: 2.61 time: 0.038566 Aug 04 13:53:49.946394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 68/119] 10.222.0.66 () {60 vars in 1187 bytes} [Thu Aug 4 13:53:49 2022] GET /compute/v2.1/flavors/detail => generated 7151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:53:49.970360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b56412fd-d44f-46ae-92e6-b1dd5c8dc84e tempest-FlavorsV261TestJSON-402164735 tempest-FlavorsV261TestJSON-402164735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:50.020061 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b56412fd-d44f-46ae-92e6-b1dd5c8dc84e tempest-FlavorsV261TestJSON-402164735 tempest-FlavorsV261TestJSON-402164735-project] 10.222.0.66 "GET /compute/v2.1/flavors" status: 200 len: 3678 microversion: 2.61 time: 0.053966 Aug 04 13:53:50.025155 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 69/120] 10.222.0.66 () {60 vars in 1166 bytes} [Thu Aug 4 13:53:49 2022] GET /compute/v2.1/flavors => generated 3678 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:53:50.046413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a220894b-ebf8-4081-bb1b-203c6a9ec70b tempest-FlavorsV261TestJSON-1519793098 tempest-FlavorsV261TestJSON-1519793098-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:50.047345 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:50.047345 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:53:50.068422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-981d81d6-c334-4042-9f3e-17abe8b0484e tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:50.071222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:50.081701 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-981d81d6-c334-4042-9f3e-17abe8b0484e tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.259502 Aug 04 13:53:50.097584 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a220894b-ebf8-4081-bb1b-203c6a9ec70b tempest-FlavorsV261TestJSON-1519793098 tempest-FlavorsV261TestJSON-1519793098-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/434369133" status: 202 len: 0 microversion: 2.61 time: 0.053863 Aug 04 13:53:50.097584 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 70/121] 10.222.0.66 () {60 vars in 1199 bytes} [Thu Aug 4 13:53:50 2022] DELETE /compute/v2.1/flavors/434369133 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:53:50.098393 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 52/122] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:49 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:50.105312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53986eb3-e443-4a32-aeef-32932d76c5ca tempest-FlavorsV261TestJSON-1519793098 tempest-FlavorsV261TestJSON-1519793098-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:50.110775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-20c569f8-5d2b-4871-a20f-dac189b466f2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:50.111703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-20c569f8-5d2b-4871-a20f-dac189b466f2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:50.132419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20c569f8-5d2b-4871-a20f-dac189b466f2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:50.132967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20c569f8-5d2b-4871-a20f-dac189b466f2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:50.133855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20c569f8-5d2b-4871-a20f-dac189b466f2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:50.134393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20c569f8-5d2b-4871-a20f-dac189b466f2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:50.140808 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-53986eb3-e443-4a32-aeef-32932d76c5ca tempest-FlavorsV261TestJSON-1519793098 tempest-FlavorsV261TestJSON-1519793098-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6695 microversion: 2.61 time: 0.046609 Aug 04 13:53:50.141783 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 71/123] 10.222.0.66 () {60 vars in 1187 bytes} [Thu Aug 4 13:53:50 2022] GET /compute/v2.1/flavors/detail => generated 6695 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:53:50.237184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-20c569f8-5d2b-4871-a20f-dac189b466f2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:50.249435 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-20c569f8-5d2b-4871-a20f-dac189b466f2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1320 microversion: 2.1 time: 0.145972 Aug 04 13:53:50.251310 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 53/124] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:50 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:51.109979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c96cb62c-180b-4d5c-bc40-3f39d0fcd240 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:51.110735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c96cb62c-180b-4d5c-bc40-3f39d0fcd240 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:51.118619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c96cb62c-180b-4d5c-bc40-3f39d0fcd240 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:51.119226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c96cb62c-180b-4d5c-bc40-3f39d0fcd240 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:51.121321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c96cb62c-180b-4d5c-bc40-3f39d0fcd240 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:51.121919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c96cb62c-180b-4d5c-bc40-3f39d0fcd240 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:51.129082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=83 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:51.275285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac0f0f86-7248-46f6-bda8-0eef99aa2fcf tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:51.275838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ac0f0f86-7248-46f6-bda8-0eef99aa2fcf tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:51.286077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac0f0f86-7248-46f6-bda8-0eef99aa2fcf tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:51.288647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac0f0f86-7248-46f6-bda8-0eef99aa2fcf tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:51.289507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac0f0f86-7248-46f6-bda8-0eef99aa2fcf tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:51.290327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac0f0f86-7248-46f6-bda8-0eef99aa2fcf tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:51.295564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c96cb62c-180b-4d5c-bc40-3f39d0fcd240 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:51.308504 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c96cb62c-180b-4d5c-bc40-3f39d0fcd240 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.208714 Aug 04 13:53:51.310867 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 72/125] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:51 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:51.375979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ac0f0f86-7248-46f6-bda8-0eef99aa2fcf tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:51.387154 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac0f0f86-7248-46f6-bda8-0eef99aa2fcf tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1320 microversion: 2.1 time: 0.116035 Aug 04 13:53:51.388128 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 54/126] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:51 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1320 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:51.619160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-faff5602-7a16-4b78-9893-c15acbac02ba req-fff47860-b03b-4f99-8938-bfcb19187c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6e7e50-fdd7-4395-ab38-d439c6747103", "name": "network-vif-plugged", "status": "completed", "tag": "18367270-b495-4f90-90ae-4137701c1b40"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:51.633606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-faff5602-7a16-4b78-9893-c15acbac02ba req-fff47860-b03b-4f99-8938-bfcb19187c02 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:51.634052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-faff5602-7a16-4b78-9893-c15acbac02ba req-fff47860-b03b-4f99-8938-bfcb19187c02 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:51.655228 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-faff5602-7a16-4b78-9893-c15acbac02ba req-fff47860-b03b-4f99-8938-bfcb19187c02 service nova] Creating event network-vif-plugged:18367270-b495-4f90-90ae-4137701c1b40 for instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 on n-h2-844627-10 Aug 04 13:53:51.655769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-faff5602-7a16-4b78-9893-c15acbac02ba req-fff47860-b03b-4f99-8938-bfcb19187c02 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:53:51.657304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e97d7c0b-a144-4bf9-ad18-28d101c1d69b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:51.657864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e97d7c0b-a144-4bf9-ad18-28d101c1d69b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:51.658512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e97d7c0b-a144-4bf9-ad18-28d101c1d69b None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:51.659474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e97d7c0b-a144-4bf9-ad18-28d101c1d69b None None] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:51.665475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=19 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:51.668715 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.compute.rpcapi [None req-e97d7c0b-a144-4bf9-ad18-28d101c1d69b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 13:53:51.669614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e97d7c0b-a144-4bf9-ad18-28d101c1d69b None None] Releasing lock "compute-rpcapi-router" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:53:51.695458 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e97d7c0b-a144-4bf9-ad18-28d101c1d69b None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.342258 Aug 04 13:53:51.697425 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 73/127] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:52.331564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f643f9fe-96ff-42da-9d53-77ab70219bf4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:52.332279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f643f9fe-96ff-42da-9d53-77ab70219bf4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:52.340002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f643f9fe-96ff-42da-9d53-77ab70219bf4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:52.340483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f643f9fe-96ff-42da-9d53-77ab70219bf4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:52.341297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f643f9fe-96ff-42da-9d53-77ab70219bf4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:52.341767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f643f9fe-96ff-42da-9d53-77ab70219bf4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:52.421170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e13518e-3b14-41d0-a439-19a458fe1543 tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Action: 'update', calling method: .version_select at 0x7f4700e60e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:52.490949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f643f9fe-96ff-42da-9d53-77ab70219bf4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:52.502385 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f643f9fe-96ff-42da-9d53-77ab70219bf4 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.176704 Aug 04 13:53:52.503269 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 74/128] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:52 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:52.511616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4789512b-8417-48bb-98f4-ee747efde204 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:52.512895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4789512b-8417-48bb-98f4-ee747efde204 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:52.522372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4789512b-8417-48bb-98f4-ee747efde204 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:52.523414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4789512b-8417-48bb-98f4-ee747efde204 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:52.524906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4789512b-8417-48bb-98f4-ee747efde204 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:52.525850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4789512b-8417-48bb-98f4-ee747efde204 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:52.609082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4789512b-8417-48bb-98f4-ee747efde204 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:52.617130 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4789512b-8417-48bb-98f4-ee747efde204 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1320 microversion: 2.1 time: 0.111167 Aug 04 13:53:52.617713 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 75/129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:52 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1320 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:52.865899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=35 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:52.868308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e13518e-3b14-41d0-a439-19a458fe1543 tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:52.869188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e13518e-3b14-41d0-a439-19a458fe1543 tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:52.870483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e13518e-3b14-41d0-a439-19a458fe1543 tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:52.871139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e13518e-3b14-41d0-a439-19a458fe1543 tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:52.935254 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e13518e-3b14-41d0-a439-19a458fe1543 tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/3482101de24749dba795ee7da4d3a89b" status: 200 len: 240 microversion: 2.36 time: 0.809472 Aug 04 13:53:52.936188 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 55/130] 10.222.0.66 () {62 vars in 1303 bytes} [Thu Aug 4 13:53:52 2022] PUT /compute/v2.1/os-quota-sets/3482101de24749dba795ee7da4d3a89b => generated 240 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:53:52.947231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b000938-4df5-489a-8795-64ba6611d95d tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Calling method '.version_select at 0x7f470108b280>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:53.482618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=95 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:53:53.489496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b000938-4df5-489a-8795-64ba6611d95d tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:53.490289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b000938-4df5-489a-8795-64ba6611d95d tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:53.491246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b000938-4df5-489a-8795-64ba6611d95d tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:53.491852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b000938-4df5-489a-8795-64ba6611d95d tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:53.514686 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b000938-4df5-489a-8795-64ba6611d95d tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/3482101de24749dba795ee7da4d3a89b/detail" status: 200 len: 672 microversion: 2.36 time: 0.571354 Aug 04 13:53:53.516002 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 76/131] 10.222.0.66 () {60 vars in 1304 bytes} [Thu Aug 4 13:53:52 2022] GET /compute/v2.1/os-quota-sets/3482101de24749dba795ee7da4d3a89b/detail => generated 672 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:53:53.530374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a7e30b95-e364-4a2d-911d-3e9746984cf6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:53.531005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a7e30b95-e364-4a2d-911d-3e9746984cf6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:53.537800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7e30b95-e364-4a2d-911d-3e9746984cf6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:53.538264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7e30b95-e364-4a2d-911d-3e9746984cf6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:53.539056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7e30b95-e364-4a2d-911d-3e9746984cf6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:53.539561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7e30b95-e364-4a2d-911d-3e9746984cf6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:53.638661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ccb22c5c-bd32-4649-a315-5480a308290c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:53.639292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ccb22c5c-bd32-4649-a315-5480a308290c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:53.646702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ccb22c5c-bd32-4649-a315-5480a308290c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:53.647421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ccb22c5c-bd32-4649-a315-5480a308290c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:53.648744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ccb22c5c-bd32-4649-a315-5480a308290c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:53.649518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ccb22c5c-bd32-4649-a315-5480a308290c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:53.770793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a7e30b95-e364-4a2d-911d-3e9746984cf6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:53.781001 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a7e30b95-e364-4a2d-911d-3e9746984cf6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1338 microversion: 2.1 time: 0.260609 Aug 04 13:53:53.800708 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 56/132] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:53 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1338 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:53.831463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ccb22c5c-bd32-4649-a315-5480a308290c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:53.839903 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ccb22c5c-bd32-4649-a315-5480a308290c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1388 microversion: 2.1 time: 0.205259 Aug 04 13:53:53.840676 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 77/133] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:53 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1388 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:54.238097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Action: 'update', calling method: .version_select at 0x7f470108bdc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:54.501359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-894149147", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:54.589457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:53:54.683310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:54.684545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:54.685629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:54.686218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:54.767735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:54.769286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:54.773438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:54.774365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:54.845492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:53:54.846577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:53:54.847325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:53:54.848027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:53:54.848636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:53:54.860144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:54.860961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:54.862095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:54.862714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:54.882751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:53:54.887510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for user cca2bff6e81c4f54bad52f77e67faa55 and project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:53:54.897300 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-36f942ac-a8fe-49c6-bc92-6215aab7d1ea tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/3482101de24749dba795ee7da4d3a89b?user_id=9bc2d0d081b94cb09f1b4ea1f2075efe" status: 200 len: 240 microversion: 2.36 time: 0.664360 Aug 04 13:53:54.901965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:53:54.904607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:53:54.905077 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 78/134] 10.222.0.66 () {62 vars in 1384 bytes} [Thu Aug 4 13:53:54 2022] PUT /compute/v2.1/os-quota-sets/3482101de24749dba795ee7da4d3a89b?user_id=9bc2d0d081b94cb09f1b4ea1f2075efe => generated 240 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:53:54.921291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81b6eb9b-09e2-4358-8c2c-b1e7c3e7938a tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:54.923690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81b6eb9b-09e2-4358-8c2c-b1e7c3e7938a tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:54.937130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81b6eb9b-09e2-4358-8c2c-b1e7c3e7938a tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:54.937859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81b6eb9b-09e2-4358-8c2c-b1e7c3e7938a tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:54.940440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81b6eb9b-09e2-4358-8c2c-b1e7c3e7938a tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:54.944209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81b6eb9b-09e2-4358-8c2c-b1e7c3e7938a tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:54.979128 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-80e632e2-8424-40aa-9902-116b1d417641 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.861242 Aug 04 13:53:54.980156 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 57/135] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:53:54.995535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a4052f09-39c9-48d7-b16b-8e9a6ecc412c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:55.000779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a4052f09-39c9-48d7-b16b-8e9a6ecc412c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:55.019082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4052f09-39c9-48d7-b16b-8e9a6ecc412c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:55.019636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4052f09-39c9-48d7-b16b-8e9a6ecc412c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:55.020368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4052f09-39c9-48d7-b16b-8e9a6ecc412c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:55.020827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4052f09-39c9-48d7-b16b-8e9a6ecc412c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:55.413144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-81b6eb9b-09e2-4358-8c2c-b1e7c3e7938a tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:55.422841 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81b6eb9b-09e2-4358-8c2c-b1e7c3e7938a tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1487 microversion: 2.1 time: 0.514599 Aug 04 13:53:55.423432 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 79/136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:54 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1487 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:55.445892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f81cca78-6e5c-46b1-be5c-ea804e8f3674 tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] Calling method '.version_select at 0x7f47010264c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:55.527396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a4052f09-39c9-48d7-b16b-8e9a6ecc412c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:55.539386 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a4052f09-39c9-48d7-b16b-8e9a6ecc412c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1388 microversion: 2.1 time: 0.557717 Aug 04 13:53:55.540940 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 58/137] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:54 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1388 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:55.546360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f65ed7a-80ac-497a-8569-543f2b715814 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:55.547321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f65ed7a-80ac-497a-8569-543f2b715814 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:55.642200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f65ed7a-80ac-497a-8569-543f2b715814 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:55.651478 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f65ed7a-80ac-497a-8569-543f2b715814 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1212 microversion: 2.1 time: 0.109092 Aug 04 13:53:55.652372 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 59/138] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:55 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1212 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:55.725435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-01aa5d08-dd66-48c1-941c-46e290aa5cef req-05c35936-3401-459e-9ee9-4ffe2aa562df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "206086e4-b66e-49e9-9299-4cc160efecbd", "tag": "c3f8fbbc-3537-4d62-9f4b-5adf086a2321"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:55.736305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-01aa5d08-dd66-48c1-941c-46e290aa5cef req-05c35936-3401-459e-9ee9-4ffe2aa562df service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:55.737360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-01aa5d08-dd66-48c1-941c-46e290aa5cef req-05c35936-3401-459e-9ee9-4ffe2aa562df service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:55.750120 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-01aa5d08-dd66-48c1-941c-46e290aa5cef req-05c35936-3401-459e-9ee9-4ffe2aa562df service nova] Creating event network-changed:c3f8fbbc-3537-4d62-9f4b-5adf086a2321 for instance 206086e4-b66e-49e9-9299-4cc160efecbd on n-h1-844627-10 Aug 04 13:53:55.754134 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f81cca78-6e5c-46b1-be5c-ea804e8f3674 tempest-QuotasAdminTestV236-1427155021 tempest-QuotasAdminTestV236-1427155021-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/3482101de24749dba795ee7da4d3a89b?user_id=9bc2d0d081b94cb09f1b4ea1f2075efe" status: 200 len: 282 microversion: 2.36 time: 0.314302 Aug 04 13:53:55.756004 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 80/139] 10.222.0.66 () {60 vars in 1364 bytes} [Thu Aug 4 13:53:55 2022] GET /compute/v2.1/os-quota-sets/3482101de24749dba795ee7da4d3a89b?user_id=9bc2d0d081b94cb09f1b4ea1f2075efe => generated 282 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:53:55.761901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc344fbd-4da3-47a6-a1fb-4d9cd770e45f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:55.762697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc344fbd-4da3-47a6-a1fb-4d9cd770e45f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:55.767291 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-01aa5d08-dd66-48c1-941c-46e290aa5cef req-05c35936-3401-459e-9ee9-4ffe2aa562df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101892 Aug 04 13:53:55.769055 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 60/140] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:53:55.770690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc344fbd-4da3-47a6-a1fb-4d9cd770e45f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:55.771149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc344fbd-4da3-47a6-a1fb-4d9cd770e45f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:55.771939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc344fbd-4da3-47a6-a1fb-4d9cd770e45f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:55.772381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc344fbd-4da3-47a6-a1fb-4d9cd770e45f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:55.900999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Calling method '.version_select at 0x7f4700f3e790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:55.904244 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:55.904244 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:55.905864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:55.906635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:55.926325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:55.927036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:55.949196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:55.950007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:55.972908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:55.973632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.020090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.023645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.048537 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0c7c5db-d61f-4571-9b53-6699ce244541 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.277621 Aug 04 13:53:56.053049 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 61/141] 10.222.0.66 () {60 vars in 1243 bytes} [Thu Aug 4 13:53:55 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:53:56.070242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Calling method '.version_select at 0x7f4700efbca0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:56.080716 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:56.080716 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:56.082158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.082832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.100585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.101162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.131629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.132459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.141740 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc344fbd-4da3-47a6-a1fb-4d9cd770e45f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1640 microversion: 2.1 time: 0.382507 Aug 04 13:53:56.144578 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 81/142] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:55 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1640 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:56.149540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.150163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.165001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2bffaf71-0cc2-4ec1-a201-b375e7092ba3 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:56.165500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2bffaf71-0cc2-4ec1-a201-b375e7092ba3 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:56.171970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bffaf71-0cc2-4ec1-a201-b375e7092ba3 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.173124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bffaf71-0cc2-4ec1-a201-b375e7092ba3 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.174127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bffaf71-0cc2-4ec1-a201-b375e7092ba3 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.174702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bffaf71-0cc2-4ec1-a201-b375e7092ba3 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.182221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.182680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.189332 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1afd681e-fed0-4118-baa4-3172d083a930 tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.122626 Aug 04 13:53:56.190403 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 62/143] 10.222.0.66 () {60 vars in 1222 bytes} [Thu Aug 4 13:53:56 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:53:56.207905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c46e515-8e11-4d20-97a6-f282290e1fea tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Calling method '.version_select at 0x7f4700e60e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:56.209958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2bffaf71-0cc2-4ec1-a201-b375e7092ba3 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:53:56.210696 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:53:56.210696 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:53:56.212272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c46e515-8e11-4d20-97a6-f282290e1fea tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.212810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c46e515-8e11-4d20-97a6-f282290e1fea tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.232178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c46e515-8e11-4d20-97a6-f282290e1fea tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.232633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c46e515-8e11-4d20-97a6-f282290e1fea tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.240234 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c46e515-8e11-4d20-97a6-f282290e1fea tempest-HypervisorAdminV253TestBase-1694647324 tempest-HypervisorAdminV253TestBase-1694647324-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/ce5065ff-e9a2-4fb8-a5b8-75ae6af38916" status: 200 len: 794 microversion: 2.53 time: 0.040848 Aug 04 13:53:56.250567 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 63/144] 10.222.0.66 () {60 vars in 1298 bytes} [Thu Aug 4 13:53:56 2022] GET /compute/v2.1/os-hypervisors/ce5065ff-e9a2-4fb8-a5b8-75ae6af38916 => generated 794 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:53:56.375319 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2bffaf71-0cc2-4ec1-a201-b375e7092ba3 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 204 len: 0 microversion: 2.1 time: 0.213865 Aug 04 13:53:56.376048 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 82/145] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:53:56 2022] DELETE /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 13:53:56.384734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37104903-531f-41dd-bec8-894c824bc572 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:56.385834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-37104903-531f-41dd-bec8-894c824bc572 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:56.393376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37104903-531f-41dd-bec8-894c824bc572 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.394257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37104903-531f-41dd-bec8-894c824bc572 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.395052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37104903-531f-41dd-bec8-894c824bc572 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.395484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37104903-531f-41dd-bec8-894c824bc572 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.551037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-37104903-531f-41dd-bec8-894c824bc572 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:56.567413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-deb807f2-d2a3-495a-bb77-3fde26d05ba2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:56.568847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-deb807f2-d2a3-495a-bb77-3fde26d05ba2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:56.577351 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37104903-531f-41dd-bec8-894c824bc572 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1493 microversion: 2.1 time: 0.196813 Aug 04 13:53:56.578453 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 64/146] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:56 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1493 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:56.583963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb807f2-d2a3-495a-bb77-3fde26d05ba2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.584477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb807f2-d2a3-495a-bb77-3fde26d05ba2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.585937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb807f2-d2a3-495a-bb77-3fde26d05ba2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.586738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb807f2-d2a3-495a-bb77-3fde26d05ba2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.675069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2be16400-af00-4dca-8c5b-e2eb421c7f84 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:56.675819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2be16400-af00-4dca-8c5b-e2eb421c7f84 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:56.684277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2be16400-af00-4dca-8c5b-e2eb421c7f84 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.685697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2be16400-af00-4dca-8c5b-e2eb421c7f84 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.696026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2be16400-af00-4dca-8c5b-e2eb421c7f84 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:56.696908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2be16400-af00-4dca-8c5b-e2eb421c7f84 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:56.798620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2be16400-af00-4dca-8c5b-e2eb421c7f84 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:56.809223 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2be16400-af00-4dca-8c5b-e2eb421c7f84 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1293 microversion: 2.1 time: 0.139039 Aug 04 13:53:56.810800 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 65/147] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:56 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1293 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:56.916446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-deb807f2-d2a3-495a-bb77-3fde26d05ba2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:56.924555 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-deb807f2-d2a3-495a-bb77-3fde26d05ba2 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1388 microversion: 2.1 time: 0.362693 Aug 04 13:53:56.925257 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 83/148] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:56 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1388 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:57.603933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-522f187b-ca70-414c-8c8d-173daca9332c tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:57.606011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-522f187b-ca70-414c-8c8d-173daca9332c tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:57.618839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-522f187b-ca70-414c-8c8d-173daca9332c tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:57.619538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-522f187b-ca70-414c-8c8d-173daca9332c tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:57.620714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-522f187b-ca70-414c-8c8d-173daca9332c tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:57.621351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-522f187b-ca70-414c-8c8d-173daca9332c tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:57.831784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-11a0dcc3-6072-4437-8972-2f5e0f1e9f71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:57.832667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-11a0dcc3-6072-4437-8972-2f5e0f1e9f71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:57.843661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11a0dcc3-6072-4437-8972-2f5e0f1e9f71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:57.844384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11a0dcc3-6072-4437-8972-2f5e0f1e9f71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:57.845244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11a0dcc3-6072-4437-8972-2f5e0f1e9f71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:57.846236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11a0dcc3-6072-4437-8972-2f5e0f1e9f71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:57.935986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-11a0dcc3-6072-4437-8972-2f5e0f1e9f71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:57.940832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-522f187b-ca70-414c-8c8d-173daca9332c tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:57.949352 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-522f187b-ca70-414c-8c8d-173daca9332c tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1493 microversion: 2.1 time: 0.353585 Aug 04 13:53:57.966630 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 66/149] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:57 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1493 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:57.967628 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-11a0dcc3-6072-4437-8972-2f5e0f1e9f71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1291 microversion: 2.1 time: 0.124830 Aug 04 13:53:57.968983 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 84/150] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:57 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1291 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:53:57.986795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-77ad839c-f5a3-4c9a-82ec-19e5454e5edd tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:57.988497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-77ad839c-f5a3-4c9a-82ec-19e5454e5edd tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:58.000328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77ad839c-f5a3-4c9a-82ec-19e5454e5edd tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:58.003663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77ad839c-f5a3-4c9a-82ec-19e5454e5edd tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:58.006195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77ad839c-f5a3-4c9a-82ec-19e5454e5edd tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:58.006993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77ad839c-f5a3-4c9a-82ec-19e5454e5edd tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:58.395496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-77ad839c-f5a3-4c9a-82ec-19e5454e5edd tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:58.412903 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-77ad839c-f5a3-4c9a-82ec-19e5454e5edd tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1388 microversion: 2.1 time: 0.458490 Aug 04 13:53:58.413557 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 67/151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:57 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1388 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:58.761941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-985bc7a0-8009-4f5b-a0a3-7774eaf0908e tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] Action: 'create', calling method: .version_select at 0x7f4700fa2820>, body: {"security_group": {"name": "tempest-securitygroup-499181375", "description": "tempest-description-626893608"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:53:58.978387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-adab127d-dc1e-4444-a526-7a577ac1a197 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:58.980033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-adab127d-dc1e-4444-a526-7a577ac1a197 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:58.993860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adab127d-dc1e-4444-a526-7a577ac1a197 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:58.994651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adab127d-dc1e-4444-a526-7a577ac1a197 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:58.997378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adab127d-dc1e-4444-a526-7a577ac1a197 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:58.999040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adab127d-dc1e-4444-a526-7a577ac1a197 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:59.136704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-adab127d-dc1e-4444-a526-7a577ac1a197 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ad0fed28b4f40b49915d01ded853db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9804746bd04ab4a79fb9e54e805f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:53:59.152290 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-adab127d-dc1e-4444-a526-7a577ac1a197 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 200 len: 1451 microversion: 2.1 time: 0.179802 Aug 04 13:53:59.167974 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 68/152] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:58 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 1451 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:53:59.182656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9fdcff85-a21a-4253-b46a-833fbd45aa51 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:53:59.184698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9fdcff85-a21a-4253-b46a-833fbd45aa51 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:53:59.231534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fdcff85-a21a-4253-b46a-833fbd45aa51 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:59.233266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fdcff85-a21a-4253-b46a-833fbd45aa51 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:59.240388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fdcff85-a21a-4253-b46a-833fbd45aa51 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:53:59.250095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fdcff85-a21a-4253-b46a-833fbd45aa51 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:53:59.999542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9fdcff85-a21a-4253-b46a-833fbd45aa51 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:00.007919 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9fdcff85-a21a-4253-b46a-833fbd45aa51 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1333 microversion: 2.1 time: 0.838508 Aug 04 13:54:00.008591 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 69/153] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:53:59 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1333 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:00.015624 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-985bc7a0-8009-4f5b-a0a3-7774eaf0908e tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.489549 Aug 04 13:54:00.025708 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 85/154] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:53:58 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:00.028033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b59aa881-c123-40e3-b4f0-1f43a4f58fac req-7043acef-43de-43e8-941b-5c2933dc247d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6e7e50-fdd7-4395-ab38-d439c6747103", "name": "network-vif-deleted", "tag": "18367270-b495-4f90-90ae-4137701c1b40"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:00.030788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2aec27ce-accc-4898-9f3c-f6e3e968ce39 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:00.031744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2aec27ce-accc-4898-9f3c-f6e3e968ce39 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:00.040481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b59aa881-c123-40e3-b4f0-1f43a4f58fac req-7043acef-43de-43e8-941b-5c2933dc247d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:00.041999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b59aa881-c123-40e3-b4f0-1f43a4f58fac req-7043acef-43de-43e8-941b-5c2933dc247d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:00.044342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2aec27ce-accc-4898-9f3c-f6e3e968ce39 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:00.044797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2aec27ce-accc-4898-9f3c-f6e3e968ce39 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:00.045637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2aec27ce-accc-4898-9f3c-f6e3e968ce39 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:00.046125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2aec27ce-accc-4898-9f3c-f6e3e968ce39 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:00.047915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:00.059459 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b59aa881-c123-40e3-b4f0-1f43a4f58fac req-7043acef-43de-43e8-941b-5c2933dc247d service nova] Creating event network-vif-deleted:18367270-b495-4f90-90ae-4137701c1b40 for instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 on n-h2-844627-10 Aug 04 13:54:00.066229 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b59aa881-c123-40e3-b4f0-1f43a4f58fac req-7043acef-43de-43e8-941b-5c2933dc247d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042492 Aug 04 13:54:00.067076 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 70/155] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:00.073775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b6cd7f63-c4d3-4712-b2fc-ec61ab612f51 tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] Action: 'create', calling method: .version_select at 0x7f4700e603a0>, body: {"security_group": {"name": "tempest-securitygroup-963576965", "description": "tempest-description-865264264"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:00.365321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2aec27ce-accc-4898-9f3c-f6e3e968ce39 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:00.373981 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2aec27ce-accc-4898-9f3c-f6e3e968ce39 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1388 microversion: 2.1 time: 0.347011 Aug 04 13:54:00.374842 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 86/156] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:00 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1388 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:00.380687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:00.381598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:00.388134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:00.389415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:00.390413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:00.390949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:00.406998 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] HTTP exception thrown: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Request method failure captured: Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 HTTP/1.1 Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689OW-Q1llww2w_h5LnDNwjX1BkmU_KFIl4j5XOcz6W1CE0FYFtEmtRksFSGdEEqdtP4hutRzSRFu0y49qMDCBdxRJTwiaEEhAB2PIcAcRCI95xqi_QayHwQCMOUZjmDYlQHzDbRrVIiJk8LtKzzx98pMaJ-LJ9Aqmx_XYQxESy-K8c Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2e9804746bd04ab4a79fb9e54e805f60 Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AggregatesAdminTestJSON-526225307 Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:00.426543 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e9804746bd04ab4a79fb9e54e805f60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e9804746bd04ab4a79fb9e54e805f60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e9804746bd04ab4a79fb9e54e805f60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e9804746bd04ab4a79fb9e54e805f60"}]}] Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AggregatesAdminTestJSON-526225307 Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2e9804746bd04ab4a79fb9e54e805f60 Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-526225307 Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AggregatesAdminTestJSON-526225307-project Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 0ad0fed28b4f40b49915d01ded853db9 Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AggregatesAdminTestJSON-526225307-project Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:00.427854 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '4f6e7e50-fdd7-4395-ab38-d439c6747103'} Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:00.428602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:00.434790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:00.436596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Returning 404 to user: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:00.436596 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f78d60c-3ff5-42d0-b805-194654c5c053 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 404 len: 111 microversion: 2.1 time: 0.052291 Aug 04 13:54:00.436596 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 87/157] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:00 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:00.442699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35bb0efc-0d1b-41ba-b319-1460506af748 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844627-10"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:00.447433 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:00.447433 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:00.459296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35bb0efc-0d1b-41ba-b319-1460506af748 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:00.460010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35bb0efc-0d1b-41ba-b319-1460506af748 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:00.560289 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b6cd7f63-c4d3-4712-b2fc-ec61ab612f51 tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.491539 Aug 04 13:54:00.563337 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 71/158] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:54:00 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:00.894411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e95b256c-1506-417f-b317-e23adc44533b tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] Action: 'create', calling method: .version_select at 0x7f4700e7eaf0>, body: {"security_group": {"name": "tempest-securitygroup-1621457434", "description": "tempest-description-944091630"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:01.220419 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-35bb0efc-0d1b-41ba-b319-1460506af748 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.783458 Aug 04 13:54:01.221059 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 88/159] 10.222.0.66 () {60 vars in 1191 bytes} [Thu Aug 4 13:54:00 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:01.243911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0782080b-d2af-4bd8-9d5e-c0a7ad6d972c req-ed443be5-1488-43c0-924e-eb5c9367198d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4404b9e-c6d1-4f63-bb72-b180f02ca603", "tag": "7772b93f-4e1b-4b26-bc3c-00df0a0b3c45"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:01.285349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0782080b-d2af-4bd8-9d5e-c0a7ad6d972c req-ed443be5-1488-43c0-924e-eb5c9367198d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:01.285813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0782080b-d2af-4bd8-9d5e-c0a7ad6d972c req-ed443be5-1488-43c0-924e-eb5c9367198d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:01.323064 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0782080b-d2af-4bd8-9d5e-c0a7ad6d972c req-ed443be5-1488-43c0-924e-eb5c9367198d service nova] Creating event network-changed:7772b93f-4e1b-4b26-bc3c-00df0a0b3c45 for instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 on n-h2-844627-10 Aug 04 13:54:01.333455 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0782080b-d2af-4bd8-9d5e-c0a7ad6d972c req-ed443be5-1488-43c0-924e-eb5c9367198d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098425 Aug 04 13:54:01.334263 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 89/160] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:01.347115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-677d2908-ae83-4f33-a538-476ccc8d6d8f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:01.347849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-677d2908-ae83-4f33-a538-476ccc8d6d8f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:01.367458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-677d2908-ae83-4f33-a538-476ccc8d6d8f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:01.374784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-677d2908-ae83-4f33-a538-476ccc8d6d8f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:01.384536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-677d2908-ae83-4f33-a538-476ccc8d6d8f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:01.391116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-677d2908-ae83-4f33-a538-476ccc8d6d8f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:01.646135 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e95b256c-1506-417f-b317-e23adc44533b tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.074476 Aug 04 13:54:01.654278 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 72/161] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:54:00 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:01.661167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc885fc4-d4fd-4cf0-a1af-9ee65f6a4b4e tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:01.662256 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:01.662256 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:01.688596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-677d2908-ae83-4f33-a538-476ccc8d6d8f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:01.693227 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bc885fc4-d4fd-4cf0-a1af-9ee65f6a4b4e tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.036945 Aug 04 13:54:01.694327 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 73/162] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:01 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:01.698840 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-677d2908-ae83-4f33-a538-476ccc8d6d8f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1312 microversion: 2.1 time: 0.363551 Aug 04 13:54:01.699772 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 90/163] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:01 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1312 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:01.703543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-20298be3-283d-49cd-be46-9a10d87b4347 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:01.704730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-20298be3-283d-49cd-be46-9a10d87b4347 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:01.713193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20298be3-283d-49cd-be46-9a10d87b4347 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:01.713832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20298be3-283d-49cd-be46-9a10d87b4347 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:01.714986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20298be3-283d-49cd-be46-9a10d87b4347 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:01.715980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20298be3-283d-49cd-be46-9a10d87b4347 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:01.858334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-20298be3-283d-49cd-be46-9a10d87b4347 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:01.878931 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-20298be3-283d-49cd-be46-9a10d87b4347 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1388 microversion: 2.1 time: 0.179374 Aug 04 13:54:01.893303 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 74/164] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:01 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1388 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:01.899142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72416c93-0aab-4c06-a983-a5705d153a27 tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] Action: 'create', calling method: .version_select at 0x7f4700e604c0>, body: {"security_group": {"name": "tempest-securitygroup-1493077379", "description": "tempest-description-1737378603"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:01.904316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2369da6e-c8fc-460c-bff0-af6e4fc418d1 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:01.907728 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:01.907728 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:01.909908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2369da6e-c8fc-460c-bff0-af6e4fc418d1 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:01.910535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2369da6e-c8fc-460c-bff0-af6e4fc418d1 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:01.911818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2369da6e-c8fc-460c-bff0-af6e4fc418d1 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:01.912451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2369da6e-c8fc-460c-bff0-af6e4fc418d1 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:01.937133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:01.961516 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2369da6e-c8fc-460c-bff0-af6e4fc418d1 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.260249 Aug 04 13:54:01.962231 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 91/165] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:54:01 2022] GET /compute/v2.1/os-services => generated 949 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:01.969145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab01dbfa-9ce3-4c28-b6b6-0c2c4700470a tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1892290088"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:01.974158 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:01.974158 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:01.975788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.aggregate [None req-ab01dbfa-9ce3-4c28-b6b6-0c2c4700470a tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Generated uuid b759daf1-f8ff-4743-bc18-d3d162698107 for aggregate {{(pid=130960) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:02.000171 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab01dbfa-9ce3-4c28-b6b6-0c2c4700470a tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036336 Aug 04 13:54:02.001490 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 92/166] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:02.057064 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-72416c93-0aab-4c06-a983-a5705d153a27 tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.162356 Aug 04 13:54:02.065682 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 75/167] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:54:01 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:02.065682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-daed26ce-ca56-4500-9832-d1356106bae7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.066680 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:02.066680 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:02.067902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-daed26ce-ca56-4500-9832-d1356106bae7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.068355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-daed26ce-ca56-4500-9832-d1356106bae7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:02.068860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bea03cac-8af7-4a04-9180-a9588e82bee7 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Action: 'create', calling method: .version_select at 0x7f4700d93430>, body: {"keypair": {"name": "tempest-keypair-688944415", "type": "ssh", "user_id": "1314ca054f5e4350b7c3d153e5eae52b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3fPwmtHv8o/Ft42bq9+041s3vtXNbKRG9k1EdRg/3ANzhxWgpBo6In32KhMqWLbq6dmude/qCH2QRFFJMvkuSLmIieuOXv5SVkxnIckBQTfrg8PHEqEM2SB3K4a8EECQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:02.069174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-daed26ce-ca56-4500-9832-d1356106bae7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.069604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-daed26ce-ca56-4500-9832-d1356106bae7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:02.088765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-bea03cac-8af7-4a04-9180-a9588e82bee7 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Getting quotas for project 583a550ff7d34ba2af7fe5eea8d7d682. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:54:02.092913 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-daed26ce-ca56-4500-9832-d1356106bae7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=n-d-844627-10" status: 200 len: 581 microversion: 2.1 time: 0.033954 Aug 04 13:54:02.093034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-bea03cac-8af7-4a04-9180-a9588e82bee7 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Getting quotas for user 456acccb0f514432910b805a6e11c696 and project 583a550ff7d34ba2af7fe5eea8d7d682. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:54:02.093534 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 76/168] 10.222.0.66 () {58 vars in 1174 bytes} [Thu Aug 4 13:54:02 2022] GET /compute/v2.1/os-services?host=n-d-844627-10 => generated 581 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:02.098999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d89205a9-205c-4bf2-8cea-d1e6cfc9d25a tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:02.101415 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:02.101415 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:02.111115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d89205a9-205c-4bf2-8cea-d1e6cfc9d25a tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.111997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d89205a9-205c-4bf2-8cea-d1e6cfc9d25a tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:02.118677 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bea03cac-8af7-4a04-9180-a9588e82bee7 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.116036 Aug 04 13:54:02.119289 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 93/169] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 13:54:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 13:54:02.125773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7190bd3c-a5a7-4dd5-8d3b-c271ff8b28cc tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] Calling method '.version_select at 0x7f4700e26af0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.127508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:02.240693 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d89205a9-205c-4bf2-8cea-d1e6cfc9d25a tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.146147 Aug 04 13:54:02.241343 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 77/170] 10.222.0.66 () {60 vars in 1191 bytes} [Thu Aug 4 13:54:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:02.245866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-79c34256-dd8f-4b94-98e0-555f1c7879e7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.248655 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:02.248655 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:02.249982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79c34256-dd8f-4b94-98e0-555f1c7879e7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.250436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79c34256-dd8f-4b94-98e0-555f1c7879e7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:02.251308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79c34256-dd8f-4b94-98e0-555f1c7879e7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.252260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79c34256-dd8f-4b94-98e0-555f1c7879e7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:02.278252 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-79c34256-dd8f-4b94-98e0-555f1c7879e7 tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035470 Aug 04 13:54:02.281024 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 78/171] 10.222.0.66 () {58 vars in 1176 bytes} [Thu Aug 4 13:54:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:02.289471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-944e5fbe-d742-4538-8b94-71ac4b92a868 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Action: 'create', calling method: .version_select at 0x7f4700d5c1f0>, body: {"keypair": {"name": "tempest-keypair-1960188289", "type": "ssh", "user_id": "1314ca054f5e4350b7c3d153e5eae52b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHW3JlW2IN+nsM1ntradIt2c7Fea49e5DrGLgDFD0ooUr0vMhRYXvxyBZblzH57xWNAP9p//3WjCm+x8AtMQg7UXIKV8VMPhDJrqcODwugbxwNBzKliO85n0oV4ntIFvXQ=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:02.306390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-944e5fbe-d742-4538-8b94-71ac4b92a868 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Getting quotas for project 583a550ff7d34ba2af7fe5eea8d7d682. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:54:02.310573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-944e5fbe-d742-4538-8b94-71ac4b92a868 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Getting quotas for user 456acccb0f514432910b805a6e11c696 and project 583a550ff7d34ba2af7fe5eea8d7d682. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:54:02.334247 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-944e5fbe-d742-4538-8b94-71ac4b92a868 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.051477 Aug 04 13:54:02.334923 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 79/172] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 13:54:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 13:54:02.339335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6be37787-f8c3-4287-a815-076001d88d80 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.340103 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:02.340103 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:02.347538 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6be37787-f8c3-4287-a815-076001d88d80 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.011595 Aug 04 13:54:02.348111 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 80/173] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 13:54:02 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:02.352444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e2f2339-f7ae-437c-98b2-eef579a3f5fa tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.354796 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:02.354796 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:02.356028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e2f2339-f7ae-437c-98b2-eef579a3f5fa tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.356481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e2f2339-f7ae-437c-98b2-eef579a3f5fa tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:02.357314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e2f2339-f7ae-437c-98b2-eef579a3f5fa tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.357753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e2f2339-f7ae-437c-98b2-eef579a3f5fa tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:02.381920 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2e2f2339-f7ae-437c-98b2-eef579a3f5fa tempest-ServicesAdminTestJSON-1706690080 tempest-ServicesAdminTestJSON-1706690080-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.032783 Aug 04 13:54:02.382720 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 81/174] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:54:02 2022] GET /compute/v2.1/os-services => generated 949 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:02.387484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-23493eda-de3e-4131-92f2-e0536354d865 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Calling method '.version_select at 0x7f4700db0430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.398620 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-23493eda-de3e-4131-92f2-e0536354d865 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-688944415?user_id=1314ca054f5e4350b7c3d153e5eae52b" status: 200 len: 511 microversion: 2.10 time: 0.014962 Aug 04 13:54:02.399583 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 82/175] 10.222.0.66 () {60 vars in 1337 bytes} [Thu Aug 4 13:54:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-688944415?user_id=1314ca054f5e4350b7c3d153e5eae52b => generated 511 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:02.412105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fc901f22-67c6-4fae-b6e2-92ead6fd6b66 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:02.416338 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:02.416338 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:02.425696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc901f22-67c6-4fae-b6e2-92ead6fd6b66 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.426152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc901f22-67c6-4fae-b6e2-92ead6fd6b66 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:02.562114 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fc901f22-67c6-4fae-b6e2-92ead6fd6b66 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.161248 Aug 04 13:54:02.568889 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 83/176] 10.222.0.66 () {60 vars in 1191 bytes} [Thu Aug 4 13:54:02 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:02.568889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-47130db1-f001-451d-afcd-a1e9065572dd tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Action: 'create', calling method: .version_select at 0x7f4700d5c280>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2059559339", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTO/G2AS2s3pc3D6IqDOV++gSiO+7KUr0BZtdmDzvl3DoZGSPAvz6j8D+tIm0Cogda4OOf1OowmIdJB4y7TUFC38O16c8oMCGD2Blv81rxJTjmvWR3zQfAP/d6xtQdq5A=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:02.587194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-47130db1-f001-451d-afcd-a1e9065572dd tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Getting quotas for project 583a550ff7d34ba2af7fe5eea8d7d682. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:54:02.591372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-47130db1-f001-451d-afcd-a1e9065572dd tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Getting quotas for user 456acccb0f514432910b805a6e11c696 and project 583a550ff7d34ba2af7fe5eea8d7d682. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:54:02.617634 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-47130db1-f001-451d-afcd-a1e9065572dd tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.053074 Aug 04 13:54:02.618486 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 84/177] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 13:54:02 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 13:54:02.627009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5ac152f6-7320-469a-981f-a4837f08b969 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.628841 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:02.628841 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:02.655496 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5ac152f6-7320-469a-981f-a4837f08b969 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.035766 Aug 04 13:54:02.657309 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 85/178] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:02 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:02.667289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-199ecc82-a2ae-4860-93b9-b43ba9089ba5 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Calling method '.version_select at 0x7f4700e7e5e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.672052 n-d-844627-10 devstack@n-api.service[130961]: WARNING oslo_db.sqlalchemy.utils [None req-199ecc82-a2ae-4860-93b9-b43ba9089ba5 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 13:54:02.681382 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-199ecc82-a2ae-4860-93b9-b43ba9089ba5 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] 10.222.0.66 "GET /compute/v2.1/os-keypairs?user_id=1314ca054f5e4350b7c3d153e5eae52b" status: 200 len: 725 microversion: 2.10 time: 0.022260 Aug 04 13:54:02.683497 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 86/179] 10.222.0.66 () {60 vars in 1259 bytes} [Thu Aug 4 13:54:02 2022] GET /compute/v2.1/os-keypairs?user_id=1314ca054f5e4350b7c3d153e5eae52b => generated 725 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:02.689223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ff079fe7-0398-40d4-9dc1-fdfa750903af tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-645555355"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:02.694622 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:02.694622 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:02.696148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-ff079fe7-0398-40d4-9dc1-fdfa750903af tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Generated uuid a7bcfb6d-e411-44a2-8bad-9f8a3c3a8e50 for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:02.728398 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ff079fe7-0398-40d4-9dc1-fdfa750903af tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.043551 Aug 04 13:54:02.729246 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 87/180] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:02.738727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd49b747-a7d5-4166-9b95-3c1aa7cd5ba9 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Calling method '.version_select at 0x7f4700d8ea60>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.765904 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd49b747-a7d5-4166-9b95-3c1aa7cd5ba9 tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2059559339" status: 204 len: 0 microversion: 2.10 time: 0.032008 Aug 04 13:54:02.767602 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 88/181] 10.222.0.66 () {60 vars in 1325 bytes} [Thu Aug 4 13:54:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2059559339 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 13:54:02.774146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ed8741a5-76c6-4cb1-8a9c-689492191fd5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:02.775061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ed8741a5-76c6-4cb1-8a9c-689492191fd5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:02.784312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed8741a5-76c6-4cb1-8a9c-689492191fd5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.785048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed8741a5-76c6-4cb1-8a9c-689492191fd5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:02.786133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed8741a5-76c6-4cb1-8a9c-689492191fd5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:02.786698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed8741a5-76c6-4cb1-8a9c-689492191fd5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:03.116659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ed8741a5-76c6-4cb1-8a9c-689492191fd5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:03.131670 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ed8741a5-76c6-4cb1-8a9c-689492191fd5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1312 microversion: 2.1 time: 0.362039 Aug 04 13:54:03.132950 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 89/182] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:02 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1312 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:03.150615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf4b6dfe-cda3-4a11-9602-0cea864f9d2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:03.154063 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:03.154063 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:03.165798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf4b6dfe-cda3-4a11-9602-0cea864f9d2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:03.166861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf4b6dfe-cda3-4a11-9602-0cea864f9d2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:03.463563 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf4b6dfe-cda3-4a11-9602-0cea864f9d2c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.329364 Aug 04 13:54:03.464371 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 90/183] 10.222.0.66 () {60 vars in 1191 bytes} [Thu Aug 4 13:54:03 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:03.474399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d9eb5dd5-9db7-46b8-ab14-51768737077a tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Calling method '.version_select at 0x7f4700d5cf70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:03.498433 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d9eb5dd5-9db7-46b8-ab14-51768737077a tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960188289?user_id=1314ca054f5e4350b7c3d153e5eae52b" status: 204 len: 0 microversion: 2.10 time: 0.027941 Aug 04 13:54:03.500671 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 91/184] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 13:54:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960188289?user_id=1314ca054f5e4350b7c3d153e5eae52b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 13:54:03.508926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf3aa84f-7d4c-413b-8815-6a368cb24339 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:03.509550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf3aa84f-7d4c-413b-8815-6a368cb24339 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:03.516358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf3aa84f-7d4c-413b-8815-6a368cb24339 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:03.517756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf3aa84f-7d4c-413b-8815-6a368cb24339 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:03.518661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf3aa84f-7d4c-413b-8815-6a368cb24339 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:03.519101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf3aa84f-7d4c-413b-8815-6a368cb24339 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:03.695779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bf3aa84f-7d4c-413b-8815-6a368cb24339 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:03.710809 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf3aa84f-7d4c-413b-8815-6a368cb24339 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1388 microversion: 2.1 time: 0.209777 Aug 04 13:54:03.711853 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 92/185] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:03 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1388 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:03.734767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2dd67530-8eec-49d2-99d2-ab69ae329580 req-5bdb5bb1-a59c-4ed3-b3b0-c5a4d53152b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206086e4-b66e-49e9-9299-4cc160efecbd", "name": "network-vif-plugged", "status": "completed", "tag": "c3f8fbbc-3537-4d62-9f4b-5adf086a2321"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:03.753561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2dd67530-8eec-49d2-99d2-ab69ae329580 req-5bdb5bb1-a59c-4ed3-b3b0-c5a4d53152b6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:03.754103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2dd67530-8eec-49d2-99d2-ab69ae329580 req-5bdb5bb1-a59c-4ed3-b3b0-c5a4d53152b6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:03.765947 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2dd67530-8eec-49d2-99d2-ab69ae329580 req-5bdb5bb1-a59c-4ed3-b3b0-c5a4d53152b6 service nova] Creating event network-vif-plugged:c3f8fbbc-3537-4d62-9f4b-5adf086a2321 for instance 206086e4-b66e-49e9-9299-4cc160efecbd on n-h1-844627-10 Aug 04 13:54:03.771546 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2dd67530-8eec-49d2-99d2-ab69ae329580 req-5bdb5bb1-a59c-4ed3-b3b0-c5a4d53152b6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057942 Aug 04 13:54:03.772577 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 93/186] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:03.778294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-054bd312-5c7d-4033-9534-14a7764f7d4c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:03.779201 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:03.779201 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:03.788353 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-054bd312-5c7d-4033-9534-14a7764f7d4c tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.014402 Aug 04 13:54:03.789585 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 94/187] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 13:54:03 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:03.794559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-77491ddd-c260-4ae8-831e-e36b9059b5dc tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] Calling method '.version_select at 0x7f4700d5c310>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:03.814902 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-77491ddd-c260-4ae8-831e-e36b9059b5dc tempest-KeyPairsV210TestJSON-1991744251 tempest-KeyPairsV210TestJSON-1991744251-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-688944415?user_id=1314ca054f5e4350b7c3d153e5eae52b" status: 204 len: 0 microversion: 2.10 time: 0.023770 Aug 04 13:54:03.816946 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 95/188] 10.222.0.66 () {60 vars in 1340 bytes} [Thu Aug 4 13:54:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-688944415?user_id=1314ca054f5e4350b7c3d153e5eae52b => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 13:54:03.826457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3ed085b6-4039-4d4f-a453-b281d5165d23 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:03.829947 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:03.829947 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:03.839628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ed085b6-4039-4d4f-a453-b281d5165d23 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:03.840266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ed085b6-4039-4d4f-a453-b281d5165d23 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:03.984693 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7190bd3c-a5a7-4dd5-8d3b-c271ff8b28cc tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] 10.222.0.66 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8308 microversion: 2.1 time: 1.862110 Aug 04 13:54:03.986034 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 94/189] 10.222.0.66 () {58 vars in 1191 bytes} [Thu Aug 4 13:54:02 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8308 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:04.007992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6235ba39-392b-44be-986e-533c80a722d2 tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] Calling method '.version_select at 0x7f4701005f70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:04.048085 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3ed085b6-4039-4d4f-a453-b281d5165d23 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.229439 Aug 04 13:54:04.049376 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 96/190] 10.222.0.66 () {60 vars in 1191 bytes} [Thu Aug 4 13:54:03 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:04.065045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b78803b5-9fa7-4e39-b687-ef1ac3bd9397 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:04.065936 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:04.065936 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:04.099021 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b78803b5-9fa7-4e39-b687-ef1ac3bd9397 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.042032 Aug 04 13:54:04.100105 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 97/191] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:04 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:04.112659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-04a243bd-0362-4299-a295-43f680ca2986 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-40236801"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:04.116073 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:04.116073 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:04.117231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-04a243bd-0362-4299-a295-43f680ca2986 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Generated uuid f3e5b3bc-4fbd-4a7e-aeff-bb2e76b6f5c5 for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:04.124684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=85,nova_api:DELETE=9 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:04.140441 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-04a243bd-0362-4299-a295-43f680ca2986 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.032451 Aug 04 13:54:04.148166 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 98/192] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:04 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:04.153563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e41a8538-4d8f-46a1-a7f8-a9db9bedf2e7 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:04.156624 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:04.156624 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:04.166346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e41a8538-4d8f-46a1-a7f8-a9db9bedf2e7 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:04.166908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e41a8538-4d8f-46a1-a7f8-a9db9bedf2e7 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:04.305404 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6235ba39-392b-44be-986e-533c80a722d2 tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.301859 Aug 04 13:54:04.314769 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 95/193] 10.222.0.66 () {58 vars in 1191 bytes} [Thu Aug 4 13:54:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:54:04.321253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-970dfa24-0bf4-4463-b8a4-1be8c3862e3a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:04.321982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-970dfa24-0bf4-4463-b8a4-1be8c3862e3a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:04.332136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-970dfa24-0bf4-4463-b8a4-1be8c3862e3a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:04.333048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-970dfa24-0bf4-4463-b8a4-1be8c3862e3a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:04.333849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-970dfa24-0bf4-4463-b8a4-1be8c3862e3a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:04.334542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-970dfa24-0bf4-4463-b8a4-1be8c3862e3a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:04.351701 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e41a8538-4d8f-46a1-a7f8-a9db9bedf2e7 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.201641 Aug 04 13:54:04.352373 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 99/194] 10.222.0.66 () {60 vars in 1191 bytes} [Thu Aug 4 13:54:04 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:04.358776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:04.362609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-556beb87-6332-43a0-a5c5-ec5d66422a9c tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] Calling method '.version_select at 0x7f4700e60790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:04.546236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-970dfa24-0bf4-4463-b8a4-1be8c3862e3a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:04.555234 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-970dfa24-0bf4-4463-b8a4-1be8c3862e3a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1312 microversion: 2.1 time: 0.239010 Aug 04 13:54:04.556513 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 96/195] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:04 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:04.561952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f874fd0e-f2a8-4fba-8bcb-cfad2ae92338 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844627-10"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:04.566206 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:04.566206 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:04.582559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f874fd0e-f2a8-4fba-8bcb-cfad2ae92338 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:04.585438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f874fd0e-f2a8-4fba-8bcb-cfad2ae92338 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:04.688604 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-556beb87-6332-43a0-a5c5-ec5d66422a9c tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/34862568-52aa-4211-b57d-69fcc5041ce7" status: 202 len: 0 microversion: 2.1 time: 0.330205 Aug 04 13:54:04.690784 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 100/196] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 13:54:04 2022] DELETE /compute/v2.1/os-security-groups/34862568-52aa-4211-b57d-69fcc5041ce7 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:04.699039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41833c71-79e1-4d11-85b2-fbd657b52f28 tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] Calling method '.version_select at 0x7f4700fa9430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:04.775133 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f874fd0e-f2a8-4fba-8bcb-cfad2ae92338 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 225 microversion: 2.1 time: 0.217039 Aug 04 13:54:04.776473 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 97/197] 10.222.0.66 () {60 vars in 1191 bytes} [Thu Aug 4 13:54:04 2022] POST /compute/v2.1/os-aggregates/4/action => generated 225 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:04.793703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ae90b79-2933-4ab6-be0a-32e84eb68756 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:04.795222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2ae90b79-2933-4ab6-be0a-32e84eb68756 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:04.802639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ae90b79-2933-4ab6-be0a-32e84eb68756 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:04.803376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ae90b79-2933-4ab6-be0a-32e84eb68756 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:04.804369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ae90b79-2933-4ab6-be0a-32e84eb68756 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:04.805075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ae90b79-2933-4ab6-be0a-32e84eb68756 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.030643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2ae90b79-2933-4ab6-be0a-32e84eb68756 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:05.043238 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ae90b79-2933-4ab6-be0a-32e84eb68756 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1388 microversion: 2.1 time: 0.264837 Aug 04 13:54:05.045860 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 98/198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:04 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1388 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:05.051302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30168401-88c6-4722-b9f9-8828b45ca239 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.052234 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.052234 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:05.066739 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-41833c71-79e1-4d11-85b2-fbd657b52f28 tempest-SecurityGroupsTestAdminJSON-861870622 tempest-SecurityGroupsTestAdminJSON-861870622-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/7aca4ea5-d859-4ddb-ad39-31309b3a143c" status: 202 len: 0 microversion: 2.1 time: 0.371619 Aug 04 13:54:05.069371 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 101/199] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 13:54:04 2022] DELETE /compute/v2.1/os-security-groups/7aca4ea5-d859-4ddb-ad39-31309b3a143c => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:54:05.078328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d0d748e-430e-4b68-ae9e-b698312a8c76 tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] Calling method '.version_select at 0x7f4700eeeee0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.086309 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30168401-88c6-4722-b9f9-8828b45ca239 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.039281 Aug 04 13:54:05.099783 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 99/200] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:05 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:05.104427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6e7af91e-6698-4ad4-a13f-c56e2b387a5d tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1286433862"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:05.110944 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.110944 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:05.112187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.aggregate [None req-6e7af91e-6698-4ad4-a13f-c56e2b387a5d tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Generated uuid 4992167c-3e4c-4f43-8e9e-19b335026883 for aggregate {{(pid=130960) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:05.158882 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6e7af91e-6698-4ad4-a13f-c56e2b387a5d tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057905 Aug 04 13:54:05.165527 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 100/201] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:05.171037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1435ff92-ae99-48f1-a2b6-1bcb432d0d7a tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.172136 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.172136 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:05.201861 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1435ff92-ae99-48f1-a2b6-1bcb432d0d7a tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.033857 Aug 04 13:54:05.202517 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 101/202] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:05 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:05.217864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d554751e-9c09-4522-9c71-aec6c8a7f6b4 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Calling method '.version_select at 0x7f4700d91940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.220713 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.220713 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:05.225588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d554751e-9c09-4522-9c71-aec6c8a7f6b4 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.226074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d554751e-9c09-4522-9c71-aec6c8a7f6b4 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.226942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d554751e-9c09-4522-9c71-aec6c8a7f6b4 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.227413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d554751e-9c09-4522-9c71-aec6c8a7f6b4 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.253422 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d554751e-9c09-4522-9c71-aec6c8a7f6b4 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.044832 Aug 04 13:54:05.255655 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 102/203] 10.222.0.66 () {58 vars in 1128 bytes} [Thu Aug 4 13:54:05 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:05.265455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-259a6ab5-161b-4dc2-8aee-ed90b72a81a5 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.266230 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.266230 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:05.276364 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-259a6ab5-161b-4dc2-8aee-ed90b72a81a5 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-259a6ab5-161b-4dc2-8aee-ed90b72a81a5 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Request method failure captured: Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689R8BKv6Qj25OPHXcukBqk5r6QpAHnJkEpI0DT9mfx5xhYZYpNGW7gQKx0uxvVBDc-YRDLhpmyVKinoWbvlRBosLxduLIxSe3imkGVl7OzZmLKhwF-Lfgw6BSYMBTmDx0SFasliGiD4BHLeH93A3wES708AjtveSy15UrnRDP8jun8 Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ed22884de9a24c5d8ace8243601f47a9 Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:54:05.280431 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed22884de9a24c5d8ace8243601f47a9"}]}] Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ed22884de9a24c5d8ace8243601f47a9 Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AggregatesAdminTestJSON-1906663317-project-admin Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 6961faf738bf4050a48e39694c17181a Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AggregatesAdminTestJSON-1906663317-project-admin Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: exception: Aggregate 5 could not be found. Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '5'} Aug 04 13:54:05.282403 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:05.283642 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 04 13:54:05.285893 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.287384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-259a6ab5-161b-4dc2-8aee-ed90b72a81a5 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:05.287384 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-259a6ab5-161b-4dc2-8aee-ed90b72a81a5 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.024577 Aug 04 13:54:05.287384 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 103/204] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 13:54:05 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:05.292350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f6d4e9fe-d658-45f7-8c04-9000ea3cf882 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Calling method '.version_select at 0x7f4700d93d30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.295000 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.295000 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:05.296812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6d4e9fe-d658-45f7-8c04-9000ea3cf882 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.297604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6d4e9fe-d658-45f7-8c04-9000ea3cf882 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.298973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6d4e9fe-d658-45f7-8c04-9000ea3cf882 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.300101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6d4e9fe-d658-45f7-8c04-9000ea3cf882 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.364166 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f6d4e9fe-d658-45f7-8c04-9000ea3cf882 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.076045 Aug 04 13:54:05.367461 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 104/205] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:05 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:05.379051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb62a9c0-f4a5-4a00-99d7-b316881140bf tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.380604 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.380604 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:05.402971 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-bb62a9c0-f4a5-4a00-99d7-b316881140bf tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb62a9c0-f4a5-4a00-99d7-b316881140bf tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Request method failure captured: Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689R8BKv6Qj25OPHXcukBqk5r6QpAHnJkEpI0DT9mfx5xhYZYpNGW7gQKx0uxvVBDc-YRDLhpmyVKinoWbvlRBosLxduLIxSe3imkGVl7OzZmLKhwF-Lfgw6BSYMBTmDx0SFasliGiD4BHLeH93A3wES708AjtveSy15UrnRDP8jun8 Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ed22884de9a24c5d8ace8243601f47a9 Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:54:05.406927 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed22884de9a24c5d8ace8243601f47a9"}]}] Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ed22884de9a24c5d8ace8243601f47a9 Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AggregatesAdminTestJSON-1906663317-project-admin Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 6961faf738bf4050a48e39694c17181a Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AggregatesAdminTestJSON-1906663317-project-admin Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: exception: Aggregate 5 could not be found. Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '5'} Aug 04 13:54:05.410160 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:05.413212 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:05.417955 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:05.425777 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:05.425777 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:05.425777 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:05.425777 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 04 13:54:05.425777 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:05.425777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb62a9c0-f4a5-4a00-99d7-b316881140bf tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:05.425777 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb62a9c0-f4a5-4a00-99d7-b316881140bf tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.056119 Aug 04 13:54:05.429863 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 105/206] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:05 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:05.430533 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d0d748e-430e-4b68-ae9e-b698312a8c76 tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/939f00f1-4c99-4c83-9337-1d675b12412f" status: 202 len: 0 microversion: 2.1 time: 0.356806 Aug 04 13:54:05.431938 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 102/207] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 13:54:05 2022] DELETE /compute/v2.1/os-security-groups/939f00f1-4c99-4c83-9337-1d675b12412f => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:05.437827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-542a065f-f7ea-4357-96be-494b72c61a6c tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-408462678"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:05.440890 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.440890 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:05.443672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-288d94a2-0738-4e4e-a472-9eba5b8aa98b tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Calling method '.version_select at 0x7f4701005820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.447011 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.447011 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:05.448353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-542a065f-f7ea-4357-96be-494b72c61a6c tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Generated uuid 739c8011-a594-4d42-8df2-6e71208a848c for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:05.448801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-288d94a2-0738-4e4e-a472-9eba5b8aa98b tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.449435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-288d94a2-0738-4e4e-a472-9eba5b8aa98b tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.451123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-288d94a2-0738-4e4e-a472-9eba5b8aa98b tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.451631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-288d94a2-0738-4e4e-a472-9eba5b8aa98b tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.489008 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-288d94a2-0738-4e4e-a472-9eba5b8aa98b tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.056136 Aug 04 13:54:05.489687 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 106/208] 10.222.0.66 () {58 vars in 1128 bytes} [Thu Aug 4 13:54:05 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:05.499758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-59a979d7-c1d6-436f-8834-3c18a806e3e3 tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] Calling method '.version_select at 0x7f4700d93790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.518772 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-542a065f-f7ea-4357-96be-494b72c61a6c tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.084637 Aug 04 13:54:05.519927 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 103/209] 10.222.0.66 () {62 vars in 1205 bytes} [Thu Aug 4 13:54:05 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:05.528206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c1e3f73-346c-47f1-983c-260ec003aae0 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-334077956", "name": "tempest-test_aggregate-444359951"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:05.567533 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.567533 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:05.568901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-3c1e3f73-346c-47f1-983c-260ec003aae0 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Generated uuid ec546dda-cf29-4feb-a2b7-6bdde9d077fe for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:05.612501 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c1e3f73-346c-47f1-983c-260ec003aae0 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.089705 Aug 04 13:54:05.620071 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 104/210] 10.222.0.66 () {60 vars in 1165 bytes} [Thu Aug 4 13:54:05 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:05.620071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51959405-54d8-4861-9763-7cfcde21413f tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Calling method '.version_select at 0x7f4700fa9040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.620430 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.620430 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:05.631702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51959405-54d8-4861-9763-7cfcde21413f tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.633226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51959405-54d8-4861-9763-7cfcde21413f tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.674009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51959405-54d8-4861-9763-7cfcde21413f tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.674987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51959405-54d8-4861-9763-7cfcde21413f tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.706862 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-51959405-54d8-4861-9763-7cfcde21413f tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-h2-844627-10" status: 200 len: 471 microversion: 2.1 time: 0.090379 Aug 04 13:54:05.707965 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 105/211] 10.222.0.66 () {58 vars in 1173 bytes} [Thu Aug 4 13:54:05 2022] GET /compute/v2.1/os-hosts/n-h2-844627-10 => generated 471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:05.717600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1aaf7b3c-8c12-46e3-8c04-357b50790cf1 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-628959965"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:05.799501 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:05.799501 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:05.863026 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1aaf7b3c-8c12-46e3-8c04-357b50790cf1 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.149376 Aug 04 13:54:05.864332 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 106/212] 10.222.0.66 () {62 vars in 1210 bytes} [Thu Aug 4 13:54:05 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:05.872769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08f24f82-1b0a-43e9-bd2f-61021e48a1b4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:05.873892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-08f24f82-1b0a-43e9-bd2f-61021e48a1b4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:05.883840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08f24f82-1b0a-43e9-bd2f-61021e48a1b4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.884652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08f24f82-1b0a-43e9-bd2f-61021e48a1b4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:05.886320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08f24f82-1b0a-43e9-bd2f-61021e48a1b4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:05.887250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08f24f82-1b0a-43e9-bd2f-61021e48a1b4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:06.117215 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-59a979d7-c1d6-436f-8834-3c18a806e3e3 tempest-SecurityGroupsTestAdminJSON-976282139 tempest-SecurityGroupsTestAdminJSON-976282139-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/8fbb55f9-4588-439e-bea2-399abc057240" status: 202 len: 0 microversion: 2.1 time: 0.626163 Aug 04 13:54:06.118368 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 107/213] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 13:54:05 2022] DELETE /compute/v2.1/os-security-groups/8fbb55f9-4588-439e-bea2-399abc057240 => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:06.126664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d5e4801-f5ac-4297-bed9-87247be8cc81 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:06.127805 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.127805 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:06.176619 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6d5e4801-f5ac-4297-bed9-87247be8cc81 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.056899 Aug 04 13:54:06.177480 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 108/214] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:06 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:06.188264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff6caf43-1ec3-47d7-805a-70b576fe75d2 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Calling method '.version_select at 0x7f4700d935e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:06.193590 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.193590 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:06.210523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff6caf43-1ec3-47d7-805a-70b576fe75d2 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:06.211737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff6caf43-1ec3-47d7-805a-70b576fe75d2 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:06.269234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff6caf43-1ec3-47d7-805a-70b576fe75d2 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:06.269725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff6caf43-1ec3-47d7-805a-70b576fe75d2 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:06.302430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08f24f82-1b0a-43e9-bd2f-61021e48a1b4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:06.315703 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08f24f82-1b0a-43e9-bd2f-61021e48a1b4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1312 microversion: 2.1 time: 0.447853 Aug 04 13:54:06.334835 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 107/215] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:05 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1312 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:06.342284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-648d81a4-64b2-418a-af88-3cebd8582e78 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:06.343741 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.343741 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:06.354946 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-648d81a4-64b2-418a-af88-3cebd8582e78 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.016968 Aug 04 13:54:06.356373 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 108/216] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 13:54:06 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:06.362844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-964b3f85-cb46-42d9-a219-a40a3793b054 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:06.363707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-964b3f85-cb46-42d9-a219-a40a3793b054 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:06.371263 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff6caf43-1ec3-47d7-805a-70b576fe75d2 tempest-HostsAdminTestJSON-1113325984 tempest-HostsAdminTestJSON-1113325984-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-h1-844627-10" status: 200 len: 471 microversion: 2.1 time: 0.187257 Aug 04 13:54:06.375659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-964b3f85-cb46-42d9-a219-a40a3793b054 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:06.377521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-964b3f85-cb46-42d9-a219-a40a3793b054 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:06.378816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-964b3f85-cb46-42d9-a219-a40a3793b054 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:06.379011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-964b3f85-cb46-42d9-a219-a40a3793b054 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:06.385471 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 109/217] 10.222.0.66 () {58 vars in 1173 bytes} [Thu Aug 4 13:54:06 2022] GET /compute/v2.1/os-hosts/n-h1-844627-10 => generated 471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:06.397876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cb1ca79-b770-4d0a-951b-f65daddddf55 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:06.399668 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.399668 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:06.410656 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-8cb1ca79-b770-4d0a-951b-f65daddddf55 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cb1ca79-b770-4d0a-951b-f65daddddf55 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Request method failure captured: Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689R8BKv6Qj25OPHXcukBqk5r6QpAHnJkEpI0DT9mfx5xhYZYpNGW7gQKx0uxvVBDc-YRDLhpmyVKinoWbvlRBosLxduLIxSe3imkGVl7OzZmLKhwF-Lfgw6BSYMBTmDx0SFasliGiD4BHLeH93A3wES708AjtveSy15UrnRDP8jun8 Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ed22884de9a24c5d8ace8243601f47a9 Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:54:06.416501 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed22884de9a24c5d8ace8243601f47a9"}]}] Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ed22884de9a24c5d8ace8243601f47a9 Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AggregatesAdminTestJSON-1906663317-project-admin Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 6961faf738bf4050a48e39694c17181a Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AggregatesAdminTestJSON-1906663317-project-admin Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: exception: Aggregate 7 could not be found. Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '7'} Aug 04 13:54:06.418099 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:06.418971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 04 13:54:06.420471 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.425075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cb1ca79-b770-4d0a-951b-f65daddddf55 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:06.426079 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8cb1ca79-b770-4d0a-951b-f65daddddf55 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.041223 Aug 04 13:54:06.430300 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 110/218] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 13:54:06 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:06.442512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b079541a-4ade-4be4-82d2-ad09c6248631 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:06.446304 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.446304 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:06.465925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b079541a-4ade-4be4-82d2-ad09c6248631 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:06.466717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b079541a-4ade-4be4-82d2-ad09c6248631 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:06.598592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-964b3f85-cb46-42d9-a219-a40a3793b054 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:06.608970 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-964b3f85-cb46-42d9-a219-a40a3793b054 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1388 microversion: 2.1 time: 0.250785 Aug 04 13:54:06.625667 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 109/219] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:06 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1388 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:06.631463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a800bf4-efad-4c4a-8953-3f66a14f56a3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:06.640387 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.640387 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:06.662803 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b079541a-4ade-4be4-82d2-ad09c6248631 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.230252 Aug 04 13:54:06.663633 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 111/220] 10.222.0.66 () {62 vars in 1232 bytes} [Thu Aug 4 13:54:06 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:06.667138 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3a800bf4-efad-4c4a-8953-3f66a14f56a3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a800bf4-efad-4c4a-8953-3f66a14f56a3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Request method failure captured: Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689R8BKv6Qj25OPHXcukBqk5r6QpAHnJkEpI0DT9mfx5xhYZYpNGW7gQKx0uxvVBDc-YRDLhpmyVKinoWbvlRBosLxduLIxSe3imkGVl7OzZmLKhwF-Lfgw6BSYMBTmDx0SFasliGiD4BHLeH93A3wES708AjtveSy15UrnRDP8jun8 Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: ed22884de9a24c5d8ace8243601f47a9 Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:06.671977 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ed22884de9a24c5d8ace8243601f47a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ed22884de9a24c5d8ace8243601f47a9"}]}] Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: ed22884de9a24c5d8ace8243601f47a9 Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1906663317 Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminTestJSON-1906663317-project-admin Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6961faf738bf4050a48e39694c17181a Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminTestJSON-1906663317-project-admin Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: exception: Aggregate 7 could not be found. Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7'} Aug 04 13:54:06.673301 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:06.674022 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:06.675007 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:06.676295 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:06.676295 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:06.676295 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:06.676295 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 04 13:54:06.676295 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:06.678298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a800bf4-efad-4c4a-8953-3f66a14f56a3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:06.679520 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a800bf4-efad-4c4a-8953-3f66a14f56a3 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.052123 Aug 04 13:54:06.680629 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 110/221] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:06 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:06.686263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-991f596b-9840-4440-991f-30f6e8ad69c2 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:06.690217 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.690217 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:06.700996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-991f596b-9840-4440-991f-30f6e8ad69c2 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:06.701620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-991f596b-9840-4440-991f-30f6e8ad69c2 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:06.874719 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-991f596b-9840-4440-991f-30f6e8ad69c2 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.192577 Aug 04 13:54:06.876198 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 111/222] 10.222.0.66 () {62 vars in 1232 bytes} [Thu Aug 4 13:54:06 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:06.883473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f173b6ec-9f57-47ab-b401-a4ad57bd6445 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1848158975"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:06.888754 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.888754 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:06.890255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-f173b6ec-9f57-47ab-b401-a4ad57bd6445 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Generated uuid a9da63c0-79c2-4d0d-a139-3c709aaa6328 for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:06.930283 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f173b6ec-9f57-47ab-b401-a4ad57bd6445 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052421 Aug 04 13:54:06.930971 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 112/223] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:06.936378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38861819-4c4a-4ef3-ae7c-54335dce8313 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:06.938352 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.938352 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:06.975189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-38861819-4c4a-4ef3-ae7c-54335dce8313 tempest-AggregatesAdminTestV241-1591228528 tempest-AggregatesAdminTestV241-1591228528-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.042788 Aug 04 13:54:06.980670 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 113/224] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 13:54:06 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:06.987466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-baa51018-ea9b-42a2-a76a-c50595fb9c34 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:06.989132 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:06.989132 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:06.999806 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-baa51018-ea9b-42a2-a76a-c50595fb9c34 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.017580 Aug 04 13:54:07.000947 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 114/225] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 13:54:06 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:07.016146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f5c22992-331d-4839-b9ae-d56931fe5fc0 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:07.019549 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.019549 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:07.049998 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f5c22992-331d-4839-b9ae-d56931fe5fc0 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.040584 Aug 04 13:54:07.052614 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 115/226] 10.222.0.66 () {60 vars in 1191 bytes} [Thu Aug 4 13:54:07 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:07.064719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-686431b9-cea0-40e5-9396-6999b558b148 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:07.065622 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.065622 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:07.084845 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-686431b9-cea0-40e5-9396-6999b558b148 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.025482 Aug 04 13:54:07.085794 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 116/227] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 13:54:07 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:07.106163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3bb71b35-13d4-49e3-a54f-95127579f210 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:07.107853 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.107853 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:07.139349 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3bb71b35-13d4-49e3-a54f-95127579f210 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.045024 Aug 04 13:54:07.144296 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 117/228] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:07 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:07.155402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3f7746b7-af76-4c8f-94af-a855ac1170a8 req-7a07c786-2719-4792-94e7-081de898d792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4404b9e-c6d1-4f63-bb72-b180f02ca603", "name": "network-vif-plugged", "status": "completed", "tag": "7772b93f-4e1b-4b26-bc3c-00df0a0b3c45"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:07.184441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d00df73a-add3-4b0d-a88e-dd2fe4aee3e0 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Action: 'update', calling method: .version_select at 0x7f4700e22d30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:07.192289 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.192289 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:07.194084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d00df73a-add3-4b0d-a88e-dd2fe4aee3e0 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.197353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3f7746b7-af76-4c8f-94af-a855ac1170a8 req-7a07c786-2719-4792-94e7-081de898d792 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.197947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3f7746b7-af76-4c8f-94af-a855ac1170a8 req-7a07c786-2719-4792-94e7-081de898d792 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.198709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d00df73a-add3-4b0d-a88e-dd2fe4aee3e0 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.235340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d00df73a-add3-4b0d-a88e-dd2fe4aee3e0 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.236252 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3f7746b7-af76-4c8f-94af-a855ac1170a8 req-7a07c786-2719-4792-94e7-081de898d792 service nova] Creating event network-vif-plugged:7772b93f-4e1b-4b26-bc3c-00df0a0b3c45 for instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 on n-h2-844627-10 Aug 04 13:54:07.237132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d00df73a-add3-4b0d-a88e-dd2fe4aee3e0 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.241859 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3f7746b7-af76-4c8f-94af-a855ac1170a8 req-7a07c786-2719-4792-94e7-081de898d792 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096099 Aug 04 13:54:07.243146 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 118/229] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:07.250273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd084c22-89d6-4c2d-8391-869c7d987a51 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-131157939", "availability_zone": "tempest-test_az-246974775"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:07.252673 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-d00df73a-add3-4b0d-a88e-dd2fe4aee3e0 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] HTTP exception thrown: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.254204 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.254204 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:07.255678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-bd084c22-89d6-4c2d-8391-869c7d987a51 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Generated uuid 13ce46c5-6f4d-4f0a-87ce-772406c32914 for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d00df73a-add3-4b0d-a88e-dd2fe4aee3e0 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Request method failure captured: Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/os-services/00ba7b6c-125c-4e1a-b9bc-68276f856e8e HTTP/1.1 Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 56 Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689-M2zq9IIjbJiIp7zLbg2kZOMrb8JgYvTJPDmrynaCJkef_7F9JnwWhnO-v6qCACLvyFFsbTPxCGGWYg3GoY5lWumry8gyJDg7Ts3qBCp4fpbVXik96iDlSXuf0TyXduT4nHWWQwoJmwznmjdT3I8x9TTDoISU1YFEzSqSGdcBZfA Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: b90df67995f94d4286b7607dc1c8a3d9 Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-204948809 Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:54:07.261491 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b90df67995f94d4286b7607dc1c8a3d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b90df67995f94d4286b7607dc1c8a3d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b90df67995f94d4286b7607dc1c8a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b90df67995f94d4286b7607dc1c8a3d9"}]}] Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-204948809 Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: b90df67995f94d4286b7607dc1c8a3d9 Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-204948809 Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 17fc0694fa70469b9838f654db59c099 Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:54:07.263090 n-d-844627-10 devstack@n-api.service[130960]: exception: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '00ba7b6c-125c-4e1a-b9bc-68276f856e8e', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.263993 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:07.265381 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:07.267269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:07.267269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.267269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.267269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d00df73a-add3-4b0d-a88e-dd2fe4aee3e0 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Returning 404 to user: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:07.267269 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d00df73a-add3-4b0d-a88e-dd2fe4aee3e0 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-services/00ba7b6c-125c-4e1a-b9bc-68276f856e8e" status: 404 len: 110 microversion: 2.53 time: 0.602188 Aug 04 13:54:07.268409 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 112/230] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Aug 4 13:54:06 2022] PUT /compute/v2.1/os-services/00ba7b6c-125c-4e1a-b9bc-68276f856e8e => generated 110 bytes in 604 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:07.279703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4175696c-30ab-47a8-b0c2-63755f1f8832 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Action: 'update', calling method: .version_select at 0x7f470365aca0>, body: {"status": "disabled"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:07.284475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4175696c-30ab-47a8-b0c2-63755f1f8832 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.285026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4175696c-30ab-47a8-b0c2-63755f1f8832 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.292419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4175696c-30ab-47a8-b0c2-63755f1f8832 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.292967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4175696c-30ab-47a8-b0c2-63755f1f8832 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.299900 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-4175696c-30ab-47a8-b0c2-63755f1f8832 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] HTTP exception thrown: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4175696c-30ab-47a8-b0c2-63755f1f8832 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Request method failure captured: Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/os-services/00ba7b6c-125c-4e1a-b9bc-68276f856e8e HTTP/1.1 Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 22 Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689-M2zq9IIjbJiIp7zLbg2kZOMrb8JgYvTJPDmrynaCJkef_7F9JnwWhnO-v6qCACLvyFFsbTPxCGGWYg3GoY5lWumry8gyJDg7Ts3qBCp4fpbVXik96iDlSXuf0TyXduT4nHWWQwoJmwznmjdT3I8x9TTDoISU1YFEzSqSGdcBZfA Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: b90df67995f94d4286b7607dc1c8a3d9 Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-204948809 Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:54:07.302218 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b90df67995f94d4286b7607dc1c8a3d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b90df67995f94d4286b7607dc1c8a3d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b90df67995f94d4286b7607dc1c8a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b90df67995f94d4286b7607dc1c8a3d9"}]}] Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-204948809 Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: b90df67995f94d4286b7607dc1c8a3d9 Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-204948809 Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 17fc0694fa70469b9838f654db59c099 Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: {"status": "disabled"} Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: exception: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.303931 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '00ba7b6c-125c-4e1a-b9bc-68276f856e8e', 'body': {'status': 'disabled'}} Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.305023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:07.306577 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:07.308222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.308222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.309791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4175696c-30ab-47a8-b0c2-63755f1f8832 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Returning 404 to user: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:07.311347 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4175696c-30ab-47a8-b0c2-63755f1f8832 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-services/00ba7b6c-125c-4e1a-b9bc-68276f856e8e" status: 404 len: 110 microversion: 2.53 time: 0.035511 Aug 04 13:54:07.312956 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 113/231] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Aug 4 13:54:07 2022] PUT /compute/v2.1/os-services/00ba7b6c-125c-4e1a-b9bc-68276f856e8e => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:07.323361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dcbad4dc-45ac-4d9b-a8e4-23b829f2dd8a tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Action: 'update', calling method: .version_select at 0x7f4700d4bf70>, body: {"status": "enabled"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:07.327651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dcbad4dc-45ac-4d9b-a8e4-23b829f2dd8a tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.328327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dcbad4dc-45ac-4d9b-a8e4-23b829f2dd8a tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.328466 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd084c22-89d6-4c2d-8391-869c7d987a51 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.082735 Aug 04 13:54:07.331178 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 119/232] 10.222.0.66 () {60 vars in 1165 bytes} [Thu Aug 4 13:54:07 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:07.338739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dcbad4dc-45ac-4d9b-a8e4-23b829f2dd8a tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.339684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dcbad4dc-45ac-4d9b-a8e4-23b829f2dd8a tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.346628 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-dcbad4dc-45ac-4d9b-a8e4-23b829f2dd8a tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] HTTP exception thrown: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.347720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5df19606-7a3c-422a-b951-98bbf2426eca tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:07.348519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5df19606-7a3c-422a-b951-98bbf2426eca tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dcbad4dc-45ac-4d9b-a8e4-23b829f2dd8a tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Request method failure captured: Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/os-services/00ba7b6c-125c-4e1a-b9bc-68276f856e8e HTTP/1.1 Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 21 Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689-M2zq9IIjbJiIp7zLbg2kZOMrb8JgYvTJPDmrynaCJkef_7F9JnwWhnO-v6qCACLvyFFsbTPxCGGWYg3GoY5lWumry8gyJDg7Ts3qBCp4fpbVXik96iDlSXuf0TyXduT4nHWWQwoJmwznmjdT3I8x9TTDoISU1YFEzSqSGdcBZfA Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: b90df67995f94d4286b7607dc1c8a3d9 Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-204948809 Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:54:07.349072 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b90df67995f94d4286b7607dc1c8a3d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b90df67995f94d4286b7607dc1c8a3d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b90df67995f94d4286b7607dc1c8a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b90df67995f94d4286b7607dc1c8a3d9"}]}] Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-204948809 Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: b90df67995f94d4286b7607dc1c8a3d9 Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-204948809 Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 17fc0694fa70469b9838f654db59c099 Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: {"status": "enabled"} Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: exception: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.350680 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '00ba7b6c-125c-4e1a-b9bc-68276f856e8e', 'body': {'status': 'enabled'}} Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.351686 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:07.353205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:07.354590 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. Aug 04 13:54:07.354590 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:07.355859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dcbad4dc-45ac-4d9b-a8e4-23b829f2dd8a tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Returning 404 to user: Service 00ba7b6c-125c-4e1a-b9bc-68276f856e8e could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:07.357048 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dcbad4dc-45ac-4d9b-a8e4-23b829f2dd8a tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-services/00ba7b6c-125c-4e1a-b9bc-68276f856e8e" status: 404 len: 110 microversion: 2.53 time: 0.038387 Aug 04 13:54:07.358474 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 114/233] 10.222.0.66 () {62 vars in 1309 bytes} [Thu Aug 4 13:54:07 2022] PUT /compute/v2.1/os-services/00ba7b6c-125c-4e1a-b9bc-68276f856e8e => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:07.366733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6642cb46-420e-43ef-bbcd-339828458e7f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-131157939_new", "availability_zone": "tempest-test_az-246974775_new"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:07.366872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5df19606-7a3c-422a-b951-98bbf2426eca tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.367267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5df19606-7a3c-422a-b951-98bbf2426eca tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.371141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5df19606-7a3c-422a-b951-98bbf2426eca tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.371606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5df19606-7a3c-422a-b951-98bbf2426eca tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.513359 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.513359 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:07.557632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6642cb46-420e-43ef-bbcd-339828458e7f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.558092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6642cb46-420e-43ef-bbcd-339828458e7f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.604332 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6642cb46-420e-43ef-bbcd-339828458e7f tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.243963 Aug 04 13:54:07.605385 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 115/234] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 13:54:07 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:07.609917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d51521b1-2b46-4193-b2ae-8e8376424280 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:07.612395 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.612395 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:07.613795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d51521b1-2b46-4193-b2ae-8e8376424280 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.614413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d51521b1-2b46-4193-b2ae-8e8376424280 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.615231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d51521b1-2b46-4193-b2ae-8e8376424280 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.615779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d51521b1-2b46-4193-b2ae-8e8376424280 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.696398 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d51521b1-2b46-4193-b2ae-8e8376424280 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.089900 Aug 04 13:54:07.698008 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 116/235] 10.222.0.66 () {60 vars in 1178 bytes} [Thu Aug 4 13:54:07 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:54:07.707647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5df19606-7a3c-422a-b951-98bbf2426eca tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:07.707903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-907643e7-19d1-4aa7-84ff-e7e36f437ba6 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:07.713508 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.713508 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:07.717560 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5df19606-7a3c-422a-b951-98bbf2426eca tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1312 microversion: 2.1 time: 0.379695 Aug 04 13:54:07.718137 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 120/236] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:07 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1312 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:07.731893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f16f2ea3-bfef-4483-85d5-753d7acbedcc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:07.732844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f16f2ea3-bfef-4483-85d5-753d7acbedcc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:07.755109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f16f2ea3-bfef-4483-85d5-753d7acbedcc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.759468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f16f2ea3-bfef-4483-85d5-753d7acbedcc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.761199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f16f2ea3-bfef-4483-85d5-753d7acbedcc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.761556 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-907643e7-19d1-4aa7-84ff-e7e36f437ba6 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.057572 Aug 04 13:54:07.761977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f16f2ea3-bfef-4483-85d5-753d7acbedcc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.763171 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 117/237] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 13:54:07 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:07.772729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d6386898-bf16-471a-8bf0-4b5233dbf261 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:07.779325 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.779325 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:07.782923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6386898-bf16-471a-8bf0-4b5233dbf261 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.783464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6386898-bf16-471a-8bf0-4b5233dbf261 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.784599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6386898-bf16-471a-8bf0-4b5233dbf261 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.787442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6386898-bf16-471a-8bf0-4b5233dbf261 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.827331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:07.838716 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d6386898-bf16-471a-8bf0-4b5233dbf261 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.072862 Aug 04 13:54:07.839941 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 118/238] 10.222.0.66 () {60 vars in 1211 bytes} [Thu Aug 4 13:54:07 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:54:07.849812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2f165df5-893a-4a5b-bdd1-343001c51fd0 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:07.852104 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.852104 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:07.900050 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2f165df5-893a-4a5b-bdd1-343001c51fd0 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.058271 Aug 04 13:54:07.900731 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 119/239] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:07 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:07.909405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ffb78d86-4b3f-411f-94af-889ffbcccee6 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:07.913874 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.913874 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:07.915828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffb78d86-4b3f-411f-94af-889ffbcccee6 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.916274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffb78d86-4b3f-411f-94af-889ffbcccee6 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.917124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffb78d86-4b3f-411f-94af-889ffbcccee6 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:07.918098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffb78d86-4b3f-411f-94af-889ffbcccee6 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:07.955325 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ffb78d86-4b3f-411f-94af-889ffbcccee6 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.053127 Aug 04 13:54:07.956644 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 120/240] 10.222.0.66 () {60 vars in 1178 bytes} [Thu Aug 4 13:54:07 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:54:07.963417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43c17aef-a81c-440c-8da5-f2293c7c6fa5 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-300098834"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:07.967116 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:07.967116 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:07.968371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.aggregate [None req-43c17aef-a81c-440c-8da5-f2293c7c6fa5 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Generated uuid 00333e14-a15e-4d09-ae01-3801bdbbf87d for aggregate {{(pid=130960) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:08.029098 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-43c17aef-a81c-440c-8da5-f2293c7c6fa5 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071084 Aug 04 13:54:08.032056 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 121/241] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:08.050114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2b294587-2dde-4b64-aa16-fd14318efec1 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.053974 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:08.053974 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:08.055559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b294587-2dde-4b64-aa16-fd14318efec1 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.056230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b294587-2dde-4b64-aa16-fd14318efec1 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.057847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b294587-2dde-4b64-aa16-fd14318efec1 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.058484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b294587-2dde-4b64-aa16-fd14318efec1 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.091781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f16f2ea3-bfef-4483-85d5-753d7acbedcc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:08.092539 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2b294587-2dde-4b64-aa16-fd14318efec1 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=n-d-844627-10&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.058254 Aug 04 13:54:08.093840 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 122/242] 10.222.0.66 () {60 vars in 1237 bytes} [Thu Aug 4 13:54:08 2022] GET /compute/v2.1/os-services?host=n-d-844627-10&binary=xxx => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:08.102641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4fa791a6-4d7b-46d3-87c5-707fff351703 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.103771 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:08.103771 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:08.110955 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f16f2ea3-bfef-4483-85d5-753d7acbedcc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1588 microversion: 2.1 time: 0.388345 Aug 04 13:54:08.111443 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4fa791a6-4d7b-46d3-87c5-707fff351703 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.016293 Aug 04 13:54:08.118142 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 123/243] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 13:54:08 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:08.118768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f30b7e11-c228-4596-96f8-422cac493017 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.121544 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:08.121544 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:08.122915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f30b7e11-c228-4596-96f8-422cac493017 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.124430 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 121/244] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:07 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1588 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:08.131992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f30b7e11-c228-4596-96f8-422cac493017 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.132985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f30b7e11-c228-4596-96f8-422cac493017 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.143851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f30b7e11-c228-4596-96f8-422cac493017 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.146161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7bde1cc-e2f1-4841-a355-a4974d4397a7 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.147310 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:08.147310 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:08.183385 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f30b7e11-c228-4596-96f8-422cac493017 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.069417 Aug 04 13:54:08.184357 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e7bde1cc-e2f1-4841-a355-a4974d4397a7 tempest-AggregatesAdminTestJSON-1906663317 tempest-AggregatesAdminTestJSON-1906663317-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.058302 Aug 04 13:54:08.193007 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 124/245] 10.222.0.66 () {60 vars in 1178 bytes} [Thu Aug 4 13:54:08 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:54:08.193007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2c8b263-89ab-48fb-a102-1ce434de8e1f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.193007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d2c8b263-89ab-48fb-a102-1ce434de8e1f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:08.195876 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 122/246] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:08 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:08.205193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2c8b263-89ab-48fb-a102-1ce434de8e1f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.205662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2c8b263-89ab-48fb-a102-1ce434de8e1f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.210307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-444c6bca-4bc0-4b35-9ce8-863c107f7781 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.210502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2c8b263-89ab-48fb-a102-1ce434de8e1f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.210760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2c8b263-89ab-48fb-a102-1ce434de8e1f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.224769 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:08.224769 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:08.228278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444c6bca-4bc0-4b35-9ce8-863c107f7781 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.228745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444c6bca-4bc0-4b35-9ce8-863c107f7781 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.229677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444c6bca-4bc0-4b35-9ce8-863c107f7781 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.230128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444c6bca-4bc0-4b35-9ce8-863c107f7781 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.311913 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-444c6bca-4bc0-4b35-9ce8-863c107f7781 tempest-ServicesAdminNegativeV253TestJSON-204948809 tempest-ServicesAdminNegativeV253TestJSON-204948809-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.114596 Aug 04 13:54:08.313039 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 123/247] 10.222.0.66 () {60 vars in 1239 bytes} [Thu Aug 4 13:54:08 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:08.321145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.323348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:08.328845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:08.333884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.334692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.335299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.335977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.354801 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] HTTP exception thrown: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Request method failure captured: Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 HTTP/1.1 Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689OW-Q1llww2w_h5LnDNwjX1BkmU_KFIl4j5XOcz6W1CE0FYFtEmtRksFSGdEEqdtP4hutRzSRFu0y49qMDCBdxRJTwiaEEhAB2PIcAcRCI95xqi_QayHwQCMOUZjmDYlQHzDbRrVIiJk8LtKzzx98pMaJ-LJ9Aqmx_XYQxESy-K8c Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2e9804746bd04ab4a79fb9e54e805f60 Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminTestJSON-526225307 Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:08.357824 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e9804746bd04ab4a79fb9e54e805f60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e9804746bd04ab4a79fb9e54e805f60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e9804746bd04ab4a79fb9e54e805f60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e9804746bd04ab4a79fb9e54e805f60"}]}] Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminTestJSON-526225307 Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2e9804746bd04ab4a79fb9e54e805f60 Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-526225307 Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminTestJSON-526225307-project Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 0ad0fed28b4f40b49915d01ded853db9 Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminTestJSON-526225307-project Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.359340 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4f6e7e50-fdd7-4395-ab38-d439c6747103'} Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:08.360283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.361728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.363891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Returning 404 to user: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:08.365285 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76cbd258-13f9-4e8e-8b47-cd1eca5723bb tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 404 len: 111 microversion: 2.1 time: 0.050760 Aug 04 13:54:08.366018 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 124/248] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:54:08 2022] DELETE /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:08.437915 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2c8b263-89ab-48fb-a102-1ce434de8e1f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.252053 Aug 04 13:54:08.439402 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 125/249] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 13:54:08 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:08.444122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.446194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] [instance: 4f6e7e50-fdd7-4395-ab38-d439c6747103] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:08.455229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.455794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.456814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.457625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.475066 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] HTTP exception thrown: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Request method failure captured: Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 HTTP/1.1 Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689OW-Q1llww2w_h5LnDNwjX1BkmU_KFIl4j5XOcz6W1CE0FYFtEmtRksFSGdEEqdtP4hutRzSRFu0y49qMDCBdxRJTwiaEEhAB2PIcAcRCI95xqi_QayHwQCMOUZjmDYlQHzDbRrVIiJk8LtKzzx98pMaJ-LJ9Aqmx_XYQxESy-K8c Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2e9804746bd04ab4a79fb9e54e805f60 Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AggregatesAdminTestJSON-526225307 Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:08.477285 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e9804746bd04ab4a79fb9e54e805f60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e9804746bd04ab4a79fb9e54e805f60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e9804746bd04ab4a79fb9e54e805f60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e9804746bd04ab4a79fb9e54e805f60"}]}] Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AggregatesAdminTestJSON-526225307 Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2e9804746bd04ab4a79fb9e54e805f60 Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-526225307 Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AggregatesAdminTestJSON-526225307-project Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 0ad0fed28b4f40b49915d01ded853db9 Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AggregatesAdminTestJSON-526225307-project Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.478891 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '4f6e7e50-fdd7-4395-ab38-d439c6747103'} Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:08.479726 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. Aug 04 13:54:08.481114 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.485056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] Returning 404 to user: Instance 4f6e7e50-fdd7-4395-ab38-d439c6747103 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:08.486652 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5aad8300-d132-499f-8a85-05bf1616d5e6 tempest-AggregatesAdminTestJSON-526225307 tempest-AggregatesAdminTestJSON-526225307-project] 10.222.0.66 "GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103" status: 404 len: 111 microversion: 2.1 time: 0.046113 Aug 04 13:54:08.487797 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 126/250] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:08 2022] GET /compute/v2.1/servers/4f6e7e50-fdd7-4395-ab38-d439c6747103 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:08.743019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1ae306ec-13e6-4e92-b4eb-bc8b3f202472 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.744150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1ae306ec-13e6-4e92-b4eb-bc8b3f202472 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:08.754890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ae306ec-13e6-4e92-b4eb-bc8b3f202472 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.755617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ae306ec-13e6-4e92-b4eb-bc8b3f202472 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.759432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ae306ec-13e6-4e92-b4eb-bc8b3f202472 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:08.760531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ae306ec-13e6-4e92-b4eb-bc8b3f202472 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:08.964986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a41e00a-bd54-4f7e-b29d-e1f10187b1a1 tempest-ServicesAdminNegativeV253TestJSON-1280156763 tempest-ServicesAdminNegativeV253TestJSON-1280156763-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:08.967950 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:08.967950 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:08.986063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9a41e00a-bd54-4f7e-b29d-e1f10187b1a1 tempest-ServicesAdminNegativeV253TestJSON-1280156763 tempest-ServicesAdminNegativeV253TestJSON-1280156763-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '161d762477c14763aefa6725e54b6cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908ce1b83796465da843b73ae5eae11a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a41e00a-bd54-4f7e-b29d-e1f10187b1a1 tempest-ServicesAdminNegativeV253TestJSON-1280156763 tempest-ServicesAdminNegativeV253TestJSON-1280156763-project] Request method failure captured: Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6898MBXISwxSyvjbXk1N7obmbtJ3VKb4hQebg8zRPdutjFh73-55ziESlt3eq72oYIOM8MaCjIEP-2zSdJ5RnNcHNvTUuKA4GixLGpbWoT_qA4G9e_iKJ2FlYqFTL1A06IQcwTQ4GmEYRQD03zZqrvVo6L4a6uc69pMhgQpv_kXw15M Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 908ce1b83796465da843b73ae5eae11a Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1280156763 Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:08.989016 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/908ce1b83796465da843b73ae5eae11a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_908ce1b83796465da843b73ae5eae11a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/908ce1b83796465da843b73ae5eae11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/908ce1b83796465da843b73ae5eae11a"}]}] Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1280156763 Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 908ce1b83796465da843b73ae5eae11a Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1280156763 Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1280156763-project Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 161d762477c14763aefa6725e54b6cf2 Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1280156763-project Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 13:54:08.990457 n-d-844627-10 devstack@n-api.service[130961]: action_args: {} Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:08.991348 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 13:54:08.992739 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:08.997578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a41e00a-bd54-4f7e-b29d-e1f10187b1a1 tempest-ServicesAdminNegativeV253TestJSON-1280156763 tempest-ServicesAdminNegativeV253TestJSON-1280156763-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:09.004516 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a41e00a-bd54-4f7e-b29d-e1f10187b1a1 tempest-ServicesAdminNegativeV253TestJSON-1280156763 tempest-ServicesAdminNegativeV253TestJSON-1280156763-project] 10.222.0.66 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.637073 Aug 04 13:54:09.007126 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 125/251] 10.222.0.66 () {60 vars in 1178 bytes} [Thu Aug 4 13:54:08 2022] GET /compute/v2.1/os-services => generated 112 bytes in 640 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:09.108882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1ae306ec-13e6-4e92-b4eb-bc8b3f202472 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:09.119141 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1ae306ec-13e6-4e92-b4eb-bc8b3f202472 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1462 microversion: 2.1 time: 0.380225 Aug 04 13:54:09.119725 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 127/252] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:08 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1462 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:09.910352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e4f0a85-fe73-4c18-8c65-2d9c2eb90242 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:09.915028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4e4f0a85-fe73-4c18-8c65-2d9c2eb90242 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:09.939909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e4f0a85-fe73-4c18-8c65-2d9c2eb90242 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:09.941301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e4f0a85-fe73-4c18-8c65-2d9c2eb90242 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:09.943607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e4f0a85-fe73-4c18-8c65-2d9c2eb90242 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:09.944404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e4f0a85-fe73-4c18-8c65-2d9c2eb90242 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:10.086480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86b72395-9d5d-4a26-bda7-8518a604e8b1 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:10.087277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-86b72395-9d5d-4a26-bda7-8518a604e8b1 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:10.098280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86b72395-9d5d-4a26-bda7-8518a604e8b1 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:10.099192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86b72395-9d5d-4a26-bda7-8518a604e8b1 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:10.102611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86b72395-9d5d-4a26-bda7-8518a604e8b1 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:10.104245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86b72395-9d5d-4a26-bda7-8518a604e8b1 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:10.484217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-86b72395-9d5d-4a26-bda7-8518a604e8b1 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:10.498798 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86b72395-9d5d-4a26-bda7-8518a604e8b1 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 200 len: 1588 microversion: 2.1 time: 0.417558 Aug 04 13:54:10.499404 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 128/253] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:10 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 1588 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:10.504935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ee6c8ad7-69d2-4c13-90ca-a9976b5d96f8 req-5cca4c9b-a596-4d79-bb2c-7b53bb7b923e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "206086e4-b66e-49e9-9299-4cc160efecbd", "tag": "c3f8fbbc-3537-4d62-9f4b-5adf086a2321"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:10.528382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ee6c8ad7-69d2-4c13-90ca-a9976b5d96f8 req-5cca4c9b-a596-4d79-bb2c-7b53bb7b923e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:10.532353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ee6c8ad7-69d2-4c13-90ca-a9976b5d96f8 req-5cca4c9b-a596-4d79-bb2c-7b53bb7b923e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:10.556128 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ee6c8ad7-69d2-4c13-90ca-a9976b5d96f8 req-5cca4c9b-a596-4d79-bb2c-7b53bb7b923e service nova] Creating event network-changed:c3f8fbbc-3537-4d62-9f4b-5adf086a2321 for instance 206086e4-b66e-49e9-9299-4cc160efecbd on n-h1-844627-10 Aug 04 13:54:10.571459 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ee6c8ad7-69d2-4c13-90ca-a9976b5d96f8 req-5cca4c9b-a596-4d79-bb2c-7b53bb7b923e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070554 Aug 04 13:54:10.574859 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 129/254] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:10.690704 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e4f0a85-fe73-4c18-8c65-2d9c2eb90242 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1615 microversion: 2.1 time: 1.547783 Aug 04 13:54:10.704983 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 126/255] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:09 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1615 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:10.714460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:10.715121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:10.724863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:10.725334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:10.734150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:10.734837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:10.892478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6006f04353b541b6b4013236f34bfa33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3550ddad584a4ca8a2ad864c2aa63b2a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:10.892478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] flavor_id is None. Assuming migration. {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 13:54:10.892900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 13:54:12.098745 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-887e7d74-fb9b-4584-bd19-1dfee54efb0b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603/action" status: 202 len: 0 microversion: 2.1 time: 1.388196 Aug 04 13:54:12.100603 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 130/256] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:54:10 2022] POST /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603/action => generated 0 bytes in 1391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:12.109266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-00f89697-1878-4141-be2b-01a57e28061d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:12.111042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-00f89697-1878-4141-be2b-01a57e28061d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:12.121438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00f89697-1878-4141-be2b-01a57e28061d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.122136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00f89697-1878-4141-be2b-01a57e28061d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.123139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00f89697-1878-4141-be2b-01a57e28061d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.123783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00f89697-1878-4141-be2b-01a57e28061d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.293455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=21 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:12.295083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-00f89697-1878-4141-be2b-01a57e28061d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:12.305369 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-00f89697-1878-4141-be2b-01a57e28061d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1471 microversion: 2.1 time: 0.200110 Aug 04 13:54:12.306299 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 127/257] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:12 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:12.687168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-672b1fbb-2c79-45d5-a704-09a15a8b65ba tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:12.690677 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:12.690677 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:12.692477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-672b1fbb-2c79-45d5-a704-09a15a8b65ba tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.693021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-672b1fbb-2c79-45d5-a704-09a15a8b65ba tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.693842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-672b1fbb-2c79-45d5-a704-09a15a8b65ba tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.694510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-672b1fbb-2c79-45d5-a704-09a15a8b65ba tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.723148 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-672b1fbb-2c79-45d5-a704-09a15a8b65ba tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.436428 Aug 04 13:54:12.724026 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 131/258] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:54:12 2022] GET /compute/v2.1/os-services => generated 949 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:12.738803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4d3ed41-b99c-41f5-a86f-58099f703506 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:12.742850 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:12.742850 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:12.744133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4d3ed41-b99c-41f5-a86f-58099f703506 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.744790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4d3ed41-b99c-41f5-a86f-58099f703506 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.745609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4d3ed41-b99c-41f5-a86f-58099f703506 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.748795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4d3ed41-b99c-41f5-a86f-58099f703506 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.749573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=23 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:12.766198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:12.787349 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4d3ed41-b99c-41f5-a86f-58099f703506 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.052828 Aug 04 13:54:12.788441 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 128/259] 10.222.0.66 () {58 vars in 1170 bytes} [Thu Aug 4 13:54:12 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:12.802377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3e453d1f-c56f-4d38-b7ec-129162cd01e8 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:12.805038 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:12.805038 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:12.807672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e453d1f-c56f-4d38-b7ec-129162cd01e8 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.808220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e453d1f-c56f-4d38-b7ec-129162cd01e8 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.809195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e453d1f-c56f-4d38-b7ec-129162cd01e8 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.810148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e453d1f-c56f-4d38-b7ec-129162cd01e8 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.836988 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3e453d1f-c56f-4d38-b7ec-129162cd01e8 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.038875 Aug 04 13:54:12.837691 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 132/260] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:54:12 2022] GET /compute/v2.1/os-services => generated 949 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:12.853440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-67a32604-43ea-4eb8-9571-4b94fddd8179 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:12.856481 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:12.856481 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:12.858351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67a32604-43ea-4eb8-9571-4b94fddd8179 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.859094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67a32604-43ea-4eb8-9571-4b94fddd8179 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.860029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67a32604-43ea-4eb8-9571-4b94fddd8179 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.861005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67a32604-43ea-4eb8-9571-4b94fddd8179 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.887506 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-67a32604-43ea-4eb8-9571-4b94fddd8179 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=n-d-844627-10&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038092 Aug 04 13:54:12.888925 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 129/261] 10.222.0.66 () {58 vars in 1196 bytes} [Thu Aug 4 13:54:12 2022] GET /compute/v2.1/os-services?host=n-d-844627-10&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:54:12.901738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-053169b4-c47c-4bd8-8723-7d513cceddd4 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:12.904417 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:12.904417 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:12.906383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-053169b4-c47c-4bd8-8723-7d513cceddd4 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.907548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-053169b4-c47c-4bd8-8723-7d513cceddd4 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.908536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-053169b4-c47c-4bd8-8723-7d513cceddd4 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.909472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-053169b4-c47c-4bd8-8723-7d513cceddd4 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.937322 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-053169b4-c47c-4bd8-8723-7d513cceddd4 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.039366 Aug 04 13:54:12.938554 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 133/262] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:54:12 2022] GET /compute/v2.1/os-services => generated 949 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:12.951431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e17dc637-fbb2-44b2-a4d1-76d0fd9ca181 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:12.955767 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:12.955767 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:12.957790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e17dc637-fbb2-44b2-a4d1-76d0fd9ca181 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.958868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e17dc637-fbb2-44b2-a4d1-76d0fd9ca181 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.960431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e17dc637-fbb2-44b2-a4d1-76d0fd9ca181 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:12.961104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e17dc637-fbb2-44b2-a4d1-76d0fd9ca181 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:12.995009 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e17dc637-fbb2-44b2-a4d1-76d0fd9ca181 tempest-ServicesAdminNegativeTestJSON-1619433766 tempest-ServicesAdminNegativeTestJSON-1619433766-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.048368 Aug 04 13:54:12.996502 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 130/263] 10.222.0.66 () {58 vars in 1198 bytes} [Thu Aug 4 13:54:12 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:54:13.330789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5b15720b-ffcc-4429-a112-4b4c18e9a201 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:13.331681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b15720b-ffcc-4429-a112-4b4c18e9a201 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:13.338113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b15720b-ffcc-4429-a112-4b4c18e9a201 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:13.338560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b15720b-ffcc-4429-a112-4b4c18e9a201 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:13.340235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b15720b-ffcc-4429-a112-4b4c18e9a201 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:13.340696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b15720b-ffcc-4429-a112-4b4c18e9a201 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:13.484387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-657dcfbf-adb4-4623-baa5-b22c86ad813a tempest-ServicesAdminNegativeTestJSON-579252228 tempest-ServicesAdminNegativeTestJSON-579252228-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:13.487064 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:13.487064 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:13.488699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-657dcfbf-adb4-4623-baa5-b22c86ad813a tempest-ServicesAdminNegativeTestJSON-579252228 tempest-ServicesAdminNegativeTestJSON-579252228-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b7eebefc0c1e4a36ba2f5b541865ecde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a76d2e3fd6f4c8cb86909784593f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-657dcfbf-adb4-4623-baa5-b22c86ad813a tempest-ServicesAdminNegativeTestJSON-579252228 tempest-ServicesAdminNegativeTestJSON-579252228-project] Request method failure captured: Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-AT3WSwyx8QsOsQ3QNkKJzrXy3UnnGtC5Q9VgdyysUgiAm1FT9QgbGfJaFpNucAvOkJhBz93McToMpk7hhz2m4s4PyqH6r11SANkAjmWs0I4dsU98Z5tN10zIfwY0b07OdKDjR1heaWCIZE3bHlHPoeDkG7LFAsZ7X6xjuPoW8QB8 Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3a76d2e3fd6f4c8cb86909784593f9fd Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-579252228 Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:13.490643 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3a76d2e3fd6f4c8cb86909784593f9fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3a76d2e3fd6f4c8cb86909784593f9fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3a76d2e3fd6f4c8cb86909784593f9fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3a76d2e3fd6f4c8cb86909784593f9fd"}]}] Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-579252228 Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3a76d2e3fd6f4c8cb86909784593f9fd Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-579252228 Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServicesAdminNegativeTestJSON-579252228-project Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b7eebefc0c1e4a36ba2f5b541865ecde Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-579252228-project Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 13:54:13.492075 n-d-844627-10 devstack@n-api.service[130960]: action_args: {} Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:13.492750 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 13:54:13.493798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:13.496600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-657dcfbf-adb4-4623-baa5-b22c86ad813a tempest-ServicesAdminNegativeTestJSON-579252228 tempest-ServicesAdminNegativeTestJSON-579252228-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:13.497865 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-657dcfbf-adb4-4623-baa5-b22c86ad813a tempest-ServicesAdminNegativeTestJSON-579252228 tempest-ServicesAdminNegativeTestJSON-579252228-project] 10.222.0.66 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.491624 Aug 04 13:54:13.498842 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 134/264] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:54:13 2022] GET /compute/v2.1/os-services => generated 112 bytes in 494 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:13.523235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5b15720b-ffcc-4429-a112-4b4c18e9a201 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:13.531417 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5b15720b-ffcc-4429-a112-4b4c18e9a201 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1471 microversion: 2.1 time: 0.205203 Aug 04 13:54:13.532414 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 131/265] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:13 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:14.556539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d9743ac-40e6-4646-85bb-c98e6d333110 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:14.557373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6d9743ac-40e6-4646-85bb-c98e6d333110 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:14.565211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d9743ac-40e6-4646-85bb-c98e6d333110 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:14.567341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d9743ac-40e6-4646-85bb-c98e6d333110 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:14.568952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d9743ac-40e6-4646-85bb-c98e6d333110 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:14.570932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d9743ac-40e6-4646-85bb-c98e6d333110 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:14.807843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d9743ac-40e6-4646-85bb-c98e6d333110 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:14.819035 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6d9743ac-40e6-4646-85bb-c98e6d333110 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1471 microversion: 2.1 time: 0.266964 Aug 04 13:54:14.820511 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 135/266] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:14 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:15.841327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa86f07a-e3b4-4318-a2ba-a8d56e340222 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:15.841968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa86f07a-e3b4-4318-a2ba-a8d56e340222 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:15.851109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa86f07a-e3b4-4318-a2ba-a8d56e340222 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:15.853470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa86f07a-e3b4-4318-a2ba-a8d56e340222 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:15.854480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa86f07a-e3b4-4318-a2ba-a8d56e340222 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:15.854918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa86f07a-e3b4-4318-a2ba-a8d56e340222 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:16.008424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa86f07a-e3b4-4318-a2ba-a8d56e340222 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:16.018189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa86f07a-e3b4-4318-a2ba-a8d56e340222 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1471 microversion: 2.1 time: 0.180664 Aug 04 13:54:16.018943 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 132/267] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:15 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:16.444311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20b3819a-db17-48e5-9a5b-b7a212870e4d tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Calling method '.version_select at 0x7f4700cf9f70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:16.447274 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:16.447274 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:16.448482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20b3819a-db17-48e5-9a5b-b7a212870e4d tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:16.448955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20b3819a-db17-48e5-9a5b-b7a212870e4d tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:16.449786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20b3819a-db17-48e5-9a5b-b7a212870e4d tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:16.450414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20b3819a-db17-48e5-9a5b-b7a212870e4d tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:16.475035 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-20b3819a-db17-48e5-9a5b-b7a212870e4d tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.414828 Aug 04 13:54:16.481812 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 136/268] 10.222.0.66 () {58 vars in 1128 bytes} [Thu Aug 4 13:54:16 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:16.486905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1763537707", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:16.545998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:54:16.840162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:54:16.840596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:54:16.841137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:54:16.841613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:54:16.842204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:54:16.862015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:16.862556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:16.865591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:16.866392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:16.893637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Getting quotas for project 6f4528cf84674fb9b91e9d01bb3a898f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:54:16.899822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Getting quotas for user 5ed2cafefbc24d6c9ff8a7b0e052c4d3 and project 6f4528cf84674fb9b91e9d01bb3a898f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:54:16.914940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:54:16.917654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:54:16.984341 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-435423fa-5344-42b6-a22b-6a3d4c691d90 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890446 Aug 04 13:54:16.986410 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 133/269] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 13:54:17.050338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-790049e6-090f-42fe-8d85-aa3affaa0cb8 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Calling method '.version_select at 0x7f4700d7cc10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:17.052770 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.052770 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:17.053898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-790049e6-090f-42fe-8d85-aa3affaa0cb8 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '2220e1fb01cf4c688e382987358bdf3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8705c20cda45ffa5d97b1a2368d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-790049e6-090f-42fe-8d85-aa3affaa0cb8 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Request method failure captured: Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-FIbaJda_Auzzxh6qDjqFSVApwZpWItmIXWel7_Grp-agYJNNBC2IRHo_JkqgExYgISFZvYQLP1eB54rtg1tpnd1WNTDsTdRZsUS7HvbuBO2_uDhK8hL2L6Nf316sqA1DIF4_9cLUKMZ8-mNsJcnRRXB4dhDbLWXus8irE0qJNfN4 Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:17.055745 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}] Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 2220e1fb01cf4c688e382987358bdf3e Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: action_args: {} Aug 04 13:54:17.057308 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:17.058163 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 13:54:17.059248 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.060764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-790049e6-090f-42fe-8d85-aa3affaa0cb8 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:17.060764 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-790049e6-090f-42fe-8d85-aa3affaa0cb8 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] 10.222.0.66 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.565376 Aug 04 13:54:17.063439 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 137/270] 10.222.0.66 () {58 vars in 1128 bytes} [Thu Aug 4 13:54:16 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 572 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:17.072083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0feec715-234a-438e-9551-35dafeb8a3ac tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:17.072544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0feec715-234a-438e-9551-35dafeb8a3ac tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:17.118080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ead6244f-3160-4a8c-92bb-348115a4bd12 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:17.121588 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.121588 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:17.127139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ead6244f-3160-4a8c-92bb-348115a4bd12 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:17.128017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ead6244f-3160-4a8c-92bb-348115a4bd12 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:17.133047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ead6244f-3160-4a8c-92bb-348115a4bd12 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:17.133834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ead6244f-3160-4a8c-92bb-348115a4bd12 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:17.170437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0feec715-234a-438e-9551-35dafeb8a3ac tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:17.180648 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0feec715-234a-438e-9551-35dafeb8a3ac tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1223 microversion: 2.1 time: 0.116053 Aug 04 13:54:17.183029 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 138/271] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:17 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:17.196301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-de0ccf70-f9c0-4c2e-87f2-0568557ee94c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:17.198399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-de0ccf70-f9c0-4c2e-87f2-0568557ee94c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:17.209693 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ead6244f-3160-4a8c-92bb-348115a4bd12 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.221913 Aug 04 13:54:17.211925 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 134/272] 10.222.0.66 () {58 vars in 1176 bytes} [Thu Aug 4 13:54:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:17.219834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f44f6404-f2fd-4432-9a58-e0fe3f4cda04 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Calling method '.version_select at 0x7f4700eeec10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:17.223002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de0ccf70-f9c0-4c2e-87f2-0568557ee94c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:17.223466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de0ccf70-f9c0-4c2e-87f2-0568557ee94c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:17.224769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de0ccf70-f9c0-4c2e-87f2-0568557ee94c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:17.225302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de0ccf70-f9c0-4c2e-87f2-0568557ee94c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:17.228565 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.228565 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:17.234055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f44f6404-f2fd-4432-9a58-e0fe3f4cda04 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '2220e1fb01cf4c688e382987358bdf3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8705c20cda45ffa5d97b1a2368d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f44f6404-f2fd-4432-9a58-e0fe3f4cda04 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Request method failure captured: Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hosts/n-d-844627-10/reboot HTTP/1.1 Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-FIbaJda_Auzzxh6qDjqFSVApwZpWItmIXWel7_Grp-agYJNNBC2IRHo_JkqgExYgISFZvYQLP1eB54rtg1tpnd1WNTDsTdRZsUS7HvbuBO2_uDhK8hL2L6Nf316sqA1DIF4_9cLUKMZ8-mNsJcnRRXB4dhDbLWXus8irE0qJNfN4 Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:17.239847 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}] Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 2220e1fb01cf4c688e382987358bdf3e Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'n-d-844627-10'} Aug 04 13:54:17.241305 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:17.242422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 13:54:17.243653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.247238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f44f6404-f2fd-4432-9a58-e0fe3f4cda04 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:17.252744 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f44f6404-f2fd-4432-9a58-e0fe3f4cda04 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-d-844627-10/reboot" status: 403 len: 111 microversion: 2.1 time: 0.038907 Aug 04 13:54:17.256446 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 135/273] 10.222.0.66 () {58 vars in 1191 bytes} [Thu Aug 4 13:54:17 2022] GET /compute/v2.1/os-hosts/n-d-844627-10/reboot => generated 111 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:17.283131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:17.287234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4bc410a-b165-45ac-af3a-5bab1b2f09e0 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1529685904"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:17.311309 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.311309 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:17.314363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-f4bc410a-b165-45ac-af3a-5bab1b2f09e0 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Generated uuid e18c8db2-0433-4c93-8117-0b9a08c7e788 for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:17.396346 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4bc410a-b165-45ac-af3a-5bab1b2f09e0 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.138757 Aug 04 13:54:17.398182 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 136/274] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:17.414457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c6bed2a1-dee3-4eae-bbb6-9c8944c89d99 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Calling method '.version_select at 0x7f4700c67b80>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:17.415747 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.415747 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:17.434637 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-c6bed2a1-dee3-4eae-bbb6-9c8944c89d99 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c6bed2a1-dee3-4eae-bbb6-9c8944c89d99 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Request method failure captured: Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-H0gfs-4rvVCV3j7jrOTiSun0_31AA05-bLbAzYUZSkF6TUpG7t8F-MFvH2Rwk7jD8g_GlUOLDWd6p_9z5d_Me7lUPbEQUT5h13Ewcj-NnURz87P-Cmaz0N9qjwswAfnBA7_ZWYV0nY44_kcOcuNegYl7HOkyJxO0ZkvwlrQzB0Lc Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:17.437487 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}] Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7d9a63cf91d44572809b06de5e0ae004 Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'nonexistent_hostname'} Aug 04 13:54:17.439369 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:17.440125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 13:54:17.441223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.442749 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.447874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c6bed2a1-dee3-4eae-bbb6-9c8944c89d99 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:17.449916 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c6bed2a1-dee3-4eae-bbb6-9c8944c89d99 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.046487 Aug 04 13:54:17.452079 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 137/275] 10.222.0.66 () {58 vars in 1212 bytes} [Thu Aug 4 13:54:17 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:17.463331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac69d2d3-7de0-4637-9b1b-e13b018fdfba tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:17.466188 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.466188 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:17.487323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac69d2d3-7de0-4637-9b1b-e13b018fdfba tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:17.493425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac69d2d3-7de0-4637-9b1b-e13b018fdfba tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:17.706143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-de0ccf70-f9c0-4c2e-87f2-0568557ee94c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:17.714960 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-de0ccf70-f9c0-4c2e-87f2-0568557ee94c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1471 microversion: 2.1 time: 0.529206 Aug 04 13:54:17.720517 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 139/276] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:17 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1471 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:17.733677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0afe2c6c-e883-4f57-8626-68ccbd1dffb4 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Calling method '.version_select at 0x7f4700d7c550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:17.733677 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.733677 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:17.733677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0afe2c6c-e883-4f57-8626-68ccbd1dffb4 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '2220e1fb01cf4c688e382987358bdf3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8705c20cda45ffa5d97b1a2368d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0afe2c6c-e883-4f57-8626-68ccbd1dffb4 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Request method failure captured: Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-hosts/n-d-844627-10 HTTP/1.1 Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-FIbaJda_Auzzxh6qDjqFSVApwZpWItmIXWel7_Grp-agYJNNBC2IRHo_JkqgExYgISFZvYQLP1eB54rtg1tpnd1WNTDsTdRZsUS7HvbuBO2_uDhK8hL2L6Nf316sqA1DIF4_9cLUKMZ8-mNsJcnRRXB4dhDbLWXus8irE0qJNfN4 Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:17.735469 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}] Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 2220e1fb01cf4c688e382987358bdf3e Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'n-d-844627-10'} Aug 04 13:54:17.736834 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:17.737758 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 13:54:17.739033 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.751782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0afe2c6c-e883-4f57-8626-68ccbd1dffb4 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:17.753417 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0afe2c6c-e883-4f57-8626-68ccbd1dffb4 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-d-844627-10" status: 403 len: 109 microversion: 2.1 time: 0.025624 Aug 04 13:54:17.755358 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 140/277] 10.222.0.66 () {58 vars in 1170 bytes} [Thu Aug 4 13:54:17 2022] GET /compute/v2.1/os-hosts/n-d-844627-10 => generated 109 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:17.805413 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac69d2d3-7de0-4637-9b1b-e13b018fdfba tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.342494 Aug 04 13:54:17.805413 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 138/278] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 13:54:17 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:17.805413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3f8ec77-4d41-4eec-b0d2-18f53d94a927 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Calling method '.version_select at 0x7f4700eeec10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:17.805413 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.805413 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:17.812203 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-c3f8ec77-4d41-4eec-b0d2-18f53d94a927 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3f8ec77-4d41-4eec-b0d2-18f53d94a927 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Request method failure captured: Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-H0gfs-4rvVCV3j7jrOTiSun0_31AA05-bLbAzYUZSkF6TUpG7t8F-MFvH2Rwk7jD8g_GlUOLDWd6p_9z5d_Me7lUPbEQUT5h13Ewcj-NnURz87P-Cmaz0N9qjwswAfnBA7_ZWYV0nY44_kcOcuNegYl7HOkyJxO0ZkvwlrQzB0Lc Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:17.814598 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}] Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7d9a63cf91d44572809b06de5e0ae004 Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'nonexistent_hostname'} Aug 04 13:54:17.815937 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.816767 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:17.817810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.818948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3f8ec77-4d41-4eec-b0d2-18f53d94a927 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:17.818948 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c3f8ec77-4d41-4eec-b0d2-18f53d94a927 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.015695 Aug 04 13:54:17.818948 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 139/279] 10.222.0.66 () {58 vars in 1191 bytes} [Thu Aug 4 13:54:17 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:17.821775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-46301517-9693-4179-b9fe-2b776c184439 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:17.825345 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.825345 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:17.833555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46301517-9693-4179-b9fe-2b776c184439 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:17.834130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46301517-9693-4179-b9fe-2b776c184439 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:17.860723 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-46301517-9693-4179-b9fe-2b776c184439 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-844627-10. Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-46301517-9693-4179-b9fe-2b776c184439 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Request method failure captured: Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 40 Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-IJ7TyvzRXjiq4p8whOScIPVSsIj67tjZSVtYpzSJfH-BDbIW6L52oSV_6fTDm_9_faizyio56goV9-mhkK7UfSuqZ3u5KcAru7BIYUT_0GcJhkLPAsXVdrloniMthTUkAh2xuylGb_jmRk-ynbU5RqRdxATCVTtoxGP0lpReaYKc Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:17.864911 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}] Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6d62b806e7ab4254804b025536c5adf2 Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: {"add_host": {"host": "n-h2-844627-10"}} Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:17.866358 n-d-844627-10 devstack@n-api.service[130961]: exception: Aggregate 11 already has host n-h2-844627-10. Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-844627-10'}}} Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result.read() Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 13:54:17.867502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-844627-10-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 13:54:17.868704 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 13:54:17.869992 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 13:54:17.871231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result.read() Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-844627-10-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 13, 54, 17, 852493), 'updated_at': None, 'host': 'n-h2-844627-10', 'aggregate_id': 11}] Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.872178 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-844627-10. Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.873891 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-844627-10. Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:17.878508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:17.879905 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-844627-10. Aug 04 13:54:17.879905 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.879905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-46301517-9693-4179-b9fe-2b776c184439 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-844627-10. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:17.879905 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-46301517-9693-4179-b9fe-2b776c184439 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.058514 Aug 04 13:54:17.880435 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 140/280] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 13:54:17 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 04 13:54:17.885875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2b02d65e-3386-4eb5-8424-de0c15f10527 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Calling method '.version_select at 0x7f4700bc44c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:17.886894 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.886894 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:17.888229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2b02d65e-3386-4eb5-8424-de0c15f10527 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '2220e1fb01cf4c688e382987358bdf3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8705c20cda45ffa5d97b1a2368d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2b02d65e-3386-4eb5-8424-de0c15f10527 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Request method failure captured: Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hosts/n-d-844627-10/shutdown HTTP/1.1 Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-FIbaJda_Auzzxh6qDjqFSVApwZpWItmIXWel7_Grp-agYJNNBC2IRHo_JkqgExYgISFZvYQLP1eB54rtg1tpnd1WNTDsTdRZsUS7HvbuBO2_uDhK8hL2L6Nf316sqA1DIF4_9cLUKMZ8-mNsJcnRRXB4dhDbLWXus8irE0qJNfN4 Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:17.890035 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}] Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 2220e1fb01cf4c688e382987358bdf3e Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'n-d-844627-10'} Aug 04 13:54:17.891337 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:17.892046 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 13:54:17.893081 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:17.894997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2b02d65e-3386-4eb5-8424-de0c15f10527 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:17.898437 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2b02d65e-3386-4eb5-8424-de0c15f10527 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-d-844627-10/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.014411 Aug 04 13:54:17.904744 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 141/281] 10.222.0.66 () {58 vars in 1197 bytes} [Thu Aug 4 13:54:17 2022] GET /compute/v2.1/os-hosts/n-d-844627-10/shutdown => generated 113 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:17.925842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e2600e2e-eb58-4777-ae08-37118822351b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:17.930535 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:17.930535 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:17.963001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2600e2e-eb58-4777-ae08-37118822351b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:17.963466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2600e2e-eb58-4777-ae08-37118822351b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:18.157847 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e2600e2e-eb58-4777-ae08-37118822351b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.249841 Aug 04 13:54:18.160619 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 142/282] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 13:54:17 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:18.174685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-823bd7b1-f524-41e1-add7-f0ef2d1199c0 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Calling method '.version_select at 0x7f4700efb1f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.176461 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.176461 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:18.199493 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-823bd7b1-f524-41e1-add7-f0ef2d1199c0 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-823bd7b1-f524-41e1-add7-f0ef2d1199c0 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Request method failure captured: Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-H0gfs-4rvVCV3j7jrOTiSun0_31AA05-bLbAzYUZSkF6TUpG7t8F-MFvH2Rwk7jD8g_GlUOLDWd6p_9z5d_Me7lUPbEQUT5h13Ewcj-NnURz87P-Cmaz0N9qjwswAfnBA7_ZWYV0nY44_kcOcuNegYl7HOkyJxO0ZkvwlrQzB0Lc Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:18.204442 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}] Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7d9a63cf91d44572809b06de5e0ae004 Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'nonexistent_hostname'} Aug 04 13:54:18.205745 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:18.206569 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 13:54:18.207592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.208652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.213239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-823bd7b1-f524-41e1-add7-f0ef2d1199c0 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.215014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-823bd7b1-f524-41e1-add7-f0ef2d1199c0 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.051547 Aug 04 13:54:18.216357 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 143/283] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 13:54:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:18.223722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab3044d7-9aec-4e63-b6ae-b9deef1dbca5 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.225469 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.225469 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:18.239414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5cbe9d0c-644b-4bd7-9791-e5ec0a7ed65c tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-243326622", "id": 1990771490, "os-flavor-access:is_public": "True"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.242838 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.242838 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:18.252840 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ab3044d7-9aec-4e63-b6ae-b9deef1dbca5 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.034936 Aug 04 13:54:18.254669 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 144/284] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:18 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:18.262476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1f918d7-55c8-4431-b760-c83eeb52d34c tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.265035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e1f918d7-55c8-4431-b760-c83eeb52d34c tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:18.274128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1f918d7-55c8-4431-b760-c83eeb52d34c tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:18.276171 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5cbe9d0c-644b-4bd7-9791-e5ec0a7ed65c tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.518998 Aug 04 13:54:18.276315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1f918d7-55c8-4431-b760-c83eeb52d34c tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:18.280089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1f918d7-55c8-4431-b760-c83eeb52d34c tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:18.280834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1f918d7-55c8-4431-b760-c83eeb52d34c tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:18.284361 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 141/285] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:17 2022] POST /compute/v2.1/flavors => generated 429 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:18.290622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20418228-3806-4750-b7a1-2dc6c69baab6 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Calling method '.version_select at 0x7f4700d20160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.291975 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.291975 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:18.294330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-20418228-3806-4750-b7a1-2dc6c69baab6 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '2220e1fb01cf4c688e382987358bdf3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8705c20cda45ffa5d97b1a2368d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20418228-3806-4750-b7a1-2dc6c69baab6 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Request method failure captured: Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-hosts/n-d-844627-10/startup HTTP/1.1 Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-FIbaJda_Auzzxh6qDjqFSVApwZpWItmIXWel7_Grp-agYJNNBC2IRHo_JkqgExYgISFZvYQLP1eB54rtg1tpnd1WNTDsTdRZsUS7HvbuBO2_uDhK8hL2L6Nf316sqA1DIF4_9cLUKMZ8-mNsJcnRRXB4dhDbLWXus8irE0qJNfN4 Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:18.298274 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}] Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 2220e1fb01cf4c688e382987358bdf3e Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'n-d-844627-10'} Aug 04 13:54:18.299450 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:18.300159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 13:54:18.301769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.305514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20418228-3806-4750-b7a1-2dc6c69baab6 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.306593 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-20418228-3806-4750-b7a1-2dc6c69baab6 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] 10.222.0.66 "GET /compute/v2.1/os-hosts/n-d-844627-10/startup" status: 403 len: 110 microversion: 2.1 time: 0.020508 Aug 04 13:54:18.307355 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 142/286] 10.222.0.66 () {58 vars in 1194 bytes} [Thu Aug 4 13:54:18 2022] GET /compute/v2.1/os-hosts/n-d-844627-10/startup => generated 110 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:18.312194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff587388-306d-4f17-98d5-8809e0d7bed3 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1960245706"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.315885 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.315885 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:18.317277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.aggregate [None req-ff587388-306d-4f17-98d5-8809e0d7bed3 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Generated uuid 93ca50a2-2701-498c-9ec5-32d5bed7e824 for aggregate {{(pid=130960) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:18.352066 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff587388-306d-4f17-98d5-8809e0d7bed3 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.043428 Aug 04 13:54:18.361735 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 143/287] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:18.369488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2cff359-8f83-4619-ac3b-1423170f9275 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.373099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e1f918d7-55c8-4431-b760-c83eeb52d34c tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:18.373921 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.373921 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:18.382006 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e1f918d7-55c8-4431-b760-c83eeb52d34c tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1275 microversion: 2.1 time: 0.125416 Aug 04 13:54:18.386764 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 145/288] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:18 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1275 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:18.397649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fe9265eb-7b11-4702-ad51-55734726850c tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Calling method '.version_select at 0x7f470349f8b0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.400946 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.400946 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:18.409204 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2cff359-8f83-4619-ac3b-1423170f9275 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1990771490" status: 202 len: 0 microversion: 2.1 time: 0.046048 Aug 04 13:54:18.410884 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 144/289] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:54:18 2022] DELETE /compute/v2.1/flavors/1990771490 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:18.420738 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-fe9265eb-7b11-4702-ad51-55734726850c tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fe9265eb-7b11-4702-ad51-55734726850c tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Request method failure captured: Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-H0gfs-4rvVCV3j7jrOTiSun0_31AA05-bLbAzYUZSkF6TUpG7t8F-MFvH2Rwk7jD8g_GlUOLDWd6p_9z5d_Me7lUPbEQUT5h13Ewcj-NnURz87P-Cmaz0N9qjwswAfnBA7_ZWYV0nY44_kcOcuNegYl7HOkyJxO0ZkvwlrQzB0Lc Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:18.423369 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}] Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7d9a63cf91d44572809b06de5e0ae004 Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'nonexistent_hostname'} Aug 04 13:54:18.424800 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:18.425742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 13:54:18.427096 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.428420 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.431304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fe9265eb-7b11-4702-ad51-55734726850c tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.432487 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fe9265eb-7b11-4702-ad51-55734726850c tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.044421 Aug 04 13:54:18.438603 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 146/290] 10.222.0.66 () {58 vars in 1215 bytes} [Thu Aug 4 13:54:18 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:18.446568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dcdac1e9-d6ba-495b-8e4e-1356f74221cb tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.489891 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dcdac1e9-d6ba-495b-8e4e-1356f74221cb tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.050184 Aug 04 13:54:18.498327 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 147/291] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:18 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:18.510728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41b2ee4a-57a7-41ac-bd7d-e25562ba008a tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Action: 'update', calling method: .version_select at 0x7f4700c51820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41b2ee4a-57a7-41ac-bd7d-e25562ba008a tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Request method failure captured: Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: request: PUT /compute/v2.1/os-hosts/n-d-844627-10 HTTP/1.1 Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 51 Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-H0gfs-4rvVCV3j7jrOTiSun0_31AA05-bLbAzYUZSkF6TUpG7t8F-MFvH2Rwk7jD8g_GlUOLDWd6p_9z5d_Me7lUPbEQUT5h13Ewcj-NnURz87P-Cmaz0N9qjwswAfnBA7_ZWYV0nY44_kcOcuNegYl7HOkyJxO0ZkvwlrQzB0Lc Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:18.535652 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}] Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7d9a63cf91d44572809b06de5e0ae004 Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: {"status": "enable", "maintenance_mode": "invalid"} Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:18.538222 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'n-d-844627-10', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance: Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.539024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.540373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.541867 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.541867 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:54:18.541867 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:54:18.541867 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 13:54:18.541867 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.541867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41b2ee4a-57a7-41ac-bd7d-e25562ba008a tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.541867 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-41b2ee4a-57a7-41ac-bd7d-e25562ba008a tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-hosts/n-d-844627-10" status: 400 len: 199 microversion: 2.1 time: 0.035824 Aug 04 13:54:18.541867 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 148/292] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 13:54:18 2022] PUT /compute/v2.1/os-hosts/n-d-844627-10 => generated 199 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:18.542719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab1b4ccd-b82d-4efd-8428-fd661e6e0d27 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1077446342", "id": 38812282, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.545435 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.545435 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:18.564331 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ab1b4ccd-b82d-4efd-8428-fd661e6e0d27 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.025409 Aug 04 13:54:18.571234 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 149/293] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:18 2022] POST /compute/v2.1/flavors => generated 411 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:18.571234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e6f4e2c-e694-4317-80d1-ca227aff1766 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Action: 'update', calling method: .version_select at 0x7f4700db0820>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e6f4e2c-e694-4317-80d1-ca227aff1766 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Request method failure captured: Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: request: PUT /compute/v2.1/os-hosts/n-d-844627-10 HTTP/1.1 Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 51 Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-H0gfs-4rvVCV3j7jrOTiSun0_31AA05-bLbAzYUZSkF6TUpG7t8F-MFvH2Rwk7jD8g_GlUOLDWd6p_9z5d_Me7lUPbEQUT5h13Ewcj-NnURz87P-Cmaz0N9qjwswAfnBA7_ZWYV0nY44_kcOcuNegYl7HOkyJxO0ZkvwlrQzB0Lc Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:18.574580 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}] Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7d9a63cf91d44572809b06de5e0ae004 Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: {"status": "invalid", "maintenance_mode": "enable"} Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:18.576353 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'n-d-844627-10', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance: Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.577118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.579071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.580109 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.580109 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:54:18.580109 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:54:18.580109 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 13:54:18.580109 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.580109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e6f4e2c-e694-4317-80d1-ca227aff1766 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.580109 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e6f4e2c-e694-4317-80d1-ca227aff1766 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-hosts/n-d-844627-10" status: 400 len: 189 microversion: 2.1 time: 0.009743 Aug 04 13:54:18.581827 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 150/294] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 13:54:18 2022] PUT /compute/v2.1/os-hosts/n-d-844627-10 => generated 189 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:18.587313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d22c2d1-38fd-4716-a07d-6e080044b6b1 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.611251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-895ec587-aac5-40a2-875a-2390ef3a1045 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.614116 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.614116 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:18.615210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-895ec587-aac5-40a2-875a-2390ef3a1045 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'b8326fe76d8a440eb45fca6758dffa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd1ca28a76479f96ad9bb96a5373bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-895ec587-aac5-40a2-875a-2390ef3a1045 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Request method failure captured: Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 40 Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-GQzy4JRXgbYYbPfexqpl_fpoMptS-wSdi0KgEuCAu8PowcvXtaoxUqmJ_-jsqwYMhftorZnqRaZuG5VGb1Qxn5kxB8r260gQaZ5UE683hdFwokGJPZCMO1owYX_YygWbHYR0BEb_29ekbmkDy1z5D03iL8fwAbRXuUfTD3EclRbQ Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:18.616810 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}] Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b8326fe76d8a440eb45fca6758dffa2d Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: {"add_host": {"host": "n-h2-844627-10"}} Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:18.618100 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-844627-10'}}} Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:18.618821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 13:54:18.619814 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.621359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-895ec587-aac5-40a2-875a-2390ef3a1045 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.622769 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-895ec587-aac5-40a2-875a-2390ef3a1045 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] 10.222.0.66 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.210916 Aug 04 13:54:18.624784 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 145/295] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 13:54:18 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 213 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:18.643116 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d22c2d1-38fd-4716-a07d-6e080044b6b1 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.1 time: 0.046306 Aug 04 13:54:18.644225 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 151/296] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:18 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:18.647126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3bfeb919-9ee9-4dc2-a785-10bcfb011ac1 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Action: 'update', calling method: .version_select at 0x7f4700cf9670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.653550 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.653550 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:18.654742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3bfeb919-9ee9-4dc2-a785-10bcfb011ac1 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '2220e1fb01cf4c688e382987358bdf3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f8705c20cda45ffa5d97b1a2368d958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3bfeb919-9ee9-4dc2-a785-10bcfb011ac1 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Request method failure captured: Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/os-hosts/n-d-844627-10 HTTP/1.1 Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 50 Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-FIbaJda_Auzzxh6qDjqFSVApwZpWItmIXWel7_Grp-agYJNNBC2IRHo_JkqgExYgISFZvYQLP1eB54rtg1tpnd1WNTDsTdRZsUS7HvbuBO2_uDhK8hL2L6Nf316sqA1DIF4_9cLUKMZ8-mNsJcnRRXB4dhDbLWXus8irE0qJNfN4 Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:18.657774 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1f8705c20cda45ffa5d97b1a2368d958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f8705c20cda45ffa5d97b1a2368d958"}]}] Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1f8705c20cda45ffa5d97b1a2368d958 Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-63778110 Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 2220e1fb01cf4c688e382987358bdf3e Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-HostsAdminNegativeTestJSON-63778110-project Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: {"status": "enable", "maintenance_mode": "enable"} Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 13:54:18.658952 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'n-d-844627-10', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:18.659794 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 13:54:18.660850 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.661952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b658a358-5550-4d0f-b854-429c46ce6117 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.661952 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.661952 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:18.662273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3bfeb919-9ee9-4dc2-a785-10bcfb011ac1 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.666672 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3bfeb919-9ee9-4dc2-a785-10bcfb011ac1 tempest-HostsAdminNegativeTestJSON-63778110 tempest-HostsAdminNegativeTestJSON-63778110-project] 10.222.0.66 "PUT /compute/v2.1/os-hosts/n-d-844627-10" status: 403 len: 111 microversion: 2.1 time: 0.040120 Aug 04 13:54:18.671327 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 146/297] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 13:54:18 2022] PUT /compute/v2.1/os-hosts/n-d-844627-10 => generated 111 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:18.681459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-94724e37-ac1d-4f5c-ae01-8ea1d6ae8a47 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.682900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:18.698770 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b658a358-5550-4d0f-b854-429c46ce6117 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.052896 Aug 04 13:54:18.704127 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 152/298] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:18 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:18.715021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a442f7e-2ec5-43a4-9d64-af37c897b060 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Action: 'update', calling method: .version_select at 0x7f4700bc49d0>, body: {"status": null, "maintenance_mode": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a442f7e-2ec5-43a4-9d64-af37c897b060 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Request method failure captured: Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: request: PUT /compute/v2.1/os-hosts/n-d-844627-10 HTTP/1.1 Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 42 Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-H0gfs-4rvVCV3j7jrOTiSun0_31AA05-bLbAzYUZSkF6TUpG7t8F-MFvH2Rwk7jD8g_GlUOLDWd6p_9z5d_Me7lUPbEQUT5h13Ewcj-NnURz87P-Cmaz0N9qjwswAfnBA7_ZWYV0nY44_kcOcuNegYl7HOkyJxO0ZkvwlrQzB0Lc Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:18.721807 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}] Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7d9a63cf91d44572809b06de5e0ae004 Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: {"status": null, "maintenance_mode": null} Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 13:54:18.723080 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'n-d-844627-10', 'body': {'status': None, 'maintenance_mode': None}} Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance: Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi None Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.723937 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.725323 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.726335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:54:18.726335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:54:18.726335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 13:54:18.726335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.726869 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-94724e37-ac1d-4f5c-ae01-8ea1d6ae8a47 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/38812282" status: 202 len: 0 microversion: 2.1 time: 0.046878 Aug 04 13:54:18.726869 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 147/299] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:18 2022] DELETE /compute/v2.1/flavors/38812282 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:18.732021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-91cb0b26-bfe6-480e-8e3b-c5ec1e7eee4b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-18685006"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.735930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a442f7e-2ec5-43a4-9d64-af37c897b060 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.737141 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a442f7e-2ec5-43a4-9d64-af37c897b060 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-hosts/n-d-844627-10" status: 400 len: 127 microversion: 2.1 time: 0.031779 Aug 04 13:54:18.738030 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 153/300] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 13:54:18 2022] PUT /compute/v2.1/os-hosts/n-d-844627-10 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:18.744262 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.744262 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:18.745571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.aggregate [None req-91cb0b26-bfe6-480e-8e3b-c5ec1e7eee4b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Generated uuid 0d6527b3-f12b-4319-bee0-e22325efc118 for aggregate {{(pid=130960) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:18.759528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-971da255-6b59-4d7b-ad14-77154d51b504 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.785874 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-91cb0b26-bfe6-480e-8e3b-c5ec1e7eee4b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.059363 Aug 04 13:54:18.789247 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 148/301] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:18.801713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-09da2b71-de5c-4cde-a3fd-ed3eb810e495 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.802586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-09da2b71-de5c-4cde-a3fd-ed3eb810e495 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:18.807882 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-971da255-6b59-4d7b-ad14-77154d51b504 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.068574 Aug 04 13:54:18.810201 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 154/302] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:18 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:18.810201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7256e46-958f-4a9d-9c87-9ea8a6846d23 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Action: 'update', calling method: .version_select at 0x7f4700c51a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.826117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09da2b71-de5c-4cde-a3fd-ed3eb810e495 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:18.826117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09da2b71-de5c-4cde-a3fd-ed3eb810e495 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:18.826372 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.826372 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:18.826511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09da2b71-de5c-4cde-a3fd-ed3eb810e495 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:18.826511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09da2b71-de5c-4cde-a3fd-ed3eb810e495 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:18.826641 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.hosts [None req-d7256e46-958f-4a9d-9c87-9ea8a6846d23 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Enabling host nonexistent_hostname. Aug 04 13:54:18.833864 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-d7256e46-958f-4a9d-9c87-9ea8a6846d23 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7256e46-958f-4a9d-9c87-9ea8a6846d23 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Request method failure captured: Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 50 Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-H0gfs-4rvVCV3j7jrOTiSun0_31AA05-bLbAzYUZSkF6TUpG7t8F-MFvH2Rwk7jD8g_GlUOLDWd6p_9z5d_Me7lUPbEQUT5h13Ewcj-NnURz87P-Cmaz0N9qjwswAfnBA7_ZWYV0nY44_kcOcuNegYl7HOkyJxO0ZkvwlrQzB0Lc Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:18.836275 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/da0bf782a2834ac89db2175f636e24f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/da0bf782a2834ac89db2175f636e24f6"}]}] Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: da0bf782a2834ac89db2175f636e24f6 Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2047314806 Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7d9a63cf91d44572809b06de5e0ae004 Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2047314806-project-admin Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: {"status": "enable", "maintenance_mode": "enable"} Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.837501 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 13:54:18.838312 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:18.839293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.840361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7256e46-958f-4a9d-9c87-9ea8a6846d23 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.841191 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7256e46-958f-4a9d-9c87-9ea8a6846d23 tempest-HostsAdminNegativeTestJSON-2047314806 tempest-HostsAdminNegativeTestJSON-2047314806-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.026326 Aug 04 13:54:18.841191 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 155/303] 10.222.0.66 () {60 vars in 1211 bytes} [Thu Aug 4 13:54:18 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:18.846281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e02401da-ee04-4acd-ab35-3cf0e2bac965 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1192576369"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.849947 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.849947 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:18.860655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e02401da-ee04-4acd-ab35-3cf0e2bac965 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:18.861339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e02401da-ee04-4acd-ab35-3cf0e2bac965 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:18.871324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e02401da-ee04-4acd-ab35-3cf0e2bac965 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:18.872322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e02401da-ee04-4acd-ab35-3cf0e2bac965 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:18.881179 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e02401da-ee04-4acd-ab35-3cf0e2bac965 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1192576369 could not be found. Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e02401da-ee04-4acd-ab35-3cf0e2bac965 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Request method failure captured: Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 58 Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-IJ7TyvzRXjiq4p8whOScIPVSsIj67tjZSVtYpzSJfH-BDbIW6L52oSV_6fTDm_9_faizyio56goV9-mhkK7UfSuqZ3u5KcAru7BIYUT_0GcJhkLPAsXVdrloniMthTUkAh2xuylGb_jmRk-ynbU5RqRdxATCVTtoxGP0lpReaYKc Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:18.884665 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}] Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6d62b806e7ab4254804b025536c5adf2 Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: {"add_host": {"host": "tempest-nonexist_host-1192576369"}} Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:18.886078 n-d-844627-10 devstack@n-api.service[130961]: exception: Compute host tempest-nonexist_host-1192576369 could not be found. Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1192576369'}}} Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1192576369' is not mapped to any cell Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.887325 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 04 13:54:18.888352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1192576369 could not be found. Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1192576369 could not be found. Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:18.889482 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1192576369 could not be found. Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e02401da-ee04-4acd-ab35-3cf0e2bac965 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1192576369 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e02401da-ee04-4acd-ab35-3cf0e2bac965 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.048282 Aug 04 13:54:18.890673 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 156/304] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 13:54:18 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:18.895341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d497d73-f40b-49ac-b52d-d8019aa33872 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1220546376", "id": 594465411, "os-flavor-access:is_public": "True"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:18.900086 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.900086 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:18.935533 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d497d73-f40b-49ac-b52d-d8019aa33872 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.046092 Aug 04 13:54:18.939960 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 157/305] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:18 2022] POST /compute/v2.1/flavors => generated 426 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:18.950762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34eaf264-4e86-4848-8555-51a6b5cf3a80 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:18.951634 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:18.951634 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:18.996785 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-34eaf264-4e86-4848-8555-51a6b5cf3a80 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055298 Aug 04 13:54:18.998335 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 158/306] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:18 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:19.012155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f888128-7474-47ff-a9a6-4e2d4f64aa5b tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.013083 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.013083 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.051958 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f888128-7474-47ff-a9a6-4e2d4f64aa5b tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/594465411" status: 202 len: 0 microversion: 2.1 time: 0.052286 Aug 04 13:54:19.052621 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 159/307] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:54:18 2022] DELETE /compute/v2.1/flavors/594465411 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:19.061547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebc8b6e6-2395-4a8a-a07f-7fa725830702 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebc8b6e6-2395-4a8a-a07f-7fa725830702 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Request method failure captured: Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 283 Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-IJ7TyvzRXjiq4p8whOScIPVSsIj67tjZSVtYpzSJfH-BDbIW6L52oSV_6fTDm_9_faizyio56goV9-mhkK7UfSuqZ3u5KcAru7BIYUT_0GcJhkLPAsXVdrloniMthTUkAh2xuylGb_jmRk-ynbU5RqRdxATCVTtoxGP0lpReaYKc Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:19.073821 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}] Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6d62b806e7ab4254804b025536c5adf2 Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:19.075085 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:54:19.075631 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:19.076223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.077240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.078052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:54:19.078052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:54:19.078052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 13:54:19.078052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.078052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebc8b6e6-2395-4a8a-a07f-7fa725830702 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:19.079032 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ebc8b6e6-2395-4a8a-a07f-7fa725830702 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.023101 Aug 04 13:54:19.081038 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 160/308] 10.222.0.66 () {60 vars in 1165 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:19.099754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d092055-36f6-45f3-9de1-2fbd11fb8ee6 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.174802 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d092055-36f6-45f3-9de1-2fbd11fb8ee6 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.090199 Aug 04 13:54:19.176510 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 161/309] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:19 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:19.182392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a2edfde-a89b-42d2-ae8b-eabe4a34412e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a2edfde-a89b-42d2-ae8b-eabe4a34412e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Request method failure captured: Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 27 Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-IJ7TyvzRXjiq4p8whOScIPVSsIj67tjZSVtYpzSJfH-BDbIW6L52oSV_6fTDm_9_faizyio56goV9-mhkK7UfSuqZ3u5KcAru7BIYUT_0GcJhkLPAsXVdrloniMthTUkAh2xuylGb_jmRk-ynbU5RqRdxATCVTtoxGP0lpReaYKc Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:19.186330 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}] Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6d62b806e7ab4254804b025536c5adf2 Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: {"aggregate": {"name": ""}} Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:19.187843 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi '' Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:19.188712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 13:54:19.190246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.195032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a2edfde-a89b-42d2-ae8b-eabe4a34412e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:19.196169 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a2edfde-a89b-42d2-ae8b-eabe4a34412e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.018328 Aug 04 13:54:19.196902 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 162/310] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:19.218057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-956fd916-9a94-46df-85dc-34d259b588ce tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1429487760"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.226485 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.226485 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.229218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-956fd916-9a94-46df-85dc-34d259b588ce tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'b8326fe76d8a440eb45fca6758dffa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd1ca28a76479f96ad9bb96a5373bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-956fd916-9a94-46df-85dc-34d259b588ce tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Request method failure captured: Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 60 Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-GQzy4JRXgbYYbPfexqpl_fpoMptS-wSdi0KgEuCAu8PowcvXtaoxUqmJ_-jsqwYMhftorZnqRaZuG5VGb1Qxn5kxB8r260gQaZ5UE683hdFwokGJPZCMO1owYX_YygWbHYR0BEb_29ekbmkDy1z5D03iL8fwAbRXuUfTD3EclRbQ Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:19.231406 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}] Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b8326fe76d8a440eb45fca6758dffa2d Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: {"aggregate": {"name": "tempest-test_aggregate-1429487760"}} Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:19.232901 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1429487760'}}} Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:19.233769 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:19.234973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 13:54:19.236321 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.239449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-956fd916-9a94-46df-85dc-34d259b588ce tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:19.243292 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-956fd916-9a94-46df-85dc-34d259b588ce tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.040591 Aug 04 13:54:19.246094 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 163/311] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:19.257680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8da8233e-dd03-4038-8c42-2ceb393258b5 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1301264377", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.263933 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.263933 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.295464 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8da8233e-dd03-4038-8c42-2ceb393258b5 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.046648 Aug 04 13:54:19.298271 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 164/312] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/flavors => generated 507 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:19.306533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef9f1959-9c06-4f24-8079-89c3da23732f tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1378934224"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.317281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-ef9f1959-9c06-4f24-8079-89c3da23732f tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Generated uuid 183ae4a3-5526-49b9-ae5e-541a86f81a28 for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:19.349352 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ef9f1959-9c06-4f24-8079-89c3da23732f tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049653 Aug 04 13:54:19.350815 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 165/313] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:19.361079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e39fe87b-ecf4-48e2-aec9-98b7e035403d tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.363874 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.363874 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.403928 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e39fe87b-ecf4-48e2-aec9-98b7e035403d tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/0db8351b-d215-4ba8-96b8-2b8472e53238" status: 202 len: 0 microversion: 2.1 time: 0.048877 Aug 04 13:54:19.407472 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 166/314] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:54:19 2022] DELETE /compute/v2.1/flavors/0db8351b-d215-4ba8-96b8-2b8472e53238 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:19.419336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-87b7c6f7-23b9-49a5-9df0-c65bd17f08df tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1378934224"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.427568 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.427568 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.429303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-87b7c6f7-23b9-49a5-9df0-c65bd17f08df tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Generated uuid fe1e5e21-bd57-47a0-bac0-75aa46788efe for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:19.450192 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-87b7c6f7-23b9-49a5-9df0-c65bd17f08df tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1378934224 already exists. Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-87b7c6f7-23b9-49a5-9df0-c65bd17f08df tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Request method failure captured: Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 60 Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-IJ7TyvzRXjiq4p8whOScIPVSsIj67tjZSVtYpzSJfH-BDbIW6L52oSV_6fTDm_9_faizyio56goV9-mhkK7UfSuqZ3u5KcAru7BIYUT_0GcJhkLPAsXVdrloniMthTUkAh2xuylGb_jmRk-ynbU5RqRdxATCVTtoxGP0lpReaYKc Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:19.454467 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}] Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6d62b806e7ab4254804b025536c5adf2 Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: {"aggregate": {"name": "tempest-test_aggregate-1378934224"}} Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:19.455718 n-d-844627-10 devstack@n-api.service[130961]: exception: Aggregate tempest-test_aggregate-1378934224 already exists. Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1378934224'}}} Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 04 13:54:19.456423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1378934224 already exists. Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:19.457537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1378934224 already exists. Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1378934224 already exists. Aug 04 13:54:19.458586 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.463094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-87b7c6f7-23b9-49a5-9df0-c65bd17f08df tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1378934224 already exists. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:19.465110 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-87b7c6f7-23b9-49a5-9df0-c65bd17f08df tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.055580 Aug 04 13:54:19.466352 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 167/315] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:19.480902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f3ea89c-ebd0-415e-adaf-1dc26a055ced tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.482512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8f3ea89c-ebd0-415e-adaf-1dc26a055ced tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:19.504312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f3ea89c-ebd0-415e-adaf-1dc26a055ced tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:19.505206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f3ea89c-ebd0-415e-adaf-1dc26a055ced tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:19.507942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f3ea89c-ebd0-415e-adaf-1dc26a055ced tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:19.511129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f3ea89c-ebd0-415e-adaf-1dc26a055ced tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:19.518177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-09da2b71-de5c-4cde-a3fd-ed3eb810e495 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:19.532268 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-09da2b71-de5c-4cde-a3fd-ed3eb810e495 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.737190 Aug 04 13:54:19.545687 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 149/316] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:18 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:19.553823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ffe0a61-e681-4bef-a007-5f6a67c23af7 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.582667 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4ffe0a61-e681-4bef-a007-5f6a67c23af7 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.035229 Aug 04 13:54:19.583909 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 150/317] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:19 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:19.598561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ce34060-206f-4e1c-9529-690f3c4c1cbf tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.602464 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.602464 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:19.616834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=8,nova_api:INSERT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:19.631810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8f3ea89c-ebd0-415e-adaf-1dc26a055ced tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:19.661561 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f3ea89c-ebd0-415e-adaf-1dc26a055ced tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1281 microversion: 2.1 time: 0.191252 Aug 04 13:54:19.662412 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 168/318] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:19 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:19.681776 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4ce34060-206f-4e1c-9529-690f3c4c1cbf tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.094325 Aug 04 13:54:19.682824 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 151/319] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:19 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:19.684703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0036b108-76c6-41a9-84dd-5ae935cbd4c7 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1727405125", "id": "628b478c-4a2a-4d5e-a703-6990b20e3819", "os-flavor-access:is_public": "True"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.696258 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.696258 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.698693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da364cc0-4601-4554-8933-20cd02930f6b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2044408492"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.704664 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.704664 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:19.705775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.aggregate [None req-da364cc0-4601-4554-8933-20cd02930f6b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Generated uuid 2b7671f7-c44b-4a57-b66e-71d97dbc58d3 for aggregate {{(pid=130960) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:19.729347 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0036b108-76c6-41a9-84dd-5ae935cbd4c7 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.059168 Aug 04 13:54:19.736925 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 169/320] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/flavors => generated 507 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:19.742485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae58b54c-331a-4770-abe0-c74d12755f9a tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.743132 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.743132 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.755603 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-da364cc0-4601-4554-8933-20cd02930f6b tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064935 Aug 04 13:54:19.763549 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 152/321] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:54:19.770777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20f9c62b-d9a9-40e0-be16-5b4446154b3c tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.771997 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.771997 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:19.773989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-20f9c62b-d9a9-40e0-be16-5b4446154b3c tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'b8326fe76d8a440eb45fca6758dffa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd1ca28a76479f96ad9bb96a5373bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20f9c62b-d9a9-40e0-be16-5b4446154b3c tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Request method failure captured: Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-GQzy4JRXgbYYbPfexqpl_fpoMptS-wSdi0KgEuCAu8PowcvXtaoxUqmJ_-jsqwYMhftorZnqRaZuG5VGb1Qxn5kxB8r260gQaZ5UE683hdFwokGJPZCMO1owYX_YygWbHYR0BEb_29ekbmkDy1z5D03iL8fwAbRXuUfTD3EclRbQ Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:19.776395 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}] Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b8326fe76d8a440eb45fca6758dffa2d Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 13:54:19.778135 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '15'} Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:19.778829 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 13:54:19.779808 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.783247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20f9c62b-d9a9-40e0-be16-5b4446154b3c tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:19.784585 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-20f9c62b-d9a9-40e0-be16-5b4446154b3c tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.019581 Aug 04 13:54:19.789275 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae58b54c-331a-4770-abe0-c74d12755f9a tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/628b478c-4a2a-4d5e-a703-6990b20e3819" status: 202 len: 0 microversion: 2.1 time: 0.050458 Aug 04 13:54:19.789650 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 153/322] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:19 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:19.790029 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 170/323] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:54:19 2022] DELETE /compute/v2.1/flavors/628b478c-4a2a-4d5e-a703-6990b20e3819 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:54:19.795335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6e2beece-2aae-44a9-b8c6-ae15bf557e2c tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.798150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-40ebc7ed-5dac-4a6f-a99f-7eaade36ade0 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.825223 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6e2beece-2aae-44a9-b8c6-ae15bf557e2c tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.033757 Aug 04 13:54:19.826262 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 154/324] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:19 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:19.831569 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-40ebc7ed-5dac-4a6f-a99f-7eaade36ade0 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.032244 Aug 04 13:54:19.831569 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 171/325] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:19 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:19.836261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02db1ebe-07a7-480b-b0d7-70539b24badc tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.837090 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.837090 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.850687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7935001c-bd49-4b8e-88c1-9543b26897d6 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1441725593", "id": 151124613, "os-flavor-access:is_public": "True"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.851038 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-02db1ebe-07a7-480b-b0d7-70539b24badc tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02db1ebe-07a7-480b-b0d7-70539b24badc tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Request method failure captured: Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-IJ7TyvzRXjiq4p8whOScIPVSsIj67tjZSVtYpzSJfH-BDbIW6L52oSV_6fTDm_9_faizyio56goV9-mhkK7UfSuqZ3u5KcAru7BIYUT_0GcJhkLPAsXVdrloniMthTUkAh2xuylGb_jmRk-ynbU5RqRdxATCVTtoxGP0lpReaYKc Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:19.852906 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}] Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6d62b806e7ab4254804b025536c5adf2 Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: exception: Aggregate -1 could not be found. Aug 04 13:54:19.854129 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '-1'} Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 13:54:19.854779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.861116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.863458 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.863458 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.863458 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:19.863458 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:19.863458 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 04 13:54:19.863458 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.863458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02db1ebe-07a7-480b-b0d7-70539b24badc tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:19.863458 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-02db1ebe-07a7-480b-b0d7-70539b24badc tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021667 Aug 04 13:54:19.863458 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 172/326] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:19 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:19.866279 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.866279 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:19.871797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5c23a3bf-f171-45a4-9cab-158c6345c38c tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1540922768"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:19.878522 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.878522 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.882663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-5c23a3bf-f171-45a4-9cab-158c6345c38c tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Generated uuid 952e9e32-0d93-4d23-bab2-194787e14437 for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:19.914606 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7935001c-bd49-4b8e-88c1-9543b26897d6 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.068223 Aug 04 13:54:19.915449 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 155/327] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/flavors => generated 411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:19.934016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9c06763-2dc7-4945-8ecb-1011a0d0fc15 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.945716 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5c23a3bf-f171-45a4-9cab-158c6345c38c tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082170 Aug 04 13:54:19.946946 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 173/328] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:54:19.952427 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f9c06763-2dc7-4945-8ecb-1011a0d0fc15 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/151124613" status: 200 len: 411 microversion: 2.1 time: 0.026444 Aug 04 13:54:19.964486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e2006df-3ba4-4109-9413-45740abee48d tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.965393 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.965393 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:19.966326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e2006df-3ba4-4109-9413-45740abee48d tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'b8326fe76d8a440eb45fca6758dffa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd1ca28a76479f96ad9bb96a5373bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e2006df-3ba4-4109-9413-45740abee48d tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Request method failure captured: Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-GQzy4JRXgbYYbPfexqpl_fpoMptS-wSdi0KgEuCAu8PowcvXtaoxUqmJ_-jsqwYMhftorZnqRaZuG5VGb1Qxn5kxB8r260gQaZ5UE683hdFwokGJPZCMO1owYX_YygWbHYR0BEb_29ekbmkDy1z5D03iL8fwAbRXuUfTD3EclRbQ Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:19.967910 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}] Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b8326fe76d8a440eb45fca6758dffa2d Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 13:54:19.970048 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '16'} Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:19.970760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:19.971931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e2006df-3ba4-4109-9413-45740abee48d tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:19.973365 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 156/329] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:19 2022] GET /compute/v2.1/flavors/151124613 => generated 411 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:19.980964 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e2006df-3ba4-4109-9413-45740abee48d tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] 10.222.0.66 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.025768 Aug 04 13:54:19.984782 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 174/330] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:19 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:19.995391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d52729c3-654c-4ed8-a423-1fb26a15435f tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:19.996088 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:19.996088 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:20.028755 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d52729c3-654c-4ed8-a423-1fb26a15435f tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.042360 Aug 04 13:54:20.032313 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 175/331] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:19 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 13:54:20.051380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f24021d-cc83-4c00-af3e-34d9ce2da5b4 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:20.052797 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:20.052797 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:20.060891 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8f24021d-cc83-4c00-af3e-34d9ce2da5b4 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f24021d-cc83-4c00-af3e-34d9ce2da5b4 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Request method failure captured: Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-IJ7TyvzRXjiq4p8whOScIPVSsIj67tjZSVtYpzSJfH-BDbIW6L52oSV_6fTDm_9_faizyio56goV9-mhkK7UfSuqZ3u5KcAru7BIYUT_0GcJhkLPAsXVdrloniMthTUkAh2xuylGb_jmRk-ynbU5RqRdxATCVTtoxGP0lpReaYKc Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:20.063395 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}] Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6d62b806e7ab4254804b025536c5adf2 Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: exception: Aggregate -1 could not be found. Aug 04 13:54:20.064989 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '-1'} Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:20.065784 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 04 13:54:20.067087 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.069275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f24021d-cc83-4c00-af3e-34d9ce2da5b4 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:20.070307 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f24021d-cc83-4c00-af3e-34d9ce2da5b4 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032696 Aug 04 13:54:20.071345 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 176/332] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:20 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:20.081887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7b36f47a-8b6e-4ae8-a18c-41e742f75eb3 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:20.083333 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:20.083333 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:20.084456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7b36f47a-8b6e-4ae8-a18c-41e742f75eb3 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'b8326fe76d8a440eb45fca6758dffa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd1ca28a76479f96ad9bb96a5373bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7b36f47a-8b6e-4ae8-a18c-41e742f75eb3 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Request method failure captured: Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-GQzy4JRXgbYYbPfexqpl_fpoMptS-wSdi0KgEuCAu8PowcvXtaoxUqmJ_-jsqwYMhftorZnqRaZuG5VGb1Qxn5kxB8r260gQaZ5UE683hdFwokGJPZCMO1owYX_YygWbHYR0BEb_29ekbmkDy1z5D03iL8fwAbRXuUfTD3EclRbQ Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:20.086802 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}] Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b8326fe76d8a440eb45fca6758dffa2d Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 13:54:20.089011 n-d-844627-10 devstack@n-api.service[130961]: action_args: {} Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:20.089902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 13:54:20.091176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.094655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7b36f47a-8b6e-4ae8-a18c-41e742f75eb3 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:20.095749 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7b36f47a-8b6e-4ae8-a18c-41e742f75eb3 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018640 Aug 04 13:54:20.098027 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 177/333] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 13:54:20 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:54:20.113441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c8fef362-36ee-4291-8f7b-197e988d8335 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-761128117"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:20.121458 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:20.121458 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:20.126561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-c8fef362-36ee-4291-8f7b-197e988d8335 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Generated uuid b05f8138-3827-4cbd-8552-a47a890fe84b for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:20.182337 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c8fef362-36ee-4291-8f7b-197e988d8335 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077217 Aug 04 13:54:20.186781 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 178/334] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:54:20.196629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbe3396a-4014-4a91-9a68-fb823feef0ef tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:20.209655 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:20.209655 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:20.223365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbe3396a-4014-4a91-9a68-fb823feef0ef tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:20.224064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbe3396a-4014-4a91-9a68-fb823feef0ef tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:20.449251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a2e89e2c-3398-4020-a2c2-09e07649d867 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:20.505575 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a2e89e2c-3398-4020-a2c2-09e07649d867 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.1 time: 0.534770 Aug 04 13:54:20.506165 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 157/335] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:19 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:20.525284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-239ef434-08c8-4717-b5e8-03792676d149 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:20.526350 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:20.526350 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:20.555252 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fbe3396a-4014-4a91-9a68-fb823feef0ef tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.363703 Aug 04 13:54:20.556405 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 179/336] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 13:54:20 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:20.566040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-69a80819-9288-4c74-a64d-b25a36c571da tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:20.567045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-69a80819-9288-4c74-a64d-b25a36c571da tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:20.572273 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-239ef434-08c8-4717-b5e8-03792676d149 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/151124613" status: 202 len: 0 microversion: 2.1 time: 0.050663 Aug 04 13:54:20.573832 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 158/337] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:54:20 2022] DELETE /compute/v2.1/flavors/151124613 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:54:20.584826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c21688c4-d686-4c5f-a307-a0c817474bf9 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844627-10"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:20.585249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69a80819-9288-4c74-a64d-b25a36c571da tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:20.585921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69a80819-9288-4c74-a64d-b25a36c571da tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:20.588159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69a80819-9288-4c74-a64d-b25a36c571da tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:20.589876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69a80819-9288-4c74-a64d-b25a36c571da tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:20.592430 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:20.592430 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:20.596489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c21688c4-d686-4c5f-a307-a0c817474bf9 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'b8326fe76d8a440eb45fca6758dffa2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd1ca28a76479f96ad9bb96a5373bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c21688c4-d686-4c5f-a307-a0c817474bf9 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Request method failure captured: Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 43 Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-GQzy4JRXgbYYbPfexqpl_fpoMptS-wSdi0KgEuCAu8PowcvXtaoxUqmJ_-jsqwYMhftorZnqRaZuG5VGb1Qxn5kxB8r260gQaZ5UE683hdFwokGJPZCMO1owYX_YygWbHYR0BEb_29ekbmkDy1z5D03iL8fwAbRXuUfTD3EclRbQ Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:20.600494 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fbdd1ca28a76479f96ad9bb96a5373bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fbdd1ca28a76479f96ad9bb96a5373bb"}]}] Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: fbdd1ca28a76479f96ad9bb96a5373bb Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-436453043 Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b8326fe76d8a440eb45fca6758dffa2d Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-436453043-project Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: {"remove_host": {"host": "n-h2-844627-10"}} Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:20.601716 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-844627-10'}}} Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:20.602493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 13:54:20.603548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:20.604705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c21688c4-d686-4c5f-a307-a0c817474bf9 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:20.606055 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c21688c4-d686-4c5f-a307-a0c817474bf9 tempest-AggregatesAdminNegativeTestJSON-436453043 tempest-AggregatesAdminNegativeTestJSON-436453043-project] 10.222.0.66 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.029732 Aug 04 13:54:20.607652 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 159/338] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 13:54:20 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:20.618777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c747462-b5c2-40fb-8f3f-64feb2dbe733 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:20.675060 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c747462-b5c2-40fb-8f3f-64feb2dbe733 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.066095 Aug 04 13:54:20.676218 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 160/339] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:20 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:20.683518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5fbe0210-fdd2-49cb-8436-57837631774e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844627-10"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:20.698003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fbe0210-fdd2-49cb-8436-57837631774e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:20.698731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fbe0210-fdd2-49cb-8436-57837631774e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:20.839775 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5fbe0210-fdd2-49cb-8436-57837631774e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.160346 Aug 04 13:54:20.841830 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 161/340] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 13:54:20 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:20.847526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7daca068-6034-4672-892b-781249ad658a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:20.848450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7daca068-6034-4672-892b-781249ad658a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:20.858156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7daca068-6034-4672-892b-781249ad658a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:20.858782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7daca068-6034-4672-892b-781249ad658a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:20.859749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7daca068-6034-4672-892b-781249ad658a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:20.860339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7daca068-6034-4672-892b-781249ad658a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:21.362891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-69a80819-9288-4c74-a64d-b25a36c571da tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:21.376180 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-69a80819-9288-4c74-a64d-b25a36c571da tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.818397 Aug 04 13:54:21.376779 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 180/341] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:20 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:21.392172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eaee8d32-c896-4bc9-88e1-4bd3e375cd8b tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1615057310", "id": 317483217, "os-flavor-access:is_public": "False"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:21.395469 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:21.395469 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:21.423450 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eaee8d32-c896-4bc9-88e1-4bd3e375cd8b tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.045569 Aug 04 13:54:21.424330 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 181/342] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:21 2022] POST /compute/v2.1/flavors => generated 427 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:21.430628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-28800073-b772-4c5d-a561-0b77de433c97 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:21.432178 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:21.432178 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:21.464620 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-28800073-b772-4c5d-a561-0b77de433c97 tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.038565 Aug 04 13:54:21.466174 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 182/343] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:21 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:21.480954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dcaacee2-3a8d-4cbe-8003-b0ac19384ec1 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "317483217"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:21.500263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-dcaacee2-3a8d-4cbe-8003-b0ac19384ec1 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] HTTP exception thrown: Flavor 317483217 could not be found. Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dcaacee2-3a8d-4cbe-8003-b0ac19384ec1 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] Request method failure captured: Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 106 Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-HeKQFQ850_DB-GXPNNR1q33h_Q7nduesdM_gAcIM-ygNqMm4eunfyLPyffpmbLU2siRn-5Z0ZDle8damJi87pEsYCa1IZ3LGL0H66kkfhWEEFwqdYXME_ncvgt5bsC6l_Rj-80ISGrgc65DtiOjoGQxN6tD12DdabfA3kBpAFd1c Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 0c4699e4dbd745d09170c3345b4899c8 Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FlavorsAdminTestJSON-1186521987 Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:21.506515 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c4699e4dbd745d09170c3345b4899c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0c4699e4dbd745d09170c3345b4899c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0c4699e4dbd745d09170c3345b4899c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c4699e4dbd745d09170c3345b4899c8"}]}] Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FlavorsAdminTestJSON-1186521987 Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 0c4699e4dbd745d09170c3345b4899c8 Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1186521987 Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FlavorsAdminTestJSON-1186521987-project Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 730cce245c954d418617c57da671e768 Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FlavorsAdminTestJSON-1186521987-project Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "test", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "317483217"}} Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:21.508312 n-d-844627-10 devstack@n-api.service[130961]: exception: Flavor 317483217 could not be found. Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '317483217'}}} Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 317483217 could not be found. Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.509328 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 317483217 could not be found. Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:21.510908 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:21.512938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:21.512938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:21.512938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:21.512938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 317483217 could not be found. Aug 04 13:54:21.512938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.512938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dcaacee2-3a8d-4cbe-8003-b0ac19384ec1 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] Returning 400 to user: Flavor 317483217 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:21.517059 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dcaacee2-3a8d-4cbe-8003-b0ac19384ec1 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.044287 Aug 04 13:54:21.518007 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 183/344] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:21 2022] POST /compute/v2.1/servers => generated 80 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:54:21.525904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12828234-d090-4533-ad2b-1152fcbf368e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1802"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:21.528955 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:21.528955 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:21.531013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.aggregate [None req-12828234-d090-4533-ad2b-1152fcbf368e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Generated uuid 5ed66f35-fd5c-40af-8276-4067a8c70c79 for aggregate {{(pid=130961) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 13:54:21.539680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:DELETE=17,nova_api:SELECT=75,nova_api:INSERT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:21.569037 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12828234-d090-4533-ad2b-1152fcbf368e tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 193 microversion: 2.1 time: 0.048958 Aug 04 13:54:21.570757 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 184/345] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 13:54:21 2022] POST /compute/v2.1/os-aggregates => generated 193 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:21.583005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-141aaf9d-ea20-4e4b-89b1-b527e5b0033e tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:21.584085 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:21.584085 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:21.607287 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-141aaf9d-ea20-4e4b-89b1-b527e5b0033e tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/317483217" status: 202 len: 0 microversion: 2.1 time: 0.031272 Aug 04 13:54:21.608761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7daca068-6034-4672-892b-781249ad658a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:21.611926 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 185/346] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:54:21 2022] DELETE /compute/v2.1/flavors/317483217 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:21.619491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:21.623996 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7daca068-6034-4672-892b-781249ad658a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1323 microversion: 2.1 time: 0.777726 Aug 04 13:54:21.624615 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 162/347] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:20 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1323 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:21.628995 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:21.628995 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:21.650310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:21.650791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1d175e6-cb25-4148-9194-ad65f2aa76f8 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:21.651465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:21.659219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=25 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:21.661122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:21.662045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:21.675460 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1d175e6-cb25-4148-9194-ad65f2aa76f8 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.033377 Aug 04 13:54:21.677502 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 163/348] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:21 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:21.682222 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.compute.aggregates [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 04 13:54:21.683008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Request method failure captured: Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 42 Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-IJ7TyvzRXjiq4p8whOScIPVSsIj67tjZSVtYpzSJfH-BDbIW6L52oSV_6fTDm_9_faizyio56goV9-mhkK7UfSuqZ3u5KcAru7BIYUT_0GcJhkLPAsXVdrloniMthTUkAh2xuylGb_jmRk-ynbU5RqRdxATCVTtoxGP0lpReaYKc Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:21.685991 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d898e6edd0534c6eb061c2346d6abdad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d898e6edd0534c6eb061c2346d6abdad"}]}] Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d898e6edd0534c6eb061c2346d6abdad Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-388228901 Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6d62b806e7ab4254804b025536c5adf2 Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: {"remove_host": {"host": "nonexist_host"}} Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:21.687375 n-d-844627-10 devstack@n-api.service[130961]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 04 13:54:21.688682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 04 13:54:21.689913 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.690989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:21.694341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:21.694341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:21.694341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:21.694341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:21.694341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 04 13:54:21.694341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:21.701852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:21.710261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc1389d9-3e9b-422d-805a-4bc001dfa446 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1694100606", "id": 188550151, "os-flavor-access:is_public": "False"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:21.713884 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2368a760-0504-4aee-a182-aba4098ec3ed tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.099732 Aug 04 13:54:21.714174 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:21.714174 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:21.714494 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 186/349] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 13:54:21 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:54:21.723668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca927768-a6ed-4f90-93ed-52e7c526effb tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:21.724712 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:21.724712 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:21.742134 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bc1389d9-3e9b-422d-805a-4bc001dfa446 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.043741 Aug 04 13:54:21.743468 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 164/350] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:21 2022] POST /compute/v2.1/flavors => generated 412 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:21.756852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e14c2133-85ca-4c79-9277-5f1b38549c22 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-864063393", "id": 2139586441, "os-flavor-access:is_public": "True"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:21.787835 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca927768-a6ed-4f90-93ed-52e7c526effb tempest-AggregatesAdminNegativeTestJSON-388228901 tempest-AggregatesAdminNegativeTestJSON-388228901-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.068557 Aug 04 13:54:21.789553 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 187/351] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 13:54:21 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 13:54:21.801374 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e14c2133-85ca-4c79-9277-5f1b38549c22 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.049512 Aug 04 13:54:21.806113 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 165/352] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:21 2022] POST /compute/v2.1/flavors => generated 413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:21.830158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c90ada5a-b773-40e3-ab21-8ae791f628df tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:21.897044 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c90ada5a-b773-40e3-ab21-8ae791f628df tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.080845 Aug 04 13:54:21.900382 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 188/353] 10.222.0.66 () {58 vars in 1169 bytes} [Thu Aug 4 13:54:21 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:21.914451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe21f546-818f-4a7e-b95a-ca8f607cd6ab tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:21.970392 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe21f546-818f-4a7e-b95a-ca8f607cd6ab tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.059786 Aug 04 13:54:21.971554 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 166/354] 10.222.0.66 () {58 vars in 1177 bytes} [Thu Aug 4 13:54:21 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:21.985555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-67a25709-bbd5-412d-ad20-713123790d1f tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.011695 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-67a25709-bbd5-412d-ad20-713123790d1f tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.028358 Aug 04 13:54:22.012684 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 189/355] 10.222.0.66 () {58 vars in 1171 bytes} [Thu Aug 4 13:54:21 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:22.027722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d8e07e29-95f4-486f-83d4-1acd56de5621 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.049241 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d8e07e29-95f4-486f-83d4-1acd56de5621 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.022051 Aug 04 13:54:22.061935 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 167/356] 10.222.0.66 () {58 vars in 1169 bytes} [Thu Aug 4 13:54:22 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:22.063704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f3edd9b-98e4-475c-a961-a2a7c85472a1 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.123863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f3edd9b-98e4-475c-a961-a2a7c85472a1 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6218 microversion: 2.1 time: 0.061105 Aug 04 13:54:22.124908 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 190/357] 10.222.0.66 () {58 vars in 1169 bytes} [Thu Aug 4 13:54:22 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:22.145230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e91e4c13-d203-493b-8be6-56a0ba01c815 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.173323 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e91e4c13-d203-493b-8be6-56a0ba01c815 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6218 microversion: 2.1 time: 0.032850 Aug 04 13:54:22.188164 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 168/358] 10.222.0.66 () {58 vars in 1175 bytes} [Thu Aug 4 13:54:22 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6218 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:22.192677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b6a2fe9e-a19e-4c24-9684-8fc6abfd15a6 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.233634 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b6a2fe9e-a19e-4c24-9684-8fc6abfd15a6 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6218 microversion: 2.1 time: 0.044841 Aug 04 13:54:22.248949 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 191/359] 10.222.0.66 () {58 vars in 1173 bytes} [Thu Aug 4 13:54:22 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6218 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:54:22.261037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3083306f-cc28-4d38-acf6-78b75a87f70d tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.292239 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3083306f-cc28-4d38-acf6-78b75a87f70d tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6218 microversion: 2.1 time: 0.035900 Aug 04 13:54:22.308343 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 169/360] 10.222.0.66 () {58 vars in 1169 bytes} [Thu Aug 4 13:54:22 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6218 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:22.314208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d4c51b6-7f5a-43a8-8126-f358d7e73e2c tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.315715 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:22.315715 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:22.346956 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d4c51b6-7f5a-43a8-8126-f358d7e73e2c tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/2139586441" status: 202 len: 0 microversion: 2.1 time: 0.038577 Aug 04 13:54:22.348416 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 192/361] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:54:22 2022] DELETE /compute/v2.1/flavors/2139586441 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:54:22.357274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-52c5bcc4-500e-4c6b-9b6b-78e75e1651f8 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.397387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e997b62-c766-4c90-8997-a80bf83826cb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.398093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4e997b62-c766-4c90-8997-a80bf83826cb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:22.411325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e997b62-c766-4c90-8997-a80bf83826cb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:22.412082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e997b62-c766-4c90-8997-a80bf83826cb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:22.413826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e997b62-c766-4c90-8997-a80bf83826cb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:22.416364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e997b62-c766-4c90-8997-a80bf83826cb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:22.422639 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-52c5bcc4-500e-4c6b-9b6b-78e75e1651f8 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.069917 Aug 04 13:54:22.426655 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 170/362] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:22 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:22.431760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-01d52e3b-580b-4d9a-8769-8c88881a234c req-b2a48ed2-d0b6-47e4-8732-0a008fe9cff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee574a3-6fcd-4a52-9cdf-d0af5ce92124", "tag": "37289ac6-3ecf-4e08-88e6-ee3c9eba708a"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:22.458446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-01d52e3b-580b-4d9a-8769-8c88881a234c req-b2a48ed2-d0b6-47e4-8732-0a008fe9cff2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:22.461579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-01d52e3b-580b-4d9a-8769-8c88881a234c req-b2a48ed2-d0b6-47e4-8732-0a008fe9cff2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:22.485091 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-01d52e3b-580b-4d9a-8769-8c88881a234c req-b2a48ed2-d0b6-47e4-8732-0a008fe9cff2 service nova] Creating event network-changed:37289ac6-3ecf-4e08-88e6-ee3c9eba708a for instance 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 on n-h2-844627-10 Aug 04 13:54:22.496988 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-01d52e3b-580b-4d9a-8769-8c88881a234c req-b2a48ed2-d0b6-47e4-8732-0a008fe9cff2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068448 Aug 04 13:54:22.498489 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 171/363] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:22.512606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ee602f16-3984-4d63-9984-7e63c5aa89fe tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.514136 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:22.514136 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:22.546131 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ee602f16-3984-4d63-9984-7e63c5aa89fe tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/188550151" status: 202 len: 0 microversion: 2.1 time: 0.044007 Aug 04 13:54:22.547998 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 172/364] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:54:22 2022] DELETE /compute/v2.1/flavors/188550151 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:22.574154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b5453609-9999-49f9-934b-a895a39fa743 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.638174 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b5453609-9999-49f9-934b-a895a39fa743 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.071546 Aug 04 13:54:22.639356 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 173/365] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:22 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:22.648498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ce49122b-052a-423e-b8fa-f5550508b1ad tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:22.649526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ce49122b-052a-423e-b8fa-f5550508b1ad tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:22.658234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce49122b-052a-423e-b8fa-f5550508b1ad tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:22.658868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce49122b-052a-423e-b8fa-f5550508b1ad tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:22.659890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce49122b-052a-423e-b8fa-f5550508b1ad tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:22.660650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce49122b-052a-423e-b8fa-f5550508b1ad tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:23.130993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e997b62-c766-4c90-8997-a80bf83826cb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:23.154343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ce49122b-052a-423e-b8fa-f5550508b1ad tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:23.167813 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e997b62-c766-4c90-8997-a80bf83826cb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.771423 Aug 04 13:54:23.171263 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 193/366] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:22 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:54:23.187367 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ce49122b-052a-423e-b8fa-f5550508b1ad tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1323 microversion: 2.1 time: 0.544880 Aug 04 13:54:23.195567 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 174/367] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:22 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1323 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:23.215658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e496d2c-b715-412e-aee5-c22a4b014603 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-454975026", "id": 1518618967, "os-flavor-access:is_public": "False"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:23.227596 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:23.227596 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:23.255639 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2e496d2c-b715-412e-aee5-c22a4b014603 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.082401 Aug 04 13:54:23.256473 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 194/368] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:23 2022] POST /compute/v2.1/flavors => generated 414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:23.274125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cea4e099-5011-42a1-85d9-445b1c5c9909 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:23.324239 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cea4e099-5011-42a1-85d9-445b1c5c9909 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.059366 Aug 04 13:54:23.325371 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 175/369] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:23 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:23.345557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72ee6e21-51de-433c-98bd-d52d9088ec22 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:23.413480 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-72ee6e21-51de-433c-98bd-d52d9088ec22 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.070115 Aug 04 13:54:23.414212 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 195/370] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:23 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:23.438484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c7d7925-a9d8-47c7-abc7-2c1af2107e49 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:23.439862 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:23.439862 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:23.496302 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c7d7925-a9d8-47c7-abc7-2c1af2107e49 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1518618967" status: 202 len: 0 microversion: 2.1 time: 0.067027 Aug 04 13:54:23.500298 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 176/371] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:54:23 2022] DELETE /compute/v2.1/flavors/1518618967 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:23.514523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd63da1e-9665-4661-b20d-1ac61fef9997 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:23.564139 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd63da1e-9665-4661-b20d-1ac61fef9997 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.055897 Aug 04 13:54:23.567274 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 196/372] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:23 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:23.596282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-73d0c15e-7208-4f85-95f1-cc4abf38c3b3 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1978170666", "id": 733396610, "os-flavor-access:is_public": "True"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:23.599740 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:23.599740 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:23.621622 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-73d0c15e-7208-4f85-95f1-cc4abf38c3b3 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.032325 Aug 04 13:54:23.623814 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 177/373] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:23 2022] POST /compute/v2.1/flavors => generated 411 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:23.635898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22e6cc24-4895-44f2-9ba0-853f03550da7 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:23.679745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22e6cc24-4895-44f2-9ba0-853f03550da7 tempest-FlavorsAdminTestJSON-1186521987 tempest-FlavorsAdminTestJSON-1186521987-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.1 time: 0.048416 Aug 04 13:54:23.680791 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 197/374] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:23 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:23.699042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6018f523-9df2-45a0-b9db-ba8065c75eb3 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:23.722241 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6018f523-9df2-45a0-b9db-ba8065c75eb3 tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/733396610" status: 202 len: 0 microversion: 2.1 time: 0.027031 Aug 04 13:54:23.732762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a5834b66-ab0c-40c9-9a11-0271febafd8d tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:23.740000 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 178/375] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:54:23 2022] DELETE /compute/v2.1/flavors/733396610 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:23.769577 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a5834b66-ab0c-40c9-9a11-0271febafd8d tempest-FlavorsAdminTestJSON-2008984269 tempest-FlavorsAdminTestJSON-2008984269-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.040272 Aug 04 13:54:23.782022 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 198/376] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:23 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:24.192025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-14174444-7543-4757-a30f-58a7d23ab04d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:24.192609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-14174444-7543-4757-a30f-58a7d23ab04d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:24.203439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14174444-7543-4757-a30f-58a7d23ab04d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:24.203888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14174444-7543-4757-a30f-58a7d23ab04d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:24.206272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14174444-7543-4757-a30f-58a7d23ab04d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:24.206722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14174444-7543-4757-a30f-58a7d23ab04d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:24.219168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c097e83-2e4b-41d4-aacb-45d91d0273c9 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:24.219804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7c097e83-2e4b-41d4-aacb-45d91d0273c9 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:24.233141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c097e83-2e4b-41d4-aacb-45d91d0273c9 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:24.237251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c097e83-2e4b-41d4-aacb-45d91d0273c9 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:24.238927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c097e83-2e4b-41d4-aacb-45d91d0273c9 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:24.239389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c097e83-2e4b-41d4-aacb-45d91d0273c9 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:24.711402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-14174444-7543-4757-a30f-58a7d23ab04d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:24.724319 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-14174444-7543-4757-a30f-58a7d23ab04d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.537295 Aug 04 13:54:24.731726 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 179/377] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:24 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:25.173543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c097e83-2e4b-41d4-aacb-45d91d0273c9 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:25.184465 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c097e83-2e4b-41d4-aacb-45d91d0273c9 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1323 microversion: 2.1 time: 0.971991 Aug 04 13:54:25.188046 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 199/378] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:24 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1323 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:25.760260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-38a91bcf-3cd0-43ef-a7fc-3802274afa3f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:25.761500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-38a91bcf-3cd0-43ef-a7fc-3802274afa3f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:25.770749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38a91bcf-3cd0-43ef-a7fc-3802274afa3f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:25.771210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38a91bcf-3cd0-43ef-a7fc-3802274afa3f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:25.772186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38a91bcf-3cd0-43ef-a7fc-3802274afa3f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:25.772630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38a91bcf-3cd0-43ef-a7fc-3802274afa3f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:26.208606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6e1f295-fe1a-44f6-926d-71ba1cc91d64 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:26.210307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a6e1f295-fe1a-44f6-926d-71ba1cc91d64 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:26.225632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6e1f295-fe1a-44f6-926d-71ba1cc91d64 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:26.226089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6e1f295-fe1a-44f6-926d-71ba1cc91d64 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:26.230853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6e1f295-fe1a-44f6-926d-71ba1cc91d64 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:26.231554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6e1f295-fe1a-44f6-926d-71ba1cc91d64 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:26.456637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=40 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:26.606865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-38a91bcf-3cd0-43ef-a7fc-3802274afa3f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:26.621643 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-38a91bcf-3cd0-43ef-a7fc-3802274afa3f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.872053 Aug 04 13:54:26.629753 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 180/379] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:25 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:26.733755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6e1f295-fe1a-44f6-926d-71ba1cc91d64 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:26.746604 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a6e1f295-fe1a-44f6-926d-71ba1cc91d64 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1323 microversion: 2.1 time: 0.542413 Aug 04 13:54:26.750879 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 200/380] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:26 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1323 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:27.653428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-104c7325-d940-4a55-9e06-34f4a633957e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:27.654052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-104c7325-d940-4a55-9e06-34f4a633957e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:27.663000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:27.666518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-104c7325-d940-4a55-9e06-34f4a633957e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:27.670509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-104c7325-d940-4a55-9e06-34f4a633957e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:27.671713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-104c7325-d940-4a55-9e06-34f4a633957e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:27.674274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-104c7325-d940-4a55-9e06-34f4a633957e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:27.771903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d66794e-07be-4268-9c3c-aed7296eb5ea tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:27.773270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1d66794e-07be-4268-9c3c-aed7296eb5ea tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:27.780146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:27.786587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d66794e-07be-4268-9c3c-aed7296eb5ea tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:27.787983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d66794e-07be-4268-9c3c-aed7296eb5ea tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:27.789152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d66794e-07be-4268-9c3c-aed7296eb5ea tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:27.789839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d66794e-07be-4268-9c3c-aed7296eb5ea tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:28.302062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-104c7325-d940-4a55-9e06-34f4a633957e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:28.313105 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-104c7325-d940-4a55-9e06-34f4a633957e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.664178 Aug 04 13:54:28.313648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1d66794e-07be-4268-9c3c-aed7296eb5ea tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:28.318697 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 181/381] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:27 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:28.321966 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d66794e-07be-4268-9c3c-aed7296eb5ea tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1323 microversion: 2.1 time: 0.554177 Aug 04 13:54:28.326731 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 201/382] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:27 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1323 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:54:29.341837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b5e3dd1-aba1-4e0b-bffc-b83c33477e7d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:29.342534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b5e3dd1-aba1-4e0b-bffc-b83c33477e7d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:29.366846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b5e3dd1-aba1-4e0b-bffc-b83c33477e7d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:29.367352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b5e3dd1-aba1-4e0b-bffc-b83c33477e7d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:29.373270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b5e3dd1-aba1-4e0b-bffc-b83c33477e7d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:29.380241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b5e3dd1-aba1-4e0b-bffc-b83c33477e7d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:29.476602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-baee5d5d-a1c1-44f0-82d0-495f152f8f92 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1142589261", "ram": 512, "vcpus": 1, "disk": 10, "id": 2027634564, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:29.479873 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:29.479873 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:29.503393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=17,nova_api:INSERT=5 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:29.539736 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-baee5d5d-a1c1-44f0-82d0-495f152f8f92 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.464389 Aug 04 13:54:29.550364 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 182/383] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:29 2022] POST /compute/v2.1/flavors => generated 416 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:29.568626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82b5bbf7-ecf9-447e-922f-0bcc774027c2 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:29.569557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-82b5bbf7-ecf9-447e-922f-0bcc774027c2 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:29.593136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82b5bbf7-ecf9-447e-922f-0bcc774027c2 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:29.593868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82b5bbf7-ecf9-447e-922f-0bcc774027c2 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:29.594831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82b5bbf7-ecf9-447e-922f-0bcc774027c2 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:29.596815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82b5bbf7-ecf9-447e-922f-0bcc774027c2 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:30.193291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4b5e3dd1-aba1-4e0b-bffc-b83c33477e7d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:30.207016 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4b5e3dd1-aba1-4e0b-bffc-b83c33477e7d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.871531 Aug 04 13:54:30.230229 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 202/384] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:29 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:30.313310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82b5bbf7-ecf9-447e-922f-0bcc774027c2 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:30.324716 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-82b5bbf7-ecf9-447e-922f-0bcc774027c2 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1323 microversion: 2.1 time: 0.770784 Aug 04 13:54:30.330949 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 183/385] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:29 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:30.908026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f1c854d-8017-46be-b52a-34ea8ab7c315 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:30.922856 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8f1c854d-8017-46be-b52a-34ea8ab7c315 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] HTTP exception thrown: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f1c854d-8017-46be-b52a-34ea8ab7c315 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Request method failure captured: Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/flavors/2027634564/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-ToAnfpM1lw20OF-vaB_IQ8vwlcUsHrQEdmuUujPvNZ_ubSgTtpOyhUpi3P5_BHQBzbuN_BmPfKvnRUl1c9rJIQfbGiCTJH5NSBnB1LOdV79eVHOyPWpNuoRjPvHsEkdVKMWs11TDEdg9aD3LqoMxPmJYX78Vl_0F2PEDdBRKmNtI Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 8e66aeec9f4941c7809d288b2501f083 Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:30.945786 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e66aeec9f4941c7809d288b2501f083"}]}] Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 8e66aeec9f4941c7809d288b2501f083 Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8c6caad8f2f54c6a89f033c33c1fedb5 Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:30.948263 n-d-844627-10 devstack@n-api.service[130961]: exception: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'flavor_id': '2027634564', 'id': 'hw:cpu_thread_policy'} Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:30.949168 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f1c854d-8017-46be-b52a-34ea8ab7c315 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Returning 404 to user: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f1c854d-8017-46be-b52a-34ea8ab7c315 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] 10.222.0.66 "GET /compute/v2.1/flavors/2027634564/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.713659 Aug 04 13:54:30.950491 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 203/386] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 13:54:30 2022] GET /compute/v2.1/flavors/2027634564/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 717 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:30.959392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3ec63d57-c267-4e23-9a7e-702efb1d5427 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:30.965360 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:30.965360 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:30.966209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3ec63d57-c267-4e23-9a7e-702efb1d5427 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '8c6caad8f2f54c6a89f033c33c1fedb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66aeec9f4941c7809d288b2501f083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3ec63d57-c267-4e23-9a7e-702efb1d5427 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Request method failure captured: Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/flavors/2027634564/os-extra_specs HTTP/1.1 Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 66 Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-ToAnfpM1lw20OF-vaB_IQ8vwlcUsHrQEdmuUujPvNZ_ubSgTtpOyhUpi3P5_BHQBzbuN_BmPfKvnRUl1c9rJIQfbGiCTJH5NSBnB1LOdV79eVHOyPWpNuoRjPvHsEkdVKMWs11TDEdg9aD3LqoMxPmJYX78Vl_0F2PEDdBRKmNtI Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 8e66aeec9f4941c7809d288b2501f083 Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:30.968222 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e66aeec9f4941c7809d288b2501f083"}]}] Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 8e66aeec9f4941c7809d288b2501f083 Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8c6caad8f2f54c6a89f033c33c1fedb5 Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 04 13:54:30.969646 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'flavor_id': '2027634564', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:30.970435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 13:54:30.971911 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:30.973418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3ec63d57-c267-4e23-9a7e-702efb1d5427 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:30.973418 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3ec63d57-c267-4e23-9a7e-702efb1d5427 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] 10.222.0.66 "POST /compute/v2.1/flavors/2027634564/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.016002 Aug 04 13:54:30.976822 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 184/387] 10.222.0.66 () {60 vars in 1224 bytes} [Thu Aug 4 13:54:30 2022] POST /compute/v2.1/flavors/2027634564/os-extra_specs => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:30.979025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9966137d-4ff0-44eb-80ac-4cf9cccde519 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:30.981958 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:30.981958 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:31.042552 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9966137d-4ff0-44eb-80ac-4cf9cccde519 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/2027634564/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067208 Aug 04 13:54:31.043454 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 204/388] 10.222.0.66 () {60 vars in 1224 bytes} [Thu Aug 4 13:54:30 2022] POST /compute/v2.1/flavors/2027634564/os-extra_specs => generated 66 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:54:31.054326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6e59377-4f35-473e-8a7c-9f39b57fdf5b tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:31.054854 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:31.054854 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:31.055707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6e59377-4f35-473e-8a7c-9f39b57fdf5b tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '8c6caad8f2f54c6a89f033c33c1fedb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66aeec9f4941c7809d288b2501f083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6e59377-4f35-473e-8a7c-9f39b57fdf5b tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Request method failure captured: Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-ToAnfpM1lw20OF-vaB_IQ8vwlcUsHrQEdmuUujPvNZ_ubSgTtpOyhUpi3P5_BHQBzbuN_BmPfKvnRUl1c9rJIQfbGiCTJH5NSBnB1LOdV79eVHOyPWpNuoRjPvHsEkdVKMWs11TDEdg9aD3LqoMxPmJYX78Vl_0F2PEDdBRKmNtI Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 8e66aeec9f4941c7809d288b2501f083 Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:31.057280 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e66aeec9f4941c7809d288b2501f083"}]}] Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 8e66aeec9f4941c7809d288b2501f083 Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8c6caad8f2f54c6a89f033c33c1fedb5 Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:31.059515 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'flavor_id': '2027634564', 'id': 'hw:numa_nodes'} Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:31.060904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.062515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6e59377-4f35-473e-8a7c-9f39b57fdf5b tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:31.063734 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6e59377-4f35-473e-8a7c-9f39b57fdf5b tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] 10.222.0.66 "DELETE /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008744 Aug 04 13:54:31.066244 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 185/389] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 13:54:31 2022] DELETE /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:31.072507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bfde34a1-37a3-45dc-9204-dd0f6f62d317 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:31.143036 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bfde34a1-37a3-45dc-9204-dd0f6f62d317 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/2027634564/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074769 Aug 04 13:54:31.146413 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 205/390] 10.222.0.66 () {60 vars in 1224 bytes} [Thu Aug 4 13:54:31 2022] POST /compute/v2.1/flavors/2027634564/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:54:31.156946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1764f85-c0dc-4b30-883a-407b78635af3 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:31.160385 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:31.160385 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:31.161390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1764f85-c0dc-4b30-883a-407b78635af3 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '8c6caad8f2f54c6a89f033c33c1fedb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e66aeec9f4941c7809d288b2501f083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1764f85-c0dc-4b30-883a-407b78635af3 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Request method failure captured: Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 22 Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-ToAnfpM1lw20OF-vaB_IQ8vwlcUsHrQEdmuUujPvNZ_ubSgTtpOyhUpi3P5_BHQBzbuN_BmPfKvnRUl1c9rJIQfbGiCTJH5NSBnB1LOdV79eVHOyPWpNuoRjPvHsEkdVKMWs11TDEdg9aD3LqoMxPmJYX78Vl_0F2PEDdBRKmNtI Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 8e66aeec9f4941c7809d288b2501f083 Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:31.166256 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e66aeec9f4941c7809d288b2501f083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e66aeec9f4941c7809d288b2501f083"}]}] Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 8e66aeec9f4941c7809d288b2501f083 Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8c6caad8f2f54c6a89f033c33c1fedb5 Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: {"hw:numa_nodes": "1"} Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:31.167575 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'flavor_id': '2027634564', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:31.168314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 13:54:31.169699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.170849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1764f85-c0dc-4b30-883a-407b78635af3 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:31.170849 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1764f85-c0dc-4b30-883a-407b78635af3 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458 tempest-FlavorsExtraSpecsNegativeTestJSON-1314000458-project] 10.222.0.66 "PUT /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018135 Aug 04 13:54:31.184553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6ee2d581-2dc5-4be4-a85d-84c7a9ab41d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:31.185023 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 186/391] 10.222.0.66 () {60 vars in 1265 bytes} [Thu Aug 4 13:54:31 2022] PUT /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:31.185919 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:31.185919 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:31.201363 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-6ee2d581-2dc5-4be4-a85d-84c7a9ab41d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] HTTP exception thrown: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6ee2d581-2dc5-4be4-a85d-84c7a9ab41d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Request method failure captured: Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/flavors/2027634564/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-UsbyKsqLZKw8y07F04ZIuh4KtcIBcf-5Xt5Ai9FTmoxszEsuvVN6X2gC0zrchUJrrNwP8XuhddD4lUB5aeSM3aRHHG5TWZfSi5YZoymNC16ZWIfXCxqU137L9w5Ko7Br7fj9LF9YoIi76-vOG0Uv921xgN1yodO0FjyY6d3seI6A Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: a252481eff564aadaa11cc67013dee7b Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:54:31.205310 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a252481eff564aadaa11cc67013dee7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a252481eff564aadaa11cc67013dee7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a252481eff564aadaa11cc67013dee7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a252481eff564aadaa11cc67013dee7b"}]}] Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: a252481eff564aadaa11cc67013dee7b Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 58e6afa8da84455abe2e41b8950aecec Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:31.206829 n-d-844627-10 devstack@n-api.service[130961]: exception: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'flavor_id': '2027634564', 'id': 'hw:cpu_thread_policy'} Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:31.207608 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.209100 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.209100 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.209100 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.209100 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:31.209100 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:31.209100 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. Aug 04 13:54:31.209100 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.211438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6ee2d581-2dc5-4be4-a85d-84c7a9ab41d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Returning 404 to user: Flavor 2027634564 has no extra specs with key hw:cpu_thread_policy. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:31.215793 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6ee2d581-2dc5-4be4-a85d-84c7a9ab41d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/2027634564/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.041620 Aug 04 13:54:31.218190 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 206/392] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 13:54:31 2022] DELETE /compute/v2.1/flavors/2027634564/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:31.230940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf94eb7f-f3c2-4207-8e2c-fd1dfb7c748e tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:31.240729 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-bf94eb7f-f3c2-4207-8e2c-fd1dfb7c748e tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf94eb7f-f3c2-4207-8e2c-fd1dfb7c748e tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Request method failure captured: Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 27 Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-UsbyKsqLZKw8y07F04ZIuh4KtcIBcf-5Xt5Ai9FTmoxszEsuvVN6X2gC0zrchUJrrNwP8XuhddD4lUB5aeSM3aRHHG5TWZfSi5YZoymNC16ZWIfXCxqU137L9w5Ko7Br7fj9LF9YoIi76-vOG0Uv921xgN1yodO0FjyY6d3seI6A Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: a252481eff564aadaa11cc67013dee7b Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:54:31.256210 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a252481eff564aadaa11cc67013dee7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a252481eff564aadaa11cc67013dee7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a252481eff564aadaa11cc67013dee7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a252481eff564aadaa11cc67013dee7b"}]}] Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: a252481eff564aadaa11cc67013dee7b Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 58e6afa8da84455abe2e41b8950aecec Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: {"hw:cpu_policy": "shared"} Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:31.257824 n-d-844627-10 devstack@n-api.service[130960]: exception: Request body and URI mismatch Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'flavor_id': '2027634564', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.258667 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.259963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:31.259963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:31.259963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 04 13:54:31.259963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.266457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf94eb7f-f3c2-4207-8e2c-fd1dfb7c748e tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:31.267629 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf94eb7f-f3c2-4207-8e2c-fd1dfb7c748e tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.041041 Aug 04 13:54:31.268699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4f515882-2a38-4970-beb5-b0ea1807fd65 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:31.270116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4f515882-2a38-4970-beb5-b0ea1807fd65 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:31.271098 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 187/393] 10.222.0.66 () {60 vars in 1265 bytes} [Thu Aug 4 13:54:31 2022] PUT /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes => generated 73 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:54:31.290035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f515882-2a38-4970-beb5-b0ea1807fd65 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:31.292855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2a188d5-dac8-4ce6-822b-da0166aa68ea tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:31.298489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f515882-2a38-4970-beb5-b0ea1807fd65 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:31.302817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f515882-2a38-4970-beb5-b0ea1807fd65 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:31.308555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f515882-2a38-4970-beb5-b0ea1807fd65 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2a188d5-dac8-4ce6-822b-da0166aa68ea tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Request method failure captured: Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 49 Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-UsbyKsqLZKw8y07F04ZIuh4KtcIBcf-5Xt5Ai9FTmoxszEsuvVN6X2gC0zrchUJrrNwP8XuhddD4lUB5aeSM3aRHHG5TWZfSi5YZoymNC16ZWIfXCxqU137L9w5Ko7Br7fj9LF9YoIi76-vOG0Uv921xgN1yodO0FjyY6d3seI6A Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: a252481eff564aadaa11cc67013dee7b Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:54:31.318013 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a252481eff564aadaa11cc67013dee7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a252481eff564aadaa11cc67013dee7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a252481eff564aadaa11cc67013dee7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a252481eff564aadaa11cc67013dee7b"}]}] Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: a252481eff564aadaa11cc67013dee7b Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 58e6afa8da84455abe2e41b8950aecec Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 04 13:54:31.319654 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'flavor_id': '2027634564', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance: Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 04 13:54:31.320388 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.321615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:31.322982 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:31.322982 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:31.322982 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:54:31.322982 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:54:31.322982 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 13:54:31.322982 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:31.326322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2a188d5-dac8-4ce6-822b-da0166aa68ea tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:31.328252 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2a188d5-dac8-4ce6-822b-da0166aa68ea tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.052847 Aug 04 13:54:31.332047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 188/394] 10.222.0.66 () {60 vars in 1265 bytes} [Thu Aug 4 13:54:31 2022] PUT /compute/v2.1/flavors/2027634564/os-extra_specs/hw:numa_nodes => generated 117 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:54:31.353328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-166949fd-4870-4c37-8205-159039403af2 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:31.356617 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:31.356617 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:31.409914 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-166949fd-4870-4c37-8205-159039403af2 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/2027634564" status: 202 len: 0 microversion: 2.1 time: 0.069731 Aug 04 13:54:31.413194 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 189/395] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:54:31 2022] DELETE /compute/v2.1/flavors/2027634564 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:54:31.429732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0db9e7ea-daf4-4a20-aa65-1c130875bee0 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:31.433898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0db9e7ea-daf4-4a20-aa65-1c130875bee0 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:31.449394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0db9e7ea-daf4-4a20-aa65-1c130875bee0 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:31.452539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0db9e7ea-daf4-4a20-aa65-1c130875bee0 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:31.457940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0db9e7ea-daf4-4a20-aa65-1c130875bee0 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:31.458721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0db9e7ea-daf4-4a20-aa65-1c130875bee0 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:31.673444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:31.900285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4f515882-2a38-4970-beb5-b0ea1807fd65 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:31.917857 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4f515882-2a38-4970-beb5-b0ea1807fd65 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.681141 Aug 04 13:54:31.918489 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 207/396] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:31 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:31.941288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-faadb948-0f32-4366-9c58-cd34fe4d7947 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:32.037241 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-faadb948-0f32-4366-9c58-cd34fe4d7947 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312 tempest-FlavorsExtraSpecsNegativeTestJSON-1858169312-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.110870 Aug 04 13:54:32.041413 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 208/397] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:31 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:32.069691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0db9e7ea-daf4-4a20-aa65-1c130875bee0 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:32.086336 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0db9e7ea-daf4-4a20-aa65-1c130875bee0 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1323 microversion: 2.1 time: 0.671524 Aug 04 13:54:32.101507 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 190/398] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:31 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1323 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:32.945123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:32.946456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:32.962536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:32.966159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:32.967025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:32.967480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:33.113222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-007d5173-0e0e-48ea-908f-270519c6410f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:33.113668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-007d5173-0e0e-48ea-908f-270519c6410f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:33.126875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-007d5173-0e0e-48ea-908f-270519c6410f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:33.127400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-007d5173-0e0e-48ea-908f-270519c6410f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:33.128227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-007d5173-0e0e-48ea-908f-270519c6410f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:33.130531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-007d5173-0e0e-48ea-908f-270519c6410f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:33.516077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:33.524206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.587869 Aug 04 13:54:33.525179 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 209/399] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:32 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:33.529425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:33.530916 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-757a379d-d547-4934-a13d-c8147902fc8b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004738 Aug 04 13:54:33.531441 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 210/400] 10.222.0.66 () {56 vars in 886 bytes} [Thu Aug 4 13:54:33 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 13:54:34.363486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-007d5173-0e0e-48ea-908f-270519c6410f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:34.378664 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-007d5173-0e0e-48ea-908f-270519c6410f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1323 microversion: 2.1 time: 1.268820 Aug 04 13:54:34.379289 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 191/401] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:33 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1323 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:34.550964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4636b531-82e4-4632-b4b0-67900db2b998 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:34.552387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4636b531-82e4-4632-b4b0-67900db2b998 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:34.587134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4636b531-82e4-4632-b4b0-67900db2b998 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:34.594614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4636b531-82e4-4632-b4b0-67900db2b998 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:34.595487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4636b531-82e4-4632-b4b0-67900db2b998 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:34.601037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4636b531-82e4-4632-b4b0-67900db2b998 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:34.652854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:34.769781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ad1a6493-51b5-4c77-b026-2e9c12cf3582 req-8de20f1f-c2ff-4c81-b5b6-8c0aab7deff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee574a3-6fcd-4a52-9cdf-d0af5ce92124", "name": "network-vif-plugged", "status": "completed", "tag": "37289ac6-3ecf-4e08-88e6-ee3c9eba708a"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:34.791846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ad1a6493-51b5-4c77-b026-2e9c12cf3582 req-8de20f1f-c2ff-4c81-b5b6-8c0aab7deff1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:34.794839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ad1a6493-51b5-4c77-b026-2e9c12cf3582 req-8de20f1f-c2ff-4c81-b5b6-8c0aab7deff1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:34.825334 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ad1a6493-51b5-4c77-b026-2e9c12cf3582 req-8de20f1f-c2ff-4c81-b5b6-8c0aab7deff1 service nova] Creating event network-vif-plugged:37289ac6-3ecf-4e08-88e6-ee3c9eba708a for instance 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 on n-h2-844627-10 Aug 04 13:54:34.831357 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ad1a6493-51b5-4c77-b026-2e9c12cf3582 req-8de20f1f-c2ff-4c81-b5b6-8c0aab7deff1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067040 Aug 04 13:54:34.832720 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 192/402] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:35.400474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-47c5a056-01b5-4497-a50e-a0fe617d41ec tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:35.401214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-47c5a056-01b5-4497-a50e-a0fe617d41ec tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:35.419485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47c5a056-01b5-4497-a50e-a0fe617d41ec tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:35.420092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47c5a056-01b5-4497-a50e-a0fe617d41ec tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:35.420932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47c5a056-01b5-4497-a50e-a0fe617d41ec tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:35.421457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47c5a056-01b5-4497-a50e-a0fe617d41ec tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:35.524385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4636b531-82e4-4632-b4b0-67900db2b998 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:35.536144 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4636b531-82e4-4632-b4b0-67900db2b998 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.989114 Aug 04 13:54:35.549265 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 211/403] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:34 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:35.993625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-47c5a056-01b5-4497-a50e-a0fe617d41ec tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:36.008898 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-47c5a056-01b5-4497-a50e-a0fe617d41ec tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1323 microversion: 2.1 time: 0.611679 Aug 04 13:54:36.010717 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 193/404] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:35 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1323 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:54:36.558015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3905f44-b070-491a-a856-6eab13b728ae tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:36.559637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c3905f44-b070-491a-a856-6eab13b728ae tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:36.572074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3905f44-b070-491a-a856-6eab13b728ae tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:36.572711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3905f44-b070-491a-a856-6eab13b728ae tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:36.573543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3905f44-b070-491a-a856-6eab13b728ae tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:36.573982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3905f44-b070-491a-a856-6eab13b728ae tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:36.881078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c3905f44-b070-491a-a856-6eab13b728ae tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:36.892227 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c3905f44-b070-491a-a856-6eab13b728ae tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.337916 Aug 04 13:54:36.892831 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 212/405] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:36 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:37.034804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06a53540-95bf-47af-8e32-f4b247c7c161 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:37.035817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-06a53540-95bf-47af-8e32-f4b247c7c161 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:37.048991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06a53540-95bf-47af-8e32-f4b247c7c161 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:37.049672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06a53540-95bf-47af-8e32-f4b247c7c161 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:37.051299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06a53540-95bf-47af-8e32-f4b247c7c161 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:37.052293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06a53540-95bf-47af-8e32-f4b247c7c161 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:37.917116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-82ec42a2-3d6c-45fd-9175-63ba4b1e58f3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:37.917970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-82ec42a2-3d6c-45fd-9175-63ba4b1e58f3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:37.936765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82ec42a2-3d6c-45fd-9175-63ba4b1e58f3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:37.945572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82ec42a2-3d6c-45fd-9175-63ba4b1e58f3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:37.946802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82ec42a2-3d6c-45fd-9175-63ba4b1e58f3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:37.947680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82ec42a2-3d6c-45fd-9175-63ba4b1e58f3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:37.965602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-06a53540-95bf-47af-8e32-f4b247c7c161 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:38.000800 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-06a53540-95bf-47af-8e32-f4b247c7c161 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1473 microversion: 2.1 time: 0.971560 Aug 04 13:54:38.001891 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 194/406] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:37 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1473 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:38.029719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:38.030510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:38.055588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:38.056222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:38.056846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:38.057505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:38.108658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Request method failure captured: Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124/diagnostics HTTP/1.1 Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-FO2zOH3Hv_BSAPhEIYbRZwyiPb4bk9bxeBmKfp9C3mAo3qiBvL7leugif2FtAlR9PPI5f3bmiVnM5wqBNMyj_yeV6wcoLLojhDiH5888Ihe2Uk87Rj8781eI4-ZrP3G-MK4ILQeOGmqNIoi7ndi9w8Ovm_3LPM4Dr_Ptz2MF6UVM Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 6f4528cf84674fb9b91e9d01bb3a898f Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1712924507 Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:54:38.126101 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6f4528cf84674fb9b91e9d01bb3a898f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6f4528cf84674fb9b91e9d01bb3a898f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6f4528cf84674fb9b91e9d01bb3a898f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6f4528cf84674fb9b91e9d01bb3a898f"}]}] Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1712924507 Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 6f4528cf84674fb9b91e9d01bb3a898f Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1712924507 Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerDiagnosticsNegativeTest-1712924507-project Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 5ed2cafefbc24d6c9ff8a7b0e052c4d3 Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1712924507-project Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:54:38.127584 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'server_id': '6ee574a3-6fcd-4a52-9cdf-d0af5ce92124'} Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:54:38.128401 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 13:54:38.130507 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:54:38.133341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:38.134499 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-710ad297-b937-4ac2-be04-408c900eeed1 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.109806 Aug 04 13:54:38.135226 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 195/407] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 13:54:38 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124/diagnostics => generated 117 bytes in 111 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:38.145120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-927d560d-304b-47b9-839a-4dcac8deb15a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:38.145776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-927d560d-304b-47b9-839a-4dcac8deb15a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:38.162579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-927d560d-304b-47b9-839a-4dcac8deb15a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:38.169460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-927d560d-304b-47b9-839a-4dcac8deb15a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:38.171051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-927d560d-304b-47b9-839a-4dcac8deb15a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:38.171865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-927d560d-304b-47b9-839a-4dcac8deb15a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:38.246658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-927d560d-304b-47b9-839a-4dcac8deb15a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:54:38.539465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-927d560d-304b-47b9-839a-4dcac8deb15a tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 204 len: 0 microversion: 2.1 time: 0.398048 Aug 04 13:54:38.541252 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 196/408] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:54:38 2022] DELETE /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:54:38.552753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bcac8dc8-931b-4548-8814-b723a670c346 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:38.554142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bcac8dc8-931b-4548-8814-b723a670c346 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:38.572146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bcac8dc8-931b-4548-8814-b723a670c346 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:38.574113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bcac8dc8-931b-4548-8814-b723a670c346 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:38.575689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bcac8dc8-931b-4548-8814-b723a670c346 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:38.578632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bcac8dc8-931b-4548-8814-b723a670c346 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:38.660731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:39.418489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bcac8dc8-931b-4548-8814-b723a670c346 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:39.430160 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bcac8dc8-931b-4548-8814-b723a670c346 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1479 microversion: 2.1 time: 0.885304 Aug 04 13:54:39.450306 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 197/409] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:38 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1479 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:39.870066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-82ec42a2-3d6c-45fd-9175-63ba4b1e58f3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:39.878604 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-82ec42a2-3d6c-45fd-9175-63ba4b1e58f3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 1.965642 Aug 04 13:54:39.879188 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 213/410] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:37 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:54:40.460888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1ac3a11b-30e3-472c-a04e-f8e1aa8a7c77 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:40.462920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1ac3a11b-30e3-472c-a04e-f8e1aa8a7c77 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:40.506758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ac3a11b-30e3-472c-a04e-f8e1aa8a7c77 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:40.512828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ac3a11b-30e3-472c-a04e-f8e1aa8a7c77 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:40.526842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ac3a11b-30e3-472c-a04e-f8e1aa8a7c77 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:40.527895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ac3a11b-30e3-472c-a04e-f8e1aa8a7c77 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:40.907883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-333c16b0-1621-46de-a59d-3802e6d43fb2 tempest-FlavorsV255TestJSON-91498303 tempest-FlavorsV255TestJSON-91498303-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1053500165", "id": 1973371617, "os-flavor-access:is_public": "True"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:40.916271 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:40.916271 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:40.954458 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-333c16b0-1621-46de-a59d-3802e6d43fb2 tempest-FlavorsV255TestJSON-91498303 tempest-FlavorsV255TestJSON-91498303-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.478901 Aug 04 13:54:40.955229 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 214/411] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 13:54:40 2022] POST /compute/v2.1/flavors => generated 449 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 13:54:40.966682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e5ea941c-0c2c-4966-ab73-de3ee4823fd6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:40.971358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e5ea941c-0c2c-4966-ab73-de3ee4823fd6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:40.982747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5ea941c-0c2c-4966-ab73-de3ee4823fd6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:40.986677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5ea941c-0c2c-4966-ab73-de3ee4823fd6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:40.987772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5ea941c-0c2c-4966-ab73-de3ee4823fd6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:40.988454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5ea941c-0c2c-4966-ab73-de3ee4823fd6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:41.308630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1ac3a11b-30e3-472c-a04e-f8e1aa8a7c77 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:41.322615 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1ac3a11b-30e3-472c-a04e-f8e1aa8a7c77 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1479 microversion: 2.1 time: 0.873004 Aug 04 13:54:41.323673 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 198/412] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:40 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1479 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:41.830983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-feafc5e0-cc63-45b4-adf7-f0c7736080b4 tempest-FlavorsV255TestJSON-1313974739 tempest-FlavorsV255TestJSON-1313974739-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:41.850533 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-feafc5e0-cc63-45b4-adf7-f0c7736080b4 tempest-FlavorsV255TestJSON-1313974739 tempest-FlavorsV255TestJSON-1313974739-project] 10.222.0.66 "GET /compute/v2.1/flavors/1973371617" status: 200 len: 449 microversion: 2.55 time: 0.525227 Aug 04 13:54:41.860180 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 199/413] 10.222.0.66 () {60 vars in 1199 bytes} [Thu Aug 4 13:54:41 2022] GET /compute/v2.1/flavors/1973371617 => generated 449 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:41.866087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-48330eec-78b5-48fd-8027-6355b0d457cf tempest-FlavorsV255TestJSON-91498303 tempest-FlavorsV255TestJSON-91498303-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:41.869472 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:41.869472 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:41.911737 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-48330eec-78b5-48fd-8027-6355b0d457cf tempest-FlavorsV255TestJSON-91498303 tempest-FlavorsV255TestJSON-91498303-project-admin] 10.222.0.66 "PUT /compute/v2.1/flavors/1973371617" status: 200 len: 450 microversion: 2.55 time: 0.046907 Aug 04 13:54:41.916844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e5ea941c-0c2c-4966-ab73-de3ee4823fd6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:41.923998 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 200/414] 10.222.0.66 () {62 vars in 1219 bytes} [Thu Aug 4 13:54:41 2022] PUT /compute/v2.1/flavors/1973371617 => generated 450 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:54:41.931109 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e5ea941c-0c2c-4966-ab73-de3ee4823fd6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1476 microversion: 2.1 time: 0.973190 Aug 04 13:54:41.932657 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 215/415] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:40 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1476 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:41.935668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4d8fc0d8-9730-43aa-8b07-3918b930a553 tempest-FlavorsV255TestJSON-1313974739 tempest-FlavorsV255TestJSON-1313974739-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:42.062044 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4d8fc0d8-9730-43aa-8b07-3918b930a553 tempest-FlavorsV255TestJSON-1313974739 tempest-FlavorsV255TestJSON-1313974739-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.129157 Aug 04 13:54:42.076592 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 201/416] 10.222.0.66 () {60 vars in 1187 bytes} [Thu Aug 4 13:54:41 2022] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:54:42.095980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b06ed7d3-51c0-46f3-a1d7-ead8a1d43051 tempest-FlavorsV255TestJSON-1313974739 tempest-FlavorsV255TestJSON-1313974739-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:42.136688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=79,nova_api:DELETE=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:42.170005 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b06ed7d3-51c0-46f3-a1d7-ead8a1d43051 tempest-FlavorsV255TestJSON-1313974739 tempest-FlavorsV255TestJSON-1313974739-project] 10.222.0.66 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.078721 Aug 04 13:54:42.200315 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 216/417] 10.222.0.66 () {60 vars in 1166 bytes} [Thu Aug 4 13:54:42 2022] GET /compute/v2.1/flavors => generated 3681 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:54:42.210149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9a3a35c3-e68d-4266-a09e-bac600f28f4f tempest-FlavorsV255TestJSON-91498303 tempest-FlavorsV255TestJSON-91498303-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:42.211741 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:42.211741 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:42.278003 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9a3a35c3-e68d-4266-a09e-bac600f28f4f tempest-FlavorsV255TestJSON-91498303 tempest-FlavorsV255TestJSON-91498303-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1973371617" status: 202 len: 0 microversion: 2.55 time: 0.075730 Aug 04 13:54:42.283280 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 202/418] 10.222.0.66 () {60 vars in 1202 bytes} [Thu Aug 4 13:54:42 2022] DELETE /compute/v2.1/flavors/1973371617 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:54:42.292851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75960c4e-712d-48b7-88fc-0da35f1f8314 tempest-FlavorsV255TestJSON-91498303 tempest-FlavorsV255TestJSON-91498303-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:42.337058 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75960c4e-712d-48b7-88fc-0da35f1f8314 tempest-FlavorsV255TestJSON-91498303 tempest-FlavorsV255TestJSON-91498303-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 6151 microversion: 2.55 time: 0.049978 Aug 04 13:54:42.340022 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 217/419] 10.222.0.66 () {60 vars in 1187 bytes} [Thu Aug 4 13:54:42 2022] GET /compute/v2.1/flavors/detail => generated 6151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:54:42.350721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2128330d-e8e6-4001-8955-7d792982c225 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:42.351563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2128330d-e8e6-4001-8955-7d792982c225 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:42.379636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2128330d-e8e6-4001-8955-7d792982c225 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:42.381736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2128330d-e8e6-4001-8955-7d792982c225 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:42.390427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2128330d-e8e6-4001-8955-7d792982c225 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:42.392357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2128330d-e8e6-4001-8955-7d792982c225 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:43.315456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1554741144", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:43.407123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2128330d-e8e6-4001-8955-7d792982c225 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:43.453879 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2128330d-e8e6-4001-8955-7d792982c225 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1479 microversion: 2.1 time: 1.107966 Aug 04 13:54:43.454514 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 203/420] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:42 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1479 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:54:43.458790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:54:43.485024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a8aae823-2179-461a-aadd-8b86e5d8a6c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:43.485895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a8aae823-2179-461a-aadd-8b86e5d8a6c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:43.505432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8aae823-2179-461a-aadd-8b86e5d8a6c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:43.511556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8aae823-2179-461a-aadd-8b86e5d8a6c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:43.525055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8aae823-2179-461a-aadd-8b86e5d8a6c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:43.525712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8aae823-2179-461a-aadd-8b86e5d8a6c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:44.385017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a8aae823-2179-461a-aadd-8b86e5d8a6c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:44.397766 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a8aae823-2179-461a-aadd-8b86e5d8a6c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1475 microversion: 2.1 time: 0.937721 Aug 04 13:54:44.407435 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 204/421] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:43 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1475 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:44.417794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e8811c90-fbe0-49bf-af75-2329b9580d5e req-dd7bb36b-366e-4be7-82bc-9d7a27442760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee574a3-6fcd-4a52-9cdf-d0af5ce92124", "name": "network-vif-deleted", "tag": "37289ac6-3ecf-4e08-88e6-ee3c9eba708a"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:44.441081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e8811c90-fbe0-49bf-af75-2329b9580d5e req-dd7bb36b-366e-4be7-82bc-9d7a27442760 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:44.447286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e8811c90-fbe0-49bf-af75-2329b9580d5e req-dd7bb36b-366e-4be7-82bc-9d7a27442760 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:44.469787 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e8811c90-fbe0-49bf-af75-2329b9580d5e req-dd7bb36b-366e-4be7-82bc-9d7a27442760 service nova] Creating event network-vif-deleted:37289ac6-3ecf-4e08-88e6-ee3c9eba708a for instance 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 on n-h2-844627-10 Aug 04 13:54:44.486815 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e8811c90-fbe0-49bf-af75-2329b9580d5e req-dd7bb36b-366e-4be7-82bc-9d7a27442760 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077120 Aug 04 13:54:44.488472 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 205/422] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:44.504823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:54:44.506175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:54:44.507003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:54:44.508331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:54:44.509038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:54:44.528722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:44.534606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:44.536008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:44.539524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:44.545491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:44.549039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:44.559638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:44.560098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:44.562940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:44.562940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:44.604491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Getting quotas for project 7b30c782fc334aa19f39ac3178b29a17. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:54:44.612788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Getting quotas for user 50f66b75313549e4bd9a676ae1078b7c and project 7b30c782fc334aa19f39ac3178b29a17. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:54:44.638669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:44.639163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:44.641011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lazy-loading 'fault' on Instance uuid 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:54:44.647086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:54:44.655950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:54:44.762137 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3cc2263-53af-4f95-bb3a-0fa6a73bcc31 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.260071 Aug 04 13:54:44.765477 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 218/423] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:54:44.795573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ed2cafefbc24d6c9ff8a7b0e052c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4528cf84674fb9b91e9d01bb3a898f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:44.807188 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-32094e9a-d2c5-4417-8b79-ef770d9b9744 tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 200 len: 1313 microversion: 2.1 time: 0.314419 Aug 04 13:54:44.812729 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 206/424] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:44 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:44.927633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1961545331", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:45.044425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:54:45.429064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a74a597a-ce07-4501-9d41-925cf71e1bec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:45.430483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a74a597a-ce07-4501-9d41-925cf71e1bec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:45.444755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a74a597a-ce07-4501-9d41-925cf71e1bec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:45.450687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a74a597a-ce07-4501-9d41-925cf71e1bec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:45.452440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a74a597a-ce07-4501-9d41-925cf71e1bec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:45.453317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a74a597a-ce07-4501-9d41-925cf71e1bec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:46.171687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:54:46.172208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:54:46.172570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:54:46.173465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:54:46.174000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:54:46.227635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:46.230399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:46.234829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:46.239655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:46.335341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Getting quotas for project 7b30c782fc334aa19f39ac3178b29a17. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:54:46.346339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Getting quotas for user 50f66b75313549e4bd9a676ae1078b7c and project 7b30c782fc334aa19f39ac3178b29a17. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:54:46.370004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:54:46.377564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:54:46.504752 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-71d0c234-b59e-4c79-a5c7-29456ceb746b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.579126 Aug 04 13:54:46.512344 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 219/425] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:54:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:54:46.528546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:46.533542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] [instance: 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:46.567955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:46.589813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:46.598070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:46.598911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:46.710215 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] HTTP exception thrown: Instance 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 could not be found. Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Request method failure captured: Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 HTTP/1.1 Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-FO2zOH3Hv_BSAPhEIYbRZwyiPb4bk9bxeBmKfp9C3mAo3qiBvL7leugif2FtAlR9PPI5f3bmiVnM5wqBNMyj_yeV6wcoLLojhDiH5888Ihe2Uk87Rj8781eI4-ZrP3G-MK4ILQeOGmqNIoi7ndi9w8Ovm_3LPM4Dr_Ptz2MF6UVM Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 6f4528cf84674fb9b91e9d01bb3a898f Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1712924507 Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:54:46.718306 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6f4528cf84674fb9b91e9d01bb3a898f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6f4528cf84674fb9b91e9d01bb3a898f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6f4528cf84674fb9b91e9d01bb3a898f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6f4528cf84674fb9b91e9d01bb3a898f"}]}] Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1712924507 Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 6f4528cf84674fb9b91e9d01bb3a898f Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1712924507 Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerDiagnosticsNegativeTest-1712924507-project Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 5ed2cafefbc24d6c9ff8a7b0e052c4d3 Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1712924507-project Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 could not be found. Aug 04 13:54:46.719955 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '6ee574a3-6fcd-4a52-9cdf-d0af5ce92124'} Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 could not be found. Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:54:46.720791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 could not be found. Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 could not be found. Aug 04 13:54:46.722250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:54:46.724514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] Returning 404 to user: Instance 6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:54:46.726758 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9dce36aa-14de-4802-976c-4992b6b5e21f tempest-ServerDiagnosticsNegativeTest-1712924507 tempest-ServerDiagnosticsNegativeTest-1712924507-project] 10.222.0.66 "GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124" status: 404 len: 111 microversion: 2.1 time: 0.212397 Aug 04 13:54:46.739219 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 220/426] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:46 2022] GET /compute/v2.1/servers/6ee574a3-6fcd-4a52-9cdf-d0af5ce92124 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:54:46.758095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f84c046-6419-4005-9e86-b73b2d2e0d8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:46.758953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f84c046-6419-4005-9e86-b73b2d2e0d8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:47.035649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a74a597a-ce07-4501-9d41-925cf71e1bec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:47.056847 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a74a597a-ce07-4501-9d41-925cf71e1bec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1475 microversion: 2.1 time: 1.620831 Aug 04 13:54:47.057767 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 207/427] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:45 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1475 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:47.099124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-fc96a3cb-0225-43c1-9f27-cec2c1c84372 req-6926c564-de1e-436f-97ad-531979e0dc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4404b9e-c6d1-4f63-bb72-b180f02ca603", "name": "network-vif-unplugged", "status": "completed", "tag": "7772b93f-4e1b-4b26-bc3c-00df0a0b3c45"}, {"name": "network-changed", "server_uuid": "f4404b9e-c6d1-4f63-bb72-b180f02ca603", "tag": "7772b93f-4e1b-4b26-bc3c-00df0a0b3c45"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:47.152422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fc96a3cb-0225-43c1-9f27-cec2c1c84372 req-6926c564-de1e-436f-97ad-531979e0dc0b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:47.152903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fc96a3cb-0225-43c1-9f27-cec2c1c84372 req-6926c564-de1e-436f-97ad-531979e0dc0b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:47.218036 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fc96a3cb-0225-43c1-9f27-cec2c1c84372 req-6926c564-de1e-436f-97ad-531979e0dc0b service nova] Creating event network-vif-unplugged:7772b93f-4e1b-4b26-bc3c-00df0a0b3c45 for instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 on n-h1-844627-10 Aug 04 13:54:47.218853 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fc96a3cb-0225-43c1-9f27-cec2c1c84372 req-6926c564-de1e-436f-97ad-531979e0dc0b service nova] Creating event network-changed:7772b93f-4e1b-4b26-bc3c-00df0a0b3c45 for instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 on n-h1-844627-10 Aug 04 13:54:47.290672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-fc96a3cb-0225-43c1-9f27-cec2c1c84372 req-6926c564-de1e-436f-97ad-531979e0dc0b service nova] Instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:54:47.396538 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-fc96a3cb-0225-43c1-9f27-cec2c1c84372 req-6926c564-de1e-436f-97ad-531979e0dc0b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.284101 Aug 04 13:54:47.399421 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 208/428] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:47.491943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f84c046-6419-4005-9e86-b73b2d2e0d8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:47.504397 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f84c046-6419-4005-9e86-b73b2d2e0d8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1214 microversion: 2.1 time: 0.763721 Aug 04 13:54:47.527566 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 221/429] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:46 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1214 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:48.106983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-89c3f529-9cd8-4f41-8635-25985e4a8698 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:48.108544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-89c3f529-9cd8-4f41-8635-25985e4a8698 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:48.134000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89c3f529-9cd8-4f41-8635-25985e4a8698 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:48.135043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89c3f529-9cd8-4f41-8635-25985e4a8698 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:48.138209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89c3f529-9cd8-4f41-8635-25985e4a8698 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:48.138975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89c3f529-9cd8-4f41-8635-25985e4a8698 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:48.548782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49d27224-aabc-4393-9724-e3566fe32a75 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:48.549707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49d27224-aabc-4393-9724-e3566fe32a75 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:48.562245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49d27224-aabc-4393-9724-e3566fe32a75 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:48.562881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49d27224-aabc-4393-9724-e3566fe32a75 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:48.565759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49d27224-aabc-4393-9724-e3566fe32a75 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:48.568051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49d27224-aabc-4393-9724-e3566fe32a75 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:48.984514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-49d27224-aabc-4393-9724-e3566fe32a75 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:49.009525 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49d27224-aabc-4393-9724-e3566fe32a75 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1266 microversion: 2.1 time: 0.465614 Aug 04 13:54:49.010906 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 222/430] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:48 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:49.221102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-89c3f529-9cd8-4f41-8635-25985e4a8698 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:49.251794 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-89c3f529-9cd8-4f41-8635-25985e4a8698 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1475 microversion: 2.1 time: 1.158310 Aug 04 13:54:49.252487 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 209/431] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:48 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1475 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:50.036089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bcbe25d8-b3a7-4416-9498-8badb0a64deb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:50.036835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bcbe25d8-b3a7-4416-9498-8badb0a64deb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:50.048953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcbe25d8-b3a7-4416-9498-8badb0a64deb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:50.053444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcbe25d8-b3a7-4416-9498-8badb0a64deb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:50.054401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcbe25d8-b3a7-4416-9498-8badb0a64deb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:50.062981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcbe25d8-b3a7-4416-9498-8badb0a64deb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:50.274299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a1cccc1-627d-4ae6-be8c-921345f7da7f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:50.275781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a1cccc1-627d-4ae6-be8c-921345f7da7f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:50.287682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a1cccc1-627d-4ae6-be8c-921345f7da7f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:50.289435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a1cccc1-627d-4ae6-be8c-921345f7da7f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:50.291632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a1cccc1-627d-4ae6-be8c-921345f7da7f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:50.292350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a1cccc1-627d-4ae6-be8c-921345f7da7f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:50.374729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bcbe25d8-b3a7-4416-9498-8badb0a64deb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:50.385271 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bcbe25d8-b3a7-4416-9498-8badb0a64deb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1272 microversion: 2.1 time: 0.353106 Aug 04 13:54:50.397501 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 223/432] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:50 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1272 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:51.413588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dba638ca-bd0b-46a3-9698-d0283d9a898a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:51.416469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dba638ca-bd0b-46a3-9698-d0283d9a898a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:51.430533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dba638ca-bd0b-46a3-9698-d0283d9a898a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:51.435086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dba638ca-bd0b-46a3-9698-d0283d9a898a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:51.436796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dba638ca-bd0b-46a3-9698-d0283d9a898a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:51.438180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dba638ca-bd0b-46a3-9698-d0283d9a898a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:51.951223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dba638ca-bd0b-46a3-9698-d0283d9a898a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:51.968239 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dba638ca-bd0b-46a3-9698-d0283d9a898a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1272 microversion: 2.1 time: 0.554083 Aug 04 13:54:51.976671 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 224/433] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:51 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1272 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:52.661985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a1cccc1-627d-4ae6-be8c-921345f7da7f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:52.679482 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a1cccc1-627d-4ae6-be8c-921345f7da7f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1473 microversion: 2.1 time: 2.409368 Aug 04 13:54:52.680074 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 210/434] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:50 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1473 bytes in 2411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:54:53.003810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0d3834d-1330-44a3-8c6c-b609330c302a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:53.005216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c0d3834d-1330-44a3-8c6c-b609330c302a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:53.026308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0d3834d-1330-44a3-8c6c-b609330c302a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:53.034085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0d3834d-1330-44a3-8c6c-b609330c302a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:53.038894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0d3834d-1330-44a3-8c6c-b609330c302a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:53.039795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0d3834d-1330-44a3-8c6c-b609330c302a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:53.708497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1709886b-a9eb-4203-a502-1aa1c78899d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:53.709938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1709886b-a9eb-4203-a502-1aa1c78899d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:53.740610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1709886b-a9eb-4203-a502-1aa1c78899d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:53.746571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1709886b-a9eb-4203-a502-1aa1c78899d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:53.747837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1709886b-a9eb-4203-a502-1aa1c78899d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:53.750248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1709886b-a9eb-4203-a502-1aa1c78899d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:53.809164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c0d3834d-1330-44a3-8c6c-b609330c302a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:53.834265 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0d3834d-1330-44a3-8c6c-b609330c302a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1272 microversion: 2.1 time: 0.834611 Aug 04 13:54:53.836386 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 225/435] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:52 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1272 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:55.108431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1709886b-a9eb-4203-a502-1aa1c78899d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:55.122848 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1709886b-a9eb-4203-a502-1aa1c78899d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1470 microversion: 2.1 time: 1.417157 Aug 04 13:54:55.138778 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 211/436] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:53 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1470 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:55.399652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0be066cb-5637-4d83-b9c8-214eb23f3455 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Calling method '.version_select at 0x7f470349f8b0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:55.401049 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:55.401049 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:55.402307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be066cb-5637-4d83-b9c8-214eb23f3455 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:55.406773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be066cb-5637-4d83-b9c8-214eb23f3455 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:55.460246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be066cb-5637-4d83-b9c8-214eb23f3455 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:55.460699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be066cb-5637-4d83-b9c8-214eb23f3455 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:55.493307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be066cb-5637-4d83-b9c8-214eb23f3455 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:55.494836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be066cb-5637-4d83-b9c8-214eb23f3455 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:55.510304 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0be066cb-5637-4d83-b9c8-214eb23f3455 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.441574 Aug 04 13:54:55.514700 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 226/437] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:54 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:55.526695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba8fdadd-2858-4ca7-a5d1-49a0b30a9568 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:55.527682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ba8fdadd-2858-4ca7-a5d1-49a0b30a9568 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:55.554147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba8fdadd-2858-4ca7-a5d1-49a0b30a9568 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:55.556945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba8fdadd-2858-4ca7-a5d1-49a0b30a9568 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:55.557987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba8fdadd-2858-4ca7-a5d1-49a0b30a9568 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:55.558590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba8fdadd-2858-4ca7-a5d1-49a0b30a9568 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:55.722421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c7c7594c-4ffc-49ba-a6a5-108cd21ba83d tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Action: 'create', calling method: .version_select at 0x7f4700d4b430>, body: {"keypair": {"name": "tempest-keypair-2105900556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAG6pLlrOjLjAVAKhAKcreJoIoKmFam6qrfQsjlSK1f2PoGfCYsiUokifamkE4YSis41jsfJLkoPWICVrTEVVA384GnGXt0C4BxdSUCkOm72q3S9yNeimgBX25C0BwdOw=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:55.763119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c7c7594c-4ffc-49ba-a6a5-108cd21ba83d tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Getting quotas for project 6adc52f7e03846d3a73ef1c6d2b040cd. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:54:55.775463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c7c7594c-4ffc-49ba-a6a5-108cd21ba83d tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Getting quotas for user c5534a5c5eff41e998b2b92ca13bb372 and project 6adc52f7e03846d3a73ef1c6d2b040cd. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:54:55.838888 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c7c7594c-4ffc-49ba-a6a5-108cd21ba83d tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.696425 Aug 04 13:54:55.854099 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 212/438] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:54:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:55.870608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c52a112-6c3e-4423-94ad-64600fd7ce2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:55.873103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c52a112-6c3e-4423-94ad-64600fd7ce2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:55.889723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c52a112-6c3e-4423-94ad-64600fd7ce2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:55.890442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c52a112-6c3e-4423-94ad-64600fd7ce2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:55.891403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c52a112-6c3e-4423-94ad-64600fd7ce2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:55.895696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c52a112-6c3e-4423-94ad-64600fd7ce2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:56.048807 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c52a112-6c3e-4423-94ad-64600fd7ce2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603/action" status: 204 len: 0 microversion: 2.1 time: 0.190000 Aug 04 13:54:56.051767 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 213/439] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:54:55 2022] POST /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603/action => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:54:56.088462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f8265eed-40c9-430e-a6f8-e0351a7e28cf tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Calling method '.version_select at 0x7f4700cf9670>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:56.091066 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:56.091066 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:56.098213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8265eed-40c9-430e-a6f8-e0351a7e28cf tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:56.103142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8265eed-40c9-430e-a6f8-e0351a7e28cf tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:56.157398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8265eed-40c9-430e-a6f8-e0351a7e28cf tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:56.159291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8265eed-40c9-430e-a6f8-e0351a7e28cf tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:56.195617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8265eed-40c9-430e-a6f8-e0351a7e28cf tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:56.196567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8265eed-40c9-430e-a6f8-e0351a7e28cf tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:56.220403 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f8265eed-40c9-430e-a6f8-e0351a7e28cf tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.152693 Aug 04 13:54:56.224699 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 214/440] 10.222.0.66 () {58 vars in 1167 bytes} [Thu Aug 4 13:54:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:56.242915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15ec3c0d-5447-4954-814f-c342ebfa43c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:56.246453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-15ec3c0d-5447-4954-814f-c342ebfa43c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:56.269263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15ec3c0d-5447-4954-814f-c342ebfa43c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:56.269947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15ec3c0d-5447-4954-814f-c342ebfa43c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:56.270895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15ec3c0d-5447-4954-814f-c342ebfa43c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:56.271497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15ec3c0d-5447-4954-814f-c342ebfa43c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:56.302983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:57.452837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-15ec3c0d-5447-4954-814f-c342ebfa43c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:57.464464 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-15ec3c0d-5447-4954-814f-c342ebfa43c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1470 microversion: 2.1 time: 1.235616 Aug 04 13:54:57.471313 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 215/441] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:56 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1470 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:57.492936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-357d2b1b-3cf2-44df-8691-233eaf7ac05d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Calling method '.version_select at 0x7f4700b3cd30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:57.497772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=14 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:57.505912 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:57.505912 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:57.512122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-357d2b1b-3cf2-44df-8691-233eaf7ac05d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:57.516403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-357d2b1b-3cf2-44df-8691-233eaf7ac05d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:57.555266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ba8fdadd-2858-4ca7-a5d1-49a0b30a9568 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:57.565565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ba8fdadd-2858-4ca7-a5d1-49a0b30a9568 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1314 microversion: 2.1 time: 2.049387 Aug 04 13:54:57.577981 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 227/442] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:55 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1314 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:57.590632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-357d2b1b-3cf2-44df-8691-233eaf7ac05d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:57.591096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-357d2b1b-3cf2-44df-8691-233eaf7ac05d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:57.645056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-357d2b1b-3cf2-44df-8691-233eaf7ac05d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:57.648053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-357d2b1b-3cf2-44df-8691-233eaf7ac05d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:57.679779 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-357d2b1b-3cf2-44df-8691-233eaf7ac05d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.205567 Aug 04 13:54:57.683230 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 216/443] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:57.694694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c373ac0-f917-49ce-ab0d-9de228644255 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Calling method '.version_select at 0x7f4700efb280>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:57.696008 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:57.696008 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:57.697752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c373ac0-f917-49ce-ab0d-9de228644255 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:57.698391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c373ac0-f917-49ce-ab0d-9de228644255 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:57.814883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c373ac0-f917-49ce-ab0d-9de228644255 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:57.816187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c373ac0-f917-49ce-ab0d-9de228644255 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:57.863664 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c373ac0-f917-49ce-ab0d-9de228644255 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.172559 Aug 04 13:54:57.868957 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 228/444] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:57.901244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7bb2a7dd-7fd5-42bd-b7e2-c7f55b029b37 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Calling method '.version_select at 0x7f4700b3c3a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:57.902386 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:57.902386 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:57.905607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bb2a7dd-7fd5-42bd-b7e2-c7f55b029b37 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:57.906448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bb2a7dd-7fd5-42bd-b7e2-c7f55b029b37 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:57.943294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ff7930c5-9ef0-4bb0-8c74-e0a40288a9b2 req-49ea3ac0-2c87-49b3-8adf-6e637d4a970d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9802281d-83eb-4b5d-8fe0-bc812e0872e4", "tag": "f591719b-2d26-42da-b7bb-dfe4d507c0a9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:57.982027 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7bb2a7dd-7fd5-42bd-b7e2-c7f55b029b37 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.094221 Aug 04 13:54:57.987246 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 217/445] 10.222.0.66 () {58 vars in 1179 bytes} [Thu Aug 4 13:54:57 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:57.989938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ff7930c5-9ef0-4bb0-8c74-e0a40288a9b2 req-49ea3ac0-2c87-49b3-8adf-6e637d4a970d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:57.990626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ff7930c5-9ef0-4bb0-8c74-e0a40288a9b2 req-49ea3ac0-2c87-49b3-8adf-6e637d4a970d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:57.998763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eef4e2f6-d29d-4111-a296-ef772183024d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Calling method '.version_select at 0x7f4700b3cb80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:57.999953 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:57.999953 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:58.002632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f6-d29d-4111-a296-ef772183024d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.007711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f6-d29d-4111-a296-ef772183024d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.036039 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ff7930c5-9ef0-4bb0-8c74-e0a40288a9b2 req-49ea3ac0-2c87-49b3-8adf-6e637d4a970d service nova] Creating event network-changed:f591719b-2d26-42da-b7bb-dfe4d507c0a9 for instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 on n-h1-844627-10 Aug 04 13:54:58.051520 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ff7930c5-9ef0-4bb0-8c74-e0a40288a9b2 req-49ea3ac0-2c87-49b3-8adf-6e637d4a970d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112780 Aug 04 13:54:58.052459 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 229/446] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:58.064436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=90,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:58.066384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f6-d29d-4111-a296-ef772183024d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.067017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f6-d29d-4111-a296-ef772183024d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.083743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f6-d29d-4111-a296-ef772183024d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.084484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef4e2f6-d29d-4111-a296-ef772183024d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.094828 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eef4e2f6-d29d-4111-a296-ef772183024d tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.101585 Aug 04 13:54:58.096231 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 218/447] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:54:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:54:58.115375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-244ac0b8-9166-4227-97fd-7be6b9c04566 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Calling method '.version_select at 0x7f4700c51b80>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:58.116666 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:58.116666 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:58.119419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-244ac0b8-9166-4227-97fd-7be6b9c04566 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.121306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-244ac0b8-9166-4227-97fd-7be6b9c04566 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.183421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-244ac0b8-9166-4227-97fd-7be6b9c04566 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.185538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-244ac0b8-9166-4227-97fd-7be6b9c04566 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.212365 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-244ac0b8-9166-4227-97fd-7be6b9c04566 tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.109734 Aug 04 13:54:58.217673 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 230/448] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:58.241874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b9e69bc4-c865-43a5-8957-f9776f17d45f tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Calling method '.version_select at 0x7f4700b3cd30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:58.243080 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:58.243080 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:54:58.245717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9e69bc4-c865-43a5-8957-f9776f17d45f tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.247390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9e69bc4-c865-43a5-8957-f9776f17d45f tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.320056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9e69bc4-c865-43a5-8957-f9776f17d45f tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.320427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9e69bc4-c865-43a5-8957-f9776f17d45f tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.354409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:54:58.360749 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b9e69bc4-c865-43a5-8957-f9776f17d45f tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.122601 Aug 04 13:54:58.367114 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 219/449] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 13:54:58 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:58.386916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e3a4d8e9-4db9-48d8-93a5-68ac11ff3d7b tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Calling method '.version_select at 0x7f4700efb0d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:58.387962 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:54:58.387962 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:54:58.389439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3a4d8e9-4db9-48d8-93a5-68ac11ff3d7b tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.389883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3a4d8e9-4db9-48d8-93a5-68ac11ff3d7b tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.434176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3a4d8e9-4db9-48d8-93a5-68ac11ff3d7b tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.435150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3a4d8e9-4db9-48d8-93a5-68ac11ff3d7b tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.469197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3a4d8e9-4db9-48d8-93a5-68ac11ff3d7b tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.472276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3a4d8e9-4db9-48d8-93a5-68ac11ff3d7b tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.503689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0e3c3ed6-6df2-4f98-8f81-880f053c3259 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:58.510399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0e3c3ed6-6df2-4f98-8f81-880f053c3259 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:58.535295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e3c3ed6-6df2-4f98-8f81-880f053c3259 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.536062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e3c3ed6-6df2-4f98-8f81-880f053c3259 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.539883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e3c3ed6-6df2-4f98-8f81-880f053c3259 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:58.548266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e3c3ed6-6df2-4f98-8f81-880f053c3259 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:58.563915 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e3a4d8e9-4db9-48d8-93a5-68ac11ff3d7b tempest-HypervisorAdminTestJSON-806927837 tempest-HypervisorAdminTestJSON-806927837-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.181382 Aug 04 13:54:58.572462 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 231/450] 10.222.0.66 () {58 vars in 1173 bytes} [Thu Aug 4 13:54:58 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:54:58.959289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-228437317", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": "none"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:59.080202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:54:59.080674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:54:59.081177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:54:59.082965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:54:59.084773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:54:59.114962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:59.115936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:59.116977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:59.119166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:59.170162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Getting quotas for project bc37a49b672e409a86cfeed9d5a2ac60. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:54:59.175195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Getting quotas for user 5bb09533ed914c6bbbabd297e1d7b2fd and project bc37a49b672e409a86cfeed9d5a2ac60. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:54:59.222333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:54:59.234987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:54:59.353699 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b86abd78-f9e3-44ca-9760-086d2eb42a3f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.779929 Aug 04 13:54:59.359889 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 232/451] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 13:54:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 13:54:59.364596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3b415314-c933-48c2-9ffb-fba9fb9aa004 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:54:59.382331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3b415314-c933-48c2-9ffb-fba9fb9aa004 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:54:59.409457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b415314-c933-48c2-9ffb-fba9fb9aa004 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:59.417574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b415314-c933-48c2-9ffb-fba9fb9aa004 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:59.418688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b415314-c933-48c2-9ffb-fba9fb9aa004 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:54:59.421646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b415314-c933-48c2-9ffb-fba9fb9aa004 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:54:59.529297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e3c3ed6-6df2-4f98-8f81-880f053c3259 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:54:59.546048 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0e3c3ed6-6df2-4f98-8f81-880f053c3259 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1470 microversion: 2.1 time: 1.050702 Aug 04 13:54:59.546758 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 220/452] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:58 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1470 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:54:59.556673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e59aff61-c54d-41ea-bc69-6b4cbe01b329 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:54:59.569053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e59aff61-c54d-41ea-bc69-6b4cbe01b329 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:00.264400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e59aff61-c54d-41ea-bc69-6b4cbe01b329 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:00.276714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e59aff61-c54d-41ea-bc69-6b4cbe01b329 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:00.283393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e59aff61-c54d-41ea-bc69-6b4cbe01b329 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:00.304207 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e59aff61-c54d-41ea-bc69-6b4cbe01b329 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "PUT /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1358 microversion: 2.75 time: 0.755013 Aug 04 13:55:00.306402 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 221/453] 10.222.0.66 () {62 vars in 1297 bytes} [Thu Aug 4 13:54:59 2022] PUT /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1358 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:00.339015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f38c887f-333a-48bd-82f3-347abe79d566 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:00.345195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f38c887f-333a-48bd-82f3-347abe79d566 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:00.837472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f38c887f-333a-48bd-82f3-347abe79d566 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:00.860986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f38c887f-333a-48bd-82f3-347abe79d566 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:00.876448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f38c887f-333a-48bd-82f3-347abe79d566 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:00.907020 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f38c887f-333a-48bd-82f3-347abe79d566 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1358 microversion: 2.75 time: 0.566640 Aug 04 13:55:00.911569 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 222/454] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:00 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1358 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:00.984721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e2509f9-939d-4bfd-a14c-f9f32c4b9101 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:00.994324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e2509f9-939d-4bfd-a14c-f9f32c4b9101 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:01.098034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3b415314-c933-48c2-9ffb-fba9fb9aa004 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:01.112084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e2509f9-939d-4bfd-a14c-f9f32c4b9101 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:01.118700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e2509f9-939d-4bfd-a14c-f9f32c4b9101 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:01.131962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e2509f9-939d-4bfd-a14c-f9f32c4b9101 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:01.131962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e2509f9-939d-4bfd-a14c-f9f32c4b9101 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:01.139418 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3b415314-c933-48c2-9ffb-fba9fb9aa004 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1314 microversion: 2.1 time: 1.781316 Aug 04 13:55:01.149411 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 233/455] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:54:59 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1314 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:01.953930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:01.958058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:01.966192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:01.967532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:01.968796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:01.969432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:02.264840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8e2509f9-939d-4bfd-a14c-f9f32c4b9101 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:02.280469 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e2509f9-939d-4bfd-a14c-f9f32c4b9101 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1470 microversion: 2.1 time: 1.352095 Aug 04 13:55:02.282157 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 223/456] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:00 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1470 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:02.298576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7753f2d8-1f45-40df-bf9b-c1cf82d53249 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:02.300803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7753f2d8-1f45-40df-bf9b-c1cf82d53249 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:02.330688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7753f2d8-1f45-40df-bf9b-c1cf82d53249 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:02.334424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7753f2d8-1f45-40df-bf9b-c1cf82d53249 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:02.335624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7753f2d8-1f45-40df-bf9b-c1cf82d53249 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:02.338901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7753f2d8-1f45-40df-bf9b-c1cf82d53249 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:02.375194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:02.397406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:02.403259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:02.425069 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8b9ef489-bb7a-4782-b0a2-213fc59c0940 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1418 microversion: 2.75 time: 0.486278 Aug 04 13:55:02.426309 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 234/457] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:01 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1418 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:02.436455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-675f2efc-b7a3-42e7-99a0-aafeb318cc1d req-5ec44b7b-98c5-47fb-bf11-5b92788a12b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c14895f-4aef-46ad-b327-8534e734e5aa", "tag": "6b407fd8-cbd3-41a0-a7e4-9e7dd0c89d76"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:02.468633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-675f2efc-b7a3-42e7-99a0-aafeb318cc1d req-5ec44b7b-98c5-47fb-bf11-5b92788a12b0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:02.469899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-675f2efc-b7a3-42e7-99a0-aafeb318cc1d req-5ec44b7b-98c5-47fb-bf11-5b92788a12b0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:02.511747 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-675f2efc-b7a3-42e7-99a0-aafeb318cc1d req-5ec44b7b-98c5-47fb-bf11-5b92788a12b0 service nova] Creating event network-changed:6b407fd8-cbd3-41a0-a7e4-9e7dd0c89d76 for instance 4c14895f-4aef-46ad-b327-8534e734e5aa on n-h2-844627-10 Aug 04 13:55:02.529368 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-675f2efc-b7a3-42e7-99a0-aafeb318cc1d req-5ec44b7b-98c5-47fb-bf11-5b92788a12b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097396 Aug 04 13:55:02.543942 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 235/458] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:02.767189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-08b46947-7c1d-4d9a-9a1d-7656eb62424b req-0701ea48-0c0d-4b02-bee3-dfdbd58ceb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4404b9e-c6d1-4f63-bb72-b180f02ca603", "name": "network-vif-plugged", "status": "completed", "tag": "7772b93f-4e1b-4b26-bc3c-00df0a0b3c45"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:02.796260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-08b46947-7c1d-4d9a-9a1d-7656eb62424b req-0701ea48-0c0d-4b02-bee3-dfdbd58ceb6e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:02.799758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-08b46947-7c1d-4d9a-9a1d-7656eb62424b req-0701ea48-0c0d-4b02-bee3-dfdbd58ceb6e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:02.840371 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-08b46947-7c1d-4d9a-9a1d-7656eb62424b req-0701ea48-0c0d-4b02-bee3-dfdbd58ceb6e service nova] Creating event network-vif-plugged:7772b93f-4e1b-4b26-bc3c-00df0a0b3c45 for instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 on n-h1-844627-10 Aug 04 13:55:02.855300 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-08b46947-7c1d-4d9a-9a1d-7656eb62424b req-0701ea48-0c0d-4b02-bee3-dfdbd58ceb6e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092743 Aug 04 13:55:02.857829 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 236/459] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:55:02.932187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7753f2d8-1f45-40df-bf9b-c1cf82d53249 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:02.946872 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7753f2d8-1f45-40df-bf9b-c1cf82d53249 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1314 microversion: 2.1 time: 0.661938 Aug 04 13:55:02.947923 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 224/460] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:02 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:03.307471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d1f955e-2ddc-4104-b2e0-601359f179d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:03.308239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7d1f955e-2ddc-4104-b2e0-601359f179d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:03.331292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d1f955e-2ddc-4104-b2e0-601359f179d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:03.332010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d1f955e-2ddc-4104-b2e0-601359f179d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:03.334536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d1f955e-2ddc-4104-b2e0-601359f179d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:03.334835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d1f955e-2ddc-4104-b2e0-601359f179d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:03.348114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:03.454243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:03.455746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:03.467534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:03.467980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:03.468782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:03.469228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:03.816445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7d1f955e-2ddc-4104-b2e0-601359f179d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:03.833356 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7d1f955e-2ddc-4104-b2e0-601359f179d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1462 microversion: 2.1 time: 0.530168 Aug 04 13:55:03.838562 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 237/461] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:03 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1462 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:03.858596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0d7de890-681b-4870-9165-2f81cd7747de tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:03.859469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0d7de890-681b-4870-9165-2f81cd7747de tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:03.880381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d7de890-681b-4870-9165-2f81cd7747de tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:03.882662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d7de890-681b-4870-9165-2f81cd7747de tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:03.883609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d7de890-681b-4870-9165-2f81cd7747de tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:03.884729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d7de890-681b-4870-9165-2f81cd7747de tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:04.019751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:04.035506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:04.038290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:04.054110 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1cd29bd3-4c07-4850-b534-0aafcdb758e3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1418 microversion: 2.75 time: 0.603933 Aug 04 13:55:04.056148 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 225/462] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:03 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1418 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:04.068246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c97782b-74d6-4670-96b1-9d6434d0e19d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:04.071709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0c97782b-74d6-4670-96b1-9d6434d0e19d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:04.101539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c97782b-74d6-4670-96b1-9d6434d0e19d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:04.102389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c97782b-74d6-4670-96b1-9d6434d0e19d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:04.103390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c97782b-74d6-4670-96b1-9d6434d0e19d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:04.104045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c97782b-74d6-4670-96b1-9d6434d0e19d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:04.535650 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0d7de890-681b-4870-9165-2f81cd7747de tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1615 microversion: 2.1 time: 0.681578 Aug 04 13:55:04.541902 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 238/463] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:03 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1615 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:04.557374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1662622060", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "3b5ac0de-c12c-4194-b159-5942319edd05"}], "security_groups": [{"name": "tempest-securitygroup--1812901157"}], "key_name": "tempest-keypair-2105900556", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:04.704092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0c97782b-74d6-4670-96b1-9d6434d0e19d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:04.717119 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c97782b-74d6-4670-96b1-9d6434d0e19d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1314 microversion: 2.1 time: 0.659676 Aug 04 13:55:04.717923 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 226/464] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:04 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:04.916403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] validate_networks() for [('3b5ac0de-c12c-4194-b159-5942319edd05', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:55:05.199861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-493122454", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "16aa4d93-210e-4f85-a9b8-18b7b6afc7af"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:05.280724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] validate_networks() for [('16aa4d93-210e-4f85-a9b8-18b7b6afc7af', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:55:06.478163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:06.478604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:06.479066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:06.479478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:06.479894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:06.483677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:06.505114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:06.505742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:06.507596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:06.510649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:06.560438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Getting quotas for project 6adc52f7e03846d3a73ef1c6d2b040cd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:55:06.573793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Getting quotas for user c5534a5c5eff41e998b2b92ca13bb372 and project 6adc52f7e03846d3a73ef1c6d2b040cd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:55:06.605081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:55:06.613617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:55:06.708855 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19e99ba3-d028-4f47-840a-133ad78a530a tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.165558 Aug 04 13:55:06.710055 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 239/465] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:55:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 2167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:55:06.715556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e3c90309-39c2-4597-9925-a126a99adad7 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '.version_select at 0x7f4700bb74c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:06.720171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3c90309-39c2-4597-9925-a126a99adad7 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:06.720976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3c90309-39c2-4597-9925-a126a99adad7 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:06.737605 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e3c90309-39c2-4597-9925-a126a99adad7 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.026003 Aug 04 13:55:06.739937 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 240/466] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 13:55:06 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:06.749336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:06.750502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:06.772005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:06.773277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:06.777840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:06.778637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:07.042408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:07.055177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:07.062196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:07.078685 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-840680d6-8c02-4454-b3d6-1810394f7221 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1416 microversion: 2.75 time: 0.332853 Aug 04 13:55:07.081191 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 241/467] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:06 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1416 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:07.094071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9abf579-4ee8-4812-87ae-9857f43e1537 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:07.094703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f9abf579-4ee8-4812-87ae-9857f43e1537 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:07.109002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9abf579-4ee8-4812-87ae-9857f43e1537 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:07.109737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9abf579-4ee8-4812-87ae-9857f43e1537 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:07.110430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9abf579-4ee8-4812-87ae-9857f43e1537 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:07.110848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9abf579-4ee8-4812-87ae-9857f43e1537 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:08.012267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:08.013305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:08.013966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:08.014550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:08.015131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:08.033065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f9abf579-4ee8-4812-87ae-9857f43e1537 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:08.034738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:08.035225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:08.036168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:08.036632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:08.052258 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f9abf579-4ee8-4812-87ae-9857f43e1537 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1314 microversion: 2.1 time: 0.969947 Aug 04 13:55:08.071733 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 242/468] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:07 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:08.078058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8380cf78-aae0-4e3b-95e7-37fe368df2e8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:08.085567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8380cf78-aae0-4e3b-95e7-37fe368df2e8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:08.090944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:55:08.097819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for user d9613691b93147d48d9f1a51bf5767c9 and project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:55:08.112570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:55:08.115894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:55:08.126175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8380cf78-aae0-4e3b-95e7-37fe368df2e8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:08.133323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8380cf78-aae0-4e3b-95e7-37fe368df2e8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:08.135208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8380cf78-aae0-4e3b-95e7-37fe368df2e8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:08.135989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8380cf78-aae0-4e3b-95e7-37fe368df2e8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:08.231020 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9bad7975-22e0-4573-9989-605ee6f38ffd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.511773 Aug 04 13:55:08.237848 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 227/469] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 13:55:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3517 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 13:55:08.246298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1956243977", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:08.352524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8380cf78-aae0-4e3b-95e7-37fe368df2e8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:08.382795 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8380cf78-aae0-4e3b-95e7-37fe368df2e8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1238 microversion: 2.1 time: 0.301537 Aug 04 13:55:08.385268 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 243/470] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:08 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1238 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:08.445455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:55:08.622007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-20fb3622-4888-4a86-93ad-be0b944ff367 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Calling method '.version_select at 0x7f4700acc040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:08.626657 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:55:08.626657 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:55:08.628491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20fb3622-4888-4a86-93ad-be0b944ff367 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:08.629556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20fb3622-4888-4a86-93ad-be0b944ff367 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:08.693596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20fb3622-4888-4a86-93ad-be0b944ff367 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:08.694258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20fb3622-4888-4a86-93ad-be0b944ff367 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:08.746210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20fb3622-4888-4a86-93ad-be0b944ff367 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:08.746764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20fb3622-4888-4a86-93ad-be0b944ff367 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:08.783964 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-20fb3622-4888-4a86-93ad-be0b944ff367 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.395255 Aug 04 13:55:08.788366 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 244/471] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:55:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:08.829759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:08.833512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:08.851997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:08.853486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:08.857629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:08.859308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:09.113235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:09.126739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:09.127045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:09.128164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:09.129052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:09.129886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:09.131661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:09.134266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:09.143558 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-875ee1ae-228c-4877-a5c3-0f61ec27cb96 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1416 microversion: 2.75 time: 0.349461 Aug 04 13:55:09.147197 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 245/472] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:08 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1416 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:09.182618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:09.184094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:09.203082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:09.204072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:09.205251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:09.207229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:09.233316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:09.233818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:09.238114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:09.238573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:09.277198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:55:09.289432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for user cca2bff6e81c4f54bad52f77e67faa55 and project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:55:09.318539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:09.319115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:55:09.323045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:55:09.332795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:09.337037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:09.340022 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ea510b29-2b91-4f3c-a2f6-3149793c28a2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1265 microversion: 2.25 time: 0.191456 Aug 04 13:55:09.352896 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 246/473] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:09 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:09.422994 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eaa5fbde-fb55-4bf9-9e17-05f0abe744af tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183644 Aug 04 13:55:09.424316 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 228/474] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:55:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:55:09.430396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab0a3036-6fcd-4f94-ba93-04082e936a5e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:09.431724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ab0a3036-6fcd-4f94-ba93-04082e936a5e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:09.441814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab0a3036-6fcd-4f94-ba93-04082e936a5e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:09.442527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab0a3036-6fcd-4f94-ba93-04082e936a5e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:09.443482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab0a3036-6fcd-4f94-ba93-04082e936a5e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:09.444114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab0a3036-6fcd-4f94-ba93-04082e936a5e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:09.645037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75ea2506-7f1a-4f75-9ceb-8939afb7d4d9 tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] Calling method '.version_select at 0x7f4700b0caf0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:09.646984 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:55:09.646984 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:55:09.648442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75ea2506-7f1a-4f75-9ceb-8939afb7d4d9 tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'b8b1f07d0f5e4da480126944bc751e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89799250cb42b7a960e46203a46837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75ea2506-7f1a-4f75-9ceb-8939afb7d4d9 tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] Request method failure captured: Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hypervisors/n-h2-844627-10/search HTTP/1.1 Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-6qIMgiwGcgy4s97Dv4YHR-l7VMC2L7yH-IovwAnb5IaLB62FikO38pVURem5qGvnvbwe3WrYkWJPVs3F6ROaR6131lsxagGXqyxuaYqX5hQPVMp7IWjN6vW4neRxnaiuLsMR-5kTBX7HN27PIPwxqX0Qe3rlk0rTDZQu5ovu6beE Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: ee89799250cb42b7a960e46203a46837 Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1825055865 Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:55:09.651719 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee89799250cb42b7a960e46203a46837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ee89799250cb42b7a960e46203a46837"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ee89799250cb42b7a960e46203a46837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee89799250cb42b7a960e46203a46837"}]}] Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1825055865 Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: ee89799250cb42b7a960e46203a46837 Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1825055865 Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b8b1f07d0f5e4da480126944bc751e77 Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 13:55:09.653397 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'n-h2-844627-10'} Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:55:09.655427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 13:55:09.657466 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:09.658787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75ea2506-7f1a-4f75-9ceb-8939afb7d4d9 tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:55:09.668469 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75ea2506-7f1a-4f75-9ceb-8939afb7d4d9 tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/n-h2-844627-10/search" status: 403 len: 117 microversion: 2.1 time: 0.319713 Aug 04 13:55:09.671481 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 247/475] 10.222.0.66 () {58 vars in 1212 bytes} [Thu Aug 4 13:55:09 2022] GET /compute/v2.1/os-hypervisors/n-h2-844627-10/search => generated 117 bytes in 328 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:55:09.683417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae47827e-0175-400e-972e-d27ed9c08623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:09.686622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ae47827e-0175-400e-972e-d27ed9c08623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:09.709802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae47827e-0175-400e-972e-d27ed9c08623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:09.711287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae47827e-0175-400e-972e-d27ed9c08623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:09.714088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae47827e-0175-400e-972e-d27ed9c08623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:09.715490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae47827e-0175-400e-972e-d27ed9c08623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:09.996542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae47827e-0175-400e-972e-d27ed9c08623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.012130 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae47827e-0175-400e-972e-d27ed9c08623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1300 microversion: 2.1 time: 0.338813 Aug 04 13:55:10.014613 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 248/476] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:09 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1300 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:10.030643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-89e939f7-8953-45e6-bacf-b1297270b8bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:10.033019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-89e939f7-8953-45e6-bacf-b1297270b8bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:10.172420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ab0a3036-6fcd-4f94-ba93-04082e936a5e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.189482 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab0a3036-6fcd-4f94-ba93-04082e936a5e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1314 microversion: 2.1 time: 0.763638 Aug 04 13:55:10.204165 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 229/477] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:09 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:10.220843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c224f492-7201-4b50-936c-b6ce8c794454 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Calling method '.version_select at 0x7f4700d209d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:10.227568 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:55:10.227568 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:55:10.231125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c224f492-7201-4b50-936c-b6ce8c794454 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.233043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c224f492-7201-4b50-936c-b6ce8c794454 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.252311 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-c224f492-7201-4b50-936c-b6ce8c794454 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c224f492-7201-4b50-936c-b6ce8c794454 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Request method failure captured: Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-7BTB8B0IEtZUKgWdVRanDL2kf5zHuls_zWdlajPrnaZ-N-JI2tafA5ZcV9f9T3oIvx7uWeo3s-YHFm94OhZjijl3k-DZtmrANN53J3ldp7YYqcJy4sYXnaAR8B7TgSzn8xSCD0qZPdtVXNbSRhR396jCuKJHsBh27jofkYFmh82E Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 0c01bd892c46420cb22d7c5fb478eadd Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-487809552 Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:55:10.258248 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c01bd892c46420cb22d7c5fb478eadd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0c01bd892c46420cb22d7c5fb478eadd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0c01bd892c46420cb22d7c5fb478eadd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c01bd892c46420cb22d7c5fb478eadd"}]}] Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-487809552 Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 0c01bd892c46420cb22d7c5fb478eadd Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-487809552 Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 88189788acac4245ac60b4698b13ce62 Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 13:55:10.259623 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:10.260378 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:10.262556 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:10.262556 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:55:10.262556 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:55:10.262556 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 13:55:10.262556 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:10.262556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c224f492-7201-4b50-936c-b6ce8c794454 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:55:10.262556 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c224f492-7201-4b50-936c-b6ce8c794454 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.054525 Aug 04 13:55:10.262556 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 230/478] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 13:55:10 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:55:10.279198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3219ef4c-cdd5-4581-8d77-66a33f807d98 req-68d26e5f-3510-42ce-99a4-31add28ae8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9802281d-83eb-4b5d-8fe0-bc812e0872e4", "name": "network-vif-plugged", "status": "completed", "tag": "f591719b-2d26-42da-b7bb-dfe4d507c0a9"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:10.308622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3219ef4c-cdd5-4581-8d77-66a33f807d98 req-68d26e5f-3510-42ce-99a4-31add28ae8bc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.309965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3219ef4c-cdd5-4581-8d77-66a33f807d98 req-68d26e5f-3510-42ce-99a4-31add28ae8bc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.334732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-89e939f7-8953-45e6-bacf-b1297270b8bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.344178 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3219ef4c-cdd5-4581-8d77-66a33f807d98 req-68d26e5f-3510-42ce-99a4-31add28ae8bc service nova] Creating event network-vif-plugged:f591719b-2d26-42da-b7bb-dfe4d507c0a9 for instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 on n-h1-844627-10 Aug 04 13:55:10.351893 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-89e939f7-8953-45e6-bacf-b1297270b8bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1213 microversion: 2.1 time: 0.335525 Aug 04 13:55:10.352412 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3219ef4c-cdd5-4581-8d77-66a33f807d98 req-68d26e5f-3510-42ce-99a4-31add28ae8bc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090573 Aug 04 13:55:10.360538 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 231/479] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:10.362186 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 249/480] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:10 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1213 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:10.392375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-370b599c-00dc-4868-ba46-60a1eba0af4b tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Calling method '.version_select at 0x7f4700bb7b80>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:10.393380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:10.395194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:10.409773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.410707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.411984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.412823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.422695 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:55:10.422695 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:55:10.427107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-370b599c-00dc-4868-ba46-60a1eba0af4b tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.441509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-370b599c-00dc-4868-ba46-60a1eba0af4b tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.491337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-370b599c-00dc-4868-ba46-60a1eba0af4b tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.498036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-370b599c-00dc-4868-ba46-60a1eba0af4b tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.545985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-370b599c-00dc-4868-ba46-60a1eba0af4b tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.548470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-370b599c-00dc-4868-ba46-60a1eba0af4b tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.565354 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-370b599c-00dc-4868-ba46-60a1eba0af4b tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.200707 Aug 04 13:55:10.566749 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 250/481] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:55:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:10.578255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:10.579262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:10.596253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.597338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.600205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.601842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.709781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.727467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.730665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.744222 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2386a379-854d-4dcb-9e73-0607793d3f1a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1437 microversion: 2.75 time: 0.383955 Aug 04 13:55:10.748548 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 232/482] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:10 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1437 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:10.772625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9c25b8e-c69d-4c9e-9837-82b58cf5e47d tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] Calling method '.version_select at 0x7f4700c68ee0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:10.780682 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:55:10.780682 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:55:10.788318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f9c25b8e-c69d-4c9e-9837-82b58cf5e47d tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'b8b1f07d0f5e4da480126944bc751e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee89799250cb42b7a960e46203a46837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9c25b8e-c69d-4c9e-9837-82b58cf5e47d tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] Request method failure captured: Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-6qIMgiwGcgy4s97Dv4YHR-l7VMC2L7yH-IovwAnb5IaLB62FikO38pVURem5qGvnvbwe3WrYkWJPVs3F6ROaR6131lsxagGXqyxuaYqX5hQPVMp7IWjN6vW4neRxnaiuLsMR-5kTBX7HN27PIPwxqX0Qe3rlk0rTDZQu5ovu6beE Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ee89799250cb42b7a960e46203a46837 Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1825055865 Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:55:10.794802 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee89799250cb42b7a960e46203a46837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ee89799250cb42b7a960e46203a46837"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ee89799250cb42b7a960e46203a46837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee89799250cb42b7a960e46203a46837"}]}] Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1825055865 Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ee89799250cb42b7a960e46203a46837 Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1825055865 Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b8b1f07d0f5e4da480126944bc751e77 Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 13:55:10.796443 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '1'} Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:55:10.797290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 13:55:10.798674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:10.799892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.808250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9c25b8e-c69d-4c9e-9837-82b58cf5e47d tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:55:10.816205 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f9c25b8e-c69d-4c9e-9837-82b58cf5e47d tempest-HypervisorAdminNegativeUnderV252Test-1825055865 tempest-HypervisorAdminNegativeUnderV252Test-1825055865-project] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.062738 Aug 04 13:55:10.816900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.817841 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 233/483] 10.222.0.66 () {58 vars in 1176 bytes} [Thu Aug 4 13:55:10 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:55:10.819754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:10.822581 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4c296da-595b-445d-83a3-e8c4e2a029d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1319 microversion: 2.25 time: 0.253618 Aug 04 13:55:10.824917 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 251/484] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:10 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:10.838193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:10.847582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:10.866702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34e3c1a2-e3d6-471d-bee1-cd4fb3af5759 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Calling method '.version_select at 0x7f4700ab4160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:10.871555 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:55:10.871555 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:55:10.874087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.875019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.880651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34e3c1a2-e3d6-471d-bee1-cd4fb3af5759 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.881044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:10.881790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.882793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34e3c1a2-e3d6-471d-bee1-cd4fb3af5759 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:10.911829 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-34e3c1a2-e3d6-471d-bee1-cd4fb3af5759 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] HTTP exception thrown: No hypervisor matching '7064b315-168a-45d3-b0f7-a5cad88e57e3' could be found. Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34e3c1a2-e3d6-471d-bee1-cd4fb3af5759 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Request method failure captured: Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-hypervisors/7064b315-168a-45d3-b0f7-a5cad88e57e3/servers HTTP/1.1 Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-7BTB8B0IEtZUKgWdVRanDL2kf5zHuls_zWdlajPrnaZ-N-JI2tafA5ZcV9f9T3oIvx7uWeo3s-YHFm94OhZjijl3k-DZtmrANN53J3ldp7YYqcJy4sYXnaAR8B7TgSzn8xSCD0qZPdtVXNbSRhR396jCuKJHsBh27jofkYFmh82E Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 0c01bd892c46420cb22d7c5fb478eadd Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-487809552 Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:55:10.915348 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c01bd892c46420cb22d7c5fb478eadd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0c01bd892c46420cb22d7c5fb478eadd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0c01bd892c46420cb22d7c5fb478eadd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0c01bd892c46420cb22d7c5fb478eadd"}]}] Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-487809552 Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 0c01bd892c46420cb22d7c5fb478eadd Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-487809552 Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 88189788acac4245ac60b4698b13ce62 Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: exception: No hypervisor matching '7064b315-168a-45d3-b0f7-a5cad88e57e3' could be found. Aug 04 13:55:10.916843 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7064b315-168a-45d3-b0f7-a5cad88e57e3'} Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7064b315-168a-45d3-b0f7-a5cad88e57e3' could be found. Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:10.917679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:10.918936 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:10.918936 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:10.918936 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:55:10.918936 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:55:10.918936 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7064b315-168a-45d3-b0f7-a5cad88e57e3' could be found. Aug 04 13:55:10.918936 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:10.923756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34e3c1a2-e3d6-471d-bee1-cd4fb3af5759 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] Returning 404 to user: No hypervisor matching '7064b315-168a-45d3-b0f7-a5cad88e57e3' could be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:55:10.927089 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-34e3c1a2-e3d6-471d-bee1-cd4fb3af5759 tempest-HypervisorAdminNegativeUnderV252Test-487809552 tempest-HypervisorAdminNegativeUnderV252Test-487809552-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/7064b315-168a-45d3-b0f7-a5cad88e57e3/servers" status: 404 len: 123 microversion: 2.1 time: 0.088391 Aug 04 13:55:10.929142 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 252/485] 10.222.0.66 () {58 vars in 1281 bytes} [Thu Aug 4 13:55:10 2022] GET /compute/v2.1/os-hypervisors/7064b315-168a-45d3-b0f7-a5cad88e57e3/servers => generated 123 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:55:11.037731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-644315c1-89c4-4072-94cd-4dc3044de7a2 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:11.038795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-644315c1-89c4-4072-94cd-4dc3044de7a2 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:11.060028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-644315c1-89c4-4072-94cd-4dc3044de7a2 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.060516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-644315c1-89c4-4072-94cd-4dc3044de7a2 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:11.061503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-644315c1-89c4-4072-94cd-4dc3044de7a2 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.062124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-644315c1-89c4-4072-94cd-4dc3044de7a2 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:11.170024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:11.174562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:11.175187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:11.175542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:11.178106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:11.292142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-644315c1-89c4-4072-94cd-4dc3044de7a2 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:11.306311 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-644315c1-89c4-4072-94cd-4dc3044de7a2 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1300 microversion: 2.1 time: 0.272081 Aug 04 13:55:11.306916 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 253/486] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:11 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1300 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:11.328385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb4d187d-1123-4932-a9d3-d4105ada3f2b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:11.332457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb4d187d-1123-4932-a9d3-d4105ada3f2b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:11.362200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb4d187d-1123-4932-a9d3-d4105ada3f2b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.366288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb4d187d-1123-4932-a9d3-d4105ada3f2b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:11.367399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb4d187d-1123-4932-a9d3-d4105ada3f2b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.368689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb4d187d-1123-4932-a9d3-d4105ada3f2b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:11.395714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:11.431189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.434141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:11.437443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.443253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:11.837215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:11.881831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:11.884549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:11.906314 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6fe23c55-4de6-4344-ae91-e208b27e2d89 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "POST /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca/action" status: 202 len: 1494 microversion: 2.75 time: 1.080093 Aug 04 13:55:11.907271 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 234/487] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 13:55:10 2022] POST /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca/action => generated 1494 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 13:55:11.933156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-796b9ecc-1d4e-4dd7-99a2-25aae0253c35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:11.939347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-796b9ecc-1d4e-4dd7-99a2-25aae0253c35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:11.952335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-796b9ecc-1d4e-4dd7-99a2-25aae0253c35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.953218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb4d187d-1123-4932-a9d3-d4105ada3f2b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:11.959851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-796b9ecc-1d4e-4dd7-99a2-25aae0253c35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:11.965029 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb4d187d-1123-4932-a9d3-d4105ada3f2b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1314 microversion: 2.1 time: 0.656989 Aug 04 13:55:11.966214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-796b9ecc-1d4e-4dd7-99a2-25aae0253c35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.966702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-796b9ecc-1d4e-4dd7-99a2-25aae0253c35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:11.968526 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 254/488] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:11 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:11.983640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:11.984265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:11.995935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.996385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:11.997833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:11.998272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:12.205648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-796b9ecc-1d4e-4dd7-99a2-25aae0253c35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:12.246730 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-796b9ecc-1d4e-4dd7-99a2-25aae0253c35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1273 microversion: 2.1 time: 0.326112 Aug 04 13:55:12.257831 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 235/489] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:11 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:12.271827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:12.278655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:12.297949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:12.298417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:12.299214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:12.299666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:12.601948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:12.616323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:12.619969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:12.635906 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd786651-0a36-41ab-b5a3-33367436e402 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.376594 Aug 04 13:55:12.655366 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 236/490] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:12 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:12.666221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8300b37d-cd9e-4d91-8698-c63c5207a1d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:12.669125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8300b37d-cd9e-4d91-8698-c63c5207a1d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:12.688506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8300b37d-cd9e-4d91-8698-c63c5207a1d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:12.689063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8300b37d-cd9e-4d91-8698-c63c5207a1d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:12.691306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8300b37d-cd9e-4d91-8698-c63c5207a1d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:12.693158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8300b37d-cd9e-4d91-8698-c63c5207a1d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:13.050586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:13.066863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:13.068917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:13.070294 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d2376dbb-a346-41bc-a815-ec41e6703bc5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1361 microversion: 2.25 time: 1.100610 Aug 04 13:55:13.082269 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 255/491] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:11 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1361 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:13.094694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-50ca587b-5d29-461a-977a-fcc8014a2e89 req-12f37ecd-9377-48dc-8ade-90cb9210207e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c14895f-4aef-46ad-b327-8534e734e5aa", "name": "network-vif-plugged", "status": "completed", "tag": "6b407fd8-cbd3-41a0-a7e4-9e7dd0c89d76"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:13.107517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-50ca587b-5d29-461a-977a-fcc8014a2e89 req-12f37ecd-9377-48dc-8ade-90cb9210207e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:13.108411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-50ca587b-5d29-461a-977a-fcc8014a2e89 req-12f37ecd-9377-48dc-8ade-90cb9210207e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:13.132199 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-50ca587b-5d29-461a-977a-fcc8014a2e89 req-12f37ecd-9377-48dc-8ade-90cb9210207e service nova] Creating event network-vif-plugged:6b407fd8-cbd3-41a0-a7e4-9e7dd0c89d76 for instance 4c14895f-4aef-46ad-b327-8534e734e5aa on n-h2-844627-10 Aug 04 13:55:13.155671 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-50ca587b-5d29-461a-977a-fcc8014a2e89 req-12f37ecd-9377-48dc-8ade-90cb9210207e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071559 Aug 04 13:55:13.156436 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 256/492] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:13.161960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ccbe1e54-b0ca-418e-b1dc-de73ac23f61c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:13.175652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ccbe1e54-b0ca-418e-b1dc-de73ac23f61c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:13.198679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccbe1e54-b0ca-418e-b1dc-de73ac23f61c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:13.208220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccbe1e54-b0ca-418e-b1dc-de73ac23f61c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:13.209543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccbe1e54-b0ca-418e-b1dc-de73ac23f61c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:13.212825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccbe1e54-b0ca-418e-b1dc-de73ac23f61c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:13.380770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8300b37d-cd9e-4d91-8698-c63c5207a1d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:13.390013 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8300b37d-cd9e-4d91-8698-c63c5207a1d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1368 microversion: 2.1 time: 0.732924 Aug 04 13:55:13.394886 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 237/493] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:12 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1368 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:13.399605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-1d35e3f0-031d-4097-9e8f-c4d1122ca231 req-66428522-4369-43a1-875a-c2e5aebb7db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3861160-fd38-4411-9578-cbe56e26a0f7", "tag": "00402c6c-b47f-4ddd-a152-4636377d16c8"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:13.433055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1d35e3f0-031d-4097-9e8f-c4d1122ca231 req-66428522-4369-43a1-875a-c2e5aebb7db9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:13.433673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1d35e3f0-031d-4097-9e8f-c4d1122ca231 req-66428522-4369-43a1-875a-c2e5aebb7db9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:13.454723 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-1d35e3f0-031d-4097-9e8f-c4d1122ca231 req-66428522-4369-43a1-875a-c2e5aebb7db9 service nova] Creating event network-changed:00402c6c-b47f-4ddd-a152-4636377d16c8 for instance d3861160-fd38-4411-9578-cbe56e26a0f7 on n-h2-844627-10 Aug 04 13:55:13.462741 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-1d35e3f0-031d-4097-9e8f-c4d1122ca231 req-66428522-4369-43a1-875a-c2e5aebb7db9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066384 Aug 04 13:55:13.463761 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 238/494] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:13.479007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-24aa523a-bc48-4e23-8d96-784a18698a50 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:13.479860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-24aa523a-bc48-4e23-8d96-784a18698a50 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:13.503994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-24aa523a-bc48-4e23-8d96-784a18698a50 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:13.505243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-24aa523a-bc48-4e23-8d96-784a18698a50 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:13.506192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-24aa523a-bc48-4e23-8d96-784a18698a50 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:13.506744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-24aa523a-bc48-4e23-8d96-784a18698a50 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:13.722699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-24aa523a-bc48-4e23-8d96-784a18698a50 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:13.733951 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-24aa523a-bc48-4e23-8d96-784a18698a50 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1271 microversion: 2.1 time: 0.268478 Aug 04 13:55:13.735039 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 239/495] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:13 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:13.757440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:13.763599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:13.780046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:13.782683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:13.785977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:13.786659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:13.824137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:13.922927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ccbe1e54-b0ca-418e-b1dc-de73ac23f61c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:13.942460 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ccbe1e54-b0ca-418e-b1dc-de73ac23f61c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1314 microversion: 2.1 time: 0.781265 Aug 04 13:55:13.945428 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 257/496] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:13 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:14.101284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:14.103082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:14.117417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:14.118416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:14.119505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:14.120216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:14.139735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:14.354185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:14.371301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:14.373432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:14.386487 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1253ba08-6c72-4c76-8f7f-c6935e9a888d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.639527 Aug 04 13:55:14.388342 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 240/497] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:13 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:14.416260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-34827dff-4efc-4d06-8de3-2f7215698f55 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:14.417260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-34827dff-4efc-4d06-8de3-2f7215698f55 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:14.431084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34827dff-4efc-4d06-8de3-2f7215698f55 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:14.432176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34827dff-4efc-4d06-8de3-2f7215698f55 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:14.433243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34827dff-4efc-4d06-8de3-2f7215698f55 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:14.433939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34827dff-4efc-4d06-8de3-2f7215698f55 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:14.803877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:14.828641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:14.833495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:14.836040 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8c644e80-de93-4c21-92b9-14211b7fec0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1361 microversion: 2.25 time: 0.740898 Aug 04 13:55:14.839845 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 258/498] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:14 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1361 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:14.853379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1b8e4d27-6a0d-4939-aa8a-4a2f34c721d0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:14.855170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b8e4d27-6a0d-4939-aa8a-4a2f34c721d0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:14.880510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b8e4d27-6a0d-4939-aa8a-4a2f34c721d0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:14.883387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b8e4d27-6a0d-4939-aa8a-4a2f34c721d0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:14.886740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b8e4d27-6a0d-4939-aa8a-4a2f34c721d0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:14.889133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b8e4d27-6a0d-4939-aa8a-4a2f34c721d0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:14.945126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34827dff-4efc-4d06-8de3-2f7215698f55 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:14.959605 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-34827dff-4efc-4d06-8de3-2f7215698f55 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1368 microversion: 2.1 time: 0.548288 Aug 04 13:55:14.974064 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 241/499] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:14 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1368 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:14.980158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-95e23ef6-d983-4e68-85a8-97e1ca1d8195 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:14.981054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-95e23ef6-d983-4e68-85a8-97e1ca1d8195 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:14.986653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:14.988827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95e23ef6-d983-4e68-85a8-97e1ca1d8195 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:14.989563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95e23ef6-d983-4e68-85a8-97e1ca1d8195 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:14.990554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95e23ef6-d983-4e68-85a8-97e1ca1d8195 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:14.991314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95e23ef6-d983-4e68-85a8-97e1ca1d8195 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:15.062399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b8e4d27-6a0d-4939-aa8a-4a2f34c721d0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:15.074697 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1b8e4d27-6a0d-4939-aa8a-4a2f34c721d0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1271 microversion: 2.1 time: 0.232192 Aug 04 13:55:15.075333 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 259/500] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:14 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:15.339079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f7a3b422-9803-494e-bd8f-50e612aebc9c req-f7e95c45-3f21-4c29-b10e-ec70821966d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e44dc8-8cc8-4787-aac7-7b82cd8679e4", "tag": "7f0e237c-1431-4143-8b98-9539ef44bae6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:15.348447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-95e23ef6-d983-4e68-85a8-97e1ca1d8195 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:15.361896 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-95e23ef6-d983-4e68-85a8-97e1ca1d8195 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1314 microversion: 2.1 time: 0.386346 Aug 04 13:55:15.362466 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 242/501] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:14 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:15.376610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f7a3b422-9803-494e-bd8f-50e612aebc9c req-f7e95c45-3f21-4c29-b10e-ec70821966d5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:15.377331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f7a3b422-9803-494e-bd8f-50e612aebc9c req-f7e95c45-3f21-4c29-b10e-ec70821966d5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:15.408377 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f7a3b422-9803-494e-bd8f-50e612aebc9c req-f7e95c45-3f21-4c29-b10e-ec70821966d5 service nova] Creating event network-changed:7f0e237c-1431-4143-8b98-9539ef44bae6 for instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 on n-h2-844627-10 Aug 04 13:55:15.420327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:15.421002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:15.424741 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f7a3b422-9803-494e-bd8f-50e612aebc9c req-f7e95c45-3f21-4c29-b10e-ec70821966d5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087556 Aug 04 13:55:15.426414 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 260/502] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:55:15.430948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:15.436645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:15.438518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:15.440562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:15.557893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:15.569837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:15.594005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:15.624219 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d6a15eb-52e7-4689-b604-1a6f09938678 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.208724 Aug 04 13:55:15.637084 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 243/503] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:15 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:15.866823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:15.867541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:15.908715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:15.909207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:15.910007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:15.910449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:15.985807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eb422bd2-a73d-4b03-9549-a2f19826e623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:15.986692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eb422bd2-a73d-4b03-9549-a2f19826e623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:15.996596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb422bd2-a73d-4b03-9549-a2f19826e623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:15.997961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb422bd2-a73d-4b03-9549-a2f19826e623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:16.000044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb422bd2-a73d-4b03-9549-a2f19826e623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:16.001343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb422bd2-a73d-4b03-9549-a2f19826e623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:16.534164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:16.713135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:16.726967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:16.734442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:16.737156 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7d20aa7f-0cf6-45eb-b472-1bccad3a2ca1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1361 microversion: 2.25 time: 0.878615 Aug 04 13:55:16.754108 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 261/504] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:15 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1361 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:16.768947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eb422bd2-a73d-4b03-9549-a2f19826e623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:16.773191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a790814-69de-4219-adea-6fd33c1e3d49 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:16.774055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1a790814-69de-4219-adea-6fd33c1e3d49 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:16.779330 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eb422bd2-a73d-4b03-9549-a2f19826e623 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1368 microversion: 2.1 time: 0.797172 Aug 04 13:55:16.785492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a790814-69de-4219-adea-6fd33c1e3d49 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:16.786356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a790814-69de-4219-adea-6fd33c1e3d49 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:16.792605 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 244/505] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:15 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1368 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:16.794021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a790814-69de-4219-adea-6fd33c1e3d49 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:16.794639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a790814-69de-4219-adea-6fd33c1e3d49 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:16.799660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-17270661-4f04-44e5-b8fb-4204c28f7559 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:16.800171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-17270661-4f04-44e5-b8fb-4204c28f7559 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:16.807542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17270661-4f04-44e5-b8fb-4204c28f7559 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:16.808294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17270661-4f04-44e5-b8fb-4204c28f7559 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:16.809292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17270661-4f04-44e5-b8fb-4204c28f7559 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:16.810019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17270661-4f04-44e5-b8fb-4204c28f7559 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:16.890652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-17270661-4f04-44e5-b8fb-4204c28f7559 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:55:17.100733 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-17270661-4f04-44e5-b8fb-4204c28f7559 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "DELETE /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 204 len: 0 microversion: 2.1 time: 0.305695 Aug 04 13:55:17.101715 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 245/506] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:55:16 2022] DELETE /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:55:17.108246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b3db8523-a694-49ec-9816-539d8e5bf856 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:17.109385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b3db8523-a694-49ec-9816-539d8e5bf856 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:17.123241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3db8523-a694-49ec-9816-539d8e5bf856 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:17.124063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3db8523-a694-49ec-9816-539d8e5bf856 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:17.125047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3db8523-a694-49ec-9816-539d8e5bf856 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:17.125629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3db8523-a694-49ec-9816-539d8e5bf856 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:17.376823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1a790814-69de-4219-adea-6fd33c1e3d49 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:17.384759 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a790814-69de-4219-adea-6fd33c1e3d49 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1313 microversion: 2.1 time: 0.628435 Aug 04 13:55:17.385369 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 262/507] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:16 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:17.402035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:17.402771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:17.416228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:17.416685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:17.420746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:17.421413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:17.592057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:17.602580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:17.604123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:17.615970 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75770ddf-e5d4-4481-bddd-97e3b1ad7ef7 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.221364 Aug 04 13:55:17.616577 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 263/508] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:17 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:17.624120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-882763119", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "492327838", "adminPass": "***", "networks": [{"uuid": "3039de0c-849f-4290-b9b8-50645f6d6d1c"}], "security_groups": [{"name": "tempest-securitygroup--1634228691"}], "key_name": "tempest-keypair-1562324001", "user_data": "}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:17.689329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b3db8523-a694-49ec-9816-539d8e5bf856 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:17.701132 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b3db8523-a694-49ec-9816-539d8e5bf856 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1464 microversion: 2.1 time: 0.594390 Aug 04 13:55:17.701941 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 246/509] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:17 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1464 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:17.879729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] validate_networks() for [('3039de0c-849f-4290-b9b8-50645f6d6d1c', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:55:17.944537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-927000364", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:18.010624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:55:18.384612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:18.385250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:18.385961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:18.386567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:18.387027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:18.394438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=21 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:18.409717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:18.411317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:18.412907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:18.417098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:18.436382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Getting quotas for project 9897fe3193ba44d683cac4a1d4381158. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:55:18.441186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Getting quotas for user 962006014e414681a9ccf556eaa7162b and project 9897fe3193ba44d683cac4a1d4381158. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:55:18.454648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:55:18.457015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:55:18.520734 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9fd8b328-f2d5-4a8c-9816-8952921dbe8c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817352 Aug 04 13:55:18.526997 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 247/510] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:55:18.526997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-193a8cee-3656-4cf4-9c27-b7712d3f18f5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:18.527459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-193a8cee-3656-4cf4-9c27-b7712d3f18f5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:18.534627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-193a8cee-3656-4cf4-9c27-b7712d3f18f5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:18.535085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-193a8cee-3656-4cf4-9c27-b7712d3f18f5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:18.535875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-193a8cee-3656-4cf4-9c27-b7712d3f18f5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:18.536318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-193a8cee-3656-4cf4-9c27-b7712d3f18f5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.016651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:19.019865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:19.020895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:19.021474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:19.021971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:19.040963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.041427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.042243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.051023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.096328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Getting quotas for project dc689abcb1e94127aa8838ecb76ea9d9. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:55:19.109436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Getting quotas for user 3bb6f86c5d0642f689d50d86dd8ec82e and project dc689abcb1e94127aa8838ecb76ea9d9. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:55:19.141105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:55:19.143798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:55:19.202937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-193a8cee-3656-4cf4-9c27-b7712d3f18f5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:19.213198 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-193a8cee-3656-4cf4-9c27-b7712d3f18f5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1463 microversion: 2.1 time: 0.690291 Aug 04 13:55:19.217304 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 248/511] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:18 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1463 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:19.229127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:19.234522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:19.243120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.245681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.249967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.250846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.285935 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2dbb98dc-c885-42cd-854e-e7dad91bc21c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.667022 Aug 04 13:55:19.289161 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 264/512] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:55:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:55:19.303028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3f76a5fe-04cb-43cb-932d-9cbdfb2627c8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:19.304138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3f76a5fe-04cb-43cb-932d-9cbdfb2627c8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:19.317404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f76a5fe-04cb-43cb-932d-9cbdfb2627c8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.318682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f76a5fe-04cb-43cb-932d-9cbdfb2627c8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.322085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f76a5fe-04cb-43cb-932d-9cbdfb2627c8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.324477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f76a5fe-04cb-43cb-932d-9cbdfb2627c8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.754285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:19.775787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:19.778356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:19.780117 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-03811f44-865c-4d12-b53b-c71cd4c64280 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1361 microversion: 2.25 time: 0.561407 Aug 04 13:55:19.780917 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 249/513] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:19 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:19.788207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-754792e6-24a6-4204-a3be-825ab61f418c req-760107d3-27c7-4d1c-8a31-5df863e8469c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521a6443-46e3-4a58-9c10-1c23aba8dec8", "tag": "34993f2e-4116-45e0-a4c8-4d10c39d4bb7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:19.798926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3f76a5fe-04cb-43cb-932d-9cbdfb2627c8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:19.800442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-754792e6-24a6-4204-a3be-825ab61f418c req-760107d3-27c7-4d1c-8a31-5df863e8469c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.801429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-754792e6-24a6-4204-a3be-825ab61f418c req-760107d3-27c7-4d1c-8a31-5df863e8469c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.807220 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3f76a5fe-04cb-43cb-932d-9cbdfb2627c8 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1368 microversion: 2.1 time: 0.515624 Aug 04 13:55:19.814328 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 265/514] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:19 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1368 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:19.819229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9585dd80-2ecb-4d48-ad2a-451c864ca034 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:19.836300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9585dd80-2ecb-4d48-ad2a-451c864ca034 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:19.841654 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-754792e6-24a6-4204-a3be-825ab61f418c req-760107d3-27c7-4d1c-8a31-5df863e8469c service nova] Creating event network-changed:34993f2e-4116-45e0-a4c8-4d10c39d4bb7 for instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 on n-h1-844627-10 Aug 04 13:55:19.848459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9585dd80-2ecb-4d48-ad2a-451c864ca034 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.848957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9585dd80-2ecb-4d48-ad2a-451c864ca034 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.849792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9585dd80-2ecb-4d48-ad2a-451c864ca034 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.849957 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-754792e6-24a6-4204-a3be-825ab61f418c req-760107d3-27c7-4d1c-8a31-5df863e8469c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067498 Aug 04 13:55:19.850179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9585dd80-2ecb-4d48-ad2a-451c864ca034 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.850945 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 250/515] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:19.858722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ec86e6f1-d0f3-4922-8b22-0b7d483fc65e tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:19.860042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ec86e6f1-d0f3-4922-8b22-0b7d483fc65e tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:19.867200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec86e6f1-d0f3-4922-8b22-0b7d483fc65e tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.868051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec86e6f1-d0f3-4922-8b22-0b7d483fc65e tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:19.869133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec86e6f1-d0f3-4922-8b22-0b7d483fc65e tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:19.869797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec86e6f1-d0f3-4922-8b22-0b7d483fc65e tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:20.003833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ec86e6f1-d0f3-4922-8b22-0b7d483fc65e tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:20.017166 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ec86e6f1-d0f3-4922-8b22-0b7d483fc65e tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1270 microversion: 2.1 time: 0.164706 Aug 04 13:55:20.018706 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 251/516] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:19 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:20.025811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:20.026531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:20.044449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:20.048256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:20.049143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:20.049588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:20.143098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9585dd80-2ecb-4d48-ad2a-451c864ca034 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:20.151924 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9585dd80-2ecb-4d48-ad2a-451c864ca034 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1313 microversion: 2.1 time: 0.336442 Aug 04 13:55:20.155415 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 266/517] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:19 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:20.167939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-059490ba-8eec-49e6-a3b6-2831a90e3456 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:20.173436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-059490ba-8eec-49e6-a3b6-2831a90e3456 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:20.223710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:20.244319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:20.246323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:20.256449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-059490ba-8eec-49e6-a3b6-2831a90e3456 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:20.263840 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-059490ba-8eec-49e6-a3b6-2831a90e3456 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1262 microversion: 2.1 time: 0.106483 Aug 04 13:55:20.266863 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 267/518] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:20 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1262 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:20.267198 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e84c044-e788-4212-b691-7c9690aaf13d tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.247415 Aug 04 13:55:20.277275 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 252/519] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:20 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:20.283660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2aba6054-08ed-4779-acff-5e865f541a8b req-ebe0e26b-bb66-4ead-9995-c7d9fccc0fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3861160-fd38-4411-9578-cbe56e26a0f7", "name": "network-vif-plugged", "status": "completed", "tag": "00402c6c-b47f-4ddd-a152-4636377d16c8"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:20.297841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2aba6054-08ed-4779-acff-5e865f541a8b req-ebe0e26b-bb66-4ead-9995-c7d9fccc0fd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:20.298586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2aba6054-08ed-4779-acff-5e865f541a8b req-ebe0e26b-bb66-4ead-9995-c7d9fccc0fd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:20.300906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-131434103", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9802281d-83eb-4b5d-8fe0-bc812e0872e4"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:20.310762 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2aba6054-08ed-4779-acff-5e865f541a8b req-ebe0e26b-bb66-4ead-9995-c7d9fccc0fd4 service nova] Creating event network-vif-plugged:00402c6c-b47f-4ddd-a152-4636377d16c8 for instance d3861160-fd38-4411-9578-cbe56e26a0f7 on n-h2-844627-10 Aug 04 13:55:20.316462 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2aba6054-08ed-4779-acff-5e865f541a8b req-ebe0e26b-bb66-4ead-9995-c7d9fccc0fd4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048328 Aug 04 13:55:20.317607 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 268/520] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:20.430286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:55:20.803937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:20.805404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:20.823061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:20.824184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:20.825281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:20.825963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:20.883941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:20.884659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:20.885323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:20.885885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:20.886446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:20.903950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:20.904395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:20.905486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:20.905918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:20.961494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Getting quotas for project 7b30c782fc334aa19f39ac3178b29a17. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:55:20.967769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Getting quotas for user 50f66b75313549e4bd9a676ae1078b7c and project 7b30c782fc334aa19f39ac3178b29a17. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:55:20.997665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:55:21.000010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:55:21.056680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:21.069176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:21.072039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:21.073615 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b9197b4a-53e4-4cc8-a422-ff6273aa3209 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1361 microversion: 2.25 time: 0.274035 Aug 04 13:55:21.074962 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 269/521] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:20 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:21.091512 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4ef21f2a-1588-4ad0-99eb-135c5a675373 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821673 Aug 04 13:55:21.093460 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 253/522] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:55:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:55:21.107271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-94810681-daca-4057-9d15-cde53ba69edf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:21.111090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-94810681-daca-4057-9d15-cde53ba69edf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:21.112379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-160b81cc-0e0a-44b0-b1d6-d00e17a26882 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:21.118058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-160b81cc-0e0a-44b0-b1d6-d00e17a26882 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:21.145386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-160b81cc-0e0a-44b0-b1d6-d00e17a26882 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:21.148179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94810681-daca-4057-9d15-cde53ba69edf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:21.148728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94810681-daca-4057-9d15-cde53ba69edf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:21.149507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94810681-daca-4057-9d15-cde53ba69edf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:21.149952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94810681-daca-4057-9d15-cde53ba69edf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:21.152703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-160b81cc-0e0a-44b0-b1d6-d00e17a26882 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:21.156362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-160b81cc-0e0a-44b0-b1d6-d00e17a26882 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:21.160392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-160b81cc-0e0a-44b0-b1d6-d00e17a26882 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:21.424747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-160b81cc-0e0a-44b0-b1d6-d00e17a26882 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:21.439155 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-160b81cc-0e0a-44b0-b1d6-d00e17a26882 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1276 microversion: 2.1 time: 0.339467 Aug 04 13:55:21.441610 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 254/523] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:21 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1276 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:21.460331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c624330c-e5db-4cb3-b034-6d46db3d10be tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:21.461004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c624330c-e5db-4cb3-b034-6d46db3d10be tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:21.773036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c624330c-e5db-4cb3-b034-6d46db3d10be tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:21.784935 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c624330c-e5db-4cb3-b034-6d46db3d10be tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1213 microversion: 2.1 time: 0.342132 Aug 04 13:55:21.787789 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 255/524] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:21 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1213 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:21.792484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-095f5e25-4c33-49d4-b2b0-7b41eca4f500 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:21.793109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-095f5e25-4c33-49d4-b2b0-7b41eca4f500 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:21.829321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-94810681-daca-4057-9d15-cde53ba69edf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:21.839831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-095f5e25-4c33-49d4-b2b0-7b41eca4f500 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:21.840311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-095f5e25-4c33-49d4-b2b0-7b41eca4f500 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:21.845292 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-94810681-daca-4057-9d15-cde53ba69edf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1368 microversion: 2.1 time: 0.765517 Aug 04 13:55:21.845457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-095f5e25-4c33-49d4-b2b0-7b41eca4f500 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:21.845879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-095f5e25-4c33-49d4-b2b0-7b41eca4f500 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:21.846423 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 270/525] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:21 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1368 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:21.868684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-63cfd35d-dbb4-4ab2-b762-eca175a38aa3 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:21.871071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-63cfd35d-dbb4-4ab2-b762-eca175a38aa3 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:21.885158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:21.906919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63cfd35d-dbb4-4ab2-b762-eca175a38aa3 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:21.909960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63cfd35d-dbb4-4ab2-b762-eca175a38aa3 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:21.911354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63cfd35d-dbb4-4ab2-b762-eca175a38aa3 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:21.916049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63cfd35d-dbb4-4ab2-b762-eca175a38aa3 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:22.393353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-63cfd35d-dbb4-4ab2-b762-eca175a38aa3 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:22.409403 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-63cfd35d-dbb4-4ab2-b762-eca175a38aa3 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1320 microversion: 2.1 time: 0.561513 Aug 04 13:55:22.410276 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 271/526] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:21 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1320 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:22.428416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:22.432002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:22.444108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:22.447403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:22.449788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:22.451288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:22.798739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:22.827422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:22.839454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:22.861790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-095f5e25-4c33-49d4-b2b0-7b41eca4f500 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:22.883867 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-89fa897e-5b25-4b45-843f-cf01d0f84694 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.462640 Aug 04 13:55:22.898253 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 272/527] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:22 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:22.902536 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-095f5e25-4c33-49d4-b2b0-7b41eca4f500 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1313 microversion: 2.1 time: 1.113494 Aug 04 13:55:22.906328 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 256/528] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:21 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1313 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:22.915510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c5aa0849-4319-40ba-929a-2176ada3da78 req-0e8b4ec7-1b84-4d38-a42a-54ba7804084d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206086e4-b66e-49e9-9299-4cc160efecbd", "name": "network-vif-deleted", "tag": "c3f8fbbc-3537-4d62-9f4b-5adf086a2321"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:22.928078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:22.929317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:22.947569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:22.948964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:22.951814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:22.952708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:22.965438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c5aa0849-4319-40ba-929a-2176ada3da78 req-0e8b4ec7-1b84-4d38-a42a-54ba7804084d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:22.973577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c5aa0849-4319-40ba-929a-2176ada3da78 req-0e8b4ec7-1b84-4d38-a42a-54ba7804084d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:23.022398 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c5aa0849-4319-40ba-929a-2176ada3da78 req-0e8b4ec7-1b84-4d38-a42a-54ba7804084d service nova] Creating event network-vif-deleted:c3f8fbbc-3537-4d62-9f4b-5adf086a2321 for instance 206086e4-b66e-49e9-9299-4cc160efecbd on n-h1-844627-10 Aug 04 13:55:23.033435 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c5aa0849-4319-40ba-929a-2176ada3da78 req-0e8b4ec7-1b84-4d38-a42a-54ba7804084d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133405 Aug 04 13:55:23.036335 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 273/529] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:23.046767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3839c38e-dd1c-4a12-87ea-53067a38bd6c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:23.056179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3839c38e-dd1c-4a12-87ea-53067a38bd6c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:23.075166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3839c38e-dd1c-4a12-87ea-53067a38bd6c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:23.076225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3839c38e-dd1c-4a12-87ea-53067a38bd6c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:23.077348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3839c38e-dd1c-4a12-87ea-53067a38bd6c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:23.078049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3839c38e-dd1c-4a12-87ea-53067a38bd6c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:23.251160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3839c38e-dd1c-4a12-87ea-53067a38bd6c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:23.262157 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3839c38e-dd1c-4a12-87ea-53067a38bd6c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1276 microversion: 2.1 time: 0.224105 Aug 04 13:55:23.277097 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 274/530] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:23 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:23.294414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4f9e1469-53e8-490a-97c6-15677c4389b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:23.296740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4f9e1469-53e8-490a-97c6-15677c4389b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:23.314497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f9e1469-53e8-490a-97c6-15677c4389b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:23.318951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f9e1469-53e8-490a-97c6-15677c4389b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:23.322045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f9e1469-53e8-490a-97c6-15677c4389b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:23.322849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f9e1469-53e8-490a-97c6-15677c4389b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:23.686949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4f9e1469-53e8-490a-97c6-15677c4389b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:23.711155 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4f9e1469-53e8-490a-97c6-15677c4389b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1265 microversion: 2.1 time: 0.432514 Aug 04 13:55:23.718060 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 275/531] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:23 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1265 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:23.730691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-26211596-cdaa-4f3c-9c90-a164e42b3106 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:23.732962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-26211596-cdaa-4f3c-9c90-a164e42b3106 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:23.761112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26211596-cdaa-4f3c-9c90-a164e42b3106 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:23.762901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26211596-cdaa-4f3c-9c90-a164e42b3106 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:23.769187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26211596-cdaa-4f3c-9c90-a164e42b3106 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:23.769878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26211596-cdaa-4f3c-9c90-a164e42b3106 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:24.602802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-26211596-cdaa-4f3c-9c90-a164e42b3106 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:24.622587 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-26211596-cdaa-4f3c-9c90-a164e42b3106 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1368 microversion: 2.1 time: 0.902556 Aug 04 13:55:24.632951 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 276/532] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:23 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1368 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:24.632951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8a5cef66-8f54-43f2-ae52-192d121fe995 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:24.632951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8a5cef66-8f54-43f2-ae52-192d121fe995 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:24.649601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a5cef66-8f54-43f2-ae52-192d121fe995 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:24.650171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a5cef66-8f54-43f2-ae52-192d121fe995 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:24.650966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a5cef66-8f54-43f2-ae52-192d121fe995 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:24.651424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a5cef66-8f54-43f2-ae52-192d121fe995 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:24.696315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:24.705329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:24.706855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:24.708029 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3f098db1-4967-4b24-9ccd-9b09f41419ac tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1557 microversion: 2.25 time: 1.786481 Aug 04 13:55:24.708598 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 257/533] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:22 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1557 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:24.740809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7846bb40-0b50-4adf-bdbb-ad802c2f942f req-c4dbbe89-796e-4e92-a514-3586508cbd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e44dc8-8cc8-4787-aac7-7b82cd8679e4", "name": "network-vif-plugged", "status": "completed", "tag": "7f0e237c-1431-4143-8b98-9539ef44bae6"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:24.759182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7846bb40-0b50-4adf-bdbb-ad802c2f942f req-c4dbbe89-796e-4e92-a514-3586508cbd5c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:24.759629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7846bb40-0b50-4adf-bdbb-ad802c2f942f req-c4dbbe89-796e-4e92-a514-3586508cbd5c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:24.775190 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7846bb40-0b50-4adf-bdbb-ad802c2f942f req-c4dbbe89-796e-4e92-a514-3586508cbd5c service nova] Creating event network-vif-plugged:7f0e237c-1431-4143-8b98-9539ef44bae6 for instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 on n-h2-844627-10 Aug 04 13:55:24.782006 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7846bb40-0b50-4adf-bdbb-ad802c2f942f req-c4dbbe89-796e-4e92-a514-3586508cbd5c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047398 Aug 04 13:55:24.783260 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 258/534] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:24.789659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:24.790830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:24.797803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:24.798351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:24.799518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:24.800197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:24.803632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:25.144496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:25.163076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:25.165454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:25.173050 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9ed64431-5725-4aee-a22a-b046c62a5b5c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.388380 Aug 04 13:55:25.173773 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 259/535] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:24 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:25.178912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aa5a4cdf-ba65-4a6d-9c2b-4e6634eda9e9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:25.179830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aa5a4cdf-ba65-4a6d-9c2b-4e6634eda9e9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:25.191087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa5a4cdf-ba65-4a6d-9c2b-4e6634eda9e9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:25.191926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa5a4cdf-ba65-4a6d-9c2b-4e6634eda9e9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:25.194990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa5a4cdf-ba65-4a6d-9c2b-4e6634eda9e9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:25.195702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa5a4cdf-ba65-4a6d-9c2b-4e6634eda9e9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:25.546289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8a5cef66-8f54-43f2-ae52-192d121fe995 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:25.556953 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8a5cef66-8f54-43f2-ae52-192d121fe995 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1388 microversion: 2.1 time: 0.932214 Aug 04 13:55:25.572920 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 277/536] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:24 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1388 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:25.578345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a070201-9485-45ff-9ed2-b221ffb4d5ec tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:25.579152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9a070201-9485-45ff-9ed2-b221ffb4d5ec tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:25.586343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a070201-9485-45ff-9ed2-b221ffb4d5ec tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:25.587591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a070201-9485-45ff-9ed2-b221ffb4d5ec tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:25.588313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a070201-9485-45ff-9ed2-b221ffb4d5ec tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:25.588752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a070201-9485-45ff-9ed2-b221ffb4d5ec tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:25.600585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aa5a4cdf-ba65-4a6d-9c2b-4e6634eda9e9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:25.614022 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aa5a4cdf-ba65-4a6d-9c2b-4e6634eda9e9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1313 microversion: 2.1 time: 0.438111 Aug 04 13:55:25.615087 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 260/537] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:25 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:25.694587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9a070201-9485-45ff-9ed2-b221ffb4d5ec tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:25.700628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:25.712283 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a070201-9485-45ff-9ed2-b221ffb4d5ec tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1276 microversion: 2.1 time: 0.137599 Aug 04 13:55:25.718278 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 278/538] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:25 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:25.723094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab3afe2e-8cb0-4734-b140-3c4d8c677022 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:25.724003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ab3afe2e-8cb0-4734-b140-3c4d8c677022 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:25.730750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab3afe2e-8cb0-4734-b140-3c4d8c677022 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:25.731994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab3afe2e-8cb0-4734-b140-3c4d8c677022 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:25.733026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab3afe2e-8cb0-4734-b140-3c4d8c677022 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:25.733634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab3afe2e-8cb0-4734-b140-3c4d8c677022 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:25.759890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-89debad6-127f-46de-bad7-452549f768f3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:25.760516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-89debad6-127f-46de-bad7-452549f768f3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:25.768969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89debad6-127f-46de-bad7-452549f768f3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:25.769421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89debad6-127f-46de-bad7-452549f768f3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:25.770221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89debad6-127f-46de-bad7-452549f768f3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:25.770729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89debad6-127f-46de-bad7-452549f768f3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:25.818979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ab3afe2e-8cb0-4734-b140-3c4d8c677022 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:25.827551 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ab3afe2e-8cb0-4734-b140-3c4d8c677022 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1271 microversion: 2.1 time: 0.108120 Aug 04 13:55:25.828346 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 279/539] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:25 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:25.951285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-71c45190-086a-41c1-9ca5-2dca915257f8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Action: 'create', calling method: .version_select at 0x7f4700a7ca60>, body: {"keypair": {"name": "tempest-keypair-2117328771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmNCIr2/+VvcSegA9iM7p/mmQ739EgT8nHIlufld3t6UqYuD4qpbDg5jwx+RbjZYCChawuwEC0T8V8nrRC2BBzByTkeFIs0jUpfcsaKHGWNqWkjolLpj2aMwHZsBvYl2A=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:25.974364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-71c45190-086a-41c1-9ca5-2dca915257f8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Getting quotas for project c6bc03c5e3934e81adecc7004e0e87f0. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:55:25.979629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-71c45190-086a-41c1-9ca5-2dca915257f8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Getting quotas for user 7f51c32e1dd7438bac9feb8e38975452 and project c6bc03c5e3934e81adecc7004e0e87f0. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:55:26.010035 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-71c45190-086a-41c1-9ca5-2dca915257f8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180417 Aug 04 13:55:26.011287 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 280/540] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:55:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:26.015788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-41bd7182-7e9b-427b-a48d-4fa657672758 req-31965cd7-84d7-42e5-9606-e7eb0093945c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af05b69d-855c-42e3-b5c5-772d703fc11a", "tag": "f7209b74-7505-4bb3-b3a5-61607d4e42dc"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:26.037864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-41bd7182-7e9b-427b-a48d-4fa657672758 req-31965cd7-84d7-42e5-9606-e7eb0093945c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.038310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-41bd7182-7e9b-427b-a48d-4fa657672758 req-31965cd7-84d7-42e5-9606-e7eb0093945c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.055725 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-41bd7182-7e9b-427b-a48d-4fa657672758 req-31965cd7-84d7-42e5-9606-e7eb0093945c service nova] Creating event network-changed:f7209b74-7505-4bb3-b3a5-61607d4e42dc for instance af05b69d-855c-42e3-b5c5-772d703fc11a on n-h2-844627-10 Aug 04 13:55:26.062554 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-41bd7182-7e9b-427b-a48d-4fa657672758 req-31965cd7-84d7-42e5-9606-e7eb0093945c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049744 Aug 04 13:55:26.064086 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 281/541] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:26.074355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4606572e-e87d-48f5-a504-746b956e7095 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:26.075832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4606572e-e87d-48f5-a504-746b956e7095 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:26.083083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4606572e-e87d-48f5-a504-746b956e7095 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.083725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4606572e-e87d-48f5-a504-746b956e7095 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.084665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4606572e-e87d-48f5-a504-746b956e7095 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.085302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4606572e-e87d-48f5-a504-746b956e7095 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.108546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-89debad6-127f-46de-bad7-452549f768f3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid d3861160-fd38-4411-9578-cbe56e26a0f7 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:55:26.195911 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-89debad6-127f-46de-bad7-452549f768f3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 2051 microversion: 2.25 time: 0.578691 Aug 04 13:55:26.196669 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 261/542] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:25 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 2051 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:26.215210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:26.216267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:26.223632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.224081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.225007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.225460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.353965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:26.363720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:26.365573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:26.371448 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9fc12f24-0cc2-44d6-938b-e039cc915cd0 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.173494 Aug 04 13:55:26.372912 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 262/543] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:26 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:26.377502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6a936bcd-03a5-4d14-a674-9a50196ad6a8 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:26.378112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6a936bcd-03a5-4d14-a674-9a50196ad6a8 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:26.384999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a936bcd-03a5-4d14-a674-9a50196ad6a8 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.386056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a936bcd-03a5-4d14-a674-9a50196ad6a8 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.387428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a936bcd-03a5-4d14-a674-9a50196ad6a8 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.388531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a936bcd-03a5-4d14-a674-9a50196ad6a8 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.412423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4606572e-e87d-48f5-a504-746b956e7095 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:26.424636 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4606572e-e87d-48f5-a504-746b956e7095 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1368 microversion: 2.1 time: 0.359078 Aug 04 13:55:26.425414 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 282/544] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:26 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:26.573726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-6a936bcd-03a5-4d14-a674-9a50196ad6a8 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid d3861160-fd38-4411-9578-cbe56e26a0f7 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:55:26.583846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6a7fc13-1423-4a3e-8dbf-b09cf3f6da89 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:26.585080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a6a7fc13-1423-4a3e-8dbf-b09cf3f6da89 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:26.611066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6a7fc13-1423-4a3e-8dbf-b09cf3f6da89 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.613281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6a7fc13-1423-4a3e-8dbf-b09cf3f6da89 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.614694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6a7fc13-1423-4a3e-8dbf-b09cf3f6da89 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.616383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6a7fc13-1423-4a3e-8dbf-b09cf3f6da89 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.617607 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6a936bcd-03a5-4d14-a674-9a50196ad6a8 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 2051 microversion: 2.25 time: 0.243362 Aug 04 13:55:26.618258 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 263/545] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:26 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 2051 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:26.647879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fdc4510b-6c49-4f6c-8764-3c8e6a9a06e8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:26.650019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fdc4510b-6c49-4f6c-8764-3c8e6a9a06e8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:26.660076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdc4510b-6c49-4f6c-8764-3c8e6a9a06e8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.660829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdc4510b-6c49-4f6c-8764-3c8e6a9a06e8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:26.662983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdc4510b-6c49-4f6c-8764-3c8e6a9a06e8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:26.663872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdc4510b-6c49-4f6c-8764-3c8e6a9a06e8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.041125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6a7fc13-1423-4a3e-8dbf-b09cf3f6da89 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:27.067434 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a6a7fc13-1423-4a3e-8dbf-b09cf3f6da89 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1388 microversion: 2.1 time: 0.484978 Aug 04 13:55:27.070565 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 283/546] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:26 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1388 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:27.079665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-875f6798-f51f-4914-acca-789da3eb9cef tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:27.084415 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:55:27.084415 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:55:27.095802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-875f6798-f51f-4914-acca-789da3eb9cef tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.096574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-875f6798-f51f-4914-acca-789da3eb9cef tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.100901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-875f6798-f51f-4914-acca-789da3eb9cef tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.101601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-875f6798-f51f-4914-acca-789da3eb9cef tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.133902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fdc4510b-6c49-4f6c-8764-3c8e6a9a06e8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:27.147055 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fdc4510b-6c49-4f6c-8764-3c8e6a9a06e8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1313 microversion: 2.1 time: 0.515685 Aug 04 13:55:27.160879 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-875f6798-f51f-4914-acca-789da3eb9cef tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.088211 Aug 04 13:55:27.161498 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 264/547] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:26 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:27.169204 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 284/548] 10.222.0.66 () {60 vars in 1217 bytes} [Thu Aug 4 13:55:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:55:27.179215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8914ce09-2ade-4bf2-af5d-078a34a0656c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:27.180092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8914ce09-2ade-4bf2-af5d-078a34a0656c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:27.181854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-985a407e-545b-4ad9-90e6-c9042d5bed23 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:27.182748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-985a407e-545b-4ad9-90e6-c9042d5bed23 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:27.196069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8914ce09-2ade-4bf2-af5d-078a34a0656c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.201555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8914ce09-2ade-4bf2-af5d-078a34a0656c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.202419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-985a407e-545b-4ad9-90e6-c9042d5bed23 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.202663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8914ce09-2ade-4bf2-af5d-078a34a0656c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.203219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-985a407e-545b-4ad9-90e6-c9042d5bed23 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.203335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8914ce09-2ade-4bf2-af5d-078a34a0656c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.204370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-985a407e-545b-4ad9-90e6-c9042d5bed23 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.205064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-985a407e-545b-4ad9-90e6-c9042d5bed23 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.541412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-985a407e-545b-4ad9-90e6-c9042d5bed23 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:27.544316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8914ce09-2ade-4bf2-af5d-078a34a0656c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:27.551965 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8914ce09-2ade-4bf2-af5d-078a34a0656c tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1318 microversion: 2.1 time: 0.389306 Aug 04 13:55:27.554780 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-985a407e-545b-4ad9-90e6-c9042d5bed23 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.383168 Aug 04 13:55:27.555922 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 285/549] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:27 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:27.563576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bab17eda-5864-4901-a7e8-20bb40eafb20 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844627-10", "block_migration": "auto"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:27.565476 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 265/550] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:27 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:27.570174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bab17eda-5864-4901-a7e8-20bb40eafb20 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:27.580224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bab17eda-5864-4901-a7e8-20bb40eafb20 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.581679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bab17eda-5864-4901-a7e8-20bb40eafb20 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.583653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bab17eda-5864-4901-a7e8-20bb40eafb20 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.585484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bab17eda-5864-4901-a7e8-20bb40eafb20 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.594723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-70cef70b-caed-44f9-865e-86da774605dd req-bf7824cb-dc03-49cc-84ba-99bc7164056d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521a6443-46e3-4a58-9c10-1c23aba8dec8", "name": "network-vif-plugged", "status": "completed", "tag": "34993f2e-4116-45e0-a4c8-4d10c39d4bb7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:27.604565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-70cef70b-caed-44f9-865e-86da774605dd req-bf7824cb-dc03-49cc-84ba-99bc7164056d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.605057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-70cef70b-caed-44f9-865e-86da774605dd req-bf7824cb-dc03-49cc-84ba-99bc7164056d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.616508 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-70cef70b-caed-44f9-865e-86da774605dd req-bf7824cb-dc03-49cc-84ba-99bc7164056d service nova] Creating event network-vif-plugged:34993f2e-4116-45e0-a4c8-4d10c39d4bb7 for instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 on n-h1-844627-10 Aug 04 13:55:27.622159 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-70cef70b-caed-44f9-865e-86da774605dd req-bf7824cb-dc03-49cc-84ba-99bc7164056d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054835 Aug 04 13:55:27.623534 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 266/551] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:27.629943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:27.630648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:27.637413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.638108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.639620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.640267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.714413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-bab17eda-5864-4901-a7e8-20bb40eafb20 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'flavor' on Instance uuid d3861160-fd38-4411-9578-cbe56e26a0f7 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:55:27.786818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bab17eda-5864-4901-a7e8-20bb40eafb20 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Going to try to live migrate instance to n-h1-844627-10 {{(pid=130961) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 13:55:27.801788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:27.812746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:27.814379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:27.822710 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2a96acc9-b753-4b08-b592-ca7b1c90e3be tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.197597 Aug 04 13:55:27.823292 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 267/552] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:27 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:27.829386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d179322-2aee-4766-8a75-1a5cd27cec72 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:27.831635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2d179322-2aee-4766-8a75-1a5cd27cec72 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:27.839601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d179322-2aee-4766-8a75-1a5cd27cec72 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.840506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d179322-2aee-4766-8a75-1a5cd27cec72 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:27.841616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d179322-2aee-4766-8a75-1a5cd27cec72 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:27.842297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d179322-2aee-4766-8a75-1a5cd27cec72 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:28.434757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2d179322-2aee-4766-8a75-1a5cd27cec72 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:28.446266 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2d179322-2aee-4766-8a75-1a5cd27cec72 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1368 microversion: 2.1 time: 0.621599 Aug 04 13:55:28.452991 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 268/553] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:27 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1368 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:28.454611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-829510128", "imageRef": "cb620a46-6083-480a-bafc-9176c5ab2e93", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3ac2b07f-a218-4049-804f-12347f9c6796"}], "security_groups": [{"name": "tempest-securitygroup--1676323337"}], "key_name": "tempest-keypair-2117328771", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:28.472344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:28.669970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] validate_networks() for [('3ac2b07f-a218-4049-804f-12347f9c6796', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:55:29.498278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:29.498844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:29.499364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:29.499828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:29.500377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:29.519576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:29.520017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:29.521041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:29.521650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:29.539582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Getting quotas for project c6bc03c5e3934e81adecc7004e0e87f0. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:55:29.543683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Getting quotas for user 7f51c32e1dd7438bac9feb8e38975452 and project c6bc03c5e3934e81adecc7004e0e87f0. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:55:29.554987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:55:29.557316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cb620a46-6083-480a-bafc-9176c5ab2e93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:55:29.605594 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7510b83c-ead0-459f-a37b-ddc8ddf7b61c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.155818 Aug 04 13:55:29.612146 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 269/554] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:55:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:55:29.614902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f852f515-c89d-4a94-97de-4966579bf72e tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:29.615528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f852f515-c89d-4a94-97de-4966579bf72e tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:29.622487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f852f515-c89d-4a94-97de-4966579bf72e tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:29.622941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f852f515-c89d-4a94-97de-4966579bf72e tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:29.623732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f852f515-c89d-4a94-97de-4966579bf72e tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:29.624173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f852f515-c89d-4a94-97de-4966579bf72e tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:29.836576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f852f515-c89d-4a94-97de-4966579bf72e tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:29.846320 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f852f515-c89d-4a94-97de-4966579bf72e tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1388 microversion: 2.1 time: 0.235276 Aug 04 13:55:29.846953 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 270/555] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:29 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1388 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:29.859736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43ba8f8a-b46e-4b70-bf68-fe74eb27bb53 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:29.860348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-43ba8f8a-b46e-4b70-bf68-fe74eb27bb53 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:29.867188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43ba8f8a-b46e-4b70-bf68-fe74eb27bb53 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:29.867972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43ba8f8a-b46e-4b70-bf68-fe74eb27bb53 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:29.869052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43ba8f8a-b46e-4b70-bf68-fe74eb27bb53 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:29.869919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43ba8f8a-b46e-4b70-bf68-fe74eb27bb53 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.089468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-43ba8f8a-b46e-4b70-bf68-fe74eb27bb53 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.097580 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-43ba8f8a-b46e-4b70-bf68-fe74eb27bb53 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1462 microversion: 2.1 time: 0.249666 Aug 04 13:55:30.100208 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 271/556] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:29 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1462 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:30.119647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5410d59f-3b55-48a7-8d06-0eaaf8315dad req-bd3f7a4e-a4d3-4793-a529-c3cdbda47763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74769383-c385-4b29-b45c-820aff3e1a77", "tag": "3936056c-899a-4fed-ae2a-e09fe32d211d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:30.130010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5410d59f-3b55-48a7-8d06-0eaaf8315dad req-bd3f7a4e-a4d3-4793-a529-c3cdbda47763 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.130826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5410d59f-3b55-48a7-8d06-0eaaf8315dad req-bd3f7a4e-a4d3-4793-a529-c3cdbda47763 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.144461 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5410d59f-3b55-48a7-8d06-0eaaf8315dad req-bd3f7a4e-a4d3-4793-a529-c3cdbda47763 service nova] Creating event network-changed:3936056c-899a-4fed-ae2a-e09fe32d211d for instance 74769383-c385-4b29-b45c-820aff3e1a77 on n-h1-844627-10 Aug 04 13:55:30.150840 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5410d59f-3b55-48a7-8d06-0eaaf8315dad req-bd3f7a4e-a4d3-4793-a529-c3cdbda47763 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049127 Aug 04 13:55:30.151754 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 272/557] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:30.159528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5297de9e-933d-4c63-8989-1bdd911041f0 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:30.163731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5297de9e-933d-4c63-8989-1bdd911041f0 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:30.172520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5297de9e-933d-4c63-8989-1bdd911041f0 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.173385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5297de9e-933d-4c63-8989-1bdd911041f0 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.174393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5297de9e-933d-4c63-8989-1bdd911041f0 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.175046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5297de9e-933d-4c63-8989-1bdd911041f0 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.321197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5297de9e-933d-4c63-8989-1bdd911041f0 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.328899 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5297de9e-933d-4c63-8989-1bdd911041f0 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1318 microversion: 2.1 time: 0.175711 Aug 04 13:55:30.329588 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 273/558] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:30 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:30.334209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c8fac97e-fd83-4cda-9d79-d8835d239dc1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:30.334939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c8fac97e-fd83-4cda-9d79-d8835d239dc1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:30.341343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8fac97e-fd83-4cda-9d79-d8835d239dc1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.341792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8fac97e-fd83-4cda-9d79-d8835d239dc1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.342814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8fac97e-fd83-4cda-9d79-d8835d239dc1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.342998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8fac97e-fd83-4cda-9d79-d8835d239dc1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.351825 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bab17eda-5864-4901-a7e8-20bb40eafb20 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7/action" status: 202 len: 0 microversion: 2.25 time: 2.794599 Aug 04 13:55:30.352598 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 286/559] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 13:55:27 2022] POST /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7/action => generated 0 bytes in 2796 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:55:30.358142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:30.358754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:30.365937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.366391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.367167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.367599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.444407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.452958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.454477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.459473 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-02e8d240-2163-476c-9b8f-ba445229e7c3 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.105706 Aug 04 13:55:30.460034 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 287/560] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:30 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:30.469735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa253eaf-0b34-4bf0-9253-bcccae1bc5e6 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:30.469735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa253eaf-0b34-4bf0-9253-bcccae1bc5e6 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:30.471747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa253eaf-0b34-4bf0-9253-bcccae1bc5e6 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.472202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa253eaf-0b34-4bf0-9253-bcccae1bc5e6 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.472987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa253eaf-0b34-4bf0-9253-bcccae1bc5e6 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.473419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa253eaf-0b34-4bf0-9253-bcccae1bc5e6 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.502138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c8fac97e-fd83-4cda-9d79-d8835d239dc1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.509917 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c8fac97e-fd83-4cda-9d79-d8835d239dc1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.179256 Aug 04 13:55:30.510579 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 274/561] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:30 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:30.515893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c69263f-ed53-46c4-bc9c-239177dff124 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:30.516582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c69263f-ed53-46c4-bc9c-239177dff124 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:30.522765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c69263f-ed53-46c4-bc9c-239177dff124 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.523294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c69263f-ed53-46c4-bc9c-239177dff124 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.524163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c69263f-ed53-46c4-bc9c-239177dff124 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.524673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c69263f-ed53-46c4-bc9c-239177dff124 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.592314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c69263f-ed53-46c4-bc9c-239177dff124 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.599710 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c69263f-ed53-46c4-bc9c-239177dff124 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1249 microversion: 2.1 time: 0.088164 Aug 04 13:55:30.601292 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 275/562] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:30 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:30.606482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:30.609013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:30.616957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.617528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.618393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.618829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.632730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa253eaf-0b34-4bf0-9253-bcccae1bc5e6 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.641594 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa253eaf-0b34-4bf0-9253-bcccae1bc5e6 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1559 microversion: 2.1 time: 0.180584 Aug 04 13:55:30.642153 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 288/563] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:30 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:30.646589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:30.647215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:30.653077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.653537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.654315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.655204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.706503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.713265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Old instance type m1.heat2, new instance type m1.heat {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 13:55:30.720023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:30.720456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:30.720916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:30.721322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:30.721725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:30.769715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:30.826051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.835694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.836668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:30.837844 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eaeb75ad-5d29-402c-a40e-0d968d0eb812 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.194781 Aug 04 13:55:30.838401 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 289/564] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:30 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:30.844997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7ddd5733-5105-4774-82c8-bdbfdc87a7ca tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:30.844997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7ddd5733-5105-4774-82c8-bdbfdc87a7ca tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:30.850072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ddd5733-5105-4774-82c8-bdbfdc87a7ca tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.850518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ddd5733-5105-4774-82c8-bdbfdc87a7ca tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.850633 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-48481eda-12a5-4cdd-9c38-53ef07e60466 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8/action" status: 202 len: 0 microversion: 2.1 time: 0.247782 Aug 04 13:55:30.851455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ddd5733-5105-4774-82c8-bdbfdc87a7ca tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.851923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ddd5733-5105-4774-82c8-bdbfdc87a7ca tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.852071 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 276/565] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:55:30 2022] POST /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:55:30.862049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9717e36e-bee2-4549-8189-c6c3b5bb21a4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:30.862486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9717e36e-bee2-4549-8189-c6c3b5bb21a4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:30.869424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9717e36e-bee2-4549-8189-c6c3b5bb21a4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.870098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9717e36e-bee2-4549-8189-c6c3b5bb21a4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:30.870955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9717e36e-bee2-4549-8189-c6c3b5bb21a4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:30.872017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9717e36e-bee2-4549-8189-c6c3b5bb21a4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.000020 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7ddd5733-5105-4774-82c8-bdbfdc87a7ca tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160548 Aug 04 13:55:31.000717 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 290/566] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 13:55:30 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:31.012621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55b27400-b37a-40e4-883a-b6a46205de37 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:31.013807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55b27400-b37a-40e4-883a-b6a46205de37 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:31.021904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55b27400-b37a-40e4-883a-b6a46205de37 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.022767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55b27400-b37a-40e4-883a-b6a46205de37 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.023833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55b27400-b37a-40e4-883a-b6a46205de37 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.025169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55b27400-b37a-40e4-883a-b6a46205de37 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.046301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9717e36e-bee2-4549-8189-c6c3b5bb21a4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:31.054695 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9717e36e-bee2-4549-8189-c6c3b5bb21a4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.196641 Aug 04 13:55:31.055394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 277/567] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:30 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:31.238470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-55b27400-b37a-40e4-883a-b6a46205de37 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:31.250139 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55b27400-b37a-40e4-883a-b6a46205de37 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1388 microversion: 2.1 time: 0.246721 Aug 04 13:55:31.252361 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 291/568] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:31 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1388 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:31.318612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-1d0117d0-484c-4fa5-9155-512ff7eed29d req-80740964-d895-4a9d-8ebf-2eb2f3893b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af05b69d-855c-42e3-b5c5-772d703fc11a", "name": "network-vif-plugged", "status": "completed", "tag": "f7209b74-7505-4bb3-b3a5-61607d4e42dc"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:31.338131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1d0117d0-484c-4fa5-9155-512ff7eed29d req-80740964-d895-4a9d-8ebf-2eb2f3893b4e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.338997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1d0117d0-484c-4fa5-9155-512ff7eed29d req-80740964-d895-4a9d-8ebf-2eb2f3893b4e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.351746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eb484312-3e7a-4065-9eac-4529c08ce115 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:31.352627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eb484312-3e7a-4065-9eac-4529c08ce115 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:31.362438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb484312-3e7a-4065-9eac-4529c08ce115 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.370083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb484312-3e7a-4065-9eac-4529c08ce115 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.373475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb484312-3e7a-4065-9eac-4529c08ce115 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.374171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb484312-3e7a-4065-9eac-4529c08ce115 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.380628 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-1d0117d0-484c-4fa5-9155-512ff7eed29d req-80740964-d895-4a9d-8ebf-2eb2f3893b4e service nova] Creating event network-vif-plugged:f7209b74-7505-4bb3-b3a5-61607d4e42dc for instance af05b69d-855c-42e3-b5c5-772d703fc11a on n-h2-844627-10 Aug 04 13:55:31.387528 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-1d0117d0-484c-4fa5-9155-512ff7eed29d req-80740964-d895-4a9d-8ebf-2eb2f3893b4e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075058 Aug 04 13:55:31.388787 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 278/569] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:31.487844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:31.488564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:31.495611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.497008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.498584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.499261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.591432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:31.601464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:31.603220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:31.609609 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-29242a13-4b3c-4150-b1c9-d2a46d6b9aff tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.126075 Aug 04 13:55:31.625709 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 279/570] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:31 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:31.636378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eba865c4-f80f-4822-8f77-22de7c6b048c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:31.637067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eba865c4-f80f-4822-8f77-22de7c6b048c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:31.647450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eba865c4-f80f-4822-8f77-22de7c6b048c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.648732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eba865c4-f80f-4822-8f77-22de7c6b048c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.653293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eba865c4-f80f-4822-8f77-22de7c6b048c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.653979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eba865c4-f80f-4822-8f77-22de7c6b048c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.663358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eb484312-3e7a-4065-9eac-4529c08ce115 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:31.675427 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eb484312-3e7a-4065-9eac-4529c08ce115 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1318 microversion: 2.1 time: 0.328813 Aug 04 13:55:31.676130 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 292/571] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:31 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:31.688002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2238ee51-e888-41e3-ba68-5a80083a9355 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:31.692738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2238ee51-e888-41e3-ba68-5a80083a9355 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:31.702349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2238ee51-e888-41e3-ba68-5a80083a9355 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.702831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2238ee51-e888-41e3-ba68-5a80083a9355 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.703559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2238ee51-e888-41e3-ba68-5a80083a9355 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.704003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2238ee51-e888-41e3-ba68-5a80083a9355 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.813687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2238ee51-e888-41e3-ba68-5a80083a9355 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:31.829322 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2238ee51-e888-41e3-ba68-5a80083a9355 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1249 microversion: 2.1 time: 0.146048 Aug 04 13:55:31.838197 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 293/572] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:31 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1249 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:31.864649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:31.865439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:31.867063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eba865c4-f80f-4822-8f77-22de7c6b048c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:31.872111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.872653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.873528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:31.874041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:31.882607 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eba865c4-f80f-4822-8f77-22de7c6b048c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.254472 Aug 04 13:55:31.883724 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 280/573] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:31 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:32.023682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:32.033068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:32.034637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:32.035818 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-78e013a9-8a53-462e-be16-0b45fba8781b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.175580 Aug 04 13:55:32.036389 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 294/574] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:31 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:32.076942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac86be42-fa15-4314-bae9-e7369aaad12f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:32.077454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac86be42-fa15-4314-bae9-e7369aaad12f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:32.083564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac86be42-fa15-4314-bae9-e7369aaad12f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.084011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac86be42-fa15-4314-bae9-e7369aaad12f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:32.084781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac86be42-fa15-4314-bae9-e7369aaad12f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.085251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac86be42-fa15-4314-bae9-e7369aaad12f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:32.186538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-bfbdb665-16cf-4658-a26e-6a979e92dd61 req-68f95488-9c2a-46b2-86ea-a9f4d3c93607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608bc65c-ea5b-45ed-99f1-706ba5a958e3", "tag": "31b48178-e307-4711-87aa-797381b2a7c0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:32.201102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bfbdb665-16cf-4658-a26e-6a979e92dd61 req-68f95488-9c2a-46b2-86ea-a9f4d3c93607 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.201751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bfbdb665-16cf-4658-a26e-6a979e92dd61 req-68f95488-9c2a-46b2-86ea-a9f4d3c93607 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:32.213473 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bfbdb665-16cf-4658-a26e-6a979e92dd61 req-68f95488-9c2a-46b2-86ea-a9f4d3c93607 service nova] Creating event network-changed:31b48178-e307-4711-87aa-797381b2a7c0 for instance 608bc65c-ea5b-45ed-99f1-706ba5a958e3 on n-h2-844627-10 Aug 04 13:55:32.218946 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-bfbdb665-16cf-4658-a26e-6a979e92dd61 req-68f95488-9c2a-46b2-86ea-a9f4d3c93607 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039931 Aug 04 13:55:32.219751 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 295/575] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:55:32.251564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac86be42-fa15-4314-bae9-e7369aaad12f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:32.259276 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac86be42-fa15-4314-bae9-e7369aaad12f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.186305 Aug 04 13:55:32.259973 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 281/576] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:32 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:32.274181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df968562-ded2-408e-b6ab-15218744f195 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:32.275017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-df968562-ded2-408e-b6ab-15218744f195 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:32.282106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df968562-ded2-408e-b6ab-15218744f195 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.283597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df968562-ded2-408e-b6ab-15218744f195 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:32.285054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df968562-ded2-408e-b6ab-15218744f195 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.285667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df968562-ded2-408e-b6ab-15218744f195 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:32.351884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-9ab222ca-73b9-4eb2-8b70-a44e3f117fd0 req-df5ff75d-2b82-458d-b6f8-b4ff7fb51825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e44dc8-8cc8-4787-aac7-7b82cd8679e4", "tag": "7f0e237c-1431-4143-8b98-9539ef44bae6"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:32.363292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9ab222ca-73b9-4eb2-8b70-a44e3f117fd0 req-df5ff75d-2b82-458d-b6f8-b4ff7fb51825 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.365350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9ab222ca-73b9-4eb2-8b70-a44e3f117fd0 req-df5ff75d-2b82-458d-b6f8-b4ff7fb51825 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:32.379515 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9ab222ca-73b9-4eb2-8b70-a44e3f117fd0 req-df5ff75d-2b82-458d-b6f8-b4ff7fb51825 service nova] Creating event network-changed:7f0e237c-1431-4143-8b98-9539ef44bae6 for instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 on n-h2-844627-10 Aug 04 13:55:32.384592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-9ab222ca-73b9-4eb2-8b70-a44e3f117fd0 req-df5ff75d-2b82-458d-b6f8-b4ff7fb51825 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036683 Aug 04 13:55:32.385225 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 282/577] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:32.451266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-df968562-ded2-408e-b6ab-15218744f195 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:32.453863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:32.461772 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-df968562-ded2-408e-b6ab-15218744f195 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1388 microversion: 2.1 time: 0.191811 Aug 04 13:55:32.462695 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 296/578] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:32 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1388 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:32.635655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:32.636485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:32.644069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.644681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:32.645628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.646166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:32.695766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca3d7c82-e058-4b0f-afcc-1207db5c85d3 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:32.696503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ca3d7c82-e058-4b0f-afcc-1207db5c85d3 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:32.711146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca3d7c82-e058-4b0f-afcc-1207db5c85d3 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.722301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca3d7c82-e058-4b0f-afcc-1207db5c85d3 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:32.724085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca3d7c82-e058-4b0f-afcc-1207db5c85d3 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:32.725058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca3d7c82-e058-4b0f-afcc-1207db5c85d3 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.001266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:33.021881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:33.023603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:33.030562 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-56bd3765-2c4c-4e57-bce1-30a088facbdf tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.399311 Aug 04 13:55:33.045411 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 283/579] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:32 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:33.053142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dfdf0040-b074-4a99-8c94-c2d4fd2dd5de tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:33.056085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dfdf0040-b074-4a99-8c94-c2d4fd2dd5de tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:33.068913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfdf0040-b074-4a99-8c94-c2d4fd2dd5de tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.073706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfdf0040-b074-4a99-8c94-c2d4fd2dd5de tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.074725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfdf0040-b074-4a99-8c94-c2d4fd2dd5de tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.075433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfdf0040-b074-4a99-8c94-c2d4fd2dd5de tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.289587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dfdf0040-b074-4a99-8c94-c2d4fd2dd5de tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:33.304344 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dfdf0040-b074-4a99-8c94-c2d4fd2dd5de tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1297 microversion: 2.1 time: 0.257046 Aug 04 13:55:33.316944 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 284/580] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:33 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1297 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:33.317476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7319198d-7a21-48fc-a467-07151aba7605 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:33.324101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7319198d-7a21-48fc-a467-07151aba7605 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:33.333516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7319198d-7a21-48fc-a467-07151aba7605 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.334068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7319198d-7a21-48fc-a467-07151aba7605 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.334977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7319198d-7a21-48fc-a467-07151aba7605 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.335645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7319198d-7a21-48fc-a467-07151aba7605 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.370481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ca3d7c82-e058-4b0f-afcc-1207db5c85d3 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:33.386204 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca3d7c82-e058-4b0f-afcc-1207db5c85d3 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1318 microversion: 2.1 time: 0.694188 Aug 04 13:55:33.388780 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 297/581] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:32 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:33.397799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:33.400367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:33.415742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.416517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.417680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.418951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.835349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7319198d-7a21-48fc-a467-07151aba7605 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:33.845212 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7319198d-7a21-48fc-a467-07151aba7605 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.532575 Aug 04 13:55:33.852429 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 285/582] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:33 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:33.863364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:33.864044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-98d884aa-425c-4348-8d31-f6a8d1c221c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:33.864742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-98d884aa-425c-4348-8d31-f6a8d1c221c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:33.874264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:33.874734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-98d884aa-425c-4348-8d31-f6a8d1c221c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.875427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-98d884aa-425c-4348-8d31-f6a8d1c221c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.876591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:33.877040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-98d884aa-425c-4348-8d31-f6a8d1c221c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.877905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-98d884aa-425c-4348-8d31-f6a8d1c221c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.879096 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d9f817f1-a8d2-4340-b07a-a5d7e8f076e5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.488616 Aug 04 13:55:33.880251 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 298/583] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:33 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:33.886395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b21e5111-c5f0-4159-a177-be6b2162562a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:33.888412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b21e5111-c5f0-4159-a177-be6b2162562a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:33.896411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b21e5111-c5f0-4159-a177-be6b2162562a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.897175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b21e5111-c5f0-4159-a177-be6b2162562a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:33.898261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b21e5111-c5f0-4159-a177-be6b2162562a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:33.899189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b21e5111-c5f0-4159-a177-be6b2162562a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.302823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-98d884aa-425c-4348-8d31-f6a8d1c221c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:34.311085 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-98d884aa-425c-4348-8d31-f6a8d1c221c0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.454242 Aug 04 13:55:34.314307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b21e5111-c5f0-4159-a177-be6b2162562a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:34.318042 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 286/584] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:33 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:34.332024 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b21e5111-c5f0-4159-a177-be6b2162562a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1588 microversion: 2.1 time: 0.450501 Aug 04 13:55:34.332684 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 299/585] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:33 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1588 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:34.337767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:34.338674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:34.339087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7b3cd499-a33e-4c38-848c-e8ab1c56635d tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:34.339707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7b3cd499-a33e-4c38-848c-e8ab1c56635d tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:34.348347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b3cd499-a33e-4c38-848c-e8ab1c56635d tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.348838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b3cd499-a33e-4c38-848c-e8ab1c56635d tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.350008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b3cd499-a33e-4c38-848c-e8ab1c56635d tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.350458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b3cd499-a33e-4c38-848c-e8ab1c56635d tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.351629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.352305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.353390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.353932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.460605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7b3cd499-a33e-4c38-848c-e8ab1c56635d tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:34.475334 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7b3cd499-a33e-4c38-848c-e8ab1c56635d tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1303 microversion: 2.1 time: 0.141047 Aug 04 13:55:34.485108 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 300/586] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:34 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:34.488181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:34.494861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8dcd93f4-e85e-4fc5-a3ed-ddb4a00d8c25 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:34.495372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8dcd93f4-e85e-4fc5-a3ed-ddb4a00d8c25 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:34.501855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8dcd93f4-e85e-4fc5-a3ed-ddb4a00d8c25 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.502311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8dcd93f4-e85e-4fc5-a3ed-ddb4a00d8c25 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.503733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8dcd93f4-e85e-4fc5-a3ed-ddb4a00d8c25 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.504188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8dcd93f4-e85e-4fc5-a3ed-ddb4a00d8c25 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.505800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:34.507358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:34.513174 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c7cbd8b-1aea-48fd-9d45-794d741bb66b tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.179082 Aug 04 13:55:34.525383 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 287/587] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:34 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:34.537734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88143d2a-bea1-44a6-9e7b-c51237ac1e26 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:34.538604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-88143d2a-bea1-44a6-9e7b-c51237ac1e26 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:34.547312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88143d2a-bea1-44a6-9e7b-c51237ac1e26 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.548583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88143d2a-bea1-44a6-9e7b-c51237ac1e26 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.550614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88143d2a-bea1-44a6-9e7b-c51237ac1e26 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.556479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88143d2a-bea1-44a6-9e7b-c51237ac1e26 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.832430 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8dcd93f4-e85e-4fc5-a3ed-ddb4a00d8c25 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.346433 Aug 04 13:55:34.837000 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 301/588] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 13:55:34 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a/os-interface => generated 285 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:34.866208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa1db0ae-aa71-4e7f-be93-13b3f48a3b8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:34.868453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa1db0ae-aa71-4e7f-be93-13b3f48a3b8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:34.890778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa1db0ae-aa71-4e7f-be93-13b3f48a3b8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.892563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa1db0ae-aa71-4e7f-be93-13b3f48a3b8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.894002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa1db0ae-aa71-4e7f-be93-13b3f48a3b8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.898623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa1db0ae-aa71-4e7f-be93-13b3f48a3b8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:34.957794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-88143d2a-bea1-44a6-9e7b-c51237ac1e26 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:34.969216 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-88143d2a-bea1-44a6-9e7b-c51237ac1e26 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1318 microversion: 2.1 time: 0.442540 Aug 04 13:55:34.969808 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 288/589] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:34 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:34.979430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:34.980064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:34.998381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:34.998838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:35.002394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:35.004481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:35.752348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:35.764399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:35.771074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:35.772599 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eef12d36-c880-4268-9358-025f1a475596 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.801853 Aug 04 13:55:35.773729 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 289/590] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:34 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:35.784688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff579e53-9b74-4833-b33a-f03d3d692288 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:35.787921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff579e53-9b74-4833-b33a-f03d3d692288 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:35.802637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff579e53-9b74-4833-b33a-f03d3d692288 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:35.804258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff579e53-9b74-4833-b33a-f03d3d692288 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:35.806728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff579e53-9b74-4833-b33a-f03d3d692288 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:35.807849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff579e53-9b74-4833-b33a-f03d3d692288 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:35.843174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa1db0ae-aa71-4e7f-be93-13b3f48a3b8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:35.854934 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa1db0ae-aa71-4e7f-be93-13b3f48a3b8f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.991959 Aug 04 13:55:35.856258 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 302/591] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:34 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:35.862944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-d9c1d232-8cdc-4a59-b4ec-1c9791cb095a req-e2563e12-343b-48e6-b4d9-0c1efc18a131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608bc65c-ea5b-45ed-99f1-706ba5a958e3", "name": "network-vif-plugged", "status": "completed", "tag": "31b48178-e307-4711-87aa-797381b2a7c0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:35.877120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d9c1d232-8cdc-4a59-b4ec-1c9791cb095a req-e2563e12-343b-48e6-b4d9-0c1efc18a131 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:35.878680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d9c1d232-8cdc-4a59-b4ec-1c9791cb095a req-e2563e12-343b-48e6-b4d9-0c1efc18a131 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:35.900432 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-d9c1d232-8cdc-4a59-b4ec-1c9791cb095a req-e2563e12-343b-48e6-b4d9-0c1efc18a131 service nova] Creating event network-vif-plugged:31b48178-e307-4711-87aa-797381b2a7c0 for instance 608bc65c-ea5b-45ed-99f1-706ba5a958e3 on n-h2-844627-10 Aug 04 13:55:35.907792 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-d9c1d232-8cdc-4a59-b4ec-1c9791cb095a req-e2563e12-343b-48e6-b4d9-0c1efc18a131 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049626 Aug 04 13:55:35.909221 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 303/592] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:35.946682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a2deb95-5a13-471a-a1ab-9bf29b2377e8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:35.947746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a2deb95-5a13-471a-a1ab-9bf29b2377e8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:35.967868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a2deb95-5a13-471a-a1ab-9bf29b2377e8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:35.982120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a2deb95-5a13-471a-a1ab-9bf29b2377e8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:35.982120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a2deb95-5a13-471a-a1ab-9bf29b2377e8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:35.982120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a2deb95-5a13-471a-a1ab-9bf29b2377e8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:35.990977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=26 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:36.102109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a2deb95-5a13-471a-a1ab-9bf29b2377e8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:36.115785 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a2deb95-5a13-471a-a1ab-9bf29b2377e8 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1303 microversion: 2.1 time: 0.205142 Aug 04 13:55:36.116757 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 304/593] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:35 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:36.132655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff579e53-9b74-4833-b33a-f03d3d692288 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:36.137603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:36.139216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:36.142911 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff579e53-9b74-4833-b33a-f03d3d692288 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.367121 Aug 04 13:55:36.157323 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 290/594] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:35 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:36.160809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:36.163009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:36.163496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9138f67e-4f5f-48ef-822a-7c0e383c3c2d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:36.164383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9138f67e-4f5f-48ef-822a-7c0e383c3c2d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:36.165902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:36.166676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:36.172126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9138f67e-4f5f-48ef-822a-7c0e383c3c2d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:36.173124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9138f67e-4f5f-48ef-822a-7c0e383c3c2d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:36.174246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9138f67e-4f5f-48ef-822a-7c0e383c3c2d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:36.175137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9138f67e-4f5f-48ef-822a-7c0e383c3c2d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:36.337367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:36.351264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:36.353173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:36.362904 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a649c8c-dcd2-4566-9b87-f8a4cff44049 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.244567 Aug 04 13:55:36.364707 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 305/595] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:36 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:36.382287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9138f67e-4f5f-48ef-822a-7c0e383c3c2d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:36.392346 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9138f67e-4f5f-48ef-822a-7c0e383c3c2d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1318 microversion: 2.1 time: 0.233470 Aug 04 13:55:36.404856 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 291/596] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:36 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:36.798555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:36.799163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:36.806125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:36.806516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:36.807305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:36.807764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:36.876627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7a2e88d8-dd7e-4c2d-96db-9fc814cd0ef0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:36.877208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a2e88d8-dd7e-4c2d-96db-9fc814cd0ef0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:36.888228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a2e88d8-dd7e-4c2d-96db-9fc814cd0ef0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:36.893189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a2e88d8-dd7e-4c2d-96db-9fc814cd0ef0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:36.894603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a2e88d8-dd7e-4c2d-96db-9fc814cd0ef0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:36.895603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a2e88d8-dd7e-4c2d-96db-9fc814cd0ef0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.062726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.078018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.079682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.085266 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-81cf1bc0-8b12-4184-a2fa-d5d67aa7fc70 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.290542 Aug 04 13:55:37.107374 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 306/597] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:36 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:37.145262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b57fe40c-87ff-442b-bda5-2de0cd80bd0f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:37.146166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b57fe40c-87ff-442b-bda5-2de0cd80bd0f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:37.157942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:37.160116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b57fe40c-87ff-442b-bda5-2de0cd80bd0f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.160843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b57fe40c-87ff-442b-bda5-2de0cd80bd0f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.167246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b57fe40c-87ff-442b-bda5-2de0cd80bd0f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.171712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b57fe40c-87ff-442b-bda5-2de0cd80bd0f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.182901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7a2e88d8-dd7e-4c2d-96db-9fc814cd0ef0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.193032 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7a2e88d8-dd7e-4c2d-96db-9fc814cd0ef0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.321228 Aug 04 13:55:37.196178 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 292/598] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:36 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:37.226690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a41ad97b-39b2-4f27-a3f6-cb582adef98b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:37.227563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a41ad97b-39b2-4f27-a3f6-cb582adef98b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:37.239404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a41ad97b-39b2-4f27-a3f6-cb582adef98b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.242127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a41ad97b-39b2-4f27-a3f6-cb582adef98b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.244850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a41ad97b-39b2-4f27-a3f6-cb582adef98b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.251900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a41ad97b-39b2-4f27-a3f6-cb582adef98b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.485138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b57fe40c-87ff-442b-bda5-2de0cd80bd0f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.494324 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b57fe40c-87ff-442b-bda5-2de0cd80bd0f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.359143 Aug 04 13:55:37.496816 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 307/599] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:37 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:37.508121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c716735-3232-431c-81d3-6fcd0c7cec81 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:37.509128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8c716735-3232-431c-81d3-6fcd0c7cec81 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:37.522612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c716735-3232-431c-81d3-6fcd0c7cec81 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.523431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c716735-3232-431c-81d3-6fcd0c7cec81 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.527091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c716735-3232-431c-81d3-6fcd0c7cec81 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.528435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c716735-3232-431c-81d3-6fcd0c7cec81 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.575137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a41ad97b-39b2-4f27-a3f6-cb582adef98b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.577558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:37.591940 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a41ad97b-39b2-4f27-a3f6-cb582adef98b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.381355 Aug 04 13:55:37.592900 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 293/600] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:37 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:37.611591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-04111dfe-4116-4250-b4bf-223e26974174 req-cd9ffe62-81f5-4291-91d1-7c722f380535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af05b69d-855c-42e3-b5c5-772d703fc11a", "tag": "f7209b74-7505-4bb3-b3a5-61607d4e42dc"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:37.628578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-04111dfe-4116-4250-b4bf-223e26974174 req-cd9ffe62-81f5-4291-91d1-7c722f380535 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.629308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-04111dfe-4116-4250-b4bf-223e26974174 req-cd9ffe62-81f5-4291-91d1-7c722f380535 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.644857 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-04111dfe-4116-4250-b4bf-223e26974174 req-cd9ffe62-81f5-4291-91d1-7c722f380535 service nova] Creating event network-changed:f7209b74-7505-4bb3-b3a5-61607d4e42dc for instance af05b69d-855c-42e3-b5c5-772d703fc11a on n-h2-844627-10 Aug 04 13:55:37.689017 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-04111dfe-4116-4250-b4bf-223e26974174 req-cd9ffe62-81f5-4291-91d1-7c722f380535 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081448 Aug 04 13:55:37.689986 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 294/601] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:37.695291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:37.695995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:37.719066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.719509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.720413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.726299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.756042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8c716735-3232-431c-81d3-6fcd0c7cec81 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.769197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8c716735-3232-431c-81d3-6fcd0c7cec81 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1588 microversion: 2.1 time: 0.264853 Aug 04 13:55:37.771019 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 308/602] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:37 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1588 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:37.777783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-87f94c49-4ae7-4f0e-bd94-4b83144bb1eb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:37.778723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-87f94c49-4ae7-4f0e-bd94-4b83144bb1eb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:37.787675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87f94c49-4ae7-4f0e-bd94-4b83144bb1eb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.788423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87f94c49-4ae7-4f0e-bd94-4b83144bb1eb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.789456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87f94c49-4ae7-4f0e-bd94-4b83144bb1eb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.790638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87f94c49-4ae7-4f0e-bd94-4b83144bb1eb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.931488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.947384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.949227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:37.956573 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c3922933-ccd4-4165-bf37-626c17cf467a tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.265385 Aug 04 13:55:37.957751 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 295/603] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:37 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:37.963295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5e03bd8f-8330-4e18-8786-3c97ba952955 req-7f7bce3c-f0f9-4d8f-acac-e2f3497c32a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74769383-c385-4b29-b45c-820aff3e1a77", "name": "network-vif-plugged", "status": "completed", "tag": "3936056c-899a-4fed-ae2a-e09fe32d211d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:37.975083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5e03bd8f-8330-4e18-8786-3c97ba952955 req-7f7bce3c-f0f9-4d8f-acac-e2f3497c32a2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:37.975944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5e03bd8f-8330-4e18-8786-3c97ba952955 req-7f7bce3c-f0f9-4d8f-acac-e2f3497c32a2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:37.994504 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5e03bd8f-8330-4e18-8786-3c97ba952955 req-7f7bce3c-f0f9-4d8f-acac-e2f3497c32a2 service nova] Creating event network-vif-plugged:3936056c-899a-4fed-ae2a-e09fe32d211d for instance 74769383-c385-4b29-b45c-820aff3e1a77 on n-h1-844627-10 Aug 04 13:55:38.000687 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5e03bd8f-8330-4e18-8786-3c97ba952955 req-7f7bce3c-f0f9-4d8f-acac-e2f3497c32a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041384 Aug 04 13:55:38.001632 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 296/604] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:38.116617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:38.117351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:38.138966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.138966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:38.138966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.138966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:38.338207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-87f94c49-4ae7-4f0e-bd94-4b83144bb1eb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:38.350891 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-87f94c49-4ae7-4f0e-bd94-4b83144bb1eb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1468 microversion: 2.1 time: 0.578165 Aug 04 13:55:38.351735 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 309/605] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:37 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1468 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:38.374429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ff6ca5d6-efcf-413f-980c-0ffdd6bde3c6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:38.375227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ff6ca5d6-efcf-413f-980c-0ffdd6bde3c6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:38.381808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff6ca5d6-efcf-413f-980c-0ffdd6bde3c6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.382516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff6ca5d6-efcf-413f-980c-0ffdd6bde3c6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:38.383474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff6ca5d6-efcf-413f-980c-0ffdd6bde3c6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.384058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff6ca5d6-efcf-413f-980c-0ffdd6bde3c6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:38.551305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:38.561154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:38.562847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:38.564415 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5aba3a4d-9cc7-469b-a15d-475d620c93d0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.452029 Aug 04 13:55:38.565720 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 297/606] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:38 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:38.632862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1819857392", "block_migration": true, "disk_over_commit": false}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:38.635481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:38.649493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.653084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:38.654143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.657775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:38.777035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lazy-loading 'flavor' on Instance uuid 608bc65c-ea5b-45ed-99f1-706ba5a958e3 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:55:38.782451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ff6ca5d6-efcf-413f-980c-0ffdd6bde3c6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:38.801178 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ff6ca5d6-efcf-413f-980c-0ffdd6bde3c6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.434323 Aug 04 13:55:38.802052 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 310/607] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:38 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:38.829390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a2178ee8-7f97-4c71-8d6e-9d404f0c4fa2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:38.830232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a2178ee8-7f97-4c71-8d6e-9d404f0c4fa2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:38.839458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:38.851401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2178ee8-7f97-4c71-8d6e-9d404f0c4fa2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.851877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2178ee8-7f97-4c71-8d6e-9d404f0c4fa2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:38.852687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2178ee8-7f97-4c71-8d6e-9d404f0c4fa2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.853839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2178ee8-7f97-4c71-8d6e-9d404f0c4fa2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:38.879366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Going to try to live migrate instance to tempest-host-1819857392 {{(pid=130960) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 13:55:38.888381 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] HTTP exception thrown: Compute host tempest-host-1819857392 could not be found. Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Request method failure captured: Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3/action HTTP/1.1 Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 107 Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68_EfGKQCjxinFsJshlCkaGX4vRjGVmXFPF4EiioifMlBeqSGlNcyf0BGfpaACBvztdFDt0mw0pLUKwLXpGaNmqa40vx_zFpnSI3UaYZYxbHTUE2fMmYzL5Mc3Mq2rGpsqeesa2AK1O5r6YaBGD10XMY0YXHJmbe0yXXm0VNPZVVidI Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2a5f1acb9626409282cbfcf18fa8fd30 Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-LiveMigrationNegativeTest-1929897825 Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:55:38.906283 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a5f1acb9626409282cbfcf18fa8fd30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2a5f1acb9626409282cbfcf18fa8fd30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2a5f1acb9626409282cbfcf18fa8fd30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a5f1acb9626409282cbfcf18fa8fd30"}]}] Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-LiveMigrationNegativeTest-1929897825 Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2a5f1acb9626409282cbfcf18fa8fd30 Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1929897825 Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-LiveMigrationNegativeTest-1929897825-project-admin Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 05a95aee90f74a7787ba37b80d895d01 Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-LiveMigrationNegativeTest-1929897825-project-admin Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: {"os-migrateLive": {"host": "tempest-host-1819857392", "block_migration": true, "disk_over_commit": false}} Aug 04 13:55:38.907964 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: exception: Compute host tempest-host-1819857392 could not be found. Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '608bc65c-ea5b-45ed-99f1-706ba5a958e3', 'body': {'os-migrateLive': {'host': 'tempest-host-1819857392', 'block_migration': True, 'disk_over_commit': False}}} Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 13:55:38.909067 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1819857392 could not be found. Aug 04 13:55:38.910379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1819857392 could not be found. Aug 04 13:55:38.911668 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1819857392 could not be found. Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Returning 400 to user: Compute host tempest-host-1819857392 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-61f7f890-68ef-43b1-939e-dc4e64d07823 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3/action" status: 400 len: 100 microversion: 2.1 time: 0.342491 Aug 04 13:55:38.913356 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 298/608] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Aug 4 13:55:38 2022] POST /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3/action => generated 100 bytes in 344 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:55:38.916824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d362d499-61ee-48b9-9a33-1525e8ebc620 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:38.917450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d362d499-61ee-48b9-9a33-1525e8ebc620 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:38.926008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d362d499-61ee-48b9-9a33-1525e8ebc620 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.926597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d362d499-61ee-48b9-9a33-1525e8ebc620 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:38.930038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d362d499-61ee-48b9-9a33-1525e8ebc620 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:38.930575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d362d499-61ee-48b9-9a33-1525e8ebc620 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.249612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d362d499-61ee-48b9-9a33-1525e8ebc620 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:39.252653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a2178ee8-7f97-4c71-8d6e-9d404f0c4fa2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:39.258552 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d362d499-61ee-48b9-9a33-1525e8ebc620 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.347102 Aug 04 13:55:39.260010 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 299/609] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:38 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:39.260339 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a2178ee8-7f97-4c71-8d6e-9d404f0c4fa2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.448148 Aug 04 13:55:39.261447 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 311/610] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:38 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:39.265945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-243fc12f-c6f3-419d-a187-306209e54b1d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:39.266665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-243fc12f-c6f3-419d-a187-306209e54b1d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:39.268839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:39.269737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:39.273353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-243fc12f-c6f3-419d-a187-306209e54b1d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.273802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-243fc12f-c6f3-419d-a187-306209e54b1d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.274578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-243fc12f-c6f3-419d-a187-306209e54b1d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.275184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-243fc12f-c6f3-419d-a187-306209e54b1d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.277712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.278396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.279184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.280032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.364830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:39.387683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:39.389309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:39.394752 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-59922f78-ca1e-442a-ae25-de81472faa32 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.131449 Aug 04 13:55:39.395340 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 312/611] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:39 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:39.464320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-243fc12f-c6f3-419d-a187-306209e54b1d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:39.472957 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-243fc12f-c6f3-419d-a187-306209e54b1d tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1468 microversion: 2.1 time: 0.211221 Aug 04 13:55:39.473585 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 300/612] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:39 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1468 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:39.558715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-361695249", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:39.587498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:39.589541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:39.596170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=10 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:39.597529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=19 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:39.600479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.601260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.602670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.603285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.624709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:55:39.825444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:39.838853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:39.842279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:39.844164 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-47f54b41-140c-463e-8713-39a6b0f9e5f6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.260210 Aug 04 13:55:39.860638 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 301/613] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:39 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:39.865995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eb3e6e09-e032-41aa-ab6f-d59898b173d6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:39.866597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eb3e6e09-e032-41aa-ab6f-d59898b173d6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:39.873503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb3e6e09-e032-41aa-ab6f-d59898b173d6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.874027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb3e6e09-e032-41aa-ab6f-d59898b173d6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.874749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb3e6e09-e032-41aa-ab6f-d59898b173d6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.875192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb3e6e09-e032-41aa-ab6f-d59898b173d6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.974484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:39.974770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:39.975250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:39.975680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:39.976086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:39.991012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.991603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:39.992593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:39.993219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:40.015413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Getting quotas for project 9897fe3193ba44d683cac4a1d4381158. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:55:40.020168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Getting quotas for user 962006014e414681a9ccf556eaa7162b and project 9897fe3193ba44d683cac4a1d4381158. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:55:40.033572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:55:40.035898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:55:40.071387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eb3e6e09-e032-41aa-ab6f-d59898b173d6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:40.087305 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eb3e6e09-e032-41aa-ab6f-d59898b173d6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.225272 Aug 04 13:55:40.088259 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 302/614] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:39 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:40.095919 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e19ea47f-1e37-4e2c-9cab-300d511cc383 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540978 Aug 04 13:55:40.097287 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 313/615] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:55:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:55:40.112552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e07eaa7c-65ef-4b69-917f-687b9563b447 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:40.128856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e07eaa7c-65ef-4b69-917f-687b9563b447 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:40.187637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e07eaa7c-65ef-4b69-917f-687b9563b447 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:40.195613 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e07eaa7c-65ef-4b69-917f-687b9563b447 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1218 microversion: 2.1 time: 0.091675 Aug 04 13:55:40.196951 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 303/616] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:40 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:40.282966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-071be0c1-d7f8-44af-b6fa-510133d68072 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:40.283592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-071be0c1-d7f8-44af-b6fa-510133d68072 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:40.287412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-433cbfb1-803c-464d-a5f0-dbc7ca837030 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:40.288900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-433cbfb1-803c-464d-a5f0-dbc7ca837030 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:40.291500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-071be0c1-d7f8-44af-b6fa-510133d68072 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:40.291952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-071be0c1-d7f8-44af-b6fa-510133d68072 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:40.292764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-071be0c1-d7f8-44af-b6fa-510133d68072 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:40.293696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-071be0c1-d7f8-44af-b6fa-510133d68072 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:40.293907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:40.298682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-433cbfb1-803c-464d-a5f0-dbc7ca837030 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:40.298827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-433cbfb1-803c-464d-a5f0-dbc7ca837030 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:40.305006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-433cbfb1-803c-464d-a5f0-dbc7ca837030 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:40.306462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-433cbfb1-803c-464d-a5f0-dbc7ca837030 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:40.536629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-071be0c1-d7f8-44af-b6fa-510133d68072 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:40.547958 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-071be0c1-d7f8-44af-b6fa-510133d68072 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.269127 Aug 04 13:55:40.552670 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 314/617] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:40 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:40.557695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:40.570436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:40.571657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-433cbfb1-803c-464d-a5f0-dbc7ca837030 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:40.580089 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-433cbfb1-803c-464d-a5f0-dbc7ca837030 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.297920 Aug 04 13:55:40.594272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:40.595072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:40.595326 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 304/618] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:40 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:40.596719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:40.597547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:40.603355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:40.692931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:40.702112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:40.703756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:40.709268 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c15aa0e1-c14b-4c58-9b1f-4c8fc842d3d2 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.155247 Aug 04 13:55:40.709848 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 315/619] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:40 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:40.868535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:40.869271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:40.876098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:40.876544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:40.877714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:40.878153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.060944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:41.073846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:41.075775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:41.077111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e9dd544a-4b8f-41db-a3f0-4f914f9a52cf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.213218 Aug 04 13:55:41.078118 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 305/620] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:40 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:41.109545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-481fab27-af77-453e-bcdd-fcf84630ffa4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:41.110081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-481fab27-af77-453e-bcdd-fcf84630ffa4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:41.118237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-481fab27-af77-453e-bcdd-fcf84630ffa4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.118695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-481fab27-af77-453e-bcdd-fcf84630ffa4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.119719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-481fab27-af77-453e-bcdd-fcf84630ffa4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.120159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-481fab27-af77-453e-bcdd-fcf84630ffa4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.218810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0b05c8f1-6e41-47e8-87dd-16468682b1e2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:41.219539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0b05c8f1-6e41-47e8-87dd-16468682b1e2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:41.226599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b05c8f1-6e41-47e8-87dd-16468682b1e2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.227434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b05c8f1-6e41-47e8-87dd-16468682b1e2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.228437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b05c8f1-6e41-47e8-87dd-16468682b1e2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.229129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b05c8f1-6e41-47e8-87dd-16468682b1e2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.282654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-481fab27-af77-453e-bcdd-fcf84630ffa4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:41.295070 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-481fab27-af77-453e-bcdd-fcf84630ffa4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.190745 Aug 04 13:55:41.296091 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 316/621] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:41 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:41.314843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0b05c8f1-6e41-47e8-87dd-16468682b1e2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:41.324124 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0b05c8f1-6e41-47e8-87dd-16468682b1e2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1270 microversion: 2.1 time: 0.109551 Aug 04 13:55:41.329739 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 306/622] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:41 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1270 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:41.573544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-25b690a5-7c3f-4db4-9841-8938b513b00c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:41.574848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-25b690a5-7c3f-4db4-9841-8938b513b00c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:41.584297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25b690a5-7c3f-4db4-9841-8938b513b00c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.584751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25b690a5-7c3f-4db4-9841-8938b513b00c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.586890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25b690a5-7c3f-4db4-9841-8938b513b00c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.587375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25b690a5-7c3f-4db4-9841-8938b513b00c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.604836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-65697838-49d3-4b4e-813f-a01d5f3eda2f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:41.606729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-65697838-49d3-4b4e-813f-a01d5f3eda2f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:41.619922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65697838-49d3-4b4e-813f-a01d5f3eda2f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.620731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65697838-49d3-4b4e-813f-a01d5f3eda2f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.621804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65697838-49d3-4b4e-813f-a01d5f3eda2f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.622458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65697838-49d3-4b4e-813f-a01d5f3eda2f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.896699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-25b690a5-7c3f-4db4-9841-8938b513b00c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:41.905448 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-25b690a5-7c3f-4db4-9841-8938b513b00c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.335659 Aug 04 13:55:41.906473 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 317/623] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:41 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:41.923123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:41.923783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:41.935592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.936149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.936832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:41.937307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:41.944443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-65697838-49d3-4b4e-813f-a01d5f3eda2f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:41.961019 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-65697838-49d3-4b4e-813f-a01d5f3eda2f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.361718 Aug 04 13:55:41.963664 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 307/624] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:41 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:42.059594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:42.073655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:42.077478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:42.084817 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aaeb65e3-8a53-4429-8137-09a3d4fc1c35 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.176791 Aug 04 13:55:42.085637 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 318/625] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:41 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:42.108475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:42.109248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:42.116466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:42.116926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:42.117757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:42.118231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:42.316327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4347d50-7383-4bba-a32d-a5abde5f6bf5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:42.317172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b4347d50-7383-4bba-a32d-a5abde5f6bf5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:42.327040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4347d50-7383-4bba-a32d-a5abde5f6bf5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:42.327494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4347d50-7383-4bba-a32d-a5abde5f6bf5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:42.328337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4347d50-7383-4bba-a32d-a5abde5f6bf5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:42.328784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4347d50-7383-4bba-a32d-a5abde5f6bf5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:42.367449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:42.384437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:42.386608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:42.388637 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-27917192-899e-4e5f-82ef-3f9f9b43f95d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.286525 Aug 04 13:55:42.403188 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 308/626] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:42 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:42.408788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77b5aec3-f09c-420d-ab2a-364738d30325 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:42.409523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-77b5aec3-f09c-420d-ab2a-364738d30325 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:42.418608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77b5aec3-f09c-420d-ab2a-364738d30325 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:42.419326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77b5aec3-f09c-420d-ab2a-364738d30325 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:42.421563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77b5aec3-f09c-420d-ab2a-364738d30325 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:42.422380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77b5aec3-f09c-420d-ab2a-364738d30325 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:42.532625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-77b5aec3-f09c-420d-ab2a-364738d30325 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:42.541559 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-77b5aec3-f09c-420d-ab2a-364738d30325 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1276 microversion: 2.1 time: 0.137172 Aug 04 13:55:42.553537 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 309/627] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:42 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:42.576277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4347d50-7383-4bba-a32d-a5abde5f6bf5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:42.585562 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4347d50-7383-4bba-a32d-a5abde5f6bf5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.273318 Aug 04 13:55:42.587238 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 319/628] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:42 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:42.931774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7be35425-9609-446b-899f-64401d30ddcd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:42.933244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7be35425-9609-446b-899f-64401d30ddcd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:42.944231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7be35425-9609-446b-899f-64401d30ddcd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:42.945190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7be35425-9609-446b-899f-64401d30ddcd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:42.946400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7be35425-9609-446b-899f-64401d30ddcd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:42.947139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7be35425-9609-446b-899f-64401d30ddcd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:42.985353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b789ab25-f0f1-453e-aa29-cf7bf165d6c1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:42.986540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b789ab25-f0f1-453e-aa29-cf7bf165d6c1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:43.017041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b789ab25-f0f1-453e-aa29-cf7bf165d6c1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.020887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b789ab25-f0f1-453e-aa29-cf7bf165d6c1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.022251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b789ab25-f0f1-453e-aa29-cf7bf165d6c1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.023032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b789ab25-f0f1-453e-aa29-cf7bf165d6c1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.560026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b789ab25-f0f1-453e-aa29-cf7bf165d6c1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:43.567045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7be35425-9609-446b-899f-64401d30ddcd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:43.567871 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b789ab25-f0f1-453e-aa29-cf7bf165d6c1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.587295 Aug 04 13:55:43.580918 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 320/629] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:42 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:43.581824 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7be35425-9609-446b-899f-64401d30ddcd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.655892 Aug 04 13:55:43.582830 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 310/630] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:42 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:43.586516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:43.587504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:43.588507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:43.589435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:43.594432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.595187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.599524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.599524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.599524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.599524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.601943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.602585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.728180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:43.736995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:43.738505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:43.743532 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c38ec63-8b6c-4fe7-b118-8e7477906cf5 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.161624 Aug 04 13:55:43.754639 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 321/631] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:43 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:43.754639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33aab912-8ccf-4100-8528-4e86d81da2dc tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:43.754639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-33aab912-8ccf-4100-8528-4e86d81da2dc tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:43.757374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33aab912-8ccf-4100-8528-4e86d81da2dc tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.757825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33aab912-8ccf-4100-8528-4e86d81da2dc tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.758593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33aab912-8ccf-4100-8528-4e86d81da2dc tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.759038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33aab912-8ccf-4100-8528-4e86d81da2dc tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.858287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:43.866203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:43.868003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:43.869130 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2d1333b-3fd8-4364-b01f-bce6f54eb5fc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.285036 Aug 04 13:55:43.869699 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 311/632] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:43 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:43.874680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c224c10-e02b-41cd-8a24-4eaaa58d6c9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:43.875284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c224c10-e02b-41cd-8a24-4eaaa58d6c9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:43.881232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c224c10-e02b-41cd-8a24-4eaaa58d6c9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.881684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c224c10-e02b-41cd-8a24-4eaaa58d6c9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.882506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c224c10-e02b-41cd-8a24-4eaaa58d6c9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:43.882941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c224c10-e02b-41cd-8a24-4eaaa58d6c9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:43.898973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:44.068933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-33aab912-8ccf-4100-8528-4e86d81da2dc tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:44.076832 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-33aab912-8ccf-4100-8528-4e86d81da2dc tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1318 microversion: 2.1 time: 0.331713 Aug 04 13:55:44.077781 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 322/633] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:43 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:44.082081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f8dd7fa9-a92b-46bf-b8e7-b3ed4ab8867e req-84b3ead4-b033-4246-8042-161552dab31b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aa0178a-7901-40f1-92af-39c4f286b8bb", "tag": "3dbce7d2-641d-41d9-8e84-8646c896ff25"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:44.092359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f8dd7fa9-a92b-46bf-b8e7-b3ed4ab8867e req-84b3ead4-b033-4246-8042-161552dab31b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:44.092894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f8dd7fa9-a92b-46bf-b8e7-b3ed4ab8867e req-84b3ead4-b033-4246-8042-161552dab31b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:44.105201 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f8dd7fa9-a92b-46bf-b8e7-b3ed4ab8867e req-84b3ead4-b033-4246-8042-161552dab31b service nova] Creating event network-changed:3dbce7d2-641d-41d9-8e84-8646c896ff25 for instance 9aa0178a-7901-40f1-92af-39c4f286b8bb on n-h2-844627-10 Aug 04 13:55:44.110629 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f8dd7fa9-a92b-46bf-b8e7-b3ed4ab8867e req-84b3ead4-b033-4246-8042-161552dab31b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031920 Aug 04 13:55:44.111577 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 323/634] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:44.199928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7c224c10-e02b-41cd-8a24-4eaaa58d6c9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:44.207603 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c224c10-e02b-41cd-8a24-4eaaa58d6c9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.336897 Aug 04 13:55:44.208181 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 312/635] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:43 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:44.590456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0ba5ba5-4984-436b-ba50-ab6fb0dc4d35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:44.591164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c0ba5ba5-4984-436b-ba50-ab6fb0dc4d35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:44.598337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0ba5ba5-4984-436b-ba50-ab6fb0dc4d35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:44.598790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0ba5ba5-4984-436b-ba50-ab6fb0dc4d35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:44.599556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0ba5ba5-4984-436b-ba50-ab6fb0dc4d35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:44.599995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0ba5ba5-4984-436b-ba50-ab6fb0dc4d35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:44.610607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2a56f3a8-9c05-4f4c-b872-12696c0da18b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:44.611214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2a56f3a8-9c05-4f4c-b872-12696c0da18b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:44.617330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a56f3a8-9c05-4f4c-b872-12696c0da18b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:44.617777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a56f3a8-9c05-4f4c-b872-12696c0da18b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:44.618544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a56f3a8-9c05-4f4c-b872-12696c0da18b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:44.618982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a56f3a8-9c05-4f4c-b872-12696c0da18b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:44.816189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c0ba5ba5-4984-436b-ba50-ab6fb0dc4d35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:44.823999 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0ba5ba5-4984-436b-ba50-ab6fb0dc4d35 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.238305 Aug 04 13:55:44.825199 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 324/636] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:44 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:44.828953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a56f3a8-9c05-4f4c-b872-12696c0da18b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:44.829710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:44.830428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:44.836490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:44.837027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:44.837774 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2a56f3a8-9c05-4f4c-b872-12696c0da18b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.230929 Aug 04 13:55:44.837913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:44.838184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:44.838729 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 313/637] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:44 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:44.893902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:44.894643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:44.901528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:44.901972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:44.902737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:44.903164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:44.906551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:44.914658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:44.916182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:44.920995 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37be7421-7fce-4d85-86e5-86171dbc72ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.094818 Aug 04 13:55:44.921567 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 325/638] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:44 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:45.032152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:45.039979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:45.041563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:45.042837 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a8b60bfe-fa35-487d-a00e-e6790746ecc7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.152766 Aug 04 13:55:45.043282 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 314/639] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:44 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:45.098369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ead4ec6-0045-402a-b4d5-a21fd2fc0fe8 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:45.098983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0ead4ec6-0045-402a-b4d5-a21fd2fc0fe8 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:45.105264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ead4ec6-0045-402a-b4d5-a21fd2fc0fe8 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:45.105729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ead4ec6-0045-402a-b4d5-a21fd2fc0fe8 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:45.106475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ead4ec6-0045-402a-b4d5-a21fd2fc0fe8 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:45.106913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ead4ec6-0045-402a-b4d5-a21fd2fc0fe8 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:45.229057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9637736c-862a-4ea9-be41-adf6dbc8ddaf tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:45.229725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9637736c-862a-4ea9-be41-adf6dbc8ddaf tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:45.236383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9637736c-862a-4ea9-be41-adf6dbc8ddaf tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:45.236808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9637736c-862a-4ea9-be41-adf6dbc8ddaf tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:45.237573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9637736c-862a-4ea9-be41-adf6dbc8ddaf tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:45.238017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9637736c-862a-4ea9-be41-adf6dbc8ddaf tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:45.239455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0ead4ec6-0045-402a-b4d5-a21fd2fc0fe8 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:45.248008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0ead4ec6-0045-402a-b4d5-a21fd2fc0fe8 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1318 microversion: 2.1 time: 0.153640 Aug 04 13:55:45.248585 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 326/640] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:45 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:45.367607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9637736c-862a-4ea9-be41-adf6dbc8ddaf tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:45.375890 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9637736c-862a-4ea9-be41-adf6dbc8ddaf tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.151033 Aug 04 13:55:45.376455 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 315/641] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:45 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:45.846466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0e9cae2-f17c-4193-89b5-2826d7dd3e30 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:45.847079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0e9cae2-f17c-4193-89b5-2826d7dd3e30 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:45.854135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0e9cae2-f17c-4193-89b5-2826d7dd3e30 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:45.854343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0e9cae2-f17c-4193-89b5-2826d7dd3e30 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:45.855119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0e9cae2-f17c-4193-89b5-2826d7dd3e30 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:45.855564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0e9cae2-f17c-4193-89b5-2826d7dd3e30 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:45.859387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-00327071-3aef-4b0f-8b41-4f57e0a31468 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:45.860112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-00327071-3aef-4b0f-8b41-4f57e0a31468 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:45.866719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00327071-3aef-4b0f-8b41-4f57e0a31468 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:45.867168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00327071-3aef-4b0f-8b41-4f57e0a31468 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:45.867928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00327071-3aef-4b0f-8b41-4f57e0a31468 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:45.868357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00327071-3aef-4b0f-8b41-4f57e0a31468 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:46.193113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-00327071-3aef-4b0f-8b41-4f57e0a31468 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.201011 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-00327071-3aef-4b0f-8b41-4f57e0a31468 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.345439 Aug 04 13:55:46.209187 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 316/642] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:45 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:46.218077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:46.218500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:46.221179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f0e9cae2-f17c-4193-89b5-2826d7dd3e30 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.224685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:46.225294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:46.226175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:46.226735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:46.229369 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0e9cae2-f17c-4193-89b5-2826d7dd3e30 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.386767 Aug 04 13:55:46.230940 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 327/643] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:45 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:46.237195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:46.238105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:46.244547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:46.245330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:46.246739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:46.247395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:46.326877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.334738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.336247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.341524 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f5da1036-bb35-4a21-ba56-564243473804 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1446 microversion: 2.75 time: 0.130770 Aug 04 13:55:46.342092 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 317/644] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:46 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:46.347082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ced96d18-fead-4b2d-8b88-19118858bf40 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:46.347680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ced96d18-fead-4b2d-8b88-19118858bf40 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:46.353697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ced96d18-fead-4b2d-8b88-19118858bf40 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:46.354138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ced96d18-fead-4b2d-8b88-19118858bf40 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:46.355042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ced96d18-fead-4b2d-8b88-19118858bf40 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:46.356095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ced96d18-fead-4b2d-8b88-19118858bf40 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:46.549846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.557905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.560006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.561262 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90a649a8-7852-420c-b84e-ebbe362b035e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.329195 Aug 04 13:55:46.561900 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 328/645] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:46 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:46.566365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bdded00e-59e0-4b15-958a-7846543ae0e0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:46.567044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bdded00e-59e0-4b15-958a-7846543ae0e0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:46.573147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bdded00e-59e0-4b15-958a-7846543ae0e0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:46.573798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bdded00e-59e0-4b15-958a-7846543ae0e0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:46.575148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bdded00e-59e0-4b15-958a-7846543ae0e0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:46.575584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bdded00e-59e0-4b15-958a-7846543ae0e0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:46.602584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ced96d18-fead-4b2d-8b88-19118858bf40 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.612242 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ced96d18-fead-4b2d-8b88-19118858bf40 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1318 microversion: 2.1 time: 0.269102 Aug 04 13:55:46.613128 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 318/646] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:46 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:46.703515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bdded00e-59e0-4b15-958a-7846543ae0e0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:46.710984 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bdded00e-59e0-4b15-958a-7846543ae0e0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.148082 Aug 04 13:55:46.711541 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 329/647] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:46 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:47.221914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2b7a56cd-24fd-4e8f-a0c7-8d96189d6571 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:47.222710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2b7a56cd-24fd-4e8f-a0c7-8d96189d6571 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:47.229416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b7a56cd-24fd-4e8f-a0c7-8d96189d6571 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.229997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b7a56cd-24fd-4e8f-a0c7-8d96189d6571 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.231461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b7a56cd-24fd-4e8f-a0c7-8d96189d6571 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.232002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b7a56cd-24fd-4e8f-a0c7-8d96189d6571 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.261939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b7002fb1-9098-49e7-843a-a0f607f42bee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:47.267719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b7002fb1-9098-49e7-843a-a0f607f42bee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:47.289685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7002fb1-9098-49e7-843a-a0f607f42bee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.290439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7002fb1-9098-49e7-843a-a0f607f42bee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.291405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7002fb1-9098-49e7-843a-a0f607f42bee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.294704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7002fb1-9098-49e7-843a-a0f607f42bee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.621593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2b7a56cd-24fd-4e8f-a0c7-8d96189d6571 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:47.630200 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2b7a56cd-24fd-4e8f-a0c7-8d96189d6571 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.412062 Aug 04 13:55:47.631359 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 319/648] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:47 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:47.636160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:47.637081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:47.643593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.644084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.645915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.647078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.669639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7002fb1-9098-49e7-843a-a0f607f42bee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:47.678318 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b7002fb1-9098-49e7-843a-a0f607f42bee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1471 microversion: 2.1 time: 0.432045 Aug 04 13:55:47.678927 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 330/649] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:47 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1471 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:47.685731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:47.686259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:47.701788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.703320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.704318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.704954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.761346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:47.785461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:47.790722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:47.809608 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-beaedd19-6b25-41d4-8e1b-f8946177f726 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1452 microversion: 2.75 time: 0.174014 Aug 04 13:55:47.811980 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 320/650] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:47 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:47.823189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-55df8946-572b-44a4-9937-45544a0e043a tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:47.826172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-55df8946-572b-44a4-9937-45544a0e043a tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:47.836778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55df8946-572b-44a4-9937-45544a0e043a tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.837309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55df8946-572b-44a4-9937-45544a0e043a tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.838054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55df8946-572b-44a4-9937-45544a0e043a tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:47.838484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55df8946-572b-44a4-9937-45544a0e043a tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:47.979835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:47.990603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:47.992413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:47.993818 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4cc1829c-1f47-4ed7-a671-d4802f66019e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.314055 Aug 04 13:55:48.009104 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 331/651] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:47 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:48.014474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ffadf90-ae2d-49fd-b70a-a08023333fcb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:48.015092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ffadf90-ae2d-49fd-b70a-a08023333fcb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:48.021222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ffadf90-ae2d-49fd-b70a-a08023333fcb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:48.021680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ffadf90-ae2d-49fd-b70a-a08023333fcb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:48.022471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ffadf90-ae2d-49fd-b70a-a08023333fcb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:48.023143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ffadf90-ae2d-49fd-b70a-a08023333fcb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:48.037324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-55df8946-572b-44a4-9937-45544a0e043a tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:48.040198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:48.047327 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-55df8946-572b-44a4-9937-45544a0e043a tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1318 microversion: 2.1 time: 0.234652 Aug 04 13:55:48.057873 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 321/652] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:47 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:48.096892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ca01c172-ba22-4063-b2fc-ab3f5b1534d3 req-9565ad97-1ef5-466d-8202-3073a1dbd83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9e1d4b-b8b1-44de-9409-65db8223e4b2", "tag": "dddc2305-f311-4ae1-af98-ee954b3cd677"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:48.107724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ca01c172-ba22-4063-b2fc-ab3f5b1534d3 req-9565ad97-1ef5-466d-8202-3073a1dbd83f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:48.108301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ca01c172-ba22-4063-b2fc-ab3f5b1534d3 req-9565ad97-1ef5-466d-8202-3073a1dbd83f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:48.119375 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ca01c172-ba22-4063-b2fc-ab3f5b1534d3 req-9565ad97-1ef5-466d-8202-3073a1dbd83f service nova] Creating event network-changed:dddc2305-f311-4ae1-af98-ee954b3cd677 for instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 on n-h1-844627-10 Aug 04 13:55:48.126598 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ca01c172-ba22-4063-b2fc-ab3f5b1534d3 req-9565ad97-1ef5-466d-8202-3073a1dbd83f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033529 Aug 04 13:55:48.127363 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 322/653] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:48.173130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ffadf90-ae2d-49fd-b70a-a08023333fcb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:48.180819 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ffadf90-ae2d-49fd-b70a-a08023333fcb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1313 microversion: 2.1 time: 0.170234 Aug 04 13:55:48.181425 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 332/654] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:48 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:48.651555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aee0e1db-1db3-4d06-bda1-f2361950ce83 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:48.652761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aee0e1db-1db3-4d06-bda1-f2361950ce83 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:48.659835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aee0e1db-1db3-4d06-bda1-f2361950ce83 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:48.660290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aee0e1db-1db3-4d06-bda1-f2361950ce83 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:48.661097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aee0e1db-1db3-4d06-bda1-f2361950ce83 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:48.661536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aee0e1db-1db3-4d06-bda1-f2361950ce83 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:48.699002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cc3b9c2b-f2c3-4d5d-8bad-27a752949843 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:48.700325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cc3b9c2b-f2c3-4d5d-8bad-27a752949843 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:48.707766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc3b9c2b-f2c3-4d5d-8bad-27a752949843 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:48.708218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc3b9c2b-f2c3-4d5d-8bad-27a752949843 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:48.709016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc3b9c2b-f2c3-4d5d-8bad-27a752949843 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:48.709454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc3b9c2b-f2c3-4d5d-8bad-27a752949843 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:48.875786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aee0e1db-1db3-4d06-bda1-f2361950ce83 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:48.885763 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aee0e1db-1db3-4d06-bda1-f2361950ce83 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.238359 Aug 04 13:55:48.887506 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 323/655] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:48 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:48.894574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:48.895530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:48.902389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:48.902844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:48.903744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:48.904055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:48.910143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cc3b9c2b-f2c3-4d5d-8bad-27a752949843 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:48.920132 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cc3b9c2b-f2c3-4d5d-8bad-27a752949843 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1476 microversion: 2.1 time: 0.224750 Aug 04 13:55:48.920819 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 333/656] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:48 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:48.968881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:48.976803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:48.978344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:48.983656 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b95791a-692e-43ff-a18b-865b674a0427 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1452 microversion: 2.75 time: 0.094424 Aug 04 13:55:48.984216 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 324/657] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:48 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:49.015364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:49.016084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:49.022121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.022567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.023338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.023777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.069585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fc6a5ab5-2d13-475f-a260-fe485b26abcb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:49.070269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fc6a5ab5-2d13-475f-a260-fe485b26abcb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:49.076597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc6a5ab5-2d13-475f-a260-fe485b26abcb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.077082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc6a5ab5-2d13-475f-a260-fe485b26abcb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.077838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc6a5ab5-2d13-475f-a260-fe485b26abcb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.078266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc6a5ab5-2d13-475f-a260-fe485b26abcb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.326458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:49.341072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:49.343112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:49.346152 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c1c93c21-3381-4d56-a4d3-41e54b0538c6 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.334203 Aug 04 13:55:49.347200 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 334/658] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:49 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:49.354200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab70b74e-de29-487d-9e36-4f9f94849429 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:49.355044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ab70b74e-de29-487d-9e36-4f9f94849429 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:49.365292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab70b74e-de29-487d-9e36-4f9f94849429 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.365893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab70b74e-de29-487d-9e36-4f9f94849429 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.382780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab70b74e-de29-487d-9e36-4f9f94849429 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.383575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab70b74e-de29-487d-9e36-4f9f94849429 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.624211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fc6a5ab5-2d13-475f-a260-fe485b26abcb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:49.631823 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fc6a5ab5-2d13-475f-a260-fe485b26abcb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1318 microversion: 2.1 time: 0.565984 Aug 04 13:55:49.632405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 325/659] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:49 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:49.648661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-bc281a63-1311-41ae-b49e-17258cd6cb3a req-fba94eb3-639d-4acc-9115-d0c563a7c95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa0178a-7901-40f1-92af-39c4f286b8bb", "name": "network-vif-plugged", "status": "completed", "tag": "3dbce7d2-641d-41d9-8e84-8646c896ff25"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:49.662022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bc281a63-1311-41ae-b49e-17258cd6cb3a req-fba94eb3-639d-4acc-9115-d0c563a7c95a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.662699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bc281a63-1311-41ae-b49e-17258cd6cb3a req-fba94eb3-639d-4acc-9115-d0c563a7c95a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.695885 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-bc281a63-1311-41ae-b49e-17258cd6cb3a req-fba94eb3-639d-4acc-9115-d0c563a7c95a service nova] Creating event network-vif-plugged:3dbce7d2-641d-41d9-8e84-8646c896ff25 for instance 9aa0178a-7901-40f1-92af-39c4f286b8bb on n-h2-844627-10 Aug 04 13:55:49.701836 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-bc281a63-1311-41ae-b49e-17258cd6cb3a req-fba94eb3-639d-4acc-9115-d0c563a7c95a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057173 Aug 04 13:55:49.703468 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 326/660] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:49.796133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ab70b74e-de29-487d-9e36-4f9f94849429 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:49.804015 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ab70b74e-de29-487d-9e36-4f9f94849429 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1463 microversion: 2.1 time: 0.454503 Aug 04 13:55:49.804584 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 335/661] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:49 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1463 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:49.909826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6a80cc7-d4fe-427e-be4b-393d67d6f43f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:49.910614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a6a80cc7-d4fe-427e-be4b-393d67d6f43f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:49.916927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6a80cc7-d4fe-427e-be4b-393d67d6f43f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.917412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6a80cc7-d4fe-427e-be4b-393d67d6f43f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.918230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6a80cc7-d4fe-427e-be4b-393d67d6f43f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.918671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6a80cc7-d4fe-427e-be4b-393d67d6f43f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.953014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-13f76972-ebd2-4efa-8ee1-96dc4716d17a tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:49.958799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-13f76972-ebd2-4efa-8ee1-96dc4716d17a tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Searching by: {'deleted': False, 'project_id': '09fd58c763834d40b50d22870ab094dc'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 13:55:49.969780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13f76972-ebd2-4efa-8ee1-96dc4716d17a tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.970849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13f76972-ebd2-4efa-8ee1-96dc4716d17a tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:49.971876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13f76972-ebd2-4efa-8ee1-96dc4716d17a tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:49.972532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13f76972-ebd2-4efa-8ee1-96dc4716d17a tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.008066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:50.028321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:50.055363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6a80cc7-d4fe-427e-be4b-393d67d6f43f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:50.062743 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a6a80cc7-d4fe-427e-be4b-393d67d6f43f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.156731 Aug 04 13:55:50.063309 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 336/662] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:49 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:50.076582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af2573cc-12eb-46da-891e-dac8a5770154 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:50.076582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af2573cc-12eb-46da-891e-dac8a5770154 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:50.076582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2573cc-12eb-46da-891e-dac8a5770154 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.076905 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-13f76972-ebd2-4efa-8ee1-96dc4716d17a tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.249618 Aug 04 13:55:50.077006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2573cc-12eb-46da-891e-dac8a5770154 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.077086 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 327/663] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:55:49 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:55:50.077160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2573cc-12eb-46da-891e-dac8a5770154 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.077160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2573cc-12eb-46da-891e-dac8a5770154 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.080755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:50.081746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:50.087567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.088023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.089908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.090051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.173567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:50.181883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:50.183406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:50.188437 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4f99a1cf-53fe-4b52-a9e5-8a68d0546fa8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1452 microversion: 2.75 time: 0.111776 Aug 04 13:55:50.189039 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 328/664] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:50 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:50.193438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:50.199303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Searching by: {'deleted': False} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 13:55:50.200859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:50.205009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.205454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.206238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.206665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.235880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-af2573cc-12eb-46da-891e-dac8a5770154 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:50.243417 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af2573cc-12eb-46da-891e-dac8a5770154 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1476 microversion: 2.1 time: 0.179155 Aug 04 13:55:50.243987 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 337/665] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:50 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:50.248691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-bb0f7ba5-da7c-4bae-92d0-193dc6abdfb9 req-2fe6df4a-a709-43a6-8d91-896effc08eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3861160-fd38-4411-9578-cbe56e26a0f7", "name": "network-vif-unplugged", "status": "completed", "tag": "00402c6c-b47f-4ddd-a152-4636377d16c8"}, {"name": "network-changed", "server_uuid": "d3861160-fd38-4411-9578-cbe56e26a0f7", "tag": "00402c6c-b47f-4ddd-a152-4636377d16c8"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:50.258490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bb0f7ba5-da7c-4bae-92d0-193dc6abdfb9 req-2fe6df4a-a709-43a6-8d91-896effc08eea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.258937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bb0f7ba5-da7c-4bae-92d0-193dc6abdfb9 req-2fe6df4a-a709-43a6-8d91-896effc08eea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.269964 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bb0f7ba5-da7c-4bae-92d0-193dc6abdfb9 req-2fe6df4a-a709-43a6-8d91-896effc08eea service nova] Creating event network-vif-unplugged:00402c6c-b47f-4ddd-a152-4636377d16c8 for instance d3861160-fd38-4411-9578-cbe56e26a0f7 on n-h2-844627-10 Aug 04 13:55:50.270472 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bb0f7ba5-da7c-4bae-92d0-193dc6abdfb9 req-2fe6df4a-a709-43a6-8d91-896effc08eea service nova] Creating event network-changed:00402c6c-b47f-4ddd-a152-4636377d16c8 for instance d3861160-fd38-4411-9578-cbe56e26a0f7 on n-h2-844627-10 Aug 04 13:55:50.275591 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-bb0f7ba5-da7c-4bae-92d0-193dc6abdfb9 req-2fe6df4a-a709-43a6-8d91-896effc08eea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.030502 Aug 04 13:55:50.276367 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 338/666] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:50.319626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 13:55:50.375736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:50.376081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:50.382406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.382982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.383857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.384430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.556833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:50.566046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:50.567577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:50.568762 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-140ad6cc-3b17-46f5-91f9-7389363acef0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.198500 Aug 04 13:55:50.569356 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 339/667] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:50 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:50.613067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.613512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.652086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-40e2376f-28bd-4961-a131-955b88a84a19 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:50.652706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-40e2376f-28bd-4961-a131-955b88a84a19 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:50.659195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40e2376f-28bd-4961-a131-955b88a84a19 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.659647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40e2376f-28bd-4961-a131-955b88a84a19 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.660417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40e2376f-28bd-4961-a131-955b88a84a19 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:50.660853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40e2376f-28bd-4961-a131-955b88a84a19 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:50.856164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-40e2376f-28bd-4961-a131-955b88a84a19 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:50.864081 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-40e2376f-28bd-4961-a131-955b88a84a19 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1318 microversion: 2.1 time: 0.215764 Aug 04 13:55:50.864661 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 340/668] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:50 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:51.083916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8402aa85-4936-4101-9353-3148332c2a5f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.084544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8402aa85-4936-4101-9353-3148332c2a5f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:51.091576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8402aa85-4936-4101-9353-3148332c2a5f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.092056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8402aa85-4936-4101-9353-3148332c2a5f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.092827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8402aa85-4936-4101-9353-3148332c2a5f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.093349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8402aa85-4936-4101-9353-3148332c2a5f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.153757 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-38317661-e1de-4161-8725-8a1b982d21f8 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19434 microversion: 2.1 time: 0.963614 Aug 04 13:55:51.154797 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 329/669] 10.222.0.66 () {58 vars in 1171 bytes} [Thu Aug 4 13:55:50 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19434 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:55:51.193533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6466640f-7c01-4995-bfc7-36e042743887 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.198777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6466640f-7c01-4995-bfc7-36e042743887 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Searching by: {'deleted': False, 'project_id': '09fd58c763834d40b50d22870ab094dc'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 13:55:51.204886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6466640f-7c01-4995-bfc7-36e042743887 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.205356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6466640f-7c01-4995-bfc7-36e042743887 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.206156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6466640f-7c01-4995-bfc7-36e042743887 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.206591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6466640f-7c01-4995-bfc7-36e042743887 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.236716 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6466640f-7c01-4995-bfc7-36e042743887 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?tenant_id=7b30c782fc334aa19f39ac3178b29a17" status: 200 len: 15 microversion: 2.1 time: 0.046799 Aug 04 13:55:51.237311 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 330/670] 10.222.0.66 () {58 vars in 1231 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers/detail?tenant_id=7b30c782fc334aa19f39ac3178b29a17 => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:55:51.241974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.243102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:51.249669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.250126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.250913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.251435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.256974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:51.285475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8402aa85-4936-4101-9353-3148332c2a5f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:51.293795 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8402aa85-4936-4101-9353-3148332c2a5f tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.213705 Aug 04 13:55:51.294748 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 341/671] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:51.298950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.306418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Searching by: {'tenant_id': '7b30c782fc334aa19f39ac3178b29a17', 'deleted': False} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 13:55:51.313153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.313645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.314454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.314898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.318259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:51.326462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:51.327986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:51.332982 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-95b9be8f-885c-450f-ae74-157eb2fc5f7c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1452 microversion: 2.75 time: 0.094617 Aug 04 13:55:51.333547 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 331/672] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:51.337898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4b8ff74e-dc87-450e-864e-407a54243630 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.338496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4b8ff74e-dc87-450e-864e-407a54243630 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:51.344102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b8ff74e-dc87-450e-864e-407a54243630 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.344545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b8ff74e-dc87-450e-864e-407a54243630 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.345354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b8ff74e-dc87-450e-864e-407a54243630 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.345775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b8ff74e-dc87-450e-864e-407a54243630 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.416342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 13:55:51.544707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.545723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.559230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4b8ff74e-dc87-450e-864e-407a54243630 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:51.567221 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4b8ff74e-dc87-450e-864e-407a54243630 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1476 microversion: 2.1 time: 0.232689 Aug 04 13:55:51.567889 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 332/673] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:51.592781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.593601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:51.601781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.602245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.603035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.603476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.688635 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e66936ac-f1e8-4f15-8d5b-31873c5d96a6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7b30c782fc334aa19f39ac3178b29a17" status: 200 len: 4832 microversion: 2.1 time: 0.393020 Aug 04 13:55:51.689273 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 342/674] 10.222.0.66 () {58 vars in 1257 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7b30c782fc334aa19f39ac3178b29a17 => generated 4832 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:51.713943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd51115d-c0c1-42a7-b056-22c15b65ebab tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.720226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd51115d-c0c1-42a7-b056-22c15b65ebab tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Searching by: {'tenant_id': '09fd58c763834d40b50d22870ab094dc', 'deleted': False} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 13:55:51.725082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd51115d-c0c1-42a7-b056-22c15b65ebab tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.725528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd51115d-c0c1-42a7-b056-22c15b65ebab tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.726314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd51115d-c0c1-42a7-b056-22c15b65ebab tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.726739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd51115d-c0c1-42a7-b056-22c15b65ebab tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.751211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:51.755579 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd51115d-c0c1-42a7-b056-22c15b65ebab tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=09fd58c763834d40b50d22870ab094dc" status: 200 len: 15 microversion: 2.1 time: 0.045992 Aug 04 13:55:51.756155 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 343/675] 10.222.0.66 () {58 vars in 1257 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=09fd58c763834d40b50d22870ab094dc => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:55:51.759568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:51.761115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:51.762909 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-90920ae0-fa4c-4a42-b226-b7e0a43a3b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.175272 Aug 04 13:55:51.763695 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 333/676] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:51.776830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4afd7218-4150-4044-950f-eb44a01e53da tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.782160 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4afd7218-4150-4044-950f-eb44a01e53da tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008942 Aug 04 13:55:51.782688 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 344/677] 10.222.0.66 () {58 vars in 1189 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:55:51.801548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0babfd7d-b3ef-4e7c-9941-4641d331b2a4 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:51.803866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0babfd7d-b3ef-4e7c-9941-4641d331b2a4 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:51.811395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0babfd7d-b3ef-4e7c-9941-4641d331b2a4 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.812096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0babfd7d-b3ef-4e7c-9941-4641d331b2a4 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.812781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0babfd7d-b3ef-4e7c-9941-4641d331b2a4 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.813261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0babfd7d-b3ef-4e7c-9941-4641d331b2a4 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.888772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6c3360cf-85ce-4e22-a0a4-0e5a38c5e4bf tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.889687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6c3360cf-85ce-4e22-a0a4-0e5a38c5e4bf tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:51.896195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c3360cf-85ce-4e22-a0a4-0e5a38c5e4bf tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.896929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c3360cf-85ce-4e22-a0a4-0e5a38c5e4bf tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.898075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c3360cf-85ce-4e22-a0a4-0e5a38c5e4bf tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.898510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c3360cf-85ce-4e22-a0a4-0e5a38c5e4bf tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.972243 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0babfd7d-b3ef-4e7c-9941-4641d331b2a4 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action" status: 202 len: 0 microversion: 2.1 time: 0.174290 Aug 04 13:55:51.975826 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 334/678] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:55:51 2022] POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:55:51.982175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e0f9916a-5810-455b-93a0-3615af37e2d5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:51.986989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e0f9916a-5810-455b-93a0-3615af37e2d5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:51.990556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e0f9916a-5810-455b-93a0-3615af37e2d5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '7b30c782fc334aa19f39ac3178b29a17'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 13:55:51.998019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f9916a-5810-455b-93a0-3615af37e2d5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.998509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f9916a-5810-455b-93a0-3615af37e2d5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:51.999376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f9916a-5810-455b-93a0-3615af37e2d5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:51.999817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f9916a-5810-455b-93a0-3615af37e2d5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.086263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-e0f9916a-5810-455b-93a0-3615af37e2d5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 13:55:52.086403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6c3360cf-85ce-4e22-a0a4-0e5a38c5e4bf tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:52.094491 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6c3360cf-85ce-4e22-a0a4-0e5a38c5e4bf tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1468 microversion: 2.1 time: 0.210733 Aug 04 13:55:52.095343 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 345/679] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:52.115191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4c1f8d14-5755-4bb5-af32-a2ba21cd13cf tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:52.115749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c1f8d14-5755-4bb5-af32-a2ba21cd13cf tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:52.122405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c1f8d14-5755-4bb5-af32-a2ba21cd13cf tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.122850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c1f8d14-5755-4bb5-af32-a2ba21cd13cf tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.123642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c1f8d14-5755-4bb5-af32-a2ba21cd13cf tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.124083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c1f8d14-5755-4bb5-af32-a2ba21cd13cf tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.148266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-4c1f8d14-5755-4bb5-af32-a2ba21cd13cf tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lazy-loading 'flavor' on Instance uuid 9aa0178a-7901-40f1-92af-39c4f286b8bb {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:55:52.150191 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e0f9916a-5810-455b-93a0-3615af37e2d5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.173095 Aug 04 13:55:52.150788 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 335/680] 10.222.0.66 () {58 vars in 1150 bytes} [Thu Aug 4 13:55:51 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:55:52.162976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0064cf4a-7533-45c7-bb39-de7ef38f6708 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:52.165273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0064cf4a-7533-45c7-bb39-de7ef38f6708 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:52.171584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0064cf4a-7533-45c7-bb39-de7ef38f6708 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.171972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0064cf4a-7533-45c7-bb39-de7ef38f6708 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.172783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0064cf4a-7533-45c7-bb39-de7ef38f6708 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.173254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0064cf4a-7533-45c7-bb39-de7ef38f6708 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.223582 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4c1f8d14-5755-4bb5-af32-a2ba21cd13cf tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb/action" status: 202 len: 0 microversion: 2.1 time: 0.112131 Aug 04 13:55:52.228787 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 346/681] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:55:52 2022] POST /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:55:52.234629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-444b8e6c-298e-4f71-a995-e1f4751eae92 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:52.235546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-444b8e6c-298e-4f71-a995-e1f4751eae92 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:52.242141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444b8e6c-298e-4f71-a995-e1f4751eae92 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.242591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444b8e6c-298e-4f71-a995-e1f4751eae92 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.243372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444b8e6c-298e-4f71-a995-e1f4751eae92 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.243810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444b8e6c-298e-4f71-a995-e1f4751eae92 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.253020 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0064cf4a-7533-45c7-bb39-de7ef38f6708 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action" status: 202 len: 0 microversion: 2.1 time: 0.093354 Aug 04 13:55:52.256834 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 336/682] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:55:52 2022] POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:55:52.262106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-24c5ec1c-00a7-40fd-a324-fd5f1033eef6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:52.262718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-24c5ec1c-00a7-40fd-a324-fd5f1033eef6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:52.268667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-24c5ec1c-00a7-40fd-a324-fd5f1033eef6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.269131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-24c5ec1c-00a7-40fd-a324-fd5f1033eef6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.269896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-24c5ec1c-00a7-40fd-a324-fd5f1033eef6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.270324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-24c5ec1c-00a7-40fd-a324-fd5f1033eef6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.470486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-444b8e6c-298e-4f71-a995-e1f4751eae92 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:52.478084 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-444b8e6c-298e-4f71-a995-e1f4751eae92 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1476 microversion: 2.1 time: 0.247782 Aug 04 13:55:52.478741 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 347/683] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:52 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:52.483828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76206549-2081-4d45-8a66-52ef888c7c0e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:52.484444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76206549-2081-4d45-8a66-52ef888c7c0e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:52.487281 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-24c5ec1c-00a7-40fd-a324-fd5f1033eef6 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1616 microversion: 2.1 time: 0.228979 Aug 04 13:55:52.487447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:52.490163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 337/684] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:52 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1616 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:52.492185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76206549-2081-4d45-8a66-52ef888c7c0e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.492635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76206549-2081-4d45-8a66-52ef888c7c0e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.493482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76206549-2081-4d45-8a66-52ef888c7c0e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.493918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76206549-2081-4d45-8a66-52ef888c7c0e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.494038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:52.494644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:52.502536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.503053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.504250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.504250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.591855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:52.599873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:52.601463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:52.606344 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-01f39c27-210a-4133-8122-ef18bb8ee066 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1452 microversion: 2.75 time: 0.117479 Aug 04 13:55:52.607130 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 338/685] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:52 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:52.626035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2965f72f-8d46-4ca5-8a2b-f5c9fb9f38c9 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:52.626461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2965f72f-8d46-4ca5-8a2b-f5c9fb9f38c9 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:52.635480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2965f72f-8d46-4ca5-8a2b-f5c9fb9f38c9 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.636046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2965f72f-8d46-4ca5-8a2b-f5c9fb9f38c9 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.637382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2965f72f-8d46-4ca5-8a2b-f5c9fb9f38c9 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.637812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2965f72f-8d46-4ca5-8a2b-f5c9fb9f38c9 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.661706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76206549-2081-4d45-8a66-52ef888c7c0e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:52.669908 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76206549-2081-4d45-8a66-52ef888c7c0e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.190149 Aug 04 13:55:52.670487 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 348/686] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:52 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:52.674953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d0429ffe-c203-47df-8e66-a6d1ae6d47a9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:52.675606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d0429ffe-c203-47df-8e66-a6d1ae6d47a9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:52.681608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d0429ffe-c203-47df-8e66-a6d1ae6d47a9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.682064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d0429ffe-c203-47df-8e66-a6d1ae6d47a9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.682837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d0429ffe-c203-47df-8e66-a6d1ae6d47a9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.683762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d0429ffe-c203-47df-8e66-a6d1ae6d47a9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.686475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:52.778559 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2965f72f-8d46-4ca5-8a2b-f5c9fb9f38c9 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1616 microversion: 2.1 time: 0.156187 Aug 04 13:55:52.779388 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 339/687] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:52 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1616 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:52.799918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-83cab582-0a5e-44fa-87d7-b7d0e086118f tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:52.806604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-83cab582-0a5e-44fa-87d7-b7d0e086118f tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Searching by: {'host': 'n-h1-844627-10', 'deleted': False} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 13:55:52.813309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83cab582-0a5e-44fa-87d7-b7d0e086118f tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.813628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83cab582-0a5e-44fa-87d7-b7d0e086118f tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.814470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83cab582-0a5e-44fa-87d7-b7d0e086118f tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.814900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83cab582-0a5e-44fa-87d7-b7d0e086118f tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.909981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-83cab582-0a5e-44fa-87d7-b7d0e086118f tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 13:55:52.968674 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-83cab582-0a5e-44fa-87d7-b7d0e086118f tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers?host=n-h1-844627-10&all_tenants=1" status: 200 len: 1966 microversion: 2.1 time: 0.172983 Aug 04 13:55:52.969310 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 340/688] 10.222.0.66 () {58 vars in 1192 bytes} [Thu Aug 4 13:55:52 2022] GET /compute/v2.1/servers?host=n-h1-844627-10&all_tenants=1 => generated 1966 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:52.974862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:52.975476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:52.981545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.982178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.982792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:52.983229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:52.992172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d0429ffe-c203-47df-8e66-a6d1ae6d47a9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.001924 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d0429ffe-c203-47df-8e66-a6d1ae6d47a9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1476 microversion: 2.1 time: 0.330444 Aug 04 13:55:53.002522 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 349/689] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:52 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:53.020194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9781aff-3b21-400b-a62e-41bade603c44 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:53.026390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b9781aff-3b21-400b-a62e-41bade603c44 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 13:55:53.032310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9781aff-3b21-400b-a62e-41bade603c44 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.032784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9781aff-3b21-400b-a62e-41bade603c44 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.033607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9781aff-3b21-400b-a62e-41bade603c44 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.034048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9781aff-3b21-400b-a62e-41bade603c44 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.115833 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b9781aff-3b21-400b-a62e-41bade603c44 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.099086 Aug 04 13:55:53.116596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 350/690] 10.222.0.66 () {58 vars in 1196 bytes} [Thu Aug 4 13:55:53 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:55:53.117906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.126656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.128209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.128643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-10d5fed5-1b1a-42dd-985b-1d8054adff10 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:53.129403 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b5d940d-db0f-4e0f-95c2-d68b14360b5f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.159157 Aug 04 13:55:53.129987 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 341/691] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:52 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:53.130934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-10d5fed5-1b1a-42dd-985b-1d8054adff10 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:53.137614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-10d5fed5-1b1a-42dd-985b-1d8054adff10 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.138062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-10d5fed5-1b1a-42dd-985b-1d8054adff10 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.138828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-10d5fed5-1b1a-42dd-985b-1d8054adff10 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.139261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-10d5fed5-1b1a-42dd-985b-1d8054adff10 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.226025 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-10d5fed5-1b1a-42dd-985b-1d8054adff10 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action" status: 202 len: 0 microversion: 2.1 time: 0.100989 Aug 04 13:55:53.226703 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 351/692] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:55:53 2022] POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:55:53.235146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:53.237982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:53.244180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.244624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.247313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.247757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.338617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:53.339031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:53.339528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:53.339927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:53.340328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:53.385710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:53.402131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:53.410226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.411663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.411953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.412451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.445270 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ea9df5c3-3224-403a-9fcf-57393105950a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action" status: 202 len: 1067 microversion: 2.1 time: 0.214059 Aug 04 13:55:53.445958 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 342/693] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:55:53 2022] POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action => generated 1067 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 13:55:53.463331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-30a83f68-d4f2-4683-b502-d852958f56f1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:53.463996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-30a83f68-d4f2-4683-b502-d852958f56f1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:53.471070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30a83f68-d4f2-4683-b502-d852958f56f1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.471604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30a83f68-d4f2-4683-b502-d852958f56f1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.472384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30a83f68-d4f2-4683-b502-d852958f56f1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.472861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30a83f68-d4f2-4683-b502-d852958f56f1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.499960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4a8d5e3c-a8c0-4ef7-b592-b898df171569 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:53.500574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4a8d5e3c-a8c0-4ef7-b592-b898df171569 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:53.503782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:53.508091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a8d5e3c-a8c0-4ef7-b592-b898df171569 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.508540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a8d5e3c-a8c0-4ef7-b592-b898df171569 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.509338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a8d5e3c-a8c0-4ef7-b592-b898df171569 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.509856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a8d5e3c-a8c0-4ef7-b592-b898df171569 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.660123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-30a83f68-d4f2-4683-b502-d852958f56f1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.669126 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-30a83f68-d4f2-4683-b502-d852958f56f1 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.208477 Aug 04 13:55:53.669311 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 352/694] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:53 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:53.673949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:53.674639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:53.680794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.681464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.682150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.682602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.690327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4a8d5e3c-a8c0-4ef7-b592-b898df171569 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.698166 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4a8d5e3c-a8c0-4ef7-b592-b898df171569 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1459 microversion: 2.1 time: 0.202129 Aug 04 13:55:53.698737 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 343/695] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:53 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1459 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:53.703198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1936fb1-2212-44d6-abcb-69d709b4e3d9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:53.703795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1936fb1-2212-44d6-abcb-69d709b4e3d9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:53.709607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1936fb1-2212-44d6-abcb-69d709b4e3d9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.710054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1936fb1-2212-44d6-abcb-69d709b4e3d9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.710812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1936fb1-2212-44d6-abcb-69d709b4e3d9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.711250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1936fb1-2212-44d6-abcb-69d709b4e3d9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.752857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.761449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.762916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.768019 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7b1024c0-7a01-45f5-9524-87e5084b0d16 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1452 microversion: 2.75 time: 0.097714 Aug 04 13:55:53.768590 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 353/696] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:53 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:53.773302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-58de1601-5502-4790-8ce4-64a42b941700 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:53.773918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-58de1601-5502-4790-8ce4-64a42b941700 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:53.780307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58de1601-5502-4790-8ce4-64a42b941700 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.780788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58de1601-5502-4790-8ce4-64a42b941700 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.781587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58de1601-5502-4790-8ce4-64a42b941700 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:53.782030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58de1601-5502-4790-8ce4-64a42b941700 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:53.886109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c1936fb1-2212-44d6-abcb-69d709b4e3d9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:53.894733 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1936fb1-2212-44d6-abcb-69d709b4e3d9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.194941 Aug 04 13:55:53.895410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 344/697] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:53 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:54.025481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c771d5e8-94c1-428c-b4c5-b6ad36541f10 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:54.026100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c771d5e8-94c1-428c-b4c5-b6ad36541f10 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:54.034829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c771d5e8-94c1-428c-b4c5-b6ad36541f10 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.036407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c771d5e8-94c1-428c-b4c5-b6ad36541f10 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.037726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c771d5e8-94c1-428c-b4c5-b6ad36541f10 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.038376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c771d5e8-94c1-428c-b4c5-b6ad36541f10 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.039692 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-58de1601-5502-4790-8ce4-64a42b941700 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1612 microversion: 2.1 time: 0.270025 Aug 04 13:55:54.040654 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 354/698] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:53 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1612 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:54.069577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-198dc16d-6424-40a1-8f61-ccc813db448c tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:54.072576 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:55:54.072576 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:55:54.074508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-198dc16d-6424-40a1-8f61-ccc813db448c tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.075044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-198dc16d-6424-40a1-8f61-ccc813db448c tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.075932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-198dc16d-6424-40a1-8f61-ccc813db448c tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.076443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-198dc16d-6424-40a1-8f61-ccc813db448c tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.100507 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-198dc16d-6424-40a1-8f61-ccc813db448c tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.034454 Aug 04 13:55:54.101147 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 355/699] 10.222.0.66 () {58 vars in 1176 bytes} [Thu Aug 4 13:55:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:55:54.112626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844627-10", "block_migration": true, "disk_over_commit": false}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:54.115068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:54.121996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.122436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.123208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.123648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.149402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Lazy-loading 'flavor' on Instance uuid 9aa0178a-7901-40f1-92af-39c4f286b8bb {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:55:54.162432 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 9aa0178a-7901-40f1-92af-39c4f286b8bb while it is in vm_state suspended Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Request method failure captured: Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb/action HTTP/1.1 Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 98 Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68_EfGKQCjxinFsJshlCkaGX4vRjGVmXFPF4EiioifMlBeqSGlNcyf0BGfpaACBvztdFDt0mw0pLUKwLXpGaNmqa40vx_zFpnSI3UaYZYxbHTUE2fMmYzL5Mc3Mq2rGpsqeesa2AK1O5r6YaBGD10XMY0YXHJmbe0yXXm0VNPZVVidI Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2a5f1acb9626409282cbfcf18fa8fd30 Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-LiveMigrationNegativeTest-1929897825 Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:55:54.164633 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a5f1acb9626409282cbfcf18fa8fd30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2a5f1acb9626409282cbfcf18fa8fd30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2a5f1acb9626409282cbfcf18fa8fd30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2a5f1acb9626409282cbfcf18fa8fd30"}]}] Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-LiveMigrationNegativeTest-1929897825 Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2a5f1acb9626409282cbfcf18fa8fd30 Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1929897825 Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-LiveMigrationNegativeTest-1929897825-project-admin Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 05a95aee90f74a7787ba37b80d895d01 Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-LiveMigrationNegativeTest-1929897825-project-admin Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: {"os-migrateLive": {"host": "n-h1-844627-10", "block_migration": true, "disk_over_commit": false}} Aug 04 13:55:54.166285 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: exception: Cannot 'os-migrateLive' instance 9aa0178a-7901-40f1-92af-39c4f286b8bb while it is in vm_state suspended Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9aa0178a-7901-40f1-92af-39c4f286b8bb', 'body': {'os-migrateLive': {'host': 'n-h1-844627-10', 'block_migration': True, 'disk_over_commit': False}}} Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 13:55:54.172052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9aa0178a-7901-40f1-92af-39c4f286b8bb in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:55:54.173494 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 9aa0178a-7901-40f1-92af-39c4f286b8bb while it is in vm_state suspended Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 9aa0178a-7901-40f1-92af-39c4f286b8bb while it is in vm_state suspended Aug 04 13:55:54.175226 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:55:54.176580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 9aa0178a-7901-40f1-92af-39c4f286b8bb while it is in vm_state suspended {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:55:54.176580 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fbd2314f-25ab-47ef-bf23-2c90c8b6ab07 tempest-LiveMigrationNegativeTest-1929897825 tempest-LiveMigrationNegativeTest-1929897825-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb/action" status: 409 len: 155 microversion: 2.1 time: 0.057388 Aug 04 13:55:54.176580 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 356/700] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:55:54 2022] POST /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb/action => generated 155 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 13:55:54.176580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:54.176580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:54.178026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.178476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.179255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.179696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.181425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c771d5e8-94c1-428c-b4c5-b6ad36541f10 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:54.189792 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c771d5e8-94c1-428c-b4c5-b6ad36541f10 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1476 microversion: 2.1 time: 0.170327 Aug 04 13:55:54.190362 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 345/701] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:54 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1476 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:54.194815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-56650223-3140-43ee-96d7-af9beb6c48f1 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:54.195462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-56650223-3140-43ee-96d7-af9beb6c48f1 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:54.202112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56650223-3140-43ee-96d7-af9beb6c48f1 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.202735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56650223-3140-43ee-96d7-af9beb6c48f1 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.203671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56650223-3140-43ee-96d7-af9beb6c48f1 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.204255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56650223-3140-43ee-96d7-af9beb6c48f1 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.229411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-56650223-3140-43ee-96d7-af9beb6c48f1 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:55:54.311869 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-56650223-3140-43ee-96d7-af9beb6c48f1 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 204 len: 0 microversion: 2.1 time: 0.120165 Aug 04 13:55:54.312951 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 346/702] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:55:54 2022] DELETE /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:55:54.322119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4830f36-2cac-40db-b559-dab7eab37016 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:54.322978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d4830f36-2cac-40db-b559-dab7eab37016 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:54.328196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:54.329810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4830f36-2cac-40db-b559-dab7eab37016 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.330358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4830f36-2cac-40db-b559-dab7eab37016 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.331195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4830f36-2cac-40db-b559-dab7eab37016 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.331701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4830f36-2cac-40db-b559-dab7eab37016 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.336591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:54.338246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:54.339425 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1df08678-3fef-42ec-95a9-2bdd31ccae7d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.171777 Aug 04 13:55:54.339970 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 357/703] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:54 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:54.466523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4830f36-2cac-40db-b559-dab7eab37016 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:54.474723 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4830f36-2cac-40db-b559-dab7eab37016 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1465 microversion: 2.1 time: 0.157519 Aug 04 13:55:54.475289 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 347/704] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:54 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:54.690158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4559fb4-3fc7-4461-aae2-9e090e4ed02b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:54.690723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f4559fb4-3fc7-4461-aae2-9e090e4ed02b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:54.696881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4559fb4-3fc7-4461-aae2-9e090e4ed02b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.697354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4559fb4-3fc7-4461-aae2-9e090e4ed02b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.698129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4559fb4-3fc7-4461-aae2-9e090e4ed02b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.698579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4559fb4-3fc7-4461-aae2-9e090e4ed02b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.792494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:54.793181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:54.800144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.800588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.801402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.801828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.841633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f4559fb4-3fc7-4461-aae2-9e090e4ed02b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:54.849321 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4559fb4-3fc7-4461-aae2-9e090e4ed02b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.163098 Aug 04 13:55:54.849892 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 358/705] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:54 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:54.871641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:54.879770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:54.881283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:54.886026 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-10bf403a-eaa1-4777-902a-c6c606c2a7ab tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1452 microversion: 2.75 time: 0.097329 Aug 04 13:55:54.887238 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 348/706] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:54 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:54.915554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0095156e-8e08-462e-9613-ad90e6392356 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:54.916165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0095156e-8e08-462e-9613-ad90e6392356 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:54.923260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0095156e-8e08-462e-9613-ad90e6392356 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.923709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0095156e-8e08-462e-9613-ad90e6392356 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:54.924499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0095156e-8e08-462e-9613-ad90e6392356 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:54.924959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0095156e-8e08-462e-9613-ad90e6392356 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.058095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0095156e-8e08-462e-9613-ad90e6392356 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:55.066505 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0095156e-8e08-462e-9613-ad90e6392356 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.154786 Aug 04 13:55:55.067075 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 359/707] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:54 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:55.211625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-599fdfcc-0859-4c43-9e8c-b101aff5adf0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:55.212183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-599fdfcc-0859-4c43-9e8c-b101aff5adf0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:55.218265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-599fdfcc-0859-4c43-9e8c-b101aff5adf0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.218705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-599fdfcc-0859-4c43-9e8c-b101aff5adf0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.219457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-599fdfcc-0859-4c43-9e8c-b101aff5adf0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.219885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-599fdfcc-0859-4c43-9e8c-b101aff5adf0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.354972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-599fdfcc-0859-4c43-9e8c-b101aff5adf0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:55.362316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:55.362941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:55.363406 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-599fdfcc-0859-4c43-9e8c-b101aff5adf0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1476 microversion: 2.1 time: 0.155669 Aug 04 13:55:55.363984 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 349/708] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:55 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:55.369123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.369584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.370362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.370860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.495683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-95991db4-e21c-4591-9121-75f4806232f6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:55.496221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-95991db4-e21c-4591-9121-75f4806232f6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:55.498656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:55.502468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95991db4-e21c-4591-9121-75f4806232f6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.502919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95991db4-e21c-4591-9121-75f4806232f6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.503708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95991db4-e21c-4591-9121-75f4806232f6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.504152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95991db4-e21c-4591-9121-75f4806232f6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.507050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:55.508563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:55.509820 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5cfc9e19-db7c-40ff-9132-557c2b32e425 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.151385 Aug 04 13:55:55.510371 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 360/709] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:55 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:55.638658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-95991db4-e21c-4591-9121-75f4806232f6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:55.646166 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-95991db4-e21c-4591-9121-75f4806232f6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1465 microversion: 2.1 time: 0.154443 Aug 04 13:55:55.646726 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 350/710] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:55 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:55.870408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bfe9b1cb-0169-4e88-9a2b-ef0cae733e07 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:55.871567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bfe9b1cb-0169-4e88-9a2b-ef0cae733e07 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:55.877682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfe9b1cb-0169-4e88-9a2b-ef0cae733e07 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.878142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfe9b1cb-0169-4e88-9a2b-ef0cae733e07 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.878914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfe9b1cb-0169-4e88-9a2b-ef0cae733e07 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.879351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfe9b1cb-0169-4e88-9a2b-ef0cae733e07 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.910839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:55.911606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:55.918879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.919496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:55.920275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:55.920785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:56.001009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:56.009088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:56.010584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:56.015451 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd19f676-5023-4ebf-9647-e638636620fb tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1452 microversion: 2.75 time: 0.108513 Aug 04 13:55:56.016012 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 351/711] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:55 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:56.030819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bfe9b1cb-0169-4e88-9a2b-ef0cae733e07 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:56.038585 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bfe9b1cb-0169-4e88-9a2b-ef0cae733e07 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.172172 Aug 04 13:55:56.039245 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 361/712] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:55 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:56.087528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5424b7d4-389b-4189-b51b-5ec9f331c9c3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:56.088170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5424b7d4-389b-4189-b51b-5ec9f331c9c3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:56.094792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5424b7d4-389b-4189-b51b-5ec9f331c9c3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:56.095237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5424b7d4-389b-4189-b51b-5ec9f331c9c3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:56.096005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5424b7d4-389b-4189-b51b-5ec9f331c9c3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:56.096468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5424b7d4-389b-4189-b51b-5ec9f331c9c3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:56.228545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5424b7d4-389b-4189-b51b-5ec9f331c9c3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:56.236499 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5424b7d4-389b-4189-b51b-5ec9f331c9c3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.152888 Aug 04 13:55:56.237327 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 352/713] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:56 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:56.383833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8806ce65-daf2-404b-a2b7-2712d1581f97 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:56.384486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8806ce65-daf2-404b-a2b7-2712d1581f97 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:56.391226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8806ce65-daf2-404b-a2b7-2712d1581f97 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:56.391672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8806ce65-daf2-404b-a2b7-2712d1581f97 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:56.392441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8806ce65-daf2-404b-a2b7-2712d1581f97 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:56.392888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8806ce65-daf2-404b-a2b7-2712d1581f97 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:56.536293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:56.537508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:56.549596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:56.550500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:56.552436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:56.553079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:56.663705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8806ce65-daf2-404b-a2b7-2712d1581f97 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:56.672219 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8806ce65-daf2-404b-a2b7-2712d1581f97 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1476 microversion: 2.1 time: 0.292197 Aug 04 13:55:56.672912 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 362/714] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:56 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:56.677537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebff25bb-7a82-45ec-baa6-e1056c6322fb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:56.678368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ebff25bb-7a82-45ec-baa6-e1056c6322fb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:56.685268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebff25bb-7a82-45ec-baa6-e1056c6322fb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:56.685947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebff25bb-7a82-45ec-baa6-e1056c6322fb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:56.686729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebff25bb-7a82-45ec-baa6-e1056c6322fb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:56.687168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebff25bb-7a82-45ec-baa6-e1056c6322fb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.108606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.118058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.119868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.121839 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-00a7a1e5-03fc-4c69-ac2b-7d02bfd9511b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.593684 Aug 04 13:55:57.122620 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 353/715] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:56 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:57.127493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:57.128363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:57.135657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.138576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.139514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.140064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.178963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ebff25bb-7a82-45ec-baa6-e1056c6322fb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.187489 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ebff25bb-7a82-45ec-baa6-e1056c6322fb tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 200 len: 1465 microversion: 2.1 time: 0.513475 Aug 04 13:55:57.188068 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 363/716] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:56 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 1465 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:57.193504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-efe6e34e-1de4-49e1-a7a2-edbd802ac1a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:57.194370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-efe6e34e-1de4-49e1-a7a2-edbd802ac1a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:57.212364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efe6e34e-1de4-49e1-a7a2-edbd802ac1a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.213742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efe6e34e-1de4-49e1-a7a2-edbd802ac1a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.214696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efe6e34e-1de4-49e1-a7a2-edbd802ac1a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.215235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efe6e34e-1de4-49e1-a7a2-edbd802ac1a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.227381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.237345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.239009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.244530 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a111c3e2-265c-4199-9195-8fc89a65f49c tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1437 microversion: 2.75 time: 0.120553 Aug 04 13:55:57.245153 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 354/717] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:57 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:57.256731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-faa52982-d2fb-4afd-8cd3-7a6834a542df tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:57.257597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-faa52982-d2fb-4afd-8cd3-7a6834a542df tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:57.265061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faa52982-d2fb-4afd-8cd3-7a6834a542df tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.265757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faa52982-d2fb-4afd-8cd3-7a6834a542df tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.266693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faa52982-d2fb-4afd-8cd3-7a6834a542df tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.267268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faa52982-d2fb-4afd-8cd3-7a6834a542df tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.569181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-efe6e34e-1de4-49e1-a7a2-edbd802ac1a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.578514 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-efe6e34e-1de4-49e1-a7a2-edbd802ac1a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.389075 Aug 04 13:55:57.579023 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 364/718] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:57 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:57.583075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-faa52982-d2fb-4afd-8cd3-7a6834a542df tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.604666 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-faa52982-d2fb-4afd-8cd3-7a6834a542df tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.351539 Aug 04 13:55:57.613817 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 355/719] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:57 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:57.622655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c69dd258-9261-4e5b-a320-2dd1db705f13 req-7c5449e7-36a0-4b7e-9fcf-8a6f0db33a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aa0178a-7901-40f1-92af-39c4f286b8bb", "name": "network-vif-deleted", "tag": "3dbce7d2-641d-41d9-8e84-8646c896ff25"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:57.633458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c69dd258-9261-4e5b-a320-2dd1db705f13 req-7c5449e7-36a0-4b7e-9fcf-8a6f0db33a3b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.634079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c69dd258-9261-4e5b-a320-2dd1db705f13 req-7c5449e7-36a0-4b7e-9fcf-8a6f0db33a3b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.645964 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c69dd258-9261-4e5b-a320-2dd1db705f13 req-7c5449e7-36a0-4b7e-9fcf-8a6f0db33a3b service nova] Creating event network-vif-deleted:3dbce7d2-641d-41d9-8e84-8646c896ff25 for instance 9aa0178a-7901-40f1-92af-39c4f286b8bb on n-h2-844627-10 Aug 04 13:55:57.650988 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c69dd258-9261-4e5b-a320-2dd1db705f13 req-7c5449e7-36a0-4b7e-9fcf-8a6f0db33a3b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034476 Aug 04 13:55:57.651605 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 356/720] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:57.694092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c79201cb-c963-4df7-bc68-d3a330ed2774 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:57.694784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c79201cb-c963-4df7-bc68-d3a330ed2774 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:57.702227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c79201cb-c963-4df7-bc68-d3a330ed2774 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.702684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c79201cb-c963-4df7-bc68-d3a330ed2774 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.703456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c79201cb-c963-4df7-bc68-d3a330ed2774 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.703924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c79201cb-c963-4df7-bc68-d3a330ed2774 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.717727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:57.720896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:57.727192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.727818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.728601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.729067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.749782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:57.821517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:55:57.821958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:55:57.822438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:55:57.822901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:55:57.823324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:55:57.847765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c79201cb-c963-4df7-bc68-d3a330ed2774 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:57.850601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:55:57.857940 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c79201cb-c963-4df7-bc68-d3a330ed2774 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1476 microversion: 2.1 time: 0.167888 Aug 04 13:55:57.859048 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 357/721] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:57 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:57.892359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:57.900752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.901315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:57.904447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:57.905144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.025498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:55:58.083368 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2f9504d7-d9c1-4326-8e7a-a0dcf5f80797 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca/action" status: 202 len: 1942 microversion: 2.75 time: 0.501825 Aug 04 13:55:58.084015 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 365/722] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 13:55:57 2022] POST /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca/action => generated 1942 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 13:55:58.108762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-61dd137b-7404-44f5-bca7-d97a92bbea27 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:58.109026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-61dd137b-7404-44f5-bca7-d97a92bbea27 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:58.116474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61dd137b-7404-44f5-bca7-d97a92bbea27 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.116975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61dd137b-7404-44f5-bca7-d97a92bbea27 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.117739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61dd137b-7404-44f5-bca7-d97a92bbea27 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.118330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61dd137b-7404-44f5-bca7-d97a92bbea27 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.145223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:58.145835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:58.153350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.153350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.153613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.153933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.259536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-61dd137b-7404-44f5-bca7-d97a92bbea27 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:55:58.278496 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-61dd137b-7404-44f5-bca7-d97a92bbea27 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.174155 Aug 04 13:55:58.279088 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 358/723] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:58 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:58.285529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:58.286253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 9aa0178a-7901-40f1-92af-39c4f286b8bb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:58.293039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.293629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.294501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.295016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.309401 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] HTTP exception thrown: Instance 9aa0178a-7901-40f1-92af-39c4f286b8bb could not be found. Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Request method failure captured: Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb HTTP/1.1 Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68_EcXBQBt0GSHib1OYIGQfXeQApxLEBaGiL-5U5dbEgx-WXeAtfklcH99bDvRooXg4zUWZCUMWgJ82zaadIg9MS4_PErt_eZcMJg6CRjZe4baxXY3XvN30_1MS_CzmKJwF75CGcbMBBQ5lpYR_tBDbtoVz0R6qCQeeHDezLLxjC9lQ Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 9897fe3193ba44d683cac4a1d4381158 Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-LiveMigrationNegativeTest-1470335772 Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:55:58.311131 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9897fe3193ba44d683cac4a1d4381158"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9897fe3193ba44d683cac4a1d4381158"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9897fe3193ba44d683cac4a1d4381158"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9897fe3193ba44d683cac4a1d4381158"}]}] Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-LiveMigrationNegativeTest-1470335772 Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 9897fe3193ba44d683cac4a1d4381158 Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1470335772 Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-LiveMigrationNegativeTest-1470335772-project Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 962006014e414681a9ccf556eaa7162b Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-LiveMigrationNegativeTest-1470335772-project Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 9aa0178a-7901-40f1-92af-39c4f286b8bb could not be found. Aug 04 13:55:58.312510 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9aa0178a-7901-40f1-92af-39c4f286b8bb'} Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aa0178a-7901-40f1-92af-39c4f286b8bb could not be found. Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:55:58.313538 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aa0178a-7901-40f1-92af-39c4f286b8bb could not be found. Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aa0178a-7901-40f1-92af-39c4f286b8bb could not be found. Aug 04 13:55:58.314713 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:55:58.315900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Returning 404 to user: Instance 9aa0178a-7901-40f1-92af-39c4f286b8bb could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:55:58.315900 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cabb0bb4-285a-47e6-ace4-71d33bc24c20 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb" status: 404 len: 111 microversion: 2.1 time: 0.030674 Aug 04 13:55:58.315900 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 359/724] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:58 2022] GET /compute/v2.1/servers/9aa0178a-7901-40f1-92af-39c4f286b8bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:55:58.316764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:58.321601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-248464a6-20f5-46de-b88a-5ef4cc5d4ced tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:58.322099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-248464a6-20f5-46de-b88a-5ef4cc5d4ced tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:58.324935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:58.326442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:58.327593 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f1e0c89-5371-4627-99ae-87f34e35a957 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.186439 Aug 04 13:55:58.328146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-248464a6-20f5-46de-b88a-5ef4cc5d4ced tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.328348 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 366/725] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:58 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:55:58.328592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-248464a6-20f5-46de-b88a-5ef4cc5d4ced tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.329385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-248464a6-20f5-46de-b88a-5ef4cc5d4ced tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.329821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-248464a6-20f5-46de-b88a-5ef4cc5d4ced tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.356231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-248464a6-20f5-46de-b88a-5ef4cc5d4ced tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:55:58.432216 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-248464a6-20f5-46de-b88a-5ef4cc5d4ced tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "DELETE /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 204 len: 0 microversion: 2.1 time: 0.113897 Aug 04 13:55:58.432694 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 360/726] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:55:58 2022] DELETE /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:55:58.441169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8938b1d8-b29b-4bf8-9675-132b939d4b69 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:58.441786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8938b1d8-b29b-4bf8-9675-132b939d4b69 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:58.447798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8938b1d8-b29b-4bf8-9675-132b939d4b69 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.448249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8938b1d8-b29b-4bf8-9675-132b939d4b69 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.449074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8938b1d8-b29b-4bf8-9675-132b939d4b69 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.449517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8938b1d8-b29b-4bf8-9675-132b939d4b69 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.597912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8938b1d8-b29b-4bf8-9675-132b939d4b69 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:58.600598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7db75dd-ce91-4d1a-967a-5630d61ed3f2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:58.601429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d7db75dd-ce91-4d1a-967a-5630d61ed3f2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:58.606534 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8938b1d8-b29b-4bf8-9675-132b939d4b69 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1474 microversion: 2.1 time: 0.169222 Aug 04 13:55:58.607380 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 367/727] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:58 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1474 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:58.608639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7db75dd-ce91-4d1a-967a-5630d61ed3f2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.609268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7db75dd-ce91-4d1a-967a-5630d61ed3f2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.610113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7db75dd-ce91-4d1a-967a-5630d61ed3f2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.610562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7db75dd-ce91-4d1a-967a-5630d61ed3f2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.626175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be8378ec-c8dd-42a2-be4c-9974ed9a5d3b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:58.626797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be8378ec-c8dd-42a2-be4c-9974ed9a5d3b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:58.632753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8378ec-c8dd-42a2-be4c-9974ed9a5d3b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.633241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8378ec-c8dd-42a2-be4c-9974ed9a5d3b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.634012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8378ec-c8dd-42a2-be4c-9974ed9a5d3b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.634454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8378ec-c8dd-42a2-be4c-9974ed9a5d3b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.884999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d7db75dd-ce91-4d1a-967a-5630d61ed3f2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:58.892650 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d7db75dd-ce91-4d1a-967a-5630d61ed3f2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.296647 Aug 04 13:55:58.893264 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 361/728] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:58 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:58.898091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-410cfe28-1535-4774-9d1f-26d13a5ad713 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:58.898741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-410cfe28-1535-4774-9d1f-26d13a5ad713 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:58.902840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-be8378ec-c8dd-42a2-be4c-9974ed9a5d3b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:58.907882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-410cfe28-1535-4774-9d1f-26d13a5ad713 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.908368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-410cfe28-1535-4774-9d1f-26d13a5ad713 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.909189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-410cfe28-1535-4774-9d1f-26d13a5ad713 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:58.909632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-410cfe28-1535-4774-9d1f-26d13a5ad713 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:58.912176 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be8378ec-c8dd-42a2-be4c-9974ed9a5d3b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.289723 Aug 04 13:55:58.912746 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 368/729] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:58 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:55:59.069270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-410cfe28-1535-4774-9d1f-26d13a5ad713 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:59.079741 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-410cfe28-1535-4774-9d1f-26d13a5ad713 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1476 microversion: 2.1 time: 0.184780 Aug 04 13:55:59.080755 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 362/730] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:58 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:59.303977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a1f87735-363e-471e-8a69-e52eb0ac4993 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:59.304615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a1f87735-363e-471e-8a69-e52eb0ac4993 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:59.312810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1f87735-363e-471e-8a69-e52eb0ac4993 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.313366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1f87735-363e-471e-8a69-e52eb0ac4993 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.314230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1f87735-363e-471e-8a69-e52eb0ac4993 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.314820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1f87735-363e-471e-8a69-e52eb0ac4993 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.351457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:59.352364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:59.360437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.361164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.361943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.362638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.426060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-a1f87735-363e-471e-8a69-e52eb0ac4993 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:55:59.450391 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a1f87735-363e-471e-8a69-e52eb0ac4993 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.149847 Aug 04 13:55:59.456890 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 369/731] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:59 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:59.469778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0bf84481-18fd-4a89-a8ef-306619cc3dc6 req-e1379b96-000d-41c8-bdaa-409ebb14dc60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9e1d4b-b8b1-44de-9409-65db8223e4b2", "name": "network-vif-plugged", "status": "completed", "tag": "dddc2305-f311-4ae1-af98-ee954b3cd677"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:55:59.484423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0bf84481-18fd-4a89-a8ef-306619cc3dc6 req-e1379b96-000d-41c8-bdaa-409ebb14dc60 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.485096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0bf84481-18fd-4a89-a8ef-306619cc3dc6 req-e1379b96-000d-41c8-bdaa-409ebb14dc60 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.497725 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0bf84481-18fd-4a89-a8ef-306619cc3dc6 req-e1379b96-000d-41c8-bdaa-409ebb14dc60 service nova] Creating event network-vif-plugged:dddc2305-f311-4ae1-af98-ee954b3cd677 for instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 on n-h1-844627-10 Aug 04 13:55:59.504220 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0bf84481-18fd-4a89-a8ef-306619cc3dc6 req-e1379b96-000d-41c8-bdaa-409ebb14dc60 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044006 Aug 04 13:55:59.505201 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 370/732] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:55:59.575968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:59.585194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:59.586746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:59.587948 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a920fb4a-b37c-47e1-8dc4-6ef264254397 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.240389 Aug 04 13:55:59.588535 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 363/733] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:55:59 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:55:59.629825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ed22e6b8-0b13-4c71-805d-f78b28b8f5e6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:59.630529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ed22e6b8-0b13-4c71-805d-f78b28b8f5e6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:59.637090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed22e6b8-0b13-4c71-805d-f78b28b8f5e6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.637584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed22e6b8-0b13-4c71-805d-f78b28b8f5e6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.638323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed22e6b8-0b13-4c71-805d-f78b28b8f5e6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.638759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed22e6b8-0b13-4c71-805d-f78b28b8f5e6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.843201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ed22e6b8-0b13-4c71-805d-f78b28b8f5e6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:55:59.850872 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ed22e6b8-0b13-4c71-805d-f78b28b8f5e6 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1474 microversion: 2.1 time: 0.226535 Aug 04 13:55:59.851441 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 371/734] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:59 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1474 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:55:59.913937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a7bab267-47b3-4773-8e11-359e28d38d67 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:59.914551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a7bab267-47b3-4773-8e11-359e28d38d67 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:59.922325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7bab267-47b3-4773-8e11-359e28d38d67 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.922777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7bab267-47b3-4773-8e11-359e28d38d67 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.923545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7bab267-47b3-4773-8e11-359e28d38d67 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.923983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7bab267-47b3-4773-8e11-359e28d38d67 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.933606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbe8df70-0c1d-430b-8e29-5ca42a8ed300 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:55:59.934224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fbe8df70-0c1d-430b-8e29-5ca42a8ed300 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:55:59.940328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbe8df70-0c1d-430b-8e29-5ca42a8ed300 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.940781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbe8df70-0c1d-430b-8e29-5ca42a8ed300 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:55:59.941596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbe8df70-0c1d-430b-8e29-5ca42a8ed300 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:55:59.942094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbe8df70-0c1d-430b-8e29-5ca42a8ed300 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:00.123998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a7bab267-47b3-4773-8e11-359e28d38d67 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:00.131876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fbe8df70-0c1d-430b-8e29-5ca42a8ed300 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:00.132535 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a7bab267-47b3-4773-8e11-359e28d38d67 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.222322 Aug 04 13:56:00.133190 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 364/735] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:59 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:00.141838 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fbe8df70-0c1d-430b-8e29-5ca42a8ed300 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.211829 Aug 04 13:56:00.150497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d1f8c07d-decf-4064-9af7-29a8ea4393a8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:00.151118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d1f8c07d-decf-4064-9af7-29a8ea4393a8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:00.156487 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 372/736] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:55:59 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:00.162046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1f8c07d-decf-4064-9af7-29a8ea4393a8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:00.162804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1f8c07d-decf-4064-9af7-29a8ea4393a8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:00.163485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1f8c07d-decf-4064-9af7-29a8ea4393a8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:00.163935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1f8c07d-decf-4064-9af7-29a8ea4393a8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:00.321078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d1f8c07d-decf-4064-9af7-29a8ea4393a8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:00.329083 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d1f8c07d-decf-4064-9af7-29a8ea4393a8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1475 microversion: 2.1 time: 0.186653 Aug 04 13:56:00.329661 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 365/737] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:00 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1475 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:00.475355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-07ebee50-813e-4e7a-b88d-23a6344abba9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:00.475972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-07ebee50-813e-4e7a-b88d-23a6344abba9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:00.484530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ebee50-813e-4e7a-b88d-23a6344abba9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:00.485008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ebee50-813e-4e7a-b88d-23a6344abba9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:00.485786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ebee50-813e-4e7a-b88d-23a6344abba9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:00.486291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ebee50-813e-4e7a-b88d-23a6344abba9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:00.587517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-07ebee50-813e-4e7a-b88d-23a6344abba9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:00.611583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:00.612200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:00.615308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:00.620036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:00.621003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:00.622021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:00.623366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:00.626328 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-07ebee50-813e-4e7a-b88d-23a6344abba9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.154713 Aug 04 13:56:00.626931 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 373/738] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:00 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:00.845046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:00.858018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:00.859576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:00.860802 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fb9bfbc2-1fb9-450e-8a5e-21486b8e4235 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.253298 Aug 04 13:56:00.861418 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 366/739] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:00 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:00.874296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5a031406-bc34-4fc6-812d-ca7c27cdf4d2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:00.875297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5a031406-bc34-4fc6-812d-ca7c27cdf4d2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:00.882556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a031406-bc34-4fc6-812d-ca7c27cdf4d2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:00.883129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a031406-bc34-4fc6-812d-ca7c27cdf4d2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:00.883974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a031406-bc34-4fc6-812d-ca7c27cdf4d2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:00.884492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a031406-bc34-4fc6-812d-ca7c27cdf4d2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:00.978698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5a031406-bc34-4fc6-812d-ca7c27cdf4d2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962006014e414681a9ccf556eaa7162b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9897fe3193ba44d683cac4a1d4381158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:00.989314 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5a031406-bc34-4fc6-812d-ca7c27cdf4d2 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 200 len: 1432 microversion: 2.1 time: 0.120056 Aug 04 13:56:00.989981 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 374/740] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:00 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 1432 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:01.037179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5d977eb0-ffce-4841-a405-727e6967dd2f req-a8cf3469-c71d-4ba7-adba-3e8165717c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608bc65c-ea5b-45ed-99f1-706ba5a958e3", "name": "network-vif-deleted", "tag": "31b48178-e307-4711-87aa-797381b2a7c0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:01.049111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5d977eb0-ffce-4841-a405-727e6967dd2f req-a8cf3469-c71d-4ba7-adba-3e8165717c14 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.049815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5d977eb0-ffce-4841-a405-727e6967dd2f req-a8cf3469-c71d-4ba7-adba-3e8165717c14 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.076532 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5d977eb0-ffce-4841-a405-727e6967dd2f req-a8cf3469-c71d-4ba7-adba-3e8165717c14 service nova] Creating event network-vif-deleted:31b48178-e307-4711-87aa-797381b2a7c0 for instance 608bc65c-ea5b-45ed-99f1-706ba5a958e3 on n-h2-844627-10 Aug 04 13:56:01.081637 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5d977eb0-ffce-4841-a405-727e6967dd2f req-a8cf3469-c71d-4ba7-adba-3e8165717c14 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048071 Aug 04 13:56:01.082673 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 367/741] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:01.162301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f496ed3a-c176-42dd-8b5b-0b4e9125612b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:01.163135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f496ed3a-c176-42dd-8b5b-0b4e9125612b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:01.169700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cde39a2d-33e6-4fcb-a069-1ac8130fc646 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:01.171315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f496ed3a-c176-42dd-8b5b-0b4e9125612b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.172257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cde39a2d-33e6-4fcb-a069-1ac8130fc646 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:01.172927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f496ed3a-c176-42dd-8b5b-0b4e9125612b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.173922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f496ed3a-c176-42dd-8b5b-0b4e9125612b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.174530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f496ed3a-c176-42dd-8b5b-0b4e9125612b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.182881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cde39a2d-33e6-4fcb-a069-1ac8130fc646 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.183440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cde39a2d-33e6-4fcb-a069-1ac8130fc646 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.184378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cde39a2d-33e6-4fcb-a069-1ac8130fc646 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.184821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cde39a2d-33e6-4fcb-a069-1ac8130fc646 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.386843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f496ed3a-c176-42dd-8b5b-0b4e9125612b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:01.393446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cde39a2d-33e6-4fcb-a069-1ac8130fc646 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:01.394924 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f496ed3a-c176-42dd-8b5b-0b4e9125612b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.243336 Aug 04 13:56:01.395622 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 375/742] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:01 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:01.400818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-edec2051-1ff5-4d3c-a929-786e18f3b7d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:01.402664 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cde39a2d-33e6-4fcb-a069-1ac8130fc646 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.238837 Aug 04 13:56:01.403245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-edec2051-1ff5-4d3c-a929-786e18f3b7d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:01.403589 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 368/743] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:01 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:01.410360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-edec2051-1ff5-4d3c-a929-786e18f3b7d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.410939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-edec2051-1ff5-4d3c-a929-786e18f3b7d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.411827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-edec2051-1ff5-4d3c-a929-786e18f3b7d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.412385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-edec2051-1ff5-4d3c-a929-786e18f3b7d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.534067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:01.592516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-edec2051-1ff5-4d3c-a929-786e18f3b7d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:01.600045 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-edec2051-1ff5-4d3c-a929-786e18f3b7d3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1475 microversion: 2.1 time: 0.203195 Aug 04 13:56:01.600611 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 376/744] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:01 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1475 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:01.651799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-af0a6633-c2a7-4f4b-bd82-669654d92ebc tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:01.652966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-af0a6633-c2a7-4f4b-bd82-669654d92ebc tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:01.659253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af0a6633-c2a7-4f4b-bd82-669654d92ebc tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.659733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af0a6633-c2a7-4f4b-bd82-669654d92ebc tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.660730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af0a6633-c2a7-4f4b-bd82-669654d92ebc tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.661299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af0a6633-c2a7-4f4b-bd82-669654d92ebc tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.752351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-af0a6633-c2a7-4f4b-bd82-669654d92ebc tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:01.768249 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-af0a6633-c2a7-4f4b-bd82-669654d92ebc tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.120355 Aug 04 13:56:01.769060 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 369/745] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:01 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:01.884775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:01.885663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:01.892689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.893245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:01.894129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:01.894607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.010977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:02.011603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] [instance: 608bc65c-ea5b-45ed-99f1-706ba5a958e3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:02.017852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.018419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.019205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.019645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.033461 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] HTTP exception thrown: Instance 608bc65c-ea5b-45ed-99f1-706ba5a958e3 could not be found. Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Request method failure captured: Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 HTTP/1.1 Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68_EcXBQBt0GSHib1OYIGQfXeQApxLEBaGiL-5U5dbEgx-WXeAtfklcH99bDvRooXg4zUWZCUMWgJ82zaadIg9MS4_PErt_eZcMJg6CRjZe4baxXY3XvN30_1MS_CzmKJwF75CGcbMBBQ5lpYR_tBDbtoVz0R6qCQeeHDezLLxjC9lQ Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 9897fe3193ba44d683cac4a1d4381158 Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-LiveMigrationNegativeTest-1470335772 Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:56:02.035309 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9897fe3193ba44d683cac4a1d4381158"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9897fe3193ba44d683cac4a1d4381158"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9897fe3193ba44d683cac4a1d4381158"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9897fe3193ba44d683cac4a1d4381158"}]}] Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-LiveMigrationNegativeTest-1470335772 Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 9897fe3193ba44d683cac4a1d4381158 Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1470335772 Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-LiveMigrationNegativeTest-1470335772-project Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 962006014e414681a9ccf556eaa7162b Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-LiveMigrationNegativeTest-1470335772-project Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 608bc65c-ea5b-45ed-99f1-706ba5a958e3 could not be found. Aug 04 13:56:02.036927 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '608bc65c-ea5b-45ed-99f1-706ba5a958e3'} Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608bc65c-ea5b-45ed-99f1-706ba5a958e3 could not be found. Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:02.038271 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608bc65c-ea5b-45ed-99f1-706ba5a958e3 could not be found. Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608bc65c-ea5b-45ed-99f1-706ba5a958e3 could not be found. Aug 04 13:56:02.041089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:02.044669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] Returning 404 to user: Instance 608bc65c-ea5b-45ed-99f1-706ba5a958e3 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:02.044669 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81654547-5cd4-4f34-a5a6-ae0b4c55b211 tempest-LiveMigrationNegativeTest-1470335772 tempest-LiveMigrationNegativeTest-1470335772-project] 10.222.0.66 "GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3" status: 404 len: 111 microversion: 2.1 time: 0.029669 Aug 04 13:56:02.044669 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 370/746] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:02 2022] GET /compute/v2.1/servers/608bc65c-ea5b-45ed-99f1-706ba5a958e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:56:02.105668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:02.114325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:02.116353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:02.117745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-96807efb-99c4-4961-aac7-4c44a3f80ee5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.237302 Aug 04 13:56:02.118302 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 377/747] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:01 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:02.418468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-017886cd-2de0-4354-bd9f-af16f5740c28 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:02.418468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-017886cd-2de0-4354-bd9f-af16f5740c28 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:02.423773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-16dbe849-3c17-404d-b1c7-4b5d44a30196 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:02.424610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-16dbe849-3c17-404d-b1c7-4b5d44a30196 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:02.425271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-017886cd-2de0-4354-bd9f-af16f5740c28 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.425908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-017886cd-2de0-4354-bd9f-af16f5740c28 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.426688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-017886cd-2de0-4354-bd9f-af16f5740c28 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.427127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-017886cd-2de0-4354-bd9f-af16f5740c28 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.435814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16dbe849-3c17-404d-b1c7-4b5d44a30196 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.436269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16dbe849-3c17-404d-b1c7-4b5d44a30196 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.440468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16dbe849-3c17-404d-b1c7-4b5d44a30196 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.441804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16dbe849-3c17-404d-b1c7-4b5d44a30196 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.669684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-017886cd-2de0-4354-bd9f-af16f5740c28 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:02.686092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-16dbe849-3c17-404d-b1c7-4b5d44a30196 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:02.686466 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-017886cd-2de0-4354-bd9f-af16f5740c28 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.272841 Aug 04 13:56:02.687057 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 371/748] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:02 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:02.692205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30f0c398-3eb5-4135-9f9c-3d3da0228632 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:02.692859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-30f0c398-3eb5-4135-9f9c-3d3da0228632 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:02.694962 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-16dbe849-3c17-404d-b1c7-4b5d44a30196 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.274907 Aug 04 13:56:02.696035 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 378/749] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:02 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:02.699192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30f0c398-3eb5-4135-9f9c-3d3da0228632 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.700096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30f0c398-3eb5-4135-9f9c-3d3da0228632 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.701008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30f0c398-3eb5-4135-9f9c-3d3da0228632 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.701347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30f0c398-3eb5-4135-9f9c-3d3da0228632 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.793749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-16487e3f-cd18-4350-8ca6-7e0c0be0aa84 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:02.794375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-16487e3f-cd18-4350-8ca6-7e0c0be0aa84 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:02.800782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16487e3f-cd18-4350-8ca6-7e0c0be0aa84 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.801278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16487e3f-cd18-4350-8ca6-7e0c0be0aa84 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.802063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16487e3f-cd18-4350-8ca6-7e0c0be0aa84 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:02.802684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16487e3f-cd18-4350-8ca6-7e0c0be0aa84 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:02.832160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:02.848094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=10 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:02.894137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-30f0c398-3eb5-4135-9f9c-3d3da0228632 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:02.908624 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30f0c398-3eb5-4135-9f9c-3d3da0228632 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1475 microversion: 2.1 time: 0.219997 Aug 04 13:56:02.910099 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 372/750] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:02 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1475 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:02.936188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-16487e3f-cd18-4350-8ca6-7e0c0be0aa84 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:02.955240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-16487e3f-cd18-4350-8ca6-7e0c0be0aa84 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.165175 Aug 04 13:56:02.955828 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 379/751] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:02 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:03.141382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:03.142094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:03.148588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:03.149087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:03.149863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:03.150301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:03.318813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:03.327301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:03.328897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:03.330174 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-17ffc5db-c367-4320-b1b5-7cb0f9b652e2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.192613 Aug 04 13:56:03.330645 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 373/752] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:03 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:03.707861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c73e7615-565e-4edf-a63d-225d80652b87 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:03.708590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c73e7615-565e-4edf-a63d-225d80652b87 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:03.716269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c73e7615-565e-4edf-a63d-225d80652b87 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:03.716435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8bce72eb-ae60-46f5-9813-6a559fd3f07c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:03.716723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c73e7615-565e-4edf-a63d-225d80652b87 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:03.717369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8bce72eb-ae60-46f5-9813-6a559fd3f07c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:03.717536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c73e7615-565e-4edf-a63d-225d80652b87 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:03.718117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c73e7615-565e-4edf-a63d-225d80652b87 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:03.727409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bce72eb-ae60-46f5-9813-6a559fd3f07c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:03.727868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bce72eb-ae60-46f5-9813-6a559fd3f07c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:03.729244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bce72eb-ae60-46f5-9813-6a559fd3f07c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:03.729704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bce72eb-ae60-46f5-9813-6a559fd3f07c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:03.734765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:03.939480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c73e7615-565e-4edf-a63d-225d80652b87 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:03.943203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8bce72eb-ae60-46f5-9813-6a559fd3f07c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:03.947909 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c73e7615-565e-4edf-a63d-225d80652b87 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.244258 Aug 04 13:56:03.949555 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 380/753] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:03 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:03.951527 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8bce72eb-ae60-46f5-9813-6a559fd3f07c tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1371 microversion: 2.1 time: 0.239483 Aug 04 13:56:03.952909 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 374/754] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:03 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:03.954637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c843c9f6-9b16-4cc7-bc6c-a4ecfe69d0aa tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:03.955350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c843c9f6-9b16-4cc7-bc6c-a4ecfe69d0aa tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:03.961359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c843c9f6-9b16-4cc7-bc6c-a4ecfe69d0aa tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:03.961910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c843c9f6-9b16-4cc7-bc6c-a4ecfe69d0aa tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:03.962773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c843c9f6-9b16-4cc7-bc6c-a4ecfe69d0aa tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:03.963306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c843c9f6-9b16-4cc7-bc6c-a4ecfe69d0aa tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:03.991452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea3c8417-aa16-4bfd-b3b9-263c003313f1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:03.992075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ea3c8417-aa16-4bfd-b3b9-263c003313f1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:03.999872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea3c8417-aa16-4bfd-b3b9-263c003313f1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:04.000379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea3c8417-aa16-4bfd-b3b9-263c003313f1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:04.001959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea3c8417-aa16-4bfd-b3b9-263c003313f1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:04.002532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea3c8417-aa16-4bfd-b3b9-263c003313f1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:04.082270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:04.099626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-ea3c8417-aa16-4bfd-b3b9-263c003313f1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:04.120041 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ea3c8417-aa16-4bfd-b3b9-263c003313f1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.142240 Aug 04 13:56:04.121433 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 375/755] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:03 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:04.123927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c843c9f6-9b16-4cc7-bc6c-a4ecfe69d0aa tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:04.132155 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c843c9f6-9b16-4cc7-bc6c-a4ecfe69d0aa tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1475 microversion: 2.1 time: 0.181391 Aug 04 13:56:04.133224 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 381/756] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:03 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1475 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:04.264414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e8a48dbe-bb7a-4db4-a1aa-fbacf955a382 req-d638b327-89da-44e2-a820-fde5828f087b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521a6443-46e3-4a58-9c10-1c23aba8dec8", "name": "network-vif-unplugged", "status": "completed", "tag": "34993f2e-4116-45e0-a4c8-4d10c39d4bb7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:04.275259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e8a48dbe-bb7a-4db4-a1aa-fbacf955a382 req-d638b327-89da-44e2-a820-fde5828f087b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:04.275736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e8a48dbe-bb7a-4db4-a1aa-fbacf955a382 req-d638b327-89da-44e2-a820-fde5828f087b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:04.289129 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e8a48dbe-bb7a-4db4-a1aa-fbacf955a382 req-d638b327-89da-44e2-a820-fde5828f087b service nova] Creating event network-vif-unplugged:34993f2e-4116-45e0-a4c8-4d10c39d4bb7 for instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 on n-h1-844627-10 Aug 04 13:56:04.295624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-e8a48dbe-bb7a-4db4-a1aa-fbacf955a382 req-d638b327-89da-44e2-a820-fde5828f087b service nova] Instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:56:04.301846 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e8a48dbe-bb7a-4db4-a1aa-fbacf955a382 req-d638b327-89da-44e2-a820-fde5828f087b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041140 Aug 04 13:56:04.302811 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 376/757] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:04.352426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:04.353071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:04.363908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:04.364354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:04.365156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:04.365591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:04.773607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:04.783028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:04.784720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:04.786201 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f946cd08-e8c0-42a8-953d-ec10b13fcf42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.437630 Aug 04 13:56:04.787079 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 382/758] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:04 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:04.882752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-04be6cdc-18cd-4bc1-83f1-71c1c08ea031 tempest-QuotaClassesAdminTestJSON-1068642485 tempest-QuotaClassesAdminTestJSON-1068642485-project-admin] Calling method '.version_select at 0x7f47007e5ca0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:04.883619 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:56:04.883619 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:56:04.895808 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-04be6cdc-18cd-4bc1-83f1-71c1c08ea031 tempest-QuotaClassesAdminTestJSON-1068642485 tempest-QuotaClassesAdminTestJSON-1068642485-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.139161 Aug 04 13:56:04.896361 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 377/759] 10.222.0.66 () {58 vars in 1185 bytes} [Thu Aug 4 13:56:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:56:04.907805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a0974f3-21bc-454e-ace1-6d37904a6403 tempest-QuotaClassesAdminTestJSON-1068642485 tempest-QuotaClassesAdminTestJSON-1068642485-project-admin] Action: 'update', calling method: .version_select at 0x7f4700ab4dc0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:04.911059 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:56:04.911059 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:56:04.970645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d8eee38e-902c-499d-a6c3-55c6b6818848 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:04.971384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d8eee38e-902c-499d-a6c3-55c6b6818848 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:04.978114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8eee38e-902c-499d-a6c3-55c6b6818848 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:04.978639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8eee38e-902c-499d-a6c3-55c6b6818848 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:04.979416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8eee38e-902c-499d-a6c3-55c6b6818848 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:04.980401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8eee38e-902c-499d-a6c3-55c6b6818848 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:04.983646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:05.123815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d8eee38e-902c-499d-a6c3-55c6b6818848 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:05.131625 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d8eee38e-902c-499d-a6c3-55c6b6818848 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.165199 Aug 04 13:56:05.132515 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 378/760] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:04 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:05.137217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ce0d101d-7f3c-4232-a1a0-d4eb7381a604 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:05.137848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ce0d101d-7f3c-4232-a1a0-d4eb7381a604 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:05.144161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce0d101d-7f3c-4232-a1a0-d4eb7381a604 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.144607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce0d101d-7f3c-4232-a1a0-d4eb7381a604 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:05.145449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce0d101d-7f3c-4232-a1a0-d4eb7381a604 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.146101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce0d101d-7f3c-4232-a1a0-d4eb7381a604 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:05.207367 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a0974f3-21bc-454e-ace1-6d37904a6403 tempest-QuotaClassesAdminTestJSON-1068642485 tempest-QuotaClassesAdminTestJSON-1068642485-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.303441 Aug 04 13:56:05.208030 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 383/761] 10.222.0.66 () {60 vars in 1206 bytes} [Thu Aug 4 13:56:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:05.212656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68309ba9-5a9a-41b7-9fc0-47f3a205cf7b tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:05.213348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68309ba9-5a9a-41b7-9fc0-47f3a205cf7b tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:05.220065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68309ba9-5a9a-41b7-9fc0-47f3a205cf7b tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.220527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68309ba9-5a9a-41b7-9fc0-47f3a205cf7b tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:05.221329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68309ba9-5a9a-41b7-9fc0-47f3a205cf7b tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.222212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68309ba9-5a9a-41b7-9fc0-47f3a205cf7b tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:05.305742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-68309ba9-5a9a-41b7-9fc0-47f3a205cf7b tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:05.316112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ce0d101d-7f3c-4232-a1a0-d4eb7381a604 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:05.325167 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ce0d101d-7f3c-4232-a1a0-d4eb7381a604 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1557 microversion: 2.1 time: 0.191428 Aug 04 13:56:05.325885 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 379/762] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:05 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1557 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:05.331177 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68309ba9-5a9a-41b7-9fc0-47f3a205cf7b tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.121896 Aug 04 13:56:05.331842 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 384/763] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:05 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:05.334653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f1f17134-83fa-4ebc-a56a-500748ec3652 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:05.335453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f1f17134-83fa-4ebc-a56a-500748ec3652 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:05.336742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-85e2674c-33ca-49b8-a252-43ea4a69b6f9 tempest-QuotaClassesAdminTestJSON-1068642485 tempest-QuotaClassesAdminTestJSON-1068642485-project-admin] Calling method '.version_select at 0x7f4700bb7dc0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:05.337935 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:56:05.337935 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:56:05.348934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1f17134-83fa-4ebc-a56a-500748ec3652 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.349384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1f17134-83fa-4ebc-a56a-500748ec3652 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:05.349517 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-85e2674c-33ca-49b8-a252-43ea4a69b6f9 tempest-QuotaClassesAdminTestJSON-1068642485 tempest-QuotaClassesAdminTestJSON-1068642485-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016528 Aug 04 13:56:05.350041 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 385/764] 10.222.0.66 () {58 vars in 1185 bytes} [Thu Aug 4 13:56:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:05.350150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1f17134-83fa-4ebc-a56a-500748ec3652 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.350602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1f17134-83fa-4ebc-a56a-500748ec3652 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:05.354965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d9c0ecc2-572a-411e-94b3-d0839a911b9b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:05.355458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d9c0ecc2-572a-411e-94b3-d0839a911b9b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:05.361424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9c0ecc2-572a-411e-94b3-d0839a911b9b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.361870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9c0ecc2-572a-411e-94b3-d0839a911b9b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:05.362636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9c0ecc2-572a-411e-94b3-d0839a911b9b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.363069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9c0ecc2-572a-411e-94b3-d0839a911b9b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:05.476901 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d9c0ecc2-572a-411e-94b3-d0839a911b9b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125645 Aug 04 13:56:05.477529 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 386/765] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 13:56:05 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:05.484013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9aeb7bc-4fcb-4289-9350-c4e024ba883f tempest-QuotaClassesAdminTestJSON-1068642485 tempest-QuotaClassesAdminTestJSON-1068642485-project-admin] Action: 'update', calling method: .version_select at 0x7f4700c67940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:05.488909 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:56:05.488909 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:56:05.591987 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b9aeb7bc-4fcb-4289-9350-c4e024ba883f tempest-QuotaClassesAdminTestJSON-1068642485 tempest-QuotaClassesAdminTestJSON-1068642485-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.113123 Aug 04 13:56:05.602843 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 387/766] 10.222.0.66 () {60 vars in 1206 bytes} [Thu Aug 4 13:56:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:05.721170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f1f17134-83fa-4ebc-a56a-500748ec3652 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:05.731818 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f1f17134-83fa-4ebc-a56a-500748ec3652 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1473 microversion: 2.1 time: 0.404471 Aug 04 13:56:05.733516 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 380/767] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:05 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1473 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:05.810836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:05.812549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:05.820615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.821342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:05.822354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:05.823010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:06.162264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-886b0c31-ad0d-4f2e-ad21-884a5eb73ab4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:06.162959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-886b0c31-ad0d-4f2e-ad21-884a5eb73ab4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:06.166701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:06.171461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-886b0c31-ad0d-4f2e-ad21-884a5eb73ab4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:06.172064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-886b0c31-ad0d-4f2e-ad21-884a5eb73ab4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:06.172969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-886b0c31-ad0d-4f2e-ad21-884a5eb73ab4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:06.173584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-886b0c31-ad0d-4f2e-ad21-884a5eb73ab4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:06.180252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:06.192646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:06.194287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:06.195482 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0110a6cc-69d8-4606-afbd-2095a240ff97 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.389820 Aug 04 13:56:06.196054 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 388/768] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:05 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:06.361269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-057c58ee-2049-41b5-bd17-ff2bf91b0b24 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:06.362363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-057c58ee-2049-41b5-bd17-ff2bf91b0b24 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:06.368660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-057c58ee-2049-41b5-bd17-ff2bf91b0b24 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:06.369378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-057c58ee-2049-41b5-bd17-ff2bf91b0b24 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:06.370162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-057c58ee-2049-41b5-bd17-ff2bf91b0b24 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:06.371389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-057c58ee-2049-41b5-bd17-ff2bf91b0b24 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:06.509718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-057c58ee-2049-41b5-bd17-ff2bf91b0b24 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:06.551206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-057c58ee-2049-41b5-bd17-ff2bf91b0b24 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.193981 Aug 04 13:56:06.551785 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 389/769] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:06 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:06.619173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-886b0c31-ad0d-4f2e-ad21-884a5eb73ab4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:06.629200 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-886b0c31-ad0d-4f2e-ad21-884a5eb73ab4 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.478654 Aug 04 13:56:06.630320 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 381/770] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:06 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:06.756161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e6b3747b-9cff-4726-91d5-25454ddf3105 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:06.757210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e6b3747b-9cff-4726-91d5-25454ddf3105 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:06.780640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6b3747b-9cff-4726-91d5-25454ddf3105 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:06.785126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6b3747b-9cff-4726-91d5-25454ddf3105 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:06.787103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6b3747b-9cff-4726-91d5-25454ddf3105 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:06.787748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6b3747b-9cff-4726-91d5-25454ddf3105 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:07.231196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:07.232820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:07.241869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:07.242508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:07.243768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:07.244635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:07.351849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e6b3747b-9cff-4726-91d5-25454ddf3105 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:07.363322 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e6b3747b-9cff-4726-91d5-25454ddf3105 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1473 microversion: 2.1 time: 0.612094 Aug 04 13:56:07.364154 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 390/771] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:06 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1473 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:07.510092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:07.518813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:07.520328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:07.521540 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1f320c3-4994-4afe-9f4c-c5b770b2fb69 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.302876 Aug 04 13:56:07.534084 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 382/772] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:07 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:07.581777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-92d37968-5df5-4252-9970-d5cd59b4acf3 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:07.583003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-92d37968-5df5-4252-9970-d5cd59b4acf3 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:07.598033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92d37968-5df5-4252-9970-d5cd59b4acf3 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:07.599410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92d37968-5df5-4252-9970-d5cd59b4acf3 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:07.600726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92d37968-5df5-4252-9970-d5cd59b4acf3 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:07.601413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92d37968-5df5-4252-9970-d5cd59b4acf3 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:07.607249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-8a9dbb37-2c18-4277-b8c9-ca7cd157f103 req-d5d32326-12d3-470b-af69-5c58c7bf4899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9e1d4b-b8b1-44de-9409-65db8223e4b2", "tag": "dddc2305-f311-4ae1-af98-ee954b3cd677"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:07.620476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8a9dbb37-2c18-4277-b8c9-ca7cd157f103 req-d5d32326-12d3-470b-af69-5c58c7bf4899 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:07.621231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8a9dbb37-2c18-4277-b8c9-ca7cd157f103 req-d5d32326-12d3-470b-af69-5c58c7bf4899 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:07.633274 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-8a9dbb37-2c18-4277-b8c9-ca7cd157f103 req-d5d32326-12d3-470b-af69-5c58c7bf4899 service nova] Creating event network-changed:dddc2305-f311-4ae1-af98-ee954b3cd677 for instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 on n-h1-844627-10 Aug 04 13:56:07.639994 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-8a9dbb37-2c18-4277-b8c9-ca7cd157f103 req-d5d32326-12d3-470b-af69-5c58c7bf4899 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040296 Aug 04 13:56:07.643938 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 383/773] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:07.656101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-13c907d8-8498-4960-b3e7-ec125aeccf9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:07.657206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-13c907d8-8498-4960-b3e7-ec125aeccf9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:07.665393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13c907d8-8498-4960-b3e7-ec125aeccf9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:07.665845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13c907d8-8498-4960-b3e7-ec125aeccf9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:07.666617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13c907d8-8498-4960-b3e7-ec125aeccf9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:07.667048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13c907d8-8498-4960-b3e7-ec125aeccf9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:07.694933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-92d37968-5df5-4252-9970-d5cd59b4acf3 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:07.717522 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-92d37968-5df5-4252-9970-d5cd59b4acf3 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.144661 Aug 04 13:56:07.718424 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 391/774] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:07 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:07.849027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-13c907d8-8498-4960-b3e7-ec125aeccf9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:07.857941 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-13c907d8-8498-4960-b3e7-ec125aeccf9f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.207724 Aug 04 13:56:07.860914 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 384/775] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:07 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:08.383942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-328869e5-3228-474a-9ae5-8e0d2b01f378 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:08.384674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-328869e5-3228-474a-9ae5-8e0d2b01f378 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:08.392166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-328869e5-3228-474a-9ae5-8e0d2b01f378 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:08.392849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-328869e5-3228-474a-9ae5-8e0d2b01f378 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:08.393775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-328869e5-3228-474a-9ae5-8e0d2b01f378 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:08.394215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-328869e5-3228-474a-9ae5-8e0d2b01f378 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:08.551295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:08.552684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:08.570361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:08.571236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:08.574263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:08.574997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:08.671921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-328869e5-3228-474a-9ae5-8e0d2b01f378 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:08.684642 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-328869e5-3228-474a-9ae5-8e0d2b01f378 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1473 microversion: 2.1 time: 0.304305 Aug 04 13:56:08.685665 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 392/776] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:08 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:08.751083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02af143e-769b-408c-99ee-a2a5112795d2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:08.752065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-02af143e-769b-408c-99ee-a2a5112795d2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:08.759097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02af143e-769b-408c-99ee-a2a5112795d2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:08.760006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02af143e-769b-408c-99ee-a2a5112795d2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:08.761735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02af143e-769b-408c-99ee-a2a5112795d2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:08.763585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02af143e-769b-408c-99ee-a2a5112795d2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:08.879847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-02af143e-769b-408c-99ee-a2a5112795d2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:08.910450 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-02af143e-769b-408c-99ee-a2a5112795d2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.163985 Aug 04 13:56:08.911586 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 393/777] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:08 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:08.917026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c13fc3a5-466d-4090-b10a-a1413ba2ce4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:08.917916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c13fc3a5-466d-4090-b10a-a1413ba2ce4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:08.923558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:UPDATE=21,nova_api:SELECT=70,nova_api:INSERT=9 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:08.925351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c13fc3a5-466d-4090-b10a-a1413ba2ce4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:08.925968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c13fc3a5-466d-4090-b10a-a1413ba2ce4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:08.926938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c13fc3a5-466d-4090-b10a-a1413ba2ce4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:08.927536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c13fc3a5-466d-4090-b10a-a1413ba2ce4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:09.024661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:09.041794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:09.044266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:09.046389 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d0f17126-d6a3-47ff-aae6-6d7e18d6fde5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1567 microversion: 2.25 time: 0.501853 Aug 04 13:56:09.047363 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 385/778] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:08 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1567 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:09.253845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c13fc3a5-466d-4090-b10a-a1413ba2ce4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:09.268792 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c13fc3a5-466d-4090-b10a-a1413ba2ce4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.355960 Aug 04 13:56:09.271571 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 394/779] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:08 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:09.536785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75290cf4-f646-44f7-b1da-df4a9d9c3b43 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Calling method '.version_select at 0x7f4700bf1670>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:09.626166 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75290cf4-f646-44f7-b1da-df4a9d9c3b43 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 200 len: 371 microversion: 2.1 time: 0.267125 Aug 04 13:56:09.626798 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 386/780] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 13:56:09 2022] GET /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:09.644525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf3cbf72-a5c3-453d-a1b0-6c3e390500e6 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Action: 'update', calling method: .version_select at 0x7f4700868430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:09.706878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eaf13d7d-bb0c-482f-8130-91d38f66c24a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:09.707770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eaf13d7d-bb0c-482f-8130-91d38f66c24a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:09.716306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaf13d7d-bb0c-482f-8130-91d38f66c24a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:09.717352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaf13d7d-bb0c-482f-8130-91d38f66c24a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:09.718410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaf13d7d-bb0c-482f-8130-91d38f66c24a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:09.719135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaf13d7d-bb0c-482f-8130-91d38f66c24a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:09.756531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf3cbf72-a5c3-453d-a1b0-6c3e390500e6 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:09.756531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf3cbf72-a5c3-453d-a1b0-6c3e390500e6 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:09.761359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf3cbf72-a5c3-453d-a1b0-6c3e390500e6 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:09.761963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf3cbf72-a5c3-453d-a1b0-6c3e390500e6 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:09.846687 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf3cbf72-a5c3-453d-a1b0-6c3e390500e6 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 200 len: 328 microversion: 2.1 time: 0.211048 Aug 04 13:56:09.847367 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 395/781] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 13:56:09 2022] PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 328 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:09.938610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-87eef608-e506-4c1c-a99d-075c032b1043 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:09.939780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-87eef608-e506-4c1c-a99d-075c032b1043 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:09.946632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87eef608-e506-4c1c-a99d-075c032b1043 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:09.947274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87eef608-e506-4c1c-a99d-075c032b1043 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:09.948230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87eef608-e506-4c1c-a99d-075c032b1043 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:09.949461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87eef608-e506-4c1c-a99d-075c032b1043 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.083641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-87eef608-e506-4c1c-a99d-075c032b1043 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:10.102882 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-87eef608-e506-4c1c-a99d-075c032b1043 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.168014 Aug 04 13:56:10.103471 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 396/782] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:09 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:10.185217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1985960989", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:10.193528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eaf13d7d-bb0c-482f-8130-91d38f66c24a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:10.214103 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eaf13d7d-bb0c-482f-8130-91d38f66c24a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1470 microversion: 2.1 time: 0.510912 Aug 04 13:56:10.215405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 387/783] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:09 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1470 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:10.220921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:10.221831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:10.228539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.229558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.230928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.231685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.264047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:10.493518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:10.502669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:10.504377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:10.505610 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e08a6713-3f84-4884-98a2-3bff8993f99e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1557 microversion: 2.25 time: 0.288955 Aug 04 13:56:10.506320 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 388/784] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:10 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1557 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:10.510961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-14022a7d-7262-4c7e-9cdb-c381d79d3458 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:10.512018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-14022a7d-7262-4c7e-9cdb-c381d79d3458 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:10.524149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14022a7d-7262-4c7e-9cdb-c381d79d3458 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.524630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14022a7d-7262-4c7e-9cdb-c381d79d3458 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.525528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14022a7d-7262-4c7e-9cdb-c381d79d3458 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.525974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14022a7d-7262-4c7e-9cdb-c381d79d3458 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.557108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:10.557602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:10.558644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:10.559060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:10.559512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:10.569364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.569815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.570899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.571422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.588751 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-14022a7d-7262-4c7e-9cdb-c381d79d3458 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8/action" status: 204 len: 0 microversion: 2.1 time: 0.081202 Aug 04 13:56:10.589448 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 389/785] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:56:10 2022] POST /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:56:10.594682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82d857f2-1d66-40c9-a809-c6183ae82cf0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:10.595398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-82d857f2-1d66-40c9-a809-c6183ae82cf0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:10.596333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Getting quotas for project dba8b89372824d37af687627a5243484. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:10.604992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Getting quotas for user 22efe358a84b4cb3b0c6e2ba8f39f305 and project dba8b89372824d37af687627a5243484. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:10.605210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82d857f2-1d66-40c9-a809-c6183ae82cf0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.605210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82d857f2-1d66-40c9-a809-c6183ae82cf0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.605210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82d857f2-1d66-40c9-a809-c6183ae82cf0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.605210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82d857f2-1d66-40c9-a809-c6183ae82cf0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.634534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.utils [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] cores quota exceeded for dba8b89372824d37af687627a5243484, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130961) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 13:56:10.635367 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Request method failure captured: Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 145 Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68_4v0mF9-GAsoYQUK0DICkPGyF7TeKVzDG4rzi5N5CSNp6jF-uYYozEfFZ1hozyAWPWDEmotOWwSr2_H2c-mTr-YKZG29iLvHJSF8xjjXerxRNwkdlyCgaV4gdQ-ASUW31jfKoRgm2w1FXQuacyDpTyW929LMgsbHw9cnOEH74QCn8 Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dba8b89372824d37af687627a5243484 Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:56:10.662325 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dba8b89372824d37af687627a5243484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dba8b89372824d37af687627a5243484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dba8b89372824d37af687627a5243484"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dba8b89372824d37af687627a5243484"}]}] Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dba8b89372824d37af687627a5243484 Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-QuotasAdminNegativeTest-1974814784-project Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 22efe358a84b4cb3b0c6e2ba8f39f305 Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-QuotasAdminNegativeTest-1974814784-project Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1985960989", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} Aug 04 13:56:10.664165 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1985960989', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452'}}} Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 13:56:10.665037 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:10.666102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:10.667359 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:10.668597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:10.668597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:10.668597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:10.668597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:10.668597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 13:56:10.668597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:10.668597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:10.668597 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-46ff7b36-7e8e-4d6b-aa12-d4b4b714dfde tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.559436 Aug 04 13:56:10.668597 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 397/786] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:56:10 2022] POST /compute/v2.1/servers => generated 111 bytes in 561 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:56:10.671701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be403ca1-ff1a-4686-a5f8-af6d900e0fbb tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '.version_select at 0x7f4700935040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:10.675419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be403ca1-ff1a-4686-a5f8-af6d900e0fbb tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.675878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be403ca1-ff1a-4686-a5f8-af6d900e0fbb tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.685779 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be403ca1-ff1a-4686-a5f8-af6d900e0fbb tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 1538 microversion: 2.25 time: 0.019934 Aug 04 13:56:10.686370 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 398/787] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Aug 4 13:56:10 2022] GET /compute/v2.1/os-migrations => generated 1538 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:10.692814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-17eb9913-6ac1-4f24-927e-0f5e4c8aa004 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:10.693675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-17eb9913-6ac1-4f24-927e-0f5e4c8aa004 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:10.700742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17eb9913-6ac1-4f24-927e-0f5e4c8aa004 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.701299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17eb9913-6ac1-4f24-927e-0f5e4c8aa004 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.702291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17eb9913-6ac1-4f24-927e-0f5e4c8aa004 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.702896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17eb9913-6ac1-4f24-927e-0f5e4c8aa004 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.726823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:10.857819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82d857f2-1d66-40c9-a809-c6183ae82cf0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:10.868581 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-82d857f2-1d66-40c9-a809-c6183ae82cf0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.277628 Aug 04 13:56:10.869183 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 390/788] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:10 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:10.875231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5c2ce45-574c-4861-bf14-f9852a6cd1e9 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Action: 'update', calling method: .version_select at 0x7f470047bb80>, body: {"quota_set": {"cores": 20}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:10.949907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-17eb9913-6ac1-4f24-927e-0f5e4c8aa004 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:10.955168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5c2ce45-574c-4861-bf14-f9852a6cd1e9 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.955667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5c2ce45-574c-4861-bf14-f9852a6cd1e9 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.956694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5c2ce45-574c-4861-bf14-f9852a6cd1e9 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.957762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5c2ce45-574c-4861-bf14-f9852a6cd1e9 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.958206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-17eb9913-6ac1-4f24-927e-0f5e4c8aa004 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1470 microversion: 2.1 time: 0.269205 Aug 04 13:56:10.958758 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 399/789] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:10 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:10.965415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-473582b1-bad1-49bf-abd8-c4b398e88c0d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:10.966240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-473582b1-bad1-49bf-abd8-c4b398e88c0d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:10.975783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-473582b1-bad1-49bf-abd8-c4b398e88c0d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.976515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-473582b1-bad1-49bf-abd8-c4b398e88c0d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:10.977333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-473582b1-bad1-49bf-abd8-c4b398e88c0d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:10.977776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-473582b1-bad1-49bf-abd8-c4b398e88c0d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:11.030450 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5c2ce45-574c-4861-bf14-f9852a6cd1e9 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 200 len: 329 microversion: 2.1 time: 0.158549 Aug 04 13:56:11.031292 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 391/790] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 13:56:10 2022] PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 329 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:11.044022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5e06ee7a-d4fc-4361-83ac-5b26a40a2db3 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Calling method '.version_select at 0x7f47007bc940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:11.125413 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5e06ee7a-d4fc-4361-83ac-5b26a40a2db3 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 200 len: 371 microversion: 2.1 time: 0.085724 Aug 04 13:56:11.125995 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 392/791] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 13:56:11 2022] GET /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:11.137312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3cebd4dd-da87-4dee-829f-8472adb7dad8 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:11.137921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3cebd4dd-da87-4dee-829f-8472adb7dad8 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:11.144232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3cebd4dd-da87-4dee-829f-8472adb7dad8 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:11.144650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3cebd4dd-da87-4dee-829f-8472adb7dad8 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:11.145467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3cebd4dd-da87-4dee-829f-8472adb7dad8 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:11.145905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3cebd4dd-da87-4dee-829f-8472adb7dad8 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:11.213389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-473582b1-bad1-49bf-abd8-c4b398e88c0d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid d3861160-fd38-4411-9578-cbe56e26a0f7 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:11.227291 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-473582b1-bad1-49bf-abd8-c4b398e88c0d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 2051 microversion: 2.25 time: 0.267289 Aug 04 13:56:11.228827 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 400/792] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:10 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 2051 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:11.229904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:11.235895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-3cebd4dd-da87-4dee-829f-8472adb7dad8 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:11.255457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-98a011a1-324d-4b42-9221-65b896a22223 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Action: 'update', calling method: .version_select at 0x7f47008dac10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:11.270529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3cebd4dd-da87-4dee-829f-8472adb7dad8 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.137437 Aug 04 13:56:11.271608 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 393/793] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:11 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:11.349648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98a011a1-324d-4b42-9221-65b896a22223 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:11.350103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98a011a1-324d-4b42-9221-65b896a22223 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:11.350914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98a011a1-324d-4b42-9221-65b896a22223 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:11.351655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98a011a1-324d-4b42-9221-65b896a22223 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:11.366572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1046291881", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "16aa4d93-210e-4f85-a9b8-18b7b6afc7af"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:11.409981 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-98a011a1-324d-4b42-9221-65b896a22223 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 200 len: 328 microversion: 2.1 time: 0.180325 Aug 04 13:56:11.423407 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 401/794] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 13:56:11 2022] PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 328 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:11.446983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] validate_networks() for [('16aa4d93-210e-4f85-a9b8-18b7b6afc7af', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:11.472650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-756542960", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:11.532655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:12.194168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:12.194746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:12.195100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:12.195514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:12.196006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:12.206789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.207377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.208447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.208603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.226302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Getting quotas for project dba8b89372824d37af687627a5243484. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:12.231638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Getting quotas for user 22efe358a84b4cb3b0c6e2ba8f39f305 and project dba8b89372824d37af687627a5243484. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:12.245333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.utils [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] instances quota exceeded for dba8b89372824d37af687627a5243484, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130961) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 13:56:12.246182 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Request method failure captured: Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 144 Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68_4v0mF9-GAsoYQUK0DICkPGyF7TeKVzDG4rzi5N5CSNp6jF-uYYozEfFZ1hozyAWPWDEmotOWwSr2_H2c-mTr-YKZG29iLvHJSF8xjjXerxRNwkdlyCgaV4gdQ-ASUW31jfKoRgm2w1FXQuacyDpTyW929LMgsbHw9cnOEH74QCn8 Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dba8b89372824d37af687627a5243484 Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:56:12.249093 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dba8b89372824d37af687627a5243484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dba8b89372824d37af687627a5243484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dba8b89372824d37af687627a5243484"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dba8b89372824d37af687627a5243484"}]}] Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dba8b89372824d37af687627a5243484 Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-QuotasAdminNegativeTest-1974814784-project Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 22efe358a84b4cb3b0c6e2ba8f39f305 Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-QuotasAdminNegativeTest-1974814784-project Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-756542960", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} Aug 04 13:56:12.250600 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-756542960', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452'}}} Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 13:56:12.251452 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:12.252559 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:12.254424 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:12.256265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:12.256265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:12.256265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:12.256265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:12.256265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 13:56:12.256265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:12.256265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:12.256265 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-52a146f0-9930-4b91-a35f-8b4b582eda9a tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.781801 Aug 04 13:56:12.256265 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 402/795] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:56:11 2022] POST /compute/v2.1/servers => generated 119 bytes in 787 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:56:12.259583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-d3cce47b-2d56-4570-935c-2d258c253660 req-15c6f22e-ace4-4428-9a4c-a610a01dbc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521a6443-46e3-4a58-9c10-1c23aba8dec8", "name": "network-vif-plugged", "status": "completed", "tag": "34993f2e-4116-45e0-a4c8-4d10c39d4bb7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:12.269189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d3cce47b-2d56-4570-935c-2d258c253660 req-15c6f22e-ace4-4428-9a4c-a610a01dbc0e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.269664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d3cce47b-2d56-4570-935c-2d258c253660 req-15c6f22e-ace4-4428-9a4c-a610a01dbc0e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.281764 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-d3cce47b-2d56-4570-935c-2d258c253660 req-15c6f22e-ace4-4428-9a4c-a610a01dbc0e service nova] Creating event network-vif-plugged:34993f2e-4116-45e0-a4c8-4d10c39d4bb7 for instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 on n-h1-844627-10 Aug 04 13:56:12.292550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-d3cce47b-2d56-4570-935c-2d258c253660 req-15c6f22e-ace4-4428-9a4c-a610a01dbc0e service nova] Instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:56:12.299214 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-d3cce47b-2d56-4570-935c-2d258c253660 req-15c6f22e-ace4-4428-9a4c-a610a01dbc0e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043034 Aug 04 13:56:12.299872 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 403/796] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:12.305225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dddae33c-b666-4de9-8a3c-c175ce2de131 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:12.305947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dddae33c-b666-4de9-8a3c-c175ce2de131 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:12.313198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dddae33c-b666-4de9-8a3c-c175ce2de131 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.313646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dddae33c-b666-4de9-8a3c-c175ce2de131 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.314510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dddae33c-b666-4de9-8a3c-c175ce2de131 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.314976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dddae33c-b666-4de9-8a3c-c175ce2de131 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.423980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:12.424448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:12.424859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:12.425304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:12.425711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:12.435271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.435826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.436660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.437118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.453695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:12.458627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for user d9613691b93147d48d9f1a51bf5767c9 and project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:12.470902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:56:12.472105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dddae33c-b666-4de9-8a3c-c175ce2de131 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:12.473182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:56:12.480248 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dddae33c-b666-4de9-8a3c-c175ce2de131 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.178725 Aug 04 13:56:12.480818 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 404/797] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:12 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:12.485254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-425ec105-67d4-4a79-93a9-a0e77a6608d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:12.485868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-425ec105-67d4-4a79-93a9-a0e77a6608d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:12.492916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-425ec105-67d4-4a79-93a9-a0e77a6608d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.493553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-425ec105-67d4-4a79-93a9-a0e77a6608d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.494155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-425ec105-67d4-4a79-93a9-a0e77a6608d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.494581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-425ec105-67d4-4a79-93a9-a0e77a6608d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.518997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e9207836-3c19-4bf9-82b2-816a4c4cc6ff tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.157426 Aug 04 13:56:12.519919 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 394/798] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 13:56:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 13:56:12.524128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ee0d0e9b-549e-46bd-9388-94897fdc92ba tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Action: 'update', calling method: .version_select at 0x7f47005753a0>, body: {"quota_set": {"instances": 10}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:12.609770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee0d0e9b-549e-46bd-9388-94897fdc92ba tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.610230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee0d0e9b-549e-46bd-9388-94897fdc92ba tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.611045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee0d0e9b-549e-46bd-9388-94897fdc92ba tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.611482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee0d0e9b-549e-46bd-9388-94897fdc92ba tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.640552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-425ec105-67d4-4a79-93a9-a0e77a6608d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:12.648729 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-425ec105-67d4-4a79-93a9-a0e77a6608d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1470 microversion: 2.1 time: 0.166890 Aug 04 13:56:12.649358 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 405/799] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:12 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:12.671691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a587653-cad6-43c5-9980-f77d16bbe2a6 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:12.672319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a587653-cad6-43c5-9980-f77d16bbe2a6 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:12.680143 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ee0d0e9b-549e-46bd-9388-94897fdc92ba tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 200 len: 329 microversion: 2.1 time: 0.159300 Aug 04 13:56:12.680704 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 395/800] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 13:56:12 2022] PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 329 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:12.686946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-252a8fea-7c95-477b-a144-620590eec885 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:12.687333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-252a8fea-7c95-477b-a144-620590eec885 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:12.696632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a587653-cad6-43c5-9980-f77d16bbe2a6 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.697286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a587653-cad6-43c5-9980-f77d16bbe2a6 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.697961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a587653-cad6-43c5-9980-f77d16bbe2a6 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.699014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a587653-cad6-43c5-9980-f77d16bbe2a6 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.751800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-252a8fea-7c95-477b-a144-620590eec885 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:12.760456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-252a8fea-7c95-477b-a144-620590eec885 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:12.762932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-252a8fea-7c95-477b-a144-620590eec885 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:12.764140 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-252a8fea-7c95-477b-a144-620590eec885 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1262 microversion: 2.25 time: 0.082289 Aug 04 13:56:12.765193 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 396/801] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:12 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:12.778279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aae5f51a-081b-4b94-a3a2-3cfd9cd4b893 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Calling method '.version_select at 0x7f4700bf18b0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:12.809223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-7a587653-cad6-43c5-9980-f77d16bbe2a6 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:12.831390 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a587653-cad6-43c5-9980-f77d16bbe2a6 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.165284 Aug 04 13:56:12.831915 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 406/802] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:12 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:12.879277 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aae5f51a-081b-4b94-a3a2-3cfd9cd4b893 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 200 len: 371 microversion: 2.1 time: 0.112882 Aug 04 13:56:12.880024 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 397/803] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 13:56:12 2022] GET /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:12.891670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f2cd585-bc4a-450c-99d5-a2f56486e94a tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Action: 'update', calling method: .version_select at 0x7f4700503d30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:12.962605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f2cd585-bc4a-450c-99d5-a2f56486e94a tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.963309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f2cd585-bc4a-450c-99d5-a2f56486e94a tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:12.964826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f2cd585-bc4a-450c-99d5-a2f56486e94a tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:12.964826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f2cd585-bc4a-450c-99d5-a2f56486e94a tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.017936 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9f2cd585-bc4a-450c-99d5-a2f56486e94a tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 200 len: 325 microversion: 2.1 time: 0.130071 Aug 04 13:56:13.018816 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 407/804] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 13:56:12 2022] PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 325 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:13.078697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-465128183", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:13.136987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:13.343029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:13.343447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:13.343917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:13.344322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:13.344725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:13.354223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.354759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.355549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.355994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.373047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Getting quotas for project dba8b89372824d37af687627a5243484. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:13.379664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Getting quotas for user 22efe358a84b4cb3b0c6e2ba8f39f305 and project dba8b89372824d37af687627a5243484. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:13.397615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.utils [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] ram quota exceeded for dba8b89372824d37af687627a5243484, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130960) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 13:56:13.398803 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Request method failure captured: Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 144 Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68_4v0mF9-GAsoYQUK0DICkPGyF7TeKVzDG4rzi5N5CSNp6jF-uYYozEfFZ1hozyAWPWDEmotOWwSr2_H2c-mTr-YKZG29iLvHJSF8xjjXerxRNwkdlyCgaV4gdQ-ASUW31jfKoRgm2w1FXQuacyDpTyW929LMgsbHw9cnOEH74QCn8 Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: dba8b89372824d37af687627a5243484 Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:56:13.405145 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dba8b89372824d37af687627a5243484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dba8b89372824d37af687627a5243484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dba8b89372824d37af687627a5243484"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dba8b89372824d37af687627a5243484"}]}] Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: dba8b89372824d37af687627a5243484 Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-QuotasAdminNegativeTest-1974814784-project Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 22efe358a84b4cb3b0c6e2ba8f39f305 Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-QuotasAdminNegativeTest-1974814784-project Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-465128183", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} Aug 04 13:56:13.406684 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-465128183', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452'}}} Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 13:56:13.407584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:13.409004 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.410717 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:13.412307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:13.412307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:13.412307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:13.412307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:13.412307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 13:56:13.412307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.412307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:13.412307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b8385f0c-e26f-48ca-b993-6502fe017ab2 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.332813 Aug 04 13:56:13.412307 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 398/805] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:56:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 335 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:56:13.418817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3e7ea3c-4c7a-4f60-8fc0-1d8077e75d82 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Action: 'update', calling method: .version_select at 0x7f47009e0820>, body: {"quota_set": {"ram": 51200}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:13.481331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3e7ea3c-4c7a-4f60-8fc0-1d8077e75d82 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.481782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3e7ea3c-4c7a-4f60-8fc0-1d8077e75d82 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.482581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3e7ea3c-4c7a-4f60-8fc0-1d8077e75d82 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.483022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3e7ea3c-4c7a-4f60-8fc0-1d8077e75d82 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.502398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77156146-47b6-4380-b41d-0b80f3d8a425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:13.503347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-77156146-47b6-4380-b41d-0b80f3d8a425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:13.512046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77156146-47b6-4380-b41d-0b80f3d8a425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.512562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77156146-47b6-4380-b41d-0b80f3d8a425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.513534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77156146-47b6-4380-b41d-0b80f3d8a425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.513965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77156146-47b6-4380-b41d-0b80f3d8a425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.541802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:13.546197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3e7ea3c-4c7a-4f60-8fc0-1d8077e75d82 tempest-QuotasAdminNegativeTest-622605897 tempest-QuotasAdminNegativeTest-622605897-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 200 len: 329 microversion: 2.1 time: 0.131277 Aug 04 13:56:13.546778 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 408/806] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 13:56:13 2022] PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:13.567162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-58dcd846-4559-4cc5-9d0f-ba7e01bccaf5 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Action: 'update', calling method: .version_select at 0x7f4700503f70>, body: {"quota_set": {"ram": 0}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:13.572924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-58dcd846-4559-4cc5-9d0f-ba7e01bccaf5 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '22efe358a84b4cb3b0c6e2ba8f39f305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dba8b89372824d37af687627a5243484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-58dcd846-4559-4cc5-9d0f-ba7e01bccaf5 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Request method failure captured: Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: request: PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 HTTP/1.1 Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 25 Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68_4v0mF9-GAsoYQUK0DICkPGyF7TeKVzDG4rzi5N5CSNp6jF-uYYozEfFZ1hozyAWPWDEmotOWwSr2_H2c-mTr-YKZG29iLvHJSF8xjjXerxRNwkdlyCgaV4gdQ-ASUW31jfKoRgm2w1FXQuacyDpTyW929LMgsbHw9cnOEH74QCn8 Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dba8b89372824d37af687627a5243484 Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:56:13.581862 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dba8b89372824d37af687627a5243484"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dba8b89372824d37af687627a5243484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dba8b89372824d37af687627a5243484"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dba8b89372824d37af687627a5243484"}]}] Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dba8b89372824d37af687627a5243484 Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1974814784 Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-QuotasAdminNegativeTest-1974814784-project Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 22efe358a84b4cb3b0c6e2ba8f39f305 Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-QuotasAdminNegativeTest-1974814784-project Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: {"quota_set": {"ram": 0}} Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 13:56:13.583553 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dba8b89372824d37af687627a5243484', 'body': {'quota_set': {'ram': 0}}} Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:13.584620 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.586314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:13.587828 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:13.587828 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:13.587828 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 13:56:13.587828 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 13:56:13.587828 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 13:56:13.587828 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:13.589358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-58dcd846-4559-4cc5-9d0f-ba7e01bccaf5 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:13.590233 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-58dcd846-4559-4cc5-9d0f-ba7e01bccaf5 tempest-QuotasAdminNegativeTest-1974814784 tempest-QuotasAdminNegativeTest-1974814784-project] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484" status: 403 len: 116 microversion: 2.1 time: 0.034761 Aug 04 13:56:13.590812 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 409/807] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 13:56:13 2022] PUT /compute/v2.1/os-quota-sets/dba8b89372824d37af687627a5243484 => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:56:13.678352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eb1c7f8e-dc32-438f-9348-d332dceba677 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:13.678809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eb1c7f8e-dc32-438f-9348-d332dceba677 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:13.691330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb1c7f8e-dc32-438f-9348-d332dceba677 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.699333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb1c7f8e-dc32-438f-9348-d332dceba677 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.700535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb1c7f8e-dc32-438f-9348-d332dceba677 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.702247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb1c7f8e-dc32-438f-9348-d332dceba677 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.740050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-77156146-47b6-4380-b41d-0b80f3d8a425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:13.753787 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-77156146-47b6-4380-b41d-0b80f3d8a425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.254992 Aug 04 13:56:13.772739 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 399/808] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:13 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:13.787773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:13.788911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:13.793504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:13.798649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.799160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.799884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.800323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.905262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:13.914916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:13.916626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:13.918022 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-288a51bc-1563-4da3-a8b3-ac5dbc649a0e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1320 microversion: 2.25 time: 0.135177 Aug 04 13:56:13.918763 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 400/809] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:13 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1320 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:13.923089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-afd1b635-9c35-4b77-9b1b-0724107902dd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:13.923711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-afd1b635-9c35-4b77-9b1b-0724107902dd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:13.938066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afd1b635-9c35-4b77-9b1b-0724107902dd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.938521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afd1b635-9c35-4b77-9b1b-0724107902dd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.939372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afd1b635-9c35-4b77-9b1b-0724107902dd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:13.939851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afd1b635-9c35-4b77-9b1b-0724107902dd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:13.973544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eb1c7f8e-dc32-438f-9348-d332dceba677 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:13.982773 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eb1c7f8e-dc32-438f-9348-d332dceba677 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1462 microversion: 2.1 time: 0.308698 Aug 04 13:56:13.983351 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 410/810] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:13 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1462 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:14.005791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c663927d-289c-438d-922c-f6be0771149d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:14.006691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c663927d-289c-438d-922c-f6be0771149d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:14.014798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c663927d-289c-438d-922c-f6be0771149d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:14.015976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c663927d-289c-438d-922c-f6be0771149d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:14.016850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c663927d-289c-438d-922c-f6be0771149d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:14.017460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c663927d-289c-438d-922c-f6be0771149d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:14.030955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-afd1b635-9c35-4b77-9b1b-0724107902dd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:14.049862 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-afd1b635-9c35-4b77-9b1b-0724107902dd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.130144 Aug 04 13:56:14.059523 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 401/811] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:13 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:14.244489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c663927d-289c-438d-922c-f6be0771149d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:14.253526 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c663927d-289c-438d-922c-f6be0771149d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1462 microversion: 2.1 time: 0.252975 Aug 04 13:56:14.255031 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 411/812] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:13 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1462 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:14.280001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-976a37fe-30fd-4875-9abc-8b5fc0524821 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'create', calling method: .version_select at 0x7f47005089d0>, body: {"keypair": {"name": "tempest-keypair-270449515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLwgVKbaAKZdp6wT0urmIdnHe5BHfu3MHUvWfUALkPDCLCYK0P8+L5i/me/HY+mcDeUceII4tSH99UvBjT+6Xf4Rkmv9lHbisMPxl+i1BjvaLbSVTM7HEDR1FDPMPPohQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:14.297946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-976a37fe-30fd-4875-9abc-8b5fc0524821 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:14.304521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-976a37fe-30fd-4875-9abc-8b5fc0524821 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for user cca2bff6e81c4f54bad52f77e67faa55 and project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:14.333825 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-976a37fe-30fd-4875-9abc-8b5fc0524821 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059066 Aug 04 13:56:14.334541 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 402/813] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:56:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:14.779138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-96b3c028-d101-421c-ad56-34471e184cbb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:14.780957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-96b3c028-d101-421c-ad56-34471e184cbb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:14.794208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96b3c028-d101-421c-ad56-34471e184cbb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:14.795555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96b3c028-d101-421c-ad56-34471e184cbb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:14.797573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96b3c028-d101-421c-ad56-34471e184cbb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:14.798594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96b3c028-d101-421c-ad56-34471e184cbb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:14.940930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:14.941766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:14.950126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:14.950903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:14.951952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:14.952557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:15.128208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-96b3c028-d101-421c-ad56-34471e184cbb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:15.136566 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-96b3c028-d101-421c-ad56-34471e184cbb tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1471 microversion: 2.1 time: 0.362296 Aug 04 13:56:15.137448 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 412/814] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:14 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:15.160523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49a50f33-b60d-4774-9f60-44190447818a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:15.162047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49a50f33-b60d-4774-9f60-44190447818a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:15.173571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49a50f33-b60d-4774-9f60-44190447818a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:15.174371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49a50f33-b60d-4774-9f60-44190447818a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:15.175240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49a50f33-b60d-4774-9f60-44190447818a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:15.176094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49a50f33-b60d-4774-9f60-44190447818a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:15.203204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:15.211714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:15.214471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:15.215865 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5fb78412-0ef4-4ea9-980c-6b65ec47e72c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1362 microversion: 2.25 time: 0.280215 Aug 04 13:56:15.216651 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 403/815] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:14 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:15.286997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-49a50f33-b60d-4774-9f60-44190447818a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:15.306778 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49a50f33-b60d-4774-9f60-44190447818a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.168009 Aug 04 13:56:15.308225 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 413/816] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:15 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:15.564163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7afbbd15-90b4-43db-bc44-97174ab15754 req-d55df334-cc8b-4185-b5d6-6ce87895f707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c10284-3c28-4847-b418-8aa77c90a92a", "tag": "5ac920bb-6091-4fef-9386-511d0cf7d506"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:15.610359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7afbbd15-90b4-43db-bc44-97174ab15754 req-d55df334-cc8b-4185-b5d6-6ce87895f707 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:15.616603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7afbbd15-90b4-43db-bc44-97174ab15754 req-d55df334-cc8b-4185-b5d6-6ce87895f707 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:15.632136 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7afbbd15-90b4-43db-bc44-97174ab15754 req-d55df334-cc8b-4185-b5d6-6ce87895f707 service nova] Creating event network-changed:5ac920bb-6091-4fef-9386-511d0cf7d506 for instance e9c10284-3c28-4847-b418-8aa77c90a92a on n-h2-844627-10 Aug 04 13:56:15.639744 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7afbbd15-90b4-43db-bc44-97174ab15754 req-d55df334-cc8b-4185-b5d6-6ce87895f707 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082804 Aug 04 13:56:15.640944 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 404/817] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:16.159182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9eb1334-5268-4cfa-9df1-2934cf589a9d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:16.159930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f9eb1334-5268-4cfa-9df1-2934cf589a9d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:16.169904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6c84643d-d60c-48ea-8d3e-bfb61ffb4fe2 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '.version_select at 0x7f4700508160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:16.172436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9eb1334-5268-4cfa-9df1-2934cf589a9d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:16.174466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c84643d-d60c-48ea-8d3e-bfb61ffb4fe2 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:16.175116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9eb1334-5268-4cfa-9df1-2934cf589a9d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:16.175310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c84643d-d60c-48ea-8d3e-bfb61ffb4fe2 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:16.176152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9eb1334-5268-4cfa-9df1-2934cf589a9d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:16.177569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9eb1334-5268-4cfa-9df1-2934cf589a9d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:16.187687 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6c84643d-d60c-48ea-8d3e-bfb61ffb4fe2 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 1198 microversion: 2.1 time: 0.024538 Aug 04 13:56:16.188905 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 405/818] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 13:56:16 2022] GET /compute/v2.1/os-migrations => generated 1198 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:16.212145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2b49781a-7346-4fa2-8249-6f06cb8d2885 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:16.225483 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2b49781a-7346-4fa2-8249-6f06cb8d2885 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020273 Aug 04 13:56:16.226997 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 406/819] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:56:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:16.239765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0299767d-a2cd-4098-a3f4-60bc8f24d66d tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-487623880", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:16.243047 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:56:16.243047 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:56:16.264639 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0299767d-a2cd-4098-a3f4-60bc8f24d66d tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.029899 Aug 04 13:56:16.265931 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 407/820] 10.222.0.66 () {60 vars in 1146 bytes} [Thu Aug 4 13:56:16 2022] POST /compute/v2.1/flavors => generated 498 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:16.273654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:16.275408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:16.283398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:16.284084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:16.285073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:16.285510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:16.373224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f9eb1334-5268-4cfa-9df1-2934cf589a9d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:16.380721 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f9eb1334-5268-4cfa-9df1-2934cf589a9d tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1477 microversion: 2.1 time: 0.226017 Aug 04 13:56:16.381578 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 414/821] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:16 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:16.386544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-390c08d3-8345-4e70-8a4b-ad9cfeb88eec tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:16.394766 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-390c08d3-8345-4e70-8a4b-ad9cfeb88eec tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012189 Aug 04 13:56:16.395518 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 415/822] 10.222.0.66 () {58 vars in 1182 bytes} [Thu Aug 4 13:56:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:56:16.399975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd9be741-a989-4730-a40a-7890d0c8c885 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:16.400580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd9be741-a989-4730-a40a-7890d0c8c885 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:16.406918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd9be741-a989-4730-a40a-7890d0c8c885 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:16.407360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd9be741-a989-4730-a40a-7890d0c8c885 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:16.409023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd9be741-a989-4730-a40a-7890d0c8c885 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:16.410084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd9be741-a989-4730-a40a-7890d0c8c885 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:16.458284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:16.467401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:16.469842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:16.471244 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a4b65c05-e65a-4fe2-a513-bc435f59add4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1362 microversion: 2.25 time: 0.203275 Aug 04 13:56:16.472359 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 408/823] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:16 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:16.497364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-fd9be741-a989-4730-a40a-7890d0c8c885 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:16.516486 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd9be741-a989-4730-a40a-7890d0c8c885 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.119739 Aug 04 13:56:16.517397 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 416/824] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:16 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:16.523868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-965861399", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "c495b1d0-d4e5-4490-8b62-2594f9be53ba"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:16.581069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:16.809737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:16.810423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:16.810931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:16.811390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:16.812154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:16.823902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:16.824531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:16.825473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:16.826154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:16.849243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:16.855054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for user cca2bff6e81c4f54bad52f77e67faa55 and project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:16.868006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:56:16.870579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:56:16.918360 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7480fd6b-fbc9-4717-a087-60be05f01a08 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.403085 Aug 04 13:56:16.918921 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 409/825] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 13:56:16.929778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e822d93d-414b-4737-8449-425be0a4cddc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:16.930395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e822d93d-414b-4737-8449-425be0a4cddc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:17.008065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e822d93d-414b-4737-8449-425be0a4cddc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:17.013633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:17.016565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e822d93d-414b-4737-8449-425be0a4cddc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1278 microversion: 2.1 time: 0.090584 Aug 04 13:56:17.017474 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 417/826] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:16 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:17.411059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5e56038a-c3f0-434a-b7b6-e4132370b5c0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:17.412271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5e56038a-c3f0-434a-b7b6-e4132370b5c0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:17.428168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e56038a-c3f0-434a-b7b6-e4132370b5c0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:17.434857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e56038a-c3f0-434a-b7b6-e4132370b5c0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:17.435800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e56038a-c3f0-434a-b7b6-e4132370b5c0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:17.436250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e56038a-c3f0-434a-b7b6-e4132370b5c0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:17.496486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:17.500021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:17.517156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:17.519366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:17.520395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:17.521498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:17.849920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5e56038a-c3f0-434a-b7b6-e4132370b5c0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:17.860845 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5e56038a-c3f0-434a-b7b6-e4132370b5c0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1477 microversion: 2.1 time: 0.457554 Aug 04 13:56:17.861736 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 410/827] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:17 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1477 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:17.881195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d0e30333-592d-48f0-89d8-f6720f4ca3b9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:17.881823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d0e30333-592d-48f0-89d8-f6720f4ca3b9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:17.894061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0e30333-592d-48f0-89d8-f6720f4ca3b9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:17.894509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0e30333-592d-48f0-89d8-f6720f4ca3b9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:17.895310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0e30333-592d-48f0-89d8-f6720f4ca3b9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:17.898202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0e30333-592d-48f0-89d8-f6720f4ca3b9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:17.920628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:17.929118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:17.931365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:17.933535 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55640c3f-25d9-4997-810a-67bd14a6268a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1362 microversion: 2.25 time: 0.441475 Aug 04 13:56:17.959644 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 418/828] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:17 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:18.038930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75cb9d32-c0b9-4dc9-a243-e1e2b669f12b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:18.039805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-75cb9d32-c0b9-4dc9-a243-e1e2b669f12b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:18.053870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75cb9d32-c0b9-4dc9-a243-e1e2b669f12b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:18.054449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75cb9d32-c0b9-4dc9-a243-e1e2b669f12b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:18.055400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75cb9d32-c0b9-4dc9-a243-e1e2b669f12b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:18.055882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75cb9d32-c0b9-4dc9-a243-e1e2b669f12b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:18.067799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-d0e30333-592d-48f0-89d8-f6720f4ca3b9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:18.124296 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d0e30333-592d-48f0-89d8-f6720f4ca3b9 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.259828 Aug 04 13:56:18.125335 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 411/829] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:17 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:18.189056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75cb9d32-c0b9-4dc9-a243-e1e2b669f12b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:18.197929 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75cb9d32-c0b9-4dc9-a243-e1e2b669f12b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1338 microversion: 2.1 time: 0.164005 Aug 04 13:56:18.200651 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 419/830] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:18 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1338 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:18.884543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fb940232-472d-45f8-b56a-49a968f600a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:18.885937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fb940232-472d-45f8-b56a-49a968f600a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:18.893591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb940232-472d-45f8-b56a-49a968f600a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:18.894364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb940232-472d-45f8-b56a-49a968f600a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:18.895673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb940232-472d-45f8-b56a-49a968f600a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:18.896200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb940232-472d-45f8-b56a-49a968f600a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:18.957514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:18.958977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:18.970093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:18.970910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:18.972218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:18.976081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:19.137208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb940232-472d-45f8-b56a-49a968f600a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:19.145231 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fb940232-472d-45f8-b56a-49a968f600a5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1477 microversion: 2.1 time: 0.264500 Aug 04 13:56:19.160150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 412/831] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:18 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1477 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:19.168438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e6831b9a-fddd-45ba-90f9-ba79a62c5470 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:19.169975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e6831b9a-fddd-45ba-90f9-ba79a62c5470 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:19.177766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6831b9a-fddd-45ba-90f9-ba79a62c5470 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:19.178561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6831b9a-fddd-45ba-90f9-ba79a62c5470 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:19.179592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6831b9a-fddd-45ba-90f9-ba79a62c5470 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:19.180249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6831b9a-fddd-45ba-90f9-ba79a62c5470 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:19.188340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:19.192909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:19.200774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:19.202578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:19.203920 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e564e9be-0465-4f41-9914-43cfb1697b5b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1362 microversion: 2.25 time: 0.251748 Aug 04 13:56:19.217746 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 420/832] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:18 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:19.227987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-022be68e-48a7-4edd-adeb-362db01d6ee2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:19.229115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-022be68e-48a7-4edd-adeb-362db01d6ee2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:19.239204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-022be68e-48a7-4edd-adeb-362db01d6ee2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:19.252546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-022be68e-48a7-4edd-adeb-362db01d6ee2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:19.253810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-022be68e-48a7-4edd-adeb-362db01d6ee2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:19.256797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-022be68e-48a7-4edd-adeb-362db01d6ee2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:19.292508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-e6831b9a-fddd-45ba-90f9-ba79a62c5470 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:19.334076 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e6831b9a-fddd-45ba-90f9-ba79a62c5470 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.171094 Aug 04 13:56:19.348897 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 413/833] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:19 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:19.349358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-022be68e-48a7-4edd-adeb-362db01d6ee2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:19.349358 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-022be68e-48a7-4edd-adeb-362db01d6ee2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1336 microversion: 2.1 time: 0.129039 Aug 04 13:56:19.349358 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 421/834] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:19 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1336 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:20.167836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3fecb8fd-a445-443f-87b3-394270b07728 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:20.168453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3fecb8fd-a445-443f-87b3-394270b07728 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:20.178591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fecb8fd-a445-443f-87b3-394270b07728 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:20.179314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fecb8fd-a445-443f-87b3-394270b07728 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:20.180277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fecb8fd-a445-443f-87b3-394270b07728 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:20.180970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fecb8fd-a445-443f-87b3-394270b07728 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:20.190204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fc5d7cc2-0d16-4a01-8620-4817697aaaee req-65a8054f-2eb8-4b27-9155-d197e616b6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9802281d-83eb-4b5d-8fe0-bc812e0872e4", "name": "network-vif-unplugged", "status": "completed", "tag": "f591719b-2d26-42da-b7bb-dfe4d507c0a9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:20.209115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fc5d7cc2-0d16-4a01-8620-4817697aaaee req-65a8054f-2eb8-4b27-9155-d197e616b6a0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:20.209835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fc5d7cc2-0d16-4a01-8620-4817697aaaee req-65a8054f-2eb8-4b27-9155-d197e616b6a0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:20.231378 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fc5d7cc2-0d16-4a01-8620-4817697aaaee req-65a8054f-2eb8-4b27-9155-d197e616b6a0 service nova] Creating event network-vif-unplugged:f591719b-2d26-42da-b7bb-dfe4d507c0a9 for instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 on n-h1-844627-10 Aug 04 13:56:20.242265 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fc5d7cc2-0d16-4a01-8620-4817697aaaee req-65a8054f-2eb8-4b27-9155-d197e616b6a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056182 Aug 04 13:56:20.243444 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 422/835] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:56:20.257348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:20.258732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:20.275014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:20.275794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:20.277278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:20.278075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:20.520520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3fecb8fd-a445-443f-87b3-394270b07728 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:20.530243 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3fecb8fd-a445-443f-87b3-394270b07728 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1477 microversion: 2.1 time: 0.366468 Aug 04 13:56:20.530827 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 414/836] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:20 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:20.540264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3df0796-e6cb-452d-93de-91717a5bf47d tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:20.547486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3df0796-e6cb-452d-93de-91717a5bf47d tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:20.565410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3df0796-e6cb-452d-93de-91717a5bf47d tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:20.566017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3df0796-e6cb-452d-93de-91717a5bf47d tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:20.566931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3df0796-e6cb-452d-93de-91717a5bf47d tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:20.567370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3df0796-e6cb-452d-93de-91717a5bf47d tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:20.573881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:20.586618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:20.593751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:20.596161 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2ff35785-23c5-4957-ab65-87644e075f82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1362 microversion: 2.25 time: 0.346666 Aug 04 13:56:20.608791 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 423/837] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:20 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:20.640099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52281962-7f23-41fd-b9c2-d5d4d7cc1bde tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:20.641214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-52281962-7f23-41fd-b9c2-d5d4d7cc1bde tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:20.653242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52281962-7f23-41fd-b9c2-d5d4d7cc1bde tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:20.654081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52281962-7f23-41fd-b9c2-d5d4d7cc1bde tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:20.657498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52281962-7f23-41fd-b9c2-d5d4d7cc1bde tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:20.658799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52281962-7f23-41fd-b9c2-d5d4d7cc1bde tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.063812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-a3df0796-e6cb-452d-93de-91717a5bf47d tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:21.088377 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3df0796-e6cb-452d-93de-91717a5bf47d tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.551871 Aug 04 13:56:21.101137 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 415/838] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:20 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:21.101137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70db1d4f-b5f0-466c-9ac1-b77cda624bc1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0320572b-cacd-4384-b08d-4240f0ba594e"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:21.101137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-70db1d4f-b5f0-466c-9ac1-b77cda624bc1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:21.118983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70db1d4f-b5f0-466c-9ac1-b77cda624bc1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.119661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70db1d4f-b5f0-466c-9ac1-b77cda624bc1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.121389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70db1d4f-b5f0-466c-9ac1-b77cda624bc1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.123717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70db1d4f-b5f0-466c-9ac1-b77cda624bc1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.179482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-52281962-7f23-41fd-b9c2-d5d4d7cc1bde tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:21.190723 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-52281962-7f23-41fd-b9c2-d5d4d7cc1bde tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1378 microversion: 2.1 time: 0.580564 Aug 04 13:56:21.204266 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 424/839] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:20 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1378 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:21.204266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-319f6e97-122d-4359-8cb1-8ea9b4e43eb4 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:21.204266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-319f6e97-122d-4359-8cb1-8ea9b4e43eb4 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:21.212727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319f6e97-122d-4359-8cb1-8ea9b4e43eb4 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.213423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319f6e97-122d-4359-8cb1-8ea9b4e43eb4 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.214690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319f6e97-122d-4359-8cb1-8ea9b4e43eb4 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.215544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319f6e97-122d-4359-8cb1-8ea9b4e43eb4 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.253822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-319f6e97-122d-4359-8cb1-8ea9b4e43eb4 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:56:21.389495 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-319f6e97-122d-4359-8cb1-8ea9b4e43eb4 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "DELETE /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 204 len: 0 microversion: 2.1 time: 0.196284 Aug 04 13:56:21.390187 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 425/840] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:56:21 2022] DELETE /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:56:21.402895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0187fe10-bd7a-4759-9e26-a6b7fe52b0fa tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:21.403620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0187fe10-bd7a-4759-9e26-a6b7fe52b0fa tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:21.411109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0187fe10-bd7a-4759-9e26-a6b7fe52b0fa tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.411571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0187fe10-bd7a-4759-9e26-a6b7fe52b0fa tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.412327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0187fe10-bd7a-4759-9e26-a6b7fe52b0fa tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.412763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0187fe10-bd7a-4759-9e26-a6b7fe52b0fa tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.599775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0187fe10-bd7a-4759-9e26-a6b7fe52b0fa tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:21.612629 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0187fe10-bd7a-4759-9e26-a6b7fe52b0fa tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1713 microversion: 2.1 time: 0.214842 Aug 04 13:56:21.613483 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 426/841] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:21 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1713 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:21.637286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-9034928b-9293-4dc8-849d-75477e5dde39 req-39942866-d78f-4f55-aba1-9a38d7c54801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa08578-7e81-4056-8727-9015a7e5ad33", "tag": "8c8ae616-b10d-4353-8410-e4d906727bd0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:21.644799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:21.669664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9034928b-9293-4dc8-849d-75477e5dde39 req-39942866-d78f-4f55-aba1-9a38d7c54801 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.672086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9034928b-9293-4dc8-849d-75477e5dde39 req-39942866-d78f-4f55-aba1-9a38d7c54801 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.692338 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-70db1d4f-b5f0-466c-9ac1-b77cda624bc1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "POST /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601190 Aug 04 13:56:21.701886 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 416/842] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 13:56:21 2022] POST /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:21.711274 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-9034928b-9293-4dc8-849d-75477e5dde39 req-39942866-d78f-4f55-aba1-9a38d7c54801 service nova] Creating event network-changed:8c8ae616-b10d-4353-8410-e4d906727bd0 for instance 7aa08578-7e81-4056-8727-9015a7e5ad33 on n-h2-844627-10 Aug 04 13:56:21.714712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aeebbf8f-5721-4b50-9799-6b0a58eae582 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:21.715756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aeebbf8f-5721-4b50-9799-6b0a58eae582 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:21.722828 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-9034928b-9293-4dc8-849d-75477e5dde39 req-39942866-d78f-4f55-aba1-9a38d7c54801 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107029 Aug 04 13:56:21.726661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aeebbf8f-5721-4b50-9799-6b0a58eae582 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.727841 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 427/843] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:21.733235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aeebbf8f-5721-4b50-9799-6b0a58eae582 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.734260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aeebbf8f-5721-4b50-9799-6b0a58eae582 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.736073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:21.737035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aeebbf8f-5721-4b50-9799-6b0a58eae582 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.740038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:21.751499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.752061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:21.753380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:21.753927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:22.019171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:22.021561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aeebbf8f-5721-4b50-9799-6b0a58eae582 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:22.028229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:22.030072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:22.031209 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bb6edba8-418c-462b-84ac-f43b003180dc tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1362 microversion: 2.25 time: 0.302044 Aug 04 13:56:22.031770 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 428/844] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:21 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:22.033139 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aeebbf8f-5721-4b50-9799-6b0a58eae582 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1477 microversion: 2.1 time: 0.329298 Aug 04 13:56:22.035388 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 417/845] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:21 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1477 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:22.120175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5b370690-9a24-47b8-9b80-029679a51f34 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:22.120913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b370690-9a24-47b8-9b80-029679a51f34 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:22.142250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b370690-9a24-47b8-9b80-029679a51f34 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:22.142805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b370690-9a24-47b8-9b80-029679a51f34 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:22.145017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b370690-9a24-47b8-9b80-029679a51f34 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:22.145656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b370690-9a24-47b8-9b80-029679a51f34 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:22.211691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a58fc600-e43e-4242-ad2d-e60a6078de32 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:22.212304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a58fc600-e43e-4242-ad2d-e60a6078de32 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:22.221340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a58fc600-e43e-4242-ad2d-e60a6078de32 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:22.222903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a58fc600-e43e-4242-ad2d-e60a6078de32 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:22.225213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a58fc600-e43e-4242-ad2d-e60a6078de32 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:22.225923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a58fc600-e43e-4242-ad2d-e60a6078de32 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:22.246245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-5b370690-9a24-47b8-9b80-029679a51f34 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:22.290668 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5b370690-9a24-47b8-9b80-029679a51f34 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.175680 Aug 04 13:56:22.313049 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 429/846] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:22 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:22.318183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5b037d6e-488e-4b22-92c6-a096edd8fef5 req-4c444fa5-324a-4643-bf76-55b63949827a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c10284-3c28-4847-b418-8aa77c90a92a", "name": "network-vif-plugged", "status": "completed", "tag": "5ac920bb-6091-4fef-9386-511d0cf7d506"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:22.329000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5b037d6e-488e-4b22-92c6-a096edd8fef5 req-4c444fa5-324a-4643-bf76-55b63949827a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:22.329707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5b037d6e-488e-4b22-92c6-a096edd8fef5 req-4c444fa5-324a-4643-bf76-55b63949827a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:22.343622 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5b037d6e-488e-4b22-92c6-a096edd8fef5 req-4c444fa5-324a-4643-bf76-55b63949827a service nova] Creating event network-vif-plugged:5ac920bb-6091-4fef-9386-511d0cf7d506 for instance e9c10284-3c28-4847-b418-8aa77c90a92a on n-h2-844627-10 Aug 04 13:56:22.349981 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5b037d6e-488e-4b22-92c6-a096edd8fef5 req-4c444fa5-324a-4643-bf76-55b63949827a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035375 Aug 04 13:56:22.350586 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 430/847] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:22.428967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a58fc600-e43e-4242-ad2d-e60a6078de32 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:22.438158 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a58fc600-e43e-4242-ad2d-e60a6078de32 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1378 microversion: 2.1 time: 0.230397 Aug 04 13:56:22.439326 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 418/848] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:22 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1378 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:22.638945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d672974-7df4-4a86-876b-0512ded4693c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:22.641563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8d672974-7df4-4a86-876b-0512ded4693c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:22.653938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d672974-7df4-4a86-876b-0512ded4693c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:22.654486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d672974-7df4-4a86-876b-0512ded4693c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:22.655548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d672974-7df4-4a86-876b-0512ded4693c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:22.655988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d672974-7df4-4a86-876b-0512ded4693c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:22.971614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d672974-7df4-4a86-876b-0512ded4693c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:22.997085 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d672974-7df4-4a86-876b-0512ded4693c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1713 microversion: 2.1 time: 0.362840 Aug 04 13:56:22.998182 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 431/849] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:22 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1713 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:23.054317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:23.056562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:23.056815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a3f1fb4-da7a-4dd5-b750-1ec0bf285f35 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:23.059518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1a3f1fb4-da7a-4dd5-b750-1ec0bf285f35 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:23.070883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:23.071628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:23.072898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:23.074143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:23.076342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a3f1fb4-da7a-4dd5-b750-1ec0bf285f35 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:23.077075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a3f1fb4-da7a-4dd5-b750-1ec0bf285f35 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:23.079316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a3f1fb4-da7a-4dd5-b750-1ec0bf285f35 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:23.081274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a3f1fb4-da7a-4dd5-b750-1ec0bf285f35 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:23.474485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:23.481616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1a3f1fb4-da7a-4dd5-b750-1ec0bf285f35 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:23.490353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:23.490477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:23.492067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:23.495851 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6cf1b321-1a12-4918-8775-e12491e30a2b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1362 microversion: 2.25 time: 0.444999 Aug 04 13:56:23.498037 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a3f1fb4-da7a-4dd5-b750-1ec0bf285f35 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1477 microversion: 2.1 time: 0.446192 Aug 04 13:56:23.498850 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 432/850] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:23 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1477 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:23.500125 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 419/851] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:23 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:23.505044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-db44e63a-183e-4438-ba07-a135bdc0e253 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:23.505650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-db44e63a-183e-4438-ba07-a135bdc0e253 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:23.508196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-551e8f33-1ce3-4e2d-b3fc-844ba97de1ee tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:23.512638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-551e8f33-1ce3-4e2d-b3fc-844ba97de1ee tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:23.531870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-551e8f33-1ce3-4e2d-b3fc-844ba97de1ee tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:23.533574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db44e63a-183e-4438-ba07-a135bdc0e253 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:23.533895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-551e8f33-1ce3-4e2d-b3fc-844ba97de1ee tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:23.534065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db44e63a-183e-4438-ba07-a135bdc0e253 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:23.534800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db44e63a-183e-4438-ba07-a135bdc0e253 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:23.535236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db44e63a-183e-4438-ba07-a135bdc0e253 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:23.538317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-551e8f33-1ce3-4e2d-b3fc-844ba97de1ee tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:23.539054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-551e8f33-1ce3-4e2d-b3fc-844ba97de1ee tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:24.036977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-551e8f33-1ce3-4e2d-b3fc-844ba97de1ee tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:24.078336 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-551e8f33-1ce3-4e2d-b3fc-844ba97de1ee tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.576746 Aug 04 13:56:24.078958 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 433/852] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:23 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:24.099201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c18a1682-1375-4bae-93da-0e3a4db9c4b7 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:24.105742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c18a1682-1375-4bae-93da-0e3a4db9c4b7 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:24.123117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c18a1682-1375-4bae-93da-0e3a4db9c4b7 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:24.124911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c18a1682-1375-4bae-93da-0e3a4db9c4b7 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:24.125685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c18a1682-1375-4bae-93da-0e3a4db9c4b7 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:24.126193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c18a1682-1375-4bae-93da-0e3a4db9c4b7 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:24.514198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-db44e63a-183e-4438-ba07-a135bdc0e253 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:24.528680 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-db44e63a-183e-4438-ba07-a135bdc0e253 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1378 microversion: 2.1 time: 1.026403 Aug 04 13:56:24.530794 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 420/853] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:23 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1378 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:24.573578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c18a1682-1375-4bae-93da-0e3a4db9c4b7 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb6f86c5d0642f689d50d86dd8ec82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc689abcb1e94127aa8838ecb76ea9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:24.589676 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c18a1682-1375-4bae-93da-0e3a4db9c4b7 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 200 len: 1713 microversion: 2.1 time: 0.507128 Aug 04 13:56:24.590819 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 434/854] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:24 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 1713 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:24.597172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0061e82b-e306-4cac-a33b-f0d5be713fcf req-9f256be6-092f-4f14-bcea-eb97d3f09fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9802281d-83eb-4b5d-8fe0-bc812e0872e4", "name": "network-vif-plugged", "status": "completed", "tag": "f591719b-2d26-42da-b7bb-dfe4d507c0a9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:24.608656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0061e82b-e306-4cac-a33b-f0d5be713fcf req-9f256be6-092f-4f14-bcea-eb97d3f09fce service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:24.609347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0061e82b-e306-4cac-a33b-f0d5be713fcf req-9f256be6-092f-4f14-bcea-eb97d3f09fce service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:24.630843 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0061e82b-e306-4cac-a33b-f0d5be713fcf req-9f256be6-092f-4f14-bcea-eb97d3f09fce service nova] Creating event network-vif-plugged:f591719b-2d26-42da-b7bb-dfe4d507c0a9 for instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 on n-h1-844627-10 Aug 04 13:56:24.642189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0061e82b-e306-4cac-a33b-f0d5be713fcf req-9f256be6-092f-4f14-bcea-eb97d3f09fce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049345 Aug 04 13:56:24.648343 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 435/855] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:24.655995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:24.657604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:24.672351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:24.673290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:24.674268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:24.675015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:24.749344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1945313613", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "bd0c2de1-a833-4902-b343-80481e8458ff"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:24.855231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] validate_networks() for [('bd0c2de1-a833-4902-b343-80481e8458ff', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:25.101522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:25.118123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:25.119728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:25.127768 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f0c9477-849d-4407-bd0c-84c834e74037 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1557 microversion: 2.25 time: 0.471236 Aug 04 13:56:25.128645 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 436/856] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:24 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1557 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:25.133855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d903ae2c-4646-4b9b-a97a-0ebb94af8d29 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:25.134635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d903ae2c-4646-4b9b-a97a-0ebb94af8d29 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:25.168403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d903ae2c-4646-4b9b-a97a-0ebb94af8d29 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:25.168990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d903ae2c-4646-4b9b-a97a-0ebb94af8d29 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:25.169870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d903ae2c-4646-4b9b-a97a-0ebb94af8d29 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:25.170385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d903ae2c-4646-4b9b-a97a-0ebb94af8d29 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:25.680054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d903ae2c-4646-4b9b-a97a-0ebb94af8d29 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:25.684442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:25.694729 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d903ae2c-4646-4b9b-a97a-0ebb94af8d29 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1477 microversion: 2.1 time: 0.564915 Aug 04 13:56:25.698952 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 437/857] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:25 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1477 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:25.721742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-613f22b0-c8e1-4dfe-9420-a38cae86d3b2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:25.722404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-613f22b0-c8e1-4dfe-9420-a38cae86d3b2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:25.728996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-613f22b0-c8e1-4dfe-9420-a38cae86d3b2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:25.729981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-613f22b0-c8e1-4dfe-9420-a38cae86d3b2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:25.730964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-613f22b0-c8e1-4dfe-9420-a38cae86d3b2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:25.731566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-613f22b0-c8e1-4dfe-9420-a38cae86d3b2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:26.027133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:26.027639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:26.028023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:26.028435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:26.028844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:26.051581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:26.054017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-613f22b0-c8e1-4dfe-9420-a38cae86d3b2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:26.055954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:26.058453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:26.058933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:26.091790 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-613f22b0-c8e1-4dfe-9420-a38cae86d3b2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.391488 Aug 04 13:56:26.093401 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 438/858] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:25 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:26.102004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fc5c1dc7-5bf1-465e-ab01-804bd3438c6f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:26.102428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fc5c1dc7-5bf1-465e-ab01-804bd3438c6f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:26.117712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Getting quotas for project 9e5afd8e587c41d8bc0f86c89a38fce2. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:26.124460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc5c1dc7-5bf1-465e-ab01-804bd3438c6f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:26.128839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc5c1dc7-5bf1-465e-ab01-804bd3438c6f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:26.130054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc5c1dc7-5bf1-465e-ab01-804bd3438c6f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:26.130591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc5c1dc7-5bf1-465e-ab01-804bd3438c6f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:26.131183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Getting quotas for user 314b6dcaf21b4fb197cbd03275229572 and project 9e5afd8e587c41d8bc0f86c89a38fce2. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:26.171719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:56:26.178211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:56:26.262260 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b64198bf-98e5-443e-a039-1716baf2a6c7 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.729549 Aug 04 13:56:26.268973 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 421/859] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:56:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:56:26.275202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3d786374-f86c-4acd-8c5f-e7a05d128d70 req-d272f780-2059-4ea1-b4a9-2f1cf638da11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af05b69d-855c-42e3-b5c5-772d703fc11a", "name": "network-vif-deleted", "tag": "f7209b74-7505-4bb3-b3a5-61607d4e42dc"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:26.287478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3d786374-f86c-4acd-8c5f-e7a05d128d70 req-d272f780-2059-4ea1-b4a9-2f1cf638da11 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:26.288168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3d786374-f86c-4acd-8c5f-e7a05d128d70 req-d272f780-2059-4ea1-b4a9-2f1cf638da11 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:26.304192 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3d786374-f86c-4acd-8c5f-e7a05d128d70 req-d272f780-2059-4ea1-b4a9-2f1cf638da11 service nova] Creating event network-vif-deleted:f7209b74-7505-4bb3-b3a5-61607d4e42dc for instance af05b69d-855c-42e3-b5c5-772d703fc11a on n-h2-844627-10 Aug 04 13:56:26.311037 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3d786374-f86c-4acd-8c5f-e7a05d128d70 req-d272f780-2059-4ea1-b4a9-2f1cf638da11 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040170 Aug 04 13:56:26.312232 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 422/860] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:26.318172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f6e0191-37c7-4aa1-8eb6-2ad482d6270a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:26.319121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f6e0191-37c7-4aa1-8eb6-2ad482d6270a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:26.327898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f6e0191-37c7-4aa1-8eb6-2ad482d6270a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:26.328560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f6e0191-37c7-4aa1-8eb6-2ad482d6270a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:26.329738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f6e0191-37c7-4aa1-8eb6-2ad482d6270a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:26.330672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f6e0191-37c7-4aa1-8eb6-2ad482d6270a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.021064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5f6e0191-37c7-4aa1-8eb6-2ad482d6270a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:27.039592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f6e0191-37c7-4aa1-8eb6-2ad482d6270a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1378 microversion: 2.1 time: 0.720441 Aug 04 13:56:27.052522 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 423/861] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:26 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1378 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:27.053050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:27.053677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:27.086606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.088284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.090960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.091513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.117214 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] HTTP exception thrown: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Request method failure captured: Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a HTTP/1.1 Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689T1R0bpuHot3ZrQ_ir8iiNq6gzUISou09NOYFgYryuLP-joNoQaxCj33KwZ8d97kHnDfc9Y5u_y_vZePSjw8oyGqfEivmoDBakWs2ixx4RoCE3w1WlhkF6FhVlAZE5s0R6WAw6e3HjpKRF1Fnuu1Ce-oVMjrBrW_aio5xC3DmDRU0 Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:56:27.123764 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}] Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 3bb6f86c5d0642f689d50d86dd8ec82e Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:27.125137 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'af05b69d-855c-42e3-b5c5-772d703fc11a'} Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:27.125878 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:27.127046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.128111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Returning 404 to user: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:27.128111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9019f966-f792-4ef7-93e0-9d476937d9ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 404 len: 111 microversion: 2.1 time: 0.081051 Aug 04 13:56:27.128111 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 424/862] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:27 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:56:27.131863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a2c3cf29-06c4-40de-ac5e-67ccfad8fc8f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:27.149195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a2c3cf29-06c4-40de-ac5e-67ccfad8fc8f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:27.177619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-fc5c1dc7-5bf1-465e-ab01-804bd3438c6f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid e9c10284-3c28-4847-b418-8aa77c90a92a {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:27.185479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2c3cf29-06c4-40de-ac5e-67ccfad8fc8f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.186963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2c3cf29-06c4-40de-ac5e-67ccfad8fc8f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.189828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2c3cf29-06c4-40de-ac5e-67ccfad8fc8f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.191906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2c3cf29-06c4-40de-ac5e-67ccfad8fc8f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.199426 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fc5c1dc7-5bf1-465e-ab01-804bd3438c6f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 2052 microversion: 2.25 time: 1.104647 Aug 04 13:56:27.200019 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 439/863] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:26 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 2052 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:27.227094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5ce03bfd-9f0c-49e1-a577-6ed863ed5de9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:27.230344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5ce03bfd-9f0c-49e1-a577-6ed863ed5de9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:27.251468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ce03bfd-9f0c-49e1-a577-6ed863ed5de9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.252234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ce03bfd-9f0c-49e1-a577-6ed863ed5de9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.253238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ce03bfd-9f0c-49e1-a577-6ed863ed5de9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.255863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ce03bfd-9f0c-49e1-a577-6ed863ed5de9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.384465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a2c3cf29-06c4-40de-ac5e-67ccfad8fc8f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:27.397726 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a2c3cf29-06c4-40de-ac5e-67ccfad8fc8f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1228 microversion: 2.1 time: 0.265430 Aug 04 13:56:27.398568 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 425/864] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:27 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1228 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:27.413264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a02cb640-af9c-4cf4-bc25-78eedd2c2ba1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:27.413873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a02cb640-af9c-4cf4-bc25-78eedd2c2ba1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:27.422376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a02cb640-af9c-4cf4-bc25-78eedd2c2ba1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.422831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a02cb640-af9c-4cf4-bc25-78eedd2c2ba1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.423615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a02cb640-af9c-4cf4-bc25-78eedd2c2ba1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.424054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a02cb640-af9c-4cf4-bc25-78eedd2c2ba1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.569308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-a02cb640-af9c-4cf4-bc25-78eedd2c2ba1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:27.596316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:27.599523 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a02cb640-af9c-4cf4-bc25-78eedd2c2ba1 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.199919 Aug 04 13:56:27.618331 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 426/865] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:27 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:27.626188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:27.626424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:27.633252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.634076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.634614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.635113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.655530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5ce03bfd-9f0c-49e1-a577-6ed863ed5de9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:27.657859 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] HTTP exception thrown: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Request method failure captured: Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd HTTP/1.1 Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689T1R0bpuHot3ZrQ_ir8iiNq6gzUISou09NOYFgYryuLP-joNoQaxCj33KwZ8d97kHnDfc9Y5u_y_vZePSjw8oyGqfEivmoDBakWs2ixx4RoCE3w1WlhkF6FhVlAZE5s0R6WAw6e3HjpKRF1Fnuu1Ce-oVMjrBrW_aio5xC3DmDRU0 Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:56:27.659989 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}] Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 3bb6f86c5d0642f689d50d86dd8ec82e Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.661391 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '206086e4-b66e-49e9-9299-4cc160efecbd'} Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:27.662112 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.663398 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.664651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Returning 404 to user: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:27.664651 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-be9d4d99-cf31-4730-81dc-c126b3543b3c tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "DELETE /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 404 len: 111 microversion: 2.1 time: 0.042526 Aug 04 13:56:27.664651 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 427/866] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:56:27 2022] DELETE /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:56:27.667803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6c947dbf-471b-44de-acd3-50300720e3af tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:27.668520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6c947dbf-471b-44de-acd3-50300720e3af tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:27.676103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c947dbf-471b-44de-acd3-50300720e3af tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.677194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c947dbf-471b-44de-acd3-50300720e3af tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.677328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c947dbf-471b-44de-acd3-50300720e3af tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.678043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c947dbf-471b-44de-acd3-50300720e3af tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.679248 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5ce03bfd-9f0c-49e1-a577-6ed863ed5de9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1463 microversion: 2.1 time: 0.465845 Aug 04 13:56:27.694310 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 440/867] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:27 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1463 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:27.694310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:27.694310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:27.735758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.736580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.737701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.741486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.781836 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] HTTP exception thrown: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Request method failure captured: Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd HTTP/1.1 Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689T1R0bpuHot3ZrQ_ir8iiNq6gzUISou09NOYFgYryuLP-joNoQaxCj33KwZ8d97kHnDfc9Y5u_y_vZePSjw8oyGqfEivmoDBakWs2ixx4RoCE3w1WlhkF6FhVlAZE5s0R6WAw6e3HjpKRF1Fnuu1Ce-oVMjrBrW_aio5xC3DmDRU0 Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:56:27.783926 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}] Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 3bb6f86c5d0642f689d50d86dd8ec82e Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.785569 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '206086e4-b66e-49e9-9299-4cc160efecbd'} Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:27.786279 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:27.787425 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:27.789997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Returning 404 to user: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:27.791316 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a61b7fea-6dae-4e1e-bbec-dee79674ec2f tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 404 len: 111 microversion: 2.1 time: 0.104844 Aug 04 13:56:27.796459 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 441/868] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:27 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:56:27.825760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd9eabe2-8d7a-4d60-b886-a28a924b94b3 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:27.826413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd9eabe2-8d7a-4d60-b886-a28a924b94b3 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:27.837453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd9eabe2-8d7a-4d60-b886-a28a924b94b3 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.838044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd9eabe2-8d7a-4d60-b886-a28a924b94b3 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:27.839438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd9eabe2-8d7a-4d60-b886-a28a924b94b3 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:27.839884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd9eabe2-8d7a-4d60-b886-a28a924b94b3 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.098218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-6c947dbf-471b-44de-acd3-50300720e3af tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid e9c10284-3c28-4847-b418-8aa77c90a92a {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:28.160930 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6c947dbf-471b-44de-acd3-50300720e3af tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 2052 microversion: 2.25 time: 0.497857 Aug 04 13:56:28.161531 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 428/869] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:27 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 2052 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:28.184956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06f5fb81-6db0-4514-b91d-2d5e488b2688 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '.version_select at 0x7f47002f15e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:28.211726 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-06f5fb81-6db0-4514-b91d-2d5e488b2688 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562324001" status: 202 len: 0 microversion: 2.1 time: 0.032164 Aug 04 13:56:28.212773 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 429/870] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 13:56:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562324001 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:56:28.218996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5673159a-fa5c-456b-910e-cd8b60d055f8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:28.219677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5673159a-fa5c-456b-910e-cd8b60d055f8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:28.226962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5673159a-fa5c-456b-910e-cd8b60d055f8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.227474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5673159a-fa5c-456b-910e-cd8b60d055f8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.228336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5673159a-fa5c-456b-910e-cd8b60d055f8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.228778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5673159a-fa5c-456b-910e-cd8b60d055f8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.389889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fd9eabe2-8d7a-4d60-b886-a28a924b94b3 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:28.398641 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd9eabe2-8d7a-4d60-b886-a28a924b94b3 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1463 microversion: 2.1 time: 0.588498 Aug 04 13:56:28.406045 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 442/871] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:27 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1463 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:28.427435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41ed7b35-916a-4c07-8bf5-5a8a833db403 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:28.440173 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:56:28.440173 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:56:28.448781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ed7b35-916a-4c07-8bf5-5a8a833db403 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.450715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ed7b35-916a-4c07-8bf5-5a8a833db403 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.454262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ed7b35-916a-4c07-8bf5-5a8a833db403 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.456110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ed7b35-916a-4c07-8bf5-5a8a833db403 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.529054 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-41ed7b35-916a-4c07-8bf5-5a8a833db403 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.120058 Aug 04 13:56:28.530517 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 443/872] 10.222.0.66 () {60 vars in 1217 bytes} [Thu Aug 4 13:56:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:56:28.535546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-92e203bf-a358-4a57-9659-09d18dbeba42 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:28.536428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-92e203bf-a358-4a57-9659-09d18dbeba42 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:28.544343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92e203bf-a358-4a57-9659-09d18dbeba42 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.545026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92e203bf-a358-4a57-9659-09d18dbeba42 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.545992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92e203bf-a358-4a57-9659-09d18dbeba42 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.546628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92e203bf-a358-4a57-9659-09d18dbeba42 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.688103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-92e203bf-a358-4a57-9659-09d18dbeba42 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:28.697378 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-92e203bf-a358-4a57-9659-09d18dbeba42 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1282 microversion: 2.1 time: 0.165373 Aug 04 13:56:28.704970 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 444/873] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:28 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:28.714166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5673159a-fa5c-456b-910e-cd8b60d055f8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:28.726535 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5673159a-fa5c-456b-910e-cd8b60d055f8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1378 microversion: 2.1 time: 0.512550 Aug 04 13:56:28.730886 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 430/874] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:28 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1378 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:28.737241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ffe34869-48cf-4f92-bd06-4a4d7610926f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:28.737874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ffe34869-48cf-4f92-bd06-4a4d7610926f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:28.754604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffe34869-48cf-4f92-bd06-4a4d7610926f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.760449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffe34869-48cf-4f92-bd06-4a4d7610926f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.767235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffe34869-48cf-4f92-bd06-4a4d7610926f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.767602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:28.767736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffe34869-48cf-4f92-bd06-4a4d7610926f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.771160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:28.783875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.783875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.783875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.783875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.958458 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ffe34869-48cf-4f92-bd06-4a4d7610926f tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a/action" status: 202 len: 0 microversion: 2.25 time: 0.225893 Aug 04 13:56:28.959736 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 431/875] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 13:56:28 2022] POST /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:56:28.965865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-094a525b-21a3-4e29-937e-cb7074e42f71 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:28.966780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-094a525b-21a3-4e29-937e-cb7074e42f71 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:28.971221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:28.971647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:28.972125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:28.972534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:28.977053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:28.990580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-094a525b-21a3-4e29-937e-cb7074e42f71 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.991895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-094a525b-21a3-4e29-937e-cb7074e42f71 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:28.993198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-094a525b-21a3-4e29-937e-cb7074e42f71 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:28.993988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-094a525b-21a3-4e29-937e-cb7074e42f71 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:29.120962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:29.128738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:29.129357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:29.130911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:29.131447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:29.189493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-094a525b-21a3-4e29-937e-cb7074e42f71 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:29.241544 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-de9c7d3f-7f88-4202-9b1f-c386e7018fb0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action" status: 202 len: 1067 microversion: 2.1 time: 0.535368 Aug 04 13:56:29.242074 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 445/876] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:56:28 2022] POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action => generated 1067 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 13:56:29.261638 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-094a525b-21a3-4e29-937e-cb7074e42f71 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.300484 Aug 04 13:56:29.262236 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 432/877] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:28 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:29.270239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33471843-b76f-48d5-823a-5b60bdcfce34 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:29.286543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-33471843-b76f-48d5-823a-5b60bdcfce34 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:29.293695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-787c2c8f-af86-404c-8c35-12c7e40663e2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:29.299250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-787c2c8f-af86-404c-8c35-12c7e40663e2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:29.302717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33471843-b76f-48d5-823a-5b60bdcfce34 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:29.303663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33471843-b76f-48d5-823a-5b60bdcfce34 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:29.305170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33471843-b76f-48d5-823a-5b60bdcfce34 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:29.305677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33471843-b76f-48d5-823a-5b60bdcfce34 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:29.319060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-787c2c8f-af86-404c-8c35-12c7e40663e2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:29.319517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-787c2c8f-af86-404c-8c35-12c7e40663e2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:29.320304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-787c2c8f-af86-404c-8c35-12c7e40663e2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:29.324646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-787c2c8f-af86-404c-8c35-12c7e40663e2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:29.898489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-33471843-b76f-48d5-823a-5b60bdcfce34 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid e9c10284-3c28-4847-b418-8aa77c90a92a {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:29.922353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-787c2c8f-af86-404c-8c35-12c7e40663e2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:29.934460 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-787c2c8f-af86-404c-8c35-12c7e40663e2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.671155 Aug 04 13:56:29.937262 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 433/878] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:29 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:29.949691 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-33471843-b76f-48d5-823a-5b60bdcfce34 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 2057 microversion: 2.25 time: 0.674544 Aug 04 13:56:29.949691 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 446/879] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:29 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 2057 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:29.957843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ceab0844-1a92-476a-8efc-11a4cc1573e1 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:29.962693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3c38c16d-9575-4002-9120-5ad79dd58fd9 req-5611a725-8a60-4b3d-a5d8-9e7d0ce3972e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa08578-7e81-4056-8727-9015a7e5ad33", "name": "network-vif-plugged", "status": "completed", "tag": "8c8ae616-b10d-4353-8410-e4d906727bd0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:29.964394 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:56:29.964394 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:56:29.979012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:29.984393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3c38c16d-9575-4002-9120-5ad79dd58fd9 req-5611a725-8a60-4b3d-a5d8-9e7d0ce3972e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:29.985280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3c38c16d-9575-4002-9120-5ad79dd58fd9 req-5611a725-8a60-4b3d-a5d8-9e7d0ce3972e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.001126 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ceab0844-1a92-476a-8efc-11a4cc1573e1 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/618218615" status: 202 len: 0 microversion: 2.1 time: 0.054514 Aug 04 13:56:30.003174 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 434/880] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:56:29 2022] DELETE /compute/v2.1/flavors/618218615 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:56:30.010488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5c5c5d93-b615-4227-ba39-1fa6f3e9953a tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.012203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5c5c5d93-b615-4227-ba39-1fa6f3e9953a tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:30.016351 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3c38c16d-9575-4002-9120-5ad79dd58fd9 req-5611a725-8a60-4b3d-a5d8-9e7d0ce3972e service nova] Creating event network-vif-plugged:8c8ae616-b10d-4353-8410-e4d906727bd0 for instance 7aa08578-7e81-4056-8727-9015a7e5ad33 on n-h2-844627-10 Aug 04 13:56:30.019852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5c5c5d93-b615-4227-ba39-1fa6f3e9953a tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.020897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5c5c5d93-b615-4227-ba39-1fa6f3e9953a tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.022058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5c5c5d93-b615-4227-ba39-1fa6f3e9953a tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.023414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5c5c5d93-b615-4227-ba39-1fa6f3e9953a tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.047206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3c38c16d-9575-4002-9120-5ad79dd58fd9 req-5611a725-8a60-4b3d-a5d8-9e7d0ce3972e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084188 Aug 04 13:56:30.048199 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 447/881] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:30.061714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-970e50bf-3906-4e5a-a7c2-70fb761211b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.063710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-970e50bf-3906-4e5a-a7c2-70fb761211b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:30.081949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-970e50bf-3906-4e5a-a7c2-70fb761211b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.082765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-970e50bf-3906-4e5a-a7c2-70fb761211b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.085949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-970e50bf-3906-4e5a-a7c2-70fb761211b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.090324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-970e50bf-3906-4e5a-a7c2-70fb761211b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.378052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5c5c5d93-b615-4227-ba39-1fa6f3e9953a tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:30.383203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-970e50bf-3906-4e5a-a7c2-70fb761211b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:30.391382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:30.391587 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-970e50bf-3906-4e5a-a7c2-70fb761211b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1378 microversion: 2.1 time: 0.340606 Aug 04 13:56:30.393182 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 448/882] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:30 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1378 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:30.399416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-79d6eed4-05a8-4ad7-aa97-f970497eb2d4 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.399582 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5c5c5d93-b615-4227-ba39-1fa6f3e9953a tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1324 microversion: 2.1 time: 0.393111 Aug 04 13:56:30.402551 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 435/883] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:30 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1324 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:30.413638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3ca8dc90-ed39-45a1-b053-f5908d2fed2e tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.416165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3ca8dc90-ed39-45a1-b053-f5908d2fed2e tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:30.429319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ca8dc90-ed39-45a1-b053-f5908d2fed2e tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.429647 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-79d6eed4-05a8-4ad7-aa97-f970497eb2d4 tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5891 microversion: 2.1 time: 0.034641 Aug 04 13:56:30.430275 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 449/884] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:56:30 2022] GET /compute/v2.1/flavors/detail => generated 5891 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:30.432130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ca8dc90-ed39-45a1-b053-f5908d2fed2e tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.433146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ca8dc90-ed39-45a1-b053-f5908d2fed2e tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.433602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ca8dc90-ed39-45a1-b053-f5908d2fed2e tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.448653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-00e0a764-303f-4487-b98b-2bd4a9dd924b tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.449927 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:56:30.449927 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:56:30.473239 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-00e0a764-303f-4487-b98b-2bd4a9dd924b tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/492327838" status: 202 len: 0 microversion: 2.1 time: 0.028628 Aug 04 13:56:30.474457 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 450/885] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:56:30 2022] DELETE /compute/v2.1/flavors/492327838 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:56:30.484097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-944cbf2b-e074-4eb1-b533-90921bb15d0e tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.508142 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-944cbf2b-e074-4eb1-b533-90921bb15d0e tempest-ServersWithSpecificFlavorTestJSON-78469094 tempest-ServersWithSpecificFlavorTestJSON-78469094-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.026468 Aug 04 13:56:30.512357 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 451/886] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:56:30 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:30.540254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.541082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:30.541767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-3ca8dc90-ed39-45a1-b053-f5908d2fed2e tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:30.550965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.551413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.552444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.553214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.564226 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3ca8dc90-ed39-45a1-b053-f5908d2fed2e tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1929 microversion: 2.75 time: 0.160490 Aug 04 13:56:30.571898 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] HTTP exception thrown: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Request method failure captured: Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a HTTP/1.1 Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689T1R0bpuHot3ZrQ_ir8iiNq6gzUISou09NOYFgYryuLP-joNoQaxCj33KwZ8d97kHnDfc9Y5u_y_vZePSjw8oyGqfEivmoDBakWs2ixx4RoCE3w1WlhkF6FhVlAZE5s0R6WAw6e3HjpKRF1Fnuu1Ce-oVMjrBrW_aio5xC3DmDRU0 Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:56:30.574273 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}] Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 3bb6f86c5d0642f689d50d86dd8ec82e Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.575547 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'af05b69d-855c-42e3-b5c5-772d703fc11a'} Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:30.576270 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.577445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.579956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Returning 404 to user: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:30.579956 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-899eb09e-a2aa-44e0-a071-c48bfe0c4847 tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "DELETE /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 404 len: 111 microversion: 2.1 time: 0.043139 Aug 04 13:56:30.579956 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 452/887] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:56:30 2022] DELETE /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:56:30.581400 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 436/888] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:30 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:30.589460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.590193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: af05b69d-855c-42e3-b5c5-772d703fc11a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:30.597248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.598077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.599026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.599550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.615327 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] HTTP exception thrown: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Request method failure captured: Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a HTTP/1.1 Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689T1R0bpuHot3ZrQ_ir8iiNq6gzUISou09NOYFgYryuLP-joNoQaxCj33KwZ8d97kHnDfc9Y5u_y_vZePSjw8oyGqfEivmoDBakWs2ixx4RoCE3w1WlhkF6FhVlAZE5s0R6WAw6e3HjpKRF1Fnuu1Ce-oVMjrBrW_aio5xC3DmDRU0 Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:56:30.617787 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}] Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 3bb6f86c5d0642f689d50d86dd8ec82e Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.619087 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'af05b69d-855c-42e3-b5c5-772d703fc11a'} Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:30.620305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. Aug 04 13:56:30.621491 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.622537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Returning 404 to user: Instance af05b69d-855c-42e3-b5c5-772d703fc11a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:30.622537 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0599e122-214a-4bc1-bc3b-5d217620f6bc tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a" status: 404 len: 111 microversion: 2.1 time: 0.035312 Aug 04 13:56:30.625935 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 453/889] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:30 2022] GET /compute/v2.1/servers/af05b69d-855c-42e3-b5c5-772d703fc11a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:56:30.632620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.633150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:30.649621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.650604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.651822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.652725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.673473 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] HTTP exception thrown: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Request method failure captured: Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd HTTP/1.1 Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689T1R0bpuHot3ZrQ_ir8iiNq6gzUISou09NOYFgYryuLP-joNoQaxCj33KwZ8d97kHnDfc9Y5u_y_vZePSjw8oyGqfEivmoDBakWs2ixx4RoCE3w1WlhkF6FhVlAZE5s0R6WAw6e3HjpKRF1Fnuu1Ce-oVMjrBrW_aio5xC3DmDRU0 Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:56:30.675205 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}] Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 3bb6f86c5d0642f689d50d86dd8ec82e Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.676719 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '206086e4-b66e-49e9-9299-4cc160efecbd'} Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:30.677684 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.678963 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.680726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Returning 404 to user: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:30.680726 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-35b40d0f-20ad-402b-b6b5-b73cb81446ff tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "DELETE /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 404 len: 111 microversion: 2.1 time: 0.047883 Aug 04 13:56:30.680726 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 437/890] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:56:30 2022] DELETE /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:56:30.686398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.687023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] [instance: 206086e4-b66e-49e9-9299-4cc160efecbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:30.693712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.694174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.694948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.695389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.709987 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] HTTP exception thrown: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Request method failure captured: Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd HTTP/1.1 Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689T1R0bpuHot3ZrQ_ir8iiNq6gzUISou09NOYFgYryuLP-joNoQaxCj33KwZ8d97kHnDfc9Y5u_y_vZePSjw8oyGqfEivmoDBakWs2ixx4RoCE3w1WlhkF6FhVlAZE5s0R6WAw6e3HjpKRF1Fnuu1Ce-oVMjrBrW_aio5xC3DmDRU0 Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:56:30.711845 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dc689abcb1e94127aa8838ecb76ea9d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dc689abcb1e94127aa8838ecb76ea9d9"}]}] Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dc689abcb1e94127aa8838ecb76ea9d9 Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020 Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 3bb6f86c5d0642f689d50d86dd8ec82e Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1503199020-project Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.714084 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '206086e4-b66e-49e9-9299-4cc160efecbd'} Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:30.714832 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. Aug 04 13:56:30.716113 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:30.717365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] Returning 404 to user: Instance 206086e4-b66e-49e9-9299-4cc160efecbd could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:30.717365 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2909bb8b-2a75-416d-897a-7a5137f7cf5a tempest-ServersWithSpecificFlavorTestJSON-1503199020 tempest-ServersWithSpecificFlavorTestJSON-1503199020-project] 10.222.0.66 "GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd" status: 404 len: 111 microversion: 2.1 time: 0.031710 Aug 04 13:56:30.717365 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 454/891] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:30 2022] GET /compute/v2.1/servers/206086e4-b66e-49e9-9299-4cc160efecbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:56:30.978115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a5760c1-55f6-4178-b69d-42a8462f4fd9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.979803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a5760c1-55f6-4178-b69d-42a8462f4fd9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:30.982300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f2f85ddc-a987-4591-bef0-e942b4cb2f19 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:30.983688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f2f85ddc-a987-4591-bef0-e942b4cb2f19 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:30.990116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a5760c1-55f6-4178-b69d-42a8462f4fd9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.990763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a5760c1-55f6-4178-b69d-42a8462f4fd9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.991959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a5760c1-55f6-4178-b69d-42a8462f4fd9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.992252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2f85ddc-a987-4591-bef0-e942b4cb2f19 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.992636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a5760c1-55f6-4178-b69d-42a8462f4fd9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.993089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2f85ddc-a987-4591-bef0-e942b4cb2f19 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:30.994092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2f85ddc-a987-4591-bef0-e942b4cb2f19 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:30.994828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2f85ddc-a987-4591-bef0-e942b4cb2f19 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:31.303951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a5760c1-55f6-4178-b69d-42a8462f4fd9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:31.323698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-f2f85ddc-a987-4591-bef0-e942b4cb2f19 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid e9c10284-3c28-4847-b418-8aa77c90a92a {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:31.325440 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a5760c1-55f6-4178-b69d-42a8462f4fd9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.353870 Aug 04 13:56:31.335914 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 438/892] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:30 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:31.342050 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f2f85ddc-a987-4591-bef0-e942b4cb2f19 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 2037 microversion: 2.25 time: 0.368255 Aug 04 13:56:31.342925 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 455/893] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:30 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 2037 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:31.370330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc34dd94-72d7-410c-b2a4-e7f274d11bd7 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844627-10", "block_migration": "auto"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:31.372861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dc34dd94-72d7-410c-b2a4-e7f274d11bd7 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:31.397340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7cc527d3-1cfa-4464-8c0c-e92c165d66e1 req-a7583582-d623-4c07-bf1e-99c7f1b839a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a80a01-edba-4355-8d27-8fac463e118a", "tag": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:31.398512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc34dd94-72d7-410c-b2a4-e7f274d11bd7 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:31.399313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc34dd94-72d7-410c-b2a4-e7f274d11bd7 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:31.400807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc34dd94-72d7-410c-b2a4-e7f274d11bd7 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:31.401677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc34dd94-72d7-410c-b2a4-e7f274d11bd7 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:31.415721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7cc527d3-1cfa-4464-8c0c-e92c165d66e1 req-a7583582-d623-4c07-bf1e-99c7f1b839a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:31.417613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7cc527d3-1cfa-4464-8c0c-e92c165d66e1 req-a7583582-d623-4c07-bf1e-99c7f1b839a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:31.441342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-dc34dd94-72d7-410c-b2a4-e7f274d11bd7 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'flavor' on Instance uuid e9c10284-3c28-4847-b418-8aa77c90a92a {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:31.442187 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7cc527d3-1cfa-4464-8c0c-e92c165d66e1 req-a7583582-d623-4c07-bf1e-99c7f1b839a4 service nova] Creating event network-changed:83bf7c82-4313-4b52-9ea6-3efdcbf48b07 for instance 33a80a01-edba-4355-8d27-8fac463e118a on n-h2-844627-10 Aug 04 13:56:31.449698 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7cc527d3-1cfa-4464-8c0c-e92c165d66e1 req-a7583582-d623-4c07-bf1e-99c7f1b839a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058723 Aug 04 13:56:31.451147 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 456/894] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:56:31.465641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8074bf08-deff-4cab-bd6e-62968c01b1ec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:31.466915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8074bf08-deff-4cab-bd6e-62968c01b1ec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:31.468702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dc34dd94-72d7-410c-b2a4-e7f274d11bd7 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Going to try to live migrate instance to n-h1-844627-10 {{(pid=130960) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 13:56:31.476674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8074bf08-deff-4cab-bd6e-62968c01b1ec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:31.477600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8074bf08-deff-4cab-bd6e-62968c01b1ec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:31.478551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8074bf08-deff-4cab-bd6e-62968c01b1ec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:31.479298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8074bf08-deff-4cab-bd6e-62968c01b1ec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:31.828211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8074bf08-deff-4cab-bd6e-62968c01b1ec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:31.844002 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8074bf08-deff-4cab-bd6e-62968c01b1ec tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1528 microversion: 2.1 time: 0.390002 Aug 04 13:56:31.845271 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 457/895] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:31 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1528 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:31.850602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc849e7c-df77-4360-ae51-acdecef76f19 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:31.851235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bc849e7c-df77-4360-ae51-acdecef76f19 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:31.864155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc849e7c-df77-4360-ae51-acdecef76f19 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:31.864679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc849e7c-df77-4360-ae51-acdecef76f19 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:31.874919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc849e7c-df77-4360-ae51-acdecef76f19 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:31.875778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc849e7c-df77-4360-ae51-acdecef76f19 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:32.129512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bc849e7c-df77-4360-ae51-acdecef76f19 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:32.139709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:32.154616 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bc849e7c-df77-4360-ae51-acdecef76f19 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1324 microversion: 2.1 time: 0.308280 Aug 04 13:56:32.164175 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 458/896] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:31 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:32.169315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-297d99ac-b67d-4199-86e6-ae2d35992ec2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:32.170158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-297d99ac-b67d-4199-86e6-ae2d35992ec2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:32.181964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-297d99ac-b67d-4199-86e6-ae2d35992ec2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:32.183292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-297d99ac-b67d-4199-86e6-ae2d35992ec2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:32.184392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-297d99ac-b67d-4199-86e6-ae2d35992ec2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:32.185208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-297d99ac-b67d-4199-86e6-ae2d35992ec2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:32.335817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-297d99ac-b67d-4199-86e6-ae2d35992ec2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:32.357024 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-297d99ac-b67d-4199-86e6-ae2d35992ec2 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1935 microversion: 2.75 time: 0.191865 Aug 04 13:56:32.357615 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 459/897] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:32 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1935 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:32.365536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ad411f11-2a4a-41ae-88e2-c4445fc10397 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:32.366254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ad411f11-2a4a-41ae-88e2-c4445fc10397 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:32.372754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad411f11-2a4a-41ae-88e2-c4445fc10397 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:32.373508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad411f11-2a4a-41ae-88e2-c4445fc10397 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:32.374445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad411f11-2a4a-41ae-88e2-c4445fc10397 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:32.375048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad411f11-2a4a-41ae-88e2-c4445fc10397 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:32.622575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ad411f11-2a4a-41ae-88e2-c4445fc10397 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:32.630814 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ad411f11-2a4a-41ae-88e2-c4445fc10397 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1528 microversion: 2.1 time: 0.271310 Aug 04 13:56:32.641379 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 460/898] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:32 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1528 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:32.651777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af9aadc3-ada5-4c43-92f8-78b3fe350136 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:32.652989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af9aadc3-ada5-4c43-92f8-78b3fe350136 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:32.659409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af9aadc3-ada5-4c43-92f8-78b3fe350136 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:32.660086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af9aadc3-ada5-4c43-92f8-78b3fe350136 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:32.661064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af9aadc3-ada5-4c43-92f8-78b3fe350136 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:32.661657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af9aadc3-ada5-4c43-92f8-78b3fe350136 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:32.805952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-af9aadc3-ada5-4c43-92f8-78b3fe350136 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:32.820991 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af9aadc3-ada5-4c43-92f8-78b3fe350136 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.176533 Aug 04 13:56:32.823172 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 461/899] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:32 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:32.829579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-316c47af-4cb4-4d2e-9a07-b1afbc71e46f tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:32.830595 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:56:32.830595 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:56:32.852852 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-316c47af-4cb4-4d2e-9a07-b1afbc71e46f tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/c495b1d0-d4e5-4490-8b62-2594f9be53ba" status: 202 len: 0 microversion: 2.1 time: 0.026768 Aug 04 13:56:32.858273 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 462/900] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:56:32 2022] DELETE /compute/v2.1/flavors/c495b1d0-d4e5-4490-8b62-2594f9be53ba => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:56:32.864888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbf25f47-0be3-4897-a015-5cb0ca58cfcc tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:32.885021 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fbf25f47-0be3-4897-a015-5cb0ca58cfcc tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025174 Aug 04 13:56:32.885629 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 463/901] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:56:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:32.903720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:32.905776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:32.912341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:32.912887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:32.913707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:32.914145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:33.020300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:33.027170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Old instance type tempest-test_resize_flavor_-487623880, new instance type m1.heat {{(pid=130961) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 13:56:33.034957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:33.035500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:33.036241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:33.036775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:33.037317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:33.156767 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d5e16b7-bea6-4cdc-b282-683aaf6842bd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33/action" status: 202 len: 0 microversion: 2.1 time: 0.255343 Aug 04 13:56:33.157638 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 464/902] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:56:32 2022] POST /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:56:33.165244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a87dd9b7-cb7d-4e4a-8801-f56f012c6e1f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:33.165934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a87dd9b7-cb7d-4e4a-8801-f56f012c6e1f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:33.173216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a87dd9b7-cb7d-4e4a-8801-f56f012c6e1f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:33.173674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a87dd9b7-cb7d-4e4a-8801-f56f012c6e1f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:33.174456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a87dd9b7-cb7d-4e4a-8801-f56f012c6e1f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:33.174899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a87dd9b7-cb7d-4e4a-8801-f56f012c6e1f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:33.665514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a87dd9b7-cb7d-4e4a-8801-f56f012c6e1f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:33.674751 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a87dd9b7-cb7d-4e4a-8801-f56f012c6e1f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1537 microversion: 2.1 time: 0.513704 Aug 04 13:56:33.675412 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 465/903] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:33 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1537 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:33.680104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e92c16e-77ed-4807-ac26-c86adc82db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:33.680887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e92c16e-77ed-4807-ac26-c86adc82db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:33.687203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e92c16e-77ed-4807-ac26-c86adc82db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:33.687850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e92c16e-77ed-4807-ac26-c86adc82db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:33.688904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e92c16e-77ed-4807-ac26-c86adc82db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:33.689347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e92c16e-77ed-4807-ac26-c86adc82db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:33.966377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6e92c16e-77ed-4807-ac26-c86adc82db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:33.974929 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e92c16e-77ed-4807-ac26-c86adc82db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1324 microversion: 2.1 time: 0.298255 Aug 04 13:56:33.984525 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 466/904] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:33 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:33.991128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e007967a-ff17-4811-9bd4-d70fd3560c6a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:33.991128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e007967a-ff17-4811-9bd4-d70fd3560c6a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:33.998332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e007967a-ff17-4811-9bd4-d70fd3560c6a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:33.998791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e007967a-ff17-4811-9bd4-d70fd3560c6a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:33.999602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e007967a-ff17-4811-9bd4-d70fd3560c6a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:34.000043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e007967a-ff17-4811-9bd4-d70fd3560c6a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:34.099702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-e007967a-ff17-4811-9bd4-d70fd3560c6a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:34.132813 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e007967a-ff17-4811-9bd4-d70fd3560c6a tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1935 microversion: 2.75 time: 0.155753 Aug 04 13:56:34.133430 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 467/905] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:33 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1935 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:34.153561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12a8f7f2-c9b8-45cc-93f0-da1e00ce3468 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:34.154651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12a8f7f2-c9b8-45cc-93f0-da1e00ce3468 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:34.162555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a8f7f2-c9b8-45cc-93f0-da1e00ce3468 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:34.163050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a8f7f2-c9b8-45cc-93f0-da1e00ce3468 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:34.163915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a8f7f2-c9b8-45cc-93f0-da1e00ce3468 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:34.164355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a8f7f2-c9b8-45cc-93f0-da1e00ce3468 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:34.466752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12a8f7f2-c9b8-45cc-93f0-da1e00ce3468 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:34.474850 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12a8f7f2-c9b8-45cc-93f0-da1e00ce3468 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.325389 Aug 04 13:56:34.475435 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 468/906] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:34 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:34.696343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8bcf3e7c-ba63-46dc-b90a-19f22092e490 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:34.697319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8bcf3e7c-ba63-46dc-b90a-19f22092e490 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:34.708582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bcf3e7c-ba63-46dc-b90a-19f22092e490 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:34.709449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bcf3e7c-ba63-46dc-b90a-19f22092e490 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:34.710237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bcf3e7c-ba63-46dc-b90a-19f22092e490 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:34.710676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bcf3e7c-ba63-46dc-b90a-19f22092e490 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:34.979681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8bcf3e7c-ba63-46dc-b90a-19f22092e490 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:34.996435 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8bcf3e7c-ba63-46dc-b90a-19f22092e490 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1537 microversion: 2.1 time: 0.304543 Aug 04 13:56:34.998496 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 469/907] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:34 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:35.016200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13f96afb-4472-4b22-bf00-15326846f3de tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:35.017104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13f96afb-4472-4b22-bf00-15326846f3de tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:35.029876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13f96afb-4472-4b22-bf00-15326846f3de tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:35.030830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13f96afb-4472-4b22-bf00-15326846f3de tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:35.031814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13f96afb-4472-4b22-bf00-15326846f3de tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:35.033330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13f96afb-4472-4b22-bf00-15326846f3de tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:35.372367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-13f96afb-4472-4b22-bf00-15326846f3de tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:35.388529 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13f96afb-4472-4b22-bf00-15326846f3de tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1324 microversion: 2.1 time: 0.387514 Aug 04 13:56:35.390703 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 470/908] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:34 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:35.398870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9e70eaf7-7cfe-408c-845a-85b727506fbd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:35.400435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9e70eaf7-7cfe-408c-845a-85b727506fbd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:35.410335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e70eaf7-7cfe-408c-845a-85b727506fbd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:35.411841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e70eaf7-7cfe-408c-845a-85b727506fbd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:35.412852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e70eaf7-7cfe-408c-845a-85b727506fbd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:35.414167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e70eaf7-7cfe-408c-845a-85b727506fbd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:35.575846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-9e70eaf7-7cfe-408c-845a-85b727506fbd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:35.609008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9e70eaf7-7cfe-408c-845a-85b727506fbd tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1935 microversion: 2.75 time: 0.216107 Aug 04 13:56:35.611893 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 471/909] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:35 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1935 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:35.630055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19459025-550e-4cfe-9961-92ae117964bc tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:35.631220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19459025-550e-4cfe-9961-92ae117964bc tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:35.633532 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc34dd94-72d7-410c-b2a4-e7f274d11bd7 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a/action" status: 202 len: 0 microversion: 2.25 time: 4.267603 Aug 04 13:56:35.639812 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 439/910] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 13:56:31 2022] POST /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a/action => generated 0 bytes in 4274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:56:35.645354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:35.646808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:35.654504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:35.655474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:35.656524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:35.657230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:35.670967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19459025-550e-4cfe-9961-92ae117964bc tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:35.675115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19459025-550e-4cfe-9961-92ae117964bc tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:35.678064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19459025-550e-4cfe-9961-92ae117964bc tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:35.678938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19459025-550e-4cfe-9961-92ae117964bc tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:35.988424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-19459025-550e-4cfe-9961-92ae117964bc tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:35.999934 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19459025-550e-4cfe-9961-92ae117964bc tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.385853 Aug 04 13:56:36.014518 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 472/911] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:35 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:36.017060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:36.020633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d966058a-a864-4b48-bf2b-5d19a76cc887 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:36.021357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d966058a-a864-4b48-bf2b-5d19a76cc887 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:36.029629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d966058a-a864-4b48-bf2b-5d19a76cc887 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:36.030713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d966058a-a864-4b48-bf2b-5d19a76cc887 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:36.031290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d966058a-a864-4b48-bf2b-5d19a76cc887 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:36.031796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d966058a-a864-4b48-bf2b-5d19a76cc887 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:36.032572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:36.034204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:36.037892 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b16ef7b-030a-4c4a-aefa-9e967a5dc073 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.394811 Aug 04 13:56:36.049652 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 440/912] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:35 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:36.192297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d966058a-a864-4b48-bf2b-5d19a76cc887 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:36.201317 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d966058a-a864-4b48-bf2b-5d19a76cc887 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1537 microversion: 2.1 time: 0.185464 Aug 04 13:56:36.202154 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 473/913] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:36 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:36.414196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d774e1b7-4c3d-4128-8665-1f611ec1bd1d tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:36.414995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d774e1b7-4c3d-4128-8665-1f611ec1bd1d tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:36.417719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:36.418588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=54 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:36.426097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d774e1b7-4c3d-4128-8665-1f611ec1bd1d tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:36.426549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d774e1b7-4c3d-4128-8665-1f611ec1bd1d tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:36.427326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d774e1b7-4c3d-4128-8665-1f611ec1bd1d tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:36.427759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d774e1b7-4c3d-4128-8665-1f611ec1bd1d tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:36.623754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d774e1b7-4c3d-4128-8665-1f611ec1bd1d tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:36.632399 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d774e1b7-4c3d-4128-8665-1f611ec1bd1d tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1324 microversion: 2.1 time: 0.222144 Aug 04 13:56:36.633114 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 441/914] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:36 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:36.638810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-587d860a-26af-44e1-918a-aa284ad86fea tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:36.639425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-587d860a-26af-44e1-918a-aa284ad86fea tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:36.646869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-587d860a-26af-44e1-918a-aa284ad86fea tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:36.647341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-587d860a-26af-44e1-918a-aa284ad86fea tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:36.648132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-587d860a-26af-44e1-918a-aa284ad86fea tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:36.648703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-587d860a-26af-44e1-918a-aa284ad86fea tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:36.756134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-587d860a-26af-44e1-918a-aa284ad86fea tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:36.760044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:36.778092 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-587d860a-26af-44e1-918a-aa284ad86fea tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1935 microversion: 2.75 time: 0.143901 Aug 04 13:56:36.778790 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 474/915] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:36 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1935 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:37.031868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c00e6373-93fd-484b-8f41-7daf7ccd0bd2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:37.034256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c00e6373-93fd-484b-8f41-7daf7ccd0bd2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:37.042846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c00e6373-93fd-484b-8f41-7daf7ccd0bd2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.043627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c00e6373-93fd-484b-8f41-7daf7ccd0bd2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.044403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c00e6373-93fd-484b-8f41-7daf7ccd0bd2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.045071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c00e6373-93fd-484b-8f41-7daf7ccd0bd2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.063331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:37.064177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:37.071595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.072245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.073665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.074205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.258044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c00e6373-93fd-484b-8f41-7daf7ccd0bd2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:37.272837 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c00e6373-93fd-484b-8f41-7daf7ccd0bd2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.250329 Aug 04 13:56:37.273710 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 442/916] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:37 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:37.292555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-80c9c1db-f999-47ac-bff1-9b5dccdd35f4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:37.293241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-80c9c1db-f999-47ac-bff1-9b5dccdd35f4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:37.302914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80c9c1db-f999-47ac-bff1-9b5dccdd35f4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.303482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80c9c1db-f999-47ac-bff1-9b5dccdd35f4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.304383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80c9c1db-f999-47ac-bff1-9b5dccdd35f4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.304954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80c9c1db-f999-47ac-bff1-9b5dccdd35f4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.373203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:37.386416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:37.393968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:37.397677 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8876397d-9ebb-4298-99e7-8e8aff559f47 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.337859 Aug 04 13:56:37.399511 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 475/917] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:37 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:56:37.656753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ac98cd3-dcbe-4e3e-a725-7e6d41383a0f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:37.658400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0ac98cd3-dcbe-4e3e-a725-7e6d41383a0f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:37.673404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac98cd3-dcbe-4e3e-a725-7e6d41383a0f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.674246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac98cd3-dcbe-4e3e-a725-7e6d41383a0f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.675247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac98cd3-dcbe-4e3e-a725-7e6d41383a0f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.687859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac98cd3-dcbe-4e3e-a725-7e6d41383a0f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.718716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-80c9c1db-f999-47ac-bff1-9b5dccdd35f4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:37.727686 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-80c9c1db-f999-47ac-bff1-9b5dccdd35f4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1537 microversion: 2.1 time: 0.446567 Aug 04 13:56:37.732857 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 443/918] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:37 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1537 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:37.737929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0973f7a8-7dc4-42d6-bd92-a36833a5fad0 req-fa414a5c-6ced-4334-a5a9-acc40c45eae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a80a01-edba-4355-8d27-8fac463e118a", "name": "network-vif-plugged", "status": "completed", "tag": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:37.767430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0973f7a8-7dc4-42d6-bd92-a36833a5fad0 req-fa414a5c-6ced-4334-a5a9-acc40c45eae1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.768247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0973f7a8-7dc4-42d6-bd92-a36833a5fad0 req-fa414a5c-6ced-4334-a5a9-acc40c45eae1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.783098 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0973f7a8-7dc4-42d6-bd92-a36833a5fad0 req-fa414a5c-6ced-4334-a5a9-acc40c45eae1 service nova] Creating event network-vif-plugged:83bf7c82-4313-4b52-9ea6-3efdcbf48b07 for instance 33a80a01-edba-4355-8d27-8fac463e118a on n-h2-844627-10 Aug 04 13:56:37.804437 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0973f7a8-7dc4-42d6-bd92-a36833a5fad0 req-fa414a5c-6ced-4334-a5a9-acc40c45eae1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070017 Aug 04 13:56:37.805361 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 444/919] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:37.810619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a84b7562-67e8-4dbb-9c6d-f40fb562ed47 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:37.811933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a84b7562-67e8-4dbb-9c6d-f40fb562ed47 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:37.820413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a84b7562-67e8-4dbb-9c6d-f40fb562ed47 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.821234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a84b7562-67e8-4dbb-9c6d-f40fb562ed47 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.822216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a84b7562-67e8-4dbb-9c6d-f40fb562ed47 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:37.824218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a84b7562-67e8-4dbb-9c6d-f40fb562ed47 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:37.993235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-a84b7562-67e8-4dbb-9c6d-f40fb562ed47 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] Lazy-loading 'services' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:38.023218 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a84b7562-67e8-4dbb-9c6d-f40fb562ed47 tempest-ServersAdmin275Test-1212912968 tempest-ServersAdmin275Test-1212912968-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1920 microversion: 2.75 time: 0.216571 Aug 04 13:56:38.024775 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 445/920] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:37 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1920 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:38.071817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d614de1e-0bcb-44d0-9a6a-97fc894efebe tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:38.073197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d614de1e-0bcb-44d0-9a6a-97fc894efebe tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:38.080718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d614de1e-0bcb-44d0-9a6a-97fc894efebe tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:38.081580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d614de1e-0bcb-44d0-9a6a-97fc894efebe tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:38.082569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d614de1e-0bcb-44d0-9a6a-97fc894efebe tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:38.083208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d614de1e-0bcb-44d0-9a6a-97fc894efebe tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:38.114957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d614de1e-0bcb-44d0-9a6a-97fc894efebe tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:56:38.205256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0ac98cd3-dcbe-4e3e-a725-7e6d41383a0f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:38.219415 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d614de1e-0bcb-44d0-9a6a-97fc894efebe tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 204 len: 0 microversion: 2.75 time: 0.151709 Aug 04 13:56:38.220558 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 446/921] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 13:56:38 2022] DELETE /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 13:56:38.222137 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0ac98cd3-dcbe-4e3e-a725-7e6d41383a0f tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1324 microversion: 2.1 time: 0.572209 Aug 04 13:56:38.222743 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 476/922] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:37 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1324 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:38.232594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:38.233381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:38.242132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:38.243111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:38.243944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:38.244379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:38.297030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cde20e8e-e940-4d06-ae7f-d723f0c8f4b7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:38.298086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cde20e8e-e940-4d06-ae7f-d723f0c8f4b7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:38.305869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cde20e8e-e940-4d06-ae7f-d723f0c8f4b7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:38.313449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cde20e8e-e940-4d06-ae7f-d723f0c8f4b7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:38.314386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cde20e8e-e940-4d06-ae7f-d723f0c8f4b7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:38.314975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cde20e8e-e940-4d06-ae7f-d723f0c8f4b7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:38.424671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:38.439571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:38.446588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:38.458227 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-61bb6ecd-d7ec-45a4-8214-89d47cac7257 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1443 microversion: 2.75 time: 0.231317 Aug 04 13:56:38.459398 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 447/923] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:38 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1443 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:38.483660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:38.484286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:38.487329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:38.491955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:38.492576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:38.493591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:38.494330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.016509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cde20e8e-e940-4d06-ae7f-d723f0c8f4b7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.035593 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cde20e8e-e940-4d06-ae7f-d723f0c8f4b7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.741409 Aug 04 13:56:39.052385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.055062 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 477/924] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:38 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:39.055621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.058428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.076002 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1f45579-3abb-49d6-abe2-62d85336b777 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.584108 Aug 04 13:56:39.076787 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 448/925] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:38 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:39.086674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-12ae99f8-c803-4c3a-8ec3-c0ba3d1d7671 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:39.087555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-12ae99f8-c803-4c3a-8ec3-c0ba3d1d7671 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:39.099261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12ae99f8-c803-4c3a-8ec3-c0ba3d1d7671 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:39.099789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12ae99f8-c803-4c3a-8ec3-c0ba3d1d7671 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.100587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12ae99f8-c803-4c3a-8ec3-c0ba3d1d7671 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:39.101064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12ae99f8-c803-4c3a-8ec3-c0ba3d1d7671 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.168410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:39.272347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1b32159f-8db7-4955-ace5-56715ca37c79"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:39.275384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:39.284453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:39.285316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.286268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:39.286860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.433856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-12ae99f8-c803-4c3a-8ec3-c0ba3d1d7671 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.448762 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-12ae99f8-c803-4c3a-8ec3-c0ba3d1d7671 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1537 microversion: 2.1 time: 0.370171 Aug 04 13:56:39.450045 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 449/926] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:39 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1537 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:39.455768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-acebb25d-94ed-4267-adb0-950f6ff05d27 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:39.456652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-acebb25d-94ed-4267-adb0-950f6ff05d27 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:39.465290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-acebb25d-94ed-4267-adb0-950f6ff05d27 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:39.465810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-acebb25d-94ed-4267-adb0-950f6ff05d27 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.466694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-acebb25d-94ed-4267-adb0-950f6ff05d27 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:39.467205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-acebb25d-94ed-4267-adb0-950f6ff05d27 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.611600 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] HTTP exception thrown: Volume 1b32159f-8db7-4955-ace5-56715ca37c79 could not be found. Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Request method failure captured: Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: request: PUT /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments/0320572b-cacd-4384-b08d-4240f0ba594e HTTP/1.1 Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 74 Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-uJam0mk8lX2QqaPG2yrojnv2Yoy2TfVAhv7yji2EbWLKkPfhpofAdbRhc10z5YI1k_mwxjKmFCwS5eFq5Un_P24VVadNXXlagXm0q2YgkBaOv2La0j6fXDQoYY1o40gE-nxVVB6BctuYZ2OHloxlH8etN11GgIokuH6R_FWsi0Ng Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2dc7ec9ea62c47c29bfd7af499d52d1e Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesAdminNegativeTest-1889070668 Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:56:39.650597 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2dc7ec9ea62c47c29bfd7af499d52d1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2dc7ec9ea62c47c29bfd7af499d52d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2dc7ec9ea62c47c29bfd7af499d52d1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2dc7ec9ea62c47c29bfd7af499d52d1e"}]}] Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesAdminNegativeTest-1889070668 Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2dc7ec9ea62c47c29bfd7af499d52d1e Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1889070668 Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesAdminNegativeTest-1889070668-project-admin Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7572040df9bc4d73a39183e8edb56583 Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesAdminNegativeTest-1889070668-project-admin Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: {"volumeAttachment": {"volumeId": "1b32159f-8db7-4955-ace5-56715ca37c79"}} Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:56:39.653330 n-d-844627-10 devstack@n-api.service[130961]: exception: Volume 1b32159f-8db7-4955-ace5-56715ca37c79 could not be found. Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': '63e44dc8-8cc8-4787-aac7-7b82cd8679e4', 'id': '0320572b-cacd-4384-b08d-4240f0ba594e', 'body': {'volumeAttachment': {'volumeId': '1b32159f-8db7-4955-ace5-56715ca37c79'}}} Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 13:56:39.654682 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b32159f-8db7-4955-ace5-56715ca37c79 could not be found. (HTTP 404) (Request-ID: req-9e30e129-00ff-4ccf-8ff1-f29684848ae4) Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 13:56:39.656174 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b32159f-8db7-4955-ace5-56715ca37c79 could not be found. Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:39.657668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 1b32159f-8db7-4955-ace5-56715ca37c79 could not be found. Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b32159f-8db7-4955-ace5-56715ca37c79 could not be found. Aug 04 13:56:39.659026 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:39.662619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Returning 400 to user: Volume 1b32159f-8db7-4955-ace5-56715ca37c79 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:39.662619 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3452a31f-4640-484b-bedf-debfabf6deab tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] 10.222.0.66 "PUT /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments/0320572b-cacd-4384-b08d-4240f0ba594e" status: 400 len: 107 microversion: 2.1 time: 0.585390 Aug 04 13:56:39.662619 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 478/927] 10.222.0.66 () {60 vars in 1433 bytes} [Thu Aug 4 13:56:39 2022] PUT /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments/0320572b-cacd-4384-b08d-4240f0ba594e => generated 107 bytes in 588 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:56:39.662619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-1d995903-8ad5-4ce9-86fc-2e21e88322fb req-a40101b2-43d0-45f4-8498-f9184c512a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c10284-3c28-4847-b418-8aa77c90a92a", "name": "network-vif-unplugged", "status": "completed", "tag": "5ac920bb-6091-4fef-9386-511d0cf7d506"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:39.679762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1d995903-8ad5-4ce9-86fc-2e21e88322fb req-a40101b2-43d0-45f4-8498-f9184c512a61 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:39.680211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1d995903-8ad5-4ce9-86fc-2e21e88322fb req-a40101b2-43d0-45f4-8498-f9184c512a61 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.709995 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-1d995903-8ad5-4ce9-86fc-2e21e88322fb req-a40101b2-43d0-45f4-8498-f9184c512a61 service nova] Creating event network-vif-unplugged:5ac920bb-6091-4fef-9386-511d0cf7d506 for instance e9c10284-3c28-4847-b418-8aa77c90a92a on n-h2-844627-10 Aug 04 13:56:39.727891 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-1d995903-8ad5-4ce9-86fc-2e21e88322fb req-a40101b2-43d0-45f4-8498-f9184c512a61 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081406 Aug 04 13:56:39.729503 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 479/928] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:39.735032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-acebb25d-94ed-4267-adb0-950f6ff05d27 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.746160 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-acebb25d-94ed-4267-adb0-950f6ff05d27 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1520 microversion: 2.1 time: 0.294717 Aug 04 13:56:39.747150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 450/929] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:39 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:39.749952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:39.750783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:39.767412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:39.768071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.769080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:39.769830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:39.786348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-089a09fd-d373-4f0e-9584-1f3b6a59948e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Action: 'create', calling method: .version_select at 0x7f470020dd30>, body: {"pool": null} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:39.949181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.964838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.967004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:39.974764 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22b7ea13-ecb1-4dc1-a357-31eb30ada352 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1443 microversion: 2.75 time: 0.236774 Aug 04 13:56:39.990179 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 480/930] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:39 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1443 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:39.990179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd9efce0-fe2a-4e76-bc3c-5cb60d362bce tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:39.990179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bd9efce0-fe2a-4e76-bc3c-5cb60d362bce tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:40.010694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd9efce0-fe2a-4e76-bc3c-5cb60d362bce tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:40.011444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd9efce0-fe2a-4e76-bc3c-5cb60d362bce tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:40.012462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd9efce0-fe2a-4e76-bc3c-5cb60d362bce tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:40.014562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd9efce0-fe2a-4e76-bc3c-5cb60d362bce tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:40.204097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-bd9efce0-fe2a-4e76-bc3c-5cb60d362bce tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lazy-loading 'services' on Instance uuid 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:40.400183 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd9efce0-fe2a-4e76-bc3c-5cb60d362bce tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "DELETE /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments/0320572b-cacd-4384-b08d-4240f0ba594e" status: 202 len: 0 microversion: 2.1 time: 0.414397 Aug 04 13:56:40.400912 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 481/931] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 13:56:39 2022] DELETE /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments/0320572b-cacd-4384-b08d-4240f0ba594e => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:56:40.411657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3148d647-90af-4bba-a197-eb9b016a3d52 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:40.413115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3148d647-90af-4bba-a197-eb9b016a3d52 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:40.422853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3148d647-90af-4bba-a197-eb9b016a3d52 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:40.425148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3148d647-90af-4bba-a197-eb9b016a3d52 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:40.426181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3148d647-90af-4bba-a197-eb9b016a3d52 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:40.426741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3148d647-90af-4bba-a197-eb9b016a3d52 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:40.667402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3148d647-90af-4bba-a197-eb9b016a3d52 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:40.676274 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3148d647-90af-4bba-a197-eb9b016a3d52 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.272416 Aug 04 13:56:40.677246 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 482/932] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:40 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:40.683750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:40.684527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:40.694679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:40.695232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:40.696200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:40.696620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:40.972256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:40.984144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:40.990448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:40.996969 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3f20356d-e713-4ae8-a884-cf8e6a0f3d82 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.317307 Aug 04 13:56:41.003098 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 483/933] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:40 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:41.009109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-62094c4b-bb70-47c3-b859-9c348e7304f1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:41.013348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-62094c4b-bb70-47c3-b859-9c348e7304f1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:41.022678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62094c4b-bb70-47c3-b859-9c348e7304f1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.027564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62094c4b-bb70-47c3-b859-9c348e7304f1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.029777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62094c4b-bb70-47c3-b859-9c348e7304f1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.030700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62094c4b-bb70-47c3-b859-9c348e7304f1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.067243 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-62094c4b-bb70-47c3-b859-9c348e7304f1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064044 Aug 04 13:56:41.068039 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 484/934] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 13:56:41 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:41.077371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f655eba9-7ec3-44e5-bef2-d93facf3230b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:41.077999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f655eba9-7ec3-44e5-bef2-d93facf3230b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:41.081541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:41.085581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f655eba9-7ec3-44e5-bef2-d93facf3230b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.086034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f655eba9-7ec3-44e5-bef2-d93facf3230b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.086816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f655eba9-7ec3-44e5-bef2-d93facf3230b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.087254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f655eba9-7ec3-44e5-bef2-d93facf3230b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.313684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f655eba9-7ec3-44e5-bef2-d93facf3230b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:41.325208 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f655eba9-7ec3-44e5-bef2-d93facf3230b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.252320 Aug 04 13:56:41.326113 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 485/935] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:41 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:41.345273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:41.345894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:41.353179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.353803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.355167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.355604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.393396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.394097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.394754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lazy-loading 'fault' on Instance uuid 3c059425-829b-4f5b-b09c-e1839b3c28ca {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:41.487054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:41.500184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:41.503652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bb09533ed914c6bbbabd297e1d7b2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc37a49b672e409a86cfeed9d5a2ac60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:41.511207 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-694dbc7f-4e7e-41e2-a5aa-a83ae67827c8 tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 200 len: 1448 microversion: 2.75 time: 0.183168 Aug 04 13:56:41.512125 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 486/936] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:41 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 1448 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:41.624635 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-089a09fd-d373-4f0e-9584-1f3b6a59948e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.860270 Aug 04 13:56:41.625885 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 451/937] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 13:56:39 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:41.705129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e01f2b0c-ecdd-49d3-8758-cdff1705ac0c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:41.705767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e01f2b0c-ecdd-49d3-8758-cdff1705ac0c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:41.715645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e01f2b0c-ecdd-49d3-8758-cdff1705ac0c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.716111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e01f2b0c-ecdd-49d3-8758-cdff1705ac0c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.718086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e01f2b0c-ecdd-49d3-8758-cdff1705ac0c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.719918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e01f2b0c-ecdd-49d3-8758-cdff1705ac0c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.753894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-49fe2d0b-b797-4102-83a8-ad1ea4ff081c req-211c4703-fd43-4d96-b218-287ccc40f354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c10284-3c28-4847-b418-8aa77c90a92a", "tag": "5ac920bb-6091-4fef-9386-511d0cf7d506"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:41.770776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-49fe2d0b-b797-4102-83a8-ad1ea4ff081c req-211c4703-fd43-4d96-b218-287ccc40f354 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:41.777352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-49fe2d0b-b797-4102-83a8-ad1ea4ff081c req-211c4703-fd43-4d96-b218-287ccc40f354 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:41.791014 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-49fe2d0b-b797-4102-83a8-ad1ea4ff081c req-211c4703-fd43-4d96-b218-287ccc40f354 service nova] Creating event network-changed:5ac920bb-6091-4fef-9386-511d0cf7d506 for instance e9c10284-3c28-4847-b418-8aa77c90a92a on n-h2-844627-10 Aug 04 13:56:41.797380 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-49fe2d0b-b797-4102-83a8-ad1ea4ff081c req-211c4703-fd43-4d96-b218-287ccc40f354 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047377 Aug 04 13:56:41.802800 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 452/938] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:41.836270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-652827414", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "bd0c2de1-a833-4902-b343-80481e8458ff"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:41.922758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] validate_networks() for [('bd0c2de1-a833-4902-b343-80481e8458ff', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:42.093932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e01f2b0c-ecdd-49d3-8758-cdff1705ac0c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:42.102808 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e01f2b0c-ecdd-49d3-8758-cdff1705ac0c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.405228 Aug 04 13:56:42.115337 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 487/939] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:41 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:42.121959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:42.123177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:42.129770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:42.130382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:42.131801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:42.131801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:42.461163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:42.490867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:42.493076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:42.495358 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-448a8c7a-cc3a-42d0-a470-535a9549108e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.389482 Aug 04 13:56:42.496662 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 488/940] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:42 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:42.502543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-31b06b3d-5492-4f24-9ee1-1e6d69bdfe2c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:42.505251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-31b06b3d-5492-4f24-9ee1-1e6d69bdfe2c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:42.515359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31b06b3d-5492-4f24-9ee1-1e6d69bdfe2c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:42.516445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31b06b3d-5492-4f24-9ee1-1e6d69bdfe2c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:42.517484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31b06b3d-5492-4f24-9ee1-1e6d69bdfe2c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:42.518313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31b06b3d-5492-4f24-9ee1-1e6d69bdfe2c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:42.558583 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-31b06b3d-5492-4f24-9ee1-1e6d69bdfe2c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060330 Aug 04 13:56:42.559650 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 489/941] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 13:56:42 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:42.565190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9ad028de-b393-4884-86d4-9a63d1f3cc80 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:42.566284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9ad028de-b393-4884-86d4-9a63d1f3cc80 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:42.575156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ad028de-b393-4884-86d4-9a63d1f3cc80 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:42.576166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ad028de-b393-4884-86d4-9a63d1f3cc80 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:42.577357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ad028de-b393-4884-86d4-9a63d1f3cc80 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:42.578096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ad028de-b393-4884-86d4-9a63d1f3cc80 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.188092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9ad028de-b393-4884-86d4-9a63d1f3cc80 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:43.199049 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9ad028de-b393-4884-86d4-9a63d1f3cc80 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.637671 Aug 04 13:56:43.200836 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 490/942] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:42 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:43.202827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:43.203312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:43.203700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:43.204102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:43.204509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:43.210581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:43.211801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] [instance: 3c059425-829b-4f5b-b09c-e1839b3c28ca] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:43.218028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.220324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.222368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.223554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.225889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.228011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.229249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.229926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.256972 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] HTTP exception thrown: Instance 3c059425-829b-4f5b-b09c-e1839b3c28ca could not be found. Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Request method failure captured: Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca HTTP/1.1 Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-wWU4s8Ybfp4HObJJwDse8bTHAM6FwiWDEDNAe_nLH7kyQKe9iVWuM7GtpHogr6CFox2_bdZPcPK0J8Op3MyCgrEShoNpB-FytKKnI8tLdbAkGYgizw7-lpvuQnlKeT3SPnYEn7V0PqpuqlyWl1iHkTF2vlygXfdCeisqEK1EOEDI Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.75 Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: bc37a49b672e409a86cfeed9d5a2ac60 Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersAdmin275Test-1312715009 Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:56:43.259290 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bc37a49b672e409a86cfeed9d5a2ac60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bc37a49b672e409a86cfeed9d5a2ac60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bc37a49b672e409a86cfeed9d5a2ac60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bc37a49b672e409a86cfeed9d5a2ac60"}]}] Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersAdmin275Test-1312715009 Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: bc37a49b672e409a86cfeed9d5a2ac60 Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersAdmin275Test-1312715009 Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersAdmin275Test-1312715009-project Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 5bb09533ed914c6bbbabd297e1d7b2fd Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersAdmin275Test-1312715009-project Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3c059425-829b-4f5b-b09c-e1839b3c28ca could not be found. Aug 04 13:56:43.261394 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3c059425-829b-4f5b-b09c-e1839b3c28ca'} Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c059425-829b-4f5b-b09c-e1839b3c28ca could not be found. Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:56:43.262960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c059425-829b-4f5b-b09c-e1839b3c28ca could not be found. Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c059425-829b-4f5b-b09c-e1839b3c28ca could not be found. Aug 04 13:56:43.264619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:56:43.265919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Getting quotas for project 9e5afd8e587c41d8bc0f86c89a38fce2. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:43.267322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] Returning 404 to user: Instance 3c059425-829b-4f5b-b09c-e1839b3c28ca could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:56:43.268286 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68e80ade-2b62-4ecc-a695-c9d5a725257f tempest-ServersAdmin275Test-1312715009 tempest-ServersAdmin275Test-1312715009-project] 10.222.0.66 "GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca" status: 404 len: 111 microversion: 2.75 time: 0.066048 Aug 04 13:56:43.269164 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 491/943] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:43 2022] GET /compute/v2.1/servers/3c059425-829b-4f5b-b09c-e1839b3c28ca => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:56:43.269581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Getting quotas for user 314b6dcaf21b4fb197cbd03275229572 and project 9e5afd8e587c41d8bc0f86c89a38fce2. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:43.273975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55ebf326-7bc0-42b8-8779-e44688f0a722 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:43.274675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55ebf326-7bc0-42b8-8779-e44688f0a722 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:43.281992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55ebf326-7bc0-42b8-8779-e44688f0a722 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.282537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55ebf326-7bc0-42b8-8779-e44688f0a722 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.283552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55ebf326-7bc0-42b8-8779-e44688f0a722 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.284189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55ebf326-7bc0-42b8-8779-e44688f0a722 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.289274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:43.310111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:56:43.319684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:56:43.429715 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2f03337f-b6d9-4a21-b565-53e15b21f3eb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.624534 Aug 04 13:56:43.432859 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 453/944] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:56:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:56:43.448668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9691dde1-80a5-46ef-a338-4c1c8ac3bb83 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:43.450247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9691dde1-80a5-46ef-a338-4c1c8ac3bb83 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:43.464025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-55ebf326-7bc0-42b8-8779-e44688f0a722 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:43.476821 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55ebf326-7bc0-42b8-8779-e44688f0a722 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.206700 Aug 04 13:56:43.480980 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 492/945] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:43 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:43.522437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:43.523337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:43.531557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.532594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.533577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.534169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.552375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9691dde1-80a5-46ef-a338-4c1c8ac3bb83 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:43.565774 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9691dde1-80a5-46ef-a338-4c1c8ac3bb83 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1223 microversion: 2.1 time: 0.122382 Aug 04 13:56:43.568199 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 454/946] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:43 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1223 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:43.581737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-270c022d-6783-4c72-b6ea-a52b236e0c98 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:43.584094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-270c022d-6783-4c72-b6ea-a52b236e0c98 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:43.604608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-270c022d-6783-4c72-b6ea-a52b236e0c98 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.605113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-270c022d-6783-4c72-b6ea-a52b236e0c98 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.607748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-270c022d-6783-4c72-b6ea-a52b236e0c98 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:43.608221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-270c022d-6783-4c72-b6ea-a52b236e0c98 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:43.678194 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-270c022d-6783-4c72-b6ea-a52b236e0c98 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108871 Aug 04 13:56:43.682689 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 455/947] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 13:56:43 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:43.772504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:43.789249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:43.794989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:43.800264 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22b6ac8b-0f50-40d0-bf6b-01f3296a0e0d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.279724 Aug 04 13:56:43.802111 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 493/948] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:43 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:44.223750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c4853c2a-8045-4583-816d-dfdbab91e150 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:44.224546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c4853c2a-8045-4583-816d-dfdbab91e150 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:44.232854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4853c2a-8045-4583-816d-dfdbab91e150 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.245153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4853c2a-8045-4583-816d-dfdbab91e150 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:44.247132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4853c2a-8045-4583-816d-dfdbab91e150 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.248121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4853c2a-8045-4583-816d-dfdbab91e150 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:44.487248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c4853c2a-8045-4583-816d-dfdbab91e150 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:44.499599 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c4853c2a-8045-4583-816d-dfdbab91e150 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.279600 Aug 04 13:56:44.502634 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 456/949] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:44 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:44.525965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d6f2004b-e0b9-4e03-9235-525908e99bc0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:44.527428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d6f2004b-e0b9-4e03-9235-525908e99bc0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:44.536620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6f2004b-e0b9-4e03-9235-525908e99bc0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.537593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6f2004b-e0b9-4e03-9235-525908e99bc0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:44.539208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6f2004b-e0b9-4e03-9235-525908e99bc0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.540013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6f2004b-e0b9-4e03-9235-525908e99bc0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:44.716372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d6f2004b-e0b9-4e03-9235-525908e99bc0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:44.725526 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d6f2004b-e0b9-4e03-9235-525908e99bc0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.221702 Aug 04 13:56:44.726720 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 457/950] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:44 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:44.731990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6199d222-17ea-4a9e-bdfb-8588c72265c9 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:44.732943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6199d222-17ea-4a9e-bdfb-8588c72265c9 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:44.738895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:44.741104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6199d222-17ea-4a9e-bdfb-8588c72265c9 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.741829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6199d222-17ea-4a9e-bdfb-8588c72265c9 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:44.742994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6199d222-17ea-4a9e-bdfb-8588c72265c9 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.743672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6199d222-17ea-4a9e-bdfb-8588c72265c9 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:44.777680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1387742188", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:44.830119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6199d222-17ea-4a9e-bdfb-8588c72265c9 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:44.837608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:44.839405 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6199d222-17ea-4a9e-bdfb-8588c72265c9 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1275 microversion: 2.1 time: 0.109951 Aug 04 13:56:44.839405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 458/951] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:44 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:44.848791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e1282de6-51c4-4007-84a1-d3f4a6100ba5 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:44.851352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e1282de6-51c4-4007-84a1-d3f4a6100ba5 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:44.858031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1282de6-51c4-4007-84a1-d3f4a6100ba5 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.858690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1282de6-51c4-4007-84a1-d3f4a6100ba5 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:44.859650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1282de6-51c4-4007-84a1-d3f4a6100ba5 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.860105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1282de6-51c4-4007-84a1-d3f4a6100ba5 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:44.899997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e1282de6-51c4-4007-84a1-d3f4a6100ba5 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059338 Aug 04 13:56:44.901265 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 459/952] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 13:56:44 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:44.907218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:44.908104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:44.915621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.916088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:44.917119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:44.917614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:45.207141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:45.217478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:45.219361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:45.220642 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3abcf2a0-0fcd-4152-b81f-164accedb201 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.317732 Aug 04 13:56:45.234384 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 460/953] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:44 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:45.275290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:45.276542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:45.277053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:45.278195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:45.278799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:45.289189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:45.289675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:45.290500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:45.294822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:45.330502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Getting quotas for project 2e77863344504cef8b27ad7730d9452c. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:45.337152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Getting quotas for user d44afbc629004152807d0ac000e4c53a and project 2e77863344504cef8b27ad7730d9452c. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:45.355549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:56:45.358437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:56:45.438763 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dd6decf3-a973-420b-a49c-b0dd7e13759a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058818 Aug 04 13:56:45.439810 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 494/954] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:56:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:56:45.452983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2600bc25-bf5b-44d9-be9f-ed33213863f1 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:45.453624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2600bc25-bf5b-44d9-be9f-ed33213863f1 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:45.516855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2600bc25-bf5b-44d9-be9f-ed33213863f1 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:45.528172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb7f812d-6625-4fb1-b75a-75372e7eef40 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:45.528813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb7f812d-6625-4fb1-b75a-75372e7eef40 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:45.534207 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2600bc25-bf5b-44d9-be9f-ed33213863f1 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1220 microversion: 2.1 time: 0.086966 Aug 04 13:56:45.550541 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 461/955] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:45 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:45.552730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb7f812d-6625-4fb1-b75a-75372e7eef40 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:45.553897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb7f812d-6625-4fb1-b75a-75372e7eef40 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:45.554198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb7f812d-6625-4fb1-b75a-75372e7eef40 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:45.554647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb7f812d-6625-4fb1-b75a-75372e7eef40 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:45.753492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f0e9e9c-6a36-4e4c-b3cf-d09b5f87c7ca tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:45.753894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cb7f812d-6625-4fb1-b75a-75372e7eef40 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:45.754588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f0e9e9c-6a36-4e4c-b3cf-d09b5f87c7ca tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:45.770624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f0e9e9c-6a36-4e4c-b3cf-d09b5f87c7ca tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:45.773971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f0e9e9c-6a36-4e4c-b3cf-d09b5f87c7ca tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:45.776008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f0e9e9c-6a36-4e4c-b3cf-d09b5f87c7ca tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:45.778730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f0e9e9c-6a36-4e4c-b3cf-d09b5f87c7ca tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:45.779266 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb7f812d-6625-4fb1-b75a-75372e7eef40 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.255153 Aug 04 13:56:45.781753 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 495/956] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:45 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:45.860677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f3d42451-f26f-4352-9fbf-31878f713913 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:45.861337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f3d42451-f26f-4352-9fbf-31878f713913 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:45.871596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3d42451-f26f-4352-9fbf-31878f713913 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:45.872055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3d42451-f26f-4352-9fbf-31878f713913 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:45.876164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3d42451-f26f-4352-9fbf-31878f713913 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:45.876664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3d42451-f26f-4352-9fbf-31878f713913 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:46.109136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f3d42451-f26f-4352-9fbf-31878f713913 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:46.143499 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f3d42451-f26f-4352-9fbf-31878f713913 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1281 microversion: 2.1 time: 0.286721 Aug 04 13:56:46.145589 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 496/957] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:45 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1281 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:46.158868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75328e8b-4286-4ce1-a40c-a7cd41730a20 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:46.170829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-75328e8b-4286-4ce1-a40c-a7cd41730a20 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:46.186119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75328e8b-4286-4ce1-a40c-a7cd41730a20 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:46.186947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75328e8b-4286-4ce1-a40c-a7cd41730a20 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:46.188170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75328e8b-4286-4ce1-a40c-a7cd41730a20 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:46.191504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75328e8b-4286-4ce1-a40c-a7cd41730a20 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:46.211318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6f0e9e9c-6a36-4e4c-b3cf-d09b5f87c7ca tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:46.232278 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f0e9e9c-6a36-4e4c-b3cf-d09b5f87c7ca tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.478516 Aug 04 13:56:46.232988 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 462/958] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:45 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:46.290097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:46.290751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:46.295632 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75328e8b-4286-4ce1-a40c-a7cd41730a20 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148718 Aug 04 13:56:46.296742 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 497/959] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 13:56:46 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:46.327738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:46.328200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:46.329020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:46.329461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:46.556666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c00581a-2439-4c75-bbf8-36c24404f35a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:46.557563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c00581a-2439-4c75-bbf8-36c24404f35a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:46.566904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c00581a-2439-4c75-bbf8-36c24404f35a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:46.567355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c00581a-2439-4c75-bbf8-36c24404f35a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:46.568134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c00581a-2439-4c75-bbf8-36c24404f35a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:46.581640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c00581a-2439-4c75-bbf8-36c24404f35a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:46.733451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9c00581a-2439-4c75-bbf8-36c24404f35a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:46.748830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:46.774881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:46.776959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:46.778253 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e12530ab-44f2-4ba4-a3f2-df07dfb24b19 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.523096 Aug 04 13:56:46.789928 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c00581a-2439-4c75-bbf8-36c24404f35a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1216 microversion: 2.1 time: 0.219155 Aug 04 13:56:46.804648 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 498/960] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:46 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1216 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:46.819368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-639064d7-58dc-432a-b30f-506cea12dc4d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:46.820310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-639064d7-58dc-432a-b30f-506cea12dc4d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:46.820820 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 463/961] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:46 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:46.834523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639064d7-58dc-432a-b30f-506cea12dc4d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:46.835019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639064d7-58dc-432a-b30f-506cea12dc4d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:46.835901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639064d7-58dc-432a-b30f-506cea12dc4d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:46.836233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639064d7-58dc-432a-b30f-506cea12dc4d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.087370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-639064d7-58dc-432a-b30f-506cea12dc4d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:47.112120 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-639064d7-58dc-432a-b30f-506cea12dc4d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.301928 Aug 04 13:56:47.112927 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 499/962] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:46 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:47.172024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c55ad37-dfa3-412b-97d6-050b76ea1e96 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:47.173322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0c55ad37-dfa3-412b-97d6-050b76ea1e96 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:47.191177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c55ad37-dfa3-412b-97d6-050b76ea1e96 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.192249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c55ad37-dfa3-412b-97d6-050b76ea1e96 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.195927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c55ad37-dfa3-412b-97d6-050b76ea1e96 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.197213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c55ad37-dfa3-412b-97d6-050b76ea1e96 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.262911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7f231248-4faa-42f0-b6dd-9ff5b7ad2f2a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:47.263968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7f231248-4faa-42f0-b6dd-9ff5b7ad2f2a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:47.272663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f231248-4faa-42f0-b6dd-9ff5b7ad2f2a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.273422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f231248-4faa-42f0-b6dd-9ff5b7ad2f2a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.277146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f231248-4faa-42f0-b6dd-9ff5b7ad2f2a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.277902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f231248-4faa-42f0-b6dd-9ff5b7ad2f2a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.607893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0c55ad37-dfa3-412b-97d6-050b76ea1e96 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:47.617975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7f231248-4faa-42f0-b6dd-9ff5b7ad2f2a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:47.618177 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c55ad37-dfa3-412b-97d6-050b76ea1e96 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1323 microversion: 2.1 time: 0.451392 Aug 04 13:56:47.628918 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 464/963] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:47 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:47.628918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6bea7b10-9cff-4e75-b95f-39aaeade070c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:47.629236 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7f231248-4faa-42f0-b6dd-9ff5b7ad2f2a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.373839 Aug 04 13:56:47.629236 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 500/964] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:47 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:47.632030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-e7eac950-9b39-419b-8281-eba2013a1ff5 req-ad747600-55e1-4467-9160-5bf6a94cdb3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4979b7c-1bc6-4922-9345-99e402757bbd", "tag": "39459960-3571-47a9-bd3d-aa345456dc55"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:47.634760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6bea7b10-9cff-4e75-b95f-39aaeade070c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:47.647131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bea7b10-9cff-4e75-b95f-39aaeade070c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.647682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bea7b10-9cff-4e75-b95f-39aaeade070c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.648481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bea7b10-9cff-4e75-b95f-39aaeade070c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.648953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bea7b10-9cff-4e75-b95f-39aaeade070c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.661068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e7eac950-9b39-419b-8281-eba2013a1ff5 req-ad747600-55e1-4467-9160-5bf6a94cdb3f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.661530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e7eac950-9b39-419b-8281-eba2013a1ff5 req-ad747600-55e1-4467-9160-5bf6a94cdb3f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.682759 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6bea7b10-9cff-4e75-b95f-39aaeade070c tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062362 Aug 04 13:56:47.691237 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-e7eac950-9b39-419b-8281-eba2013a1ff5 req-ad747600-55e1-4467-9160-5bf6a94cdb3f service nova] Creating event network-changed:39459960-3571-47a9-bd3d-aa345456dc55 for instance e4979b7c-1bc6-4922-9345-99e402757bbd on n-h1-844627-10 Aug 04 13:56:47.704955 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-e7eac950-9b39-419b-8281-eba2013a1ff5 req-ad747600-55e1-4467-9160-5bf6a94cdb3f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071125 Aug 04 13:56:47.706171 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 501/965] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:47.721020 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 465/966] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 13:56:47 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:56:47.827643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-689e9651-cfd7-46de-bad1-599db8e0debb tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:47.828349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-689e9651-cfd7-46de-bad1-599db8e0debb tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:47.830870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:47.834321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:47.844897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-689e9651-cfd7-46de-bad1-599db8e0debb tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.846393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.847388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-689e9651-cfd7-46de-bad1-599db8e0debb tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.849214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-689e9651-cfd7-46de-bad1-599db8e0debb tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.849588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.850336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-689e9651-cfd7-46de-bad1-599db8e0debb tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:47.851775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:47.852223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:48.013985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-689e9651-cfd7-46de-bad1-599db8e0debb tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:48.026456 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-689e9651-cfd7-46de-bad1-599db8e0debb tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1278 microversion: 2.1 time: 0.209398 Aug 04 13:56:48.027975 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 466/967] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:47 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:48.034923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1915249501", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "3b5ac0de-c12c-4194-b159-5942319edd05"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:48.100292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] validate_networks() for [('3b5ac0de-c12c-4194-b159-5942319edd05', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:48.297495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:48.307788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:48.309948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:48.311485 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbf42e5f-418a-45cf-9e59-6a2630f68d1b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.493637 Aug 04 13:56:48.312044 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 502/968] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:47 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:48.470770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-256537362", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:48.527008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:48.993018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:48.993498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:48.993888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:48.994286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:48.995237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:48.996672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:48.997250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:48.998014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:48.998523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:48.999086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:49.010779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.011302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.012213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.012846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.020625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.021595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.022395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.022842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.035109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Getting quotas for project 8c532a5466be43d68f5517db3c731bcc. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:49.040731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Getting quotas for user 8e166178676342cdb27f729225343f82 and project 8c532a5466be43d68f5517db3c731bcc. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:49.046152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Getting quotas for project 6adc52f7e03846d3a73ef1c6d2b040cd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:49.052034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Getting quotas for user c5534a5c5eff41e998b2b92ca13bb372 and project 6adc52f7e03846d3a73ef1c6d2b040cd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:49.058431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:56:49.061102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:56:49.067216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:56:49.070133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:56:49.107595 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b5b50b67-5e79-4c4a-a2ac-7092d20f82b4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793903 Aug 04 13:56:49.108559 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 503/969] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:56:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:56:49.113378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6c484618-bf82-43f7-9211-b131ba5a1d06 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:49.114259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6c484618-bf82-43f7-9211-b131ba5a1d06 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:49.121728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c484618-bf82-43f7-9211-b131ba5a1d06 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.122363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c484618-bf82-43f7-9211-b131ba5a1d06 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.123298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c484618-bf82-43f7-9211-b131ba5a1d06 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.123894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c484618-bf82-43f7-9211-b131ba5a1d06 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.131703 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-03b7ae47-cc0d-4bc9-a3bc-c35832a91a11 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102030 Aug 04 13:56:49.133257 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 467/970] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:56:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:56:49.146389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2a9c6336-694b-46ce-8454-4d591d49f93b tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:49.147023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2a9c6336-694b-46ce-8454-4d591d49f93b tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:49.155109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a9c6336-694b-46ce-8454-4d591d49f93b tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.155810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a9c6336-694b-46ce-8454-4d591d49f93b tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.156593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a9c6336-694b-46ce-8454-4d591d49f93b tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.157065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a9c6336-694b-46ce-8454-4d591d49f93b tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.320955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6c484618-bf82-43f7-9211-b131ba5a1d06 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.336522 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6c484618-bf82-43f7-9211-b131ba5a1d06 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.226603 Aug 04 13:56:49.348909 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 504/971] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:49 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:49.348909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-880ca307-ca00-4348-add0-24d945ed661f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:49.348909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-880ca307-ca00-4348-add0-24d945ed661f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:49.357821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-880ca307-ca00-4348-add0-24d945ed661f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.358356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-880ca307-ca00-4348-add0-24d945ed661f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.359159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-880ca307-ca00-4348-add0-24d945ed661f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.359539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-880ca307-ca00-4348-add0-24d945ed661f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.419145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a9c6336-694b-46ce-8454-4d591d49f93b tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.429441 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2a9c6336-694b-46ce-8454-4d591d49f93b tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1323 microversion: 2.1 time: 0.293246 Aug 04 13:56:49.430715 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 468/972] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:49 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:49.444669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aac0346c-663a-4eea-832a-d05507fbb411 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:49.445633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aac0346c-663a-4eea-832a-d05507fbb411 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:49.455114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aac0346c-663a-4eea-832a-d05507fbb411 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.455759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aac0346c-663a-4eea-832a-d05507fbb411 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.459612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aac0346c-663a-4eea-832a-d05507fbb411 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.460191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aac0346c-663a-4eea-832a-d05507fbb411 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.597537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-880ca307-ca00-4348-add0-24d945ed661f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.610930 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-880ca307-ca00-4348-add0-24d945ed661f tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.272122 Aug 04 13:56:49.611528 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 505/973] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:49 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:49.625934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-16393c29-efbc-4166-a701-0f356a8fb1f6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:49.625934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-16393c29-efbc-4166-a701-0f356a8fb1f6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:49.693955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-16393c29-efbc-4166-a701-0f356a8fb1f6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.700675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aac0346c-663a-4eea-832a-d05507fbb411 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.702140 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-16393c29-efbc-4166-a701-0f356a8fb1f6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1221 microversion: 2.1 time: 0.089524 Aug 04 13:56:49.703545 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 506/974] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:49 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:49.710528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-43b1ad06-98a4-4d8e-a0c6-6e2f167b3456 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:49.711237 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aac0346c-663a-4eea-832a-d05507fbb411 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1320 microversion: 2.1 time: 0.279420 Aug 04 13:56:49.711671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-43b1ad06-98a4-4d8e-a0c6-6e2f167b3456 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:49.721928 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 469/975] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:49 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:49.734637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:49.735263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:49.746375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.746685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.747551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:49.748118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:49.779494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-43b1ad06-98a4-4d8e-a0c6-6e2f167b3456 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.788287 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-43b1ad06-98a4-4d8e-a0c6-6e2f167b3456 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1218 microversion: 2.1 time: 0.083315 Aug 04 13:56:49.792901 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 507/976] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:49 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:49.948902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.957160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.958654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:49.959801 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aee744cc-c639-4aca-b12e-d2dcc38ebcf8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.231560 Aug 04 13:56:49.960350 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 470/977] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:49 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:50.361133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0477157d-bd18-4aed-a4c4-b81aa238d60c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:50.361788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0477157d-bd18-4aed-a4c4-b81aa238d60c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:50.368442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0477157d-bd18-4aed-a4c4-b81aa238d60c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:50.368932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0477157d-bd18-4aed-a4c4-b81aa238d60c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:50.369736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0477157d-bd18-4aed-a4c4-b81aa238d60c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:50.370180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0477157d-bd18-4aed-a4c4-b81aa238d60c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:50.451922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c7b63fc-17b2-4e06-af71-c5b5e97aeccb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:50.452543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3c7b63fc-17b2-4e06-af71-c5b5e97aeccb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:50.458807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c7b63fc-17b2-4e06-af71-c5b5e97aeccb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:50.459265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c7b63fc-17b2-4e06-af71-c5b5e97aeccb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:50.460046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c7b63fc-17b2-4e06-af71-c5b5e97aeccb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:50.460490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c7b63fc-17b2-4e06-af71-c5b5e97aeccb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:50.465662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:50.511477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0477157d-bd18-4aed-a4c4-b81aa238d60c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:50.521611 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0477157d-bd18-4aed-a4c4-b81aa238d60c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.164322 Aug 04 13:56:50.522313 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 508/978] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:50 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:50.607662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c7b63fc-17b2-4e06-af71-c5b5e97aeccb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:50.616132 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c7b63fc-17b2-4e06-af71-c5b5e97aeccb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1323 microversion: 2.1 time: 0.169101 Aug 04 13:56:50.616728 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 471/979] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:50 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1323 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:50.638296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b0b711d7-04ea-4c34-a1c5-0ee52e647bc7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:50.638935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b0b711d7-04ea-4c34-a1c5-0ee52e647bc7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:50.645950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0b711d7-04ea-4c34-a1c5-0ee52e647bc7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:50.646878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0b711d7-04ea-4c34-a1c5-0ee52e647bc7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:50.647813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0b711d7-04ea-4c34-a1c5-0ee52e647bc7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:50.648257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0b711d7-04ea-4c34-a1c5-0ee52e647bc7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:50.724899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a2a77747-541c-4a90-906c-e6c2a8582fcb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:50.725448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a2a77747-541c-4a90-906c-e6c2a8582fcb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:50.737520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2a77747-541c-4a90-906c-e6c2a8582fcb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:50.738245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2a77747-541c-4a90-906c-e6c2a8582fcb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:50.739631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2a77747-541c-4a90-906c-e6c2a8582fcb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:50.740267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2a77747-541c-4a90-906c-e6c2a8582fcb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.141390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a2a77747-541c-4a90-906c-e6c2a8582fcb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:51.154114 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a2a77747-541c-4a90-906c-e6c2a8582fcb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1291 microversion: 2.1 time: 0.433553 Aug 04 13:56:51.155728 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 472/980] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:50 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1291 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:51.175446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-869180e8-66bf-4ed6-abdd-af6e1e13665d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:51.176057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-869180e8-66bf-4ed6-abdd-af6e1e13665d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:51.183029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-869180e8-66bf-4ed6-abdd-af6e1e13665d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.183495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-869180e8-66bf-4ed6-abdd-af6e1e13665d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.184249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-869180e8-66bf-4ed6-abdd-af6e1e13665d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.184687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-869180e8-66bf-4ed6-abdd-af6e1e13665d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.223724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b0b711d7-04ea-4c34-a1c5-0ee52e647bc7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:51.233030 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b0b711d7-04ea-4c34-a1c5-0ee52e647bc7 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.603110 Aug 04 13:56:51.233863 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 509/981] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:50 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:51.243927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b7d7324-e0e7-4736-939d-37b2386a3944 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:51.246507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b7d7324-e0e7-4736-939d-37b2386a3944 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:51.254230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b7d7324-e0e7-4736-939d-37b2386a3944 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.254765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b7d7324-e0e7-4736-939d-37b2386a3944 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.255644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b7d7324-e0e7-4736-939d-37b2386a3944 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.256156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b7d7324-e0e7-4736-939d-37b2386a3944 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.352760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4b7d7324-e0e7-4736-939d-37b2386a3944 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:51.362390 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4b7d7324-e0e7-4736-939d-37b2386a3944 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1276 microversion: 2.1 time: 0.126539 Aug 04 13:56:51.363736 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 510/982] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:51 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:51.382906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:51.383817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:51.392335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.392695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.393582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.394206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.498404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-869180e8-66bf-4ed6-abdd-af6e1e13665d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:51.510929 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-869180e8-66bf-4ed6-abdd-af6e1e13665d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1320 microversion: 2.1 time: 0.338265 Aug 04 13:56:51.512108 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 473/983] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:51 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:51.545522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-78b2a8f2-970b-4143-8e2e-0a219b25bab2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:51.546209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-78b2a8f2-970b-4143-8e2e-0a219b25bab2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:51.563989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78b2a8f2-970b-4143-8e2e-0a219b25bab2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.565026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78b2a8f2-970b-4143-8e2e-0a219b25bab2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.567720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78b2a8f2-970b-4143-8e2e-0a219b25bab2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.568702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78b2a8f2-970b-4143-8e2e-0a219b25bab2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.837417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:51.846216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:51.847815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:51.849275 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4dbb7a2a-42bd-4af4-87a1-1163578e3d22 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1567 microversion: 2.25 time: 0.470708 Aug 04 13:56:51.850439 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 511/984] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:51 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1567 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:51.855263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-25705e0a-03a7-41c2-8ba1-0ce4a50df299 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:51.856035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-25705e0a-03a7-41c2-8ba1-0ce4a50df299 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:51.862903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25705e0a-03a7-41c2-8ba1-0ce4a50df299 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.863631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25705e0a-03a7-41c2-8ba1-0ce4a50df299 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.864617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25705e0a-03a7-41c2-8ba1-0ce4a50df299 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:51.866089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25705e0a-03a7-41c2-8ba1-0ce4a50df299 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:51.963948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-78b2a8f2-970b-4143-8e2e-0a219b25bab2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:51.972937 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-78b2a8f2-970b-4143-8e2e-0a219b25bab2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.432315 Aug 04 13:56:51.985895 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 474/985] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:51 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:52.176689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0271ec97-4590-4a38-a450-d406564f74ea tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:52.177434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0271ec97-4590-4a38-a450-d406564f74ea tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:52.186461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0271ec97-4590-4a38-a450-d406564f74ea tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.187130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0271ec97-4590-4a38-a450-d406564f74ea tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:52.188297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0271ec97-4590-4a38-a450-d406564f74ea tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.189334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0271ec97-4590-4a38-a450-d406564f74ea tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:52.310228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0271ec97-4590-4a38-a450-d406564f74ea tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:52.322708 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0271ec97-4590-4a38-a450-d406564f74ea tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1279 microversion: 2.1 time: 0.150687 Aug 04 13:56:52.325977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-25705e0a-03a7-41c2-8ba1-0ce4a50df299 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:52.332363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:52.337740 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 475/986] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:52 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:52.343338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3216eaf9-5885-4ad9-b9f9-16a175da50b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:52.344030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3216eaf9-5885-4ad9-b9f9-16a175da50b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:52.345005 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-25705e0a-03a7-41c2-8ba1-0ce4a50df299 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1323 microversion: 2.1 time: 0.488283 Aug 04 13:56:52.345939 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 512/987] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:51 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:52.366357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3216eaf9-5885-4ad9-b9f9-16a175da50b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.366804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3216eaf9-5885-4ad9-b9f9-16a175da50b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:52.367610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3216eaf9-5885-4ad9-b9f9-16a175da50b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.368457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3216eaf9-5885-4ad9-b9f9-16a175da50b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:52.390407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e8e50c0-fb76-4b32-a0e0-99862e45fb92 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:52.391020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e8e50c0-fb76-4b32-a0e0-99862e45fb92 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:52.399623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e8e50c0-fb76-4b32-a0e0-99862e45fb92 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.401532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e8e50c0-fb76-4b32-a0e0-99862e45fb92 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:52.402543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e8e50c0-fb76-4b32-a0e0-99862e45fb92 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.403179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e8e50c0-fb76-4b32-a0e0-99862e45fb92 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:52.749954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3216eaf9-5885-4ad9-b9f9-16a175da50b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:52.773912 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3216eaf9-5885-4ad9-b9f9-16a175da50b5 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.431788 Aug 04 13:56:52.782678 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 476/988] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:52 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:52.790983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eadca5c6-044d-46c1-a56a-56708b11261a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:52.792190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eadca5c6-044d-46c1-a56a-56708b11261a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:52.804607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eadca5c6-044d-46c1-a56a-56708b11261a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.805369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eadca5c6-044d-46c1-a56a-56708b11261a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:52.806621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eadca5c6-044d-46c1-a56a-56708b11261a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.807447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eadca5c6-044d-46c1-a56a-56708b11261a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:52.808518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6e8e50c0-fb76-4b32-a0e0-99862e45fb92 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:52.824001 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e8e50c0-fb76-4b32-a0e0-99862e45fb92 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1318 microversion: 2.1 time: 0.436224 Aug 04 13:56:52.846093 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 513/989] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:52 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:52.879530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:52.880489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:52.889887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.890681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:52.891798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:52.893231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.212450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eadca5c6-044d-46c1-a56a-56708b11261a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:53.236489 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eadca5c6-044d-46c1-a56a-56708b11261a tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1320 microversion: 2.1 time: 0.451762 Aug 04 13:56:53.245072 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 477/990] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:52 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:53.249203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8297cf4c-81dc-423a-a13a-863121b16930 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:53.249827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8297cf4c-81dc-423a-a13a-863121b16930 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:53.270464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8297cf4c-81dc-423a-a13a-863121b16930 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.271446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8297cf4c-81dc-423a-a13a-863121b16930 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.272245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8297cf4c-81dc-423a-a13a-863121b16930 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.272749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8297cf4c-81dc-423a-a13a-863121b16930 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.316405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:53.329393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:53.331084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:53.332699 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d7dbf78-22eb-4523-bae8-7a5f071d6b4b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1542 microversion: 2.25 time: 0.460758 Aug 04 13:56:53.345575 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 514/991] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:52 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1542 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:53.345575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b351bcf9-700a-49dd-a6f0-5f18f4032fa3 req-10e527ef-6284-4137-b0c1-31a160b9debc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121", "tag": "304ba369-863e-4bbc-96b5-d52cf5aab0e3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:53.364450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b351bcf9-700a-49dd-a6f0-5f18f4032fa3 req-10e527ef-6284-4137-b0c1-31a160b9debc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.365439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b351bcf9-700a-49dd-a6f0-5f18f4032fa3 req-10e527ef-6284-4137-b0c1-31a160b9debc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.382084 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b351bcf9-700a-49dd-a6f0-5f18f4032fa3 req-10e527ef-6284-4137-b0c1-31a160b9debc service nova] Creating event network-changed:304ba369-863e-4bbc-96b5-d52cf5aab0e3 for instance f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 on n-h2-844627-10 Aug 04 13:56:53.386958 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b351bcf9-700a-49dd-a6f0-5f18f4032fa3 req-10e527ef-6284-4137-b0c1-31a160b9debc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051856 Aug 04 13:56:53.387798 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 515/992] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:53.393216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebdde136-37c7-4437-a6d2-24d84a228758 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:53.393933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ebdde136-37c7-4437-a6d2-24d84a228758 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:53.402562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebdde136-37c7-4437-a6d2-24d84a228758 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.403024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebdde136-37c7-4437-a6d2-24d84a228758 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.404230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebdde136-37c7-4437-a6d2-24d84a228758 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.404762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebdde136-37c7-4437-a6d2-24d84a228758 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.677361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8297cf4c-81dc-423a-a13a-863121b16930 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:53.688839 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8297cf4c-81dc-423a-a13a-863121b16930 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.445227 Aug 04 13:56:53.705328 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 478/993] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:53 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:53.712300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dbef076f-5f22-45d0-9a2a-03e219b83b82 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '.version_select at 0x7f4700239a60>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:53.717673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbef076f-5f22-45d0-9a2a-03e219b83b82 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.718965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbef076f-5f22-45d0-9a2a-03e219b83b82 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.733359 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dbef076f-5f22-45d0-9a2a-03e219b83b82 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 2386 microversion: 2.25 time: 0.026149 Aug 04 13:56:53.746549 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 479/994] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Aug 4 13:56:53 2022] GET /compute/v2.1/os-migrations => generated 2386 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:53.752974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d8cf1209-b2f0-4dad-9ec5-c68eecb15aa0 req-a830b824-31a8-4b76-8bb7-76693ae646ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a43735-0b27-4bc2-8943-9ba369ecf719", "tag": "2f7d8253-a5c0-44d9-ac13-a7d2d806a1eb"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:53.785076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d8cf1209-b2f0-4dad-9ec5-c68eecb15aa0 req-a830b824-31a8-4b76-8bb7-76693ae646ec service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.788787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d8cf1209-b2f0-4dad-9ec5-c68eecb15aa0 req-a830b824-31a8-4b76-8bb7-76693ae646ec service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.818311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ebdde136-37c7-4437-a6d2-24d84a228758 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:53.833171 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ebdde136-37c7-4437-a6d2-24d84a228758 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1321 microversion: 2.1 time: 0.444206 Aug 04 13:56:53.833474 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d8cf1209-b2f0-4dad-9ec5-c68eecb15aa0 req-a830b824-31a8-4b76-8bb7-76693ae646ec service nova] Creating event network-changed:2f7d8253-a5c0-44d9-ac13-a7d2d806a1eb for instance b3a43735-0b27-4bc2-8943-9ba369ecf719 on n-h1-844627-10 Aug 04 13:56:53.848838 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 516/995] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:53 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:53.852039 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d8cf1209-b2f0-4dad-9ec5-c68eecb15aa0 req-a830b824-31a8-4b76-8bb7-76693ae646ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099117 Aug 04 13:56:53.854492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc210fbe-8eed-411b-ade8-81c90aa1195c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:53.855198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bc210fbe-8eed-411b-ade8-81c90aa1195c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:53.856211 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 480/996] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:53.859551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:53.871275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e945cc1-6ebb-44d9-be9a-d56f5d063b96 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:53.873472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc210fbe-8eed-411b-ade8-81c90aa1195c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.874149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc210fbe-8eed-411b-ade8-81c90aa1195c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.875169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc210fbe-8eed-411b-ade8-81c90aa1195c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.875842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc210fbe-8eed-411b-ade8-81c90aa1195c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.877845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e945cc1-6ebb-44d9-be9a-d56f5d063b96 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:53.894253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e945cc1-6ebb-44d9-be9a-d56f5d063b96 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.895410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e945cc1-6ebb-44d9-be9a-d56f5d063b96 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:53.897237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e945cc1-6ebb-44d9-be9a-d56f5d063b96 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:53.897946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e945cc1-6ebb-44d9-be9a-d56f5d063b96 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:54.339597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bc210fbe-8eed-411b-ade8-81c90aa1195c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:54.348904 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bc210fbe-8eed-411b-ade8-81c90aa1195c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1323 microversion: 2.1 time: 0.498856 Aug 04 13:56:54.365186 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 517/997] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:53 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1323 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:54.374679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-8e945cc1-6ebb-44d9-be9a-d56f5d063b96 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid e9c10284-3c28-4847-b418-8aa77c90a92a {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:56:54.379430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-67e63016-e9d1-4524-b8b3-48568f2f6302 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:54.379430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-67e63016-e9d1-4524-b8b3-48568f2f6302 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:54.394221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67e63016-e9d1-4524-b8b3-48568f2f6302 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:54.394984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67e63016-e9d1-4524-b8b3-48568f2f6302 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:54.395867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67e63016-e9d1-4524-b8b3-48568f2f6302 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:54.396402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67e63016-e9d1-4524-b8b3-48568f2f6302 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:54.403730 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e945cc1-6ebb-44d9-be9a-d56f5d063b96 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 2037 microversion: 2.25 time: 0.546042 Aug 04 13:56:54.404492 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 481/998] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:53 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 2037 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:54.413150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c96fac00-a985-4dde-853f-8a5ae36d7145 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:54.413150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c96fac00-a985-4dde-853f-8a5ae36d7145 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:54.415880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c96fac00-a985-4dde-853f-8a5ae36d7145 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:54.416364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c96fac00-a985-4dde-853f-8a5ae36d7145 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:54.417160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c96fac00-a985-4dde-853f-8a5ae36d7145 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:54.417581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c96fac00-a985-4dde-853f-8a5ae36d7145 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:54.705839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-67e63016-e9d1-4524-b8b3-48568f2f6302 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:54.712468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c96fac00-a985-4dde-853f-8a5ae36d7145 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:54.714223 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-67e63016-e9d1-4524-b8b3-48568f2f6302 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.346785 Aug 04 13:56:54.714799 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 518/999] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:54 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:54.722337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-526cc5df-3a63-410a-9179-a9d0639eb99d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:54.723188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-526cc5df-3a63-410a-9179-a9d0639eb99d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:54.725621 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c96fac00-a985-4dde-853f-8a5ae36d7145 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1318 microversion: 2.1 time: 0.320058 Aug 04 13:56:54.726300 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 482/1000] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:54 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:54.731666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-dc1939a5-1b98-4bad-b026-c713c4d3b139 req-a25cd095-7864-4bce-9ae9-3ae6b3091388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4979b7c-1bc6-4922-9345-99e402757bbd", "name": "network-vif-plugged", "status": "completed", "tag": "39459960-3571-47a9-bd3d-aa345456dc55"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:54.734555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-526cc5df-3a63-410a-9179-a9d0639eb99d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:54.735688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-526cc5df-3a63-410a-9179-a9d0639eb99d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:54.736853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-526cc5df-3a63-410a-9179-a9d0639eb99d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:54.738063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-526cc5df-3a63-410a-9179-a9d0639eb99d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:54.741581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-dc1939a5-1b98-4bad-b026-c713c4d3b139 req-a25cd095-7864-4bce-9ae9-3ae6b3091388 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:54.742269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-dc1939a5-1b98-4bad-b026-c713c4d3b139 req-a25cd095-7864-4bce-9ae9-3ae6b3091388 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:54.754761 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-dc1939a5-1b98-4bad-b026-c713c4d3b139 req-a25cd095-7864-4bce-9ae9-3ae6b3091388 service nova] Creating event network-vif-plugged:39459960-3571-47a9-bd3d-aa345456dc55 for instance e4979b7c-1bc6-4922-9345-99e402757bbd on n-h1-844627-10 Aug 04 13:56:54.760748 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-dc1939a5-1b98-4bad-b026-c713c4d3b139 req-a25cd095-7864-4bce-9ae9-3ae6b3091388 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032996 Aug 04 13:56:54.761566 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 483/1001] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:54.767118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0ea8eba5-ca01-4967-8ef1-84d27dd0b2cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Action: 'create', calling method: .version_select at 0x7f47002f13a0>, body: {"keypair": {"name": "tempest-keypair-715557252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmDetFbbHzffXN6aUWbta7NQllwjg20hd+PfqJQbdqIqBg4KE5007OL4zNNtse76d63zUpQSd3V4FfZDs24rDBul2CD7jLs/HxJOxQYfpSFPTPnGpA7b3sGJHdTm/4mHw=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:54.784572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-0ea8eba5-ca01-4967-8ef1-84d27dd0b2cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:54.789725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-0ea8eba5-ca01-4967-8ef1-84d27dd0b2cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for user d9613691b93147d48d9f1a51bf5767c9 and project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:54.816540 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0ea8eba5-ca01-4967-8ef1-84d27dd0b2cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.053170 Aug 04 13:56:54.817163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 484/1002] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 13:56:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 13:56:54.822208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77e97e52-5c28-4aed-b82a-c6f27287bea3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:54.823082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-77e97e52-5c28-4aed-b82a-c6f27287bea3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:54.829985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77e97e52-5c28-4aed-b82a-c6f27287bea3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:54.830421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77e97e52-5c28-4aed-b82a-c6f27287bea3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:54.831200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77e97e52-5c28-4aed-b82a-c6f27287bea3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:54.831633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77e97e52-5c28-4aed-b82a-c6f27287bea3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:55.018325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-526cc5df-3a63-410a-9179-a9d0639eb99d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:55.029462 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-526cc5df-3a63-410a-9179-a9d0639eb99d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1320 microversion: 2.1 time: 0.313526 Aug 04 13:56:55.045203 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 519/1003] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:54 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:55.050847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf1a7b0d-98fe-4754-ba75-cd2dc72c5857 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:55.051831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf1a7b0d-98fe-4754-ba75-cd2dc72c5857 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:55.059279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1a7b0d-98fe-4754-ba75-cd2dc72c5857 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:55.060022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1a7b0d-98fe-4754-ba75-cd2dc72c5857 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:55.061128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1a7b0d-98fe-4754-ba75-cd2dc72c5857 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:55.061833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1a7b0d-98fe-4754-ba75-cd2dc72c5857 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:55.099812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-77e97e52-5c28-4aed-b82a-c6f27287bea3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:55.112206 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-77e97e52-5c28-4aed-b82a-c6f27287bea3 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.293791 Aug 04 13:56:55.113181 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 485/1004] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:54 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:55.322802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cf1a7b0d-98fe-4754-ba75-cd2dc72c5857 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:55.331783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf1a7b0d-98fe-4754-ba75-cd2dc72c5857 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1321 microversion: 2.1 time: 0.285117 Aug 04 13:56:55.345442 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 520/1005] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:55 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:55.373328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23dffe81-2633-4cb7-84e3-c7f1a858eda2 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:55.374073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-23dffe81-2633-4cb7-84e3-c7f1a858eda2 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:55.381564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23dffe81-2633-4cb7-84e3-c7f1a858eda2 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:55.381934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23dffe81-2633-4cb7-84e3-c7f1a858eda2 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:55.382798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23dffe81-2633-4cb7-84e3-c7f1a858eda2 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:55.383247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23dffe81-2633-4cb7-84e3-c7f1a858eda2 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:55.736520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1762af44-72de-49d4-8207-dbf59dbcbc12 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:55.737824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1762af44-72de-49d4-8207-dbf59dbcbc12 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:55.746896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1762af44-72de-49d4-8207-dbf59dbcbc12 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:55.751773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1762af44-72de-49d4-8207-dbf59dbcbc12 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:55.755920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1762af44-72de-49d4-8207-dbf59dbcbc12 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:55.757629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1762af44-72de-49d4-8207-dbf59dbcbc12 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.015636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-23dffe81-2633-4cb7-84e3-c7f1a858eda2 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:56.023919 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-23dffe81-2633-4cb7-84e3-c7f1a858eda2 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1323 microversion: 2.1 time: 0.655819 Aug 04 13:56:56.024629 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 486/1006] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:55 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1323 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:56.030125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62f1ead6-6fa7-468d-a192-cfda64ec38d1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:56.031195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-62f1ead6-6fa7-468d-a192-cfda64ec38d1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:56.045652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62f1ead6-6fa7-468d-a192-cfda64ec38d1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:56.046528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62f1ead6-6fa7-468d-a192-cfda64ec38d1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.048137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62f1ead6-6fa7-468d-a192-cfda64ec38d1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:56.048766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62f1ead6-6fa7-468d-a192-cfda64ec38d1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.066815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1762af44-72de-49d4-8207-dbf59dbcbc12 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:56.079714 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1762af44-72de-49d4-8207-dbf59dbcbc12 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.347417 Aug 04 13:56:56.081821 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 521/1007] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:55 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:56.087207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-804956af-56a7-4702-be31-9a962429ee5d req-79c35007-bf83-4a03-9ae5-62cf98e0bdd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92c1d62-28c6-48f7-8048-1795d50d224a", "tag": "237fa1bf-4032-460b-abe3-07c35b7aa664"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:56.099490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-804956af-56a7-4702-be31-9a962429ee5d req-79c35007-bf83-4a03-9ae5-62cf98e0bdd0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:56.100304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-804956af-56a7-4702-be31-9a962429ee5d req-79c35007-bf83-4a03-9ae5-62cf98e0bdd0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.118565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-804956af-56a7-4702-be31-9a962429ee5d req-79c35007-bf83-4a03-9ae5-62cf98e0bdd0 service nova] Creating event network-changed:237fa1bf-4032-460b-abe3-07c35b7aa664 for instance a92c1d62-28c6-48f7-8048-1795d50d224a on n-h2-844627-10 Aug 04 13:56:56.123465 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-804956af-56a7-4702-be31-9a962429ee5d req-79c35007-bf83-4a03-9ae5-62cf98e0bdd0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040159 Aug 04 13:56:56.123995 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 522/1008] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:56.130022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-14f59819-1df7-4304-9830-84ab24ca72ab tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:56.130583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-14f59819-1df7-4304-9830-84ab24ca72ab tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:56.136937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14f59819-1df7-4304-9830-84ab24ca72ab tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:56.137395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14f59819-1df7-4304-9830-84ab24ca72ab tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.138173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14f59819-1df7-4304-9830-84ab24ca72ab tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:56.138611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14f59819-1df7-4304-9830-84ab24ca72ab tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.326434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-62f1ead6-6fa7-468d-a192-cfda64ec38d1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:56.335300 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62f1ead6-6fa7-468d-a192-cfda64ec38d1 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1318 microversion: 2.1 time: 0.309259 Aug 04 13:56:56.349441 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 487/1009] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:56 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:56.356957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ef8fd6dc-4c68-4ef8-a91e-45c4901a58e5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:56.357581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ef8fd6dc-4c68-4ef8-a91e-45c4901a58e5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:56.364638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef8fd6dc-4c68-4ef8-a91e-45c4901a58e5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:56.365127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef8fd6dc-4c68-4ef8-a91e-45c4901a58e5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.365961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef8fd6dc-4c68-4ef8-a91e-45c4901a58e5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:56.366399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef8fd6dc-4c68-4ef8-a91e-45c4901a58e5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.366845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-14f59819-1df7-4304-9830-84ab24ca72ab tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:56.378900 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-14f59819-1df7-4304-9830-84ab24ca72ab tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1320 microversion: 2.1 time: 0.253225 Aug 04 13:56:56.384953 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 523/1010] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:56 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1320 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:56.388697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f94909b8-0deb-43d6-b060-d4644f22bf83 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:56.390086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f94909b8-0deb-43d6-b060-d4644f22bf83 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:56.398759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f94909b8-0deb-43d6-b060-d4644f22bf83 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:56.399603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f94909b8-0deb-43d6-b060-d4644f22bf83 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.401259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f94909b8-0deb-43d6-b060-d4644f22bf83 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:56.401728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f94909b8-0deb-43d6-b060-d4644f22bf83 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:56.586164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ef8fd6dc-4c68-4ef8-a91e-45c4901a58e5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:56.591429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f94909b8-0deb-43d6-b060-d4644f22bf83 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:56.595279 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ef8fd6dc-4c68-4ef8-a91e-45c4901a58e5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.242748 Aug 04 13:56:56.596187 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 488/1011] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:56 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:56.618652 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f94909b8-0deb-43d6-b060-d4644f22bf83 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1321 microversion: 2.1 time: 0.236941 Aug 04 13:56:56.619303 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 524/1012] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:56 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:56.718126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1237349405", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "16aa4d93-210e-4f85-a9b8-18b7b6afc7af"}], "security_groups": [{"name": "tempest-securitygroup--401815287"}], "key_name": "tempest-keypair-715557252", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:56.821607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] validate_networks() for [('16aa4d93-210e-4f85-a9b8-18b7b6afc7af', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:56:57.047616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca989050-0754-48f3-80c1-66b69b21db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:57.048238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ca989050-0754-48f3-80c1-66b69b21db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:57.055286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca989050-0754-48f3-80c1-66b69b21db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.055740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca989050-0754-48f3-80c1-66b69b21db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.056508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca989050-0754-48f3-80c1-66b69b21db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.057496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca989050-0754-48f3-80c1-66b69b21db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.311452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ca989050-0754-48f3-80c1-66b69b21db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:57.322234 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca989050-0754-48f3-80c1-66b69b21db99 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1323 microversion: 2.1 time: 0.278228 Aug 04 13:56:57.323237 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 525/1013] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:57 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:57.324472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:56:57.325311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:56:57.325794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:56:57.326210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:56:57.326623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:56:57.329543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f7c510b4-7ab2-427e-913e-60d0d2f5b33e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:57.330410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f7c510b4-7ab2-427e-913e-60d0d2f5b33e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:57.338604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7c510b4-7ab2-427e-913e-60d0d2f5b33e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.339196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7c510b4-7ab2-427e-913e-60d0d2f5b33e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.340113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7c510b4-7ab2-427e-913e-60d0d2f5b33e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.340669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7c510b4-7ab2-427e-913e-60d0d2f5b33e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.346385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.346840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.349607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.350072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.372834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:56:57.378639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for user d9613691b93147d48d9f1a51bf5767c9 and project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:56:57.391604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:56:57.394086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:56:57.406175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:57.441918 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-305a9888-25ef-46e1-a842-4304a7c5f6e0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.727628 Aug 04 13:56:57.442481 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 489/1014] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 13:56:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 13:56:57.447028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f622c27c-8f18-44c0-9801-e9275f2ae0ec tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:57.447677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f622c27c-8f18-44c0-9801-e9275f2ae0ec tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:57.454198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f622c27c-8f18-44c0-9801-e9275f2ae0ec tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.454711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f622c27c-8f18-44c0-9801-e9275f2ae0ec tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.455492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f622c27c-8f18-44c0-9801-e9275f2ae0ec tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.456424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f622c27c-8f18-44c0-9801-e9275f2ae0ec tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.689427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f7c510b4-7ab2-427e-913e-60d0d2f5b33e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:57.703455 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f7c510b4-7ab2-427e-913e-60d0d2f5b33e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.378835 Aug 04 13:56:57.723835 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 526/1015] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:57 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:57.736272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e9931b3d-42af-4fc8-85fc-77f4142dabbe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:57.737200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e9931b3d-42af-4fc8-85fc-77f4142dabbe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:57.746381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9931b3d-42af-4fc8-85fc-77f4142dabbe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.746829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9931b3d-42af-4fc8-85fc-77f4142dabbe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.747665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9931b3d-42af-4fc8-85fc-77f4142dabbe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:57.748097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9931b3d-42af-4fc8-85fc-77f4142dabbe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:57.901559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f622c27c-8f18-44c0-9801-e9275f2ae0ec tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:57.909930 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f622c27c-8f18-44c0-9801-e9275f2ae0ec tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1318 microversion: 2.1 time: 0.466395 Aug 04 13:56:57.910820 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 490/1016] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:57 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:57.917139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-447907f3-7d4a-4058-945f-6b749e869c96 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:57.918143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-447907f3-7d4a-4058-945f-6b749e869c96 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:58.023695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-447907f3-7d4a-4058-945f-6b749e869c96 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:58.033876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-447907f3-7d4a-4058-945f-6b749e869c96 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:58.035629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-447907f3-7d4a-4058-945f-6b749e869c96 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:58.037252 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-447907f3-7d4a-4058-945f-6b749e869c96 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1285 microversion: 2.25 time: 0.124814 Aug 04 13:56:58.045526 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 491/1017] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:57 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:58.047284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dfcb2bb8-bf39-4f18-8544-3e6233edb8f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:58.048447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dfcb2bb8-bf39-4f18-8544-3e6233edb8f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:58.059682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e9931b3d-42af-4fc8-85fc-77f4142dabbe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:58.060404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfcb2bb8-bf39-4f18-8544-3e6233edb8f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.061127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfcb2bb8-bf39-4f18-8544-3e6233edb8f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.062328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfcb2bb8-bf39-4f18-8544-3e6233edb8f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.063170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfcb2bb8-bf39-4f18-8544-3e6233edb8f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.069982 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e9931b3d-42af-4fc8-85fc-77f4142dabbe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1320 microversion: 2.1 time: 0.345713 Aug 04 13:56:58.071506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:58.086000 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 527/1018] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:57 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:58.091406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-156feb9d-ba98-4ef9-8303-dc71fb5d5203 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:58.092927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-156feb9d-ba98-4ef9-8303-dc71fb5d5203 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:58.101206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156feb9d-ba98-4ef9-8303-dc71fb5d5203 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.101746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156feb9d-ba98-4ef9-8303-dc71fb5d5203 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.102638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156feb9d-ba98-4ef9-8303-dc71fb5d5203 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.103144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156feb9d-ba98-4ef9-8303-dc71fb5d5203 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.372340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dfcb2bb8-bf39-4f18-8544-3e6233edb8f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:58.380143 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dfcb2bb8-bf39-4f18-8544-3e6233edb8f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.339918 Aug 04 13:56:58.392280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-156feb9d-ba98-4ef9-8303-dc71fb5d5203 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:58.393549 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 492/1019] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:58 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:58.399832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f6f8e2bd-cefc-4ae6-850b-5b3826ce77bb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:58.400994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f6f8e2bd-cefc-4ae6-850b-5b3826ce77bb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:58.404839 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-156feb9d-ba98-4ef9-8303-dc71fb5d5203 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1321 microversion: 2.1 time: 0.316731 Aug 04 13:56:58.406635 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 528/1020] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:58 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:58.408380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6f8e2bd-cefc-4ae6-850b-5b3826ce77bb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.409183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6f8e2bd-cefc-4ae6-850b-5b3826ce77bb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.410136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6f8e2bd-cefc-4ae6-850b-5b3826ce77bb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.410721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6f8e2bd-cefc-4ae6-850b-5b3826ce77bb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.593901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f6f8e2bd-cefc-4ae6-850b-5b3826ce77bb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:58.602085 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f6f8e2bd-cefc-4ae6-850b-5b3826ce77bb tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1323 microversion: 2.1 time: 0.207438 Aug 04 13:56:58.602659 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 493/1021] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:58 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1323 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:58.726046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd895c05-345a-4cd6-bf69-4c9cb4d160ce tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:58.726705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bd895c05-345a-4cd6-bf69-4c9cb4d160ce tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:58.733603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd895c05-345a-4cd6-bf69-4c9cb4d160ce tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.734045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd895c05-345a-4cd6-bf69-4c9cb4d160ce tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.734795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd895c05-345a-4cd6-bf69-4c9cb4d160ce tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.735226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd895c05-345a-4cd6-bf69-4c9cb4d160ce tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.931587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7f43b1aa-9027-4075-ba53-c0163a6e7735 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:58.932852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7f43b1aa-9027-4075-ba53-c0163a6e7735 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:58.938872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f43b1aa-9027-4075-ba53-c0163a6e7735 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.939320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f43b1aa-9027-4075-ba53-c0163a6e7735 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.940113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f43b1aa-9027-4075-ba53-c0163a6e7735 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:58.940532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f43b1aa-9027-4075-ba53-c0163a6e7735 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:58.945883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bd895c05-345a-4cd6-bf69-4c9cb4d160ce tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:58.953705 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd895c05-345a-4cd6-bf69-4c9cb4d160ce tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.231435 Aug 04 13:56:58.954379 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 529/1022] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:58 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:59.061834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:59.062509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:59.064835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:59.070327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.070792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.071586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.071706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7f43b1aa-9027-4075-ba53-c0163a6e7735 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:59.072024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.079331 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7f43b1aa-9027-4075-ba53-c0163a6e7735 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1318 microversion: 2.1 time: 0.151645 Aug 04 13:56:59.079915 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 494/1023] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:58 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:59.097194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-986e2335-a3bf-487e-99dd-d2b2f440fa85 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:59.098135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-986e2335-a3bf-487e-99dd-d2b2f440fa85 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:59.106534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-986e2335-a3bf-487e-99dd-d2b2f440fa85 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.107316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-986e2335-a3bf-487e-99dd-d2b2f440fa85 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.108397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-986e2335-a3bf-487e-99dd-d2b2f440fa85 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.109081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-986e2335-a3bf-487e-99dd-d2b2f440fa85 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.225765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:59.230387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:59.236569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:59.239465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:59.240648 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf1b606f-497d-49bb-aac5-ad83c562ab0b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1337 microversion: 2.25 time: 0.183486 Aug 04 13:56:59.241288 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 530/1024] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:56:59 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1337 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:56:59.323895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-986e2335-a3bf-487e-99dd-d2b2f440fa85 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:59.332075 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-986e2335-a3bf-487e-99dd-d2b2f440fa85 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1320 microversion: 2.1 time: 0.244408 Aug 04 13:56:59.332660 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 495/1025] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:59 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1320 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:56:59.404237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4951bcbe-445e-4315-90d3-60fd65adc984 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:59.404838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4951bcbe-445e-4315-90d3-60fd65adc984 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:59.411149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4951bcbe-445e-4315-90d3-60fd65adc984 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.411596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4951bcbe-445e-4315-90d3-60fd65adc984 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.412355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4951bcbe-445e-4315-90d3-60fd65adc984 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.412784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4951bcbe-445e-4315-90d3-60fd65adc984 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.434447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cbc0f330-893d-446b-9c38-af81fb25aa27 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:59.435061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cbc0f330-893d-446b-9c38-af81fb25aa27 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:59.441599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc0f330-893d-446b-9c38-af81fb25aa27 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.442051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc0f330-893d-446b-9c38-af81fb25aa27 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.442823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc0f330-893d-446b-9c38-af81fb25aa27 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.443262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc0f330-893d-446b-9c38-af81fb25aa27 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.614782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4951bcbe-445e-4315-90d3-60fd65adc984 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:59.629955 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4951bcbe-445e-4315-90d3-60fd65adc984 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.229202 Aug 04 13:56:59.639966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cbc0f330-893d-446b-9c38-af81fb25aa27 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:59.646361 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 531/1026] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:59 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:59.652406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e76db2fe-3829-4e59-8284-d32ff686125c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:59.653095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e76db2fe-3829-4e59-8284-d32ff686125c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:59.660713 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cbc0f330-893d-446b-9c38-af81fb25aa27 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1321 microversion: 2.1 time: 0.230689 Aug 04 13:56:59.662781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e76db2fe-3829-4e59-8284-d32ff686125c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.663240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e76db2fe-3829-4e59-8284-d32ff686125c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.664025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e76db2fe-3829-4e59-8284-d32ff686125c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.665097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e76db2fe-3829-4e59-8284-d32ff686125c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.677439 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 496/1027] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:59 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:59.783771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=16 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:56:59.913637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-655a9e6b-a38c-4b6f-a83c-e5940ae2b8b0 req-a2750884-6068-4cc9-803d-9cb1f4cb2d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121", "name": "network-vif-plugged", "status": "completed", "tag": "304ba369-863e-4bbc-96b5-d52cf5aab0e3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:59.931057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-655a9e6b-a38c-4b6f-a83c-e5940ae2b8b0 req-a2750884-6068-4cc9-803d-9cb1f4cb2d9e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.932361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-655a9e6b-a38c-4b6f-a83c-e5940ae2b8b0 req-a2750884-6068-4cc9-803d-9cb1f4cb2d9e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.952032 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-655a9e6b-a38c-4b6f-a83c-e5940ae2b8b0 req-a2750884-6068-4cc9-803d-9cb1f4cb2d9e service nova] Creating event network-vif-plugged:304ba369-863e-4bbc-96b5-d52cf5aab0e3 for instance f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 on n-h2-844627-10 Aug 04 13:56:59.955131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e76db2fe-3829-4e59-8284-d32ff686125c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:56:59.957406 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-655a9e6b-a38c-4b6f-a83c-e5940ae2b8b0 req-a2750884-6068-4cc9-803d-9cb1f4cb2d9e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052973 Aug 04 13:56:59.958225 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 497/1028] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:56:59.964126 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e76db2fe-3829-4e59-8284-d32ff686125c tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 200 len: 1520 microversion: 2.1 time: 0.316605 Aug 04 13:56:59.964811 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 532/1029] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:59 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:56:59.985180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d1e71f07-1b0a-42ce-ba2b-b9eb714ffd19 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:56:59.986903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d1e71f07-1b0a-42ce-ba2b-b9eb714ffd19 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:59.989922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Action: 'action', calling method: .version_select at 0x7f470302eca0>, body: {"addFloatingIp": {"address": "172.25.2.22"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:56:59.995433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1e71f07-1b0a-42ce-ba2b-b9eb714ffd19 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.996228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1e71f07-1b0a-42ce-ba2b-b9eb714ffd19 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:56:59.997242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:56:59.997760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1e71f07-1b0a-42ce-ba2b-b9eb714ffd19 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:56:59.998424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1e71f07-1b0a-42ce-ba2b-b9eb714ffd19 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:00.010767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:00.011689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:00.012662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:00.013827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:00.084492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Acquired lock "refresh_cache-33a80a01-edba-4355-8d27-8fac463e118a" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:57:00.455627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d1e71f07-1b0a-42ce-ba2b-b9eb714ffd19 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:00.467298 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d1e71f07-1b0a-42ce-ba2b-b9eb714ffd19 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.488592 Aug 04 13:57:00.468389 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 498/1030] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:56:59 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:00.487636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b4b12ad-4323-4907-bccc-129fef2e0628 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:00.488550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b4b12ad-4323-4907-bccc-129fef2e0628 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:00.497661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b4b12ad-4323-4907-bccc-129fef2e0628 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:00.498248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b4b12ad-4323-4907-bccc-129fef2e0628 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:00.499291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b4b12ad-4323-4907-bccc-129fef2e0628 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:00.499697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b4b12ad-4323-4907-bccc-129fef2e0628 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:01.098188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b4b12ad-4323-4907-bccc-129fef2e0628 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:01.106268 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b4b12ad-4323-4907-bccc-129fef2e0628 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1318 microversion: 2.1 time: 0.622844 Aug 04 13:57:01.106930 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 499/1031] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:00 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:01.111409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:01.112007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:01.117963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:01.118408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:01.119164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:01.119596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:01.224476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:01.232847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:01.234513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:01.235721 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9801598d-00b8-46ba-9455-f86a237dbae0 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1343 microversion: 2.25 time: 0.127814 Aug 04 13:57:01.236310 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 500/1032] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:01 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1343 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:01.241611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae4d2f14-b6c2-483c-a508-b13b8d2387fe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:01.242274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ae4d2f14-b6c2-483c-a508-b13b8d2387fe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:01.248317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f14-b6c2-483c-a508-b13b8d2387fe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:01.249537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f14-b6c2-483c-a508-b13b8d2387fe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:01.249836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f14-b6c2-483c-a508-b13b8d2387fe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:01.250531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae4d2f14-b6c2-483c-a508-b13b8d2387fe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:01.608302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ae4d2f14-b6c2-483c-a508-b13b8d2387fe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:01.618135 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae4d2f14-b6c2-483c-a508-b13b8d2387fe tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1320 microversion: 2.1 time: 0.379517 Aug 04 13:57:01.632768 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 501/1033] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:01 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1320 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:01.632768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-403209d0-14a1-45bd-8b09-f473bfd7a0a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:01.632768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-403209d0-14a1-45bd-8b09-f473bfd7a0a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:01.632768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-403209d0-14a1-45bd-8b09-f473bfd7a0a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:01.633281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-403209d0-14a1-45bd-8b09-f473bfd7a0a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:01.634581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-403209d0-14a1-45bd-8b09-f473bfd7a0a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:01.634581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-403209d0-14a1-45bd-8b09-f473bfd7a0a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:01.999054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-403209d0-14a1-45bd-8b09-f473bfd7a0a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:02.007057 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-403209d0-14a1-45bd-8b09-f473bfd7a0a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.385790 Aug 04 13:57:02.007884 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 502/1034] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:01 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:02.013929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b286330-72af-4cd0-be19-6cfb42c71728 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:02.014543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b286330-72af-4cd0-be19-6cfb42c71728 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:02.026862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b286330-72af-4cd0-be19-6cfb42c71728 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:02.027304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b286330-72af-4cd0-be19-6cfb42c71728 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:02.028086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b286330-72af-4cd0-be19-6cfb42c71728 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:02.028526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b286330-72af-4cd0-be19-6cfb42c71728 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:02.310180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b286330-72af-4cd0-be19-6cfb42c71728 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:02.319508 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b286330-72af-4cd0-be19-6cfb42c71728 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1321 microversion: 2.1 time: 0.310138 Aug 04 13:57:02.320272 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 503/1035] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:02 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:02.330371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-077114b1-6b4f-4157-90c8-03684b56039c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:02.331748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-077114b1-6b4f-4157-90c8-03684b56039c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:02.344324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-077114b1-6b4f-4157-90c8-03684b56039c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:02.345501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-077114b1-6b4f-4157-90c8-03684b56039c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:02.347099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-077114b1-6b4f-4157-90c8-03684b56039c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:02.347907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-077114b1-6b4f-4157-90c8-03684b56039c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:02.569296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Building network info cache for instance {{(pid=130961) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 13:57:02.573675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-077114b1-6b4f-4157-90c8-03684b56039c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:02.589932 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-077114b1-6b4f-4157-90c8-03684b56039c tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1472 microversion: 2.1 time: 0.268069 Aug 04 13:57:02.591025 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 504/1036] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:02 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:02.596298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e23cb1c2-3f98-4712-82d1-044042321e47 req-d1a6369d-9466-40d1-884c-eb7cb3df3bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a43735-0b27-4bc2-8943-9ba369ecf719", "name": "network-vif-plugged", "status": "completed", "tag": "2f7d8253-a5c0-44d9-ac13-a7d2d806a1eb"}, {"server_uuid": "a92c1d62-28c6-48f7-8048-1795d50d224a", "name": "network-vif-plugged", "status": "completed", "tag": "237fa1bf-4032-460b-abe3-07c35b7aa664"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:02.608453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e23cb1c2-3f98-4712-82d1-044042321e47 req-d1a6369d-9466-40d1-884c-eb7cb3df3bd6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:02.609182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e23cb1c2-3f98-4712-82d1-044042321e47 req-d1a6369d-9466-40d1-884c-eb7cb3df3bd6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:02.623595 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e23cb1c2-3f98-4712-82d1-044042321e47 req-d1a6369d-9466-40d1-884c-eb7cb3df3bd6 service nova] Creating event network-vif-plugged:2f7d8253-a5c0-44d9-ac13-a7d2d806a1eb for instance b3a43735-0b27-4bc2-8943-9ba369ecf719 on n-h1-844627-10 Aug 04 13:57:02.624236 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e23cb1c2-3f98-4712-82d1-044042321e47 req-d1a6369d-9466-40d1-884c-eb7cb3df3bd6 service nova] Creating event network-vif-plugged:237fa1bf-4032-460b-abe3-07c35b7aa664 for instance a92c1d62-28c6-48f7-8048-1795d50d224a on n-h2-844627-10 Aug 04 13:57:02.643069 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e23cb1c2-3f98-4712-82d1-044042321e47 req-d1a6369d-9466-40d1-884c-eb7cb3df3bd6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050974 Aug 04 13:57:02.644025 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 505/1037] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:02.654960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-087d2940-701c-488d-95cf-6046d72395b9 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:02.656437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-087d2940-701c-488d-95cf-6046d72395b9 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:02.667491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-087d2940-701c-488d-95cf-6046d72395b9 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:02.667941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-087d2940-701c-488d-95cf-6046d72395b9 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:02.668748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-087d2940-701c-488d-95cf-6046d72395b9 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:02.669271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-087d2940-701c-488d-95cf-6046d72395b9 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:02.986027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-087d2940-701c-488d-95cf-6046d72395b9 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:02.996616 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-087d2940-701c-488d-95cf-6046d72395b9 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1509 microversion: 2.1 time: 0.348908 Aug 04 13:57:02.997800 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 506/1038] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:02 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:03.002662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:03.003693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:03.013736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:03.014957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:03.016031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:03.018233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:03.405224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:03.414282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:03.415796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:03.417516 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4cbb1c0-baf7-4c4a-98c6-56d61bc8d22e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.418666 Aug 04 13:57:03.418087 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 507/1039] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:02 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:03.437088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-de3adaf9-a188-4f5b-b3e1-201814d44392 req-5a13cd37-941c-49d5-a4f5-41b9735bfdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a80a01-edba-4355-8d27-8fac463e118a", "tag": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:03.465576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-de3adaf9-a188-4f5b-b3e1-201814d44392 req-5a13cd37-941c-49d5-a4f5-41b9735bfdd9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:03.467406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-de3adaf9-a188-4f5b-b3e1-201814d44392 req-5a13cd37-941c-49d5-a4f5-41b9735bfdd9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:03.480952 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-de3adaf9-a188-4f5b-b3e1-201814d44392 req-5a13cd37-941c-49d5-a4f5-41b9735bfdd9 service nova] Creating event network-changed:83bf7c82-4313-4b52-9ea6-3efdcbf48b07 for instance 33a80a01-edba-4355-8d27-8fac463e118a on n-h2-844627-10 Aug 04 13:57:03.486172 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-de3adaf9-a188-4f5b-b3e1-201814d44392 req-5a13cd37-941c-49d5-a4f5-41b9735bfdd9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066955 Aug 04 13:57:03.487474 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 508/1040] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:03.492840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-180c96d0-22da-4c41-a3b2-12ef4746fdcf tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:03.493741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-180c96d0-22da-4c41-a3b2-12ef4746fdcf tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:03.501223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-180c96d0-22da-4c41-a3b2-12ef4746fdcf tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:03.501510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-180c96d0-22da-4c41-a3b2-12ef4746fdcf tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:03.502407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-180c96d0-22da-4c41-a3b2-12ef4746fdcf tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:03.503407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-180c96d0-22da-4c41-a3b2-12ef4746fdcf tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:03.881078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-180c96d0-22da-4c41-a3b2-12ef4746fdcf tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:03.893688 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-180c96d0-22da-4c41-a3b2-12ef4746fdcf tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1320 microversion: 2.1 time: 0.404928 Aug 04 13:57:03.894973 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 509/1041] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:03 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:03.901868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f2acc538-90d0-4d45-abaf-a06b97dc944d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:03.902912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2acc538-90d0-4d45-abaf-a06b97dc944d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:03.918535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2acc538-90d0-4d45-abaf-a06b97dc944d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:03.919907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2acc538-90d0-4d45-abaf-a06b97dc944d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:03.921608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2acc538-90d0-4d45-abaf-a06b97dc944d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:03.922247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2acc538-90d0-4d45-abaf-a06b97dc944d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:03.961242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Updating instance_info_cache with network_info: [{"id": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07", "address": "fa:16:3e:03:06:8a", "network": {"id": "bd0c2de1-a833-4902-b343-80481e8458ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1801279138-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9e5afd8e587c41d8bc0f86c89a38fce2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap83bf7c82-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130961) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 13:57:03.982299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Releasing lock "refresh_cache-33a80a01-edba-4355-8d27-8fac463e118a" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:57:03.983462 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c30dafb-24cb-46b3-8456-affcdf21ba33 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "POST /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a/action" status: 202 len: 0 microversion: 2.1 time: 3.997557 Aug 04 13:57:03.984067 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 533/1042] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:56:59 2022] POST /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a/action => generated 0 bytes in 4004 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 13:57:03.989616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fff62f94-b109-406d-bc11-537dad0185bb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:03.990479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fff62f94-b109-406d-bc11-537dad0185bb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:03.998052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fff62f94-b109-406d-bc11-537dad0185bb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:03.998508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fff62f94-b109-406d-bc11-537dad0185bb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:03.999473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fff62f94-b109-406d-bc11-537dad0185bb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:04.000075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fff62f94-b109-406d-bc11-537dad0185bb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:04.691867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f2acc538-90d0-4d45-abaf-a06b97dc944d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:04.695406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:04.701227 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f2acc538-90d0-4d45-abaf-a06b97dc944d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.805158 Aug 04 13:57:04.701870 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 510/1043] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:03 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:04.702865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fff62f94-b109-406d-bc11-537dad0185bb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:04.707221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba534ab4-e4b5-4a4f-a5fb-4b652e2cd399 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:04.707221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba534ab4-e4b5-4a4f-a5fb-4b652e2cd399 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:04.713013 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fff62f94-b109-406d-bc11-537dad0185bb tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1321 microversion: 2.1 time: 0.727303 Aug 04 13:57:04.713713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba534ab4-e4b5-4a4f-a5fb-4b652e2cd399 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:04.714252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba534ab4-e4b5-4a4f-a5fb-4b652e2cd399 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:04.715300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba534ab4-e4b5-4a4f-a5fb-4b652e2cd399 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:04.715957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba534ab4-e4b5-4a4f-a5fb-4b652e2cd399 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:04.720964 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 534/1044] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:03 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1321 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:04.730288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.22"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:04.735823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:04.746866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:04.747933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:04.749166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:04.750217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:04.777733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Acquired lock "refresh_cache-e4979b7c-1bc6-4922-9345-99e402757bbd" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:57:05.126816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba534ab4-e4b5-4a4f-a5fb-4b652e2cd399 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:05.134368 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba534ab4-e4b5-4a4f-a5fb-4b652e2cd399 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1478 microversion: 2.1 time: 0.431311 Aug 04 13:57:05.134958 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 511/1045] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:04 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1478 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:05.139852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:05.140474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:05.147037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:05.147726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:05.148797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:05.150044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:05.500794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:05.509056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:05.511099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:05.513072 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0def90fb-8859-4874-acac-56ffe886efa3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.376198 Aug 04 13:57:05.513667 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 512/1046] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:05 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:05.518538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8d658775-9be9-4427-ba1c-c06cbf4c4ef1"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:05.520970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:05.529226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:05.529689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:05.530737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:05.531184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:05.590907 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] HTTP exception thrown: Volume 16577ede-7bc8-46c3-9ecc-9e150e130481 could not be found. Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Request method failure captured: Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121/os-volume_attachments/16577ede-7bc8-46c3-9ecc-9e150e130481 HTTP/1.1 Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 74 Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-uJam0mk8lX2QqaPG2yrojnv2Yoy2TfVAhv7yji2EbWLKkPfhpofAdbRhc10z5YI1k_mwxjKmFCwS5eFq5Un_P24VVadNXXlagXm0q2YgkBaOv2La0j6fXDQoYY1o40gE-nxVVB6BctuYZ2OHloxlH8etN11GgIokuH6R_FWsi0Ng Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2dc7ec9ea62c47c29bfd7af499d52d1e Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-VolumesAdminNegativeTest-1889070668 Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:57:05.594680 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2dc7ec9ea62c47c29bfd7af499d52d1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2dc7ec9ea62c47c29bfd7af499d52d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2dc7ec9ea62c47c29bfd7af499d52d1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2dc7ec9ea62c47c29bfd7af499d52d1e"}]}] Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-VolumesAdminNegativeTest-1889070668 Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2dc7ec9ea62c47c29bfd7af499d52d1e Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1889070668 Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-VolumesAdminNegativeTest-1889070668-project-admin Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 7572040df9bc4d73a39183e8edb56583 Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-VolumesAdminNegativeTest-1889070668-project-admin Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: {"volumeAttachment": {"volumeId": "8d658775-9be9-4427-ba1c-c06cbf4c4ef1"}} Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:57:05.596284 n-d-844627-10 devstack@n-api.service[130960]: exception: Volume 16577ede-7bc8-46c3-9ecc-9e150e130481 could not be found. Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'server_id': 'f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121', 'id': '16577ede-7bc8-46c3-9ecc-9e150e130481', 'body': {'volumeAttachment': {'volumeId': '8d658775-9be9-4427-ba1c-c06cbf4c4ef1'}}} Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 13:57:05.597379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16577ede-7bc8-46c3-9ecc-9e150e130481 could not be found. (HTTP 404) (Request-ID: req-cf2783d2-8ba1-4c94-b9cd-b5a6ea62b413) Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 13:57:05.598607 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16577ede-7bc8-46c3-9ecc-9e150e130481 could not be found. Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:05.602857 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16577ede-7bc8-46c3-9ecc-9e150e130481 could not be found. Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16577ede-7bc8-46c3-9ecc-9e150e130481 could not be found. Aug 04 13:57:05.605370 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:05.609399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] Returning 404 to user: Volume 16577ede-7bc8-46c3-9ecc-9e150e130481 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:05.609399 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81abcd08-0a07-49a5-a76a-c293a3c79a32 tempest-VolumesAdminNegativeTest-1889070668 tempest-VolumesAdminNegativeTest-1889070668-project-admin] 10.222.0.66 "PUT /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121/os-volume_attachments/16577ede-7bc8-46c3-9ecc-9e150e130481" status: 404 len: 109 microversion: 2.1 time: 0.081497 Aug 04 13:57:05.613340 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 513/1047] 10.222.0.66 () {60 vars in 1433 bytes} [Thu Aug 4 13:57:05 2022] PUT /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121/os-volume_attachments/16577ede-7bc8-46c3-9ecc-9e150e130481 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:05.618217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-599d57c4-7e76-4290-a003-ede0e12c38e8 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:05.618841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-599d57c4-7e76-4290-a003-ede0e12c38e8 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:05.626814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-599d57c4-7e76-4290-a003-ede0e12c38e8 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:05.627267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-599d57c4-7e76-4290-a003-ede0e12c38e8 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:05.628440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-599d57c4-7e76-4290-a003-ede0e12c38e8 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:05.628918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-599d57c4-7e76-4290-a003-ede0e12c38e8 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:05.917507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-599d57c4-7e76-4290-a003-ede0e12c38e8 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:05.926409 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-599d57c4-7e76-4290-a003-ede0e12c38e8 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1470 microversion: 2.1 time: 0.311933 Aug 04 13:57:05.927577 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 514/1048] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:05 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1470 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:05.934114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c6c2dbf7-774b-4a88-be84-e8d5bb2b3dd3 req-dc887cd5-9129-442b-b35c-22b1aa56fcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca56d355-4e66-4634-99fb-9ed160b6bc4b", "tag": "05c9a902-25a1-4f84-9f03-64cea87afd6f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:05.944597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c6c2dbf7-774b-4a88-be84-e8d5bb2b3dd3 req-dc887cd5-9129-442b-b35c-22b1aa56fcba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:05.945307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c6c2dbf7-774b-4a88-be84-e8d5bb2b3dd3 req-dc887cd5-9129-442b-b35c-22b1aa56fcba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:05.962259 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c6c2dbf7-774b-4a88-be84-e8d5bb2b3dd3 req-dc887cd5-9129-442b-b35c-22b1aa56fcba service nova] Creating event network-changed:05c9a902-25a1-4f84-9f03-64cea87afd6f for instance ca56d355-4e66-4634-99fb-9ed160b6bc4b on n-h1-844627-10 Aug 04 13:57:05.968969 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c6c2dbf7-774b-4a88-be84-e8d5bb2b3dd3 req-dc887cd5-9129-442b-b35c-22b1aa56fcba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039675 Aug 04 13:57:05.970192 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 515/1049] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:05.976160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b77f21b4-d3a1-4edb-9610-688ba6c3a17c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:05.977261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b77f21b4-d3a1-4edb-9610-688ba6c3a17c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:05.984351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b77f21b4-d3a1-4edb-9610-688ba6c3a17c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:05.985330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b77f21b4-d3a1-4edb-9610-688ba6c3a17c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:05.987040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b77f21b4-d3a1-4edb-9610-688ba6c3a17c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:05.987782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b77f21b4-d3a1-4edb-9610-688ba6c3a17c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:06.248743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b77f21b4-d3a1-4edb-9610-688ba6c3a17c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:06.265545 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b77f21b4-d3a1-4edb-9610-688ba6c3a17c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.293729 Aug 04 13:57:06.267104 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 516/1050] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:05 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:06.272086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8de7764a-29cf-466a-bcc2-2da85da0d661 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:06.272957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8de7764a-29cf-466a-bcc2-2da85da0d661 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:06.281251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de7764a-29cf-466a-bcc2-2da85da0d661 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:06.282039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de7764a-29cf-466a-bcc2-2da85da0d661 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:06.283052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de7764a-29cf-466a-bcc2-2da85da0d661 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:06.283697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de7764a-29cf-466a-bcc2-2da85da0d661 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:06.521372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8de7764a-29cf-466a-bcc2-2da85da0d661 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:06.529337 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8de7764a-29cf-466a-bcc2-2da85da0d661 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1470 microversion: 2.1 time: 0.260922 Aug 04 13:57:06.538434 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 517/1051] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:06 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:06.757817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-51326c7f-eecc-4b4f-b02e-1a84781193e0 tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:06.758316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-51326c7f-eecc-4b4f-b02e-1a84781193e0 tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:06.778980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51326c7f-eecc-4b4f-b02e-1a84781193e0 tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:06.780234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51326c7f-eecc-4b4f-b02e-1a84781193e0 tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:06.782165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51326c7f-eecc-4b4f-b02e-1a84781193e0 tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:06.782495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51326c7f-eecc-4b4f-b02e-1a84781193e0 tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:06.859141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-51326c7f-eecc-4b4f-b02e-1a84781193e0 tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:06.982735 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-51326c7f-eecc-4b4f-b02e-1a84781193e0 tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] 10.222.0.66 "DELETE /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 204 len: 0 microversion: 2.1 time: 0.442356 Aug 04 13:57:06.983183 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 518/1052] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:06 2022] DELETE /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:06.991156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4d8c0a73-73f3-4f3e-9654-55ffab009df8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:06.992063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4d8c0a73-73f3-4f3e-9654-55ffab009df8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:07.001268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d8c0a73-73f3-4f3e-9654-55ffab009df8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:07.001616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d8c0a73-73f3-4f3e-9654-55ffab009df8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:07.003053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d8c0a73-73f3-4f3e-9654-55ffab009df8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:07.003595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d8c0a73-73f3-4f3e-9654-55ffab009df8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:07.361454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:07.592024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4d8c0a73-73f3-4f3e-9654-55ffab009df8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:07.601104 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4d8c0a73-73f3-4f3e-9654-55ffab009df8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1478 microversion: 2.1 time: 0.616463 Aug 04 13:57:07.610319 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 519/1053] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:06 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1478 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:07.615820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:07.616442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:07.625907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:07.626537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:07.628145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:07.628415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:07.745605 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.network.neutron [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] re-assign floating IP 172.25.2.22 from instance 33a80a01-edba-4355-8d27-8fac463e118a Aug 04 13:57:07.812400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Building network info cache for instance {{(pid=130961) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 13:57:07.814009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:07.834018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:07.835664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:07.837285 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2a46c54a-8760-46b8-8709-1a0a35b0914e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.225554 Aug 04 13:57:07.838909 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 520/1054] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:07 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:07.936242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-741cdbc9-3b6d-45e0-a1cf-06a92b847cb7 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:07.937111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-741cdbc9-3b6d-45e0-a1cf-06a92b847cb7 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] [instance: f4a9018d-d9c5-430e-ab90-4858d5c42679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:07.943475 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-741cdbc9-3b6d-45e0-a1cf-06a92b847cb7 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] HTTP exception thrown: Instance f4a9018d-d9c5-430e-ab90-4858d5c42679 could not be found. Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-741cdbc9-3b6d-45e0-a1cf-06a92b847cb7 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Request method failure captured: Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/f4a9018d-d9c5-430e-ab90-4858d5c42679/action HTTP/1.1 Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 15 Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69AfFmr9Gdsxu-ahMEBk14ZQJGDhdWt1bImWs6nFydgaVI26PQMU5K6HsIJ7psYSpBBfFhKocpcTnk-CoLjEkMDEg5cI_U9qK4vYGbrcSHTrfUV9HyvYv2qYxMG5M8Vt44kyJpLKcUAgpH8G0a_mDK-RXTljvoZXwED7KWtG-8CCTpo Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 13:57:07.945306 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_60ddcd2f64b8498db210e492397196ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}] Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: bf7a933194374cfd89c60a99b3b9acc5 Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: {"migrate": {}} Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:57:07.947665 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance f4a9018d-d9c5-430e-ab90-4858d5c42679 could not be found. Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'f4a9018d-d9c5-430e-ab90-4858d5c42679', 'body': {'migrate': {}}} Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a9018d-d9c5-430e-ab90-4858d5c42679 could not be found. Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:07.958469 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a9018d-d9c5-430e-ab90-4858d5c42679 could not be found. Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a9018d-d9c5-430e-ab90-4858d5c42679 could not be found. Aug 04 13:57:07.961230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:07.962701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-741cdbc9-3b6d-45e0-a1cf-06a92b847cb7 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Returning 404 to user: Instance f4a9018d-d9c5-430e-ab90-4858d5c42679 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:07.962701 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-741cdbc9-3b6d-45e0-a1cf-06a92b847cb7 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/f4a9018d-d9c5-430e-ab90-4858d5c42679/action" status: 404 len: 111 microversion: 2.1 time: 0.107129 Aug 04 13:57:07.962701 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 521/1055] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:07 2022] POST /compute/v2.1/servers/f4a9018d-d9c5-430e-ab90-4858d5c42679/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:07.966079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-fe7b81e6-bcf6-4538-bcd1-a95de312b925 req-124cbe79-9870-4f0a-abff-9714a67467e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9802281d-83eb-4b5d-8fe0-bc812e0872e4", "name": "network-vif-unplugged", "status": "completed", "tag": "f591719b-2d26-42da-b7bb-dfe4d507c0a9"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:07.989059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fe7b81e6-bcf6-4538-bcd1-a95de312b925 req-124cbe79-9870-4f0a-abff-9714a67467e0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:07.989512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fe7b81e6-bcf6-4538-bcd1-a95de312b925 req-124cbe79-9870-4f0a-abff-9714a67467e0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:08.011000 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fe7b81e6-bcf6-4538-bcd1-a95de312b925 req-124cbe79-9870-4f0a-abff-9714a67467e0 service nova] Creating event network-vif-unplugged:f591719b-2d26-42da-b7bb-dfe4d507c0a9 for instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 on n-h1-844627-10 Aug 04 13:57:08.016923 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-fe7b81e6-bcf6-4538-bcd1-a95de312b925 req-124cbe79-9870-4f0a-abff-9714a67467e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066769 Aug 04 13:57:08.017762 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 522/1056] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:08.023516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-39a29260-d5b3-46a1-a5c4-94492095886f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:08.024705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-39a29260-d5b3-46a1-a5c4-94492095886f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:08.032491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39a29260-d5b3-46a1-a5c4-94492095886f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:08.033203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39a29260-d5b3-46a1-a5c4-94492095886f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:08.034580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39a29260-d5b3-46a1-a5c4-94492095886f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:08.035173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39a29260-d5b3-46a1-a5c4-94492095886f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:08.035846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=28 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:08.276266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-39a29260-d5b3-46a1-a5c4-94492095886f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:08.292530 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-39a29260-d5b3-46a1-a5c4-94492095886f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1476 microversion: 2.1 time: 0.273186 Aug 04 13:57:08.293554 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 523/1057] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:08 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1476 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:08.299149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cde0d663-57c5-4436-877c-79516828ebbd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:08.300088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cde0d663-57c5-4436-877c-79516828ebbd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:08.309108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cde0d663-57c5-4436-877c-79516828ebbd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:08.310455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cde0d663-57c5-4436-877c-79516828ebbd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:08.311517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cde0d663-57c5-4436-877c-79516828ebbd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:08.312534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cde0d663-57c5-4436-877c-79516828ebbd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:08.548071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cde0d663-57c5-4436-877c-79516828ebbd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:08.559426 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cde0d663-57c5-4436-877c-79516828ebbd tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.264434 Aug 04 13:57:08.560784 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 524/1058] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:08 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:08.567923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-848056729", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:08.593929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Updating instance_info_cache with network_info: [{"id": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07", "address": "fa:16:3e:03:06:8a", "network": {"id": "bd0c2de1-a833-4902-b343-80481e8458ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1801279138-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9e5afd8e587c41d8bc0f86c89a38fce2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap83bf7c82-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130961) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 13:57:08.612946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Building network info cache for instance {{(pid=130961) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 13:57:08.637467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:57:09.063380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:57:09.063810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:57:09.064285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:57:09.064841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:57:09.065319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:57:09.081093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.081462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.082260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.082703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.110238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Getting quotas for project 8c532a5466be43d68f5517db3c731bcc. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:57:09.116199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Getting quotas for user 8e166178676342cdb27f729225343f82 and project 8c532a5466be43d68f5517db3c731bcc. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:57:09.130263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:57:09.132563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:57:09.195308 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe1737d9-faaa-4fb1-ad32-a8e07d337d9e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633090 Aug 04 13:57:09.202243 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 525/1059] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:57:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:57:09.207017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-203db836-d10f-48e3-ab48-23dbb4b89485 req-3068449d-6ded-4ac3-b313-660ce9ed9298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a80a01-edba-4355-8d27-8fac463e118a", "tag": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07"}, {"name": "network-changed", "server_uuid": "e4979b7c-1bc6-4922-9345-99e402757bbd", "tag": "39459960-3571-47a9-bd3d-aa345456dc55"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:09.218660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-203db836-d10f-48e3-ab48-23dbb4b89485 req-3068449d-6ded-4ac3-b313-660ce9ed9298 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.219106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-203db836-d10f-48e3-ab48-23dbb4b89485 req-3068449d-6ded-4ac3-b313-660ce9ed9298 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.232592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-203db836-d10f-48e3-ab48-23dbb4b89485 req-3068449d-6ded-4ac3-b313-660ce9ed9298 service nova] Creating event network-changed:83bf7c82-4313-4b52-9ea6-3efdcbf48b07 for instance 33a80a01-edba-4355-8d27-8fac463e118a on n-h2-844627-10 Aug 04 13:57:09.233153 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-203db836-d10f-48e3-ab48-23dbb4b89485 req-3068449d-6ded-4ac3-b313-660ce9ed9298 service nova] Creating event network-changed:39459960-3571-47a9-bd3d-aa345456dc55 for instance e4979b7c-1bc6-4922-9345-99e402757bbd on n-h1-844627-10 Aug 04 13:57:09.241651 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-203db836-d10f-48e3-ab48-23dbb4b89485 req-3068449d-6ded-4ac3-b313-660ce9ed9298 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037908 Aug 04 13:57:09.242210 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 526/1060] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:09.247442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9904c0e-9c9e-4863-b3a2-67c8da38705a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:09.248156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a9904c0e-9c9e-4863-b3a2-67c8da38705a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:09.252008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:09.258849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9904c0e-9c9e-4863-b3a2-67c8da38705a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.259305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9904c0e-9c9e-4863-b3a2-67c8da38705a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.260621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9904c0e-9c9e-4863-b3a2-67c8da38705a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.261481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9904c0e-9c9e-4863-b3a2-67c8da38705a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.623265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Updating instance_info_cache with network_info: [{"id": "39459960-3571-47a9-bd3d-aa345456dc55", "address": "fa:16:3e:8a:61:c4", "network": {"id": "bd0c2de1-a833-4902-b343-80481e8458ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1801279138-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9e5afd8e587c41d8bc0f86c89a38fce2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap39459960-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130961) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 13:57:09.642228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Releasing lock "refresh_cache-e4979b7c-1bc6-4922-9345-99e402757bbd" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:57:09.643203 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a48bdee-d9de-4af3-8d00-c0df9ca7f3a4 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "POST /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd/action" status: 202 len: 0 microversion: 2.1 time: 4.921305 Aug 04 13:57:09.643913 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 535/1061] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:04 2022] POST /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd/action => generated 0 bytes in 4923 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 13:57:09.649969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:09.650710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:09.657347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.657736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.658600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.658977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.666164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a9904c0e-9c9e-4863-b3a2-67c8da38705a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:09.674957 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a9904c0e-9c9e-4863-b3a2-67c8da38705a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1478 microversion: 2.1 time: 0.431566 Aug 04 13:57:09.675956 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 527/1062] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:09 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1478 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:09.682351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a7b1315e-c743-4fa3-bff0-984791796619 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:09.683038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a7b1315e-c743-4fa3-bff0-984791796619 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:09.689385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7b1315e-c743-4fa3-bff0-984791796619 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.689836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7b1315e-c743-4fa3-bff0-984791796619 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.690611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7b1315e-c743-4fa3-bff0-984791796619 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.691046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7b1315e-c743-4fa3-bff0-984791796619 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.722411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a7b1315e-c743-4fa3-bff0-984791796619 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:09.765988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:09.818815 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a7b1315e-c743-4fa3-bff0-984791796619 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 204 len: 0 microversion: 2.1 time: 0.140966 Aug 04 13:57:09.819327 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 528/1063] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:09 2022] DELETE /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:09.825363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da747974-35ca-407c-8b12-44a636524c13 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:09.826122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-da747974-35ca-407c-8b12-44a636524c13 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:09.832241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da747974-35ca-407c-8b12-44a636524c13 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.832697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da747974-35ca-407c-8b12-44a636524c13 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.833543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da747974-35ca-407c-8b12-44a636524c13 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.833976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da747974-35ca-407c-8b12-44a636524c13 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.946380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-da747974-35ca-407c-8b12-44a636524c13 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:09.957789 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-da747974-35ca-407c-8b12-44a636524c13 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1225 microversion: 2.1 time: 0.137050 Aug 04 13:57:09.958537 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 529/1064] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:09 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:09.963454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c9b3079c-dcd0-4319-9d26-4a4b5d74f54f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:09.964473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c9b3079c-dcd0-4319-9d26-4a4b5d74f54f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:09.971230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9b3079c-dcd0-4319-9d26-4a4b5d74f54f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.971976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9b3079c-dcd0-4319-9d26-4a4b5d74f54f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:09.973069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9b3079c-dcd0-4319-9d26-4a4b5d74f54f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:09.973760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9b3079c-dcd0-4319-9d26-4a4b5d74f54f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:10.047645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.057663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.059588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.060737 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-792c396f-5419-4960-85eb-fff892e0b75a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.415009 Aug 04 13:57:10.061332 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 536/1065] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:09 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:10.077590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba14a331-e392-408d-abdf-e6e17825f946 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:10.078299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ba14a331-e392-408d-abdf-e6e17825f946 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:10.088627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba14a331-e392-408d-abdf-e6e17825f946 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:10.089717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba14a331-e392-408d-abdf-e6e17825f946 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:10.090913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba14a331-e392-408d-abdf-e6e17825f946 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:10.091475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba14a331-e392-408d-abdf-e6e17825f946 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:10.232210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c9b3079c-dcd0-4319-9d26-4a4b5d74f54f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.240813 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c9b3079c-dcd0-4319-9d26-4a4b5d74f54f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 200 len: 1476 microversion: 2.1 time: 0.280901 Aug 04 13:57:10.241422 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 530/1066] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:09 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 1476 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:10.247264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Action: 'action', calling method: .version_select at 0x7f47031b30d0>, body: {"removeFloatingIp": {"address": "172.25.2.22"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:10.370688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ba14a331-e392-408d-abdf-e6e17825f946 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.382794 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ba14a331-e392-408d-abdf-e6e17825f946 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.312964 Aug 04 13:57:10.383767 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 537/1067] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:10 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:10.388976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-36458bce-89ab-4f5d-8a1e-30922908963e tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:10.389735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-36458bce-89ab-4f5d-8a1e-30922908963e tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:10.396577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-36458bce-89ab-4f5d-8a1e-30922908963e tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:10.397190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-36458bce-89ab-4f5d-8a1e-30922908963e tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:10.398155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-36458bce-89ab-4f5d-8a1e-30922908963e tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:10.398693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-36458bce-89ab-4f5d-8a1e-30922908963e tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:10.466047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:10.478083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:10.478634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:10.479458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:10.487000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:10.658185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-36458bce-89ab-4f5d-8a1e-30922908963e tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:10.666422 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-36458bce-89ab-4f5d-8a1e-30922908963e tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1515 microversion: 2.1 time: 0.281101 Aug 04 13:57:10.667002 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 538/1068] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:10 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:10.677152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0fe7e09c-96d1-4d9d-9200-c0c97de0fce0 req-e8a238ed-3b71-4750-98ec-f56f8fd23ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a43735-0b27-4bc2-8943-9ba369ecf719", "name": "network-vif-deleted", "tag": "2f7d8253-a5c0-44d9-ac13-a7d2d806a1eb"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:10.700679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0fe7e09c-96d1-4d9d-9200-c0c97de0fce0 req-e8a238ed-3b71-4750-98ec-f56f8fd23ea5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:10.701151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0fe7e09c-96d1-4d9d-9200-c0c97de0fce0 req-e8a238ed-3b71-4750-98ec-f56f8fd23ea5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:10.716426 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0fe7e09c-96d1-4d9d-9200-c0c97de0fce0 req-e8a238ed-3b71-4750-98ec-f56f8fd23ea5 service nova] Creating event network-vif-deleted:2f7d8253-a5c0-44d9-ac13-a7d2d806a1eb for instance b3a43735-0b27-4bc2-8943-9ba369ecf719 on n-h1-844627-10 Aug 04 13:57:10.722790 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0fe7e09c-96d1-4d9d-9200-c0c97de0fce0 req-e8a238ed-3b71-4750-98ec-f56f8fd23ea5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049778 Aug 04 13:57:10.723384 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 539/1069] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:10.731196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-db0cd111-5fe4-4e7d-b922-83de9b863043 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:10.733114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-db0cd111-5fe4-4e7d-b922-83de9b863043 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:10.740486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db0cd111-5fe4-4e7d-b922-83de9b863043 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:10.741376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db0cd111-5fe4-4e7d-b922-83de9b863043 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:10.742863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db0cd111-5fe4-4e7d-b922-83de9b863043 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:10.743413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db0cd111-5fe4-4e7d-b922-83de9b863043 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.035606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-db0cd111-5fe4-4e7d-b922-83de9b863043 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.041565 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] HTTP exception thrown: Floating IP 172.25.2.22 is not associated with instance 33a80a01-edba-4355-8d27-8fac463e118a. Aug 04 13:57:11.044201 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-db0cd111-5fe4-4e7d-b922-83de9b863043 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1478 microversion: 2.1 time: 0.319397 Aug 04 13:57:11.044850 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 540/1070] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:10 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1478 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Request method failure captured: Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a/action HTTP/1.1 Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 48 Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69AHu7BXewIiMk-oNGfnyZ_m3-vUx8-5J7TAZz_37CjTAjdWcTSRyrKDttyBll8zZkHDg-yMSYOEHD_2ONOaIPZhgzVDV_jIGiI9Ua5tFP0TRlV5Xg4OqO6Xe4XB0gVC9kMUYi7sEydubxTk-iflYCn12RwLZxCGQ_AHsxcvsrzclTs Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 9e5afd8e587c41d8bc0f86c89a38fce2 Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:57:11.045017 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5afd8e587c41d8bc0f86c89a38fce2"}]}] Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 9e5afd8e587c41d8bc0f86c89a38fce2 Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FloatingIPsAssociationTestJSON-1931319612-project Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 314b6dcaf21b4fb197cbd03275229572 Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1931319612-project Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: {"removeFloatingIp": {"address": "172.25.2.22"}} Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:57:11.046311 n-d-844627-10 devstack@n-api.service[130960]: exception: Floating IP 172.25.2.22 is not associated with instance 33a80a01-edba-4355-8d27-8fac463e118a. Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '33a80a01-edba-4355-8d27-8fac463e118a', 'body': {'removeFloatingIp': {'address': '172.25.2.22'}}} Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.22 is not associated with instance 33a80a01-edba-4355-8d27-8fac463e118a. Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:11.047123 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:11.048349 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:11.048349 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:11.048349 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:11.048349 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:11.048349 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.22 is not associated with instance 33a80a01-edba-4355-8d27-8fac463e118a. Aug 04 13:57:11.048349 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:11.048349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Returning 409 to user: Floating IP 172.25.2.22 is not associated with instance 33a80a01-edba-4355-8d27-8fac463e118a. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:11.048349 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1d025d6e-6026-4da0-b45e-30edb3e74a81 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "POST /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a/action" status: 409 len: 145 microversion: 2.1 time: 0.804169 Aug 04 13:57:11.049901 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 531/1071] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:10 2022] POST /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a/action => generated 145 bytes in 808 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:57:11.050022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f044456f-b4d4-443a-b8c0-0904f7cba4c9 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:11.050728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f044456f-b4d4-443a-b8c0-0904f7cba4c9 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:11.055484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.22"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:11.057606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f044456f-b4d4-443a-b8c0-0904f7cba4c9 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.058161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f044456f-b4d4-443a-b8c0-0904f7cba4c9 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.059007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f044456f-b4d4-443a-b8c0-0904f7cba4c9 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.059519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f044456f-b4d4-443a-b8c0-0904f7cba4c9 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.219695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f044456f-b4d4-443a-b8c0-0904f7cba4c9 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.228131 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f044456f-b4d4-443a-b8c0-0904f7cba4c9 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1225 microversion: 2.1 time: 0.182178 Aug 04 13:57:11.229581 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 541/1072] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:11 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1225 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:11.235724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:11.236700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:11.243696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.245165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.246472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.246985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.354764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:11.361117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.361594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.362372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.362809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.484279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.493971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.496422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.497881 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7be05f9-a51c-4a6d-ae07-cd1fb44e149d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.266782 Aug 04 13:57:11.506518 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 542/1073] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:11 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:11.513338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:11.514109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:11.520430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.521031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.521873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.522383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.536707 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] HTTP exception thrown: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Request method failure captured: Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 HTTP/1.1 Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AbymHZeIikqHaHbN7Xqt3cDFxPExdkcsS9-j7XUqvggqfUeoO-z6_0EQoo0YU0Ga26G4fr0wMF7yGfVmtu4DaOZ55cw3XQZ8s63hFjc1DQSXZM9-52RbB0BuZPXdU3CRYwMq8S_nA3yJtuDSCBs7JBLZhoEebBS6646uE178lveMk Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:11.538399 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e77863344504cef8b27ad7730d9452c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}] Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d44afbc629004152807d0ac000e4c53a Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:11.541836 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b3a43735-0b27-4bc2-8943-9ba369ecf719'} Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:11.551442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:11.554035 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:11.556524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Returning 404 to user: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:11.556524 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ba0dcaa9-65df-41c5-ac51-f9a7c1040860 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 404 len: 111 microversion: 2.1 time: 0.031896 Aug 04 13:57:11.556524 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 543/1074] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:11 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:11.556524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d073589-52ae-4dca-812d-6d8a497b652f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:11.556524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d073589-52ae-4dca-812d-6d8a497b652f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:11.564484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d073589-52ae-4dca-812d-6d8a497b652f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.564971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d073589-52ae-4dca-812d-6d8a497b652f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.566207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d073589-52ae-4dca-812d-6d8a497b652f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:11.566360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d073589-52ae-4dca-812d-6d8a497b652f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:11.671830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Acquired lock "refresh_cache-e4979b7c-1bc6-4922-9345-99e402757bbd" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:57:11.783145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d073589-52ae-4dca-812d-6d8a497b652f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:11.791389 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d073589-52ae-4dca-812d-6d8a497b652f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1542 microversion: 2.1 time: 0.239454 Aug 04 13:57:11.791972 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 544/1075] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:11 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1542 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:11.809386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-803052269", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:11.866198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:57:12.223096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:57:12.223556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:57:12.224054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:57:12.224446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:57:12.224885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:57:12.235329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:12.235879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:12.236786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:12.237324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:12.255725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Getting quotas for project 2e77863344504cef8b27ad7730d9452c. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:57:12.261075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Getting quotas for user d44afbc629004152807d0ac000e4c53a and project 2e77863344504cef8b27ad7730d9452c. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:57:12.273426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:57:12.275740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:57:12.322562 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-38d9e405-4208-404b-a505-8e8f89467f0e tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516962 Aug 04 13:57:12.323581 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 545/1076] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:57:12.328333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d79219a-d4fa-453c-9c0a-318a2a383181 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:12.329103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1d79219a-d4fa-453c-9c0a-318a2a383181 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:12.335706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d79219a-d4fa-453c-9c0a-318a2a383181 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:12.336159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d79219a-d4fa-453c-9c0a-318a2a383181 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:12.336969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d79219a-d4fa-453c-9c0a-318a2a383181 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:12.337408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d79219a-d4fa-453c-9c0a-318a2a383181 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:12.354805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:12.887169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1d79219a-d4fa-453c-9c0a-318a2a383181 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:12.904513 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d79219a-d4fa-453c-9c0a-318a2a383181 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 200 len: 1515 microversion: 2.1 time: 0.578085 Aug 04 13:57:12.906184 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 546/1077] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:12 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 1515 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:12.919647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bb137b68-66d9-4a5e-8a48-722136e78bbe tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:12.920671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bb137b68-66d9-4a5e-8a48-722136e78bbe tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:12.936091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb137b68-66d9-4a5e-8a48-722136e78bbe tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:12.936970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb137b68-66d9-4a5e-8a48-722136e78bbe tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:12.945142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb137b68-66d9-4a5e-8a48-722136e78bbe tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:12.946087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb137b68-66d9-4a5e-8a48-722136e78bbe tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:13.335051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Building network info cache for instance {{(pid=130960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 13:57:13.368468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bb137b68-66d9-4a5e-8a48-722136e78bbe tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:13.379788 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bb137b68-66d9-4a5e-8a48-722136e78bbe tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1478 microversion: 2.1 time: 0.471718 Aug 04 13:57:13.398130 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 547/1078] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:12 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1478 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:13.404735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd8a73f9-f061-4da7-a61c-2820b96b5d08 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:13.406388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bd8a73f9-f061-4da7-a61c-2820b96b5d08 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:13.415508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd8a73f9-f061-4da7-a61c-2820b96b5d08 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:13.416562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd8a73f9-f061-4da7-a61c-2820b96b5d08 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:13.417640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd8a73f9-f061-4da7-a61c-2820b96b5d08 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:13.418808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd8a73f9-f061-4da7-a61c-2820b96b5d08 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:13.731368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bd8a73f9-f061-4da7-a61c-2820b96b5d08 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:13.749692 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd8a73f9-f061-4da7-a61c-2820b96b5d08 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1279 microversion: 2.1 time: 0.349663 Aug 04 13:57:13.767727 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 548/1079] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:13 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1279 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:13.775567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-66416d95-6207-4ebf-85fa-c4317561903b tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:13.776431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-66416d95-6207-4ebf-85fa-c4317561903b tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:13.791829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66416d95-6207-4ebf-85fa-c4317561903b tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:13.793426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66416d95-6207-4ebf-85fa-c4317561903b tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:13.795487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66416d95-6207-4ebf-85fa-c4317561903b tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:13.800019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66416d95-6207-4ebf-85fa-c4317561903b tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:13.937744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-66416d95-6207-4ebf-85fa-c4317561903b tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:13.949769 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-66416d95-6207-4ebf-85fa-c4317561903b tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1289 microversion: 2.1 time: 0.180476 Aug 04 13:57:13.950970 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 549/1080] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:13 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1289 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:13.960016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:13.960990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:13.970384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:13.970845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:13.971630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:13.972567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:14.325088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.334272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.340398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.341739 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f56043da-d7d9-47a7-be57-0112534adcd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.389496 Aug 04 13:57:14.344294 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 550/1081] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:13 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:14.354054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3fa0264c-536f-4bde-80a9-9dcc22f308c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:14.355022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3fa0264c-536f-4bde-80a9-9dcc22f308c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:14.376555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fa0264c-536f-4bde-80a9-9dcc22f308c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:14.385816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fa0264c-536f-4bde-80a9-9dcc22f308c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:14.388141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fa0264c-536f-4bde-80a9-9dcc22f308c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:14.389863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fa0264c-536f-4bde-80a9-9dcc22f308c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:14.692562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3fa0264c-536f-4bde-80a9-9dcc22f308c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:14.701760 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3fa0264c-536f-4bde-80a9-9dcc22f308c4 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1541 microversion: 2.1 time: 0.353779 Aug 04 13:57:14.716935 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 551/1082] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:14 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1541 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:14.725035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5e54d144-f23f-4a2a-ba25-f88bd3fed40f req-f64e84b9-672e-455f-85f5-f4925fba3b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4979b7c-1bc6-4922-9345-99e402757bbd", "tag": "39459960-3571-47a9-bd3d-aa345456dc55"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:14.738850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5e54d144-f23f-4a2a-ba25-f88bd3fed40f req-f64e84b9-672e-455f-85f5-f4925fba3b96 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:14.739596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5e54d144-f23f-4a2a-ba25-f88bd3fed40f req-f64e84b9-672e-455f-85f5-f4925fba3b96 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:14.768199 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5e54d144-f23f-4a2a-ba25-f88bd3fed40f req-f64e84b9-672e-455f-85f5-f4925fba3b96 service nova] Creating event network-changed:39459960-3571-47a9-bd3d-aa345456dc55 for instance e4979b7c-1bc6-4922-9345-99e402757bbd on n-h1-844627-10 Aug 04 13:57:14.776154 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5e54d144-f23f-4a2a-ba25-f88bd3fed40f req-f64e84b9-672e-455f-85f5-f4925fba3b96 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067689 Aug 04 13:57:14.778195 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 552/1083] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:14.787563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-58205e49-301b-4758-98e4-5675437c9031 req-d23b46eb-0cfb-48de-b232-aa8b5e904d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121", "name": "network-vif-deleted", "tag": "304ba369-863e-4bbc-96b5-d52cf5aab0e3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:14.800438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-58205e49-301b-4758-98e4-5675437c9031 req-d23b46eb-0cfb-48de-b232-aa8b5e904d22 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:14.801024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-58205e49-301b-4758-98e4-5675437c9031 req-d23b46eb-0cfb-48de-b232-aa8b5e904d22 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:14.819210 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-58205e49-301b-4758-98e4-5675437c9031 req-d23b46eb-0cfb-48de-b232-aa8b5e904d22 service nova] Creating event network-vif-deleted:304ba369-863e-4bbc-96b5-d52cf5aab0e3 for instance f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 on n-h2-844627-10 Aug 04 13:57:14.834418 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-58205e49-301b-4758-98e4-5675437c9031 req-d23b46eb-0cfb-48de-b232-aa8b5e904d22 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054784 Aug 04 13:57:14.835461 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 553/1084] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:14.843239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-956eb7c3-e958-47b1-902d-7c5c2e06b910 req-40178bb2-7cf6-401c-9bba-e00f39f26638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9802281d-83eb-4b5d-8fe0-bc812e0872e4", "name": "network-vif-plugged", "status": "completed", "tag": "f591719b-2d26-42da-b7bb-dfe4d507c0a9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:14.854880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-956eb7c3-e958-47b1-902d-7c5c2e06b910 req-40178bb2-7cf6-401c-9bba-e00f39f26638 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:14.855345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-956eb7c3-e958-47b1-902d-7c5c2e06b910 req-40178bb2-7cf6-401c-9bba-e00f39f26638 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:14.872609 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-956eb7c3-e958-47b1-902d-7c5c2e06b910 req-40178bb2-7cf6-401c-9bba-e00f39f26638 service nova] Creating event network-vif-plugged:f591719b-2d26-42da-b7bb-dfe4d507c0a9 for instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 on n-h1-844627-10 Aug 04 13:57:14.883145 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-956eb7c3-e958-47b1-902d-7c5c2e06b910 req-40178bb2-7cf6-401c-9bba-e00f39f26638 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045980 Aug 04 13:57:14.883876 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 554/1085] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:14.893645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:14.894452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:14.903873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:14.904433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:14.906720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:14.907635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:14.925190 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] HTTP exception thrown: Instance f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 could not be found. Aug 04 13:57:14.929674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Updating instance_info_cache with network_info: [{"id": "39459960-3571-47a9-bd3d-aa345456dc55", "address": "fa:16:3e:8a:61:c4", "network": {"id": "bd0c2de1-a833-4902-b343-80481e8458ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1801279138-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9e5afd8e587c41d8bc0f86c89a38fce2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap39459960-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Request method failure captured: Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 HTTP/1.1 Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-VpB5WkKxxJaebx8Jdj0xoKR6oJ1GV0MwW29LvhkImVe-jMzKL9oDIsWOpFmWpKsA6m1MRbRs4m_SsSPVOSygWCJKib3BaP2pwcE9bCR4sdh2sjasWe48iXRvXWiLGw2DmCK8-vjeb_GY-tixbYvVBmYWyIXtb1XsD5nyCVXiJysI Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 6adc52f7e03846d3a73ef1c6d2b040cd Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesAdminNegativeTest-1877086382 Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:14.961124 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6adc52f7e03846d3a73ef1c6d2b040cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6adc52f7e03846d3a73ef1c6d2b040cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6adc52f7e03846d3a73ef1c6d2b040cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6adc52f7e03846d3a73ef1c6d2b040cd"}]}] Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesAdminNegativeTest-1877086382 Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 6adc52f7e03846d3a73ef1c6d2b040cd Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1877086382 Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesAdminNegativeTest-1877086382-project Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c5534a5c5eff41e998b2b92ca13bb372 Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesAdminNegativeTest-1877086382-project Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 could not be found. Aug 04 13:57:14.963577 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121'} Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 could not be found. Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:14.964397 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 could not be found. Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 could not be found. Aug 04 13:57:14.966887 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:14.969056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Returning 404 to user: Instance f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:14.969056 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-241dabee-796a-4c23-a6b8-8e6f97b6c288 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121" status: 404 len: 111 microversion: 2.1 time: 0.083166 Aug 04 13:57:14.974698 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 555/1086] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:14 2022] GET /compute/v2.1/servers/f6ba4a84-1aaf-4b35-b59f-c1c4de7ad121 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:14.985996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Releasing lock "refresh_cache-e4979b7c-1bc6-4922-9345-99e402757bbd" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:57:14.987509 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3430edfa-beb2-41e4-b10d-d148501b9ae5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "POST /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd/action" status: 202 len: 0 microversion: 2.1 time: 3.935855 Aug 04 13:57:14.991683 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 532/1087] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:11 2022] POST /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd/action => generated 0 bytes in 3937 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 13:57:15.011765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6b41e4eb-7d06-47f5-9af4-78f0388293c8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.011765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6b41e4eb-7d06-47f5-9af4-78f0388293c8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:15.012139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fc830be8-35f7-4074-be5a-eaa9120c7a04 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.012139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fc830be8-35f7-4074-be5a-eaa9120c7a04 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:15.035670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc830be8-35f7-4074-be5a-eaa9120c7a04 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.036502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b41e4eb-7d06-47f5-9af4-78f0388293c8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.037112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b41e4eb-7d06-47f5-9af4-78f0388293c8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.038361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b41e4eb-7d06-47f5-9af4-78f0388293c8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.040580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b41e4eb-7d06-47f5-9af4-78f0388293c8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.047138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc830be8-35f7-4074-be5a-eaa9120c7a04 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.048257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc830be8-35f7-4074-be5a-eaa9120c7a04 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.049871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc830be8-35f7-4074-be5a-eaa9120c7a04 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.456159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6b41e4eb-7d06-47f5-9af4-78f0388293c8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:15.468244 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6b41e4eb-7d06-47f5-9af4-78f0388293c8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1478 microversion: 2.1 time: 0.492204 Aug 04 13:57:15.469562 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 556/1088] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:14 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1478 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:15.480464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2d65f371-686e-44c4-9d20-40ccbe4df19f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.481594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2d65f371-686e-44c4-9d20-40ccbe4df19f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:15.490016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d65f371-686e-44c4-9d20-40ccbe4df19f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.492183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d65f371-686e-44c4-9d20-40ccbe4df19f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.493693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d65f371-686e-44c4-9d20-40ccbe4df19f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.494395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d65f371-686e-44c4-9d20-40ccbe4df19f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.526805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fc830be8-35f7-4074-be5a-eaa9120c7a04 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:15.535451 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fc830be8-35f7-4074-be5a-eaa9120c7a04 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1321 microversion: 2.1 time: 0.545308 Aug 04 13:57:15.550514 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 533/1089] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:14 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:15.559555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-91e3c7f8-ddc6-450f-9e9d-fafc11ebb0ab tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.560794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-91e3c7f8-ddc6-450f-9e9d-fafc11ebb0ab tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:15.567948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91e3c7f8-ddc6-450f-9e9d-fafc11ebb0ab tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.568683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91e3c7f8-ddc6-450f-9e9d-fafc11ebb0ab tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.569844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91e3c7f8-ddc6-450f-9e9d-fafc11ebb0ab tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.570872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91e3c7f8-ddc6-450f-9e9d-fafc11ebb0ab tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.597135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2d65f371-686e-44c4-9d20-40ccbe4df19f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:15.611031 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2d65f371-686e-44c4-9d20-40ccbe4df19f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1277 microversion: 2.1 time: 0.133088 Aug 04 13:57:15.612186 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 557/1090] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:15 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:15.622638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.623662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-91e3c7f8-ddc6-450f-9e9d-fafc11ebb0ab tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:15.624455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:15.642833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.643528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.644640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.645309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.788797 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-91e3c7f8-ddc6-450f-9e9d-fafc11ebb0ab tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 204 len: 0 microversion: 2.1 time: 0.236124 Aug 04 13:57:15.797244 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 534/1091] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:15 2022] DELETE /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:15.803868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7194b80b-919a-4146-b3ef-a4a201b825d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:15.805772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7194b80b-919a-4146-b3ef-a4a201b825d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:15.813463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7194b80b-919a-4146-b3ef-a4a201b825d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.814162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7194b80b-919a-4146-b3ef-a4a201b825d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:15.815150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7194b80b-919a-4146-b3ef-a4a201b825d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:15.815810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7194b80b-919a-4146-b3ef-a4a201b825d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:16.111487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:16.123578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:16.126252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:16.127798 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f9f12c0-edbf-4518-ba82-a9a3abad7834 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.514090 Aug 04 13:57:16.128465 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 558/1092] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:15 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:16.144323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.22"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:16.150260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:16.164121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:16.165185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:16.167093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:16.167093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:16.199835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Acquired lock "refresh_cache-33a80a01-edba-4355-8d27-8fac463e118a" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:57:16.246863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7194b80b-919a-4146-b3ef-a4a201b825d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:16.257006 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7194b80b-919a-4146-b3ef-a4a201b825d6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1541 microversion: 2.1 time: 0.457937 Aug 04 13:57:16.263818 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 535/1093] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:15 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1541 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:16.488808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02e9c751-8cc5-49a6-9ef2-87010ac0f238 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:16.489658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-02e9c751-8cc5-49a6-9ef2-87010ac0f238 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:16.497645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e9c751-8cc5-49a6-9ef2-87010ac0f238 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:16.498098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e9c751-8cc5-49a6-9ef2-87010ac0f238 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:16.499141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e9c751-8cc5-49a6-9ef2-87010ac0f238 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:16.499798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e9c751-8cc5-49a6-9ef2-87010ac0f238 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:16.836921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-02e9c751-8cc5-49a6-9ef2-87010ac0f238 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:16.856568 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-02e9c751-8cc5-49a6-9ef2-87010ac0f238 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1478 microversion: 2.1 time: 0.371413 Aug 04 13:57:16.866712 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 536/1094] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:16 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1478 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:16.886785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53c1ef74-21d3-449f-a2c1-d5499db05719 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:16.887657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-53c1ef74-21d3-449f-a2c1-d5499db05719 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:16.902173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53c1ef74-21d3-449f-a2c1-d5499db05719 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:16.902644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53c1ef74-21d3-449f-a2c1-d5499db05719 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:16.904407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53c1ef74-21d3-449f-a2c1-d5499db05719 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:16.904938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53c1ef74-21d3-449f-a2c1-d5499db05719 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:17.534367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-53c1ef74-21d3-449f-a2c1-d5499db05719 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:17.543192 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-53c1ef74-21d3-449f-a2c1-d5499db05719 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1321 microversion: 2.1 time: 0.672564 Aug 04 13:57:17.546213 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 537/1095] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:16 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1321 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:17.552630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5ed78c03-235d-4d50-9ae7-fa99881c1785 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:17.558633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5ed78c03-235d-4d50-9ae7-fa99881c1785 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:17.567326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ed78c03-235d-4d50-9ae7-fa99881c1785 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:17.571078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ed78c03-235d-4d50-9ae7-fa99881c1785 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:17.574010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ed78c03-235d-4d50-9ae7-fa99881c1785 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:17.576772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ed78c03-235d-4d50-9ae7-fa99881c1785 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:17.904081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5ed78c03-235d-4d50-9ae7-fa99881c1785 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:17.915722 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5ed78c03-235d-4d50-9ae7-fa99881c1785 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1319 microversion: 2.1 time: 0.367532 Aug 04 13:57:17.930410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 538/1096] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:17 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:17.937991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7eb169b4-12a1-418b-a1de-d9b44de8372d req-8514b4e2-d4d4-4666-bf8a-edc2916a40a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa08578-7e81-4056-8727-9015a7e5ad33", "name": "network-vif-unplugged", "status": "completed", "tag": "8c8ae616-b10d-4353-8410-e4d906727bd0"}, {"name": "network-changed", "server_uuid": "7aa08578-7e81-4056-8727-9015a7e5ad33", "tag": "8c8ae616-b10d-4353-8410-e4d906727bd0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:17.951667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7eb169b4-12a1-418b-a1de-d9b44de8372d req-8514b4e2-d4d4-4666-bf8a-edc2916a40a2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:17.952381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7eb169b4-12a1-418b-a1de-d9b44de8372d req-8514b4e2-d4d4-4666-bf8a-edc2916a40a2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:17.967776 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7eb169b4-12a1-418b-a1de-d9b44de8372d req-8514b4e2-d4d4-4666-bf8a-edc2916a40a2 service nova] Creating event network-vif-unplugged:8c8ae616-b10d-4353-8410-e4d906727bd0 for instance 7aa08578-7e81-4056-8727-9015a7e5ad33 on n-h1-844627-10 Aug 04 13:57:17.968590 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7eb169b4-12a1-418b-a1de-d9b44de8372d req-8514b4e2-d4d4-4666-bf8a-edc2916a40a2 service nova] Creating event network-changed:8c8ae616-b10d-4353-8410-e4d906727bd0 for instance 7aa08578-7e81-4056-8727-9015a7e5ad33 on n-h1-844627-10 Aug 04 13:57:17.975682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-7eb169b4-12a1-418b-a1de-d9b44de8372d req-8514b4e2-d4d4-4666-bf8a-edc2916a40a2 service nova] Instance 7aa08578-7e81-4056-8727-9015a7e5ad33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:57:17.990224 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7eb169b4-12a1-418b-a1de-d9b44de8372d req-8514b4e2-d4d4-4666-bf8a-edc2916a40a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.055744 Aug 04 13:57:17.992184 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 539/1097] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:18.001892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:18.003137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:18.010117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:18.011070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:18.012670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:18.013372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:18.237210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:18.248233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:18.249829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:18.250968 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0559b42b-c51c-414e-a0a6-bdf56992b68a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.255149 Aug 04 13:57:18.264421 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 540/1098] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:17 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:18.264421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-42be85cc-3994-4543-8f50-fc902012bfb1 req-2bca4dd6-54be-4ac7-ac05-f4c947f1e614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d449a828-d2f4-4361-b9e3-dd94ad315633", "tag": "5390537a-5a3f-41a7-b01a-6bccccf258ab"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:18.288538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-42be85cc-3994-4543-8f50-fc902012bfb1 req-2bca4dd6-54be-4ac7-ac05-f4c947f1e614 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:18.289927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-42be85cc-3994-4543-8f50-fc902012bfb1 req-2bca4dd6-54be-4ac7-ac05-f4c947f1e614 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:18.308371 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-42be85cc-3994-4543-8f50-fc902012bfb1 req-2bca4dd6-54be-4ac7-ac05-f4c947f1e614 service nova] Creating event network-changed:5390537a-5a3f-41a7-b01a-6bccccf258ab for instance d449a828-d2f4-4361-b9e3-dd94ad315633 on n-h2-844627-10 Aug 04 13:57:18.314266 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-42be85cc-3994-4543-8f50-fc902012bfb1 req-2bca4dd6-54be-4ac7-ac05-f4c947f1e614 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061531 Aug 04 13:57:18.314868 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 541/1099] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:18.321204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c83037e-2d3c-40ea-abd3-bbd58653e768 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:18.321772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c83037e-2d3c-40ea-abd3-bbd58653e768 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:18.330645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c83037e-2d3c-40ea-abd3-bbd58653e768 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:18.331638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c83037e-2d3c-40ea-abd3-bbd58653e768 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:18.332479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c83037e-2d3c-40ea-abd3-bbd58653e768 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:18.332965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c83037e-2d3c-40ea-abd3-bbd58653e768 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:18.477817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Building network info cache for instance {{(pid=130961) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 13:57:18.842899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c83037e-2d3c-40ea-abd3-bbd58653e768 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:18.872285 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c83037e-2d3c-40ea-abd3-bbd58653e768 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1541 microversion: 2.1 time: 0.553062 Aug 04 13:57:18.872965 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 542/1100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:18 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1541 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:18.895894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ec7772fe-b5d3-46e0-8337-2c78163a7770 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:18.896893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ec7772fe-b5d3-46e0-8337-2c78163a7770 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:18.908768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec7772fe-b5d3-46e0-8337-2c78163a7770 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:18.910876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec7772fe-b5d3-46e0-8337-2c78163a7770 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:18.914915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec7772fe-b5d3-46e0-8337-2c78163a7770 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:18.915589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec7772fe-b5d3-46e0-8337-2c78163a7770 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:19.091535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:19.125868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:19.542870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ec7772fe-b5d3-46e0-8337-2c78163a7770 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:19.546527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:19.571018 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ec7772fe-b5d3-46e0-8337-2c78163a7770 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1463 microversion: 2.1 time: 0.682220 Aug 04 13:57:19.581175 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 543/1101] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:18 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1463 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:19.597924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7cc4b02f-0ec6-443a-9373-fb2431bec208 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:19.599084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7cc4b02f-0ec6-443a-9373-fb2431bec208 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:19.614242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cc4b02f-0ec6-443a-9373-fb2431bec208 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:19.615096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cc4b02f-0ec6-443a-9373-fb2431bec208 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:19.616193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cc4b02f-0ec6-443a-9373-fb2431bec208 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:19.616851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cc4b02f-0ec6-443a-9373-fb2431bec208 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.347170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7cc4b02f-0ec6-443a-9373-fb2431bec208 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.359353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Updating instance_info_cache with network_info: [{"id": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07", "address": "fa:16:3e:03:06:8a", "network": {"id": "bd0c2de1-a833-4902-b343-80481e8458ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1801279138-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9e5afd8e587c41d8bc0f86c89a38fce2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap83bf7c82-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130961) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 13:57:20.360645 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7cc4b02f-0ec6-443a-9373-fb2431bec208 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1321 microversion: 2.1 time: 0.777951 Aug 04 13:57:20.377374 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 544/1102] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:19 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1321 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:20.382440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9558909-56e5-4fa1-9098-e1586c83dbfe tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:20.383667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f9558909-56e5-4fa1-9098-e1586c83dbfe tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:20.391962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9558909-56e5-4fa1-9098-e1586c83dbfe tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.392692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9558909-56e5-4fa1-9098-e1586c83dbfe tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.394140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9558909-56e5-4fa1-9098-e1586c83dbfe tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.394773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9558909-56e5-4fa1-9098-e1586c83dbfe tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.449376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f9558909-56e5-4fa1-9098-e1586c83dbfe tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:20.557947 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f9558909-56e5-4fa1-9098-e1586c83dbfe tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "DELETE /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 204 len: 0 microversion: 2.1 time: 0.179130 Aug 04 13:57:20.559249 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 545/1103] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:20 2022] DELETE /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:20.564950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-08ad1e30-8495-4245-8577-304a6e5c511f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:20.565658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-08ad1e30-8495-4245-8577-304a6e5c511f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:20.573425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-08ad1e30-8495-4245-8577-304a6e5c511f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.573873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-08ad1e30-8495-4245-8577-304a6e5c511f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.574651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-08ad1e30-8495-4245-8577-304a6e5c511f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.575090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-08ad1e30-8495-4245-8577-304a6e5c511f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.594813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Releasing lock "refresh_cache-33a80a01-edba-4355-8d27-8fac463e118a" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:57:20.595735 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9ccc4a15-06cd-4660-b5d4-2b27046ac8d8 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "POST /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a/action" status: 202 len: 0 microversion: 2.1 time: 4.466365 Aug 04 13:57:20.599895 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 559/1104] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:16 2022] POST /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a/action => generated 0 bytes in 4471 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 13:57:20.605837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:20.606681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:20.610097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:20.614885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.615329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.616177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.616626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.809910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-08ad1e30-8495-4245-8577-304a6e5c511f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.817679 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-08ad1e30-8495-4245-8577-304a6e5c511f tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1319 microversion: 2.1 time: 0.257081 Aug 04 13:57:20.818311 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 546/1105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:20 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:20.824174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2457d5c3-28d0-44ca-804d-33b15704bdb7 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:20.826668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2457d5c3-28d0-44ca-804d-33b15704bdb7 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:20.832607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2457d5c3-28d0-44ca-804d-33b15704bdb7 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.833083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2457d5c3-28d0-44ca-804d-33b15704bdb7 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.833850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2457d5c3-28d0-44ca-804d-33b15704bdb7 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.834277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2457d5c3-28d0-44ca-804d-33b15704bdb7 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.835555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.844453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.846190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:20.847291 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-221ddb01-6ad9-43c3-9d09-5e98f3d6787c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.246127 Aug 04 13:57:20.847845 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 560/1106] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:20 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:20.852407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51e00c52-e52d-45c5-8c3b-8c99fd3552ee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:20.853076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-51e00c52-e52d-45c5-8c3b-8c99fd3552ee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:20.859298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51e00c52-e52d-45c5-8c3b-8c99fd3552ee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.859755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51e00c52-e52d-45c5-8c3b-8c99fd3552ee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.860720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51e00c52-e52d-45c5-8c3b-8c99fd3552ee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.861204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51e00c52-e52d-45c5-8c3b-8c99fd3552ee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.913859 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2457d5c3-28d0-44ca-804d-33b15704bdb7 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action" status: 202 len: 0 microversion: 2.1 time: 0.094493 Aug 04 13:57:20.914502 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 547/1107] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:20 2022] POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:57:20.918989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d40632a3-7464-4724-befc-d7901067b611 req-f4822a8f-e746-41e0-9c95-1f152c1cde94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a80a01-edba-4355-8d27-8fac463e118a", "tag": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:20.928328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d40632a3-7464-4724-befc-d7901067b611 req-f4822a8f-e746-41e0-9c95-1f152c1cde94 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.928772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d40632a3-7464-4724-befc-d7901067b611 req-f4822a8f-e746-41e0-9c95-1f152c1cde94 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.940267 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d40632a3-7464-4724-befc-d7901067b611 req-f4822a8f-e746-41e0-9c95-1f152c1cde94 service nova] Creating event network-changed:83bf7c82-4313-4b52-9ea6-3efdcbf48b07 for instance 33a80a01-edba-4355-8d27-8fac463e118a on n-h2-844627-10 Aug 04 13:57:20.957379 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d40632a3-7464-4724-befc-d7901067b611 req-f4822a8f-e746-41e0-9c95-1f152c1cde94 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041073 Aug 04 13:57:20.958502 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 548/1108] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:20.964465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f1fe1902-5b4f-4c8f-9470-73a04195b3ec req-5f18b41e-f9ee-437c-8e3e-966ad58b78b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "660f79ef-723d-40db-9804-8774b6c26489", "tag": "b0f6482f-b8dc-442d-b5e4-ac76de5b19b1"}, {"server_uuid": "e4979b7c-1bc6-4922-9345-99e402757bbd", "name": "network-vif-deleted", "tag": "39459960-3571-47a9-bd3d-aa345456dc55"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:20.977961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f1fe1902-5b4f-4c8f-9470-73a04195b3ec req-5f18b41e-f9ee-437c-8e3e-966ad58b78b1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:20.978685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f1fe1902-5b4f-4c8f-9470-73a04195b3ec req-5f18b41e-f9ee-437c-8e3e-966ad58b78b1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:20.992770 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f1fe1902-5b4f-4c8f-9470-73a04195b3ec req-5f18b41e-f9ee-437c-8e3e-966ad58b78b1 service nova] Creating event network-changed:b0f6482f-b8dc-442d-b5e4-ac76de5b19b1 for instance 660f79ef-723d-40db-9804-8774b6c26489 on n-h2-844627-10 Aug 04 13:57:20.993305 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f1fe1902-5b4f-4c8f-9470-73a04195b3ec req-5f18b41e-f9ee-437c-8e3e-966ad58b78b1 service nova] Creating event network-vif-deleted:39459960-3571-47a9-bd3d-aa345456dc55 for instance e4979b7c-1bc6-4922-9345-99e402757bbd on n-h1-844627-10 Aug 04 13:57:21.002453 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f1fe1902-5b4f-4c8f-9470-73a04195b3ec req-5f18b41e-f9ee-437c-8e3e-966ad58b78b1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042373 Aug 04 13:57:21.003395 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 549/1109] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:21.008538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-4cf0892c-7716-4ff4-b087-c2a3d1ca3ec9 req-879e8e31-c04a-450a-ab08-1a12880b32bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca56d355-4e66-4634-99fb-9ed160b6bc4b", "name": "network-vif-plugged", "status": "completed", "tag": "05c9a902-25a1-4f84-9f03-64cea87afd6f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:21.018886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4cf0892c-7716-4ff4-b087-c2a3d1ca3ec9 req-879e8e31-c04a-450a-ab08-1a12880b32bf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.019330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4cf0892c-7716-4ff4-b087-c2a3d1ca3ec9 req-879e8e31-c04a-450a-ab08-1a12880b32bf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:21.030412 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-4cf0892c-7716-4ff4-b087-c2a3d1ca3ec9 req-879e8e31-c04a-450a-ab08-1a12880b32bf service nova] Creating event network-vif-plugged:05c9a902-25a1-4f84-9f03-64cea87afd6f for instance ca56d355-4e66-4634-99fb-9ed160b6bc4b on n-h1-844627-10 Aug 04 13:57:21.035596 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-4cf0892c-7716-4ff4-b087-c2a3d1ca3ec9 req-879e8e31-c04a-450a-ab08-1a12880b32bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030890 Aug 04 13:57:21.036214 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 550/1110] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:21.039421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-51e00c52-e52d-45c5-8c3b-8c99fd3552ee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:21.041547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc289f74-fd12-4332-8950-b44b1abb7f59 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:21.042252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc289f74-fd12-4332-8950-b44b1abb7f59 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:21.048095 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-51e00c52-e52d-45c5-8c3b-8c99fd3552ee tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1473 microversion: 2.1 time: 0.199168 Aug 04 13:57:21.048829 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 561/1111] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:20 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1473 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:21.048966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc289f74-fd12-4332-8950-b44b1abb7f59 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.049772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc289f74-fd12-4332-8950-b44b1abb7f59 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:21.050567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc289f74-fd12-4332-8950-b44b1abb7f59 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.051013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc289f74-fd12-4332-8950-b44b1abb7f59 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:21.053309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6faffbfd-f63e-4741-8f61-2a1e8bed6865 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '.version_select at 0x7f470011a040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:21.266961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc289f74-fd12-4332-8950-b44b1abb7f59 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:21.275677 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc289f74-fd12-4332-8950-b44b1abb7f59 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1684 microversion: 2.1 time: 0.237607 Aug 04 13:57:21.276273 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 551/1112] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:21 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1684 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:21.280641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:21.281538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:21.287571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.288296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:21.290573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.290923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:21.315090 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6faffbfd-f63e-4741-8f61-2a1e8bed6865 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/d4c233e6-df4d-4535-bc64-8971d1f7395f" status: 200 len: 183 microversion: 2.1 time: 0.265341 Aug 04 13:57:21.315674 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 562/1113] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 13:57:21 2022] GET /compute/v2.1/os-floating-ips/d4c233e6-df4d-4535-bc64-8971d1f7395f => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:21.325209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.325666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:21.326117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lazy-loading 'fault' on Instance uuid 9802281d-83eb-4b5d-8fe0-bc812e0872e4 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:21.328323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Action: 'action', calling method: .version_select at 0x7f47031b20d0>, body: {"removeFloatingIp": {"address": "172.25.2.22"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:21.502418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:21.510346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.511210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:21.512012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.512456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:21.519666 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-16dde783-e1ac-4766-9af2-c0a22bc84b92 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1599 microversion: 2.1 time: 0.242359 Aug 04 13:57:21.520410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 552/1114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:21 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1599 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:21.525117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a014b308-8773-47ae-9dde-5222f32e974e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:21.526354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a014b308-8773-47ae-9dde-5222f32e974e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:21.532611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a014b308-8773-47ae-9dde-5222f32e974e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.533355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a014b308-8773-47ae-9dde-5222f32e974e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:21.534189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a014b308-8773-47ae-9dde-5222f32e974e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:21.534552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a014b308-8773-47ae-9dde-5222f32e974e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:22.041582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a014b308-8773-47ae-9dde-5222f32e974e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:22.049379 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a014b308-8773-47ae-9dde-5222f32e974e tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1321 microversion: 2.1 time: 0.527694 Aug 04 13:57:22.049995 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 553/1115] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:21 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:22.054630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9588ed02-c00e-43d2-a54b-af1973916011 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:22.057660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9588ed02-c00e-43d2-a54b-af1973916011 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:22.067505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9588ed02-c00e-43d2-a54b-af1973916011 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:22.067960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9588ed02-c00e-43d2-a54b-af1973916011 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:22.069127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9588ed02-c00e-43d2-a54b-af1973916011 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:22.069253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9588ed02-c00e-43d2-a54b-af1973916011 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:22.092506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Acquired lock "refresh_cache-33a80a01-edba-4355-8d27-8fac463e118a" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:57:22.166793 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9588ed02-c00e-43d2-a54b-af1973916011 tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action" status: 202 len: 0 microversion: 2.1 time: 0.114825 Aug 04 13:57:22.168318 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 554/1116] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:22 2022] POST /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:57:22.173482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d621982a-52d8-413f-a7cb-e2f60ba29cf7 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:22.174123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d621982a-52d8-413f-a7cb-e2f60ba29cf7 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:22.180378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d621982a-52d8-413f-a7cb-e2f60ba29cf7 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:22.180835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d621982a-52d8-413f-a7cb-e2f60ba29cf7 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:22.181865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d621982a-52d8-413f-a7cb-e2f60ba29cf7 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:22.182591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d621982a-52d8-413f-a7cb-e2f60ba29cf7 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:22.246487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:22.268433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:22.620261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d621982a-52d8-413f-a7cb-e2f60ba29cf7 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:22.640942 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d621982a-52d8-413f-a7cb-e2f60ba29cf7 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1319 microversion: 2.1 time: 0.459666 Aug 04 13:57:22.640942 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 555/1117] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:22 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:22.640942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:22.640942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:22.642263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:22.642768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:22.643795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:22.644101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:23.063113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.075761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.078031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.079206 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b5d8dee5-e4f3-4699-97bd-0b58dc6ce7d3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.448419 Aug 04 13:57:23.079766 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 556/1118] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:22 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:23.084959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7579837-d92f-41e2-86c6-c39dbd268869 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:23.085859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7579837-d92f-41e2-86c6-c39dbd268869 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:23.093475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7579837-d92f-41e2-86c6-c39dbd268869 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:23.094155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7579837-d92f-41e2-86c6-c39dbd268869 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:23.095115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7579837-d92f-41e2-86c6-c39dbd268869 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:23.095712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7579837-d92f-41e2-86c6-c39dbd268869 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:23.114041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:23.361414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f7579837-d92f-41e2-86c6-c39dbd268869 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.371500 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7579837-d92f-41e2-86c6-c39dbd268869 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1473 microversion: 2.1 time: 0.290506 Aug 04 13:57:23.372338 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 557/1119] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:23 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1473 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:23.376908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3134fc24-51aa-457f-80cf-d5677a8abcea tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:23.377976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3134fc24-51aa-457f-80cf-d5677a8abcea tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:23.383952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3134fc24-51aa-457f-80cf-d5677a8abcea tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:23.384403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3134fc24-51aa-457f-80cf-d5677a8abcea tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:23.385924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3134fc24-51aa-457f-80cf-d5677a8abcea tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:23.386371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3134fc24-51aa-457f-80cf-d5677a8abcea tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:23.605569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Building network info cache for instance {{(pid=130961) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 13:57:23.651425 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3134fc24-51aa-457f-80cf-d5677a8abcea tempest-ServersAdminTestJSON-174275230 tempest-ServersAdminTestJSON-174275230-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1616 microversion: 2.1 time: 0.278167 Aug 04 13:57:23.652723 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 558/1120] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:23 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1616 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:23.657687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ecf65e98-6190-4bb3-830f-949ed26f03bf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:23.658302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ecf65e98-6190-4bb3-830f-949ed26f03bf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:23.667699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecf65e98-6190-4bb3-830f-949ed26f03bf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:23.667699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecf65e98-6190-4bb3-830f-949ed26f03bf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:23.669732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecf65e98-6190-4bb3-830f-949ed26f03bf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:23.669732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecf65e98-6190-4bb3-830f-949ed26f03bf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:23.844613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ecf65e98-6190-4bb3-830f-949ed26f03bf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5534a5c5eff41e998b2b92ca13bb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6adc52f7e03846d3a73ef1c6d2b040cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:23.858060 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ecf65e98-6190-4bb3-830f-949ed26f03bf tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 200 len: 1616 microversion: 2.1 time: 0.203464 Aug 04 13:57:23.859803 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 559/1121] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:23 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 1616 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:23.866868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c704280-82e1-43d4-85de-55b923f46ad1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:23.867571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8c704280-82e1-43d4-85de-55b923f46ad1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:23.875868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c704280-82e1-43d4-85de-55b923f46ad1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:23.876531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c704280-82e1-43d4-85de-55b923f46ad1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:23.877646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c704280-82e1-43d4-85de-55b923f46ad1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:23.878095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c704280-82e1-43d4-85de-55b923f46ad1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:24.427904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8c704280-82e1-43d4-85de-55b923f46ad1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:24.448892 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c704280-82e1-43d4-85de-55b923f46ad1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1321 microversion: 2.1 time: 0.585532 Aug 04 13:57:24.451198 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 560/1122] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:23 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:24.475215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-059aec63-51d7-4633-bc31-d2fa8d5b3a0b req-442f7d09-1b9b-4b3f-a94d-33622b5baef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a80a01-edba-4355-8d27-8fac463e118a", "tag": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:24.488954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-059aec63-51d7-4633-bc31-d2fa8d5b3a0b req-442f7d09-1b9b-4b3f-a94d-33622b5baef9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:24.489652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-059aec63-51d7-4633-bc31-d2fa8d5b3a0b req-442f7d09-1b9b-4b3f-a94d-33622b5baef9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:24.505517 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-059aec63-51d7-4633-bc31-d2fa8d5b3a0b req-442f7d09-1b9b-4b3f-a94d-33622b5baef9 service nova] Creating event network-changed:83bf7c82-4313-4b52-9ea6-3efdcbf48b07 for instance 33a80a01-edba-4355-8d27-8fac463e118a on n-h2-844627-10 Aug 04 13:57:24.516178 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-059aec63-51d7-4633-bc31-d2fa8d5b3a0b req-442f7d09-1b9b-4b3f-a94d-33622b5baef9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047039 Aug 04 13:57:24.517133 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 561/1123] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:24.523285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-adb83058-e16c-4a16-808c-15747d277d2d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:24.524086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-adb83058-e16c-4a16-808c-15747d277d2d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:24.531998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-adb83058-e16c-4a16-808c-15747d277d2d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:24.532600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-adb83058-e16c-4a16-808c-15747d277d2d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:24.533540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-adb83058-e16c-4a16-808c-15747d277d2d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:24.534008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-adb83058-e16c-4a16-808c-15747d277d2d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:24.855919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-adb83058-e16c-4a16-808c-15747d277d2d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:24.862923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Updating instance_info_cache with network_info: [{"id": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07", "address": "fa:16:3e:03:06:8a", "network": {"id": "bd0c2de1-a833-4902-b343-80481e8458ff", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1801279138-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9e5afd8e587c41d8bc0f86c89a38fce2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap83bf7c82-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130961) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 13:57:24.871554 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-adb83058-e16c-4a16-808c-15747d277d2d tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1319 microversion: 2.1 time: 0.353097 Aug 04 13:57:24.872414 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 562/1124] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:24 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:24.877986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Releasing lock "refresh_cache-33a80a01-edba-4355-8d27-8fac463e118a" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:57:24.879529 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2eb18eb4-b32b-46a0-ace1-d98aba5fe759 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "POST /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a/action" status: 202 len: 0 microversion: 2.1 time: 3.555279 Aug 04 13:57:24.880627 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 563/1125] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:21 2022] POST /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a/action => generated 0 bytes in 3557 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 04 13:57:24.894060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-90174015-faf7-4fd0-83d6-719eeb60c887 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:24.894388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cb693dd6-49d5-49fb-ab36-1f6d410333ee req-aafba9ea-b0a6-4285-8797-2bf2657a1af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e44dc8-8cc8-4787-aac7-7b82cd8679e4", "name": "network-vif-deleted", "tag": "7f0e237c-1431-4143-8b98-9539ef44bae6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:24.894578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-90174015-faf7-4fd0-83d6-719eeb60c887 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:24.903031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90174015-faf7-4fd0-83d6-719eeb60c887 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:24.903890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90174015-faf7-4fd0-83d6-719eeb60c887 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:24.905017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90174015-faf7-4fd0-83d6-719eeb60c887 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:24.905353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90174015-faf7-4fd0-83d6-719eeb60c887 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:24.916055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cb693dd6-49d5-49fb-ab36-1f6d410333ee req-aafba9ea-b0a6-4285-8797-2bf2657a1af1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:24.916724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cb693dd6-49d5-49fb-ab36-1f6d410333ee req-aafba9ea-b0a6-4285-8797-2bf2657a1af1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:24.937498 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cb693dd6-49d5-49fb-ab36-1f6d410333ee req-aafba9ea-b0a6-4285-8797-2bf2657a1af1 service nova] Creating event network-vif-deleted:7f0e237c-1431-4143-8b98-9539ef44bae6 for instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 on n-h2-844627-10 Aug 04 13:57:24.940630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-90174015-faf7-4fd0-83d6-719eeb60c887 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:24.950950 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cb693dd6-49d5-49fb-ab36-1f6d410333ee req-aafba9ea-b0a6-4285-8797-2bf2657a1af1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065619 Aug 04 13:57:24.951592 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 564/1126] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:24.966886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:24.967611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:24.975260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:24.975979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:24.977757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:24.978924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.058628 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-90174015-faf7-4fd0-83d6-719eeb60c887 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "DELETE /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 204 len: 0 microversion: 2.1 time: 0.169910 Aug 04 13:57:25.059730 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 563/1127] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:24 2022] DELETE /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:25.066352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a796b06a-a4cb-41f2-9264-29dbbd537eb0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.067039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a796b06a-a4cb-41f2-9264-29dbbd537eb0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:25.073426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:25.075652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-a4cb-41f2-9264-29dbbd537eb0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.076178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-a4cb-41f2-9264-29dbbd537eb0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.077227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-a4cb-41f2-9264-29dbbd537eb0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.077770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a796b06a-a4cb-41f2-9264-29dbbd537eb0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.717603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:25.721323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:25.726771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:25.730293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:25.736093 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa971f23-8777-4955-9bf1-8d285fb96c6f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.780840 Aug 04 13:57:25.736681 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 565/1128] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:24 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:25.737797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a796b06a-a4cb-41f2-9264-29dbbd537eb0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:25.747602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-341a7eec-f75a-41d6-8809-7a3844fcd78f req-4349f7a7-1218-4eed-ab68-15f357138397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d449a828-d2f4-4361-b9e3-dd94ad315633", "name": "network-vif-plugged", "status": "completed", "tag": "5390537a-5a3f-41a7-b01a-6bccccf258ab"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:25.748677 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a796b06a-a4cb-41f2-9264-29dbbd537eb0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1470 microversion: 2.1 time: 0.686961 Aug 04 13:57:25.760905 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 564/1129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:25 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1470 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:25.760905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.760905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] [instance: 63e44dc8-8cc8-4787-aac7-7b82cd8679e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:25.770002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.770755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.772145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.772905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.781246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-341a7eec-f75a-41d6-8809-7a3844fcd78f req-4349f7a7-1218-4eed-ab68-15f357138397 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.781723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-341a7eec-f75a-41d6-8809-7a3844fcd78f req-4349f7a7-1218-4eed-ab68-15f357138397 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.793179 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] HTTP exception thrown: Instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 could not be found. Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Request method failure captured: Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 HTTP/1.1 Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-VpB5WkKxxJaebx8Jdj0xoKR6oJ1GV0MwW29LvhkImVe-jMzKL9oDIsWOpFmWpKsA6m1MRbRs4m_SsSPVOSygWCJKib3BaP2pwcE9bCR4sdh2sjasWe48iXRvXWiLGw2DmCK8-vjeb_GY-tixbYvVBmYWyIXtb1XsD5nyCVXiJysI Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 6adc52f7e03846d3a73ef1c6d2b040cd Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-VolumesAdminNegativeTest-1877086382 Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:57:25.794977 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6adc52f7e03846d3a73ef1c6d2b040cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6adc52f7e03846d3a73ef1c6d2b040cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6adc52f7e03846d3a73ef1c6d2b040cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6adc52f7e03846d3a73ef1c6d2b040cd"}]}] Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-VolumesAdminNegativeTest-1877086382 Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 6adc52f7e03846d3a73ef1c6d2b040cd Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1877086382 Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-VolumesAdminNegativeTest-1877086382-project Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c5534a5c5eff41e998b2b92ca13bb372 Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-VolumesAdminNegativeTest-1877086382-project Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 could not be found. Aug 04 13:57:25.796564 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '63e44dc8-8cc8-4787-aac7-7b82cd8679e4'} Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 could not be found. Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:25.797515 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 could not be found. Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 could not be found. Aug 04 13:57:25.799008 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.801514 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-341a7eec-f75a-41d6-8809-7a3844fcd78f req-4349f7a7-1218-4eed-ab68-15f357138397 service nova] Creating event network-vif-plugged:5390537a-5a3f-41a7-b01a-6bccccf258ab for instance d449a828-d2f4-4361-b9e3-dd94ad315633 on n-h2-844627-10 Aug 04 13:57:25.802734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Returning 404 to user: Instance 63e44dc8-8cc8-4787-aac7-7b82cd8679e4 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:25.802945 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-341a7eec-f75a-41d6-8809-7a3844fcd78f req-4349f7a7-1218-4eed-ab68-15f357138397 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062474 Aug 04 13:57:25.804219 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 566/1130] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:25.805057 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b73c196f-6281-4cf9-84fa-4a753511c797 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4" status: 404 len: 111 microversion: 2.1 time: 0.053250 Aug 04 13:57:25.806268 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 565/1131] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:25 2022] GET /compute/v2.1/servers/63e44dc8-8cc8-4787-aac7-7b82cd8679e4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:25.809630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.810234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:25.816090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a8fc0f30-7119-4e40-be56-630044159fa9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.816717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a8fc0f30-7119-4e40-be56-630044159fa9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:25.826655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8fc0f30-7119-4e40-be56-630044159fa9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.827050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8fc0f30-7119-4e40-be56-630044159fa9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.830895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8fc0f30-7119-4e40-be56-630044159fa9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.832607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8fc0f30-7119-4e40-be56-630044159fa9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.836309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.836807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.838787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.838787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.858263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] HTTP exception thrown: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Request method failure captured: Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd HTTP/1.1 Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AHu7BXewIiMk-oNGfnyZ_m3-vUx8-5J7TAZz_37CjTAjdWcTSRyrKDttyBll8zZkHDg-yMSYOEHD_2ONOaIPZhgzVDV_jIGiI9Ua5tFP0TRlV5Xg4OqO6Xe4XB0gVC9kMUYi7sEydubxTk-iflYCn12RwLZxCGQ_AHsxcvsrzclTs Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9e5afd8e587c41d8bc0f86c89a38fce2 Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:25.859937 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5afd8e587c41d8bc0f86c89a38fce2"}]}] Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9e5afd8e587c41d8bc0f86c89a38fce2 Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FloatingIPsAssociationTestJSON-1931319612-project Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 314b6dcaf21b4fb197cbd03275229572 Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1931319612-project Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:25.861336 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e4979b7c-1bc6-4922-9345-99e402757bbd'} Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:25.862101 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:25.863763 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:25.865819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Returning 404 to user: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:25.865819 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7d554842-5d61-4493-8c23-a94aaab1b801 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 404 len: 111 microversion: 2.1 time: 0.056687 Aug 04 13:57:25.865819 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 567/1132] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:25 2022] DELETE /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:25.868265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5620f0bc-e35c-427f-85b5-2317302ab513 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:25.869030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5620f0bc-e35c-427f-85b5-2317302ab513 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:25.875910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5620f0bc-e35c-427f-85b5-2317302ab513 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.876526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5620f0bc-e35c-427f-85b5-2317302ab513 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:25.877622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5620f0bc-e35c-427f-85b5-2317302ab513 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:25.878320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5620f0bc-e35c-427f-85b5-2317302ab513 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.073257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a8fc0f30-7119-4e40-be56-630044159fa9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:26.076086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5620f0bc-e35c-427f-85b5-2317302ab513 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:26.082551 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a8fc0f30-7119-4e40-be56-630044159fa9 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1469 microversion: 2.1 time: 0.274945 Aug 04 13:57:26.083154 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 566/1133] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:25 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1469 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:26.088389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:26.088954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:26.094038 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5620f0bc-e35c-427f-85b5-2317302ab513 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1321 microversion: 2.1 time: 0.230367 Aug 04 13:57:26.095336 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 568/1134] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:25 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:26.100277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49c8f490-1227-4e57-9fac-a3678379e2d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] Calling method '.version_select at 0x7f4700123dc0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:26.107160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.108019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.109159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.109535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.127004 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49c8f490-1227-4e57-9fac-a3678379e2d0 tempest-VolumesAdminNegativeTest-1877086382 tempest-VolumesAdminNegativeTest-1877086382-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105900556" status: 202 len: 0 microversion: 2.1 time: 0.030308 Aug 04 13:57:26.127872 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 569/1135] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 13:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105900556 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:57:26.133014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:26.133937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: e4979b7c-1bc6-4922-9345-99e402757bbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:26.151257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.152337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.154031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.155239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.180369 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] HTTP exception thrown: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Request method failure captured: Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd HTTP/1.1 Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AHu7BXewIiMk-oNGfnyZ_m3-vUx8-5J7TAZz_37CjTAjdWcTSRyrKDttyBll8zZkHDg-yMSYOEHD_2ONOaIPZhgzVDV_jIGiI9Ua5tFP0TRlV5Xg4OqO6Xe4XB0gVC9kMUYi7sEydubxTk-iflYCn12RwLZxCGQ_AHsxcvsrzclTs Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9e5afd8e587c41d8bc0f86c89a38fce2 Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:26.182172 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5afd8e587c41d8bc0f86c89a38fce2"}]}] Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9e5afd8e587c41d8bc0f86c89a38fce2 Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FloatingIPsAssociationTestJSON-1931319612-project Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 314b6dcaf21b4fb197cbd03275229572 Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1931319612-project Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:26.183576 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e4979b7c-1bc6-4922-9345-99e402757bbd'} Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:26.184317 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. Aug 04 13:57:26.185578 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:26.186676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Returning 404 to user: Instance e4979b7c-1bc6-4922-9345-99e402757bbd could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:26.186676 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a9a8c49d-8312-4756-b085-8618a6a0bd56 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd" status: 404 len: 111 microversion: 2.1 time: 0.055504 Aug 04 13:57:26.186827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.186916 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 570/1136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:26 2022] GET /compute/v2.1/servers/e4979b7c-1bc6-4922-9345-99e402757bbd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:26.186991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.186991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.186991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.190801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8ba179a-3945-41c6-8ab5-3ec29449e225 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:26.191506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e8ba179a-3945-41c6-8ab5-3ec29449e225 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:26.200168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8ba179a-3945-41c6-8ab5-3ec29449e225 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.200785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8ba179a-3945-41c6-8ab5-3ec29449e225 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.201735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8ba179a-3945-41c6-8ab5-3ec29449e225 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.202249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8ba179a-3945-41c6-8ab5-3ec29449e225 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.242989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:57:26.249867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for user cca2bff6e81c4f54bad52f77e67faa55 and project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:57:26.382752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8ba179a-3945-41c6-8ab5-3ec29449e225 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:26.394783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e8ba179a-3945-41c6-8ab5-3ec29449e225 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1319 microversion: 2.1 time: 0.208865 Aug 04 13:57:26.396013 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 571/1137] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:26 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:26.401878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d50c59d-8fc6-4bf5-a99b-2af6032a0fad tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '.version_select at 0x7f4700123160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:26.455136 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-48e83f87-9340-49a0-8e42-1f8445d89302 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33/action" status: 202 len: 0 microversion: 2.1 time: 0.370684 Aug 04 13:57:26.459080 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 567/1138] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:26 2022] POST /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:57:26.464938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e3fbd922-8079-44c8-9cc1-c266dee3151e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:26.465676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e3fbd922-8079-44c8-9cc1-c266dee3151e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:26.474442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3fbd922-8079-44c8-9cc1-c266dee3151e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.474929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3fbd922-8079-44c8-9cc1-c266dee3151e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.475948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3fbd922-8079-44c8-9cc1-c266dee3151e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.476398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3fbd922-8079-44c8-9cc1-c266dee3151e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.700074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e3fbd922-8079-44c8-9cc1-c266dee3151e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:26.708843 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e3fbd922-8079-44c8-9cc1-c266dee3151e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1469 microversion: 2.1 time: 0.248269 Aug 04 13:57:26.709447 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 568/1139] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:26 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:26.761776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:26.762566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:26.769022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.769585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:26.770439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:26.771008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.053676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.062652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.064934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.066368 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-edfde23a-13eb-4f74-947d-5615234c3212 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.309967 Aug 04 13:57:27.067437 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 569/1140] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:26 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:27.105638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-310b739c-8f36-46f0-a409-fa88f7a846e8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:27.106372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-310b739c-8f36-46f0-a409-fa88f7a846e8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:27.114063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-310b739c-8f36-46f0-a409-fa88f7a846e8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.114661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-310b739c-8f36-46f0-a409-fa88f7a846e8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.115613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-310b739c-8f36-46f0-a409-fa88f7a846e8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.116239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-310b739c-8f36-46f0-a409-fa88f7a846e8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.336600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-310b739c-8f36-46f0-a409-fa88f7a846e8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.342106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:27.349058 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-310b739c-8f36-46f0-a409-fa88f7a846e8 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1469 microversion: 2.1 time: 0.248305 Aug 04 13:57:27.350248 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 570/1141] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:27 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:27.372025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-13b236e4-4821-4404-af8e-fe1bc4844e58 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:27.372641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-13b236e4-4821-4404-af8e-fe1bc4844e58 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:27.381919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13b236e4-4821-4404-af8e-fe1bc4844e58 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.382369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13b236e4-4821-4404-af8e-fe1bc4844e58 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.383144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13b236e4-4821-4404-af8e-fe1bc4844e58 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.383580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13b236e4-4821-4404-af8e-fe1bc4844e58 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.515399 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d50c59d-8fc6-4bf5-a99b-2af6032a0fad tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/d4c233e6-df4d-4535-bc64-8971d1f7395f" status: 202 len: 0 microversion: 2.1 time: 1.118163 Aug 04 13:57:27.516229 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 572/1142] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 13:57:26 2022] DELETE /compute/v2.1/os-floating-ips/d4c233e6-df4d-4535-bc64-8971d1f7395f => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:57:27.522740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0542aacb-0b86-4cea-bef3-98c9b3573cd9 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:27.523479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0542aacb-0b86-4cea-bef3-98c9b3573cd9 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:27.530518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0542aacb-0b86-4cea-bef3-98c9b3573cd9 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.531229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0542aacb-0b86-4cea-bef3-98c9b3573cd9 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.532327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0542aacb-0b86-4cea-bef3-98c9b3573cd9 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.532812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0542aacb-0b86-4cea-bef3-98c9b3573cd9 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.561829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-13b236e4-4821-4404-af8e-fe1bc4844e58 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.569438 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-13b236e4-4821-4404-af8e-fe1bc4844e58 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1471 microversion: 2.1 time: 0.201715 Aug 04 13:57:27.570354 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 571/1143] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:27 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1471 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:27.576465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33286584-d8f0-4710-b218-dc9907adaa64 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:27.576997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-33286584-d8f0-4710-b218-dc9907adaa64 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:27.583476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33286584-d8f0-4710-b218-dc9907adaa64 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.583933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33286584-d8f0-4710-b218-dc9907adaa64 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.584725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33286584-d8f0-4710-b218-dc9907adaa64 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.585192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33286584-d8f0-4710-b218-dc9907adaa64 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.615050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-33286584-d8f0-4710-b218-dc9907adaa64 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:27.720339 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-33286584-d8f0-4710-b218-dc9907adaa64 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 204 len: 0 microversion: 2.1 time: 0.148590 Aug 04 13:57:27.721158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0542aacb-0b86-4cea-bef3-98c9b3573cd9 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.724358 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 572/1144] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:27 2022] DELETE /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:27.732563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-56097971-8b52-4536-91bf-7e2314847417 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:27.732833 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0542aacb-0b86-4cea-bef3-98c9b3573cd9 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1319 microversion: 2.1 time: 0.215212 Aug 04 13:57:27.734180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-56097971-8b52-4536-91bf-7e2314847417 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:27.735978 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 573/1145] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:27 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:27.740934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-748e5b5e-40d2-4604-8ba0-2323e60f69a5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:27.741794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-748e5b5e-40d2-4604-8ba0-2323e60f69a5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:27.749570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-748e5b5e-40d2-4604-8ba0-2323e60f69a5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.750251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-748e5b5e-40d2-4604-8ba0-2323e60f69a5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.751260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-748e5b5e-40d2-4604-8ba0-2323e60f69a5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.754476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-748e5b5e-40d2-4604-8ba0-2323e60f69a5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.757606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56097971-8b52-4536-91bf-7e2314847417 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.758449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56097971-8b52-4536-91bf-7e2314847417 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.760259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56097971-8b52-4536-91bf-7e2314847417 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.760753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56097971-8b52-4536-91bf-7e2314847417 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.791197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-56097971-8b52-4536-91bf-7e2314847417 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lazy-loading 'flavor' on Instance uuid d449a828-d2f4-4361-b9e3-dd94ad315633 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:27.877697 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-56097971-8b52-4536-91bf-7e2314847417 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633/action" status: 202 len: 0 microversion: 2.1 time: 0.151400 Aug 04 13:57:27.878810 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 573/1146] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:27 2022] POST /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:57:27.885137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-911efb46-3c32-43de-b8da-8be69cbba20d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:27.886084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-911efb46-3c32-43de-b8da-8be69cbba20d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:27.893150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-911efb46-3c32-43de-b8da-8be69cbba20d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.893777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-911efb46-3c32-43de-b8da-8be69cbba20d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.894739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-911efb46-3c32-43de-b8da-8be69cbba20d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:27.895475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-911efb46-3c32-43de-b8da-8be69cbba20d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:27.987820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-748e5b5e-40d2-4604-8ba0-2323e60f69a5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:27.997245 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-748e5b5e-40d2-4604-8ba0-2323e60f69a5 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1526 microversion: 2.1 time: 0.260157 Aug 04 13:57:27.997948 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 574/1147] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:27 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1526 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:28.003135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-49cd158a-e660-4c00-87c2-4802baa491e7 req-66525786-42c7-4dc9-af73-93ec81b3d6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660f79ef-723d-40db-9804-8774b6c26489", "name": "network-vif-plugged", "status": "completed", "tag": "b0f6482f-b8dc-442d-b5e4-ac76de5b19b1"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:28.013658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-49cd158a-e660-4c00-87c2-4802baa491e7 req-66525786-42c7-4dc9-af73-93ec81b3d6d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:28.014209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-49cd158a-e660-4c00-87c2-4802baa491e7 req-66525786-42c7-4dc9-af73-93ec81b3d6d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:28.027252 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-49cd158a-e660-4c00-87c2-4802baa491e7 req-66525786-42c7-4dc9-af73-93ec81b3d6d1 service nova] Creating event network-vif-plugged:b0f6482f-b8dc-442d-b5e4-ac76de5b19b1 for instance 660f79ef-723d-40db-9804-8774b6c26489 on n-h2-844627-10 Aug 04 13:57:28.032582 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-49cd158a-e660-4c00-87c2-4802baa491e7 req-66525786-42c7-4dc9-af73-93ec81b3d6d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033341 Aug 04 13:57:28.033411 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 575/1148] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:28.038226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84987372-0ddf-4d3d-a54e-83babf7fb0e9 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:28.038946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84987372-0ddf-4d3d-a54e-83babf7fb0e9 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:28.046311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84987372-0ddf-4d3d-a54e-83babf7fb0e9 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:28.046983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84987372-0ddf-4d3d-a54e-83babf7fb0e9 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:28.048149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84987372-0ddf-4d3d-a54e-83babf7fb0e9 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:28.048828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84987372-0ddf-4d3d-a54e-83babf7fb0e9 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:28.061023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-911efb46-3c32-43de-b8da-8be69cbba20d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.074515 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-911efb46-3c32-43de-b8da-8be69cbba20d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1469 microversion: 2.1 time: 0.193937 Aug 04 13:57:28.089141 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 574/1149] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:27 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1469 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:28.114611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:28.117328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:28.135061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:28.135619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:28.136586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:28.137122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:28.414305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.425120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.432252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.433382 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-878d3837-f700-43f6-aaef-734d3abb18c7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1410 microversion: 2.25 time: 0.347387 Aug 04 13:57:28.452395 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 575/1150] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:28 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1410 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:28.452395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d78e367f-f317-4b84-ad26-e3948b6ef016 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:28.452395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d78e367f-f317-4b84-ad26-e3948b6ef016 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:28.469881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d78e367f-f317-4b84-ad26-e3948b6ef016 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:28.470341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d78e367f-f317-4b84-ad26-e3948b6ef016 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:28.471198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d78e367f-f317-4b84-ad26-e3948b6ef016 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:28.471573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d78e367f-f317-4b84-ad26-e3948b6ef016 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:28.713469 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84987372-0ddf-4d3d-a54e-83babf7fb0e9 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1632 microversion: 2.1 time: 0.678963 Aug 04 13:57:28.718663 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 576/1151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:28 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1632 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:28.729789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d78e367f-f317-4b84-ad26-e3948b6ef016 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.731080 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d78e367f-f317-4b84-ad26-e3948b6ef016 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1469 microversion: 2.1 time: 0.289923 Aug 04 13:57:28.731674 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 576/1152] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:28 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:28.759818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-69991b4e-d6be-45af-814c-801403de6c16 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:28.760438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-69991b4e-d6be-45af-814c-801403de6c16 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:28.766475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69991b4e-d6be-45af-814c-801403de6c16 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:28.766928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69991b4e-d6be-45af-814c-801403de6c16 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:28.767704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69991b4e-d6be-45af-814c-801403de6c16 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:28.768147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69991b4e-d6be-45af-814c-801403de6c16 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:28.920443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-69991b4e-d6be-45af-814c-801403de6c16 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:28.928235 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-69991b4e-d6be-45af-814c-801403de6c16 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1319 microversion: 2.1 time: 0.172511 Aug 04 13:57:28.928804 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 577/1153] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:28 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:29.018226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-210084bf-4ce2-4787-b6d1-2e89f7a1787e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:29.018843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-210084bf-4ce2-4787-b6d1-2e89f7a1787e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:29.025421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-210084bf-4ce2-4787-b6d1-2e89f7a1787e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.025872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-210084bf-4ce2-4787-b6d1-2e89f7a1787e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:29.026658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-210084bf-4ce2-4787-b6d1-2e89f7a1787e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.027102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-210084bf-4ce2-4787-b6d1-2e89f7a1787e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:29.096649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a2646c23-0fb7-49b2-9e25-ffeed5b0cb9c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:29.097471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a2646c23-0fb7-49b2-9e25-ffeed5b0cb9c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:29.104794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2646c23-0fb7-49b2-9e25-ffeed5b0cb9c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.105464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2646c23-0fb7-49b2-9e25-ffeed5b0cb9c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:29.106685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2646c23-0fb7-49b2-9e25-ffeed5b0cb9c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.107297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2646c23-0fb7-49b2-9e25-ffeed5b0cb9c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:29.234419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-210084bf-4ce2-4787-b6d1-2e89f7a1787e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:29.253712 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-210084bf-4ce2-4787-b6d1-2e89f7a1787e tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1526 microversion: 2.1 time: 0.228018 Aug 04 13:57:29.273618 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 577/1154] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:29 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:29.325989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a2646c23-0fb7-49b2-9e25-ffeed5b0cb9c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:29.334586 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a2646c23-0fb7-49b2-9e25-ffeed5b0cb9c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1469 microversion: 2.1 time: 0.242616 Aug 04 13:57:29.335727 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 578/1155] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:29 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:29.460035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:29.460244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:29.468612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.469573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:29.472524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.473323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:29.713252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:29.726760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:29.729917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:29.731841 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-db190b8a-4ea2-41f1-bf91-2d4737636f86 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1606 microversion: 2.25 time: 0.276072 Aug 04 13:57:29.733164 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 578/1156] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:57:29 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1606 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:29.741259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-424a717f-c89c-4945-b25c-938d504d5d44 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:29.742461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-424a717f-c89c-4945-b25c-938d504d5d44 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:29.753322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-424a717f-c89c-4945-b25c-938d504d5d44 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.754028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-424a717f-c89c-4945-b25c-938d504d5d44 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:29.755360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-424a717f-c89c-4945-b25c-938d504d5d44 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.756034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-424a717f-c89c-4945-b25c-938d504d5d44 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:29.772463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-438cfd03-ecc0-4220-823f-aedc0fcaf827 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:29.776118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-438cfd03-ecc0-4220-823f-aedc0fcaf827 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:29.787851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-438cfd03-ecc0-4220-823f-aedc0fcaf827 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.790156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-438cfd03-ecc0-4220-823f-aedc0fcaf827 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:29.791891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-438cfd03-ecc0-4220-823f-aedc0fcaf827 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:29.794219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-438cfd03-ecc0-4220-823f-aedc0fcaf827 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.192912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-438cfd03-ecc0-4220-823f-aedc0fcaf827 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:30.195008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-424a717f-c89c-4945-b25c-938d504d5d44 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1615 microversion: 2.1 time: 0.458718 Aug 04 13:57:30.195704 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 579/1157] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:29 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1615 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:30.201211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f3d957c-6179-4076-b7df-eeb3f931fab7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:30.202541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9f3d957c-6179-4076-b7df-eeb3f931fab7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:30.205394 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-438cfd03-ecc0-4220-823f-aedc0fcaf827 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1469 microversion: 2.1 time: 0.447258 Aug 04 13:57:30.210629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f3d957c-6179-4076-b7df-eeb3f931fab7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.211178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f3d957c-6179-4076-b7df-eeb3f931fab7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.212154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f3d957c-6179-4076-b7df-eeb3f931fab7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.213185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f3d957c-6179-4076-b7df-eeb3f931fab7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.219703 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 579/1158] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:29 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1469 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:30.226914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2c10cd6-c0cc-4fb4-b170-037a5f293046 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:30.227636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d2c10cd6-c0cc-4fb4-b170-037a5f293046 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:30.235600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2c10cd6-c0cc-4fb4-b170-037a5f293046 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.236287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2c10cd6-c0cc-4fb4-b170-037a5f293046 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.237086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2c10cd6-c0cc-4fb4-b170-037a5f293046 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.237591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2c10cd6-c0cc-4fb4-b170-037a5f293046 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.456993 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9f3d957c-6179-4076-b7df-eeb3f931fab7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.259971 Aug 04 13:57:30.457893 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 580/1159] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 13:57:30 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-interface => generated 285 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:57:30.463582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-1c1d4c7d-f3d6-4c7d-842e-fae9a9b727c8 req-eaea2fd8-649d-45e5-94bf-dced47c4d597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa08578-7e81-4056-8727-9015a7e5ad33", "name": "network-vif-plugged", "status": "completed", "tag": "8c8ae616-b10d-4353-8410-e4d906727bd0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:30.490336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1c1d4c7d-f3d6-4c7d-842e-fae9a9b727c8 req-eaea2fd8-649d-45e5-94bf-dced47c4d597 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.493005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1c1d4c7d-f3d6-4c7d-842e-fae9a9b727c8 req-eaea2fd8-649d-45e5-94bf-dced47c4d597 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.538903 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-1c1d4c7d-f3d6-4c7d-842e-fae9a9b727c8 req-eaea2fd8-649d-45e5-94bf-dced47c4d597 service nova] Creating event network-vif-plugged:8c8ae616-b10d-4353-8410-e4d906727bd0 for instance 7aa08578-7e81-4056-8727-9015a7e5ad33 on n-h1-844627-10 Aug 04 13:57:30.569980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-1c1d4c7d-f3d6-4c7d-842e-fae9a9b727c8 req-eaea2fd8-649d-45e5-94bf-dced47c4d597 service nova] Instance 7aa08578-7e81-4056-8727-9015a7e5ad33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:57:30.616403 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-1c1d4c7d-f3d6-4c7d-842e-fae9a9b727c8 req-eaea2fd8-649d-45e5-94bf-dced47c4d597 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156878 Aug 04 13:57:30.622851 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 581/1160] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:30.642576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-9c622cd1-46e2-408c-90f4-0290e1802fc7 req-8f7a471f-e423-41c6-b2b5-a8cee45385ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a80a01-edba-4355-8d27-8fac463e118a", "name": "network-vif-deleted", "tag": "83bf7c82-4313-4b52-9ea6-3efdcbf48b07"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:30.670913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9c622cd1-46e2-408c-90f4-0290e1802fc7 req-8f7a471f-e423-41c6-b2b5-a8cee45385ef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.671473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9c622cd1-46e2-408c-90f4-0290e1802fc7 req-8f7a471f-e423-41c6-b2b5-a8cee45385ef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.710513 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-9c622cd1-46e2-408c-90f4-0290e1802fc7 req-8f7a471f-e423-41c6-b2b5-a8cee45385ef service nova] Creating event network-vif-deleted:83bf7c82-4313-4b52-9ea6-3efdcbf48b07 for instance 33a80a01-edba-4355-8d27-8fac463e118a on n-h2-844627-10 Aug 04 13:57:30.727322 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-9c622cd1-46e2-408c-90f4-0290e1802fc7 req-8f7a471f-e423-41c6-b2b5-a8cee45385ef service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097457 Aug 04 13:57:30.732837 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 582/1161] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:30.754247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:30.765855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d2c10cd6-c0cc-4fb4-b170-037a5f293046 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:30.777307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2c10cd6-c0cc-4fb4-b170-037a5f293046 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1319 microversion: 2.1 time: 0.555780 Aug 04 13:57:30.777634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:30.782154 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 580/1162] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:30 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:30.790350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.794935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.796937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.798260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.808440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:30.809099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:30.832603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.833068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.836842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.839968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.920857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:30.924131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:30.925493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lazy-loading 'fault' on Instance uuid 33a80a01-edba-4355-8d27-8fac463e118a {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:31.007917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b6dcaf21b4fb197cbd03275229572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5afd8e587c41d8bc0f86c89a38fce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.027771 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] HTTP exception thrown: Cannot 'migrate' instance d449a828-d2f4-4361-b9e3-dd94ad315633 while it is in vm_state suspended Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Request method failure captured: Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633/action HTTP/1.1 Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 15 Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AfFmr9Gdsxu-ahMEBk14ZQJGDhdWt1bImWs6nFydgaVI26PQMU5K6HsIJ7psYSpBBfFhKocpcTnk-CoLjEkMDEg5cI_U9qK4vYGbrcSHTrfUV9HyvYv2qYxMG5M8Vt44kyJpLKcUAgpH8G0a_mDK-RXTljvoZXwED7KWtG-8CCTpo Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:57:31.029897 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_60ddcd2f64b8498db210e492397196ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}] Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: bf7a933194374cfd89c60a99b3b9acc5 Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: {"migrate": {}} Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:31.031838 n-d-844627-10 devstack@n-api.service[130961]: exception: Cannot 'migrate' instance d449a828-d2f4-4361-b9e3-dd94ad315633 while it is in vm_state suspended Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd449a828-d2f4-4361-b9e3-dd94ad315633', 'body': {'migrate': {}}} Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d449a828-d2f4-4361-b9e3-dd94ad315633 in vm_state suspended. Cannot resize while the instance is in this state. Aug 04 13:57:31.032903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance d449a828-d2f4-4361-b9e3-dd94ad315633 while it is in vm_state suspended Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.034259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.037051 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:31.037051 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:31.037051 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:31.037051 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:31.037051 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance d449a828-d2f4-4361-b9e3-dd94ad315633 while it is in vm_state suspended Aug 04 13:57:31.037051 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.037593 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18c7896b-54b0-4462-b30f-ba3844eb0b77 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 200 len: 1314 microversion: 2.1 time: 0.245034 Aug 04 13:57:31.037593 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 581/1163] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:30 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:31.041894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Returning 409 to user: Cannot 'migrate' instance d449a828-d2f4-4361-b9e3-dd94ad315633 while it is in vm_state suspended {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:31.043229 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4dc26eba-2d5e-4363-852c-eff7806722b0 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633/action" status: 409 len: 148 microversion: 2.1 time: 0.305230 Aug 04 13:57:31.044025 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 583/1164] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:30 2022] POST /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633/action => generated 148 bytes in 307 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:57:31.045683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3003d146-59df-42eb-b9c8-18c4a65d9be6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:31.051662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-673b40f1-3850-421d-848f-52ed593e9675 req-3381e5d0-bc8b-4449-8365-b3903246cc94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74769383-c385-4b29-b45c-820aff3e1a77", "name": "network-vif-deleted", "tag": "3936056c-899a-4fed-ae2a-e09fe32d211d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:31.053125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3003d146-59df-42eb-b9c8-18c4a65d9be6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:31.072554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-673b40f1-3850-421d-848f-52ed593e9675 req-3381e5d0-bc8b-4449-8365-b3903246cc94 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.073497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-673b40f1-3850-421d-848f-52ed593e9675 req-3381e5d0-bc8b-4449-8365-b3903246cc94 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.090622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3003d146-59df-42eb-b9c8-18c4a65d9be6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.091355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3003d146-59df-42eb-b9c8-18c4a65d9be6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.093065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3003d146-59df-42eb-b9c8-18c4a65d9be6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.096399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3003d146-59df-42eb-b9c8-18c4a65d9be6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.112571 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-673b40f1-3850-421d-848f-52ed593e9675 req-3381e5d0-bc8b-4449-8365-b3903246cc94 service nova] Creating event network-vif-deleted:3936056c-899a-4fed-ae2a-e09fe32d211d for instance 74769383-c385-4b29-b45c-820aff3e1a77 on n-h1-844627-10 Aug 04 13:57:31.130802 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-673b40f1-3850-421d-848f-52ed593e9675 req-3381e5d0-bc8b-4449-8365-b3903246cc94 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085015 Aug 04 13:57:31.135328 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 584/1165] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:31.157861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41c94d02-5969-4e18-893b-a213fedf74fb tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41c94d02-5969-4e18-893b-a213fedf74fb tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Request method failure captured: Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a/action HTTP/1.1 Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 39 Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AfFmr9Gdsxu-ahMEBk14ZQJGDhdWt1bImWs6nFydgaVI26PQMU5K6HsIJ7psYSpBBfFhKocpcTnk-CoLjEkMDEg5cI_U9qK4vYGbrcSHTrfUV9HyvYv2qYxMG5M8Vt44kyJpLKcUAgpH8G0a_mDK-RXTljvoZXwED7KWtG-8CCTpo Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:57:31.163487 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_60ddcd2f64b8498db210e492397196ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}] Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: bf7a933194374cfd89c60a99b3b9acc5 Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: {"os-resetState": {"state": "invalid"}} Aug 04 13:57:31.164848 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'a92c1d62-28c6-48f7-8048-1795d50d224a', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:31.165685 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:57:31.167024 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 13:57:31.168189 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.172708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41c94d02-5969-4e18-893b-a213fedf74fb tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:31.173935 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-41c94d02-5969-4e18-893b-a213fedf74fb tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a/action" status: 400 len: 144 microversion: 2.1 time: 0.037334 Aug 04 13:57:31.175298 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 585/1166] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:31 2022] POST /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a/action => generated 144 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:57:31.189464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e7156d2-73bd-4d50-a597-d5176db44402 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e7156d2-73bd-4d50-a597-d5176db44402 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Request method failure captured: Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a/action HTTP/1.1 Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 31 Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AfFmr9Gdsxu-ahMEBk14ZQJGDhdWt1bImWs6nFydgaVI26PQMU5K6HsIJ7psYSpBBfFhKocpcTnk-CoLjEkMDEg5cI_U9qK4vYGbrcSHTrfUV9HyvYv2qYxMG5M8Vt44kyJpLKcUAgpH8G0a_mDK-RXTljvoZXwED7KWtG-8CCTpo Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:57:31.193987 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_60ddcd2f64b8498db210e492397196ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}] Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: bf7a933194374cfd89c60a99b3b9acc5 Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: {"os-resetState": {"state": 1}} Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:31.195510 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'a92c1d62-28c6-48f7-8048-1795d50d224a', 'body': {'os-resetState': {'state': 1}}} Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 1 Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:31.196284 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 13:57:31.198290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.205767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e7156d2-73bd-4d50-a597-d5176db44402 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:31.206972 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e7156d2-73bd-4d50-a597-d5176db44402 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a/action" status: 400 len: 120 microversion: 2.1 time: 0.021631 Aug 04 13:57:31.208066 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 586/1167] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:31 2022] POST /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a/action => generated 120 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:57:31.225138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ccee04c4-a012-4b5a-aa75-3fccb65aa3f8 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:31.227983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ccee04c4-a012-4b5a-aa75-3fccb65aa3f8 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Failed to fetch instance by id 999 {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 13:57:31.228730 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-ccee04c4-a012-4b5a-aa75-3fccb65aa3f8 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ccee04c4-a012-4b5a-aa75-3fccb65aa3f8 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Request method failure captured: Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 37 Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AfFmr9Gdsxu-ahMEBk14ZQJGDhdWt1bImWs6nFydgaVI26PQMU5K6HsIJ7psYSpBBfFhKocpcTnk-CoLjEkMDEg5cI_U9qK4vYGbrcSHTrfUV9HyvYv2qYxMG5M8Vt44kyJpLKcUAgpH8G0a_mDK-RXTljvoZXwED7KWtG-8CCTpo Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:57:31.241341 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_60ddcd2f64b8498db210e492397196ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/60ddcd2f64b8498db210e492397196ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/60ddcd2f64b8498db210e492397196ed"}]}] Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 60ddcd2f64b8498db210e492397196ed Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1680322606 Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: bf7a933194374cfd89c60a99b3b9acc5 Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1680322606-project-admin Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: {"os-resetState": {"state": "error"}} Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:31.242897 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 999 could not be found. Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:57:31.243898 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 04 13:57:31.245635 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:31.248248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ccee04c4-a012-4b5a-aa75-3fccb65aa3f8 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:31.249466 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ccee04c4-a012-4b5a-aa75-3fccb65aa3f8 tempest-ServersAdminNegativeTestJSON-1680322606 tempest-ServersAdminNegativeTestJSON-1680322606-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.029246 Aug 04 13:57:31.250581 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 587/1168] 10.222.0.66 () {60 vars in 1179 bytes} [Thu Aug 4 13:57:31 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:57:31.255886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:31.256637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:31.266297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.267015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.268995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.270170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.331979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.332614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.333208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lazy-loading 'fault' on Instance uuid 74769383-c385-4b29-b45c-820aff3e1a77 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:31.390473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.402505 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f2548ac-7927-4351-ae80-9dd69b5583ab tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 200 len: 1303 microversion: 2.1 time: 0.150151 Aug 04 13:57:31.419998 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 588/1169] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:31 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:31.419998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-92c94b18-5304-4558-a1d9-0266047c29b6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:31.419998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-92c94b18-5304-4558-a1d9-0266047c29b6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:31.430262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92c94b18-5304-4558-a1d9-0266047c29b6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.430726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92c94b18-5304-4558-a1d9-0266047c29b6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.436723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92c94b18-5304-4558-a1d9-0266047c29b6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.437840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92c94b18-5304-4558-a1d9-0266047c29b6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.480778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-92c94b18-5304-4558-a1d9-0266047c29b6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:31.583082 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-92c94b18-5304-4558-a1d9-0266047c29b6 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 204 len: 0 microversion: 2.1 time: 0.174494 Aug 04 13:57:31.584296 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 589/1170] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:31 2022] DELETE /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:31.597962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7650e6c8-4019-4879-aac1-d3d46c1d4cf1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:31.599103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7650e6c8-4019-4879-aac1-d3d46c1d4cf1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:31.616850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7650e6c8-4019-4879-aac1-d3d46c1d4cf1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.619502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7650e6c8-4019-4879-aac1-d3d46c1d4cf1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.621399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7650e6c8-4019-4879-aac1-d3d46c1d4cf1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.622120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7650e6c8-4019-4879-aac1-d3d46c1d4cf1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.672292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:31.690047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3003d146-59df-42eb-b9c8-18c4a65d9be6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.714718 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3003d146-59df-42eb-b9c8-18c4a65d9be6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1469 microversion: 2.1 time: 0.679731 Aug 04 13:57:31.717147 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 582/1171] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:31 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1469 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:31.807531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e23b50ab-9407-4919-9882-6d494d18f6bd tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:31.808155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e23b50ab-9407-4919-9882-6d494d18f6bd tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:31.825522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e23b50ab-9407-4919-9882-6d494d18f6bd tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.826386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e23b50ab-9407-4919-9882-6d494d18f6bd tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.827535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e23b50ab-9407-4919-9882-6d494d18f6bd tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:31.828121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e23b50ab-9407-4919-9882-6d494d18f6bd tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:31.878837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7650e6c8-4019-4879-aac1-d3d46c1d4cf1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:31.903591 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7650e6c8-4019-4879-aac1-d3d46c1d4cf1 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1468 microversion: 2.1 time: 0.299339 Aug 04 13:57:31.903591 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 590/1172] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:31 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1468 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:32.038355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e23b50ab-9407-4919-9882-6d494d18f6bd tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:32.041446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:32.051282 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e23b50ab-9407-4919-9882-6d494d18f6bd tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1468 microversion: 2.1 time: 0.247114 Aug 04 13:57:32.051889 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 583/1173] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:31 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:32.063582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.064372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] [instance: 33a80a01-edba-4355-8d27-8fac463e118a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:32.074351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1ef17374-6b1f-4965-97a5-3190ce83737b tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:32.077107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.077782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1ef17374-6b1f-4965-97a5-3190ce83737b tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:32.078159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.079184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.079855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.094896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ef17374-6b1f-4965-97a5-3190ce83737b tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.095743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ef17374-6b1f-4965-97a5-3190ce83737b tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.097606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ef17374-6b1f-4965-97a5-3190ce83737b tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.098226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ef17374-6b1f-4965-97a5-3190ce83737b tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.107007 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] HTTP exception thrown: Instance 33a80a01-edba-4355-8d27-8fac463e118a could not be found. Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Request method failure captured: Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a HTTP/1.1 Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AHu7BXewIiMk-oNGfnyZ_m3-vUx8-5J7TAZz_37CjTAjdWcTSRyrKDttyBll8zZkHDg-yMSYOEHD_2ONOaIPZhgzVDV_jIGiI9Ua5tFP0TRlV5Xg4OqO6Xe4XB0gVC9kMUYi7sEydubxTk-iflYCn12RwLZxCGQ_AHsxcvsrzclTs Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9e5afd8e587c41d8bc0f86c89a38fce2 Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:32.109014 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e5afd8e587c41d8bc0f86c89a38fce2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e5afd8e587c41d8bc0f86c89a38fce2"}]}] Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9e5afd8e587c41d8bc0f86c89a38fce2 Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1931319612 Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FloatingIPsAssociationTestJSON-1931319612-project Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 314b6dcaf21b4fb197cbd03275229572 Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1931319612-project Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 33a80a01-edba-4355-8d27-8fac463e118a could not be found. Aug 04 13:57:32.110889 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '33a80a01-edba-4355-8d27-8fac463e118a'} Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a80a01-edba-4355-8d27-8fac463e118a could not be found. Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:32.111781 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a80a01-edba-4355-8d27-8fac463e118a could not be found. Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a80a01-edba-4355-8d27-8fac463e118a could not be found. Aug 04 13:57:32.113225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.114729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] Returning 404 to user: Instance 33a80a01-edba-4355-8d27-8fac463e118a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:32.117064 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f917eef-b202-4990-a35a-dd5e13d31351 tempest-FloatingIPsAssociationTestJSON-1931319612 tempest-FloatingIPsAssociationTestJSON-1931319612-project] 10.222.0.66 "GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a" status: 404 len: 111 microversion: 2.1 time: 0.055808 Aug 04 13:57:32.118242 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 591/1174] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:32 2022] GET /compute/v2.1/servers/33a80a01-edba-4355-8d27-8fac463e118a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:32.263524 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1ef17374-6b1f-4965-97a5-3190ce83737b tempest-DeleteServersAdminTestJSON-780121876 tempest-DeleteServersAdminTestJSON-780121876-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489/action" status: 202 len: 0 microversion: 2.1 time: 0.193230 Aug 04 13:57:32.269337 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 584/1175] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:57:32 2022] POST /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 13:57:32.273839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.274790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:32.283313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.284140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.285214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.285895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.326672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.328158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.328899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lazy-loading 'fault' on Instance uuid 660f79ef-723d-40db-9804-8774b6c26489 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:32.430730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.432174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 74769383-c385-4b29-b45c-820aff3e1a77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:32.439068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.439802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.440850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.441493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.457548 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] HTTP exception thrown: Instance 74769383-c385-4b29-b45c-820aff3e1a77 could not be found. Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Request method failure captured: Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 HTTP/1.1 Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-gVGPC9MfDtGVsqGq3Y08R9MrCmuQcZ7XEDJh0tMv5aQP8FB_6SkbMhsEqNnaQ4MNIPamDFhW2vxEdNhFDpK-Y0lFVltJK75Seyxp05YcZdXTjijHe68Gyz-N1eSnFRfM7pEF8Un7lOq5M58tm6kmiFq9QPwOSyR8oi_F3bRZWhA0 Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 7b30c782fc334aa19f39ac3178b29a17 Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersAdminTestJSON-902099025 Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:57:32.460111 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b30c782fc334aa19f39ac3178b29a17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b30c782fc334aa19f39ac3178b29a17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b30c782fc334aa19f39ac3178b29a17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b30c782fc334aa19f39ac3178b29a17"}]}] Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersAdminTestJSON-902099025 Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 7b30c782fc334aa19f39ac3178b29a17 Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersAdminTestJSON-902099025 Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersAdminTestJSON-902099025-project Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 50f66b75313549e4bd9a676ae1078b7c Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersAdminTestJSON-902099025-project Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 74769383-c385-4b29-b45c-820aff3e1a77 could not be found. Aug 04 13:57:32.461791 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '74769383-c385-4b29-b45c-820aff3e1a77'} Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74769383-c385-4b29-b45c-820aff3e1a77 could not be found. Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:32.462932 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74769383-c385-4b29-b45c-820aff3e1a77 could not be found. Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74769383-c385-4b29-b45c-820aff3e1a77 could not be found. Aug 04 13:57:32.464467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:32.466917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Returning 404 to user: Instance 74769383-c385-4b29-b45c-820aff3e1a77 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:32.468395 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae5ea0ce-d103-4abc-8af2-2ba3797745ed tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77" status: 404 len: 111 microversion: 2.1 time: 0.041453 Aug 04 13:57:32.473229 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 585/1176] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:32 2022] GET /compute/v2.1/servers/74769383-c385-4b29-b45c-820aff3e1a77 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:32.479079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c9385be9-ab1e-4958-b6a9-171680d86425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.479849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c9385be9-ab1e-4958-b6a9-171680d86425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:32.487458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9385be9-ab1e-4958-b6a9-171680d86425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.488171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9385be9-ab1e-4958-b6a9-171680d86425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.489238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9385be9-ab1e-4958-b6a9-171680d86425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.490325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9385be9-ab1e-4958-b6a9-171680d86425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.522001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c9385be9-ab1e-4958-b6a9-171680d86425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:32.554927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:32.567348 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fa06e4e-759b-4fcd-86e0-c11127b97b59 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1451 microversion: 2.1 time: 0.297398 Aug 04 13:57:32.569834 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 592/1177] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:32 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1451 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:32.596398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1b9875a1-7d93-4a0c-96f6-fea2ed754e83 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.598015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b9875a1-7d93-4a0c-96f6-fea2ed754e83 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:32.614778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b9875a1-7d93-4a0c-96f6-fea2ed754e83 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.616736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b9875a1-7d93-4a0c-96f6-fea2ed754e83 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.618224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b9875a1-7d93-4a0c-96f6-fea2ed754e83 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.618890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b9875a1-7d93-4a0c-96f6-fea2ed754e83 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.646589 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c9385be9-ab1e-4958-b6a9-171680d86425 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 204 len: 0 microversion: 2.1 time: 0.171578 Aug 04 13:57:32.652303 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 586/1178] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:32 2022] DELETE /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:32.656299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b9875a1-7d93-4a0c-96f6-fea2ed754e83 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:32.659898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-deb7a0b6-b1fa-4b8f-9434-beb4484fbbda tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.661466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-deb7a0b6-b1fa-4b8f-9434-beb4484fbbda tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:32.669882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb7a0b6-b1fa-4b8f-9434-beb4484fbbda tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.670603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb7a0b6-b1fa-4b8f-9434-beb4484fbbda tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.671536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb7a0b6-b1fa-4b8f-9434-beb4484fbbda tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.672124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb7a0b6-b1fa-4b8f-9434-beb4484fbbda tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.915268 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1b9875a1-7d93-4a0c-96f6-fea2ed754e83 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "DELETE /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 204 len: 0 microversion: 2.1 time: 0.327136 Aug 04 13:57:32.915942 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 593/1179] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:32 2022] DELETE /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:32.921653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4bd15be4-62bd-43be-bb0a-d3878c0499b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:32.925874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4bd15be4-62bd-43be-bb0a-d3878c0499b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:32.939472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4bd15be4-62bd-43be-bb0a-d3878c0499b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.940014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4bd15be4-62bd-43be-bb0a-d3878c0499b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:32.941851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4bd15be4-62bd-43be-bb0a-d3878c0499b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:32.943427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4bd15be4-62bd-43be-bb0a-d3878c0499b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:33.563650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-deb7a0b6-b1fa-4b8f-9434-beb4484fbbda tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:33.576889 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-deb7a0b6-b1fa-4b8f-9434-beb4484fbbda tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1470 microversion: 2.1 time: 0.922798 Aug 04 13:57:33.579239 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 587/1180] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:32 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1470 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:33.613172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e97186b0-cafa-4f1b-ab01-8a3ed9949c7c tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:33.632062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e97186b0-cafa-4f1b-ab01-8a3ed9949c7c tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:33.674274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e97186b0-cafa-4f1b-ab01-8a3ed9949c7c tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:33.675781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e97186b0-cafa-4f1b-ab01-8a3ed9949c7c tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:33.677188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e97186b0-cafa-4f1b-ab01-8a3ed9949c7c tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:33.682410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e97186b0-cafa-4f1b-ab01-8a3ed9949c7c tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:33.700967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4bd15be4-62bd-43be-bb0a-d3878c0499b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:33.714520 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4bd15be4-62bd-43be-bb0a-d3878c0499b9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1469 microversion: 2.1 time: 0.797033 Aug 04 13:57:33.715657 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 594/1181] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:32 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1469 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:33.723305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:33.723991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:33.740619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:33.742748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:33.743622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:33.744149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:33.833138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:33.835820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:33.836298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lazy-loading 'fault' on Instance uuid 660f79ef-723d-40db-9804-8774b6c26489 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:34.141206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:34.150354 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bee4b0d2-a036-4b2b-8c15-7f7a89252f84 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1457 microversion: 2.1 time: 0.433445 Aug 04 13:57:34.157635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e97186b0-cafa-4f1b-ab01-8a3ed9949c7c tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:34.166400 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e97186b0-cafa-4f1b-ab01-8a3ed9949c7c tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1468 microversion: 2.1 time: 0.584578 Aug 04 13:57:34.167077 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 588/1182] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:33 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1468 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:34.181521 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 595/1183] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:33 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1457 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:34.188116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-9c35b4b9-ff9a-4360-b94a-53b986569b24 req-ed75f819-3c07-4a68-86ac-971cb7d5f251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca56d355-4e66-4634-99fb-9ed160b6bc4b", "tag": "05c9a902-25a1-4f84-9f03-64cea87afd6f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:34.198540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6857d3c7-cfff-403f-bbd9-dd3c6d379fd5 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e82f492-dfb7-47ea-a3cb-c3da5734e8d4"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:34.201028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6857d3c7-cfff-403f-bbd9-dd3c6d379fd5 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:34.209388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9c35b4b9-ff9a-4360-b94a-53b986569b24 req-ed75f819-3c07-4a68-86ac-971cb7d5f251 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:34.212053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9c35b4b9-ff9a-4360-b94a-53b986569b24 req-ed75f819-3c07-4a68-86ac-971cb7d5f251 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:34.213974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6857d3c7-cfff-403f-bbd9-dd3c6d379fd5 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:34.217269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6857d3c7-cfff-403f-bbd9-dd3c6d379fd5 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:34.218249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6857d3c7-cfff-403f-bbd9-dd3c6d379fd5 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:34.220890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6857d3c7-cfff-403f-bbd9-dd3c6d379fd5 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:34.238646 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-9c35b4b9-ff9a-4360-b94a-53b986569b24 req-ed75f819-3c07-4a68-86ac-971cb7d5f251 service nova] Creating event network-changed:05c9a902-25a1-4f84-9f03-64cea87afd6f for instance ca56d355-4e66-4634-99fb-9ed160b6bc4b on n-h1-844627-10 Aug 04 13:57:34.252448 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-9c35b4b9-ff9a-4360-b94a-53b986569b24 req-ed75f819-3c07-4a68-86ac-971cb7d5f251 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069414 Aug 04 13:57:34.253375 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 596/1184] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:34.611142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-669fe2ee-e616-4e25-8e2a-1c5ba5ce16af tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:34.613489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-669fe2ee-e616-4e25-8e2a-1c5ba5ce16af tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:34.628824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-669fe2ee-e616-4e25-8e2a-1c5ba5ce16af tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:34.629720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-669fe2ee-e616-4e25-8e2a-1c5ba5ce16af tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:34.630931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-669fe2ee-e616-4e25-8e2a-1c5ba5ce16af tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:34.631567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-669fe2ee-e616-4e25-8e2a-1c5ba5ce16af tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:34.633393 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6857d3c7-cfff-403f-bbd9-dd3c6d379fd5 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "POST /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439176 Aug 04 13:57:34.634427 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 589/1185] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 13:57:34 2022] POST /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:34.737624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-68d8288e-8d3c-46d7-8a53-dc600bee5905 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:34.738462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-68d8288e-8d3c-46d7-8a53-dc600bee5905 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:34.752676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68d8288e-8d3c-46d7-8a53-dc600bee5905 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:34.753167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68d8288e-8d3c-46d7-8a53-dc600bee5905 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:34.753973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68d8288e-8d3c-46d7-8a53-dc600bee5905 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:34.754418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68d8288e-8d3c-46d7-8a53-dc600bee5905 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:35.043715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-669fe2ee-e616-4e25-8e2a-1c5ba5ce16af tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:35.057595 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-669fe2ee-e616-4e25-8e2a-1c5ba5ce16af tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1470 microversion: 2.1 time: 0.452582 Aug 04 13:57:35.060381 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 597/1186] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:34 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1470 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:35.106742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-68d8288e-8d3c-46d7-8a53-dc600bee5905 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:35.119181 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-68d8288e-8d3c-46d7-8a53-dc600bee5905 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1469 microversion: 2.1 time: 0.386405 Aug 04 13:57:35.120071 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 590/1187] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:34 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1469 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:35.190268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:35.195701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-451ddb08-0d49-4433-acc0-cb54f7c4cccd tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:35.196321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-451ddb08-0d49-4433-acc0-cb54f7c4cccd tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:35.197845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:35.208404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-451ddb08-0d49-4433-acc0-cb54f7c4cccd tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:35.208884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-451ddb08-0d49-4433-acc0-cb54f7c4cccd tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:35.209697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-451ddb08-0d49-4433-acc0-cb54f7c4cccd tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:35.211034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-451ddb08-0d49-4433-acc0-cb54f7c4cccd tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:35.217089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:35.220699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:35.222252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:35.228921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:35.356115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:35.357866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:35.361419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lazy-loading 'fault' on Instance uuid 660f79ef-723d-40db-9804-8774b6c26489 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:36.133999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:36.172785 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a357cd7-993a-442f-a33d-9bb0382deda2 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1457 microversion: 2.1 time: 0.987436 Aug 04 13:57:36.174191 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 598/1188] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:35 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1457 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:36.184746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-004108e4-4cb1-4281-b6fa-b8ca805098dd tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:36.186745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-004108e4-4cb1-4281-b6fa-b8ca805098dd tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:36.205037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-004108e4-4cb1-4281-b6fa-b8ca805098dd tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:36.206386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-451ddb08-0d49-4433-acc0-cb54f7c4cccd tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:36.206929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-004108e4-4cb1-4281-b6fa-b8ca805098dd tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:36.208880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:36.209045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-004108e4-4cb1-4281-b6fa-b8ca805098dd tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:36.210287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-004108e4-4cb1-4281-b6fa-b8ca805098dd tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:36.225557 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-451ddb08-0d49-4433-acc0-cb54f7c4cccd tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1468 microversion: 2.1 time: 1.039390 Aug 04 13:57:36.226150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 591/1189] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:35 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1468 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:36.252004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6380ebbd-e492-4fb2-a74f-57c4a3dc3c2e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:36.252629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6380ebbd-e492-4fb2-a74f-57c4a3dc3c2e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:36.262283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6380ebbd-e492-4fb2-a74f-57c4a3dc3c2e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:36.264361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6380ebbd-e492-4fb2-a74f-57c4a3dc3c2e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:36.270867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6380ebbd-e492-4fb2-a74f-57c4a3dc3c2e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:36.272082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6380ebbd-e492-4fb2-a74f-57c4a3dc3c2e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:37.056119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6380ebbd-e492-4fb2-a74f-57c4a3dc3c2e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:37.078027 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6380ebbd-e492-4fb2-a74f-57c4a3dc3c2e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1535 microversion: 2.1 time: 0.837724 Aug 04 13:57:37.081478 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 592/1190] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:36 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1535 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:37.103102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-004108e4-4cb1-4281-b6fa-b8ca805098dd tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:37.114368 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-004108e4-4cb1-4281-b6fa-b8ca805098dd tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1470 microversion: 2.1 time: 0.936823 Aug 04 13:57:37.117423 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 599/1191] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:36 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1470 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:37.216131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:37.217477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:37.248553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-18590f2e-f4e9-4a3f-bba3-c4d38446085b tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:37.250945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-18590f2e-f4e9-4a3f-bba3-c4d38446085b tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:37.263170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:37.263924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:37.268799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:37.269080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18590f2e-f4e9-4a3f-bba3-c4d38446085b tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:37.269608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18590f2e-f4e9-4a3f-bba3-c4d38446085b tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:37.270258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:37.270777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18590f2e-f4e9-4a3f-bba3-c4d38446085b tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:37.271433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18590f2e-f4e9-4a3f-bba3-c4d38446085b tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:37.313896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:37.314679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:37.323634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lazy-loading 'fault' on Instance uuid 660f79ef-723d-40db-9804-8774b6c26489 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:37.500625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-18590f2e-f4e9-4a3f-bba3-c4d38446085b tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:37.508852 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-18590f2e-f4e9-4a3f-bba3-c4d38446085b tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 200 len: 1468 microversion: 2.1 time: 0.266168 Aug 04 13:57:37.509633 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 600/1192] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:37 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 1468 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:37.599011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:37.609130 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4707091d-2bf0-454e-9bda-147c6684f273 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1457 microversion: 2.1 time: 0.412833 Aug 04 13:57:37.609724 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 593/1193] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:37 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1457 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:37.792271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-9995dc50-5ba7-4dcc-86f6-40435dc1cef2 req-06097220-78ff-4ddc-9189-40db1fcb8083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d449a828-d2f4-4361-b9e3-dd94ad315633", "name": "network-vif-deleted", "tag": "5390537a-5a3f-41a7-b01a-6bccccf258ab"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:37.811363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9995dc50-5ba7-4dcc-86f6-40435dc1cef2 req-06097220-78ff-4ddc-9189-40db1fcb8083 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:37.812280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9995dc50-5ba7-4dcc-86f6-40435dc1cef2 req-06097220-78ff-4ddc-9189-40db1fcb8083 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:37.831917 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-9995dc50-5ba7-4dcc-86f6-40435dc1cef2 req-06097220-78ff-4ddc-9189-40db1fcb8083 service nova] Creating event network-vif-deleted:5390537a-5a3f-41a7-b01a-6bccccf258ab for instance d449a828-d2f4-4361-b9e3-dd94ad315633 on n-h2-844627-10 Aug 04 13:57:37.840247 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-9995dc50-5ba7-4dcc-86f6-40435dc1cef2 req-06097220-78ff-4ddc-9189-40db1fcb8083 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056165 Aug 04 13:57:37.847076 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 601/1194] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:38.105910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0973a2d3-a6b2-48ef-ada7-41850661de89 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:38.106522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0973a2d3-a6b2-48ef-ada7-41850661de89 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:38.117893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0973a2d3-a6b2-48ef-ada7-41850661de89 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.118364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0973a2d3-a6b2-48ef-ada7-41850661de89 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.119770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0973a2d3-a6b2-48ef-ada7-41850661de89 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.120205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0973a2d3-a6b2-48ef-ada7-41850661de89 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.144771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0b36c0f-8603-48b1-ba1d-00fdc313f98b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:38.154617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c0b36c0f-8603-48b1-ba1d-00fdc313f98b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:38.174972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0b36c0f-8603-48b1-ba1d-00fdc313f98b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.179213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0b36c0f-8603-48b1-ba1d-00fdc313f98b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.179415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0b36c0f-8603-48b1-ba1d-00fdc313f98b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.179759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0b36c0f-8603-48b1-ba1d-00fdc313f98b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.430070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c0b36c0f-8603-48b1-ba1d-00fdc313f98b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.442893 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0b36c0f-8603-48b1-ba1d-00fdc313f98b tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 200 len: 1428 microversion: 2.1 time: 0.302351 Aug 04 13:57:38.457464 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 602/1195] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:38 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 1428 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:38.473268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a087207f-7452-4811-8f6a-dc3f833672d2 req-cb3a95e2-916b-4c21-9c8d-67b5aef21ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c14895f-4aef-46ad-b327-8534e734e5aa", "name": "network-vif-deleted", "tag": "6b407fd8-cbd3-41a0-a7e4-9e7dd0c89d76"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:38.494320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a087207f-7452-4811-8f6a-dc3f833672d2 req-cb3a95e2-916b-4c21-9c8d-67b5aef21ddb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.495290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a087207f-7452-4811-8f6a-dc3f833672d2 req-cb3a95e2-916b-4c21-9c8d-67b5aef21ddb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.528125 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a087207f-7452-4811-8f6a-dc3f833672d2 req-cb3a95e2-916b-4c21-9c8d-67b5aef21ddb service nova] Creating event network-vif-deleted:6b407fd8-cbd3-41a0-a7e4-9e7dd0c89d76 for instance 4c14895f-4aef-46ad-b327-8534e734e5aa on n-h2-844627-10 Aug 04 13:57:38.543183 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a087207f-7452-4811-8f6a-dc3f833672d2 req-cb3a95e2-916b-4c21-9c8d-67b5aef21ddb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084223 Aug 04 13:57:38.543866 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 603/1196] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:38.551687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:38.557119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: d449a828-d2f4-4361-b9e3-dd94ad315633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:38.563587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0973a2d3-a6b2-48ef-ada7-41850661de89 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.576616 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0973a2d3-a6b2-48ef-ada7-41850661de89 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1535 microversion: 2.1 time: 0.474815 Aug 04 13:57:38.577318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:38.579718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.580488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.581624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.582315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.591094 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 594/1197] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:38 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1535 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:38.619002 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] HTTP exception thrown: Instance d449a828-d2f4-4361-b9e3-dd94ad315633 could not be found. Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Request method failure captured: Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 HTTP/1.1 Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AetPDtwEb5F1F2bX-_ZAnp_kYF18r65xG-NNa2ber3Anwe_gQNswAOKv3bzRXNmcalfBO_jzXtWyKuteIbNYo0k_woJntmuYa2jQuc2LGOZPkGAO1ga1MIvqQimPx9k2inY4X7pxWAN1Pqzm8GE71fEMC21unG1RiLFq1nvcMRc1o Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 8c532a5466be43d68f5517db3c731bcc Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1392340592 Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:38.621426 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8c532a5466be43d68f5517db3c731bcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8c532a5466be43d68f5517db3c731bcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8c532a5466be43d68f5517db3c731bcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8c532a5466be43d68f5517db3c731bcc"}]}] Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1392340592 Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 8c532a5466be43d68f5517db3c731bcc Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1392340592 Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersAdminNegativeTestJSON-1392340592-project Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8e166178676342cdb27f729225343f82 Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1392340592-project Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d449a828-d2f4-4361-b9e3-dd94ad315633 could not be found. Aug 04 13:57:38.622764 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd449a828-d2f4-4361-b9e3-dd94ad315633'} Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d449a828-d2f4-4361-b9e3-dd94ad315633 could not be found. Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:38.625368 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d449a828-d2f4-4361-b9e3-dd94ad315633 could not be found. Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d449a828-d2f4-4361-b9e3-dd94ad315633 could not be found. Aug 04 13:57:38.626669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:38.627755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Returning 404 to user: Instance d449a828-d2f4-4361-b9e3-dd94ad315633 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:38.627755 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e833dc71-78a9-4d15-9d43-50064f80d220 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633" status: 404 len: 111 microversion: 2.1 time: 0.077821 Aug 04 13:57:38.627755 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 604/1198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:38 2022] GET /compute/v2.1/servers/d449a828-d2f4-4361-b9e3-dd94ad315633 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:38.634792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:38.635612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:38.637701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d19961b0-f041-464a-a8b1-0d8f8e2669f8 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:38.638567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d19961b0-f041-464a-a8b1-0d8f8e2669f8 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:38.643897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.644632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.645654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.647224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.649515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d19961b0-f041-464a-a8b1-0d8f8e2669f8 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.650014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d19961b0-f041-464a-a8b1-0d8f8e2669f8 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.652181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d19961b0-f041-464a-a8b1-0d8f8e2669f8 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.652851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d19961b0-f041-464a-a8b1-0d8f8e2669f8 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.705098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d19961b0-f041-464a-a8b1-0d8f8e2669f8 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:38.706593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.707645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.709851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lazy-loading 'fault' on Instance uuid 660f79ef-723d-40db-9804-8774b6c26489 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:38.756586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:38.797759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:38.818506 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e0ed2e6-9167-4375-bb93-681a0d03f198 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1309 microversion: 2.1 time: 0.183728 Aug 04 13:57:38.820603 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 605/1199] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:38 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:38.903236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:38.913673 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d19961b0-f041-464a-a8b1-0d8f8e2669f8 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 204 len: 0 microversion: 2.1 time: 0.283917 Aug 04 13:57:38.914726 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 595/1200] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:38 2022] DELETE /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:38.923068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6f780a3d-8c67-4e37-936f-1dd8cd4d588f tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:38.925592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6f780a3d-8c67-4e37-936f-1dd8cd4d588f tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:38.939383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f780a3d-8c67-4e37-936f-1dd8cd4d588f tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.941940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f780a3d-8c67-4e37-936f-1dd8cd4d588f tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:38.943129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f780a3d-8c67-4e37-936f-1dd8cd4d588f tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:38.943931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f780a3d-8c67-4e37-936f-1dd8cd4d588f tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:39.255472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f780a3d-8c67-4e37-936f-1dd8cd4d588f tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:39.270438 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6f780a3d-8c67-4e37-936f-1dd8cd4d588f tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1476 microversion: 2.1 time: 0.351371 Aug 04 13:57:39.272637 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 606/1201] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:38 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:39.481820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.482940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 4c14895f-4aef-46ad-b327-8534e734e5aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:39.490688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:39.491467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:39.494348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:39.495346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:39.514793 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] HTTP exception thrown: Instance 4c14895f-4aef-46ad-b327-8534e734e5aa could not be found. Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Request method failure captured: Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa HTTP/1.1 Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-gVGPC9MfDtGVsqGq3Y08R9MrCmuQcZ7XEDJh0tMv5aQP8FB_6SkbMhsEqNnaQ4MNIPamDFhW2vxEdNhFDpK-Y0lFVltJK75Seyxp05YcZdXTjijHe68Gyz-N1eSnFRfM7pEF8Un7lOq5M58tm6kmiFq9QPwOSyR8oi_F3bRZWhA0 Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 7b30c782fc334aa19f39ac3178b29a17 Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersAdminTestJSON-902099025 Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:57:39.516915 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b30c782fc334aa19f39ac3178b29a17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b30c782fc334aa19f39ac3178b29a17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b30c782fc334aa19f39ac3178b29a17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b30c782fc334aa19f39ac3178b29a17"}]}] Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersAdminTestJSON-902099025 Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 7b30c782fc334aa19f39ac3178b29a17 Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersAdminTestJSON-902099025 Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersAdminTestJSON-902099025-project Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 50f66b75313549e4bd9a676ae1078b7c Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersAdminTestJSON-902099025-project Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 4c14895f-4aef-46ad-b327-8534e734e5aa could not be found. Aug 04 13:57:39.518274 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '4c14895f-4aef-46ad-b327-8534e734e5aa'} Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c14895f-4aef-46ad-b327-8534e734e5aa could not be found. Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:39.519052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c14895f-4aef-46ad-b327-8534e734e5aa could not be found. Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c14895f-4aef-46ad-b327-8534e734e5aa could not be found. Aug 04 13:57:39.520227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:39.522873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Returning 404 to user: Instance 4c14895f-4aef-46ad-b327-8534e734e5aa could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:39.535245 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-363f1f28-8696-4b5c-90e9-8d2c0640b4a0 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa" status: 404 len: 111 microversion: 2.1 time: 0.059062 Aug 04 13:57:39.536298 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 596/1202] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:39 2022] GET /compute/v2.1/servers/4c14895f-4aef-46ad-b327-8534e734e5aa => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:39.547600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e06e9562-9e29-4d28-96b3-71fd214e79b2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.548767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e06e9562-9e29-4d28-96b3-71fd214e79b2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:39.558641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e06e9562-9e29-4d28-96b3-71fd214e79b2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:39.559391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e06e9562-9e29-4d28-96b3-71fd214e79b2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:39.561033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e06e9562-9e29-4d28-96b3-71fd214e79b2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:39.562548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e06e9562-9e29-4d28-96b3-71fd214e79b2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:39.598653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c91705cb-84b2-4070-97c2-962c9604789f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.600435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c91705cb-84b2-4070-97c2-962c9604789f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:39.610126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c91705cb-84b2-4070-97c2-962c9604789f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:39.610880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:39.619977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e06e9562-9e29-4d28-96b3-71fd214e79b2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:57:39.620893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c91705cb-84b2-4070-97c2-962c9604789f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:39.621862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c91705cb-84b2-4070-97c2-962c9604789f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:39.622428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c91705cb-84b2-4070-97c2-962c9604789f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:39.787058 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e06e9562-9e29-4d28-96b3-71fd214e79b2 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 204 len: 0 microversion: 2.1 time: 0.242667 Aug 04 13:57:39.793148 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 607/1203] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:39 2022] DELETE /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:39.811637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c877d383-6b18-4f66-8b2d-edfb4dcb6ff6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.812348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c877d383-6b18-4f66-8b2d-edfb4dcb6ff6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:39.833372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c877d383-6b18-4f66-8b2d-edfb4dcb6ff6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:39.835168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c877d383-6b18-4f66-8b2d-edfb4dcb6ff6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:39.836441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c877d383-6b18-4f66-8b2d-edfb4dcb6ff6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:39.838184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c877d383-6b18-4f66-8b2d-edfb4dcb6ff6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:39.971045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c91705cb-84b2-4070-97c2-962c9604789f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:39.985645 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c91705cb-84b2-4070-97c2-962c9604789f tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1535 microversion: 2.1 time: 0.390682 Aug 04 13:57:39.989239 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 597/1204] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:39 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1535 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:39.995330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:39.996057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:40.018907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:40.019467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:40.020389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:40.022450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:40.101709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c877d383-6b18-4f66-8b2d-edfb4dcb6ff6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:40.110371 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c877d383-6b18-4f66-8b2d-edfb4dcb6ff6 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1469 microversion: 2.1 time: 0.315295 Aug 04 13:57:40.112002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:40.112463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:40.112958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lazy-loading 'fault' on Instance uuid 660f79ef-723d-40db-9804-8774b6c26489 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:40.126223 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 608/1205] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:39 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:40.187787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd44afbc629004152807d0ac000e4c53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e77863344504cef8b27ad7730d9452c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:40.199654 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-be027b05-f9aa-4999-b18f-53b980d42936 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 200 len: 1309 microversion: 2.1 time: 0.209130 Aug 04 13:57:40.200269 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 598/1206] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:39 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 1309 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:40.294130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5a579e38-b4c8-47f7-9bdf-5668e366b606 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:40.294746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5a579e38-b4c8-47f7-9bdf-5668e366b606 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:40.304344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a579e38-b4c8-47f7-9bdf-5668e366b606 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:40.306686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a579e38-b4c8-47f7-9bdf-5668e366b606 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:40.307568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a579e38-b4c8-47f7-9bdf-5668e366b606 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:40.312904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a579e38-b4c8-47f7-9bdf-5668e366b606 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:40.542347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5a579e38-b4c8-47f7-9bdf-5668e366b606 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:40.557200 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5a579e38-b4c8-47f7-9bdf-5668e366b606 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1476 microversion: 2.1 time: 0.264127 Aug 04 13:57:40.560987 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 609/1207] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:40 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1476 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:40.615336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-82221d05-33c5-45e6-8019-9d5f6def390f req-fab8f628-c5b2-4efc-abf3-93fe6db1ff95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660f79ef-723d-40db-9804-8774b6c26489", "name": "network-vif-deleted", "tag": "b0f6482f-b8dc-442d-b5e4-ac76de5b19b1"}, {"server_uuid": "7aa08578-7e81-4056-8727-9015a7e5ad33", "name": "network-vif-unplugged", "status": "completed", "tag": "8c8ae616-b10d-4353-8410-e4d906727bd0"}, {"name": "network-changed", "server_uuid": "7aa08578-7e81-4056-8727-9015a7e5ad33", "tag": "8c8ae616-b10d-4353-8410-e4d906727bd0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:40.642022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-82221d05-33c5-45e6-8019-9d5f6def390f req-fab8f628-c5b2-4efc-abf3-93fe6db1ff95 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:40.643125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-82221d05-33c5-45e6-8019-9d5f6def390f req-fab8f628-c5b2-4efc-abf3-93fe6db1ff95 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:40.674268 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-82221d05-33c5-45e6-8019-9d5f6def390f req-fab8f628-c5b2-4efc-abf3-93fe6db1ff95 service nova] Creating event network-vif-deleted:b0f6482f-b8dc-442d-b5e4-ac76de5b19b1 for instance 660f79ef-723d-40db-9804-8774b6c26489 on n-h2-844627-10 Aug 04 13:57:40.675030 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-82221d05-33c5-45e6-8019-9d5f6def390f req-fab8f628-c5b2-4efc-abf3-93fe6db1ff95 service nova] Creating event network-vif-unplugged:8c8ae616-b10d-4353-8410-e4d906727bd0 for instance 7aa08578-7e81-4056-8727-9015a7e5ad33 on n-h2-844627-10 Aug 04 13:57:40.675683 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-82221d05-33c5-45e6-8019-9d5f6def390f req-fab8f628-c5b2-4efc-abf3-93fe6db1ff95 service nova] Creating event network-changed:8c8ae616-b10d-4353-8410-e4d906727bd0 for instance 7aa08578-7e81-4056-8727-9015a7e5ad33 on n-h2-844627-10 Aug 04 13:57:40.691589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-82221d05-33c5-45e6-8019-9d5f6def390f req-fab8f628-c5b2-4efc-abf3-93fe6db1ff95 service nova] Instance 7aa08578-7e81-4056-8727-9015a7e5ad33 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:57:40.714777 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-82221d05-33c5-45e6-8019-9d5f6def390f req-fab8f628-c5b2-4efc-abf3-93fe6db1ff95 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.112940 Aug 04 13:57:40.716034 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 599/1208] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:41.007605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d801b3bd-86fa-4416-a0d9-758c41bc365d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:41.008667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d801b3bd-86fa-4416-a0d9-758c41bc365d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:41.016894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d801b3bd-86fa-4416-a0d9-758c41bc365d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:41.023429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d801b3bd-86fa-4416-a0d9-758c41bc365d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:41.024648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d801b3bd-86fa-4416-a0d9-758c41bc365d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:41.039618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d801b3bd-86fa-4416-a0d9-758c41bc365d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:41.133819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dfb8bf72-4487-46ae-839b-a1eb572adb4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:41.134597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dfb8bf72-4487-46ae-839b-a1eb572adb4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:41.166529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf72-4487-46ae-839b-a1eb572adb4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:41.166990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf72-4487-46ae-839b-a1eb572adb4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:41.167794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf72-4487-46ae-839b-a1eb572adb4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:41.168238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfb8bf72-4487-46ae-839b-a1eb572adb4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:41.527213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dfb8bf72-4487-46ae-839b-a1eb572adb4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:41.538999 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dfb8bf72-4487-46ae-839b-a1eb572adb4a tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1469 microversion: 2.1 time: 0.409278 Aug 04 13:57:41.542753 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 600/1209] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:41 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1469 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:41.562734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:41.565396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:41.583373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:41.585505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:41.586555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:41.587936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:41.627534 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] HTTP exception thrown: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Request method failure captured: Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 HTTP/1.1 Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69AbymHZeIikqHaHbN7Xqt3cDFxPExdkcsS9-j7XUqvggqfUeoO-z6_0EQoo0YU0Ga26G4fr0wMF7yGfVmtu4DaOZ55cw3XQZ8s63hFjc1DQSXZM9-52RbB0BuZPXdU3CRYwMq8S_nA3yJtuDSCBs7JBLZhoEebBS6646uE178lveMk Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:57:41.630275 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e77863344504cef8b27ad7730d9452c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}] Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d44afbc629004152807d0ac000e4c53a Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:41.631825 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '660f79ef-723d-40db-9804-8774b6c26489'} Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:41.632968 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:41.634931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:41.637894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Returning 404 to user: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:41.639659 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7dc99a4f-1d8f-47fc-af98-d1babf404d44 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 404 len: 111 microversion: 2.1 time: 0.091884 Aug 04 13:57:41.640854 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 601/1210] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:41 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:41.648839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6e7bd531-1e3c-4983-a6ae-638a57bc95c4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:41.650684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6e7bd531-1e3c-4983-a6ae-638a57bc95c4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:41.659447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e7bd531-1e3c-4983-a6ae-638a57bc95c4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:41.661295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e7bd531-1e3c-4983-a6ae-638a57bc95c4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:41.662392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e7bd531-1e3c-4983-a6ae-638a57bc95c4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:41.663051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e7bd531-1e3c-4983-a6ae-638a57bc95c4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.032605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d801b3bd-86fa-4416-a0d9-758c41bc365d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:42.044863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d801b3bd-86fa-4416-a0d9-758c41bc365d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1535 microversion: 2.1 time: 1.042122 Aug 04 13:57:42.049959 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 610/1211] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:41 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1535 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:42.066996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:42.067517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:42.085229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.087062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.088315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.088835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.127399 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] HTTP exception thrown: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Request method failure captured: Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 HTTP/1.1 Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AbymHZeIikqHaHbN7Xqt3cDFxPExdkcsS9-j7XUqvggqfUeoO-z6_0EQoo0YU0Ga26G4fr0wMF7yGfVmtu4DaOZ55cw3XQZ8s63hFjc1DQSXZM9-52RbB0BuZPXdU3CRYwMq8S_nA3yJtuDSCBs7JBLZhoEebBS6646uE178lveMk Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:42.129410 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e77863344504cef8b27ad7730d9452c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}] Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d44afbc629004152807d0ac000e4c53a Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.130982 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '660f79ef-723d-40db-9804-8774b6c26489'} Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:42.131861 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.133252 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.134680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Returning 404 to user: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:42.134680 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-238da3c0-cc63-4905-b224-f34577eaf1d6 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "DELETE /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 404 len: 111 microversion: 2.1 time: 0.079922 Aug 04 13:57:42.135765 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 611/1212] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:42 2022] DELETE /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:42.163919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:42.164642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: 660f79ef-723d-40db-9804-8774b6c26489] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:42.174244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.174749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.175593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.176082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.194336 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] HTTP exception thrown: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Request method failure captured: Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 HTTP/1.1 Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AbymHZeIikqHaHbN7Xqt3cDFxPExdkcsS9-j7XUqvggqfUeoO-z6_0EQoo0YU0Ga26G4fr0wMF7yGfVmtu4DaOZ55cw3XQZ8s63hFjc1DQSXZM9-52RbB0BuZPXdU3CRYwMq8S_nA3yJtuDSCBs7JBLZhoEebBS6646uE178lveMk Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:42.196124 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e77863344504cef8b27ad7730d9452c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}] Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d44afbc629004152807d0ac000e4c53a Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.197794 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '660f79ef-723d-40db-9804-8774b6c26489'} Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:42.198521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. Aug 04 13:57:42.199712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.200777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Returning 404 to user: Instance 660f79ef-723d-40db-9804-8774b6c26489 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:42.200777 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c5b5bc37-a6c1-4eb7-bd0c-d60249119931 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489" status: 404 len: 111 microversion: 2.1 time: 0.060975 Aug 04 13:57:42.202390 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 612/1213] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:42 2022] GET /compute/v2.1/servers/660f79ef-723d-40db-9804-8774b6c26489 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:42.210251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:42.217343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:42.233694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.233873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.235031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.235530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.258693 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] HTTP exception thrown: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Request method failure captured: Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 HTTP/1.1 Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AbymHZeIikqHaHbN7Xqt3cDFxPExdkcsS9-j7XUqvggqfUeoO-z6_0EQoo0YU0Ga26G4fr0wMF7yGfVmtu4DaOZ55cw3XQZ8s63hFjc1DQSXZM9-52RbB0BuZPXdU3CRYwMq8S_nA3yJtuDSCBs7JBLZhoEebBS6646uE178lveMk Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:42.260269 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e77863344504cef8b27ad7730d9452c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}] Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d44afbc629004152807d0ac000e4c53a Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.261641 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b3a43735-0b27-4bc2-8943-9ba369ecf719'} Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:42.262385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.263603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.264812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Returning 404 to user: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:42.264812 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3581693b-0b73-4cb4-9221-c92ffb2b1193 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 404 len: 111 microversion: 2.1 time: 0.059155 Aug 04 13:57:42.266709 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 613/1214] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:42 2022] DELETE /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:42.272900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:42.273780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] [instance: b3a43735-0b27-4bc2-8943-9ba369ecf719] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:42.282881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.283602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.284589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.285245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.324208 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] HTTP exception thrown: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Request method failure captured: Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 HTTP/1.1 Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69AbymHZeIikqHaHbN7Xqt3cDFxPExdkcsS9-j7XUqvggqfUeoO-z6_0EQoo0YU0Ga26G4fr0wMF7yGfVmtu4DaOZ55cw3XQZ8s63hFjc1DQSXZM9-52RbB0BuZPXdU3CRYwMq8S_nA3yJtuDSCBs7JBLZhoEebBS6646uE178lveMk Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:42.325864 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2e77863344504cef8b27ad7730d9452c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2e77863344504cef8b27ad7730d9452c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2e77863344504cef8b27ad7730d9452c"}]}] Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2e77863344504cef8b27ad7730d9452c Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-432650621 Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d44afbc629004152807d0ac000e4c53a Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersAdminTestJSON-432650621-project Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.328585 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b3a43735-0b27-4bc2-8943-9ba369ecf719'} Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:42.330246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. Aug 04 13:57:42.332904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:42.339224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] Returning 404 to user: Instance b3a43735-0b27-4bc2-8943-9ba369ecf719 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:42.339224 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12b17fa0-a53e-49a0-9acc-804289b63303 tempest-DeleteServersAdminTestJSON-432650621 tempest-DeleteServersAdminTestJSON-432650621-project] 10.222.0.66 "GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719" status: 404 len: 111 microversion: 2.1 time: 0.059427 Aug 04 13:57:42.339224 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 614/1215] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:42 2022] GET /compute/v2.1/servers/b3a43735-0b27-4bc2-8943-9ba369ecf719 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:42.565225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f775cce8-d07d-431f-abba-45d6e43f8e14 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:42.565818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f775cce8-d07d-431f-abba-45d6e43f8e14 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:42.574709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f775cce8-d07d-431f-abba-45d6e43f8e14 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.575171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f775cce8-d07d-431f-abba-45d6e43f8e14 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.575979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f775cce8-d07d-431f-abba-45d6e43f8e14 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.581475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f775cce8-d07d-431f-abba-45d6e43f8e14 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.828823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6e7bd531-1e3c-4983-a6ae-638a57bc95c4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:42.837037 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6e7bd531-1e3c-4983-a6ae-638a57bc95c4 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1476 microversion: 2.1 time: 1.194458 Aug 04 13:57:42.838690 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 602/1216] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:41 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1476 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:42.856069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-9ce59906-00f2-43a6-88dd-89ce5ee590b8 req-4e7c3b15-3960-41d1-b80a-5b21213b2bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92c1d62-28c6-48f7-8048-1795d50d224a", "name": "network-vif-deleted", "tag": "237fa1bf-4032-460b-abe3-07c35b7aa664"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:42.873043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9ce59906-00f2-43a6-88dd-89ce5ee590b8 req-4e7c3b15-3960-41d1-b80a-5b21213b2bb1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:42.873469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9ce59906-00f2-43a6-88dd-89ce5ee590b8 req-4e7c3b15-3960-41d1-b80a-5b21213b2bb1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:42.888756 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9ce59906-00f2-43a6-88dd-89ce5ee590b8 req-4e7c3b15-3960-41d1-b80a-5b21213b2bb1 service nova] Creating event network-vif-deleted:237fa1bf-4032-460b-abe3-07c35b7aa664 for instance a92c1d62-28c6-48f7-8048-1795d50d224a on n-h2-844627-10 Aug 04 13:57:42.894719 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-9ce59906-00f2-43a6-88dd-89ce5ee590b8 req-4e7c3b15-3960-41d1-b80a-5b21213b2bb1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054304 Aug 04 13:57:42.895628 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 603/1217] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:43.042622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f775cce8-d07d-431f-abba-45d6e43f8e14 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50f66b75313549e4bd9a676ae1078b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b30c782fc334aa19f39ac3178b29a17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:43.060556 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f775cce8-d07d-431f-abba-45d6e43f8e14 tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 200 len: 1469 microversion: 2.1 time: 0.499277 Aug 04 13:57:43.081132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-58d0f442-3a65-4b8f-bc31-d774cfc25ce7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:43.082069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-58d0f442-3a65-4b8f-bc31-d774cfc25ce7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:43.087320 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 615/1218] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:42 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 1469 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:43.090100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58d0f442-3a65-4b8f-bc31-d774cfc25ce7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:43.090763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58d0f442-3a65-4b8f-bc31-d774cfc25ce7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:43.091737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58d0f442-3a65-4b8f-bc31-d774cfc25ce7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:43.097849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58d0f442-3a65-4b8f-bc31-d774cfc25ce7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:43.394880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-58d0f442-3a65-4b8f-bc31-d774cfc25ce7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:43.405498 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-58d0f442-3a65-4b8f-bc31-d774cfc25ce7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1535 microversion: 2.1 time: 0.328612 Aug 04 13:57:43.416925 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 604/1219] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:43 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1535 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:43.861373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:43.862252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:43.875160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:43.877336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:43.878385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:43.880278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:43.966922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:43.967648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:43.968320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lazy-loading 'fault' on Instance uuid a92c1d62-28c6-48f7-8048-1795d50d224a {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:44.083765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:44.085483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] [instance: 9802281d-83eb-4b5d-8fe0-bc812e0872e4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:44.104262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:44.112402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:44.113283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:44.115561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:44.159051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e166178676342cdb27f729225343f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c532a5466be43d68f5517db3c731bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:44.185675 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] HTTP exception thrown: Instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 could not be found. Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Request method failure captured: Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 HTTP/1.1 Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-gVGPC9MfDtGVsqGq3Y08R9MrCmuQcZ7XEDJh0tMv5aQP8FB_6SkbMhsEqNnaQ4MNIPamDFhW2vxEdNhFDpK-Y0lFVltJK75Seyxp05YcZdXTjijHe68Gyz-N1eSnFRfM7pEF8Un7lOq5M58tm6kmiFq9QPwOSyR8oi_F3bRZWhA0 Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 7b30c782fc334aa19f39ac3178b29a17 Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersAdminTestJSON-902099025 Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:57:44.198210 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b30c782fc334aa19f39ac3178b29a17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b30c782fc334aa19f39ac3178b29a17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b30c782fc334aa19f39ac3178b29a17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b30c782fc334aa19f39ac3178b29a17"}]}] Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersAdminTestJSON-902099025 Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 7b30c782fc334aa19f39ac3178b29a17 Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersAdminTestJSON-902099025 Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersAdminTestJSON-902099025-project Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 50f66b75313549e4bd9a676ae1078b7c Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersAdminTestJSON-902099025-project Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 could not be found. Aug 04 13:57:44.199807 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9802281d-83eb-4b5d-8fe0-bc812e0872e4'} Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 could not be found. Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:44.200666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 could not be found. Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 could not be found. Aug 04 13:57:44.202145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:44.204388 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a88cc375-bd9c-400f-b682-26a5ce498ce2 tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 200 len: 1311 microversion: 2.1 time: 0.348275 Aug 04 13:57:44.210121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] Returning 404 to user: Instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:44.216498 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-472078a2-11e5-4f2f-a477-4d373480f77e tempest-ServersAdminTestJSON-902099025 tempest-ServersAdminTestJSON-902099025-project] 10.222.0.66 "GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4" status: 404 len: 111 microversion: 2.1 time: 0.137072 Aug 04 13:57:44.221392 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 605/1221] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:44 2022] GET /compute/v2.1/servers/9802281d-83eb-4b5d-8fe0-bc812e0872e4 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:57:44.224668 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 616/1221] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:43 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 1311 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:44.428524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-27d0e252-90ab-4380-b9ed-e6da58113236 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:44.429307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-27d0e252-90ab-4380-b9ed-e6da58113236 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:44.442703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27d0e252-90ab-4380-b9ed-e6da58113236 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:44.444858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27d0e252-90ab-4380-b9ed-e6da58113236 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:44.448718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27d0e252-90ab-4380-b9ed-e6da58113236 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:44.452339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27d0e252-90ab-4380-b9ed-e6da58113236 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:44.888700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-27d0e252-90ab-4380-b9ed-e6da58113236 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:44.902837 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-27d0e252-90ab-4380-b9ed-e6da58113236 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1528 microversion: 2.1 time: 0.477813 Aug 04 13:57:44.916742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f4bd937f-1964-4c23-bac6-79dff37a30e5 req-6c8050c6-8588-4b9c-bf08-bec5cbc7b5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9802281d-83eb-4b5d-8fe0-bc812e0872e4", "name": "network-vif-deleted", "tag": "f591719b-2d26-42da-b7bb-dfe4d507c0a9"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:44.921568 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 617/1222] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:44 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1528 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:44.938399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-71c6a595-d10a-42b6-b2d5-8576ce4dd9b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:44.939037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-71c6a595-d10a-42b6-b2d5-8576ce4dd9b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:44.948716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f4bd937f-1964-4c23-bac6-79dff37a30e5 req-6c8050c6-8588-4b9c-bf08-bec5cbc7b5ff service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:44.949229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f4bd937f-1964-4c23-bac6-79dff37a30e5 req-6c8050c6-8588-4b9c-bf08-bec5cbc7b5ff service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:44.955345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71c6a595-d10a-42b6-b2d5-8576ce4dd9b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:44.955802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71c6a595-d10a-42b6-b2d5-8576ce4dd9b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:44.956584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71c6a595-d10a-42b6-b2d5-8576ce4dd9b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:44.957075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71c6a595-d10a-42b6-b2d5-8576ce4dd9b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:44.999609 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f4bd937f-1964-4c23-bac6-79dff37a30e5 req-6c8050c6-8588-4b9c-bf08-bec5cbc7b5ff service nova] Creating event network-vif-deleted:f591719b-2d26-42da-b7bb-dfe4d507c0a9 for instance 9802281d-83eb-4b5d-8fe0-bc812e0872e4 on n-h1-844627-10 Aug 04 13:57:45.017570 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f4bd937f-1964-4c23-bac6-79dff37a30e5 req-6c8050c6-8588-4b9c-bf08-bec5cbc7b5ff service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105394 Aug 04 13:57:45.022654 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 606/1223] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:57:45.233524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:45.235103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] [instance: a92c1d62-28c6-48f7-8048-1795d50d224a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:45.257436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:45.258702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:45.260536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:45.261406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:45.267406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-71c6a595-d10a-42b6-b2d5-8576ce4dd9b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:45.276659 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-71c6a595-d10a-42b6-b2d5-8576ce4dd9b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1528 microversion: 2.1 time: 0.349536 Aug 04 13:57:45.277756 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 618/1224] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:44 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1528 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:45.294071 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] HTTP exception thrown: Instance a92c1d62-28c6-48f7-8048-1795d50d224a could not be found. Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Request method failure captured: Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a HTTP/1.1 Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69AetPDtwEb5F1F2bX-_ZAnp_kYF18r65xG-NNa2ber3Anwe_gQNswAOKv3bzRXNmcalfBO_jzXtWyKuteIbNYo0k_woJntmuYa2jQuc2LGOZPkGAO1ga1MIvqQimPx9k2inY4X7pxWAN1Pqzm8GE71fEMC21unG1RiLFq1nvcMRc1o Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 8c532a5466be43d68f5517db3c731bcc Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1392340592 Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:57:45.295913 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8c532a5466be43d68f5517db3c731bcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8c532a5466be43d68f5517db3c731bcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8c532a5466be43d68f5517db3c731bcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8c532a5466be43d68f5517db3c731bcc"}]}] Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1392340592 Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 8c532a5466be43d68f5517db3c731bcc Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1392340592 Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersAdminNegativeTestJSON-1392340592-project Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8e166178676342cdb27f729225343f82 Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1392340592-project Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance a92c1d62-28c6-48f7-8048-1795d50d224a could not be found. Aug 04 13:57:45.297821 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'a92c1d62-28c6-48f7-8048-1795d50d224a'} Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92c1d62-28c6-48f7-8048-1795d50d224a could not be found. Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:45.298986 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92c1d62-28c6-48f7-8048-1795d50d224a could not be found. Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92c1d62-28c6-48f7-8048-1795d50d224a could not be found. Aug 04 13:57:45.303315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.305440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] Returning 404 to user: Instance a92c1d62-28c6-48f7-8048-1795d50d224a could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:45.305440 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3d06f107-5031-4215-82f2-9f2c880c00ab tempest-ServersAdminNegativeTestJSON-1392340592 tempest-ServersAdminNegativeTestJSON-1392340592-project] 10.222.0.66 "GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a" status: 404 len: 111 microversion: 2.1 time: 0.069559 Aug 04 13:57:45.305709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab7109a4-fd83-417b-bae7-a316f8707bba tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:45.305709 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:45.305709 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:57:45.306206 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 607/1225] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:45 2022] GET /compute/v2.1/servers/a92c1d62-28c6-48f7-8048-1795d50d224a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:57:45.310207 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-ab7109a4-fd83-417b-bae7-a316f8707bba tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] HTTP exception thrown: Flavor c495b1d0-d4e5-4490-8b62-2594f9be53ba could not be found. Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab7109a4-fd83-417b-bae7-a316f8707bba tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Request method failure captured: Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/flavors/c495b1d0-d4e5-4490-8b62-2594f9be53ba HTTP/1.1 Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689xCZSPbghkvgmVZ4v21MaQmJhIQs0Q997a23B25ECWW99_d4b-D16a2BftIIH9VdJBAg0RkABsgCtOYZFhKjylUbLV5PU0eyiCVCuVyn4TZ7SeOukNKNj4Bf376gBO0fCKv2Uw7t94xkZTGPgzv-tfu_uz_CqPC1EIoZAtz6KNFmo Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3550ddad584a4ca8a2ad864c2aa63b2a Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-MigrationsAdminTest-1536428703 Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 13:57:45.312997 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3550ddad584a4ca8a2ad864c2aa63b2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3550ddad584a4ca8a2ad864c2aa63b2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3550ddad584a4ca8a2ad864c2aa63b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3550ddad584a4ca8a2ad864c2aa63b2a"}]}] Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-MigrationsAdminTest-1536428703 Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3550ddad584a4ca8a2ad864c2aa63b2a Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-MigrationsAdminTest-1536428703 Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-MigrationsAdminTest-1536428703-project-admin Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6006f04353b541b6b4013236f34bfa33 Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-MigrationsAdminTest-1536428703-project-admin Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: exception: Flavor c495b1d0-d4e5-4490-8b62-2594f9be53ba could not be found. Aug 04 13:57:45.314616 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'c495b1d0-d4e5-4490-8b62-2594f9be53ba'} Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor c495b1d0-d4e5-4490-8b62-2594f9be53ba could not be found. Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:45.315508 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor c495b1d0-d4e5-4490-8b62-2594f9be53ba could not be found. Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor c495b1d0-d4e5-4490-8b62-2594f9be53ba could not be found. Aug 04 13:57:45.317971 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:45.319436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab7109a4-fd83-417b-bae7-a316f8707bba tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Returning 404 to user: Flavor c495b1d0-d4e5-4490-8b62-2594f9be53ba could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:45.319436 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ab7109a4-fd83-417b-bae7-a316f8707bba tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/c495b1d0-d4e5-4490-8b62-2594f9be53ba" status: 404 len: 109 microversion: 2.1 time: 0.020534 Aug 04 13:57:45.319436 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 619/1226] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:45 2022] DELETE /compute/v2.1/flavors/c495b1d0-d4e5-4490-8b62-2594f9be53ba => generated 109 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 13:57:45.640699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1761411825", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:45.709182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:57:45.920415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7d8a8af6-48d6-4b6e-9581-02471609f4a2 req-75de7c2e-dd86-4933-9100-3325a805d342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa08578-7e81-4056-8727-9015a7e5ad33", "name": "network-vif-plugged", "status": "completed", "tag": "8c8ae616-b10d-4353-8410-e4d906727bd0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:45.949982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7d8a8af6-48d6-4b6e-9581-02471609f4a2 req-75de7c2e-dd86-4933-9100-3325a805d342 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:45.954098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7d8a8af6-48d6-4b6e-9581-02471609f4a2 req-75de7c2e-dd86-4933-9100-3325a805d342 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:45.976680 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7d8a8af6-48d6-4b6e-9581-02471609f4a2 req-75de7c2e-dd86-4933-9100-3325a805d342 service nova] Creating event network-vif-plugged:8c8ae616-b10d-4353-8410-e4d906727bd0 for instance 7aa08578-7e81-4056-8727-9015a7e5ad33 on n-h2-844627-10 Aug 04 13:57:45.994789 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7d8a8af6-48d6-4b6e-9581-02471609f4a2 req-75de7c2e-dd86-4933-9100-3325a805d342 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081098 Aug 04 13:57:46.002016 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 620/1227] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:57:46.021739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:57:46.022160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:57:46.022821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:57:46.023386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:57:46.023968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:57:46.043377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:46.043844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:46.044673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:46.045321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:46.069269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:57:46.072138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Getting quotas for user cca2bff6e81c4f54bad52f77e67faa55 and project 261d13f0b3484fadacd97a9a64eaefc6. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:57:46.085192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:57:46.087657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:57:46.132619 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1a088c9c-9003-4b79-88f1-51241e47cb2d tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496979 Aug 04 13:57:46.133312 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 608/1228] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:57:46.152723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55a69a96-72e0-451c-999b-8399799c4692 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:46.153398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55a69a96-72e0-451c-999b-8399799c4692 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:46.218868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-55a69a96-72e0-451c-999b-8399799c4692 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:46.226349 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55a69a96-72e0-451c-999b-8399799c4692 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1213 microversion: 2.1 time: 0.085838 Aug 04 13:57:46.237726 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 621/1229] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:46 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:47.252707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b19ba7f0-17ac-4b8f-929a-87a8d58b2ac7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:47.254261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b19ba7f0-17ac-4b8f-929a-87a8d58b2ac7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:47.270494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b19ba7f0-17ac-4b8f-929a-87a8d58b2ac7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:47.278931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b19ba7f0-17ac-4b8f-929a-87a8d58b2ac7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:47.282820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b19ba7f0-17ac-4b8f-929a-87a8d58b2ac7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:47.283610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b19ba7f0-17ac-4b8f-929a-87a8d58b2ac7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:47.412636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b19ba7f0-17ac-4b8f-929a-87a8d58b2ac7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:47.430457 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b19ba7f0-17ac-4b8f-929a-87a8d58b2ac7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1265 microversion: 2.1 time: 0.185501 Aug 04 13:57:47.432149 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 609/1230] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:47 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:48.455334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-28e44910-819f-467c-864f-db3fb2ede27b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:48.455953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-28e44910-819f-467c-864f-db3fb2ede27b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:48.474458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28e44910-819f-467c-864f-db3fb2ede27b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:48.475370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28e44910-819f-467c-864f-db3fb2ede27b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:48.477324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28e44910-819f-467c-864f-db3fb2ede27b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:48.479819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28e44910-819f-467c-864f-db3fb2ede27b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:48.839844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-28e44910-819f-467c-864f-db3fb2ede27b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:48.858646 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-28e44910-819f-467c-864f-db3fb2ede27b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 0.408546 Aug 04 13:57:48.880757 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 622/1231] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:48 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:49.889298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-775468d8-99f4-4c98-90dc-7b59386d9212 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:49.890003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-775468d8-99f4-4c98-90dc-7b59386d9212 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:49.915901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-65edaa54-be7a-443f-a71d-43baa42e83c5 tempest-FlavorMetadataValidation-1323726205 tempest-FlavorMetadataValidation-1323726205-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1083785826", "id": 1618409941, "os-flavor-access:is_public": "True"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:49.917940 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:49.917940 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:57:49.924477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-775468d8-99f4-4c98-90dc-7b59386d9212 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:49.924973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-775468d8-99f4-4c98-90dc-7b59386d9212 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:49.933684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-775468d8-99f4-4c98-90dc-7b59386d9212 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:49.934030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-775468d8-99f4-4c98-90dc-7b59386d9212 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:49.959838 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-65edaa54-be7a-443f-a71d-43baa42e83c5 tempest-FlavorMetadataValidation-1323726205 tempest-FlavorMetadataValidation-1323726205-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.326691 Aug 04 13:57:49.964792 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 610/1232] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 13:57:49 2022] POST /compute/v2.1/flavors => generated 471 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:57:49.986191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa1c6a2c-1d8a-41c1-a6fc-b5e9e9644320 tempest-FlavorMetadataValidation-1323726205 tempest-FlavorMetadataValidation-1323726205-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:49.993537 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:49.993537 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:57:50.263598 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fa1c6a2c-1d8a-41c1-a6fc-b5e9e9644320 tempest-FlavorMetadataValidation-1323726205 tempest-FlavorMetadataValidation-1323726205-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors/1618409941/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.283291 Aug 04 13:57:50.264605 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 611/1233] 10.222.0.66 () {62 vars in 1265 bytes} [Thu Aug 4 13:57:49 2022] POST /compute/v2.1/flavors/1618409941/os-extra_specs => generated 62 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:57:50.460769 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-028fed9e-2e7b-426b-913a-e45ba313a85b tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] 10.222.0.66 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.194301 Aug 04 13:57:50.465352 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 612/1234] 10.222.0.66 () {58 vars in 1128 bytes} [Thu Aug 4 13:57:50 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 13:57:50.469855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ce644f74-37da-4302-967f-6a62b11974c1 tempest-FlavorMetadataValidation-1323726205 tempest-FlavorMetadataValidation-1323726205-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.471035 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:50.471035 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:57:50.498725 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ce644f74-37da-4302-967f-6a62b11974c1 tempest-FlavorMetadataValidation-1323726205 tempest-FlavorMetadataValidation-1323726205-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1618409941" status: 202 len: 0 microversion: 2.86 time: 0.035853 Aug 04 13:57:50.501351 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 613/1235] 10.222.0.66 () {60 vars in 1202 bytes} [Thu Aug 4 13:57:50 2022] DELETE /compute/v2.1/flavors/1618409941 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:57:50.510677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5352133e-9985-4f76-8a06-91a268eebc1b tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Calling method '.version_select at 0x7f47000119d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.590456 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5352133e-9985-4f76-8a06-91a268eebc1b tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] HTTP exception thrown: Image not found. Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5352133e-9985-4f76-8a06-91a268eebc1b tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Request method failure captured: Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Bdw8fo78MR2bp-EVwnH5zwYPkYE6p6f4urgnPn_PqbuJOTq3hlyxLljdyHyiLHks8dTltQ8600teCuYBguiLZq8c666i-f2-u0vSOu8pYAhXowiYk2FUY_Tlidxvv-GNBIg00VHrIluSGTsTqN6BVhGwx3-bsSv-FQfskwoV_UgG8 Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:57:50.612083 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}] Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a1bf842a0fd046dc824d49b2578c7fb2 Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '-1'} Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:50.613810 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.614908 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:50.616391 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 13:57:50.618640 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.620580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5352133e-9985-4f76-8a06-91a268eebc1b tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:50.621588 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5352133e-9985-4f76-8a06-91a268eebc1b tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] 10.222.0.66 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.119013 Aug 04 13:57:50.622319 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 614/1236] 10.222.0.66 () {58 vars in 1134 bytes} [Thu Aug 4 13:57:50 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:57:50.629042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3161094a-f808-49b8-943f-37d5a32637d2 tempest-FlavorMetadataValidation-1323726205 tempest-FlavorMetadataValidation-1323726205-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.656903 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3161094a-f808-49b8-943f-37d5a32637d2 tempest-FlavorMetadataValidation-1323726205 tempest-FlavorMetadataValidation-1323726205-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.033253 Aug 04 13:57:50.658175 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 615/1237] 10.222.0.66 () {60 vars in 1187 bytes} [Thu Aug 4 13:57:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:57:50.664779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf731a4b-6067-406f-8bea-4c58d91afc1b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.668267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf731a4b-6067-406f-8bea-4c58d91afc1b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:50.694744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf731a4b-6067-406f-8bea-4c58d91afc1b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:50.695298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf731a4b-6067-406f-8bea-4c58d91afc1b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:50.698645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf731a4b-6067-406f-8bea-4c58d91afc1b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:50.699171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf731a4b-6067-406f-8bea-4c58d91afc1b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:50.748055 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf731a4b-6067-406f-8bea-4c58d91afc1b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087192 Aug 04 13:57:50.749388 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 616/1238] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 13:57:50 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:50.755401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a73d520-136e-4003-83d7-b2386ed789c3 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Calling method '.version_select at 0x7f470007e310>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.786898 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-3a73d520-136e-4003-83d7-b2386ed789c3 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] HTTP exception thrown: Image not found. Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a73d520-136e-4003-83d7-b2386ed789c3 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Request method failure captured: Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/images/e350ff28-52fe-4cc7-9df1-66a019652a0j HTTP/1.1 Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Bdw8fo78MR2bp-EVwnH5zwYPkYE6p6f4urgnPn_PqbuJOTq3hlyxLljdyHyiLHks8dTltQ8600teCuYBguiLZq8c666i-f2-u0vSOu8pYAhXowiYk2FUY_Tlidxvv-GNBIg00VHrIluSGTsTqN6BVhGwx3-bsSv-FQfskwoV_UgG8 Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:57:50.788844 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}] Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a1bf842a0fd046dc824d49b2578c7fb2 Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'e350ff28-52fe-4cc7-9df1-66a019652a0j'} Aug 04 13:57:50.790383 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e350ff28-52fe-4cc7-9df1-66a019652a0j to delete Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:50.791269 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e350ff28-52fe-4cc7-9df1-66a019652a0j could not be found. Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:50.792531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 13:57:50.794875 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.796124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a73d520-136e-4003-83d7-b2386ed789c3 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:50.797087 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a73d520-136e-4003-83d7-b2386ed789c3 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] 10.222.0.66 "DELETE /compute/v2.1/images/e350ff28-52fe-4cc7-9df1-66a019652a0j" status: 404 len: 62 microversion: 2.1 time: 0.046378 Aug 04 13:57:50.798116 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 617/1239] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:50 2022] DELETE /compute/v2.1/images/e350ff28-52fe-4cc7-9df1-66a019652a0j => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:57:50.806318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d1a652f-5c53-4074-aaee-32fae29aadb9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.806899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d1a652f-5c53-4074-aaee-32fae29aadb9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:50.815809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d1a652f-5c53-4074-aaee-32fae29aadb9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:50.816366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d1a652f-5c53-4074-aaee-32fae29aadb9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:50.817291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d1a652f-5c53-4074-aaee-32fae29aadb9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:50.817811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d1a652f-5c53-4074-aaee-32fae29aadb9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:50.873117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-775468d8-99f4-4c98-90dc-7b59386d9212 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:50.898884 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-775468d8-99f4-4c98-90dc-7b59386d9212 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 1.015311 Aug 04 13:57:50.899614 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 623/1240] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:49 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:50.904202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ab5357c-1502-4b65-93bc-d02d21dc05f4 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Calling method '.version_select at 0x7f470044aee0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:50.941790 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-0ab5357c-1502-4b65-93bc-d02d21dc05f4 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] HTTP exception thrown: Image not found. Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ab5357c-1502-4b65-93bc-d02d21dc05f4 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Request method failure captured: Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/images/a6c8ef8c-3526-4ad2-9f04-6073bd0c3c441 HTTP/1.1 Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Bdw8fo78MR2bp-EVwnH5zwYPkYE6p6f4urgnPn_PqbuJOTq3hlyxLljdyHyiLHks8dTltQ8600teCuYBguiLZq8c666i-f2-u0vSOu8pYAhXowiYk2FUY_Tlidxvv-GNBIg00VHrIluSGTsTqN6BVhGwx3-bsSv-FQfskwoV_UgG8 Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:50.945629 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}] Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: a1bf842a0fd046dc824d49b2578c7fb2 Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'a6c8ef8c-3526-4ad2-9f04-6073bd0c3c441'} Aug 04 13:57:50.947685 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a6c8ef8c-3526-4ad2-9f04-6073bd0c3c441 to delete Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:50.948703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6c8ef8c-3526-4ad2-9f04-6073bd0c3c441 could not be found. Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:50.951011 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ab5357c-1502-4b65-93bc-d02d21dc05f4 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:50.953776 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0ab5357c-1502-4b65-93bc-d02d21dc05f4 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] 10.222.0.66 "DELETE /compute/v2.1/images/a6c8ef8c-3526-4ad2-9f04-6073bd0c3c441" status: 404 len: 62 microversion: 2.1 time: 0.047253 Aug 04 13:57:50.964420 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 624/1241] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:57:50 2022] DELETE /compute/v2.1/images/a6c8ef8c-3526-4ad2-9f04-6073bd0c3c441 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:57:50.974696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b3148eb-a38f-4a19-96c9-b2197feb4816 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Calling method '.version_select at 0x7f4700538940>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:51.025026 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8b3148eb-a38f-4a19-96c9-b2197feb4816 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] HTTP exception thrown: Image not found. Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b3148eb-a38f-4a19-96c9-b2197feb4816 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Request method failure captured: Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/images/tempest-invalid-268036283 HTTP/1.1 Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Bdw8fo78MR2bp-EVwnH5zwYPkYE6p6f4urgnPn_PqbuJOTq3hlyxLljdyHyiLHks8dTltQ8600teCuYBguiLZq8c666i-f2-u0vSOu8pYAhXowiYk2FUY_Tlidxvv-GNBIg00VHrIluSGTsTqN6BVhGwx3-bsSv-FQfskwoV_UgG8 Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:51.026945 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}] Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: a1bf842a0fd046dc824d49b2578c7fb2 Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'tempest-invalid-268036283'} Aug 04 13:57:51.028577 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-268036283 to delete Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:51.029534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-268036283 could not be found. Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:51.030852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b3148eb-a38f-4a19-96c9-b2197feb4816 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:51.032509 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8b3148eb-a38f-4a19-96c9-b2197feb4816 tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] 10.222.0.66 "DELETE /compute/v2.1/images/tempest-invalid-268036283" status: 404 len: 62 microversion: 2.1 time: 0.062672 Aug 04 13:57:51.041592 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 625/1242] 10.222.0.66 () {58 vars in 1203 bytes} [Thu Aug 4 13:57:50 2022] DELETE /compute/v2.1/images/tempest-invalid-268036283 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:57:51.046417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-437e03fa-93d1-447c-97c8-69598dedc43e tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Calling method '.version_select at 0x7f4700538040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:51.091441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-7d1a652f-5c53-4074-aaee-32fae29aadb9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lazy-loading 'services' on Instance uuid 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:57:51.100050 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-437e03fa-93d1-447c-97c8-69598dedc43e tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] HTTP exception thrown: Image not found. Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-437e03fa-93d1-447c-97c8-69598dedc43e tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Request method failure captured: Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/images/79f1db82-71cf-42ca-bbb6-20a69bdd67a7 HTTP/1.1 Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Bdw8fo78MR2bp-EVwnH5zwYPkYE6p6f4urgnPn_PqbuJOTq3hlyxLljdyHyiLHks8dTltQ8600teCuYBguiLZq8c666i-f2-u0vSOu8pYAhXowiYk2FUY_Tlidxvv-GNBIg00VHrIluSGTsTqN6BVhGwx3-bsSv-FQfskwoV_UgG8 Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:57:51.102053 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/abf73f777dc54b529fda0e1ba67785c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/abf73f777dc54b529fda0e1ba67785c9"}]}] Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: abf73f777dc54b529fda0e1ba67785c9 Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-814675890 Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: a1bf842a0fd046dc824d49b2578c7fb2 Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-814675890-project Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '79f1db82-71cf-42ca-bbb6-20a69bdd67a7'} Aug 04 13:57:51.104087 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 79f1db82-71cf-42ca-bbb6-20a69bdd67a7 to delete Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:51.105540 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 79f1db82-71cf-42ca-bbb6-20a69bdd67a7 could not be found. Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:57:51.107721 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-437e03fa-93d1-447c-97c8-69598dedc43e tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:57:51.111668 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-437e03fa-93d1-447c-97c8-69598dedc43e tempest-ImagesDeleteNegativeTestJSON-814675890 tempest-ImagesDeleteNegativeTestJSON-814675890-project] 10.222.0.66 "DELETE /compute/v2.1/images/79f1db82-71cf-42ca-bbb6-20a69bdd67a7" status: 404 len: 62 microversion: 2.1 time: 0.061435 Aug 04 13:57:51.115465 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 626/1243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:51 2022] DELETE /compute/v2.1/images/79f1db82-71cf-42ca-bbb6-20a69bdd67a7 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:57:51.124824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0f15ce08-1b4e-4211-a8dc-8e948f9a7644 req-d460cae5-c378-4793-9eab-7b4d03bb8d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde8a455-2bcf-44ca-b5e2-16688470f226", "tag": "03b69f95-f081-4cab-9615-bd7da2ce327d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:57:51.164681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0f15ce08-1b4e-4211-a8dc-8e948f9a7644 req-d460cae5-c378-4793-9eab-7b4d03bb8d6d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:51.165721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0f15ce08-1b4e-4211-a8dc-8e948f9a7644 req-d460cae5-c378-4793-9eab-7b4d03bb8d6d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:51.188054 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0f15ce08-1b4e-4211-a8dc-8e948f9a7644 req-d460cae5-c378-4793-9eab-7b4d03bb8d6d service nova] Creating event network-changed:03b69f95-f081-4cab-9615-bd7da2ce327d for instance bde8a455-2bcf-44ca-b5e2-16688470f226 on n-h2-844627-10 Aug 04 13:57:51.203562 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0f15ce08-1b4e-4211-a8dc-8e948f9a7644 req-d460cae5-c378-4793-9eab-7b4d03bb8d6d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082273 Aug 04 13:57:51.204549 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 627/1244] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:51.357558 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d1a652f-5c53-4074-aaee-32fae29aadb9 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments/8e82f492-dfb7-47ea-a3cb-c3da5734e8d4" status: 202 len: 0 microversion: 2.1 time: 0.557729 Aug 04 13:57:51.359449 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 618/1245] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 13:57:50 2022] DELETE /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments/8e82f492-dfb7-47ea-a3cb-c3da5734e8d4 => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:57:51.937470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22a7cf19-39cf-436c-a806-0824f322c723 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:51.938318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22a7cf19-39cf-436c-a806-0824f322c723 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:51.951156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22a7cf19-39cf-436c-a806-0824f322c723 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:51.960215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22a7cf19-39cf-436c-a806-0824f322c723 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:51.961272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22a7cf19-39cf-436c-a806-0824f322c723 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:51.962488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22a7cf19-39cf-436c-a806-0824f322c723 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:52.388459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22a7cf19-39cf-436c-a806-0824f322c723 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:52.406692 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22a7cf19-39cf-436c-a806-0824f322c723 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 0.476626 Aug 04 13:57:52.409361 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 628/1246] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:51 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:53.434065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1526620-f1cf-4e04-821f-af32695b6f95 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:53.435513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1526620-f1cf-4e04-821f-af32695b6f95 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:53.456223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1526620-f1cf-4e04-821f-af32695b6f95 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:53.461824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1526620-f1cf-4e04-821f-af32695b6f95 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:53.463031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1526620-f1cf-4e04-821f-af32695b6f95 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:53.465464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1526620-f1cf-4e04-821f-af32695b6f95 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:53.898939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c1526620-f1cf-4e04-821f-af32695b6f95 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:53.912501 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1526620-f1cf-4e04-821f-af32695b6f95 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 0.484001 Aug 04 13:57:53.914835 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 619/1247] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:53 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:54.939205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3fde8bef-8bf7-45b1-9f77-022c68c2e596 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:54.940006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3fde8bef-8bf7-45b1-9f77-022c68c2e596 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:54.956391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fde8bef-8bf7-45b1-9f77-022c68c2e596 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:54.959250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fde8bef-8bf7-45b1-9f77-022c68c2e596 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:54.960421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fde8bef-8bf7-45b1-9f77-022c68c2e596 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:54.963084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fde8bef-8bf7-45b1-9f77-022c68c2e596 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:55.923567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3fde8bef-8bf7-45b1-9f77-022c68c2e596 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:55.937344 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3fde8bef-8bf7-45b1-9f77-022c68c2e596 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 1.001580 Aug 04 13:57:55.940809 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 629/1248] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:54 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:56.963861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c423c600-78d1-494d-9edc-6f06347df3f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:56.964676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c423c600-78d1-494d-9edc-6f06347df3f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:57:56.975638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:56.976435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:57.012716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c423c600-78d1-494d-9edc-6f06347df3f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:57.017798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c423c600-78d1-494d-9edc-6f06347df3f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:57.019566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c423c600-78d1-494d-9edc-6f06347df3f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:57.029778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c423c600-78d1-494d-9edc-6f06347df3f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:57.303987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3996e55a-d021-44a4-9f96-d097a0a831db tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002641f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:57.346458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:57:57.422055 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3996e55a-d021-44a4-9f96-d097a0a831db tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/615f1491-5cf3-4b9f-9520-b146a1af5881" status: 200 len: 661 microversion: 2.1 time: 0.121752 Aug 04 13:57:57.424237 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 630/1249] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:57:57 2022] GET /compute/v2.1/images/615f1491-5cf3-4b9f-9520-b146a1af5881 => generated 661 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:57.438672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b2244551-e4f2-4506-a302-c8b83b195f78 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470051b0d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:57.509834 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b2244551-e4f2-4506-a302-c8b83b195f78 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/615f1491-5cf3-4b9f-9520-b146a1af5881" status: 200 len: 661 microversion: 2.1 time: 0.076090 Aug 04 13:57:57.511283 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 631/1250] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:57:57 2022] GET /compute/v2.1/images/615f1491-5cf3-4b9f-9520-b146a1af5881 => generated 661 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:58.980776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c423c600-78d1-494d-9edc-6f06347df3f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:57:58.996316 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c423c600-78d1-494d-9edc-6f06347df3f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 2.040510 Aug 04 13:57:59.003532 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 620/1251] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:57:56 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:57:59.645270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23e346fe-ffc7-4a82-b216-7cfdae4fb325 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470005d1f0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:59.724102 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-23e346fe-ffc7-4a82-b216-7cfdae4fb325 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/e91b2da9-9fbd-4d1a-af9d-00db1e226576" status: 200 len: 662 microversion: 2.1 time: 0.082716 Aug 04 13:57:59.725100 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 621/1252] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:57:59 2022] GET /compute/v2.1/images/e91b2da9-9fbd-4d1a-af9d-00db1e226576 => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:57:59.748915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be244f56-c9e2-45c4-bea8-58753716263d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700046790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:59.768245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af12e150-0e9e-4250-94ca-826d515e5c8e tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Calling method '.version_select at 0x7f4700491670>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:59.769223 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:59.769223 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:57:59.770780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af12e150-0e9e-4250-94ca-826d515e5c8e tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:59.771252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af12e150-0e9e-4250-94ca-826d515e5c8e tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:59.844728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af12e150-0e9e-4250-94ca-826d515e5c8e tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:59.861902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af12e150-0e9e-4250-94ca-826d515e5c8e tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:59.865487 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-be244f56-c9e2-45c4-bea8-58753716263d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/e91b2da9-9fbd-4d1a-af9d-00db1e226576" status: 200 len: 662 microversion: 2.1 time: 0.125626 Aug 04 13:57:59.875160 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 622/1253] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:57:59 2022] GET /compute/v2.1/images/e91b2da9-9fbd-4d1a-af9d-00db1e226576 => generated 662 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:57:59.885757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af12e150-0e9e-4250-94ca-826d515e5c8e tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:59.894818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af12e150-0e9e-4250-94ca-826d515e5c8e tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:59.903080 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af12e150-0e9e-4250-94ca-826d515e5c8e tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.448518 Aug 04 13:57:59.907025 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 632/1254] 10.222.0.66 () {60 vars in 1187 bytes} [Thu Aug 4 13:57:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:57:59.918765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-73cc664c-501c-41da-b094-e8d7f496b523 tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Calling method '.version_select at 0x7f4700080940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:57:59.921587 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:57:59.921587 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 13:57:59.923799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73cc664c-501c-41da-b094-e8d7f496b523 tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:59.927613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73cc664c-501c-41da-b094-e8d7f496b523 tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:59.968141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73cc664c-501c-41da-b094-e8d7f496b523 tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:57:59.969645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73cc664c-501c-41da-b094-e8d7f496b523 tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:57:59.988747 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-73cc664c-501c-41da-b094-e8d7f496b523 tempest-HypervisorAdminV228Test-160609233 tempest-HypervisorAdminV228Test-160609233-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.071324 Aug 04 13:57:59.993301 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 623/1255] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 13:57:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:00.027381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19419b2e-7123-4ef1-803a-3572a67c6c6c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:00.029661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19419b2e-7123-4ef1-803a-3572a67c6c6c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:00.057029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19419b2e-7123-4ef1-803a-3572a67c6c6c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:00.058378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19419b2e-7123-4ef1-803a-3572a67c6c6c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:00.065489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19419b2e-7123-4ef1-803a-3572a67c6c6c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:00.066322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19419b2e-7123-4ef1-803a-3572a67c6c6c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:00.080778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:00.739210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-19419b2e-7123-4ef1-803a-3572a67c6c6c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:00.756531 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19419b2e-7123-4ef1-803a-3572a67c6c6c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 0.730241 Aug 04 13:58:00.760972 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 633/1256] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:00 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:01.562162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff0ff36f-48f5-4235-898e-27e2441ea971 tempest-FloatingIPDetailsNegativeTestJSON-1152084087 tempest-FloatingIPDetailsNegativeTestJSON-1152084087-project] Calling method '.version_select at 0x7f47000eae50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:01.656212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-ff0ff36f-48f5-4235-898e-27e2441ea971 tempest-FloatingIPDetailsNegativeTestJSON-1152084087 tempest-FloatingIPDetailsNegativeTestJSON-1152084087-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2996c21d-7300-49c9-9487-393b179bf639 could not be found", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 13:58:01.657203 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ff0ff36f-48f5-4235-898e-27e2441ea971 tempest-FloatingIPDetailsNegativeTestJSON-1152084087 tempest-FloatingIPDetailsNegativeTestJSON-1152084087-project] HTTP exception thrown: Floating IP not found for ID 2996c21d-7300-49c9-9487-393b179bf639 Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff0ff36f-48f5-4235-898e-27e2441ea971 tempest-FloatingIPDetailsNegativeTestJSON-1152084087 tempest-FloatingIPDetailsNegativeTestJSON-1152084087-project] Request method failure captured: Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-floating-ips/2996c21d-7300-49c9-9487-393b179bf639 HTTP/1.1 Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69BpxfLIt_bLilN8CaZfn18fZX6Z97quKF5BkTT_sSgz-uzZxEuFKKWMF5VXaGNU7mSpFSMnft5hMsMmuRh5wnEJ1l5Hk17d920K0MoI-0sP3HjGDR2R5KFY8kiG8V_hAIhHwX4PWwncTdZtTj9dIAJb-91GH2DlgTuQM_c4emM9WM8 Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 40a9a7a690724e159e82f70820b09478 Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1152084087 Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:58:01.675909 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40a9a7a690724e159e82f70820b09478"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_40a9a7a690724e159e82f70820b09478"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/40a9a7a690724e159e82f70820b09478"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/40a9a7a690724e159e82f70820b09478"}]}] Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1152084087 Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 40a9a7a690724e159e82f70820b09478 Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1152084087 Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1152084087-project Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c3774b590bff4309a07f2e265c31e925 Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1152084087-project Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: exception: Floating IP not found for ID 2996c21d-7300-49c9-9487-393b179bf639 Aug 04 13:58:01.677659 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '2996c21d-7300-49c9-9487-393b179bf639'} Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:01.678529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2996c21d-7300-49c9-9487-393b179bf639 could not be found Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-159affc9-0a92-408f-8f56-70a5d618d84f'] Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2996c21d-7300-49c9-9487-393b179bf639. Aug 04 13:58:01.681153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2996c21d-7300-49c9-9487-393b179bf639 Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:01.682663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:58:01.684314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:58:01.684314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2996c21d-7300-49c9-9487-393b179bf639 Aug 04 13:58:01.684314 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:01.684314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff0ff36f-48f5-4235-898e-27e2441ea971 tempest-FloatingIPDetailsNegativeTestJSON-1152084087 tempest-FloatingIPDetailsNegativeTestJSON-1152084087-project] Returning 404 to user: Floating IP not found for ID 2996c21d-7300-49c9-9487-393b179bf639 {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:58:01.685263 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff0ff36f-48f5-4235-898e-27e2441ea971 tempest-FloatingIPDetailsNegativeTestJSON-1152084087 tempest-FloatingIPDetailsNegativeTestJSON-1152084087-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/2996c21d-7300-49c9-9487-393b179bf639" status: 404 len: 111 microversion: 2.1 time: 0.399864 Aug 04 13:58:01.686433 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 624/1257] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 13:58:01 2022] GET /compute/v2.1/os-floating-ips/2996c21d-7300-49c9-9487-393b179bf639 => generated 111 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:58:01.739702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f56b2f6d-2667-4838-b594-493f9998a900 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:01.743114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f56b2f6d-2667-4838-b594-493f9998a900 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:01.767894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f56b2f6d-2667-4838-b594-493f9998a900 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:01.768613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f56b2f6d-2667-4838-b594-493f9998a900 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:01.772179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f56b2f6d-2667-4838-b594-493f9998a900 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:01.774531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f56b2f6d-2667-4838-b594-493f9998a900 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:01.852464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:01.891194 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f56b2f6d-2667-4838-b594-493f9998a900 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.159240 Aug 04 13:58:01.893911 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 625/1258] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 13:58:01 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments => generated 25 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 13:58:01.920855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-34cf1fd6-39f0-4f87-864d-e9b01b78f006 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:01.924634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-34cf1fd6-39f0-4f87-864d-e9b01b78f006 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:01.948759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34cf1fd6-39f0-4f87-864d-e9b01b78f006 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:01.950410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34cf1fd6-39f0-4f87-864d-e9b01b78f006 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:01.955274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34cf1fd6-39f0-4f87-864d-e9b01b78f006 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:01.956709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34cf1fd6-39f0-4f87-864d-e9b01b78f006 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:02.137125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-43474095", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "8d424dee-b56a-4c3f-bb38-75c235d11e5a"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:02.221446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] validate_networks() for [('8d424dee-b56a-4c3f-bb38-75c235d11e5a', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:58:02.501978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34cf1fd6-39f0-4f87-864d-e9b01b78f006 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:02.519380 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-34cf1fd6-39f0-4f87-864d-e9b01b78f006 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 0.622799 Aug 04 13:58:02.521233 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 626/1259] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:01 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:02.538883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0edc501b-abd0-4875-91c0-748ba42c86dd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:02.542757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0edc501b-abd0-4875-91c0-748ba42c86dd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:02.560513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0edc501b-abd0-4875-91c0-748ba42c86dd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:02.561115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0edc501b-abd0-4875-91c0-748ba42c86dd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:02.562148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0edc501b-abd0-4875-91c0-748ba42c86dd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:02.562805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0edc501b-abd0-4875-91c0-748ba42c86dd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:02.609204 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0edc501b-abd0-4875-91c0-748ba42c86dd tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084046 Aug 04 13:58:02.610607 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 627/1260] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 13:58:02 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:58:02.622854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cf60dd83-ef40-4279-ae06-921a43b84bc0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700046310>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:02.696479 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cf60dd83-ef40-4279-ae06-921a43b84bc0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/e7b6a0ac-f8b4-4e7b-952b-6f7487898421" status: 200 len: 661 microversion: 2.1 time: 0.083349 Aug 04 13:58:02.697362 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 628/1261] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:02 2022] GET /compute/v2.1/images/e7b6a0ac-f8b4-4e7b-952b-6f7487898421 => generated 661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:02.702007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f865d2fa-e977-48ff-acc9-7b3071c530a2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:02.702513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f865d2fa-e977-48ff-acc9-7b3071c530a2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:02.714693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f865d2fa-e977-48ff-acc9-7b3071c530a2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:02.715149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f865d2fa-e977-48ff-acc9-7b3071c530a2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:02.715918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f865d2fa-e977-48ff-acc9-7b3071c530a2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:02.716531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f865d2fa-e977-48ff-acc9-7b3071c530a2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:02.747417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f865d2fa-e977-48ff-acc9-7b3071c530a2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:58:02.886094 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f865d2fa-e977-48ff-acc9-7b3071c530a2 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 204 len: 0 microversion: 2.1 time: 0.187212 Aug 04 13:58:02.887062 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 629/1262] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:58:02 2022] DELETE /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:58:02.894379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5ace3707-ade6-45d6-b2cb-2ee47313f972 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47000465e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:02.974239 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5ace3707-ade6-45d6-b2cb-2ee47313f972 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/e7b6a0ac-f8b4-4e7b-952b-6f7487898421" status: 200 len: 661 microversion: 2.1 time: 0.085080 Aug 04 13:58:02.975460 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 630/1263] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:02 2022] GET /compute/v2.1/images/e7b6a0ac-f8b4-4e7b-952b-6f7487898421 => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:02.994640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8669787a-a819-4384-968d-6c95392afda3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:02.995705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8669787a-a819-4384-968d-6c95392afda3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:03.035431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8669787a-a819-4384-968d-6c95392afda3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:03.036118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8669787a-a819-4384-968d-6c95392afda3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:03.037728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8669787a-a819-4384-968d-6c95392afda3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:03.042130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8669787a-a819-4384-968d-6c95392afda3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:03.604189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:58:03.605259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:58:03.606950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:58:03.614593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:58:03.615045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:58:03.669423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:03.675822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:03.677562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:03.678232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:03.754578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Getting quotas for project 4a0a4ae5d6de48b2bd1203bd6c3922b4. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:58:03.761147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Getting quotas for user e7461bc7dc404890b64fc7b71fdcbd94 and project 4a0a4ae5d6de48b2bd1203bd6c3922b4. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:58:03.780019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8669787a-a819-4384-968d-6c95392afda3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:03.786396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:58:03.790644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:58:03.800700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8669787a-a819-4384-968d-6c95392afda3 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1681 microversion: 2.1 time: 0.823694 Aug 04 13:58:03.801344 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 631/1264] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:02 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1681 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:03.828522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1008006982", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:03.883836 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-28640dea-18d9-4602-8b9b-0d3d6841f665 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.285712 Aug 04 13:58:03.884999 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 634/1265] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:58:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:58:03.896319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac5e504f-18e6-47dd-8c0f-2ea4d42eaa59 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:03.897535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ac5e504f-18e6-47dd-8c0f-2ea4d42eaa59 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:03.914061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac5e504f-18e6-47dd-8c0f-2ea4d42eaa59 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:03.914373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac5e504f-18e6-47dd-8c0f-2ea4d42eaa59 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:03.915527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac5e504f-18e6-47dd-8c0f-2ea4d42eaa59 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:03.923930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac5e504f-18e6-47dd-8c0f-2ea4d42eaa59 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:03.933353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:58:05.117737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:58:05.118987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:58:05.120579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:58:05.122308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:58:05.123349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:58:05.151447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:05.164318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:05.167577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:05.168195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:05.211753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:05.225801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Getting quotas for project 1b0e9ddfb4d04991834cb85bc7693736. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:58:05.247849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Getting quotas for user 352ca66812034cceb38694b98993fab5 and project 1b0e9ddfb4d04991834cb85bc7693736. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:58:05.279272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:58:05.287973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:58:05.438451 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-26af6be0-b572-4bd6-873c-51cf28471fbb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621462 Aug 04 13:58:05.440480 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 632/1266] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:58:05.452251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ac5e504f-18e6-47dd-8c0f-2ea4d42eaa59 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:05.469722 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac5e504f-18e6-47dd-8c0f-2ea4d42eaa59 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 1.580876 Aug 04 13:58:05.474799 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 635/1267] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:03 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:05.478035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b5b41122-4f80-442d-b95c-727e6503e0fa req-7a8647f6-275c-4536-bf69-4f9f6da2e11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8a455-2bcf-44ca-b5e2-16688470f226", "name": "network-vif-plugged", "status": "completed", "tag": "03b69f95-f081-4cab-9615-bd7da2ce327d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:05.494792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6ec5359e-a03f-4a5c-9955-40e81f831717 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:05.499722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6ec5359e-a03f-4a5c-9955-40e81f831717 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:05.518984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b5b41122-4f80-442d-b95c-727e6503e0fa req-7a8647f6-275c-4536-bf69-4f9f6da2e11e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:05.521881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b5b41122-4f80-442d-b95c-727e6503e0fa req-7a8647f6-275c-4536-bf69-4f9f6da2e11e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:05.541648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ec5359e-a03f-4a5c-9955-40e81f831717 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:05.542108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ec5359e-a03f-4a5c-9955-40e81f831717 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:05.552835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ec5359e-a03f-4a5c-9955-40e81f831717 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:05.554195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ec5359e-a03f-4a5c-9955-40e81f831717 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:05.561376 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b5b41122-4f80-442d-b95c-727e6503e0fa req-7a8647f6-275c-4536-bf69-4f9f6da2e11e service nova] Creating event network-vif-plugged:03b69f95-f081-4cab-9615-bd7da2ce327d for instance bde8a455-2bcf-44ca-b5e2-16688470f226 on n-h2-844627-10 Aug 04 13:58:05.570905 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b5b41122-4f80-442d-b95c-727e6503e0fa req-7a8647f6-275c-4536-bf69-4f9f6da2e11e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127186 Aug 04 13:58:05.572593 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 633/1268] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:05.598253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a92f53f2-d739-4553-be83-6161c91c933e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:05.600722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a92f53f2-d739-4553-be83-6161c91c933e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:05.646946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a92f53f2-d739-4553-be83-6161c91c933e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:05.652207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a92f53f2-d739-4553-be83-6161c91c933e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:05.658954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a92f53f2-d739-4553-be83-6161c91c933e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:05.661132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a92f53f2-d739-4553-be83-6161c91c933e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:06.131553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6ec5359e-a03f-4a5c-9955-40e81f831717 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:06.141082 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6ec5359e-a03f-4a5c-9955-40e81f831717 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1290 microversion: 2.1 time: 0.664591 Aug 04 13:58:06.146966 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 636/1269] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:05 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1290 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:06.213250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1152495507", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:06.383330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:58:06.933078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a92f53f2-d739-4553-be83-6161c91c933e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:06.943253 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a92f53f2-d739-4553-be83-6161c91c933e tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1681 microversion: 2.1 time: 1.369109 Aug 04 13:58:06.959399 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 634/1270] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:05 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1681 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:06.965206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-954ad723-0719-4734-8467-36461d1e082b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:06.981393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-954ad723-0719-4734-8467-36461d1e082b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:07.013810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-954ad723-0719-4734-8467-36461d1e082b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:07.023918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-954ad723-0719-4734-8467-36461d1e082b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:07.025008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-954ad723-0719-4734-8467-36461d1e082b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:07.025593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-954ad723-0719-4734-8467-36461d1e082b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:08.000428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:58:08.001494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:58:08.002294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:58:08.003330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:58:08.003456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:58:08.018929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:08.020627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:08.023004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:08.026335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:08.070491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Getting quotas for project 1b0e9ddfb4d04991834cb85bc7693736. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:58:08.085131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Getting quotas for user 352ca66812034cceb38694b98993fab5 and project 1b0e9ddfb4d04991834cb85bc7693736. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:58:08.127601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:58:08.130990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:58:08.226066 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a971e2f3-684c-4ba9-b643-4f1be82cffe0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.077616 Aug 04 13:58:08.227826 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 637/1271] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:58:08.233827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-809f0f66-3939-4e57-8afe-db72355df7e2 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:08.234504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-809f0f66-3939-4e57-8afe-db72355df7e2 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:08.242068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:08.244504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-809f0f66-3939-4e57-8afe-db72355df7e2 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:08.245686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-809f0f66-3939-4e57-8afe-db72355df7e2 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:08.246784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-809f0f66-3939-4e57-8afe-db72355df7e2 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:08.247529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-809f0f66-3939-4e57-8afe-db72355df7e2 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:08.306722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-954ad723-0719-4734-8467-36461d1e082b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.315034 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-954ad723-0719-4734-8467-36461d1e082b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1313 microversion: 2.1 time: 1.353655 Aug 04 13:58:08.315623 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 635/1272] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:06 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1313 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:08.324937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6fbf564d-4692-4fc5-a161-1fe8acca39ae tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:08.336806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6fbf564d-4692-4fc5-a161-1fe8acca39ae tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:08.377892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fbf564d-4692-4fc5-a161-1fe8acca39ae tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:08.384436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fbf564d-4692-4fc5-a161-1fe8acca39ae tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:08.386382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fbf564d-4692-4fc5-a161-1fe8acca39ae tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:08.387463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fbf564d-4692-4fc5-a161-1fe8acca39ae tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:08.529816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-809f0f66-3939-4e57-8afe-db72355df7e2 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.540541 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-809f0f66-3939-4e57-8afe-db72355df7e2 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1288 microversion: 2.1 time: 0.311760 Aug 04 13:58:08.541163 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 638/1273] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:08 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1288 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:08.567973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b59c04db-8e90-43fa-b313-7fc3a8eda922 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:08.569473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b59c04db-8e90-43fa-b313-7fc3a8eda922 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:08.851868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b59c04db-8e90-43fa-b313-7fc3a8eda922 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:08.873640 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b59c04db-8e90-43fa-b313-7fc3a8eda922 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1218 microversion: 2.1 time: 0.323303 Aug 04 13:58:08.876213 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 639/1274] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:08 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1218 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:08.887342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-1c37ca70-67e0-4957-b5d6-c3aac4d84d34 req-161fd202-dfd3-4dfc-ae1e-2ac412d623c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9e1d4b-b8b1-44de-9409-65db8223e4b2", "name": "network-vif-unplugged", "status": "completed", "tag": "dddc2305-f311-4ae1-af98-ee954b3cd677"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:08.922540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1c37ca70-67e0-4957-b5d6-c3aac4d84d34 req-161fd202-dfd3-4dfc-ae1e-2ac412d623c6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:08.923570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1c37ca70-67e0-4957-b5d6-c3aac4d84d34 req-161fd202-dfd3-4dfc-ae1e-2ac412d623c6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:08.954563 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-1c37ca70-67e0-4957-b5d6-c3aac4d84d34 req-161fd202-dfd3-4dfc-ae1e-2ac412d623c6 service nova] Creating event network-vif-unplugged:dddc2305-f311-4ae1-af98-ee954b3cd677 for instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 on n-h1-844627-10 Aug 04 13:58:08.966642 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-1c37ca70-67e0-4957-b5d6-c3aac4d84d34 req-161fd202-dfd3-4dfc-ae1e-2ac412d623c6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088854 Aug 04 13:58:08.972106 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 640/1275] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:09.287012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e53d3b8-6016-455f-91f0-6154c0e1707d tempest-InstanceUsageAuditLogTestJSON-234793663 tempest-InstanceUsageAuditLogTestJSON-234793663-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:09.287853 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:09.287853 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:58:09.293501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6fbf564d-4692-4fc5-a161-1fe8acca39ae tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:09.306711 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6fbf564d-4692-4fc5-a161-1fe8acca39ae tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1681 microversion: 2.1 time: 0.985540 Aug 04 13:58:09.307644 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 636/1276] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:08 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1681 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:09.341313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-acaab86f-e9a0-4fbc-85a3-0d7eb79bea34 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:09.341938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-acaab86f-e9a0-4fbc-85a3-0d7eb79bea34 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:09.348420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-acaab86f-e9a0-4fbc-85a3-0d7eb79bea34 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:09.349032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-acaab86f-e9a0-4fbc-85a3-0d7eb79bea34 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:09.364472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-acaab86f-e9a0-4fbc-85a3-0d7eb79bea34 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:09.365155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-acaab86f-e9a0-4fbc-85a3-0d7eb79bea34 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:09.373864 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e53d3b8-6016-455f-91f0-6154c0e1707d tempest-InstanceUsageAuditLogTestJSON-234793663 tempest-InstanceUsageAuditLogTestJSON-234793663-project-admin] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04 13:58:08" status: 200 len: 318 microversion: 2.1 time: 0.371799 Aug 04 13:58:09.377762 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 641/1277] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 13:58:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2013%3A58%3A08 => generated 318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:09.400426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-342bfcaa-f78f-47bd-955e-ad3a8abfec3a tempest-InstanceUsageAuditLogTestJSON-234793663 tempest-InstanceUsageAuditLogTestJSON-234793663-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:09.404413 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:09.404413 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:58:09.458793 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-342bfcaa-f78f-47bd-955e-ad3a8abfec3a tempest-InstanceUsageAuditLogTestJSON-234793663 tempest-InstanceUsageAuditLogTestJSON-234793663-project-admin] 10.222.0.66 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.066423 Aug 04 13:58:09.461352 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 642/1278] 10.222.0.66 () {58 vars in 1185 bytes} [Thu Aug 4 13:58:09 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:09.578958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a1b1ec24-cd78-4d56-868a-831917a8a008 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:09.580253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a1b1ec24-cd78-4d56-868a-831917a8a008 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:09.603469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1b1ec24-cd78-4d56-868a-831917a8a008 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:09.605784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1b1ec24-cd78-4d56-868a-831917a8a008 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:09.608988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1b1ec24-cd78-4d56-868a-831917a8a008 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:09.610686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1b1ec24-cd78-4d56-868a-831917a8a008 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:10.139048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a1b1ec24-cd78-4d56-868a-831917a8a008 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.165695 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a1b1ec24-cd78-4d56-868a-831917a8a008 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.598588 Aug 04 13:58:10.167159 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 643/1279] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:09 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:10.233872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-acaab86f-e9a0-4fbc-85a3-0d7eb79bea34 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.246422 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-acaab86f-e9a0-4fbc-85a3-0d7eb79bea34 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1463 microversion: 2.1 time: 0.912222 Aug 04 13:58:10.281416 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 637/1280] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:09 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1463 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:10.306586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-63e80ef8-8d6d-4439-ac09-bee7e2103d29 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:10.307919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-63e80ef8-8d6d-4439-ac09-bee7e2103d29 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:10.337238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63e80ef8-8d6d-4439-ac09-bee7e2103d29 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:10.339246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63e80ef8-8d6d-4439-ac09-bee7e2103d29 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:10.341610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63e80ef8-8d6d-4439-ac09-bee7e2103d29 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:10.344956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63e80ef8-8d6d-4439-ac09-bee7e2103d29 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:10.594811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-63e80ef8-8d6d-4439-ac09-bee7e2103d29 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.606961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0c9fba3-eb89-4155-8bc0-e873dafebe0a tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] Calling method '.version_select at 0x7f47004d1c10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:10.616861 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-63e80ef8-8d6d-4439-ac09-bee7e2103d29 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1278 microversion: 2.1 time: 0.329933 Aug 04 13:58:10.618045 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 638/1281] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:10 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1278 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:10.623581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3f762ff2-97df-49a5-98ea-02b84186ed87 req-4317ec4f-f6f0-4424-8c9f-d6c98cffa7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9e1d4b-b8b1-44de-9409-65db8223e4b2", "name": "network-vif-deleted", "tag": "dddc2305-f311-4ae1-af98-ee954b3cd677"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:10.640071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3f762ff2-97df-49a5-98ea-02b84186ed87 req-4317ec4f-f6f0-4424-8c9f-d6c98cffa7d6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:10.651504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3f762ff2-97df-49a5-98ea-02b84186ed87 req-4317ec4f-f6f0-4424-8c9f-d6c98cffa7d6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:10.703692 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3f762ff2-97df-49a5-98ea-02b84186ed87 req-4317ec4f-f6f0-4424-8c9f-d6c98cffa7d6 service nova] Creating event network-vif-deleted:dddc2305-f311-4ae1-af98-ee954b3cd677 for instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 on n-h1-844627-10 Aug 04 13:58:10.711611 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3f762ff2-97df-49a5-98ea-02b84186ed87 req-4317ec4f-f6f0-4424-8c9f-d6c98cffa7d6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090441 Aug 04 13:58:10.713079 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 639/1282] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:10.719730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a131fffe-4c2f-46ac-97a2-0acada5c8d2b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:10.721447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a131fffe-4c2f-46ac-97a2-0acada5c8d2b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:10.729468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a131fffe-4c2f-46ac-97a2-0acada5c8d2b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:10.730632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a131fffe-4c2f-46ac-97a2-0acada5c8d2b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:10.732017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a131fffe-4c2f-46ac-97a2-0acada5c8d2b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:10.732730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a131fffe-4c2f-46ac-97a2-0acada5c8d2b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:10.747110 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0c9fba3-eb89-4155-8bc0-e873dafebe0a tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.578287 Aug 04 13:58:10.749712 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 644/1283] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 13:58:10 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:58:10.767225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:10.769482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:10.784774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:10.786528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:10.790167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:10.791525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:10.855450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:10.856511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:10.857523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lazy-loading 'fault' on Instance uuid 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:58:10.973163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f51c32e1dd7438bac9feb8e38975452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6bc03c5e3934e81adecc7004e0e87f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:10.984758 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-15cf744b-da82-4b21-aafb-5f3083af9a86 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 200 len: 1331 microversion: 2.1 time: 0.233598 Aug 04 13:58:10.986850 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 645/1284] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:10 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 1331 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:11.004732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4516ec0-f534-4def-9b5b-f089ec3b10be tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] Action: 'create', calling method: .version_select at 0x7f47004d1af0>, body: {"pool": "non_exist_pool"} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:11.564436 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f4516ec0-f534-4def-9b5b-f089ec3b10be tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] HTTP exception thrown: Floating IP pool not found. Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4516ec0-f534-4def-9b5b-f089ec3b10be tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] Request method failure captured: Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 26 Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69BxlKOLWAwUl0X1kz9LqmzYZB-0YQhnCLpweOFLbj66KmKZDeWoUH4miHoAJu8xMSpNKgJ_DK-CvPNltf6NzaZuiFhaVf_Fed2fkzSYZx6EmBH4RRwrID4l9NW73ZQ9QyvXAUxTl_cQOubA0nYMOKfhGN21vrkbN3F5Oyz_X-MGvBc Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 79dcd4e9c1f14e928f6889fd7d7b8181 Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-365176807 Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:58:11.567283 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/79dcd4e9c1f14e928f6889fd7d7b8181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_79dcd4e9c1f14e928f6889fd7d7b8181"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/79dcd4e9c1f14e928f6889fd7d7b8181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/79dcd4e9c1f14e928f6889fd7d7b8181"}]}] Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-365176807 Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 79dcd4e9c1f14e928f6889fd7d7b8181 Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-365176807 Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FloatingIPsNegativeTestJSON-365176807-project Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7a6b66a5e7d24a9d8d9f3dd517355d8f Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-365176807-project Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: {"pool": "non_exist_pool"} Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: exception: Floating IP pool not found. Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 04 13:58:11.569008 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:58:11.570443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4516ec0-f534-4def-9b5b-f089ec3b10be tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] Returning 404 to user: Floating IP pool not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:58:11.573049 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4516ec0-f534-4def-9b5b-f089ec3b10be tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.580370 Aug 04 13:58:11.575139 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 646/1285] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 13:58:10 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 588 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:58:11.580275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0455f56d-7d2d-42a7-b207-9c30bde65a2f tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:11.580933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0455f56d-7d2d-42a7-b207-9c30bde65a2f tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:11.588966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0455f56d-7d2d-42a7-b207-9c30bde65a2f tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:11.589658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0455f56d-7d2d-42a7-b207-9c30bde65a2f tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:11.590791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0455f56d-7d2d-42a7-b207-9c30bde65a2f tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:11.591412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0455f56d-7d2d-42a7-b207-9c30bde65a2f tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:11.716191 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a131fffe-4c2f-46ac-97a2-0acada5c8d2b tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1616 microversion: 2.1 time: 1.001549 Aug 04 13:58:11.725071 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 640/1286] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:10 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1616 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:11.732580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e062a9aa-6d0a-495b-b40b-7daa84ef427e tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] Calling method '.version_select at 0x7f4700264c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:11.838101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-e062a9aa-6d0a-495b-b40b-7daa84ef427e tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2 could not be found", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 13:58:11.838995 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-e062a9aa-6d0a-495b-b40b-7daa84ef427e tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] HTTP exception thrown: Floating IP not found for ID d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2 Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e062a9aa-6d0a-495b-b40b-7daa84ef427e tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] Request method failure captured: Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-floating-ips/d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2 HTTP/1.1 Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69BxlKOLWAwUl0X1kz9LqmzYZB-0YQhnCLpweOFLbj66KmKZDeWoUH4miHoAJu8xMSpNKgJ_DK-CvPNltf6NzaZuiFhaVf_Fed2fkzSYZx6EmBH4RRwrID4l9NW73ZQ9QyvXAUxTl_cQOubA0nYMOKfhGN21vrkbN3F5Oyz_X-MGvBc Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 79dcd4e9c1f14e928f6889fd7d7b8181 Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-365176807 Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:58:11.843410 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/79dcd4e9c1f14e928f6889fd7d7b8181"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_79dcd4e9c1f14e928f6889fd7d7b8181"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/79dcd4e9c1f14e928f6889fd7d7b8181"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/79dcd4e9c1f14e928f6889fd7d7b8181"}]}] Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-365176807 Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 79dcd4e9c1f14e928f6889fd7d7b8181 Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-365176807 Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FloatingIPsNegativeTestJSON-365176807-project Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 7a6b66a5e7d24a9d8d9f3dd517355d8f Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-365176807-project Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: exception: Floating IP not found for ID d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2 Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'd45fbcdb-dff9-48a9-8f41-fe0fc676f1d2'} Aug 04 13:58:11.848446 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 13:58:11.849541 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2 could not be found Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4dd1e85-eb1f-41a2-a38b-780e00086856'] Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2. Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:11.850890 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2 Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:58:11.852221 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:58:11.854516 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2 Aug 04 13:58:11.854516 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:11.855863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e062a9aa-6d0a-495b-b40b-7daa84ef427e tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] Returning 404 to user: Floating IP not found for ID d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2 {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:58:11.856938 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e062a9aa-6d0a-495b-b40b-7daa84ef427e tempest-FloatingIPsNegativeTestJSON-365176807 tempest-FloatingIPsNegativeTestJSON-365176807-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2" status: 404 len: 111 microversion: 2.1 time: 0.130054 Aug 04 13:58:11.858344 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 641/1287] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 13:58:11 2022] DELETE /compute/v2.1/os-floating-ips/d45fbcdb-dff9-48a9-8f41-fe0fc676f1d2 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:58:11.870915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bec99f4f-d7f9-4812-8dfe-1cd8c68e902e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:11.871803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bec99f4f-d7f9-4812-8dfe-1cd8c68e902e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:11.890263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bec99f4f-d7f9-4812-8dfe-1cd8c68e902e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:11.893249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bec99f4f-d7f9-4812-8dfe-1cd8c68e902e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:11.897966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bec99f4f-d7f9-4812-8dfe-1cd8c68e902e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:11.898648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bec99f4f-d7f9-4812-8dfe-1cd8c68e902e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:12.124196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0455f56d-7d2d-42a7-b207-9c30bde65a2f tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:12.137590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bec99f4f-d7f9-4812-8dfe-1cd8c68e902e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:12.147388 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bec99f4f-d7f9-4812-8dfe-1cd8c68e902e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1276 microversion: 2.1 time: 0.287785 Aug 04 13:58:12.148529 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 642/1288] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:11 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:12.150058 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0455f56d-7d2d-42a7-b207-9c30bde65a2f tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.556515 Aug 04 13:58:12.157119 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 647/1289] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:11 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:12.162899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:12.165882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:12.167030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:12.173559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:12.180726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:12.180913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:12.181350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:12.181465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:12.182154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:12.182272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:12.182597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:12.182760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:12.202559 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] HTTP exception thrown: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Request method failure captured: Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 HTTP/1.1 Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-XH1ToVcSfxwieDPwgGx3PoGrJSVxXUg4LMpzwi5yHMKbiVfQjQtid0Qf2B31_nWavBebT3LSrp0Om9MIvw2vtSROcHH8_ptw-BfeboDt19wWGt66rB3w45A5vmTx0DyZKgS5w8Q90lWY3jZH0sVpjkjHGMBCDGeUq5KvjNr88LP8 Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c6bc03c5e3934e81adecc7004e0e87f0 Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1660958208 Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:58:12.204911 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c6bc03c5e3934e81adecc7004e0e87f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c6bc03c5e3934e81adecc7004e0e87f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c6bc03c5e3934e81adecc7004e0e87f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c6bc03c5e3934e81adecc7004e0e87f0"}]}] Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1660958208 Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c6bc03c5e3934e81adecc7004e0e87f0 Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1660958208 Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachSCSIVolumeTestJSON-1660958208-project Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7f51c32e1dd7438bac9feb8e38975452 Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1660958208-project Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:12.206382 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3b9e1d4b-b8b1-44de-9409-65db8223e4b2'} Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:58:12.207157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:12.208398 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:12.212933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Returning 404 to user: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:58:12.216753 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f209145-b167-4fbc-981a-2ba46479d2ec tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 404 len: 111 microversion: 2.1 time: 0.063715 Aug 04 13:58:12.218400 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 648/1290] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:12 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:58:12.229201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df6f5456-c48c-44b8-9253-b32f3ba3d9b7 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '.version_select at 0x7f4700bb7790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:12.255929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6006f04353b541b6b4013236f34bfa33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3550ddad584a4ca8a2ad864c2aa63b2a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:12.256537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] flavor_id is None. Assuming migration. {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 13:58:12.257547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 13:58:12.262534 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-df6f5456-c48c-44b8-9253-b32f3ba3d9b7 tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117328771" status: 202 len: 0 microversion: 2.1 time: 0.038378 Aug 04 13:58:12.263997 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 649/1291] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 13:58:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117328771 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:12.469316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:12.502796 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4133d2b3-8ede-400b-94ed-e9c03a6e0140 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226/action" status: 202 len: 0 microversion: 2.1 time: 0.353094 Aug 04 13:58:12.508982 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 643/1292] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:58:12 2022] POST /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:12.517417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-734540b0-4ff0-410c-95f4-4f02d32a50c5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:12.518213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-734540b0-4ff0-410c-95f4-4f02d32a50c5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:12.529560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-734540b0-4ff0-410c-95f4-4f02d32a50c5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:12.530472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-734540b0-4ff0-410c-95f4-4f02d32a50c5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:12.535645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-734540b0-4ff0-410c-95f4-4f02d32a50c5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:12.536505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-734540b0-4ff0-410c-95f4-4f02d32a50c5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:13.172721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f086aaec-0771-4b59-93d8-85cf83431d69 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:13.174178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f086aaec-0771-4b59-93d8-85cf83431d69 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:13.198220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f086aaec-0771-4b59-93d8-85cf83431d69 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:13.205949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f086aaec-0771-4b59-93d8-85cf83431d69 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:13.206875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f086aaec-0771-4b59-93d8-85cf83431d69 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:13.207501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f086aaec-0771-4b59-93d8-85cf83431d69 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:13.223103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-734540b0-4ff0-410c-95f4-4f02d32a50c5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:13.267662 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-734540b0-4ff0-410c-95f4-4f02d32a50c5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1472 microversion: 2.1 time: 0.753860 Aug 04 13:58:13.268754 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 650/1293] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:12 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1472 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:13.297854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-78311e9c-4223-40c1-9d46-75e191405c01 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:13.299549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-78311e9c-4223-40c1-9d46-75e191405c01 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:13.317975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78311e9c-4223-40c1-9d46-75e191405c01 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:13.319010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78311e9c-4223-40c1-9d46-75e191405c01 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:13.321561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78311e9c-4223-40c1-9d46-75e191405c01 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:13.323562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78311e9c-4223-40c1-9d46-75e191405c01 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:13.488844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f086aaec-0771-4b59-93d8-85cf83431d69 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:13.513145 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f086aaec-0771-4b59-93d8-85cf83431d69 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1276 microversion: 2.1 time: 0.345562 Aug 04 13:58:13.515794 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 644/1294] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:13 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1276 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:13.786736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0d1ea536-4109-44b7-8b9f-83fa732f858b req-77632e2f-7d32-4472-a250-cc2cfbaa1aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b22ae8-b4dd-4cca-86c3-460706c29630", "tag": "ee449665-121c-4ded-86dc-319178276579"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:13.815349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0d1ea536-4109-44b7-8b9f-83fa732f858b req-77632e2f-7d32-4472-a250-cc2cfbaa1aaf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:13.816318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0d1ea536-4109-44b7-8b9f-83fa732f858b req-77632e2f-7d32-4472-a250-cc2cfbaa1aaf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:13.831690 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0d1ea536-4109-44b7-8b9f-83fa732f858b req-77632e2f-7d32-4472-a250-cc2cfbaa1aaf service nova] Creating event network-changed:ee449665-121c-4ded-86dc-319178276579 for instance 11b22ae8-b4dd-4cca-86c3-460706c29630 on n-h1-844627-10 Aug 04 13:58:13.873047 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0d1ea536-4109-44b7-8b9f-83fa732f858b req-77632e2f-7d32-4472-a250-cc2cfbaa1aaf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100998 Aug 04 13:58:13.882271 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 645/1295] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:14.232960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-78311e9c-4223-40c1-9d46-75e191405c01 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:14.253334 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-78311e9c-4223-40c1-9d46-75e191405c01 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.982519 Aug 04 13:58:14.271600 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 651/1296] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:13 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:14.290871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d461a807-3dd5-4df2-9ad2-5e89f37eb7d7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:14.292182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d461a807-3dd5-4df2-9ad2-5e89f37eb7d7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:14.307872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d461a807-3dd5-4df2-9ad2-5e89f37eb7d7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:14.309497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d461a807-3dd5-4df2-9ad2-5e89f37eb7d7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:14.310534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d461a807-3dd5-4df2-9ad2-5e89f37eb7d7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:14.313394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d461a807-3dd5-4df2-9ad2-5e89f37eb7d7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:14.536758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7ff3ca90-1b7b-4637-a982-54ad3b8353e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:14.537545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7ff3ca90-1b7b-4637-a982-54ad3b8353e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:14.568316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ff3ca90-1b7b-4637-a982-54ad3b8353e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:14.571953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ff3ca90-1b7b-4637-a982-54ad3b8353e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:14.574292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ff3ca90-1b7b-4637-a982-54ad3b8353e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:14.576397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ff3ca90-1b7b-4637-a982-54ad3b8353e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:14.766753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d461a807-3dd5-4df2-9ad2-5e89f37eb7d7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:14.795705 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d461a807-3dd5-4df2-9ad2-5e89f37eb7d7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1472 microversion: 2.1 time: 0.502184 Aug 04 13:58:14.798082 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 646/1297] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:14 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1472 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:15.153008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7ff3ca90-1b7b-4637-a982-54ad3b8353e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:15.165905 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7ff3ca90-1b7b-4637-a982-54ad3b8353e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 0.633625 Aug 04 13:58:15.166520 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 652/1298] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:14 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:15.277846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b0a87f36-506d-4fe8-bdff-71ff238023af tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:15.278480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b0a87f36-506d-4fe8-bdff-71ff238023af tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:15.289865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:15.291507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:15.298993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0a87f36-506d-4fe8-bdff-71ff238023af tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:15.301431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0a87f36-506d-4fe8-bdff-71ff238023af tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:15.306345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0a87f36-506d-4fe8-bdff-71ff238023af tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:15.309196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0a87f36-506d-4fe8-bdff-71ff238023af tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:15.841488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c05d40a-1487-4cd3-b3a9-c9c1b0408cd2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:15.848424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c05d40a-1487-4cd3-b3a9-c9c1b0408cd2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:15.864439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b0a87f36-506d-4fe8-bdff-71ff238023af tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:15.884040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c05d40a-1487-4cd3-b3a9-c9c1b0408cd2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:15.888176 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b0a87f36-506d-4fe8-bdff-71ff238023af tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.614542 Aug 04 13:58:15.891662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c05d40a-1487-4cd3-b3a9-c9c1b0408cd2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:15.895602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c05d40a-1487-4cd3-b3a9-c9c1b0408cd2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:15.896150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 647/1299] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:15 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:15.898523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c05d40a-1487-4cd3-b3a9-c9c1b0408cd2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:16.187283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e3381356-0666-4afa-bff4-b65456fe40ad tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:16.187894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e3381356-0666-4afa-bff4-b65456fe40ad tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:16.202688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3381356-0666-4afa-bff4-b65456fe40ad tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:16.203287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3381356-0666-4afa-bff4-b65456fe40ad tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:16.204127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3381356-0666-4afa-bff4-b65456fe40ad tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:16.204571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3381356-0666-4afa-bff4-b65456fe40ad tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:16.429189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2c05d40a-1487-4cd3-b3a9-c9c1b0408cd2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:16.461817 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c05d40a-1487-4cd3-b3a9-c9c1b0408cd2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1472 microversion: 2.1 time: 0.642365 Aug 04 13:58:16.465014 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 653/1300] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:15 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1472 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:16.632338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e3381356-0666-4afa-bff4-b65456fe40ad tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:16.640601 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e3381356-0666-4afa-bff4-b65456fe40ad tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 0.457186 Aug 04 13:58:16.641221 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 648/1301] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:16 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:16.924671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-61d67053-ff3f-4794-9330-9aa4fc84f5e1 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:16.928272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-61d67053-ff3f-4794-9330-9aa4fc84f5e1 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:16.955467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61d67053-ff3f-4794-9330-9aa4fc84f5e1 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:16.956005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61d67053-ff3f-4794-9330-9aa4fc84f5e1 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:16.959673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61d67053-ff3f-4794-9330-9aa4fc84f5e1 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:16.961095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61d67053-ff3f-4794-9330-9aa4fc84f5e1 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:17.233622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-076227a2-67e2-4177-8b4d-e7ee03eda338 tempest-ListImageFiltersNegativeTestJSON-247256846 tempest-ListImageFiltersNegativeTestJSON-247256846-project] Calling method '.version_select at 0x7f470051b940>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:17.264095 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-076227a2-67e2-4177-8b4d-e7ee03eda338 tempest-ListImageFiltersNegativeTestJSON-247256846 tempest-ListImageFiltersNegativeTestJSON-247256846-project] HTTP exception thrown: Image not found. Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-076227a2-67e2-4177-8b4d-e7ee03eda338 tempest-ListImageFiltersNegativeTestJSON-247256846 tempest-ListImageFiltersNegativeTestJSON-247256846-project] Request method failure captured: Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/images/7d0a5bbd-190d-4be6-bc82-32cb21e5787a HTTP/1.1 Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69B4uBBuI7nVTx6iD8z9dm9q5KRfZEJN1EGl1Ne4jjgYv2LBUMzun9hbkAO4-QugB5IclJzw-apnfuG9PEN7o83yebv0sjwmNle81DdL_GvOrIxiWiCkoWSpkoWi0YdNf6Hyrc2sPJbie_PRdPH-JKRaEj_QCSz6LsW_nxr0Nk0b2vE Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: fa0a40e5f9854e97a18ba1c2c7dba5f4 Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-247256846 Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:58:17.266707 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fa0a40e5f9854e97a18ba1c2c7dba5f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fa0a40e5f9854e97a18ba1c2c7dba5f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fa0a40e5f9854e97a18ba1c2c7dba5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fa0a40e5f9854e97a18ba1c2c7dba5f4"}]}] Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-247256846 Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: fa0a40e5f9854e97a18ba1c2c7dba5f4 Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-247256846 Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListImageFiltersNegativeTestJSON-247256846-project Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 4f5b2dbcf8134d8388b8c76116f84bf3 Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-247256846-project Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7d0a5bbd-190d-4be6-bc82-32cb21e5787a'} Aug 04 13:58:17.268449 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 13:58:17.269532 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7d0a5bbd-190d-4be6-bc82-32cb21e5787a Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 13:58:17.270849 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7d0a5bbd-190d-4be6-bc82-32cb21e5787a could not be found. Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:58:17.272162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:17.273462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-076227a2-67e2-4177-8b4d-e7ee03eda338 tempest-ListImageFiltersNegativeTestJSON-247256846 tempest-ListImageFiltersNegativeTestJSON-247256846-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:58:17.275561 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-076227a2-67e2-4177-8b4d-e7ee03eda338 tempest-ListImageFiltersNegativeTestJSON-247256846 tempest-ListImageFiltersNegativeTestJSON-247256846-project] 10.222.0.66 "GET /compute/v2.1/images/7d0a5bbd-190d-4be6-bc82-32cb21e5787a" status: 404 len: 62 microversion: 2.1 time: 0.562850 Aug 04 13:58:17.275561 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 654/1302] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:16 2022] GET /compute/v2.1/images/7d0a5bbd-190d-4be6-bc82-32cb21e5787a => generated 62 bytes in 564 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:58:17.343937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-61d67053-ff3f-4794-9330-9aa4fc84f5e1 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:17.356123 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-61d67053-ff3f-4794-9330-9aa4fc84f5e1 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.435760 Aug 04 13:58:17.357011 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 649/1303] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:16 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:17.487144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68213689-76bd-4e64-a25b-9ad2eff15acc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:17.489886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68213689-76bd-4e64-a25b-9ad2eff15acc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:17.513094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68213689-76bd-4e64-a25b-9ad2eff15acc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:17.515889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68213689-76bd-4e64-a25b-9ad2eff15acc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:17.525082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68213689-76bd-4e64-a25b-9ad2eff15acc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:17.525870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68213689-76bd-4e64-a25b-9ad2eff15acc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:17.543408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a2c5ca5b-e2ab-4c71-957d-7de83e14d958 req-4f4b1c12-4747-4f1b-ba2c-30c2db74a35c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6ca2cc-3cdb-477e-9166-c915de5fc507", "tag": "3725cfe1-eef7-4aa9-8c08-89a978079195"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:17.567311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a2c5ca5b-e2ab-4c71-957d-7de83e14d958 req-4f4b1c12-4747-4f1b-ba2c-30c2db74a35c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:17.567768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a2c5ca5b-e2ab-4c71-957d-7de83e14d958 req-4f4b1c12-4747-4f1b-ba2c-30c2db74a35c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:17.588307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a2c5ca5b-e2ab-4c71-957d-7de83e14d958 req-4f4b1c12-4747-4f1b-ba2c-30c2db74a35c service nova] Creating event network-changed:3725cfe1-eef7-4aa9-8c08-89a978079195 for instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 on n-h2-844627-10 Aug 04 13:58:17.602042 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a2c5ca5b-e2ab-4c71-957d-7de83e14d958 req-4f4b1c12-4747-4f1b-ba2c-30c2db74a35c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062637 Aug 04 13:58:17.605640 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 650/1304] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:58:17.662018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e070dfb7-16e3-4cf3-a73d-3b26808302dd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:17.663238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e070dfb7-16e3-4cf3-a73d-3b26808302dd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:17.677446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e070dfb7-16e3-4cf3-a73d-3b26808302dd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:17.679382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e070dfb7-16e3-4cf3-a73d-3b26808302dd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:17.680245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e070dfb7-16e3-4cf3-a73d-3b26808302dd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:17.680695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e070dfb7-16e3-4cf3-a73d-3b26808302dd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:18.046999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:18.148591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-68213689-76bd-4e64-a25b-9ad2eff15acc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:18.160293 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68213689-76bd-4e64-a25b-9ad2eff15acc tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1472 microversion: 2.1 time: 0.680377 Aug 04 13:58:18.160926 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 655/1305] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:17 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1472 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:18.201466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e070dfb7-16e3-4cf3-a73d-3b26808302dd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:18.227831 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e070dfb7-16e3-4cf3-a73d-3b26808302dd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 0.558655 Aug 04 13:58:18.228687 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 651/1306] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:17 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:18.389097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4056c494-dd3e-4249-84a7-34ce43de9381 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:18.390310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4056c494-dd3e-4249-84a7-34ce43de9381 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:18.415034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4056c494-dd3e-4249-84a7-34ce43de9381 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:18.415837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4056c494-dd3e-4249-84a7-34ce43de9381 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:18.430720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4056c494-dd3e-4249-84a7-34ce43de9381 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:18.431491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4056c494-dd3e-4249-84a7-34ce43de9381 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:19.183999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb5f8ad5-3551-43f6-868a-2426310406fb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:19.185366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb5f8ad5-3551-43f6-868a-2426310406fb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:19.206255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5f8ad5-3551-43f6-868a-2426310406fb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:19.207740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5f8ad5-3551-43f6-868a-2426310406fb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:19.210321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5f8ad5-3551-43f6-868a-2426310406fb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:19.210899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5f8ad5-3551-43f6-868a-2426310406fb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:19.258425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4056c494-dd3e-4249-84a7-34ce43de9381 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:19.269492 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4056c494-dd3e-4249-84a7-34ce43de9381 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.890169 Aug 04 13:58:19.277501 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 656/1307] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:18 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:19.293356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9107d37a-eb38-4dbe-ae85-3b3f3da4d5f7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:19.294366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9107d37a-eb38-4dbe-ae85-3b3f3da4d5f7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:19.308142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9107d37a-eb38-4dbe-ae85-3b3f3da4d5f7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:19.314058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9107d37a-eb38-4dbe-ae85-3b3f3da4d5f7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:19.314577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9107d37a-eb38-4dbe-ae85-3b3f3da4d5f7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:19.315038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9107d37a-eb38-4dbe-ae85-3b3f3da4d5f7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:19.442640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=22 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:19.622182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bb5f8ad5-3551-43f6-868a-2426310406fb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:19.633336 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb5f8ad5-3551-43f6-868a-2426310406fb tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 0.450721 Aug 04 13:58:19.633980 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 652/1308] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:19 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:19.642358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-66edca3d-24e2-4d88-a823-0e73b9c056c7 req-508f0eb9-40a6-4879-a9c3-2022b5d4c2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "691963ac-14bf-4d48-9c45-643a5efa71aa", "tag": "bf8eeb52-7009-43e9-97bf-d0b34751ba4f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:19.666510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-66edca3d-24e2-4d88-a823-0e73b9c056c7 req-508f0eb9-40a6-4879-a9c3-2022b5d4c2e8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:19.669258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-66edca3d-24e2-4d88-a823-0e73b9c056c7 req-508f0eb9-40a6-4879-a9c3-2022b5d4c2e8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:19.695248 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-66edca3d-24e2-4d88-a823-0e73b9c056c7 req-508f0eb9-40a6-4879-a9c3-2022b5d4c2e8 service nova] Creating event network-changed:bf8eeb52-7009-43e9-97bf-d0b34751ba4f for instance 691963ac-14bf-4d48-9c45-643a5efa71aa on n-h2-844627-10 Aug 04 13:58:19.704852 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-66edca3d-24e2-4d88-a823-0e73b9c056c7 req-508f0eb9-40a6-4879-a9c3-2022b5d4c2e8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068032 Aug 04 13:58:19.706050 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 653/1309] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:19.735860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9107d37a-eb38-4dbe-ae85-3b3f3da4d5f7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:19.746116 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9107d37a-eb38-4dbe-ae85-3b3f3da4d5f7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 0.467144 Aug 04 13:58:19.746712 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 657/1310] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:19 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:20.306933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4c58c236-34b3-4618-9307-cf2fcae299a9 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:20.307958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4c58c236-34b3-4618-9307-cf2fcae299a9 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:20.344273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c58c236-34b3-4618-9307-cf2fcae299a9 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:20.344904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c58c236-34b3-4618-9307-cf2fcae299a9 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:20.351109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c58c236-34b3-4618-9307-cf2fcae299a9 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:20.352207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c58c236-34b3-4618-9307-cf2fcae299a9 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:20.656202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e05faf2-41fc-4106-9102-2a52a15e7879 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:20.657520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4e05faf2-41fc-4106-9102-2a52a15e7879 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:20.668912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e05faf2-41fc-4106-9102-2a52a15e7879 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:20.680091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e05faf2-41fc-4106-9102-2a52a15e7879 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:20.681357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e05faf2-41fc-4106-9102-2a52a15e7879 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:20.682008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e05faf2-41fc-4106-9102-2a52a15e7879 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:21.197319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4c58c236-34b3-4618-9307-cf2fcae299a9 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:21.215920 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4c58c236-34b3-4618-9307-cf2fcae299a9 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.916065 Aug 04 13:58:21.216725 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 654/1311] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:20 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:21.225494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-89aa9b03-e524-4cb7-87c5-9042b60f0e1f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:21.229982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-89aa9b03-e524-4cb7-87c5-9042b60f0e1f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:21.244746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89aa9b03-e524-4cb7-87c5-9042b60f0e1f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:21.245905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89aa9b03-e524-4cb7-87c5-9042b60f0e1f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:21.247174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89aa9b03-e524-4cb7-87c5-9042b60f0e1f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:21.247850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89aa9b03-e524-4cb7-87c5-9042b60f0e1f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:21.945559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e05faf2-41fc-4106-9102-2a52a15e7879 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:21.958254 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e05faf2-41fc-4106-9102-2a52a15e7879 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 1.306255 Aug 04 13:58:21.991518 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 658/1312] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:20 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:22.195863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-89aa9b03-e524-4cb7-87c5-9042b60f0e1f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:22.207402 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-89aa9b03-e524-4cb7-87c5-9042b60f0e1f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 0.989387 Aug 04 13:58:22.210597 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 655/1313] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:21 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:22.247285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e81c3bf-7f23-489d-beb3-e3335260c392 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:22.248300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e81c3bf-7f23-489d-beb3-e3335260c392 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:22.259747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e81c3bf-7f23-489d-beb3-e3335260c392 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:22.260604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e81c3bf-7f23-489d-beb3-e3335260c392 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:22.262590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e81c3bf-7f23-489d-beb3-e3335260c392 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:22.263303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e81c3bf-7f23-489d-beb3-e3335260c392 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:22.270947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:22.621273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3e81c3bf-7f23-489d-beb3-e3335260c392 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:22.631531 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e81c3bf-7f23-489d-beb3-e3335260c392 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.392949 Aug 04 13:58:22.635041 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 659/1314] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:22 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:22.982281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b2d56f7e-cff6-40a4-8c82-8a3cbe19a4ba tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:22.982960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b2d56f7e-cff6-40a4-8c82-8a3cbe19a4ba tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:23.001114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2d56f7e-cff6-40a4-8c82-8a3cbe19a4ba tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:23.002433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2d56f7e-cff6-40a4-8c82-8a3cbe19a4ba tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:23.005473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2d56f7e-cff6-40a4-8c82-8a3cbe19a4ba tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:23.008664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2d56f7e-cff6-40a4-8c82-8a3cbe19a4ba tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:23.234906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-849ad4c4-d5c3-4499-8487-68bfb5408eb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:23.237773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-849ad4c4-d5c3-4499-8487-68bfb5408eb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:23.255101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-849ad4c4-d5c3-4499-8487-68bfb5408eb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:23.255672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-849ad4c4-d5c3-4499-8487-68bfb5408eb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:23.260215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-849ad4c4-d5c3-4499-8487-68bfb5408eb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:23.262212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-849ad4c4-d5c3-4499-8487-68bfb5408eb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:23.676778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b2d56f7e-cff6-40a4-8c82-8a3cbe19a4ba tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:23.695048 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b2d56f7e-cff6-40a4-8c82-8a3cbe19a4ba tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 0.715411 Aug 04 13:58:23.696516 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 656/1315] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:22 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:23.707184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f64292c4-a9a1-43b9-a45f-b0d8f7fdac51 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:23.708253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f64292c4-a9a1-43b9-a45f-b0d8f7fdac51 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:23.724039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f64292c4-a9a1-43b9-a45f-b0d8f7fdac51 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:23.727115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f64292c4-a9a1-43b9-a45f-b0d8f7fdac51 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:23.729154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f64292c4-a9a1-43b9-a45f-b0d8f7fdac51 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:23.733255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f64292c4-a9a1-43b9-a45f-b0d8f7fdac51 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:24.024323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-849ad4c4-d5c3-4499-8487-68bfb5408eb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:24.038700 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-849ad4c4-d5c3-4499-8487-68bfb5408eb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 0.811647 Aug 04 13:58:24.056620 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 660/1316] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:23 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:24.259366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:24.260024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:24.278685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:24.279142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:24.280564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:24.281334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:24.313635 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] HTTP exception thrown: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Request method failure captured: Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 HTTP/1.1 Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-XH1ToVcSfxwieDPwgGx3PoGrJSVxXUg4LMpzwi5yHMKbiVfQjQtid0Qf2B31_nWavBebT3LSrp0Om9MIvw2vtSROcHH8_ptw-BfeboDt19wWGt66rB3w45A5vmTx0DyZKgS5w8Q90lWY3jZH0sVpjkjHGMBCDGeUq5KvjNr88LP8 Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c6bc03c5e3934e81adecc7004e0e87f0 Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1660958208 Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:58:24.318382 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c6bc03c5e3934e81adecc7004e0e87f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c6bc03c5e3934e81adecc7004e0e87f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c6bc03c5e3934e81adecc7004e0e87f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c6bc03c5e3934e81adecc7004e0e87f0"}]}] Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1660958208 Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c6bc03c5e3934e81adecc7004e0e87f0 Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1660958208 Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachSCSIVolumeTestJSON-1660958208-project Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7f51c32e1dd7438bac9feb8e38975452 Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1660958208-project Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.320620 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3b9e1d4b-b8b1-44de-9409-65db8223e4b2'} Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:58:24.321548 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.323163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.328202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Returning 404 to user: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:58:24.330408 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-154eaf52-e43f-4480-bce1-304d7681788b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 404 len: 111 microversion: 2.1 time: 0.076005 Aug 04 13:58:24.334604 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 661/1317] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:58:24 2022] DELETE /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:58:24.349503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:24.351101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] [instance: 3b9e1d4b-b8b1-44de-9409-65db8223e4b2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:24.365236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:24.366036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:24.368288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:24.369118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:24.394099 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] HTTP exception thrown: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Request method failure captured: Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 HTTP/1.1 Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-XH1ToVcSfxwieDPwgGx3PoGrJSVxXUg4LMpzwi5yHMKbiVfQjQtid0Qf2B31_nWavBebT3LSrp0Om9MIvw2vtSROcHH8_ptw-BfeboDt19wWGt66rB3w45A5vmTx0DyZKgS5w8Q90lWY3jZH0sVpjkjHGMBCDGeUq5KvjNr88LP8 Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c6bc03c5e3934e81adecc7004e0e87f0 Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1660958208 Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:58:24.396145 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c6bc03c5e3934e81adecc7004e0e87f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c6bc03c5e3934e81adecc7004e0e87f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c6bc03c5e3934e81adecc7004e0e87f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c6bc03c5e3934e81adecc7004e0e87f0"}]}] Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1660958208 Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c6bc03c5e3934e81adecc7004e0e87f0 Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1660958208 Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachSCSIVolumeTestJSON-1660958208-project Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7f51c32e1dd7438bac9feb8e38975452 Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1660958208-project Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.398275 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3b9e1d4b-b8b1-44de-9409-65db8223e4b2'} Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:58:24.399195 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. Aug 04 13:58:24.400590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:58:24.403561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] Returning 404 to user: Instance 3b9e1d4b-b8b1-44de-9409-65db8223e4b2 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:58:24.405040 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a7aec66-13b2-47ee-a91d-f63423ddfb8b tempest-AttachSCSIVolumeTestJSON-1660958208 tempest-AttachSCSIVolumeTestJSON-1660958208-project] 10.222.0.66 "GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2" status: 404 len: 111 microversion: 2.1 time: 0.066729 Aug 04 13:58:24.405786 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 662/1318] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:24 2022] GET /compute/v2.1/servers/3b9e1d4b-b8b1-44de-9409-65db8223e4b2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:58:24.495129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f64292c4-a9a1-43b9-a45f-b0d8f7fdac51 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:24.508042 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f64292c4-a9a1-43b9-a45f-b0d8f7fdac51 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.810033 Aug 04 13:58:24.508659 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 657/1319] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:23 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:24.723008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70261ee8-2aa7-45d9-b1a7-f32bca1a0fe9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:24.723490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70261ee8-2aa7-45d9-b1a7-f32bca1a0fe9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:24.734328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70261ee8-2aa7-45d9-b1a7-f32bca1a0fe9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:24.735688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70261ee8-2aa7-45d9-b1a7-f32bca1a0fe9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:24.737895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70261ee8-2aa7-45d9-b1a7-f32bca1a0fe9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:24.741461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70261ee8-2aa7-45d9-b1a7-f32bca1a0fe9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:25.060817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a38aef7a-9deb-4dbb-bd09-1955570852c9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:25.061486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a38aef7a-9deb-4dbb-bd09-1955570852c9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:25.076858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a38aef7a-9deb-4dbb-bd09-1955570852c9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:25.080162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a38aef7a-9deb-4dbb-bd09-1955570852c9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:25.081243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a38aef7a-9deb-4dbb-bd09-1955570852c9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:25.081888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a38aef7a-9deb-4dbb-bd09-1955570852c9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:25.707663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a38aef7a-9deb-4dbb-bd09-1955570852c9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:25.717291 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a38aef7a-9deb-4dbb-bd09-1955570852c9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 0.660990 Aug 04 13:58:25.718500 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 658/1320] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:25 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:25.723942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-96795804-5936-4b0e-9abf-d0ef00ceb566 req-8bc4cc00-5e11-4274-bdca-ea50eb005114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b22ae8-b4dd-4cca-86c3-460706c29630", "name": "network-vif-plugged", "status": "completed", "tag": "ee449665-121c-4ded-86dc-319178276579"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:25.737274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-96795804-5936-4b0e-9abf-d0ef00ceb566 req-8bc4cc00-5e11-4274-bdca-ea50eb005114 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:25.738131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-96795804-5936-4b0e-9abf-d0ef00ceb566 req-8bc4cc00-5e11-4274-bdca-ea50eb005114 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:25.765860 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-96795804-5936-4b0e-9abf-d0ef00ceb566 req-8bc4cc00-5e11-4274-bdca-ea50eb005114 service nova] Creating event network-vif-plugged:ee449665-121c-4ded-86dc-319178276579 for instance 11b22ae8-b4dd-4cca-86c3-460706c29630 on n-h1-844627-10 Aug 04 13:58:25.772352 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-96795804-5936-4b0e-9abf-d0ef00ceb566 req-8bc4cc00-5e11-4274-bdca-ea50eb005114 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052062 Aug 04 13:58:25.773327 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 659/1321] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:25.779171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b67076a-0787-4eb6-b87b-dfd3c43490dd tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:25.780662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b67076a-0787-4eb6-b87b-dfd3c43490dd tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:25.788763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b67076a-0787-4eb6-b87b-dfd3c43490dd tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:25.789626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b67076a-0787-4eb6-b87b-dfd3c43490dd tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:25.790976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b67076a-0787-4eb6-b87b-dfd3c43490dd tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:25.791656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b67076a-0787-4eb6-b87b-dfd3c43490dd tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:25.864779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-70261ee8-2aa7-45d9-b1a7-f32bca1a0fe9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:25.886814 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70261ee8-2aa7-45d9-b1a7-f32bca1a0fe9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 1.169012 Aug 04 13:58:25.894547 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 663/1322] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:24 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:26.100658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b67076a-0787-4eb6-b87b-dfd3c43490dd tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:26.109175 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b67076a-0787-4eb6-b87b-dfd3c43490dd tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.334309 Aug 04 13:58:26.111704 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 660/1323] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:25 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:26.741745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eefc7a40-7cc9-4ba4-87d6-f9548a5990fd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:26.742376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eefc7a40-7cc9-4ba4-87d6-f9548a5990fd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:26.757350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eefc7a40-7cc9-4ba4-87d6-f9548a5990fd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:26.757836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eefc7a40-7cc9-4ba4-87d6-f9548a5990fd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:26.758655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eefc7a40-7cc9-4ba4-87d6-f9548a5990fd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:26.759108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eefc7a40-7cc9-4ba4-87d6-f9548a5990fd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:26.935760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6dd2f7f2-fc4f-460f-b0ac-0e6a04e950b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:26.936387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6dd2f7f2-fc4f-460f-b0ac-0e6a04e950b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:26.945126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd2f7f2-fc4f-460f-b0ac-0e6a04e950b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:26.949707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd2f7f2-fc4f-460f-b0ac-0e6a04e950b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:26.950857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd2f7f2-fc4f-460f-b0ac-0e6a04e950b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:26.951489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd2f7f2-fc4f-460f-b0ac-0e6a04e950b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:27.719475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6dd2f7f2-fc4f-460f-b0ac-0e6a04e950b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:27.733282 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6dd2f7f2-fc4f-460f-b0ac-0e6a04e950b6 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 0.808400 Aug 04 13:58:27.748463 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 661/1324] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:26 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:27.756961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7459b162-0165-411b-891d-11651b44a080 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:27.761787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7459b162-0165-411b-891d-11651b44a080 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:27.777282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7459b162-0165-411b-891d-11651b44a080 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:27.778125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7459b162-0165-411b-891d-11651b44a080 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:27.779180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7459b162-0165-411b-891d-11651b44a080 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:27.787969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7459b162-0165-411b-891d-11651b44a080 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:27.909797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eefc7a40-7cc9-4ba4-87d6-f9548a5990fd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:27.938264 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eefc7a40-7cc9-4ba4-87d6-f9548a5990fd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 1.199969 Aug 04 13:58:27.940946 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 664/1325] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:26 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:27.961486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7aaee1da-cfc0-49ae-b6d0-a6600dc31c6e req-f41d070d-284e-4e65-8f7b-4a93b21cacb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ca2cc-3cdb-477e-9166-c915de5fc507", "name": "network-vif-plugged", "status": "completed", "tag": "3725cfe1-eef7-4aa9-8c08-89a978079195"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:28.004588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7aaee1da-cfc0-49ae-b6d0-a6600dc31c6e req-f41d070d-284e-4e65-8f7b-4a93b21cacb3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:28.006673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7aaee1da-cfc0-49ae-b6d0-a6600dc31c6e req-f41d070d-284e-4e65-8f7b-4a93b21cacb3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:28.065548 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7aaee1da-cfc0-49ae-b6d0-a6600dc31c6e req-f41d070d-284e-4e65-8f7b-4a93b21cacb3 service nova] Creating event network-vif-plugged:3725cfe1-eef7-4aa9-8c08-89a978079195 for instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 on n-h2-844627-10 Aug 04 13:58:28.080190 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7aaee1da-cfc0-49ae-b6d0-a6600dc31c6e req-f41d070d-284e-4e65-8f7b-4a93b21cacb3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135027 Aug 04 13:58:28.086880 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 665/1326] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:28.457125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7459b162-0165-411b-891d-11651b44a080 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:28.498147 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7459b162-0165-411b-891d-11651b44a080 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1330 microversion: 2.1 time: 0.747731 Aug 04 13:58:28.499730 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 662/1327] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:27 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1330 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:28.758266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f63971ea-00f2-4446-a43e-b41008ff46b2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:28.760351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f63971ea-00f2-4446-a43e-b41008ff46b2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:28.796997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f63971ea-00f2-4446-a43e-b41008ff46b2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:28.797901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f63971ea-00f2-4446-a43e-b41008ff46b2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:28.799414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f63971ea-00f2-4446-a43e-b41008ff46b2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:28.800093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f63971ea-00f2-4446-a43e-b41008ff46b2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:28.986275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86820408-c145-41be-9c7f-2e891299dbc2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:28.994529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-86820408-c145-41be-9c7f-2e891299dbc2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:29.032756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86820408-c145-41be-9c7f-2e891299dbc2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:29.034126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86820408-c145-41be-9c7f-2e891299dbc2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:29.037787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86820408-c145-41be-9c7f-2e891299dbc2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:29.038965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86820408-c145-41be-9c7f-2e891299dbc2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:29.085161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:29.332513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f63971ea-00f2-4446-a43e-b41008ff46b2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:29.351942 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f63971ea-00f2-4446-a43e-b41008ff46b2 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 0.594048 Aug 04 13:58:29.355916 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 666/1328] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:28 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:29.530250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca8b0170-30fa-41eb-bfc3-1ed67ddc0961 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:29.531364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ca8b0170-30fa-41eb-bfc3-1ed67ddc0961 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:29.548415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca8b0170-30fa-41eb-bfc3-1ed67ddc0961 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:29.550324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca8b0170-30fa-41eb-bfc3-1ed67ddc0961 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:29.554234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca8b0170-30fa-41eb-bfc3-1ed67ddc0961 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:29.555263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca8b0170-30fa-41eb-bfc3-1ed67ddc0961 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:29.801048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-86820408-c145-41be-9c7f-2e891299dbc2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:29.811480 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86820408-c145-41be-9c7f-2e891299dbc2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 0.837073 Aug 04 13:58:29.814032 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 663/1329] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:28 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:30.075338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ca8b0170-30fa-41eb-bfc3-1ed67ddc0961 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:30.102849 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca8b0170-30fa-41eb-bfc3-1ed67ddc0961 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1535 microversion: 2.1 time: 0.579733 Aug 04 13:58:30.116907 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 667/1330] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:29 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1535 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:30.130564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6256a07b-06ac-4323-aa7e-554db7e1eead tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Action: 'create', calling method: .version_select at 0x7f4700279940>, body: {"pool": "27abc51e-1bf4-456c-85a8-74112db16a3e"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:30.384214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-97238cfc-433c-4c40-8d05-40d0afb0fb71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:30.385021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-97238cfc-433c-4c40-8d05-40d0afb0fb71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:30.406790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97238cfc-433c-4c40-8d05-40d0afb0fb71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:30.407389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97238cfc-433c-4c40-8d05-40d0afb0fb71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:30.408265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97238cfc-433c-4c40-8d05-40d0afb0fb71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:30.408716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97238cfc-433c-4c40-8d05-40d0afb0fb71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:31.972285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-97238cfc-433c-4c40-8d05-40d0afb0fb71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:31.983532 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-97238cfc-433c-4c40-8d05-40d0afb0fb71 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 1.607115 Aug 04 13:58:31.984130 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 668/1331] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:30 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:32.002470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3cde160e-7a27-4ed8-8ffc-def41e2d7206 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:32.005104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3cde160e-7a27-4ed8-8ffc-def41e2d7206 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:32.021623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cde160e-7a27-4ed8-8ffc-def41e2d7206 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:32.022207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cde160e-7a27-4ed8-8ffc-def41e2d7206 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:32.023531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cde160e-7a27-4ed8-8ffc-def41e2d7206 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:32.024886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cde160e-7a27-4ed8-8ffc-def41e2d7206 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:32.534476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3cde160e-7a27-4ed8-8ffc-def41e2d7206 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:32.545344 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3cde160e-7a27-4ed8-8ffc-def41e2d7206 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1318 microversion: 2.1 time: 0.554935 Aug 04 13:58:32.558742 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 669/1332] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:31 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:32.566772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-91d88964-20ed-44a6-92bd-8873c7542ee1 req-3bad561a-7d43-4a1d-930d-4c6669fc2ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691963ac-14bf-4d48-9c45-643a5efa71aa", "name": "network-vif-plugged", "status": "completed", "tag": "bf8eeb52-7009-43e9-97bf-d0b34751ba4f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:32.606586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-91d88964-20ed-44a6-92bd-8873c7542ee1 req-3bad561a-7d43-4a1d-930d-4c6669fc2ff2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:32.607296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-91d88964-20ed-44a6-92bd-8873c7542ee1 req-3bad561a-7d43-4a1d-930d-4c6669fc2ff2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:32.619556 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-91d88964-20ed-44a6-92bd-8873c7542ee1 req-3bad561a-7d43-4a1d-930d-4c6669fc2ff2 service nova] Creating event network-vif-plugged:bf8eeb52-7009-43e9-97bf-d0b34751ba4f for instance 691963ac-14bf-4d48-9c45-643a5efa71aa on n-h2-844627-10 Aug 04 13:58:32.626574 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-91d88964-20ed-44a6-92bd-8873c7542ee1 req-3bad561a-7d43-4a1d-930d-4c6669fc2ff2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066227 Aug 04 13:58:32.627709 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 670/1333] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:33.033108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-606a215b-e87f-4065-98f4-5087efaabb2a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:33.042086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-606a215b-e87f-4065-98f4-5087efaabb2a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:33.067208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-606a215b-e87f-4065-98f4-5087efaabb2a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:33.073598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-606a215b-e87f-4065-98f4-5087efaabb2a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:33.102166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-606a215b-e87f-4065-98f4-5087efaabb2a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:33.103133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-606a215b-e87f-4065-98f4-5087efaabb2a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:33.833018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-606a215b-e87f-4065-98f4-5087efaabb2a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:33.848704 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-606a215b-e87f-4065-98f4-5087efaabb2a tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 0.823456 Aug 04 13:58:33.852272 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 671/1334] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:33 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:34.009678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4967c222-58fb-441f-bf6c-02c493310b94 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: .version_select at 0x7f47003cb4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1993532890", "description": "tempest-description-131099990"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:34.596594 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4967c222-58fb-441f-bf6c-02c493310b94 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.742666 Aug 04 13:58:34.606695 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 672/1335] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:58:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:34.614391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e6d61f9-5d21-4bc4-9475-5f2549e0d224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:34.618990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2e6d61f9-5d21-4bc4-9475-5f2549e0d224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:34.645451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e6d61f9-5d21-4bc4-9475-5f2549e0d224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:34.649508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e6d61f9-5d21-4bc4-9475-5f2549e0d224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:34.651795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e6d61f9-5d21-4bc4-9475-5f2549e0d224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:34.653610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e6d61f9-5d21-4bc4-9475-5f2549e0d224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:35.248466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2e6d61f9-5d21-4bc4-9475-5f2549e0d224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:35.262689 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2e6d61f9-5d21-4bc4-9475-5f2549e0d224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1468 microversion: 2.1 time: 0.650746 Aug 04 13:58:35.263623 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 673/1336] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:34 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1468 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:35.273891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2139a6ef-1f66-450e-8932-7401c25df6b3 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: .version_select at 0x7f47004ddb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1871533861", "description": "tempest-description-1706099907"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:35.362679 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6256a07b-06ac-4323-aa7e-554db7e1eead tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.236962 Aug 04 13:58:35.369212 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 664/1337] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 13:58:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:58:35.369544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-de28bb91-c3e2-43a8-be17-5e81689a6299 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:35.370318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-de28bb91-c3e2-43a8-be17-5e81689a6299 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:35.381454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de28bb91-c3e2-43a8-be17-5e81689a6299 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:35.381971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de28bb91-c3e2-43a8-be17-5e81689a6299 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:35.382859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de28bb91-c3e2-43a8-be17-5e81689a6299 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:35.383332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de28bb91-c3e2-43a8-be17-5e81689a6299 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:35.671343 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2139a6ef-1f66-450e-8932-7401c25df6b3 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.406387 Aug 04 13:58:35.671958 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 674/1338] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:58:35 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:35.683086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-529fdd04-1cd6-429a-8649-e80083a294f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:35.683777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-529fdd04-1cd6-429a-8649-e80083a294f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:35.712261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-529fdd04-1cd6-429a-8649-e80083a294f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:35.713055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-529fdd04-1cd6-429a-8649-e80083a294f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:35.714393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-529fdd04-1cd6-429a-8649-e80083a294f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:35.723385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-529fdd04-1cd6-429a-8649-e80083a294f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:35.955131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-de28bb91-c3e2-43a8-be17-5e81689a6299 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:35.966339 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-de28bb91-c3e2-43a8-be17-5e81689a6299 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 0.601791 Aug 04 13:58:35.967831 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 665/1339] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:35 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:35.988341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Action: 'action', calling method: .version_select at 0x7f470302eca0>, body: {"addFloatingIp": {"address": "172.25.2.74"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:35.995085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:36.008543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:36.019596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:36.020040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:36.024345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:36.025521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:36.100514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Acquired lock "refresh_cache-11b22ae8-b4dd-4cca-86c3-460706c29630" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:58:36.293403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-529fdd04-1cd6-429a-8649-e80083a294f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:36.310147 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-529fdd04-1cd6-429a-8649-e80083a294f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507" status: 200 len: 1468 microversion: 2.1 time: 0.631869 Aug 04 13:58:36.310762 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 675/1340] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:35 2022] GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507 => generated 1468 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:36.329017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-342111961", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "64787552-0b36-4a95-805d-526aa0b93f48"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:36.423455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] validate_networks() for [('64787552-0b36-4a95-805d-526aa0b93f48', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:58:38.830236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:58:38.830863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:58:38.831805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:58:38.832296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:58:38.832923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:58:38.835761 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:38.860663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:38.861546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:38.862777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:38.869251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:38.923571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Getting quotas for project c55ed93281454b88b28fd3f6c24fc35f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:58:38.939357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Getting quotas for user 8010f6da241841b793874beedd1b8585 and project c55ed93281454b88b28fd3f6c24fc35f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:58:38.997631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:58:39.000653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:58:39.097644 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5b8e8893-fdd3-46e2-a096-3e1ba2b9f7e9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.785670 Aug 04 13:58:39.098724 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 676/1341] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:58:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:58:39.108705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-044584b7-ae39-4614-a889-cbb090baedc6 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-158249918"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:39.112986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-044584b7-ae39-4614-a889-cbb090baedc6 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:39.125660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-044584b7-ae39-4614-a889-cbb090baedc6 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:39.126621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-044584b7-ae39-4614-a889-cbb090baedc6 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:39.128083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-044584b7-ae39-4614-a889-cbb090baedc6 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:39.130532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-044584b7-ae39-4614-a889-cbb090baedc6 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:39.601199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Building network info cache for instance {{(pid=130960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 13:58:39.719571 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-044584b7-ae39-4614-a889-cbb090baedc6 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "POST /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507/action" status: 202 len: 0 microversion: 2.1 time: 0.618208 Aug 04 13:58:39.732716 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 677/1342] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:58:39 2022] POST /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 13:58:39.745601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dde6ff04-7061-4350-a186-995faca0951e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:39.761826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dde6ff04-7061-4350-a186-995faca0951e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:39.778154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dde6ff04-7061-4350-a186-995faca0951e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:39.778616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dde6ff04-7061-4350-a186-995faca0951e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:39.779677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dde6ff04-7061-4350-a186-995faca0951e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:39.780126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dde6ff04-7061-4350-a186-995faca0951e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:40.570408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dde6ff04-7061-4350-a186-995faca0951e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:40.598117 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dde6ff04-7061-4350-a186-995faca0951e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1477 microversion: 2.1 time: 0.850794 Aug 04 13:58:40.603298 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 678/1343] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:39 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1477 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:40.630727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ce7b1e80-2dc7-4986-a1c6-a6602a1384db tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:40.630727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ce7b1e80-2dc7-4986-a1c6-a6602a1384db tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:40.657133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce7b1e80-2dc7-4986-a1c6-a6602a1384db tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:40.658809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce7b1e80-2dc7-4986-a1c6-a6602a1384db tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:40.663085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce7b1e80-2dc7-4986-a1c6-a6602a1384db tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:40.663775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce7b1e80-2dc7-4986-a1c6-a6602a1384db tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:40.879744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ce7b1e80-2dc7-4986-a1c6-a6602a1384db tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:40.885105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:40.901386 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ce7b1e80-2dc7-4986-a1c6-a6602a1384db tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1219 microversion: 2.1 time: 0.276658 Aug 04 13:58:40.902117 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 679/1344] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:40 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1219 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:41.215127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c9a72478-f96b-419b-a30a-9fed2a3d9a79 req-ec775227-5d40-407b-b10d-01c0e41c493f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b22ae8-b4dd-4cca-86c3-460706c29630", "tag": "ee449665-121c-4ded-86dc-319178276579"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:41.238311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c9a72478-f96b-419b-a30a-9fed2a3d9a79 req-ec775227-5d40-407b-b10d-01c0e41c493f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:41.238767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c9a72478-f96b-419b-a30a-9fed2a3d9a79 req-ec775227-5d40-407b-b10d-01c0e41c493f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:41.260478 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c9a72478-f96b-419b-a30a-9fed2a3d9a79 req-ec775227-5d40-407b-b10d-01c0e41c493f service nova] Creating event network-changed:ee449665-121c-4ded-86dc-319178276579 for instance 11b22ae8-b4dd-4cca-86c3-460706c29630 on n-h1-844627-10 Aug 04 13:58:41.286922 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c9a72478-f96b-419b-a30a-9fed2a3d9a79 req-ec775227-5d40-407b-b10d-01c0e41c493f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.380026 Aug 04 13:58:41.288217 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 680/1345] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:41.294454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e2990935-3dbb-4044-8c9c-6246b67aa61b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700a61ee0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:41.363169 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e2990935-3dbb-4044-8c9c-6246b67aa61b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.073339 Aug 04 13:58:41.364938 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 681/1346] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:41 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:41.620316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Updating instance_info_cache with network_info: [{"id": "ee449665-121c-4ded-86dc-319178276579", "address": "fa:16:3e:4a:f8:4d", "network": {"id": "8d424dee-b56a-4c3f-bb38-75c235d11e5a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2046738664-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4a0a4ae5d6de48b2bd1203bd6c3922b4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee449665-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 13:58:41.628954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af7aaf6b-e9c1-428b-bde7-d44364349957 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:41.629639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af7aaf6b-e9c1-428b-bde7-d44364349957 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:41.644473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af7aaf6b-e9c1-428b-bde7-d44364349957 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:41.645267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af7aaf6b-e9c1-428b-bde7-d44364349957 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:41.646318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af7aaf6b-e9c1-428b-bde7-d44364349957 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:41.646770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af7aaf6b-e9c1-428b-bde7-d44364349957 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:41.649887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Releasing lock "refresh_cache-11b22ae8-b4dd-4cca-86c3-460706c29630" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:58:41.650865 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c1221e4-1bb4-43ad-b7ca-c4e91e4ee991 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action" status: 202 len: 0 microversion: 2.1 time: 5.681311 Aug 04 13:58:41.657778 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 666/1347] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:58:35 2022] POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action => generated 0 bytes in 5689 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 13:58:41.668835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f6c4beb5-8105-4d3a-8a53-1bf3c9ccf1ec tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Action: 'create', calling method: .version_select at 0x7f47001c0670>, body: {"pool": "27abc51e-1bf4-456c-85a8-74112db16a3e"} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:42.308423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-af7aaf6b-e9c1-428b-bde7-d44364349957 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:42.334793 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af7aaf6b-e9c1-428b-bde7-d44364349957 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1476 microversion: 2.1 time: 0.709458 Aug 04 13:58:42.356461 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 682/1348] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:41 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1476 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 13:58:42.363212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b6cf681a-42a4-481e-8843-e910340b9891 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:42.365412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b6cf681a-42a4-481e-8843-e910340b9891 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:42.373696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6cf681a-42a4-481e-8843-e910340b9891 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:42.375464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6cf681a-42a4-481e-8843-e910340b9891 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:42.376568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6cf681a-42a4-481e-8843-e910340b9891 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:42.377238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6cf681a-42a4-481e-8843-e910340b9891 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:42.490842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b6cf681a-42a4-481e-8843-e910340b9891 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:42.517479 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b6cf681a-42a4-481e-8843-e910340b9891 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1273 microversion: 2.1 time: 0.159002 Aug 04 13:58:42.518338 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 683/1349] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:42 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:42.531269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fcba9ee2-9f22-4835-a7ea-4ddd2cf32acb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700503550>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:42.627165 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fcba9ee2-9f22-4835-a7ea-4ddd2cf32acb tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.107429 Aug 04 13:58:42.627765 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 684/1350] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:42 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:43.366821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68a3c790-dd3a-4450-8b5a-0df5da1f40d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:43.368952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68a3c790-dd3a-4450-8b5a-0df5da1f40d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:43.386572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68a3c790-dd3a-4450-8b5a-0df5da1f40d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:43.391158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68a3c790-dd3a-4450-8b5a-0df5da1f40d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:43.397313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68a3c790-dd3a-4450-8b5a-0df5da1f40d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:43.398700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68a3c790-dd3a-4450-8b5a-0df5da1f40d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:44.839601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-68a3c790-dd3a-4450-8b5a-0df5da1f40d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:44.859701 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68a3c790-dd3a-4450-8b5a-0df5da1f40d5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1476 microversion: 2.1 time: 1.497811 Aug 04 13:58:44.870298 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 685/1351] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:43 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1476 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:44.909108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c7f96d44-8a1a-4611-925b-938400e3a231 req-c3d4edd7-07ec-4593-8767-342418e42c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8a455-2bcf-44ca-b5e2-16688470f226", "name": "network-vif-unplugged", "status": "completed", "tag": "03b69f95-f081-4cab-9615-bd7da2ce327d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:44.963862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c7f96d44-8a1a-4611-925b-938400e3a231 req-c3d4edd7-07ec-4593-8767-342418e42c92 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:44.963862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c7f96d44-8a1a-4611-925b-938400e3a231 req-c3d4edd7-07ec-4593-8767-342418e42c92 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:45.004114 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c7f96d44-8a1a-4611-925b-938400e3a231 req-c3d4edd7-07ec-4593-8767-342418e42c92 service nova] Creating event network-vif-unplugged:03b69f95-f081-4cab-9615-bd7da2ce327d for instance bde8a455-2bcf-44ca-b5e2-16688470f226 on n-h1-844627-10 Aug 04 13:58:45.022645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-c7f96d44-8a1a-4611-925b-938400e3a231 req-c3d4edd7-07ec-4593-8767-342418e42c92 service nova] Instance bde8a455-2bcf-44ca-b5e2-16688470f226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:58:45.058968 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c7f96d44-8a1a-4611-925b-938400e3a231 req-c3d4edd7-07ec-4593-8767-342418e42c92 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.187195 Aug 04 13:58:45.064293 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 686/1352] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:45.080424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-751c81a6-5d32-40da-81db-7f3aa0376b0f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:45.081200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-751c81a6-5d32-40da-81db-7f3aa0376b0f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:45.119753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-751c81a6-5d32-40da-81db-7f3aa0376b0f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:45.120238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-751c81a6-5d32-40da-81db-7f3aa0376b0f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:45.121092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-751c81a6-5d32-40da-81db-7f3aa0376b0f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:45.121544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-751c81a6-5d32-40da-81db-7f3aa0376b0f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:45.275594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-751c81a6-5d32-40da-81db-7f3aa0376b0f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:45.299591 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-751c81a6-5d32-40da-81db-7f3aa0376b0f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1273 microversion: 2.1 time: 0.232241 Aug 04 13:58:45.304961 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 687/1353] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:45 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:45.311000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec30eae4-26ba-46f8-ba96-95774b8eb5f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470051b790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:45.407047 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec30eae4-26ba-46f8-ba96-95774b8eb5f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.099973 Aug 04 13:58:45.408301 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 688/1354] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:45 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:45.884130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-706be5c7-d4ac-4c78-bb16-c265400ed1df tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:45.885499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-706be5c7-d4ac-4c78-bb16-c265400ed1df tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:45.897221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706be5c7-d4ac-4c78-bb16-c265400ed1df tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:45.897808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706be5c7-d4ac-4c78-bb16-c265400ed1df tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:45.898987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706be5c7-d4ac-4c78-bb16-c265400ed1df tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:45.899440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706be5c7-d4ac-4c78-bb16-c265400ed1df tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:46.096964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:46.402217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-706be5c7-d4ac-4c78-bb16-c265400ed1df tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:46.414014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-706be5c7-d4ac-4c78-bb16-c265400ed1df tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1476 microversion: 2.1 time: 0.535091 Aug 04 13:58:46.433014 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 689/1355] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:45 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1476 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:46.452159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65c3401c-2a40-4f65-8cfb-6688710489c0 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:46.452983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-65c3401c-2a40-4f65-8cfb-6688710489c0 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:46.477949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65c3401c-2a40-4f65-8cfb-6688710489c0 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:46.478403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65c3401c-2a40-4f65-8cfb-6688710489c0 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:46.479201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65c3401c-2a40-4f65-8cfb-6688710489c0 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:46.479524 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f6c4beb5-8105-4d3a-8a53-1bf3c9ccf1ec tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.815475 Aug 04 13:58:46.480300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65c3401c-2a40-4f65-8cfb-6688710489c0 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:46.488688 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 667/1356] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 13:58:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:46.495827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2882fd2d-bdeb-4a56-b357-948988a55869 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470005d700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:46.592666 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2882fd2d-bdeb-4a56-b357-948988a55869 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.102130 Aug 04 13:58:46.602217 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 668/1357] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:46 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:46.609023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.176"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:46.612437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:46.620678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:46.621396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:46.623452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:46.624071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:46.668069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Acquired lock "refresh_cache-11b22ae8-b4dd-4cca-86c3-460706c29630" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:58:46.825221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-65c3401c-2a40-4f65-8cfb-6688710489c0 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:46.839015 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-65c3401c-2a40-4f65-8cfb-6688710489c0 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1273 microversion: 2.1 time: 0.402437 Aug 04 13:58:46.857177 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 690/1358] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:46 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1273 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:47.004350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-26149579-b2f0-4dda-9450-01450049fb73 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Action: 'create', calling method: .version_select at 0x7f47006a9280>, body: {"pool": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:47.964976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.176 (b8645836-4532-4403-b983-10648a07be81) with port ee449665-121c-4ded-86dc-319178276579 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 27abc51e-1bf4-456c-85a8-74112db16a3e.", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 13:58:47.966832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Releasing lock "refresh_cache-11b22ae8-b4dd-4cca-86c3-460706c29630" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:58:47.967587 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.176 (b8645836-4532-4403-b983-10648a07be81) with port ee449665-121c-4ded-86dc-319178276579 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 27abc51e-1bf4-456c-85a8-74112db16a3e. Aug 04 13:58:47.967587 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-19065a96-fb90-474e-90fe-43041262b10c'] Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Request method failure captured: Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action HTTP/1.1 Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 46 Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69BpsnaLAfZBlZKmkK87CN2Xuxmvb0MD0kUPYyymc7hfNQRlZFzbJgiF8xftY5zvfy-i7MM0xfbFi_HvJZrcp3h0FqMNoKchMeNWW7gUrUgarVbv59Y2voG3_z8KoZwc9WrtX_y5ZY-FoIVK13Hr6DlW2rg7HRIPoqzGOg-8GTM4Bcg Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:58:47.971768 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}] Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: e7461bc7dc404890b64fc7b71fdcbd94 Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: {"addFloatingIp": {"address": "172.25.2.176"}} Aug 04 13:58:47.973685 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: exception: Cannot associate floating IP 172.25.2.176 (b8645836-4532-4403-b983-10648a07be81) with port ee449665-121c-4ded-86dc-319178276579 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 27abc51e-1bf4-456c-85a8-74112db16a3e. Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-19065a96-fb90-474e-90fe-43041262b10c'] Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '11b22ae8-b4dd-4cca-86c3-460706c29630', 'body': {'addFloatingIp': {'address': '172.25.2.176'}}} Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:47.975042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 13:58:47.976501 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.176 (b8645836-4532-4403-b983-10648a07be81) with port ee449665-121c-4ded-86dc-319178276579 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 27abc51e-1bf4-456c-85a8-74112db16a3e. Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19065a96-fb90-474e-90fe-43041262b10c'] Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.176 (b8645836-4532-4403-b983-10648a07be81) with port ee449665-121c-4ded-86dc-319178276579 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 27abc51e-1bf4-456c-85a8-74112db16a3e. Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19065a96-fb90-474e-90fe-43041262b10c'] Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:47.977976 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.176 (b8645836-4532-4403-b983-10648a07be81) with port ee449665-121c-4ded-86dc-319178276579 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 27abc51e-1bf4-456c-85a8-74112db16a3e. Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19065a96-fb90-474e-90fe-43041262b10c'] Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:47.980367 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:58:47.983903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:47.983903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:58:47.983903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:58:47.983903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:58:47.983903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:58:47.983903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:58:47.983903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.176 (b8645836-4532-4403-b983-10648a07be81) with port ee449665-121c-4ded-86dc-319178276579 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 27abc51e-1bf4-456c-85a8-74112db16a3e. Aug 04 13:58:47.983903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19065a96-fb90-474e-90fe-43041262b10c'] Aug 04 13:58:47.983903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:58:47.987445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Returning 400 to user: Cannot associate floating IP 172.25.2.176 (b8645836-4532-4403-b983-10648a07be81) with port ee449665-121c-4ded-86dc-319178276579 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 27abc51e-1bf4-456c-85a8-74112db16a3e. Aug 04 13:58:47.987445 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-19065a96-fb90-474e-90fe-43041262b10c'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:58:47.990145 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7eb3bf36-0704-44c8-b418-6d8469242454 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action" status: 400 len: 382 microversion: 2.1 time: 1.386447 Aug 04 13:58:47.993305 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 669/1359] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:58:46 2022] POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action => generated 382 bytes in 1390 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:58:48.001123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-24ae490c-0748-4865-9ae4-3e7b4910cef1 req-744dc614-be59-47de-abc4-287384194493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde8a455-2bcf-44ca-b5e2-16688470f226", "tag": "03b69f95-f081-4cab-9615-bd7da2ce327d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:48.023823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-24ae490c-0748-4865-9ae4-3e7b4910cef1 req-744dc614-be59-47de-abc4-287384194493 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:48.024589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-24ae490c-0748-4865-9ae4-3e7b4910cef1 req-744dc614-be59-47de-abc4-287384194493 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:48.054499 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-24ae490c-0748-4865-9ae4-3e7b4910cef1 req-744dc614-be59-47de-abc4-287384194493 service nova] Creating event network-changed:03b69f95-f081-4cab-9615-bd7da2ce327d for instance bde8a455-2bcf-44ca-b5e2-16688470f226 on n-h1-844627-10 Aug 04 13:58:48.071834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-24ae490c-0748-4865-9ae4-3e7b4910cef1 req-744dc614-be59-47de-abc4-287384194493 service nova] Instance bde8a455-2bcf-44ca-b5e2-16688470f226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:58:48.097005 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-24ae490c-0748-4865-9ae4-3e7b4910cef1 req-744dc614-be59-47de-abc4-287384194493 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101654 Aug 04 13:58:48.097790 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 670/1360] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:48.103259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fc04b5fa-a703-41ed-88b0-996bf5487636 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:48.111067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fc04b5fa-a703-41ed-88b0-996bf5487636 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:48.125252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc04b5fa-a703-41ed-88b0-996bf5487636 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:48.132297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc04b5fa-a703-41ed-88b0-996bf5487636 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:48.133381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc04b5fa-a703-41ed-88b0-996bf5487636 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:48.133951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc04b5fa-a703-41ed-88b0-996bf5487636 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:48.729471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-fc04b5fa-a703-41ed-88b0-996bf5487636 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid ca56d355-4e66-4634-99fb-9ed160b6bc4b {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:58:48.759099 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fc04b5fa-a703-41ed-88b0-996bf5487636 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 2346 microversion: 2.25 time: 0.659915 Aug 04 13:58:48.796371 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 671/1361] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:58:48 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 2346 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:58:48.796371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5cb31dc7-d81b-49c1-b89a-98d424d54f60 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:48.796371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5cb31dc7-d81b-49c1-b89a-98d424d54f60 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:48.808963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cb31dc7-d81b-49c1-b89a-98d424d54f60 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:48.815800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cb31dc7-d81b-49c1-b89a-98d424d54f60 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:48.816940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cb31dc7-d81b-49c1-b89a-98d424d54f60 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:48.817503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cb31dc7-d81b-49c1-b89a-98d424d54f60 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:48.888756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:48.986553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:49.211832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5cb31dc7-d81b-49c1-b89a-98d424d54f60 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:49.219747 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5cb31dc7-d81b-49c1-b89a-98d424d54f60 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1474 microversion: 2.1 time: 0.436718 Aug 04 13:58:49.233719 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 672/1362] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:48 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1474 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:49.238942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2929b5f2-60d6-4b04-865e-9c002789a99b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700080550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:49.309605 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2929b5f2-60d6-4b04-865e-9c002789a99b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.074352 Aug 04 13:58:49.310201 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 673/1363] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:49 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:49.325419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-28bf1c77-fd1f-480d-bb17-bc5b5f4810a1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:49.326330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-28bf1c77-fd1f-480d-bb17-bc5b5f4810a1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:49.334610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28bf1c77-fd1f-480d-bb17-bc5b5f4810a1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:49.337523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28bf1c77-fd1f-480d-bb17-bc5b5f4810a1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:49.338561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28bf1c77-fd1f-480d-bb17-bc5b5f4810a1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:49.346045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28bf1c77-fd1f-480d-bb17-bc5b5f4810a1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:49.595313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-28bf1c77-fd1f-480d-bb17-bc5b5f4810a1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:49.605190 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-28bf1c77-fd1f-480d-bb17-bc5b5f4810a1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1315 microversion: 2.1 time: 0.293690 Aug 04 13:58:49.605781 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 674/1364] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:49 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:49.612814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d4ad573-d1e4-4a7e-996d-cc6f0e39aec7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '.version_select at 0x7f4700154f70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:52.124065 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-26149579-b2f0-4dda-9450-01450049fb73 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.234935 Aug 04 13:58:52.140919 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 691/1365] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 13:58:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:58:52.147134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b2be41df-1309-46a7-8e53-debdc370b035 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:52.151086 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 13:58:52.151086 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 13:58:52.153652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2be41df-1309-46a7-8e53-debdc370b035 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:52.154659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2be41df-1309-46a7-8e53-debdc370b035 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:52.156491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2be41df-1309-46a7-8e53-debdc370b035 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:52.163796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2be41df-1309-46a7-8e53-debdc370b035 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:52.232009 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b2be41df-1309-46a7-8e53-debdc370b035 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.089499 Aug 04 13:58:52.238822 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 692/1366] 10.222.0.66 () {60 vars in 1217 bytes} [Thu Aug 4 13:58:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:52.468683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cc9416ae-3a60-42d5-aa79-71d883ba9040 req-84e68a55-9b53-4cd5-bbe0-9361b8cf8bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ca2cc-3cdb-477e-9166-c915de5fc507", "name": "network-vif-plugged", "status": "completed", "tag": "3725cfe1-eef7-4aa9-8c08-89a978079195"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:52.495709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cc9416ae-3a60-42d5-aa79-71d883ba9040 req-84e68a55-9b53-4cd5-bbe0-9361b8cf8bc4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:52.497590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cc9416ae-3a60-42d5-aa79-71d883ba9040 req-84e68a55-9b53-4cd5-bbe0-9361b8cf8bc4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:52.534903 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cc9416ae-3a60-42d5-aa79-71d883ba9040 req-84e68a55-9b53-4cd5-bbe0-9361b8cf8bc4 service nova] Creating event network-vif-plugged:3725cfe1-eef7-4aa9-8c08-89a978079195 for instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 on n-h2-844627-10 Aug 04 13:58:52.547277 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cc9416ae-3a60-42d5-aa79-71d883ba9040 req-84e68a55-9b53-4cd5-bbe0-9361b8cf8bc4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306671 Aug 04 13:58:52.555220 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 693/1367] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:52.568806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f4106d9-b9cb-4aee-b424-36a047720496 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:52.570160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f4106d9-b9cb-4aee-b424-36a047720496 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:52.590778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f4106d9-b9cb-4aee-b424-36a047720496 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:52.593012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f4106d9-b9cb-4aee-b424-36a047720496 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:52.594165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f4106d9-b9cb-4aee-b424-36a047720496 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:52.597484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f4106d9-b9cb-4aee-b424-36a047720496 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:53.061115 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d4ad573-d1e4-4a7e-996d-cc6f0e39aec7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/b8645836-4532-4403-b983-10648a07be81" status: 202 len: 0 microversion: 2.1 time: 3.451843 Aug 04 13:58:53.061922 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 675/1368] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 13:58:49 2022] DELETE /compute/v2.1/os-floating-ips/b8645836-4532-4403-b983-10648a07be81 => generated 0 bytes in 3453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:53.067942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-17917122-b2ee-4c09-96d1-350405177c13 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470005d700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:53.170616 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-17917122-b2ee-4c09-96d1-350405177c13 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.107089 Aug 04 13:58:53.177600 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 676/1369] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:53 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:53.204909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cce42608-d99f-42c4-afcf-4c61d34f7a66 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:53.206239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cce42608-d99f-42c4-afcf-4c61d34f7a66 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:53.216485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cce42608-d99f-42c4-afcf-4c61d34f7a66 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:53.218955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cce42608-d99f-42c4-afcf-4c61d34f7a66 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:53.220017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cce42608-d99f-42c4-afcf-4c61d34f7a66 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:53.220818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cce42608-d99f-42c4-afcf-4c61d34f7a66 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:53.271312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f4106d9-b9cb-4aee-b424-36a047720496 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:53.287565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f4106d9-b9cb-4aee-b424-36a047720496 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1471 microversion: 2.1 time: 0.729223 Aug 04 13:58:53.289768 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 694/1370] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:52 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1471 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:53.302775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-89b70bdb-a691-4869-b607-977bed9f9c7f tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Action: 'create', calling method: .version_select at 0x7f4700a61160>, body: {"pool": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:54.142165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cce42608-d99f-42c4-afcf-4c61d34f7a66 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:54.171115 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cce42608-d99f-42c4-afcf-4c61d34f7a66 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1315 microversion: 2.1 time: 0.989083 Aug 04 13:58:54.177271 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 677/1371] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:53 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:54.207559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.74"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:54.618210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:54.629737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:54.632552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:54.634221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:54.634842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:55.291913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Acquired lock "refresh_cache-11b22ae8-b4dd-4cca-86c3-460706c29630" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:58:56.989727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Building network info cache for instance {{(pid=130960) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 13:58:57.487918 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-89b70bdb-a691-4869-b607-977bed9f9c7f tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.196429 Aug 04 13:58:57.489315 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 695/1372] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 13:58:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:58.129321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b374ed0d-5d3b-4633-8e27-bb491061f029 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:58.130084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b374ed0d-5d3b-4633-8e27-bb491061f029 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:58.154751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b374ed0d-5d3b-4633-8e27-bb491061f029 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:58.155890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b374ed0d-5d3b-4633-8e27-bb491061f029 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:58.156901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b374ed0d-5d3b-4633-8e27-bb491061f029 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:58.162044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b374ed0d-5d3b-4633-8e27-bb491061f029 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:58.537848 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b374ed0d-5d3b-4633-8e27-bb491061f029 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "POST /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226/action" status: 202 len: 0 microversion: 2.1 time: 1.044719 Aug 04 13:58:58.539954 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 696/1373] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:58:57 2022] POST /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226/action => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:58:58.667854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Updating instance_info_cache with network_info: [{"id": "ee449665-121c-4ded-86dc-319178276579", "address": "fa:16:3e:4a:f8:4d", "network": {"id": "8d424dee-b56a-4c3f-bb38-75c235d11e5a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2046738664-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4a0a4ae5d6de48b2bd1203bd6c3922b4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee449665-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130960) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 13:58:58.693438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Releasing lock "refresh_cache-11b22ae8-b4dd-4cca-86c3-460706c29630" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:58:58.695431 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-551b8fc8-ae85-4b54-bd47-199662d10130 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action" status: 202 len: 0 microversion: 2.1 time: 4.516505 Aug 04 13:58:58.713947 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 678/1374] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:58:54 2022] POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action => generated 0 bytes in 4535 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 13:58:58.728684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-59d5f52a-f289-4897-97a5-bf8c82006e28 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47001c79d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:58.828412 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-59d5f52a-f289-4897-97a5-bf8c82006e28 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.112602 Aug 04 13:58:58.830724 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 679/1375] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:58:58 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:58.855435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23d03e9e-f6c2-4558-b28d-cd06d218d592 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:58.858783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-23d03e9e-f6c2-4558-b28d-cd06d218d592 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:58.887733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23d03e9e-f6c2-4558-b28d-cd06d218d592 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:58.889032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23d03e9e-f6c2-4558-b28d-cd06d218d592 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:58.890112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23d03e9e-f6c2-4558-b28d-cd06d218d592 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:58.891687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23d03e9e-f6c2-4558-b28d-cd06d218d592 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:59.080514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-bb8f8b05-7ee6-4aac-90d2-a840ca2a7cae req-fd4c80e1-1bf6-4e3b-989d-54bd9c5e2a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8", "tag": "4b94338f-38f6-4326-98aa-c6b294584f3d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:59.098482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bb8f8b05-7ee6-4aac-90d2-a840ca2a7cae req-fd4c80e1-1bf6-4e3b-989d-54bd9c5e2a03 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:59.098932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bb8f8b05-7ee6-4aac-90d2-a840ca2a7cae req-fd4c80e1-1bf6-4e3b-989d-54bd9c5e2a03 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:59.123212 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bb8f8b05-7ee6-4aac-90d2-a840ca2a7cae req-fd4c80e1-1bf6-4e3b-989d-54bd9c5e2a03 service nova] Creating event network-changed:4b94338f-38f6-4326-98aa-c6b294584f3d for instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 on n-h1-844627-10 Aug 04 13:58:59.140828 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-bb8f8b05-7ee6-4aac-90d2-a840ca2a7cae req-fd4c80e1-1bf6-4e3b-989d-54bd9c5e2a03 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.597946 Aug 04 13:58:59.142078 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 697/1376] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:59.148212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0f984b1c-1883-4341-ad87-c65626b9f48b req-e14e527d-0431-4256-99ef-1c51f2d43fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8a455-2bcf-44ca-b5e2-16688470f226", "name": "network-vif-plugged", "status": "completed", "tag": "03b69f95-f081-4cab-9615-bd7da2ce327d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:59.177297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0f984b1c-1883-4341-ad87-c65626b9f48b req-e14e527d-0431-4256-99ef-1c51f2d43fed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:59.177752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0f984b1c-1883-4341-ad87-c65626b9f48b req-e14e527d-0431-4256-99ef-1c51f2d43fed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:59.195647 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0f984b1c-1883-4341-ad87-c65626b9f48b req-e14e527d-0431-4256-99ef-1c51f2d43fed service nova] Creating event network-vif-plugged:03b69f95-f081-4cab-9615-bd7da2ce327d for instance bde8a455-2bcf-44ca-b5e2-16688470f226 on n-h1-844627-10 Aug 04 13:58:59.203878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-0f984b1c-1883-4341-ad87-c65626b9f48b req-e14e527d-0431-4256-99ef-1c51f2d43fed service nova] Instance bde8a455-2bcf-44ca-b5e2-16688470f226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:58:59.225778 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0f984b1c-1883-4341-ad87-c65626b9f48b req-e14e527d-0431-4256-99ef-1c51f2d43fed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082055 Aug 04 13:58:59.227085 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 698/1377] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:59.233851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cd7a587e-1f5e-42ed-8c1b-4577f382c902 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59086d6f-5184-4367-af6c-34c2aff78662", "device": "/dev/xvdb"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:59.237245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cd7a587e-1f5e-42ed-8c1b-4577f382c902 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:59.237669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-23d03e9e-f6c2-4558-b28d-cd06d218d592 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:58:59.241841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=65,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:58:59.248669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd7a587e-1f5e-42ed-8c1b-4577f382c902 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:59.249239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd7a587e-1f5e-42ed-8c1b-4577f382c902 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:59.250061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd7a587e-1f5e-42ed-8c1b-4577f382c902 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:59.250511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd7a587e-1f5e-42ed-8c1b-4577f382c902 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:59.257594 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-23d03e9e-f6c2-4558-b28d-cd06d218d592 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1315 microversion: 2.1 time: 0.421323 Aug 04 13:58:59.258725 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 680/1378] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:58 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:58:59.265198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-1acc74b9-baf9-44d0-86c1-a75a206ac234 req-b6d0e18a-d7ec-4d49-90c4-27b5b995f836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b22ae8-b4dd-4cca-86c3-460706c29630", "tag": "ee449665-121c-4ded-86dc-319178276579"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:59.282345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1acc74b9-baf9-44d0-86c1-a75a206ac234 req-b6d0e18a-d7ec-4d49-90c4-27b5b995f836 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:59.283680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1acc74b9-baf9-44d0-86c1-a75a206ac234 req-b6d0e18a-d7ec-4d49-90c4-27b5b995f836 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:59.302337 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-1acc74b9-baf9-44d0-86c1-a75a206ac234 req-b6d0e18a-d7ec-4d49-90c4-27b5b995f836 service nova] Creating event network-changed:ee449665-121c-4ded-86dc-319178276579 for instance 11b22ae8-b4dd-4cca-86c3-460706c29630 on n-h1-844627-10 Aug 04 13:58:59.311182 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-1acc74b9-baf9-44d0-86c1-a75a206ac234 req-b6d0e18a-d7ec-4d49-90c4-27b5b995f836 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048045 Aug 04 13:58:59.313027 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 681/1379] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:58:59.328378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1149f0ed-9477-46b3-be98-b71830194876 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Action: 'create', calling method: .version_select at 0x7f470020d1f0>, body: {"pool": null} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:58:59.755538 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cd7a587e-1f5e-42ed-8c1b-4577f382c902 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "POST /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.524516 Aug 04 13:58:59.756170 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 699/1380] 10.222.0.66 () {62 vars in 1364 bytes} [Thu Aug 4 13:58:59 2022] POST /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 13:58:59.794324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5bc021d5-9c5b-413c-8658-f0b83878d688 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:58:59.795497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5bc021d5-9c5b-413c-8658-f0b83878d688 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:58:59.820201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bc021d5-9c5b-413c-8658-f0b83878d688 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:59.822440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bc021d5-9c5b-413c-8658-f0b83878d688 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:58:59.825175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bc021d5-9c5b-413c-8658-f0b83878d688 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:58:59.826862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bc021d5-9c5b-413c-8658-f0b83878d688 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:00.733561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5bc021d5-9c5b-413c-8658-f0b83878d688 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:00.744517 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5bc021d5-9c5b-413c-8658-f0b83878d688 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1470 microversion: 2.1 time: 0.971970 Aug 04 13:59:00.749342 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 700/1381] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:58:59 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1470 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:00.760021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9945c540-6206-45b5-8010-04c33a8c814a tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '.version_select at 0x7f47006d1040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:02.186725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:03.749985 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9945c540-6206-45b5-8010-04c33a8c814a tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/951eae45-3532-49ed-89d1-7d27e48f7887" status: 202 len: 0 microversion: 2.1 time: 2.999043 Aug 04 13:59:03.751983 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 701/1382] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 13:59:00 2022] DELETE /compute/v2.1/os-floating-ips/951eae45-3532-49ed-89d1-7d27e48f7887 => generated 0 bytes in 3002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:03.880911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f618d74-a5cd-4d38-8f56-cbf0caee5710 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:03.936975 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f618d74-a5cd-4d38-8f56-cbf0caee5710 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.183822 Aug 04 13:59:03.942966 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 702/1383] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:03.962467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-824c078a-c531-4fe9-906b-0a3cde05bbfa tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47005381f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:04.089893 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-824c078a-c531-4fe9-906b-0a3cde05bbfa tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.143184 Aug 04 13:59:04.091258 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 703/1384] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:03 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:04.165590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34139ca5-672f-4f1b-9a0b-496650356ed4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:04.168077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-34139ca5-672f-4f1b-9a0b-496650356ed4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:04.199181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34139ca5-672f-4f1b-9a0b-496650356ed4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:04.199696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34139ca5-672f-4f1b-9a0b-496650356ed4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:04.203719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34139ca5-672f-4f1b-9a0b-496650356ed4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:04.204411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34139ca5-672f-4f1b-9a0b-496650356ed4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:04.751160 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1149f0ed-9477-46b3-be98-b71830194876 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.435743 Aug 04 13:59:04.753114 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 682/1385] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 13:58:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:04.759023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f1948be2-0270-4386-85bd-bc31f18dadb5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:04.761171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f1948be2-0270-4386-85bd-bc31f18dadb5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:04.761450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-34139ca5-672f-4f1b-9a0b-496650356ed4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:04.763815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:04.772565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-34139ca5-672f-4f1b-9a0b-496650356ed4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1315 microversion: 2.1 time: 0.660075 Aug 04 13:59:04.773424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1948be2-0270-4386-85bd-bc31f18dadb5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:04.774352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1948be2-0270-4386-85bd-bc31f18dadb5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:04.775363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1948be2-0270-4386-85bd-bc31f18dadb5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:04.776008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1948be2-0270-4386-85bd-bc31f18dadb5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:04.778018 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 704/1386] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:04 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:04.787084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-838fd975-1bed-4c34-b232-3c090b047935 req-95a1e2a1-a181-40eb-a249-f7117da95d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8", "name": "network-vif-plugged", "status": "completed", "tag": "4b94338f-38f6-4326-98aa-c6b294584f3d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:04.831359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-838fd975-1bed-4c34-b232-3c090b047935 req-95a1e2a1-a181-40eb-a249-f7117da95d7b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:04.832813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-838fd975-1bed-4c34-b232-3c090b047935 req-95a1e2a1-a181-40eb-a249-f7117da95d7b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:04.852552 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-838fd975-1bed-4c34-b232-3c090b047935 req-95a1e2a1-a181-40eb-a249-f7117da95d7b service nova] Creating event network-vif-plugged:4b94338f-38f6-4326-98aa-c6b294584f3d for instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 on n-h1-844627-10 Aug 04 13:59:04.858801 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-838fd975-1bed-4c34-b232-3c090b047935 req-95a1e2a1-a181-40eb-a249-f7117da95d7b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078844 Aug 04 13:59:04.860018 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 705/1387] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:04.868058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7aa08731-da3b-4f6e-8d9c-f89b555e02f5 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7aa08731-da3b-4f6e-8d9c-f89b555e02f5 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Request method failure captured: Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action HTTP/1.1 Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 34 Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69BpsnaLAfZBlZKmkK87CN2Xuxmvb0MD0kUPYyymc7hfNQRlZFzbJgiF8xftY5zvfy-i7MM0xfbFi_HvJZrcp3h0FqMNoKchMeNWW7gUrUgarVbv59Y2voG3_z8KoZwc9WrtX_y5ZY-FoIVK13Hr6DlW2rg7HRIPoqzGOg-8GTM4Bcg Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:59:04.872677 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}] Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: e7461bc7dc404890b64fc7b71fdcbd94 Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: {"addFloatingIp": {"address": ""}} Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:59:04.874504 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '11b22ae8-b4dd-4cca-86c3-460706c29630', 'body': {'addFloatingIp': {'address': ''}}} Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi '' Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:04.875543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:59:04.877163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:59:04.879338 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 13:59:04.879338 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:04.880849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7aa08731-da3b-4f6e-8d9c-f89b555e02f5 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:04.881916 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7aa08731-da3b-4f6e-8d9c-f89b555e02f5 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action" status: 400 len: 142 microversion: 2.1 time: 0.020263 Aug 04 13:59:04.882689 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 706/1388] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:59:04 2022] POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:59:04.887623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8290372c-2209-40b5-9555-774dcd12f20d tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:04.917153 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8290372c-2209-40b5-9555-774dcd12f20d tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.032436 Aug 04 13:59:04.918580 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 707/1389] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 13:59:04 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:04.925267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab27ea89-199f-4d1e-9114-496468f10ec9 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Action: 'create', calling method: .version_select at 0x7f47007d78b0>, body: {"pool": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:05.706776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f1948be2-0270-4386-85bd-bc31f18dadb5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:05.718402 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f1948be2-0270-4386-85bd-bc31f18dadb5 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1470 microversion: 2.1 time: 0.963451 Aug 04 13:59:05.729108 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 683/1390] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:04 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1470 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:05.748247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:05.751202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:05.777779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:05.778804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:05.782704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:05.783527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:05.876123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Acquired lock "refresh_cache-11b22ae8-b4dd-4cca-86c3-460706c29630" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 13:59:06.324050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Releasing lock "refresh_cache-11b22ae8-b4dd-4cca-86c3-460706c29630" {{(pid=130960) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 13:59:06.324819 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] HTTP exception thrown: floating IP not found Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Request method failure captured: Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action HTTP/1.1 Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 41 Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69BpsnaLAfZBlZKmkK87CN2Xuxmvb0MD0kUPYyymc7hfNQRlZFzbJgiF8xftY5zvfy-i7MM0xfbFi_HvJZrcp3h0FqMNoKchMeNWW7gUrUgarVbv59Y2voG3_z8KoZwc9WrtX_y5ZY-FoIVK13Hr6DlW2rg7HRIPoqzGOg-8GTM4Bcg Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:06.327112 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}] Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: e7461bc7dc404890b64fc7b71fdcbd94 Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:06.328682 n-d-844627-10 devstack@n-api.service[130960]: exception: floating IP not found Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '11b22ae8-b4dd-4cca-86c3-460706c29630', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:06.329608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 04 13:59:06.330931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:06.334960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Returning 404 to user: floating IP not found {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:06.337470 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8a87fbf4-22d0-4882-bda8-2d09116c3fdb tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action" status: 404 len: 67 microversion: 2.1 time: 0.605454 Aug 04 13:59:06.338268 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 684/1391] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:59:05 2022] POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action => generated 67 bytes in 608 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:59:06.359361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e22401e1-9d95-40e5-b320-c289ebad25f9 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:06.389188 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e22401e1-9d95-40e5-b320-c289ebad25f9 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.047558 Aug 04 13:59:06.390409 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 685/1392] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:06.405569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1f0a2b5-d9c5-4806-b48f-c0af32d5cc71 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700264d30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:06.495174 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1f0a2b5-d9c5-4806-b48f-c0af32d5cc71 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.102982 Aug 04 13:59:06.501314 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 686/1393] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:06 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:06.521411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-53613517-ed5c-4946-bd27-72e83b2c5578 req-50a22f12-db30-4868-baa4-9392adf7e501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8a455-2bcf-44ca-b5e2-16688470f226", "name": "network-vif-unplugged", "status": "completed", "tag": "03b69f95-f081-4cab-9615-bd7da2ce327d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:06.563177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-53613517-ed5c-4946-bd27-72e83b2c5578 req-50a22f12-db30-4868-baa4-9392adf7e501 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:06.563633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-53613517-ed5c-4946-bd27-72e83b2c5578 req-50a22f12-db30-4868-baa4-9392adf7e501 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:06.599687 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-53613517-ed5c-4946-bd27-72e83b2c5578 req-50a22f12-db30-4868-baa4-9392adf7e501 service nova] Creating event network-vif-unplugged:03b69f95-f081-4cab-9615-bd7da2ce327d for instance bde8a455-2bcf-44ca-b5e2-16688470f226 on n-h2-844627-10 Aug 04 13:59:06.606007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-53613517-ed5c-4946-bd27-72e83b2c5578 req-50a22f12-db30-4868-baa4-9392adf7e501 service nova] Instance bde8a455-2bcf-44ca-b5e2-16688470f226 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 13:59:06.639765 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-53613517-ed5c-4946-bd27-72e83b2c5578 req-50a22f12-db30-4868-baa4-9392adf7e501 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131925 Aug 04 13:59:06.640637 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 687/1394] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:06.658565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff3be082-3068-478e-90ef-be9316ef79cb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:06.662340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff3be082-3068-478e-90ef-be9316ef79cb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:06.690595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3be082-3068-478e-90ef-be9316ef79cb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:06.692582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3be082-3068-478e-90ef-be9316ef79cb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:06.703711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3be082-3068-478e-90ef-be9316ef79cb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:06.709353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3be082-3068-478e-90ef-be9316ef79cb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:07.229771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff3be082-3068-478e-90ef-be9316ef79cb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:07.254850 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff3be082-3068-478e-90ef-be9316ef79cb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1315 microversion: 2.1 time: 0.610811 Aug 04 13:59:07.256234 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 688/1395] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:06 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:07.314291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aaa4fea1-845c-4ba0-a96d-146d9f238e5b tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:07.541604 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-aaa4fea1-845c-4ba0-a96d-146d9f238e5b tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aaa4fea1-845c-4ba0-a96d-146d9f238e5b tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Request method failure captured: Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action HTTP/1.1 Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 44 Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69BpsnaLAfZBlZKmkK87CN2Xuxmvb0MD0kUPYyymc7hfNQRlZFzbJgiF8xftY5zvfy-i7MM0xfbFi_HvJZrcp3h0FqMNoKchMeNWW7gUrUgarVbv59Y2voG3_z8KoZwc9WrtX_y5ZY-FoIVK13Hr6DlW2rg7HRIPoqzGOg-8GTM4Bcg Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:07.543337 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}] Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: e7461bc7dc404890b64fc7b71fdcbd94 Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:07.546392 n-d-844627-10 devstack@n-api.service[130960]: exception: Floating IP not found for address 0.0.0.0. Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '11b22ae8-b4dd-4cca-86c3-460706c29630', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:07.548126 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 04 13:59:07.551297 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:07.556150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aaa4fea1-845c-4ba0-a96d-146d9f238e5b tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:07.556150 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aaa4fea1-845c-4ba0-a96d-146d9f238e5b tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action" status: 404 len: 88 microversion: 2.1 time: 0.261895 Aug 04 13:59:07.556150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 689/1396] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:59:07 2022] POST /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630/action => generated 88 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:59:07.561818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-986d580a-d823-4484-b6fe-408b4e4ab6c4 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:07.586847 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-986d580a-d823-4484-b6fe-408b4e4ab6c4 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034322 Aug 04 13:59:07.587735 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 690/1397] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:07.599933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac6ce100-0bdb-47b5-ab5c-8dd7c0ecb422 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:07.600563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac6ce100-0bdb-47b5-ab5c-8dd7c0ecb422 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:07.619629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6ce100-0bdb-47b5-ab5c-8dd7c0ecb422 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:07.620057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6ce100-0bdb-47b5-ab5c-8dd7c0ecb422 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:07.621105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6ce100-0bdb-47b5-ab5c-8dd7c0ecb422 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:07.626661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6ce100-0bdb-47b5-ab5c-8dd7c0ecb422 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:08.405951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac6ce100-0bdb-47b5-ab5c-8dd7c0ecb422 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:08.437816 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac6ce100-0bdb-47b5-ab5c-8dd7c0ecb422 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1470 microversion: 2.1 time: 0.848833 Aug 04 13:59:08.444563 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 691/1398] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:07 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1470 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:08.486941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d09dddd-55fd-421b-a33c-c0ecf5e1ae99 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002393a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:08.621298 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3d09dddd-55fd-421b-a33c-c0ecf5e1ae99 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.173581 Aug 04 13:59:08.623199 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 692/1399] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:08 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:08.642681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c4bbccc-f8c4-413d-b9b3-20c2f3f361be tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:08.648449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c4bbccc-f8c4-413d-b9b3-20c2f3f361be tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:08.671273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c4bbccc-f8c4-413d-b9b3-20c2f3f361be tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:08.672028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c4bbccc-f8c4-413d-b9b3-20c2f3f361be tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:08.673106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c4bbccc-f8c4-413d-b9b3-20c2f3f361be tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:08.673731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c4bbccc-f8c4-413d-b9b3-20c2f3f361be tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:08.750216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c4bbccc-f8c4-413d-b9b3-20c2f3f361be tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:59:08.964327 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c4bbccc-f8c4-413d-b9b3-20c2f3f361be tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "DELETE /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 204 len: 0 microversion: 2.1 time: 0.339263 Aug 04 13:59:08.965340 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 693/1400] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:59:08 2022] DELETE /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:59:08.975486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f5ac2752-b950-4f23-b5e5-ba5f6271303e tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:09.052835 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f5ac2752-b950-4f23-b5e5-ba5f6271303e tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.085716 Aug 04 13:59:09.057750 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 694/1401] 10.222.0.66 () {58 vars in 1165 bytes} [Thu Aug 4 13:59:08 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:09.068724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bbe92efc-e736-4164-aaca-374fa310c3c9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:09.069796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bbe92efc-e736-4164-aaca-374fa310c3c9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:09.094401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbe92efc-e736-4164-aaca-374fa310c3c9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:09.095219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbe92efc-e736-4164-aaca-374fa310c3c9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:09.096195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbe92efc-e736-4164-aaca-374fa310c3c9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:09.098074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbe92efc-e736-4164-aaca-374fa310c3c9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:09.467132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bbe92efc-e736-4164-aaca-374fa310c3c9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:09.486666 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bbe92efc-e736-4164-aaca-374fa310c3c9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1504 microversion: 2.1 time: 0.427399 Aug 04 13:59:09.487565 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 695/1402] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:09 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:09.495245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-55c72e67-6328-4a9e-85c2-725c034c8552 req-dc8fd033-bead-4ab0-9cf9-8548f8855d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bde8a455-2bcf-44ca-b5e2-16688470f226", "tag": "03b69f95-f081-4cab-9615-bd7da2ce327d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:09.513844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-55c72e67-6328-4a9e-85c2-725c034c8552 req-dc8fd033-bead-4ab0-9cf9-8548f8855d32 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:09.514549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-55c72e67-6328-4a9e-85c2-725c034c8552 req-dc8fd033-bead-4ab0-9cf9-8548f8855d32 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:09.547052 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-55c72e67-6328-4a9e-85c2-725c034c8552 req-dc8fd033-bead-4ab0-9cf9-8548f8855d32 service nova] Creating event network-changed:03b69f95-f081-4cab-9615-bd7da2ce327d for instance bde8a455-2bcf-44ca-b5e2-16688470f226 on n-h2-844627-10 Aug 04 13:59:09.558194 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ab27ea89-199f-4d1e-9114-496468f10ec9 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.637944 Aug 04 13:59:09.558993 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-55c72e67-6328-4a9e-85c2-725c034c8552 req-dc8fd033-bead-4ab0-9cf9-8548f8855d32 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069937 Aug 04 13:59:09.559571 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 708/1403] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 13:59:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:09.560123 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 696/1404] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:09.567592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ff636c2-150d-43d8-9d43-aa66e57116d7 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:09.569663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc752b0a-8b2c-4164-a484-e3125b8a47bc tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:09.571584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bc752b0a-8b2c-4164-a484-e3125b8a47bc tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:09.578512 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ff636c2-150d-43d8-9d43-aa66e57116d7 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016730 Aug 04 13:59:09.579707 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 697/1405] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:09.584912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:09.585459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9fade02-e2be-4af0-8bed-7a5b15af59e0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:09.586956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a9fade02-e2be-4af0-8bed-7a5b15af59e0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:09.588161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc752b0a-8b2c-4164-a484-e3125b8a47bc tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:09.589653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc752b0a-8b2c-4164-a484-e3125b8a47bc tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:09.591062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc752b0a-8b2c-4164-a484-e3125b8a47bc tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:09.592088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc752b0a-8b2c-4164-a484-e3125b8a47bc tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:09.595487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9fade02-e2be-4af0-8bed-7a5b15af59e0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:09.596346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9fade02-e2be-4af0-8bed-7a5b15af59e0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:09.598567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9fade02-e2be-4af0-8bed-7a5b15af59e0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:09.599194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9fade02-e2be-4af0-8bed-7a5b15af59e0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:10.450768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a9fade02-e2be-4af0-8bed-7a5b15af59e0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:10.478826 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a9fade02-e2be-4af0-8bed-7a5b15af59e0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1463 microversion: 2.1 time: 0.897392 Aug 04 13:59:10.498195 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 698/1406] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:09 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1463 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:10.522598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e9bc04f2-122d-4df4-b6cc-5d9e56558df5 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1993532890"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:10.523548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bc752b0a-8b2c-4164-a484-e3125b8a47bc tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:10.529528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e9bc04f2-122d-4df4-b6cc-5d9e56558df5 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:10.544050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9bc04f2-122d-4df4-b6cc-5d9e56558df5 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:10.545277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9bc04f2-122d-4df4-b6cc-5d9e56558df5 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:10.547095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9bc04f2-122d-4df4-b6cc-5d9e56558df5 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:10.548195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e9bc04f2-122d-4df4-b6cc-5d9e56558df5 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:10.575331 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bc752b0a-8b2c-4164-a484-e3125b8a47bc tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1541 microversion: 2.1 time: 1.013846 Aug 04 13:59:10.590619 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 709/1407] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:09 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1541 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:10.632022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c2f60459-d044-45d6-b8b7-12e34de9fae8 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Calling method '.version_select at 0x7f470081e3a0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:11.304006 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.network.security_group_api [None req-e9bc04f2-122d-4df4-b6cc-5d9e56558df5 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Adding security group a320af46-7eb5-4529-9c22-a37a270abdc4 to port 4b94338f-38f6-4326-98aa-c6b294584f3d Aug 04 13:59:11.547021 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c2f60459-d044-45d6-b8b7-12e34de9fae8 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/3aa1ba94-b7ec-47e4-a9e3-5aa50deaf1e4" status: 200 len: 142 microversion: 2.1 time: 0.951207 Aug 04 13:59:11.548859 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 710/1408] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 13:59:10 2022] GET /compute/v2.1/os-floating-ips/3aa1ba94-b7ec-47e4-a9e3-5aa50deaf1e4 => generated 142 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:11.560427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f7bf962e-1e32-4bd3-8980-fbd69d9404f1 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:11.673035 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f7bf962e-1e32-4bd3-8980-fbd69d9404f1 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.121388 Aug 04 13:59:11.674052 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 711/1409] 10.222.0.66 () {58 vars in 1169 bytes} [Thu Aug 4 13:59:11 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:11.682865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c5ef61a5-6cd7-416f-989b-33aa2b7826c7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700491d30>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:11.817463 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c5ef61a5-6cd7-416f-989b-33aa2b7826c7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1452 microversion: 2.1 time: 0.142000 Aug 04 13:59:11.822979 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 712/1410] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:11 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:12.166936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a366eb9-b10e-45a3-b0b9-36a2abfbc548 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:12.167846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a366eb9-b10e-45a3-b0b9-36a2abfbc548 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:12.174538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a366eb9-b10e-45a3-b0b9-36a2abfbc548 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:12.175827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a366eb9-b10e-45a3-b0b9-36a2abfbc548 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:12.176801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a366eb9-b10e-45a3-b0b9-36a2abfbc548 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:12.177438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a366eb9-b10e-45a3-b0b9-36a2abfbc548 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:12.668931 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e9bc04f2-122d-4df4-b6cc-5d9e56558df5 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8/action" status: 202 len: 0 microversion: 2.1 time: 2.166257 Aug 04 13:59:12.677393 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 699/1411] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:59:10 2022] POST /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8/action => generated 0 bytes in 2176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:12.689423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bed57de-0f0c-4131-bf47-92d637a439c2 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Calling method '.version_select at 0x7f470020d3a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:12.834371 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a366eb9-b10e-45a3-b0b9-36a2abfbc548 tempest-MigrationsAdminTest-1536428703 tempest-MigrationsAdminTest-1536428703-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1616 microversion: 2.1 time: 1.004226 Aug 04 13:59:12.835434 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 713/1412] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:11 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1616 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:12.864336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4c897e63-b570-4fc6-a36a-a43b889a198c tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:12.866201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c897e63-b570-4fc6-a36a-a43b889a198c tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:12.887787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c897e63-b570-4fc6-a36a-a43b889a198c tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:12.890853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c897e63-b570-4fc6-a36a-a43b889a198c tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:12.897288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c897e63-b570-4fc6-a36a-a43b889a198c tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:12.899075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c897e63-b570-4fc6-a36a-a43b889a198c tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:13.078684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4c897e63-b570-4fc6-a36a-a43b889a198c tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7461bc7dc404890b64fc7b71fdcbd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0a4ae5d6de48b2bd1203bd6c3922b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:13.090015 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4c897e63-b570-4fc6-a36a-a43b889a198c tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 200 len: 1499 microversion: 2.1 time: 0.250539 Aug 04 13:59:13.099898 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 714/1413] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:12 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 1499 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:13.105189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9e93096a-cca6-40d9-94af-bdfd4237f92e tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:13.130268 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9e93096a-cca6-40d9-94af-bdfd4237f92e tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.028672 Aug 04 13:59:13.134304 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 715/1414] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 13:59:13 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:13.142316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0d819c07-508c-4011-a0c6-3e3c26ffebe8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1871533861"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:13.151097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0d819c07-508c-4011-a0c6-3e3c26ffebe8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:13.162596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d819c07-508c-4011-a0c6-3e3c26ffebe8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:13.163311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d819c07-508c-4011-a0c6-3e3c26ffebe8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:13.165304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d819c07-508c-4011-a0c6-3e3c26ffebe8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:13.169720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d819c07-508c-4011-a0c6-3e3c26ffebe8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:13.638555 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.network.security_group_api [None req-0d819c07-508c-4011-a0c6-3e3c26ffebe8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Adding security group 563d8499-c779-4e25-81f1-bd0714e70c34 to port 4b94338f-38f6-4326-98aa-c6b294584f3d Aug 04 13:59:14.263948 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0d819c07-508c-4011-a0c6-3e3c26ffebe8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8/action" status: 202 len: 0 microversion: 2.1 time: 1.128181 Aug 04 13:59:14.264700 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 716/1415] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:59:13 2022] POST /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8/action => generated 0 bytes in 1129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:14.270003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-9ad1df5a-2dc5-43d7-8a12-40030bde0129 req-6ca0083c-fb6b-45c8-90f5-83624baa60ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8", "tag": "4b94338f-38f6-4326-98aa-c6b294584f3d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:14.280793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9ad1df5a-2dc5-43d7-8a12-40030bde0129 req-6ca0083c-fb6b-45c8-90f5-83624baa60ed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:14.281722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9ad1df5a-2dc5-43d7-8a12-40030bde0129 req-6ca0083c-fb6b-45c8-90f5-83624baa60ed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:14.295197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-9ad1df5a-2dc5-43d7-8a12-40030bde0129 req-6ca0083c-fb6b-45c8-90f5-83624baa60ed service nova] Creating event network-changed:4b94338f-38f6-4326-98aa-c6b294584f3d for instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 on n-h1-844627-10 Aug 04 13:59:14.302163 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-9ad1df5a-2dc5-43d7-8a12-40030bde0129 req-6ca0083c-fb6b-45c8-90f5-83624baa60ed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036052 Aug 04 13:59:14.303321 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 717/1416] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:14.308910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0088ab1f-c866-408e-851a-13b86b224019 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47006d11f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:14.363952 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0088ab1f-c866-408e-851a-13b86b224019 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1461 microversion: 2.1 time: 0.059140 Aug 04 13:59:14.373236 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 718/1417] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:14 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1461 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:14.382624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6023465e-3442-4148-89a9-7a285950f639 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:14.385178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6023465e-3442-4148-89a9-7a285950f639 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:14.397174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6023465e-3442-4148-89a9-7a285950f639 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:14.397678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6023465e-3442-4148-89a9-7a285950f639 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:14.398470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6023465e-3442-4148-89a9-7a285950f639 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:14.398845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6023465e-3442-4148-89a9-7a285950f639 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:14.453845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6023465e-3442-4148-89a9-7a285950f639 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:59:14.592019 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6023465e-3442-4148-89a9-7a285950f639 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 204 len: 0 microversion: 2.1 time: 0.218412 Aug 04 13:59:14.593453 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 719/1418] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:59:14 2022] DELETE /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:59:14.603924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-08d727b1-56df-405e-8945-6dc8efb7fdea req-82b01a21-6ad8-4da7-b99d-4d0c6ccd72d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8a455-2bcf-44ca-b5e2-16688470f226", "name": "network-vif-plugged", "status": "completed", "tag": "03b69f95-f081-4cab-9615-bd7da2ce327d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:14.619055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-08d727b1-56df-405e-8945-6dc8efb7fdea req-82b01a21-6ad8-4da7-b99d-4d0c6ccd72d0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:14.619891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-08d727b1-56df-405e-8945-6dc8efb7fdea req-82b01a21-6ad8-4da7-b99d-4d0c6ccd72d0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:14.635843 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-08d727b1-56df-405e-8945-6dc8efb7fdea req-82b01a21-6ad8-4da7-b99d-4d0c6ccd72d0 service nova] Creating event network-vif-plugged:03b69f95-f081-4cab-9615-bd7da2ce327d for instance bde8a455-2bcf-44ca-b5e2-16688470f226 on n-h2-844627-10 Aug 04 13:59:14.650431 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-08d727b1-56df-405e-8945-6dc8efb7fdea req-82b01a21-6ad8-4da7-b99d-4d0c6ccd72d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053059 Aug 04 13:59:14.651780 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 720/1419] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:14.661252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65db26b3-faa5-49a8-8267-68258f29d4df tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:14.674027 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-65db26b3-faa5-49a8-8267-68258f29d4df tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020760 Aug 04 13:59:14.689230 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 721/1420] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:14.697874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:14.698741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] [instance: 11b22ae8-b4dd-4cca-86c3-460706c29630] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:14.708658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:14.709158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:14.709957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:14.710401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:14.727377 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] HTTP exception thrown: Instance 11b22ae8-b4dd-4cca-86c3-460706c29630 could not be found. Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Request method failure captured: Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 HTTP/1.1 Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69BpsnaLAfZBlZKmkK87CN2Xuxmvb0MD0kUPYyymc7hfNQRlZFzbJgiF8xftY5zvfy-i7MM0xfbFi_HvJZrcp3h0FqMNoKchMeNWW7gUrUgarVbv59Y2voG3_z8KoZwc9WrtX_y5ZY-FoIVK13Hr6DlW2rg7HRIPoqzGOg-8GTM4Bcg Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:59:14.729428 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a0a4ae5d6de48b2bd1203bd6c3922b4"}]}] Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 4a0a4ae5d6de48b2bd1203bd6c3922b4 Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191 Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: e7461bc7dc404890b64fc7b71fdcbd94 Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:59:14.731082 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 11b22ae8-b4dd-4cca-86c3-460706c29630 could not be found. Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '11b22ae8-b4dd-4cca-86c3-460706c29630'} Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b22ae8-b4dd-4cca-86c3-460706c29630 could not be found. Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:14.731833 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b22ae8-b4dd-4cca-86c3-460706c29630 could not be found. Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b22ae8-b4dd-4cca-86c3-460706c29630 could not be found. Aug 04 13:59:14.733129 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:14.734334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] Returning 404 to user: Instance 11b22ae8-b4dd-4cca-86c3-460706c29630 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:14.734334 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dca481a2-2def-4a2f-8b8e-db342645b2c7 tempest-FloatingIPsAssociationNegativeTestJSON-940039191 tempest-FloatingIPsAssociationNegativeTestJSON-940039191-project] 10.222.0.66 "GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630" status: 404 len: 111 microversion: 2.1 time: 0.040547 Aug 04 13:59:14.734334 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 722/1421] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:14 2022] GET /compute/v2.1/servers/11b22ae8-b4dd-4cca-86c3-460706c29630 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:14.736678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4f2a23e-95f1-4948-b9ef-bb5ab488a7aa tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:14.737307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4f2a23e-95f1-4948-b9ef-bb5ab488a7aa tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:14.743743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f2a23e-95f1-4948-b9ef-bb5ab488a7aa tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:14.744501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f2a23e-95f1-4948-b9ef-bb5ab488a7aa tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:14.745332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f2a23e-95f1-4948-b9ef-bb5ab488a7aa tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:14.745773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f2a23e-95f1-4948-b9ef-bb5ab488a7aa tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:15.015878 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4bed57de-0f0c-4131-bf47-92d637a439c2 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/3aa1ba94-b7ec-47e4-a9e3-5aa50deaf1e4" status: 202 len: 0 microversion: 2.1 time: 2.335981 Aug 04 13:59:15.018007 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 700/1422] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 13:59:12 2022] DELETE /compute/v2.1/os-floating-ips/3aa1ba94-b7ec-47e4-a9e3-5aa50deaf1e4 => generated 0 bytes in 2339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:15.045056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b1a3c81-2e91-4310-aef5-f96b4285bf11 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470020c940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:15.189099 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b1a3c81-2e91-4310-aef5-f96b4285bf11 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 200 len: 1461 microversion: 2.1 time: 0.158315 Aug 04 13:59:15.202510 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 701/1423] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:15 2022] GET /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 1461 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:15.218369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3584db6c-46cd-44ee-84e1-bdd7bd4847a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:15.222109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3584db6c-46cd-44ee-84e1-bdd7bd4847a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:15.244805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3584db6c-46cd-44ee-84e1-bdd7bd4847a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:15.247363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3584db6c-46cd-44ee-84e1-bdd7bd4847a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:15.249090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3584db6c-46cd-44ee-84e1-bdd7bd4847a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:15.250153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3584db6c-46cd-44ee-84e1-bdd7bd4847a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:15.818010 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4f2a23e-95f1-4948-b9ef-bb5ab488a7aa tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.085149 Aug 04 13:59:15.832378 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 723/1424] 10.222.0.66 () {58 vars in 1293 bytes} [Thu Aug 4 13:59:14 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8/os-security-groups => generated 1158 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:15.840627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a3e3e82-be76-4307-aadf-a50bbc74f5a7 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:15.881102 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a3e3e82-be76-4307-aadf-a50bbc74f5a7 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.046902 Aug 04 13:59:15.892705 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 724/1425] 10.222.0.66 () {58 vars in 1167 bytes} [Thu Aug 4 13:59:15 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:15.900944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-86f44809-0917-46b1-86ec-061242294f45 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Calling method '.version_select at 0x7f4700b0c550>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:16.425068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3584db6c-46cd-44ee-84e1-bdd7bd4847a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:16.448000 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3584db6c-46cd-44ee-84e1-bdd7bd4847a1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 200 len: 1469 microversion: 2.1 time: 1.243585 Aug 04 13:59:16.449791 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 702/1426] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:15 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 1469 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:16.464338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c0c395f-a1e3-45b1-8648-9f79c9b8bd8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:16.465235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c0c395f-a1e3-45b1-8648-9f79c9b8bd8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:16.470795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:16.479394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c0c395f-a1e3-45b1-8648-9f79c9b8bd8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:16.481389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c0c395f-a1e3-45b1-8648-9f79c9b8bd8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:16.482635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c0c395f-a1e3-45b1-8648-9f79c9b8bd8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:16.483632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c0c395f-a1e3-45b1-8648-9f79c9b8bd8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:16.503385 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-86f44809-0917-46b1-86ec-061242294f45 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.608725 Aug 04 13:59:16.504581 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 725/1427] 10.222.0.66 () {58 vars in 1164 bytes} [Thu Aug 4 13:59:15 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 13:59:16.512369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-82d99e65-90ac-4771-a35d-77976341dd25 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: .version_select at 0x7f4700688c10>, body: {"security_group": {"name": " tempest-securitygroup -1502444591 ", "description": "tempest-description-1056268744"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:16.886320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c0c395f-a1e3-45b1-8648-9f79c9b8bd8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:16.902583 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c0c395f-a1e3-45b1-8648-9f79c9b8bd8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507" status: 200 len: 1468 microversion: 2.1 time: 0.451518 Aug 04 13:59:16.905700 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 703/1428] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:16 2022] GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507 => generated 1468 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:16.912430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86ba9cf9-4909-4386-ab55-29a6fcb1ef75 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:16.924197 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86ba9cf9-4909-4386-ab55-29a6fcb1ef75 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016993 Aug 04 13:59:16.931906 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 704/1429] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:16.937693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5d816df9-d06d-4227-80e7-d82864b597c8 req-6193f52b-2fb6-402b-806d-4bbe790d077d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b22ae8-b4dd-4cca-86c3-460706c29630", "name": "network-vif-deleted", "tag": "ee449665-121c-4ded-86dc-319178276579"}, {"name": "network-changed", "server_uuid": "264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8", "tag": "4b94338f-38f6-4326-98aa-c6b294584f3d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:16.951871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5d816df9-d06d-4227-80e7-d82864b597c8 req-6193f52b-2fb6-402b-806d-4bbe790d077d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:16.952791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5d816df9-d06d-4227-80e7-d82864b597c8 req-6193f52b-2fb6-402b-806d-4bbe790d077d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:16.976098 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5d816df9-d06d-4227-80e7-d82864b597c8 req-6193f52b-2fb6-402b-806d-4bbe790d077d service nova] Creating event network-vif-deleted:ee449665-121c-4ded-86dc-319178276579 for instance 11b22ae8-b4dd-4cca-86c3-460706c29630 on n-h1-844627-10 Aug 04 13:59:16.976974 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5d816df9-d06d-4227-80e7-d82864b597c8 req-6193f52b-2fb6-402b-806d-4bbe790d077d service nova] Creating event network-changed:4b94338f-38f6-4326-98aa-c6b294584f3d for instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 on n-h1-844627-10 Aug 04 13:59:16.985054 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5d816df9-d06d-4227-80e7-d82864b597c8 req-6193f52b-2fb6-402b-806d-4bbe790d077d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051764 Aug 04 13:59:16.986062 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 705/1430] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:16.993516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d30265ac-2504-4f77-91bd-04ee4bc43b4c tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Calling method '.version_select at 0x7f47002e1550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:17.122334 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-82d99e65-90ac-4771-a35d-77976341dd25 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.615707 Aug 04 13:59:17.137493 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 726/1431] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:59:16 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:17.164632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-4a13804c-6b43-4d53-a629-82fd20725a1c req-8928b8bb-7753-452c-89d1-3b4a4b45e132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ca2cc-3cdb-477e-9166-c915de5fc507", "name": "network-vif-unplugged", "status": "completed", "tag": "3725cfe1-eef7-4aa9-8c08-89a978079195"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:17.239420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4a13804c-6b43-4d53-a629-82fd20725a1c req-8928b8bb-7753-452c-89d1-3b4a4b45e132 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:17.242412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4a13804c-6b43-4d53-a629-82fd20725a1c req-8928b8bb-7753-452c-89d1-3b4a4b45e132 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:17.339328 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-4a13804c-6b43-4d53-a629-82fd20725a1c req-8928b8bb-7753-452c-89d1-3b4a4b45e132 service nova] Creating event network-vif-unplugged:3725cfe1-eef7-4aa9-8c08-89a978079195 for instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 on n-h2-844627-10 Aug 04 13:59:17.377747 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-4a13804c-6b43-4d53-a629-82fd20725a1c req-8928b8bb-7753-452c-89d1-3b4a4b45e132 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.237568 Aug 04 13:59:17.381726 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 727/1432] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:17.419853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c4511f6-5a44-4bb8-90d3-eaa13f1970f5 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-380971674"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:17.426401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1c4511f6-5a44-4bb8-90d3-eaa13f1970f5 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:17.442012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c4511f6-5a44-4bb8-90d3-eaa13f1970f5 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:17.442735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c4511f6-5a44-4bb8-90d3-eaa13f1970f5 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:17.444121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c4511f6-5a44-4bb8-90d3-eaa13f1970f5 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:17.444963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c4511f6-5a44-4bb8-90d3-eaa13f1970f5 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:17.973443 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1c4511f6-5a44-4bb8-90d3-eaa13f1970f5 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "POST /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa/action" status: 202 len: 0 microversion: 2.1 time: 0.582122 Aug 04 13:59:17.974982 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 728/1433] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 13:59:17 2022] POST /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 13:59:17.984976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dedcb83d-aec8-44a6-9013-2e7f1427aa8e tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:18.027684 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d30265ac-2504-4f77-91bd-04ee4bc43b4c tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.040131 Aug 04 13:59:18.037792 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 706/1434] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 13:59:16 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:18.037792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-10f7d539-cf07-47dd-9e99-6308351faac7 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f47001c7790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:18.106134 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dedcb83d-aec8-44a6-9013-2e7f1427aa8e tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.128872 Aug 04 13:59:18.117943 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 729/1435] 10.222.0.66 () {58 vars in 1144 bytes} [Thu Aug 4 13:59:17 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:18.122519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-898ef5bd-fb4f-4d9a-818d-d51faf757610 req-e88828ef-d65d-40c9-aece-5fdd9e668396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bde8a455-2bcf-44ca-b5e2-16688470f226", "name": "network-vif-deleted", "tag": "03b69f95-f081-4cab-9615-bd7da2ce327d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:18.134254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-898ef5bd-fb4f-4d9a-818d-d51faf757610 req-e88828ef-d65d-40c9-aece-5fdd9e668396 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:18.134808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-898ef5bd-fb4f-4d9a-818d-d51faf757610 req-e88828ef-d65d-40c9-aece-5fdd9e668396 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:18.156726 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-898ef5bd-fb4f-4d9a-818d-d51faf757610 req-e88828ef-d65d-40c9-aece-5fdd9e668396 service nova] Creating event network-vif-deleted:03b69f95-f081-4cab-9615-bd7da2ce327d for instance bde8a455-2bcf-44ca-b5e2-16688470f226 on n-h2-844627-10 Aug 04 13:59:18.163415 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-898ef5bd-fb4f-4d9a-818d-d51faf757610 req-e88828ef-d65d-40c9-aece-5fdd9e668396 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053690 Aug 04 13:59:18.167604 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 730/1436] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:18.176631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:18.177875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: bde8a455-2bcf-44ca-b5e2-16688470f226] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:18.188085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:18.188624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:18.189683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:18.190791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:18.211610 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] HTTP exception thrown: Instance bde8a455-2bcf-44ca-b5e2-16688470f226 could not be found. Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Request method failure captured: Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 HTTP/1.1 Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689wQM0fVlXqmBpmBiqUbstHO9j98wzsfSsWTJK-hBKZWW6IQUiDXsRrB2ksHixSCh_K7YmxM4i3vUaZ-zNd-4XiCbBeW7fuxQaF9Rs9ZlBU7KmoJ0-ofUFZYPvh4kfqhM6ZVPl1CscbfP5PhnmAD6J9AWdsoBNUyW7tb0tElsO7U3g Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 261d13f0b3484fadacd97a9a64eaefc6 Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:59:18.214326 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/261d13f0b3484fadacd97a9a64eaefc6"}]}] Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 261d13f0b3484fadacd97a9a64eaefc6 Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-MigrationsAdminTest-2124879907-project Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: cca2bff6e81c4f54bad52f77e67faa55 Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-MigrationsAdminTest-2124879907-project Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance bde8a455-2bcf-44ca-b5e2-16688470f226 could not be found. Aug 04 13:59:18.216580 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'bde8a455-2bcf-44ca-b5e2-16688470f226'} Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bde8a455-2bcf-44ca-b5e2-16688470f226 could not be found. Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:18.217719 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bde8a455-2bcf-44ca-b5e2-16688470f226 could not be found. Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bde8a455-2bcf-44ca-b5e2-16688470f226 could not be found. Aug 04 13:59:18.222085 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:18.223755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Returning 404 to user: Instance bde8a455-2bcf-44ca-b5e2-16688470f226 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:18.223755 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-267fcaaf-a28a-427c-84eb-44b7c9538419 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226" status: 404 len: 111 microversion: 2.1 time: 0.046526 Aug 04 13:59:18.223755 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 731/1437] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:18 2022] GET /compute/v2.1/servers/bde8a455-2bcf-44ca-b5e2-16688470f226 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:18.227788 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-10f7d539-cf07-47dd-9e99-6308351faac7 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1" status: 200 len: 224 microversion: 2.1 time: 0.197620 Aug 04 13:59:18.235686 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 707/1438] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 13:59:18 2022] GET /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1 => generated 224 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:18.235925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9889bb2b-f70f-42f1-9b0f-080907ea6e8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002e2040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:18.236046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4b461f97-a8e3-4332-8f4c-6ce36465e719 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Calling method '.version_select at 0x7f4700279550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:18.367054 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9889bb2b-f70f-42f1-9b0f-080907ea6e8c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.148347 Aug 04 13:59:18.381551 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 732/1439] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:18 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:18.401994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b397552d-a7ec-42d8-876a-cd007bd7eff3 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:18.419669 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b397552d-a7ec-42d8-876a-cd007bd7eff3 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035652 Aug 04 13:59:18.421578 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 733/1440] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:18.429894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-870f3854-b31a-4898-bbf1-da40d7022a86 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:18.430905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-870f3854-b31a-4898-bbf1-da40d7022a86 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:18.445786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-870f3854-b31a-4898-bbf1-da40d7022a86 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:18.446331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-870f3854-b31a-4898-bbf1-da40d7022a86 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:18.447215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-870f3854-b31a-4898-bbf1-da40d7022a86 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:18.447738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-870f3854-b31a-4898-bbf1-da40d7022a86 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:18.486942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-870f3854-b31a-4898-bbf1-da40d7022a86 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:59:18.621282 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-870f3854-b31a-4898-bbf1-da40d7022a86 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 204 len: 0 microversion: 2.1 time: 0.198196 Aug 04 13:59:18.628650 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 734/1441] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:59:18 2022] DELETE /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:59:18.634241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6b6fac62-9e2c-489c-9a08-e45fe6323778 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f470052b160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:19.926876 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6b6fac62-9e2c-489c-9a08-e45fe6323778 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1" status: 202 len: 0 microversion: 2.1 time: 1.299788 Aug 04 13:59:19.927851 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 735/1442] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 13:59:18 2022] DELETE /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1 => generated 0 bytes in 1301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:19.933105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-536e34b4-16b3-4bc9-a93a-f17d1cd1665f tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:19.970412 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-536e34b4-16b3-4bc9-a93a-f17d1cd1665f tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.041122 Aug 04 13:59:19.971044 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 736/1443] 10.222.0.66 () {58 vars in 1148 bytes} [Thu Aug 4 13:59:19 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:19.983614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ddc7242a-43ed-4b1d-b4fc-168087b9bdac tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:19.984741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ddc7242a-43ed-4b1d-b4fc-168087b9bdac tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:19.998876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ddc7242a-43ed-4b1d-b4fc-168087b9bdac tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:20.005746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ddc7242a-43ed-4b1d-b4fc-168087b9bdac tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:20.006609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ddc7242a-43ed-4b1d-b4fc-168087b9bdac tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:20.007074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ddc7242a-43ed-4b1d-b4fc-168087b9bdac tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:20.468342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-ddc7242a-43ed-4b1d-b4fc-168087b9bdac tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid ca56d355-4e66-4634-99fb-9ed160b6bc4b {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:59:20.521385 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ddc7242a-43ed-4b1d-b4fc-168087b9bdac tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 2424 microversion: 2.25 time: 0.546964 Aug 04 13:59:20.536893 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 737/1444] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:19 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 2424 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:20.537397 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4b461f97-a8e3-4332-8f4c-6ce36465e719 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/79edc42e-2f6f-49a4-ba42-943270931586" status: 202 len: 0 microversion: 2.1 time: 2.298120 Aug 04 13:59:20.537397 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 708/1445] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 13:59:18 2022] DELETE /compute/v2.1/os-floating-ips/79edc42e-2f6f-49a4-ba42-943270931586 => generated 0 bytes in 2300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:20.537397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-446bfc21-da6a-4ef8-b4e9-5d42bd834768 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002e1c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:20.539593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbbe91e6-2b59-41de-aed3-959a35015026 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:20.544899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cbbe91e6-2b59-41de-aed3-959a35015026 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:20.558728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbbe91e6-2b59-41de-aed3-959a35015026 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:20.564528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbbe91e6-2b59-41de-aed3-959a35015026 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:20.566054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbbe91e6-2b59-41de-aed3-959a35015026 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:20.566523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbbe91e6-2b59-41de-aed3-959a35015026 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:20.597940 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-446bfc21-da6a-4ef8-b4e9-5d42bd834768 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.066884 Aug 04 13:59:20.600780 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 709/1446] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:20 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:20.612856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e7a470b-792e-4e6d-8063-1463b26c2819 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f47002f1790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:20.669923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-7e7a470b-792e-4e6d-8063-1463b26c2819 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 13:59:20.670142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.security_group_api [None req-7e7a470b-792e-4e6d-8063-1463b26c2819 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group be6a309d-91b7-4960-b649-5f06ed26b8c1 not found {{(pid=130960) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 13:59:20.671067 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7e7a470b-792e-4e6d-8063-1463b26c2819 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 13:59:20.671067 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-097ba3b0-01e2-468a-ad38-c8871debb589'] Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e7a470b-792e-4e6d-8063-1463b26c2819 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1 HTTP/1.1 Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:20.697548 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: exception: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-097ba3b0-01e2-468a-ad38-c8871debb589'] Aug 04 13:59:20.699316 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'be6a309d-91b7-4960-b649-5f06ed26b8c1'} Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:20.700268 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-097ba3b0-01e2-468a-ad38-c8871debb589'] Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 13:59:20.701495 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-097ba3b0-01e2-468a-ad38-c8871debb589'] Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-097ba3b0-01e2-468a-ad38-c8871debb589'] Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:20.702798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-097ba3b0-01e2-468a-ad38-c8871debb589'] Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e7a470b-792e-4e6d-8063-1463b26c2819 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-097ba3b0-01e2-468a-ad38-c8871debb589'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7e7a470b-792e-4e6d-8063-1463b26c2819 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1" status: 404 len: 194 microversion: 2.1 time: 0.097225 Aug 04 13:59:20.704155 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 710/1447] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 13:59:20 2022] GET /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:20.705802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d45394dd-9c5a-474c-a304-96c6f7aeb2ca tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:20.737237 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d45394dd-9c5a-474c-a304-96c6f7aeb2ca tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.035742 Aug 04 13:59:20.738122 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 711/1448] 10.222.0.66 () {58 vars in 1140 bytes} [Thu Aug 4 13:59:20 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:20.748428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4025001a-5ce5-41c6-a4e2-86d9801c2694 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Calling method '.version_select at 0x7f47001c70d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:20.766751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbbe91e6-2b59-41de-aed3-959a35015026 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:20.769493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:20.785929 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbbe91e6-2b59-41de-aed3-959a35015026 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 200 len: 1534 microversion: 2.1 time: 0.260501 Aug 04 13:59:20.791594 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 738/1449] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:20 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 1534 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:20.805541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c263f587-6c65-417d-9d9c-626a27046f90 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844627-10", "block_migration": "auto"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:20.813154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c263f587-6c65-417d-9d9c-626a27046f90 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:20.834059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c263f587-6c65-417d-9d9c-626a27046f90 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:20.834886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c263f587-6c65-417d-9d9c-626a27046f90 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:20.836719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c263f587-6c65-417d-9d9c-626a27046f90 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:20.838410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c263f587-6c65-417d-9d9c-626a27046f90 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:20.900455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-c263f587-6c65-417d-9d9c-626a27046f90 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'flavor' on Instance uuid ca56d355-4e66-4634-99fb-9ed160b6bc4b {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 13:59:20.918441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c263f587-6c65-417d-9d9c-626a27046f90 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Going to try to live migrate instance to n-h2-844627-10 {{(pid=130961) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 13:59:23.349908 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4025001a-5ce5-41c6-a4e2-86d9801c2694 tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/da130109-51d9-48b5-811d-04811599766b" status: 202 len: 0 microversion: 2.1 time: 2.607262 Aug 04 13:59:23.358927 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 712/1450] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 13:59:20 2022] DELETE /compute/v2.1/os-floating-ips/da130109-51d9-48b5-811d-04811599766b => generated 0 bytes in 2620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:23.372640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f7309c2-21f4-4f75-9b2d-5e2ab3392370 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: .version_select at 0x7f4700279b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-163152169", "description": "tempest-description-828420377"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:24.055121 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f7309c2-21f4-4f75-9b2d-5e2ab3392370 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.694615 Aug 04 13:59:24.064550 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 713/1451] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:59:23 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:24.070389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81120f68-dde4-4b56-ab01-687c624406c3 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:24.117090 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81120f68-dde4-4b56-ab01-687c624406c3 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.050816 Aug 04 13:59:24.132518 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 714/1452] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:24.168977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-706ad294-0fdf-4fa3-b8bb-6e79b107facf tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700279820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:24.309949 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-706ad294-0fdf-4fa3-b8bb-6e79b107facf tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.174099 Aug 04 13:59:24.311010 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 715/1453] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:24 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:24.361790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:24.363192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 7aa08578-7e81-4056-8727-9015a7e5ad33] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:24.446885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:24.447672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:24.449115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:24.449920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:24.592715 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] HTTP exception thrown: Instance 7aa08578-7e81-4056-8727-9015a7e5ad33 could not be found. Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Request method failure captured: Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 HTTP/1.1 Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689wQM0fVlXqmBpmBiqUbstHO9j98wzsfSsWTJK-hBKZWW6IQUiDXsRrB2ksHixSCh_K7YmxM4i3vUaZ-zNd-4XiCbBeW7fuxQaF9Rs9ZlBU7KmoJ0-ofUFZYPvh4kfqhM6ZVPl1CscbfP5PhnmAD6J9AWdsoBNUyW7tb0tElsO7U3g Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 261d13f0b3484fadacd97a9a64eaefc6 Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:24.603550 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/261d13f0b3484fadacd97a9a64eaefc6"}]}] Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 261d13f0b3484fadacd97a9a64eaefc6 Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-MigrationsAdminTest-2124879907-project Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: cca2bff6e81c4f54bad52f77e67faa55 Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-MigrationsAdminTest-2124879907-project Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 7aa08578-7e81-4056-8727-9015a7e5ad33 could not be found. Aug 04 13:59:24.605017 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '7aa08578-7e81-4056-8727-9015a7e5ad33'} Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa08578-7e81-4056-8727-9015a7e5ad33 could not be found. Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:24.605880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa08578-7e81-4056-8727-9015a7e5ad33 could not be found. Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa08578-7e81-4056-8727-9015a7e5ad33 could not be found. Aug 04 13:59:24.607168 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:24.614374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Returning 404 to user: Instance 7aa08578-7e81-4056-8727-9015a7e5ad33 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:24.620568 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3f5333ea-a910-41a1-97a5-589631dd3ce9 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33" status: 404 len: 111 microversion: 2.1 time: 0.307463 Aug 04 13:59:24.627964 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 716/1454] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:24 2022] GET /compute/v2.1/servers/7aa08578-7e81-4056-8727-9015a7e5ad33 => generated 111 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:24.645489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6876a7e2-32e5-4db7-ac8e-3a09a2f75f1e req-b2c67397-166f-4ba8-8ad1-117bf3a9d028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa08578-7e81-4056-8727-9015a7e5ad33", "name": "network-vif-deleted", "tag": "8c8ae616-b10d-4353-8410-e4d906727bd0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:24.695050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6876a7e2-32e5-4db7-ac8e-3a09a2f75f1e req-b2c67397-166f-4ba8-8ad1-117bf3a9d028 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:24.696437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6876a7e2-32e5-4db7-ac8e-3a09a2f75f1e req-b2c67397-166f-4ba8-8ad1-117bf3a9d028 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:24.784181 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6876a7e2-32e5-4db7-ac8e-3a09a2f75f1e req-b2c67397-166f-4ba8-8ad1-117bf3a9d028 service nova] Creating event network-vif-deleted:8c8ae616-b10d-4353-8410-e4d906727bd0 for instance 7aa08578-7e81-4056-8727-9015a7e5ad33 on n-h2-844627-10 Aug 04 13:59:24.809030 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6876a7e2-32e5-4db7-ac8e-3a09a2f75f1e req-b2c67397-166f-4ba8-8ad1-117bf3a9d028 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176090 Aug 04 13:59:24.816219 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 717/1455] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:24.844715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3869e14-faaf-4cb6-9ea0-18ab186a37bc tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] Calling method '.version_select at 0x7f4700279ee0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:25.176462 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c263f587-6c65-417d-9d9c-626a27046f90 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/action" status: 202 len: 0 microversion: 2.25 time: 4.383087 Aug 04 13:59:25.183004 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 739/1456] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 13:59:20 2022] POST /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/action => generated 0 bytes in 4387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:59:25.193039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-29ffdacf-5a80-4f72-a331-a713a94ab478 req-46aa7eb3-f190-47b1-b821-791dd4402a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691963ac-14bf-4d48-9c45-643a5efa71aa", "name": "network-vif-plugged", "status": "completed", "tag": "bf8eeb52-7009-43e9-97bf-d0b34751ba4f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:25.247966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-29ffdacf-5a80-4f72-a331-a713a94ab478 req-46aa7eb3-f190-47b1-b821-791dd4402a85 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:25.248436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-29ffdacf-5a80-4f72-a331-a713a94ab478 req-46aa7eb3-f190-47b1-b821-791dd4402a85 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:25.291401 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-29ffdacf-5a80-4f72-a331-a713a94ab478 req-46aa7eb3-f190-47b1-b821-791dd4402a85 service nova] Creating event network-vif-plugged:bf8eeb52-7009-43e9-97bf-d0b34751ba4f for instance 691963ac-14bf-4d48-9c45-643a5efa71aa on n-h2-844627-10 Aug 04 13:59:25.317907 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-29ffdacf-5a80-4f72-a331-a713a94ab478 req-46aa7eb3-f190-47b1-b821-791dd4402a85 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131976 Aug 04 13:59:25.328779 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 740/1457] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:25.360386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-79f65b5d-253b-4aea-a069-82813d7f9a77 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: .version_select at 0x7f4700865ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1054053653", "description": "tempest-description-199002469"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:27.063575 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-79f65b5d-253b-4aea-a069-82813d7f9a77 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.733154 Aug 04 13:59:27.072005 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 741/1458] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:59:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:27.077758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-250a9250-12d5-44d4-acdc-55e03c4f9de4 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:27.133624 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-250a9250-12d5-44d4-acdc-55e03c4f9de4 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.060011 Aug 04 13:59:27.134728 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 742/1459] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:59:27 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:27.140689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec95a07e-341a-464a-91cf-3e1b22b449f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '.version_select at 0x7f4700c67160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:27.194999 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec95a07e-341a-464a-91cf-3e1b22b449f0 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-270449515" status: 202 len: 0 microversion: 2.1 time: 0.057330 Aug 04 13:59:27.197933 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 743/1460] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 13:59:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-270449515 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:27.219055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:27.221415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:27.251388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:27.256404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:27.258095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:27.266710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:28.299507 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3869e14-faaf-4cb6-9ea0-18ab186a37bc tempest-FloatingIPDetailsTestJSON-1169201647 tempest-FloatingIPDetailsTestJSON-1169201647-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/fd90193a-9d4a-455b-822f-62e0b8d88a28" status: 202 len: 0 microversion: 2.1 time: 3.480137 Aug 04 13:59:28.301120 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 718/1461] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 13:59:24 2022] DELETE /compute/v2.1/os-floating-ips/fd90193a-9d4a-455b-822f-62e0b8d88a28 => generated 0 bytes in 3484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:28.307429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7a9d5b1-85b7-4aba-a3fd-90b928d09a91 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47000ff550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:28.445093 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7a9d5b1-85b7-4aba-a3fd-90b928d09a91 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.142271 Aug 04 13:59:28.448543 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 719/1462] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:28 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:28.457162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-daa19005-bc76-4edf-8103-4c16bca138eb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: .version_select at 0x7f47002e7ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-914187208", "description": "tempest-description-1136144905"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:28.594497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:28.636513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:28.646238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:28.651669 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fbdfe403-3f1f-43ff-b2f1-6070114c029e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 1.447623 Aug 04 13:59:28.658747 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 744/1463] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:27 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:28.679105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e94b4862-232c-4779-bf62-61d16a058dec tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:28.793033 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e94b4862-232c-4779-bf62-61d16a058dec tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.130016 Aug 04 13:59:28.807556 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 745/1464] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 13:59:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:28.825544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d62c988-d481-4244-80d0-0ce8769e7926 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:28.857144 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d62c988-d481-4244-80d0-0ce8769e7926 tempest-FlavorsV2TestJSON-384662337 tempest-FlavorsV2TestJSON-384662337-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046554 Aug 04 13:59:28.859993 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 746/1465] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:29.459277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba9fa11c-5ae4-4998-af48-4bed89680bb3 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Action: 'create', calling method: .version_select at 0x7f470081eb80>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFUJU/Mrr0tdz6SRdUe+VhYkaRUB6eUr0qO7IFS7f3FqtqqtM0KDKJwt4U0G5X/E1yK9c9NLmzz1k+YQ//yHtzFthBEKacftWBYAZPOQMkBu96URWThXNS2q2Ln+WHVSA=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba9fa11c-5ae4-4998-af48-4bed89680bb3 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Request method failure captured: Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 257 Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69DAbzWDLRmRtqOOgf6fBDZQWlNL73WQkAvTUVmXDCGCuw1broo57xngnvC_9NbdRGIpR7UKzB4MMgzwgxDiqB93PjOPwarlwd0WTg2uvPnl0cpBXoD-pG7dqNIC_PlBNDur8VcMazz1dVfhbodWFf41xprKFujo1Y3oTcrDahxnBIc Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:59:29.467480 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_71741d1866c046c9a93800579e9bef5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}] Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:59:29.469259 n-d-844627-10 devstack@n-api.service[130961]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFUJU/Mrr0tdz6SRdUe+VhYkaRUB6eUr0qO7IFS7f3FqtqqtM0KDKJwt4U0G5X/E1yK9c9NLmzz1k+YQ//yHtzFthBEKacftWBYAZPOQMkBu96URWThXNS2q2Ln+WHVSA=="}} Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFUJU/Mrr0tdz6SRdUe+VhYkaRUB6eUr0qO7IFS7f3FqtqqtM0KDKJwt4U0G5X/E1yK9c9NLmzz1k+YQ//yHtzFthBEKacftWBYAZPOQMkBu96URWThXNS2q2Ln+WHVSA=='}}} Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:29.470157 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:29.472029 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:59:29.475090 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:59:29.477224 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 13:59:29.477224 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:29.482758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba9fa11c-5ae4-4998-af48-4bed89680bb3 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:29.484735 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ba9fa11c-5ae4-4998-af48-4bed89680bb3 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.512175 Aug 04 13:59:29.492269 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 747/1466] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:59:28 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 520 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:59:29.518974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84d64a73-1e35-4d40-8b09-7cd4679604b7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:29.525965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84d64a73-1e35-4d40-8b09-7cd4679604b7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:29.559945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d64a73-1e35-4d40-8b09-7cd4679604b7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:29.561428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d64a73-1e35-4d40-8b09-7cd4679604b7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:29.567979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d64a73-1e35-4d40-8b09-7cd4679604b7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:29.570319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d64a73-1e35-4d40-8b09-7cd4679604b7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:29.667937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84d64a73-1e35-4d40-8b09-7cd4679604b7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:59:29.702074 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-daa19005-bc76-4edf-8103-4c16bca138eb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.252167 Aug 04 13:59:29.703289 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 720/1467] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:59:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:29.710396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30b387c3-3e54-4b5b-8776-4a50e68e9515 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47007bc790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:29.817413 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30b387c3-3e54-4b5b-8776-4a50e68e9515 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.112415 Aug 04 13:59:29.819887 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 721/1468] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:29 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:29.834023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d34d7a9a-beba-4ae6-aaa1-d2a21d5717ca tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Action: 'create', calling method: .version_select at 0x7f47000ff0d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1628811277", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:29.875029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d34d7a9a-beba-4ae6-aaa1-d2a21d5717ca tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:59:29.894752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d34d7a9a-beba-4ae6-aaa1-d2a21d5717ca tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for user f41bbbeb85d64027a31dc3d78de56eff and project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:59:29.919255 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d34d7a9a-beba-4ae6-aaa1-d2a21d5717ca tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] [56252bae-3b8a-4580-ad11-11abb94e1f99] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 13:59:29.925112 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84d64a73-1e35-4d40-8b09-7cd4679604b7 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "DELETE /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 204 len: 0 microversion: 2.1 time: 0.428172 Aug 04 13:59:29.927809 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 748/1469] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:59:29 2022] DELETE /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:59:29.948793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:29.950581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:29.974582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:29.978616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:29.983393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:29.984392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:30.650828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:30.690287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:30.693885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:30.700065 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22a2f53f-6da3-42b7-9c8f-0c4b5a2d2df2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 0.768404 Aug 04 13:59:30.707319 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 749/1470] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:29 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:30.724660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-097b7e45-8790-4784-a986-cea78d00e7a4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3fb44c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:30.942271 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [None req-d34d7a9a-beba-4ae6-aaa1-d2a21d5717ca tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] [56252bae-3b8a-4580-ad11-11abb94e1f99] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 37932. Aug 04 13:59:30.971177 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-d34d7a9a-beba-4ae6-aaa1-d2a21d5717ca tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d34d7a9a-beba-4ae6-aaa1-d2a21d5717ca tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Request method failure captured: Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 2167 Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69DAbzWDLRmRtqOOgf6fBDZQWlNL73WQkAvTUVmXDCGCuw1broo57xngnvC_9NbdRGIpR7UKzB4MMgzwgxDiqB93PjOPwarlwd0WTg2uvPnl0cpBXoD-pG7dqNIC_PlBNDur8VcMazz1dVfhbodWFf41xprKFujo1Y3oTcrDahxnBIc Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_71741d1866c046c9a93800579e9bef5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}] Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1628811277", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:31.008159 n-d-844627-10 devstack@n-api.service[130960]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1628811277', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:31.010558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d34d7a9a-beba-4ae6-aaa1-d2a21d5717ca tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:31.015079 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d34d7a9a-beba-4ae6-aaa1-d2a21d5717ca tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 1.189794 Aug 04 13:59:31.026048 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 722/1471] 10.222.0.66 () {60 vars in 1160 bytes} [Thu Aug 4 13:59:29 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 1205 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:59:31.040527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-42afa9d6-2bcd-4955-953e-adb15023b0c8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:31.042859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-42afa9d6-2bcd-4955-953e-adb15023b0c8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:31.057151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42afa9d6-2bcd-4955-953e-adb15023b0c8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:31.058435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42afa9d6-2bcd-4955-953e-adb15023b0c8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:31.060060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42afa9d6-2bcd-4955-953e-adb15023b0c8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:31.060909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42afa9d6-2bcd-4955-953e-adb15023b0c8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:31.178134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:32.141783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-097b7e45-8790-4784-a986-cea78d00e7a4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.432249 Aug 04 13:59:32.142927 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 750/1472] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:59:30 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:32.168289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0b41c92d-1db5-4d21-bcb4-8146cb3f70ba tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470093f3a0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:32.299707 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0b41c92d-1db5-4d21-bcb4-8146cb3f70ba tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.155004 Aug 04 13:59:32.309878 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 751/1473] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:32 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:32.316187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8246907b-191d-45cc-a0ef-b393674ad2fc tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Action: 'create', calling method: .version_select at 0x7f46f3fb2c10>, body: {"keypair": {"name": "tempest-keypair-463065037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKStWdvU5wEm9ZHeH8Pv9ArqWm0EkHBfhU7vyCeCxtTZChWDWn82ZWBlJ03BmdAdtkT7H5aimBGv3I5aJfNIgW7j7WvKxB6nJbQOLdejXFex4mugBGtOqI4DhBllIr+gpA=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:32.338446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-42afa9d6-2bcd-4955-953e-adb15023b0c8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:32.374156 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-42afa9d6-2bcd-4955-953e-adb15023b0c8 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1468 microversion: 2.1 time: 1.333442 Aug 04 13:59:32.374954 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 723/1474] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:31 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1468 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:32.402122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:32.405418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:32.416224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8246907b-191d-45cc-a0ef-b393674ad2fc tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:59:32.427887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:32.428351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:32.429226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:32.429674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:32.446219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8246907b-191d-45cc-a0ef-b393674ad2fc tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for user f41bbbeb85d64027a31dc3d78de56eff and project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:59:32.552833 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8246907b-191d-45cc-a0ef-b393674ad2fc tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.240771 Aug 04 13:59:32.564678 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 752/1475] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:59:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:32.598223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01a07f1f-3cb1-4145-b4fa-84dcce70ec89 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3fb4a60>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:34.361836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:34.382647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:34.384289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:34.385591 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d7ab9b9-d48d-491b-a5be-02d19f93dfe2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 2.004677 Aug 04 13:59:34.386184 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 724/1476] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:32 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:34.417368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa0f9531-d5e5-47b0-bc88-1f2684e0daf9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Action: 'create', calling method: .version_select at 0x7f47000ff700>, body: {"keypair": {"name": "tempest-keypair-463065037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUlwmBp/yvNm6G7QmyLLarE9pnedN4p8XpVpTSFiJxoA6aJ+4elwBzIDbswQWxYg40QEhjOM8O+Jq3Qq6w/Z8rW6m/B0wIOg9hdCa8bZDL0cehhlu05oFFoqGmLkzF1nA=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:34.490427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-fa0f9531-d5e5-47b0-bc88-1f2684e0daf9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:59:34.511136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-fa0f9531-d5e5-47b0-bc88-1f2684e0daf9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for user f41bbbeb85d64027a31dc3d78de56eff and project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:59:34.593517 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-fa0f9531-d5e5-47b0-bc88-1f2684e0daf9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] HTTP exception thrown: Key pair 'tempest-keypair-463065037' already exists. Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa0f9531-d5e5-47b0-bc88-1f2684e0daf9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Request method failure captured: Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 272 Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69DAbzWDLRmRtqOOgf6fBDZQWlNL73WQkAvTUVmXDCGCuw1broo57xngnvC_9NbdRGIpR7UKzB4MMgzwgxDiqB93PjOPwarlwd0WTg2uvPnl0cpBXoD-pG7dqNIC_PlBNDur8VcMazz1dVfhbodWFf41xprKFujo1Y3oTcrDahxnBIc Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_71741d1866c046c9a93800579e9bef5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}] Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: {"keypair": {"name": "tempest-keypair-463065037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUlwmBp/yvNm6G7QmyLLarE9pnedN4p8XpVpTSFiJxoA6aJ+4elwBzIDbswQWxYg40QEhjOM8O+Jq3Qq6w/Z8rW6m/B0wIOg9hdCa8bZDL0cehhlu05oFFoqGmLkzF1nA=="}} Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: exception: Key pair 'tempest-keypair-463065037' already exists. Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-463065037', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUlwmBp/yvNm6G7QmyLLarE9pnedN4p8XpVpTSFiJxoA6aJ+4elwBzIDbswQWxYg40QEhjOM8O+Jq3Qq6w/Z8rW6m/B0wIOg9hdCa8bZDL0cehhlu05oFFoqGmLkzF1nA=='}}} Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result.read() Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'f41bbbeb85d64027a31dc3d78de56eff-tempest-keypair-463065037' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 04 13:59:34.619428 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result.read() Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 13:59:34.624103 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'f41bbbeb85d64027a31dc3d78de56eff-tempest-keypair-463065037' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 13, 59, 34, 573031), 'updated_at': None, 'name': 'tempest-keypair-463065037', 'user_id': 'f41bbbeb85d64027a31dc3d78de56eff', 'fingerprint': 'de:bd:ad:01:5a:6d:bc:a3:d8:8b:71:5a:4d:99:cc:69', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUlwmBp/yvNm6G7QmyLLarE9pnedN4p8XpVpTSFiJxoA6aJ+4elwBzIDbswQWxYg40QEhjOM8O+Jq3Qq6w/Z8rW6m/B0wIOg9hdCa8bZDL0cehhlu05oFFoqGmLkzF1nA==', 'type': 'ssh'}] Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi keypair.create() Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._create() Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-463065037' already exists. Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 04 13:59:34.628494 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-463065037' already exists. Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-463065037' already exists. Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:34.634290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa0f9531-d5e5-47b0-bc88-1f2684e0daf9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Returning 409 to user: Key pair 'tempest-keypair-463065037' already exists. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:34.650363 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fa0f9531-d5e5-47b0-bc88-1f2684e0daf9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.232107 Aug 04 13:59:34.651393 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 725/1477] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:59:34 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 264 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 13:59:34.666020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-99efaf51-477f-430d-849b-841060a81d5f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3d3cee0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:34.745764 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-99efaf51-477f-430d-849b-841060a81d5f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.093082 Aug 04 13:59:34.747133 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 726/1478] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:34 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:34.769989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f5e03323-29ce-4938-a71b-dc3ac4104389 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:34.770697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f5e03323-29ce-4938-a71b-dc3ac4104389 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:34.794664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5e03323-29ce-4938-a71b-dc3ac4104389 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:34.795140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5e03323-29ce-4938-a71b-dc3ac4104389 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:34.796339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5e03323-29ce-4938-a71b-dc3ac4104389 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:34.797986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5e03323-29ce-4938-a71b-dc3ac4104389 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:35.891869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f5e03323-29ce-4938-a71b-dc3ac4104389 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:35.944281 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f5e03323-29ce-4938-a71b-dc3ac4104389 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 200 len: 1468 microversion: 2.1 time: 1.194758 Aug 04 13:59:35.950910 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 727/1479] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:34 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 1468 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:35.995448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e89a07ef-b086-4797-894e-ac98085276f2 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Calling method '.version_select at 0x7f46f3d3caf0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:36.071512 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-01a07f1f-3cb1-4145-b4fa-84dcce70ec89 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/d3fa67d9-f973-4dfc-814d-e42862bb22d5" status: 202 len: 0 microversion: 2.1 time: 3.504831 Aug 04 13:59:36.072563 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 753/1480] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 13:59:32 2022] DELETE /compute/v2.1/os-security-groups/d3fa67d9-f973-4dfc-814d-e42862bb22d5 => generated 0 bytes in 3507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:36.113147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:36.128001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:36.155283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:36.157963 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e89a07ef-b086-4797-894e-ac98085276f2 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-463065037" status: 202 len: 0 microversion: 2.1 time: 0.198953 Aug 04 13:59:36.163040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 728/1481] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 13:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-463065037 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:36.198792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:36.200746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:36.205407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:36.207883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-80c7567b-1fcf-48e6-a5e3-bf3354cdbeee tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3ccc3a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:36.210619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:36.360705 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-80c7567b-1fcf-48e6-a5e3-bf3354cdbeee tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.192747 Aug 04 13:59:36.362981 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 729/1482] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:36 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:36.368574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-97633639-783d-48eb-aaf5-13654bc9fab1 req-e7fadcd7-72ec-4252-b21f-dc828f70d62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521a6443-46e3-4a58-9c10-1c23aba8dec8", "name": "network-vif-deleted", "tag": "34993f2e-4116-45e0-a4c8-4d10c39d4bb7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:36.416994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-97633639-783d-48eb-aaf5-13654bc9fab1 req-e7fadcd7-72ec-4252-b21f-dc828f70d62e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:36.430261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-97633639-783d-48eb-aaf5-13654bc9fab1 req-e7fadcd7-72ec-4252-b21f-dc828f70d62e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:36.456195 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-97633639-783d-48eb-aaf5-13654bc9fab1 req-e7fadcd7-72ec-4252-b21f-dc828f70d62e service nova] Creating event network-vif-deleted:34993f2e-4116-45e0-a4c8-4d10c39d4bb7 for instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 on n-h1-844627-10 Aug 04 13:59:36.471321 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-97633639-783d-48eb-aaf5-13654bc9fab1 req-e7fadcd7-72ec-4252-b21f-dc828f70d62e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105933 Aug 04 13:59:36.472638 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 730/1483] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:36.486961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5740b62e-b8e1-448d-a220-65965ca2e0fe tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3d3c940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:36.826149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-5740b62e-b8e1-448d-a220-65965ca2e0fe tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 13:59:36.827571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.security_group_api [None req-5740b62e-b8e1-448d-a220-65965ca2e0fe tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 not found {{(pid=130960) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 13:59:36.828539 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5740b62e-b8e1-448d-a220-65965ca2e0fe tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 13:59:36.828539 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-f3ba7218-76fb-4b22-bd4c-4de5e64e474a'] Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5740b62e-b8e1-448d-a220-65965ca2e0fe tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-security-groups/d3fa67d9-f973-4dfc-814d-e42862bb22d5 HTTP/1.1 Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: exception: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-f3ba7218-76fb-4b22-bd4c-4de5e64e474a'] Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'd3fa67d9-f973-4dfc-814d-e42862bb22d5'} Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 13:59:36.831205 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3ba7218-76fb-4b22-bd4c-4de5e64e474a'] Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3ba7218-76fb-4b22-bd4c-4de5e64e474a'] Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3ba7218-76fb-4b22-bd4c-4de5e64e474a'] Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3ba7218-76fb-4b22-bd4c-4de5e64e474a'] Aug 04 13:59:36.835295 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.841902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5740b62e-b8e1-448d-a220-65965ca2e0fe tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 13:59:36.841902 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-f3ba7218-76fb-4b22-bd4c-4de5e64e474a'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:36.843466 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5740b62e-b8e1-448d-a220-65965ca2e0fe tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/d3fa67d9-f973-4dfc-814d-e42862bb22d5" status: 404 len: 194 microversion: 2.1 time: 0.368767 Aug 04 13:59:36.844655 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 731/1484] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 13:59:36 2022] GET /compute/v2.1/os-security-groups/d3fa67d9-f973-4dfc-814d-e42862bb22d5 => generated 194 bytes in 371 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:36.855994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33e16537-fd35-466f-b3a0-75d5366fe0b9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Action: 'create', calling method: .version_select at 0x7f46f3ccc040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxEkcbhUbTxTn9YO8pnEhY0hduKNDGq/GRwvS8QNEBplT/0/ph/nvrhBroKGaBmCPvlLqvXYl/wF98pMJm0S+9qkaPvGzCfdtEydg2/Q/Xm3d1vLXPXByXHSvyGmJY5Qg=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33e16537-fd35-466f-b3a0-75d5366fe0b9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Request method failure captured: Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 247 Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69DAbzWDLRmRtqOOgf6fBDZQWlNL73WQkAvTUVmXDCGCuw1broo57xngnvC_9NbdRGIpR7UKzB4MMgzwgxDiqB93PjOPwarlwd0WTg2uvPnl0cpBXoD-pG7dqNIC_PlBNDur8VcMazz1dVfhbodWFf41xprKFujo1Y3oTcrDahxnBIc Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_71741d1866c046c9a93800579e9bef5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}] Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxEkcbhUbTxTn9YO8pnEhY0hduKNDGq/GRwvS8QNEBplT/0/ph/nvrhBroKGaBmCPvlLqvXYl/wF98pMJm0S+9qkaPvGzCfdtEydg2/Q/Xm3d1vLXPXByXHSvyGmJY5Qg=="}} Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxEkcbhUbTxTn9YO8pnEhY0hduKNDGq/GRwvS8QNEBplT/0/ph/nvrhBroKGaBmCPvlLqvXYl/wF98pMJm0S+9qkaPvGzCfdtEydg2/Q/Xm3d1vLXPXByXHSvyGmJY5Qg=='}}} Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi '' Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:59:36.866341 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 13:59:36.872467 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:36.882344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33e16537-fd35-466f-b3a0-75d5366fe0b9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:36.883407 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-33e16537-fd35-466f-b3a0-75d5366fe0b9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.037348 Aug 04 13:59:36.887340 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 732/1485] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:59:36 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:59:36.899466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d66235cb-30fe-43a6-a2ac-dae1b66695b1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f4700239c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:37.023724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:37.038629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:37.044256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:37.049056 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76027ac2-7d99-4b29-a33d-885223a8054f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 0.973905 Aug 04 13:59:37.065499 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 754/1486] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:36 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:37.070957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f475026-c070-4e1c-bf7b-d7c37d0fce08 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Action: 'create', calling method: .version_select at 0x7f46f3fb2f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-379792581", "public_key": " "}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:37.152288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5f475026-c070-4e1c-bf7b-d7c37d0fce08 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:59:37.201589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5f475026-c070-4e1c-bf7b-d7c37d0fce08 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for user f41bbbeb85d64027a31dc3d78de56eff and project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:59:37.290223 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-5f475026-c070-4e1c-bf7b-d7c37d0fce08 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f475026-c070-4e1c-bf7b-d7c37d0fce08 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Request method failure captured: Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 94 Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69DAbzWDLRmRtqOOgf6fBDZQWlNL73WQkAvTUVmXDCGCuw1broo57xngnvC_9NbdRGIpR7UKzB4MMgzwgxDiqB93PjOPwarlwd0WTg2uvPnl0cpBXoD-pG7dqNIC_PlBNDur8VcMazz1dVfhbodWFf41xprKFujo1Y3oTcrDahxnBIc Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_71741d1866c046c9a93800579e9bef5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}] Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-379792581", "public_key": " "}} Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-379792581', 'public_key': ' '}}} Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.299232 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.315120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.322615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f475026-c070-4e1c-bf7b-d7c37d0fce08 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:37.326114 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f475026-c070-4e1c-bf7b-d7c37d0fce08 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.258470 Aug 04 13:59:37.332071 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 755/1487] 10.222.0.66 () {60 vars in 1158 bytes} [Thu Aug 4 13:59:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:59:37.349554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:37.353838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: 521a6443-46e3-4a58-9c10-1c23aba8dec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:37.373860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:37.374427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:37.375358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:37.377139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:37.414084 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] HTTP exception thrown: Instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 could not be found. Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Request method failure captured: Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 HTTP/1.1 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi689wQM0fVlXqmBpmBiqUbstHO9j98wzsfSsWTJK-hBKZWW6IQUiDXsRrB2ksHixSCh_K7YmxM4i3vUaZ-zNd-4XiCbBeW7fuxQaF9Rs9ZlBU7KmoJ0-ofUFZYPvh4kfqhM6ZVPl1CscbfP5PhnmAD6J9AWdsoBNUyW7tb0tElsO7U3g Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 261d13f0b3484fadacd97a9a64eaefc6 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/261d13f0b3484fadacd97a9a64eaefc6"}]}] Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 261d13f0b3484fadacd97a9a64eaefc6 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-MigrationsAdminTest-2124879907-project Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: cca2bff6e81c4f54bad52f77e67faa55 Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-MigrationsAdminTest-2124879907-project Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 could not be found. Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '521a6443-46e3-4a58-9c10-1c23aba8dec8'} Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 could not be found. Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 could not be found. Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.420594 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 could not be found. Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Returning 404 to user: Instance 521a6443-46e3-4a58-9c10-1c23aba8dec8 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-440ef3a2-0ba7-4cc9-b4f6-72044f6a9df1 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8" status: 404 len: 111 microversion: 2.1 time: 0.083450 Aug 04 13:59:37.433633 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 756/1488] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:37 2022] GET /compute/v2.1/servers/521a6443-46e3-4a58-9c10-1c23aba8dec8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:37.441505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-098542fc-432d-4555-b622-7627d7171bb9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Action: 'create', calling method: .version_select at 0x7f46f3fb4430>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7LgUZSpDwoDYjJhNP/LuVgZVQNK3qNgYR6pFOvA0umG+IHCxl3C9N5/15bw8QdqFzwoCpl1hvdhDE1P+r19cZokwOUvl2f2jo5r6URoEEwHejpZ4rXLOuYH08zQOGk7A=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-098542fc-432d-4555-b622-7627d7171bb9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Request method failure captured: Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 507 Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69DAbzWDLRmRtqOOgf6fBDZQWlNL73WQkAvTUVmXDCGCuw1broo57xngnvC_9NbdRGIpR7UKzB4MMgzwgxDiqB93PjOPwarlwd0WTg2uvPnl0cpBXoD-pG7dqNIC_PlBNDur8VcMazz1dVfhbodWFf41xprKFujo1Y3oTcrDahxnBIc Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_71741d1866c046c9a93800579e9bef5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}] Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7LgUZSpDwoDYjJhNP/LuVgZVQNK3qNgYR6pFOvA0umG+IHCxl3C9N5/15bw8QdqFzwoCpl1hvdhDE1P+r19cZokwOUvl2f2jo5r6URoEEwHejpZ4rXLOuYH08zQOGk7A=="}} Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7LgUZSpDwoDYjJhNP/LuVgZVQNK3qNgYR6pFOvA0umG+IHCxl3C9N5/15bw8QdqFzwoCpl1hvdhDE1P+r19cZokwOUvl2f2jo5r6URoEEwHejpZ4rXLOuYH08zQOGk7A=='}}} Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 04 13:59:37.451311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.458624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-098542fc-432d-4555-b622-7627d7171bb9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:37.465622 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-098542fc-432d-4555-b622-7627d7171bb9 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.033514 Aug 04 13:59:37.470206 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 757/1489] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:59:37 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 13:59:37.477752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-589c4e71-4582-43cf-92c6-9899f37b2bb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3fb1c10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:37.565830 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-589c4e71-4582-43cf-92c6-9899f37b2bb0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.097334 Aug 04 13:59:37.571842 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 758/1490] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:37 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:37.578141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ef63594-1e46-47c2-aa4a-37767a8555ed tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:37.581810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ef63594-1e46-47c2-aa4a-37767a8555ed tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:37.597788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ef63594-1e46-47c2-aa4a-37767a8555ed tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:37.602702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ef63594-1e46-47c2-aa4a-37767a8555ed tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:37.604262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ef63594-1e46-47c2-aa4a-37767a8555ed tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:37.604886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ef63594-1e46-47c2-aa4a-37767a8555ed tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:37.627798 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d66235cb-30fe-43a6-a2ac-dae1b66695b1 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/d25e802d-087e-4d6b-a6a8-566b2b631138" status: 202 len: 0 microversion: 2.1 time: 0.738924 Aug 04 13:59:37.628841 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 733/1491] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 13:59:36 2022] DELETE /compute/v2.1/os-security-groups/d25e802d-087e-4d6b-a6a8-566b2b631138 => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:37.634212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea038a02-fd62-4302-9e83-c4826f94191c tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Action: 'create', calling method: .version_select at 0x7f46f3cc7160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1240732926", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:37.707865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ea038a02-fd62-4302-9e83-c4826f94191c tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:59:37.718541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ef63594-1e46-47c2-aa4a-37767a8555ed tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 13:59:37.734946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ea038a02-fd62-4302-9e83-c4826f94191c tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Getting quotas for user f41bbbeb85d64027a31dc3d78de56eff and project 71741d1866c046c9a93800579e9bef5f. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:59:37.824424 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ea038a02-fd62-4302-9e83-c4826f94191c tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea038a02-fd62-4302-9e83-c4826f94191c tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Request method failure captured: Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 118 Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69DAbzWDLRmRtqOOgf6fBDZQWlNL73WQkAvTUVmXDCGCuw1broo57xngnvC_9NbdRGIpR7UKzB4MMgzwgxDiqB93PjOPwarlwd0WTg2uvPnl0cpBXoD-pG7dqNIC_PlBNDur8VcMazz1dVfhbodWFf41xprKFujo1Y3oTcrDahxnBIc Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_71741d1866c046c9a93800579e9bef5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}] Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1240732926", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1240732926', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 13:59:37.833225 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea038a02-fd62-4302-9e83-c4826f94191c tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ea038a02-fd62-4302-9e83-c4826f94191c tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.204821 Aug 04 13:59:37.842243 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 734/1492] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 13:59:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 13:59:37.853814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4e34c49-009c-43cd-b210-bb844e6e2ac2 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f47001c74c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:37.953217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-e4e34c49-009c-43cd-b210-bb844e6e2ac2 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 13:59:37.955222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.security_group_api [None req-e4e34c49-009c-43cd-b210-bb844e6e2ac2 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group d25e802d-087e-4d6b-a6a8-566b2b631138 not found {{(pid=130960) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 13:59:37.956295 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-e4e34c49-009c-43cd-b210-bb844e6e2ac2 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 13:59:37.956295 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-5c4fd831-5aa6-4565-b2ba-1610ffc92365'] Aug 04 13:59:37.957612 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ef63594-1e46-47c2-aa4a-37767a8555ed tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 204 len: 0 microversion: 2.1 time: 0.384043 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4e34c49-009c-43cd-b210-bb844e6e2ac2 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-security-groups/d25e802d-087e-4d6b-a6a8-566b2b631138 HTTP/1.1 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: exception: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-5c4fd831-5aa6-4565-b2ba-1610ffc92365'] Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'd25e802d-087e-4d6b-a6a8-566b2b631138'} Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 13:59:37.958798 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c4fd831-5aa6-4565-b2ba-1610ffc92365'] Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c4fd831-5aa6-4565-b2ba-1610ffc92365'] Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c4fd831-5aa6-4565-b2ba-1610ffc92365'] Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c4fd831-5aa6-4565-b2ba-1610ffc92365'] Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4e34c49-009c-43cd-b210-bb844e6e2ac2 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-5c4fd831-5aa6-4565-b2ba-1610ffc92365'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e4e34c49-009c-43cd-b210-bb844e6e2ac2 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/d25e802d-087e-4d6b-a6a8-566b2b631138" status: 404 len: 194 microversion: 2.1 time: 0.119818 Aug 04 13:59:37.962830 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 735/1493] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 13:59:37 2022] GET /compute/v2.1/os-security-groups/d25e802d-087e-4d6b-a6a8-566b2b631138 => generated 194 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:37.973902 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 759/1494] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 13:59:37 2022] DELETE /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 13:59:37.978683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e190f1e2-9eb4-4df4-a22d-44a827c42275 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Calling method '.version_select at 0x7f4700ae74c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:37.989716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90d25474-5d41-46b6-b2bf-c64eaf43c49f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3fb1a60>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:38.026249 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-e190f1e2-9eb4-4df4-a22d-44a827c42275 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2003244045 not found for user f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e190f1e2-9eb4-4df4-a22d-44a827c42275 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Request method failure captured: Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2003244045 HTTP/1.1 Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69DAbzWDLRmRtqOOgf6fBDZQWlNL73WQkAvTUVmXDCGCuw1broo57xngnvC_9NbdRGIpR7UKzB4MMgzwgxDiqB93PjOPwarlwd0WTg2uvPnl0cpBXoD-pG7dqNIC_PlBNDur8VcMazz1dVfhbodWFf41xprKFujo1Y3oTcrDahxnBIc Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_71741d1866c046c9a93800579e9bef5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/71741d1866c046c9a93800579e9bef5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/71741d1866c046c9a93800579e9bef5f"}]}] Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 71741d1866c046c9a93800579e9bef5f Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-955160667 Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-KeyPairsNegativeTestJSON-955160667-project Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: exception: Keypair tempest-keypair-non-existent-2003244045 not found for user f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'tempest-keypair-non-existent-2003244045'} Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2003244045 not found for user f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:38.035990 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2003244045 not found for user f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2003244045 not found for user f41bbbeb85d64027a31dc3d78de56eff Aug 04 13:59:38.041959 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:38.047270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e190f1e2-9eb4-4df4-a22d-44a827c42275 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2003244045 not found for user f41bbbeb85d64027a31dc3d78de56eff {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:38.047939 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e190f1e2-9eb4-4df4-a22d-44a827c42275 tempest-KeyPairsNegativeTestJSON-955160667 tempest-KeyPairsNegativeTestJSON-955160667-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2003244045" status: 404 len: 145 microversion: 2.1 time: 0.083772 Aug 04 13:59:38.049367 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 736/1495] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 13:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2003244045 => generated 145 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:38.069290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53ef0020-f7f1-40a8-ba9a-b9ae29520f2c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:38.075745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-53ef0020-f7f1-40a8-ba9a-b9ae29520f2c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:38.100791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53ef0020-f7f1-40a8-ba9a-b9ae29520f2c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:38.106363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53ef0020-f7f1-40a8-ba9a-b9ae29520f2c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:38.109088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53ef0020-f7f1-40a8-ba9a-b9ae29520f2c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:38.116535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53ef0020-f7f1-40a8-ba9a-b9ae29520f2c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:38.676162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-53ef0020-f7f1-40a8-ba9a-b9ae29520f2c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:38.691682 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-53ef0020-f7f1-40a8-ba9a-b9ae29520f2c tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1468 microversion: 2.1 time: 0.635143 Aug 04 13:59:38.710164 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 737/1496] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:38 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1468 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:38.725887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:38.729045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:38.752678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:38.759745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:38.761482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:38.766729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:38.802996 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90d25474-5d41-46b6-b2bf-c64eaf43c49f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/fa7c53d2-1b98-4b63-a8c8-08b1a87872a1" status: 202 len: 0 microversion: 2.1 time: 0.826802 Aug 04 13:59:38.805003 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 760/1497] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 13:59:37 2022] DELETE /compute/v2.1/os-security-groups/fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 13:59:38.811053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e65d9c4a-29a2-4291-a506-d645d7d00cd1 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470081e1f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:38.928429 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e65d9c4a-29a2-4291-a506-d645d7d00cd1 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.121918 Aug 04 13:59:38.931410 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 761/1498] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:38 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:38.947695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c8a9b65c-ee97-4664-9d35-44788c2630fb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3fb1f70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:39.047992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-c8a9b65c-ee97-4664-9d35-44788c2630fb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 13:59:39.049536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.security_group_api [None req-c8a9b65c-ee97-4664-9d35-44788c2630fb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 not found {{(pid=130961) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 13:59:39.050366 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-c8a9b65c-ee97-4664-9d35-44788c2630fb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 13:59:39.050366 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-52d07854-2b73-494c-b8ef-1cc4e0ebad8c'] Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c8a9b65c-ee97-4664-9d35-44788c2630fb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-security-groups/fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 HTTP/1.1 Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: exception: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-52d07854-2b73-494c-b8ef-1cc4e0ebad8c'] Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'fa7c53d2-1b98-4b63-a8c8-08b1a87872a1'} Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 13:59:39.054552 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52d07854-2b73-494c-b8ef-1cc4e0ebad8c'] Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52d07854-2b73-494c-b8ef-1cc4e0ebad8c'] Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52d07854-2b73-494c-b8ef-1cc4e0ebad8c'] Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52d07854-2b73-494c-b8ef-1cc4e0ebad8c'] Aug 04 13:59:39.059255 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 13:59:39.062420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c8a9b65c-ee97-4664-9d35-44788c2630fb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 13:59:39.062420 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-52d07854-2b73-494c-b8ef-1cc4e0ebad8c'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:39.069127 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c8a9b65c-ee97-4664-9d35-44788c2630fb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/fa7c53d2-1b98-4b63-a8c8-08b1a87872a1" status: 404 len: 194 microversion: 2.1 time: 0.132916 Aug 04 13:59:39.071134 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 762/1499] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 13:59:38 2022] GET /compute/v2.1/os-security-groups/fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 => generated 194 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:39.081201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0e679e8-059d-46c5-9678-0363b0a512b7 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3f5bdc0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:39.496586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:39.546087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:39.552463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:39.556098 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-da289c75-83ec-4b64-8836-1296a4009c06 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 0.842447 Aug 04 13:59:39.557641 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 738/1500] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:38 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:39.730715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-03d6cc19-a9b4-4050-8d65-36d56a30b36e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:39.732096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03d6cc19-a9b4-4050-8d65-36d56a30b36e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:39.796293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03d6cc19-a9b4-4050-8d65-36d56a30b36e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:39.801638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03d6cc19-a9b4-4050-8d65-36d56a30b36e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:39.811029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03d6cc19-a9b4-4050-8d65-36d56a30b36e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:39.811997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03d6cc19-a9b4-4050-8d65-36d56a30b36e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:40.915725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-03d6cc19-a9b4-4050-8d65-36d56a30b36e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:40.951352 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-03d6cc19-a9b4-4050-8d65-36d56a30b36e tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1468 microversion: 2.1 time: 1.238274 Aug 04 13:59:40.983313 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 739/1501] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:39 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1468 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:40.989332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86010506-dd59-49ff-85ee-527b16976940 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002e73a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:41.180927 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86010506-dd59-49ff-85ee-527b16976940 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.191993 Aug 04 13:59:41.189937 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 740/1502] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:40 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:41.195494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:41.196556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:41.217973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:41.221111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:41.222323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:41.225763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:41.486245 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0e679e8-059d-46c5-9678-0363b0a512b7 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 2.408705 Aug 04 13:59:41.492324 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 763/1503] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 13:59:39 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:41.523208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e35a223-be3f-4197-a48d-a58846de4987 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: .version_select at 0x7f46f3fb1ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-178366884", "description": "tempest-description-69265990"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:42.677572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:42.721246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:42.728037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:42.734400 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a581f27-990f-4f87-8070-e43f6cafee16 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 1.541728 Aug 04 13:59:42.739201 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 741/1504] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:41 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:42.761626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-90b94365-c1f1-4682-b952-740e01e20e4b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:42.763067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-90b94365-c1f1-4682-b952-740e01e20e4b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:42.812954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90b94365-c1f1-4682-b952-740e01e20e4b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:42.813834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90b94365-c1f1-4682-b952-740e01e20e4b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:42.816434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90b94365-c1f1-4682-b952-740e01e20e4b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:42.818072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90b94365-c1f1-4682-b952-740e01e20e4b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:43.461211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-90b94365-c1f1-4682-b952-740e01e20e4b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca2bff6e81c4f54bad52f77e67faa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261d13f0b3484fadacd97a9a64eaefc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:43.518707 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-90b94365-c1f1-4682-b952-740e01e20e4b tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 200 len: 1426 microversion: 2.1 time: 0.770557 Aug 04 13:59:43.522734 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 742/1505] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:42 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 1426 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:43.544451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a10f924f-944c-4497-ad65-2906a0d95d53 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002e73a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:43.761624 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a10f924f-944c-4497-ad65-2906a0d95d53 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.236852 Aug 04 13:59:43.773520 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 743/1506] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:43 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:43.801471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-cb8a59fe-54e8-44e5-9858-a3629346e5b9 req-3da86a10-3f86-449f-a773-2f39017a3449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4404b9e-c6d1-4f63-bb72-b180f02ca603", "name": "network-vif-deleted", "tag": "7772b93f-4e1b-4b26-bc3c-00df0a0b3c45"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:43.839734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cb8a59fe-54e8-44e5-9858-a3629346e5b9 req-3da86a10-3f86-449f-a773-2f39017a3449 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:43.840626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cb8a59fe-54e8-44e5-9858-a3629346e5b9 req-3da86a10-3f86-449f-a773-2f39017a3449 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:43.905666 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-cb8a59fe-54e8-44e5-9858-a3629346e5b9 req-3da86a10-3f86-449f-a773-2f39017a3449 service nova] Creating event network-vif-deleted:7772b93f-4e1b-4b26-bc3c-00df0a0b3c45 for instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 on n-h1-844627-10 Aug 04 13:59:43.921841 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-cb8a59fe-54e8-44e5-9858-a3629346e5b9 req-3da86a10-3f86-449f-a773-2f39017a3449 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145317 Aug 04 13:59:43.941367 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 744/1507] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:43.971926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:43.975774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:44.016999 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e35a223-be3f-4197-a48d-a58846de4987 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 2.505449 Aug 04 13:59:44.017702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:44.023318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:44.026827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:44.030802 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 764/1508] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:59:41 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:59:44.041728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:44.045200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70763867-a9b2-4af6-870d-124db5f0409c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: .version_select at 0x7f4700133940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1482059320", "description": "tempest-description-124583933"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:45.852246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:45.871278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:45.877166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:45.880118 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-05ab9922-1511-4279-bad3-96ffc5e3232b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 1.931364 Aug 04 13:59:45.904828 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 745/1509] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:43 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:45.921477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:45.922211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] [instance: f4404b9e-c6d1-4f63-bb72-b180f02ca603] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:45.943376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:45.944413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:45.947032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:45.947492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:45.993196 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] HTTP exception thrown: Instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 could not be found. Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Request method failure captured: Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 HTTP/1.1 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi689wQM0fVlXqmBpmBiqUbstHO9j98wzsfSsWTJK-hBKZWW6IQUiDXsRrB2ksHixSCh_K7YmxM4i3vUaZ-zNd-4XiCbBeW7fuxQaF9Rs9ZlBU7KmoJ0-ofUFZYPvh4kfqhM6ZVPl1CscbfP5PhnmAD6J9AWdsoBNUyW7tb0tElsO7U3g Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 261d13f0b3484fadacd97a9a64eaefc6 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/261d13f0b3484fadacd97a9a64eaefc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/261d13f0b3484fadacd97a9a64eaefc6"}]}] Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 261d13f0b3484fadacd97a9a64eaefc6 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-MigrationsAdminTest-2124879907 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-MigrationsAdminTest-2124879907-project Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: cca2bff6e81c4f54bad52f77e67faa55 Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-MigrationsAdminTest-2124879907-project Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 could not be found. Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'f4404b9e-c6d1-4f63-bb72-b180f02ca603'} Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 could not be found. Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 could not be found. Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 13:59:45.994951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:45.999660 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 13:59:45.999660 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 13:59:45.999660 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 13:59:45.999660 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 13:59:45.999660 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 13:59:45.999660 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 could not be found. Aug 04 13:59:45.999660 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 13:59:45.999660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] Returning 404 to user: Instance f4404b9e-c6d1-4f63-bb72-b180f02ca603 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 13:59:45.999660 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-429ecf9a-b537-4012-ad28-a64e66822231 tempest-MigrationsAdminTest-2124879907 tempest-MigrationsAdminTest-2124879907-project] 10.222.0.66 "GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603" status: 404 len: 111 microversion: 2.1 time: 0.090472 Aug 04 13:59:46.000991 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 746/1510] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:45 2022] GET /compute/v2.1/servers/f4404b9e-c6d1-4f63-bb72-b180f02ca603 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 13:59:46.006065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75cbd6df-eaf1-4c4b-b9d9-91241965e14e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47000ffe50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:46.238167 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75cbd6df-eaf1-4c4b-b9d9-91241965e14e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.235510 Aug 04 13:59:46.250817 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 747/1511] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:46 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:46.575736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-16817f1d-91d4-417a-9c0a-8afea10e7881 tempest-AbsoluteLimitsTestJSON-1800460363 tempest-AbsoluteLimitsTestJSON-1800460363-project] Calling method '.version_select at 0x7f46f3cc4af0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:46.618989 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70763867-a9b2-4af6-870d-124db5f0409c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.576815 Aug 04 13:59:46.620951 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 765/1512] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 13:59:44 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:46.653175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:46.691044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16817f1d-91d4-417a-9c0a-8afea10e7881 tempest-AbsoluteLimitsTestJSON-1800460363 tempest-AbsoluteLimitsTestJSON-1800460363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:46.704805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16817f1d-91d4-417a-9c0a-8afea10e7881 tempest-AbsoluteLimitsTestJSON-1800460363 tempest-AbsoluteLimitsTestJSON-1800460363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:46.707166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16817f1d-91d4-417a-9c0a-8afea10e7881 tempest-AbsoluteLimitsTestJSON-1800460363 tempest-AbsoluteLimitsTestJSON-1800460363-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:46.709598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16817f1d-91d4-417a-9c0a-8afea10e7881 tempest-AbsoluteLimitsTestJSON-1800460363 tempest-AbsoluteLimitsTestJSON-1800460363-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:46.791971 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-16817f1d-91d4-417a-9c0a-8afea10e7881 tempest-AbsoluteLimitsTestJSON-1800460363 tempest-AbsoluteLimitsTestJSON-1800460363-project] 10.222.0.66 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.538695 Aug 04 13:59:46.797113 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 748/1513] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Aug 4 13:59:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:46.839925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1189941535", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "64787552-0b36-4a95-805d-526aa0b93f48"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:46.912542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:46.914006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:46.931533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:46.942674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:46.947160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:46.956607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] validate_networks() for [('64787552-0b36-4a95-805d-526aa0b93f48', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 13:59:46.962742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:47.236014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:47.894630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:48.022616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:48.035891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:48.046112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:48.048356 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c11ef1db-4604-43e2-b22d-67c8192ef1fa tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 1.139358 Aug 04 13:59:48.049331 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 749/1514] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:46 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:59:48.067177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e2ecb71-f1d6-4841-aa36-38847c274328 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47000ffe50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:48.151634 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e2ecb71-f1d6-4841-aa36-38847c274328 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.089327 Aug 04 13:59:48.154300 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 750/1515] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:48 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:49.098179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:49.106018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:49.144796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:49.156678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:49.163833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:49.166853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:49.185289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 13:59:49.187394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 13:59:49.193790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 13:59:49.198104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 13:59:49.203834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 13:59:49.262382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:49.263897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:49.269104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:49.270346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:49.363083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Getting quotas for project c55ed93281454b88b28fd3f6c24fc35f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 13:59:49.401754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Getting quotas for user 8010f6da241841b793874beedd1b8585 and project c55ed93281454b88b28fd3f6c24fc35f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 13:59:49.473663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 13:59:49.498099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 13:59:49.646210 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55059c8c-cb0b-4c9b-a5d4-009130095d2e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.810224 Aug 04 13:59:49.649271 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 766/1516] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 13:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 13:59:49.662619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-86fc69fd-954e-4c2e-84f7-738887cf038f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3f5baf0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:49.840283 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-86fc69fd-954e-4c2e-84f7-738887cf038f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.188326 Aug 04 13:59:49.842830 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 767/1517] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:49 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:49.855844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef1eabaa-f1a4-46e5-a932-32ccd1397a40 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:49.858429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ef1eabaa-f1a4-46e5-a932-32ccd1397a40 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:50.843439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ef1eabaa-f1a4-46e5-a932-32ccd1397a40 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:50.877823 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ef1eabaa-f1a4-46e5-a932-32ccd1397a40 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1216 microversion: 2.1 time: 1.027021 Aug 04 13:59:50.881583 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 768/1518] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:49 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1216 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:50.904032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2ff7a609-954f-4d54-a9ed-a6888b90b2f5 req-93b74397-21b8-4111-a192-e06b6438de1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca56d355-4e66-4634-99fb-9ed160b6bc4b", "name": "network-vif-unplugged", "status": "completed", "tag": "05c9a902-25a1-4f84-9f03-64cea87afd6f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:50.941422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2ff7a609-954f-4d54-a9ed-a6888b90b2f5 req-93b74397-21b8-4111-a192-e06b6438de1e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:50.949920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2ff7a609-954f-4d54-a9ed-a6888b90b2f5 req-93b74397-21b8-4111-a192-e06b6438de1e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:50.991079 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2ff7a609-954f-4d54-a9ed-a6888b90b2f5 req-93b74397-21b8-4111-a192-e06b6438de1e service nova] Creating event network-vif-unplugged:05c9a902-25a1-4f84-9f03-64cea87afd6f for instance ca56d355-4e66-4634-99fb-9ed160b6bc4b on n-h1-844627-10 Aug 04 13:59:51.005881 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2ff7a609-954f-4d54-a9ed-a6888b90b2f5 req-93b74397-21b8-4111-a192-e06b6438de1e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122619 Aug 04 13:59:51.012841 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 769/1519] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:51.019520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1ad56bc6-5248-402c-8b3b-b4678724e798 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3fb4790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:51.317265 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1ad56bc6-5248-402c-8b3b-b4678724e798 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.302463 Aug 04 13:59:51.317868 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 770/1520] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:51 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:51.580327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:51.609303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:51.618375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:51.622352 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8d7f4bd9-6732-44fa-87d4-c7b043833fe1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 2.547019 Aug 04 13:59:51.634664 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 751/1521] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:49 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 2562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:51.901668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0880159c-f8c3-4fa9-a462-59023c306545 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:51.902573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0880159c-f8c3-4fa9-a462-59023c306545 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:51.924921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0880159c-f8c3-4fa9-a462-59023c306545 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:51.925425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0880159c-f8c3-4fa9-a462-59023c306545 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:51.929483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0880159c-f8c3-4fa9-a462-59023c306545 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:51.932194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0880159c-f8c3-4fa9-a462-59023c306545 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:52.176236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0880159c-f8c3-4fa9-a462-59023c306545 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:52.193956 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0880159c-f8c3-4fa9-a462-59023c306545 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1212 microversion: 2.1 time: 0.297236 Aug 04 13:59:52.211098 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 771/1522] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:51 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1212 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:52.333038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4b32152-571a-47da-8c55-fa32f5107d01 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3d3cd30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:52.539531 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b4b32152-571a-47da-8c55-fa32f5107d01 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.210707 Aug 04 13:59:52.544470 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 752/1523] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:52 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:52.674600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:52.675633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:52.699175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:52.703116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:52.709282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:52.709818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:53.246019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-26e3df41-be79-497e-a033-d4177a19be49 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:53.248157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-26e3df41-be79-497e-a033-d4177a19be49 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:53.303328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26e3df41-be79-497e-a033-d4177a19be49 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:53.304582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26e3df41-be79-497e-a033-d4177a19be49 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:53.306738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26e3df41-be79-497e-a033-d4177a19be49 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:53.307853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26e3df41-be79-497e-a033-d4177a19be49 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:53.519613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-26e3df41-be79-497e-a033-d4177a19be49 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:53.548598 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-26e3df41-be79-497e-a033-d4177a19be49 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1274 microversion: 2.1 time: 0.312440 Aug 04 13:59:53.552637 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 753/1524] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:53 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1274 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:53.578256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cf90a414-9ee8-46a8-ae23-44a45b0dcacd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3cc4dc0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:53.589179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:53.648333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:53.661799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:53.674952 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1c64c11c-c9d4-48fb-954d-bfabf9c527a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 1.001426 Aug 04 13:59:53.680396 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 772/1525] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:52 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:53.762720 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cf90a414-9ee8-46a8-ae23-44a45b0dcacd tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.206168 Aug 04 13:59:53.763341 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 754/1526] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:53 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:54.586866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-305d53e8-2960-420c-b640-c7e961515678 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:54.587756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-305d53e8-2960-420c-b640-c7e961515678 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:54.607181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-305d53e8-2960-420c-b640-c7e961515678 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:54.607782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-305d53e8-2960-420c-b640-c7e961515678 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:54.611074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-305d53e8-2960-420c-b640-c7e961515678 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:54.623780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-305d53e8-2960-420c-b640-c7e961515678 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:54.730802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:54.730802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:54.774359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:54.774683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:54.775747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:54.779991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:54.970799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-305d53e8-2960-420c-b640-c7e961515678 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:54.994257 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-305d53e8-2960-420c-b640-c7e961515678 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1274 microversion: 2.1 time: 0.412233 Aug 04 13:59:54.998395 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 773/1527] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:54 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1274 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:55.019857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be01b684-f998-43e1-91c2-298ef0978bf2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3f4f790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:55.271555 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be01b684-f998-43e1-91c2-298ef0978bf2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.271151 Aug 04 13:59:55.272082 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 774/1528] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:54 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:55.626393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:55.671108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:55.685007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:55.694647 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fb5d258e-5680-4e24-97a7-9495003f6a6a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 0.973696 Aug 04 13:59:55.696079 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 755/1529] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:54 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 13:59:56.025542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90526840-f0bc-4571-bf3d-fd1600890324 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:56.026437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-90526840-f0bc-4571-bf3d-fd1600890324 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:56.055218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90526840-f0bc-4571-bf3d-fd1600890324 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:56.067731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90526840-f0bc-4571-bf3d-fd1600890324 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:56.068604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90526840-f0bc-4571-bf3d-fd1600890324 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:56.069097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90526840-f0bc-4571-bf3d-fd1600890324 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:56.298959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-292fc5bb-5e19-4854-b641-74701ab653b1 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3cd64c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:56.344190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-90526840-f0bc-4571-bf3d-fd1600890324 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:56.357528 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90526840-f0bc-4571-bf3d-fd1600890324 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1274 microversion: 2.1 time: 0.334130 Aug 04 13:59:56.363078 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 775/1530] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:56 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1274 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:56.556052 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-292fc5bb-5e19-4854-b641-74701ab653b1 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.267796 Aug 04 13:59:56.557109 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 756/1531] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:56 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:56.736653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:56.737599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:56.754920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:56.761669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:56.763263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:56.768098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:57.398453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a26f80c6-34b4-4e95-946e-de97c16ebfcb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:57.399088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a26f80c6-34b4-4e95-946e-de97c16ebfcb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:57.420667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=14 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:57.427730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:57.440668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a26f80c6-34b4-4e95-946e-de97c16ebfcb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:57.443254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a26f80c6-34b4-4e95-946e-de97c16ebfcb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:57.445970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a26f80c6-34b4-4e95-946e-de97c16ebfcb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:57.449427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a26f80c6-34b4-4e95-946e-de97c16ebfcb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:57.946390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:58.003271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:58.005424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:58.008193 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e39a1844-b8cc-4369-8420-b8994cfbc510 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 1.275912 Aug 04 13:59:58.030268 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 776/1532] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:56 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 13:59:58.049404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c7cebd51-7333-4dcb-a69d-f35256812458 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3f4fb80>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:58.101015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a26f80c6-34b4-4e95-946e-de97c16ebfcb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 13:59:58.143923 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c7cebd51-7333-4dcb-a69d-f35256812458 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1452 microversion: 2.1 time: 0.111893 Aug 04 13:59:58.150691 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 777/1533] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:58 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:58.154111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a26f80c6-34b4-4e95-946e-de97c16ebfcb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1274 microversion: 2.1 time: 0.759535 Aug 04 13:59:58.157303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a99fe25d-3cd2-4318-94f7-51ffd955efc5 req-23d1576c-cb75-4dd1-857d-ef0b28b5f7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca56d355-4e66-4634-99fb-9ed160b6bc4b", "tag": "05c9a902-25a1-4f84-9f03-64cea87afd6f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 13:59:58.160400 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 757/1534] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:57 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1274 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:58.190419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a99fe25d-3cd2-4318-94f7-51ffd955efc5 req-23d1576c-cb75-4dd1-857d-ef0b28b5f7fb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:58.191140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a99fe25d-3cd2-4318-94f7-51ffd955efc5 req-23d1576c-cb75-4dd1-857d-ef0b28b5f7fb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:58.223357 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a99fe25d-3cd2-4318-94f7-51ffd955efc5 req-23d1576c-cb75-4dd1-857d-ef0b28b5f7fb service nova] Creating event network-changed:05c9a902-25a1-4f84-9f03-64cea87afd6f for instance ca56d355-4e66-4634-99fb-9ed160b6bc4b on n-h1-844627-10 Aug 04 13:59:58.249951 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a99fe25d-3cd2-4318-94f7-51ffd955efc5 req-23d1576c-cb75-4dd1-857d-ef0b28b5f7fb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089526 Aug 04 13:59:58.262045 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 778/1535] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 13:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 13:59:58.778810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20194e06-0ecd-4501-b13f-90ae3be8d38a tempest-NetworksTest-74752416 tempest-NetworksTest-74752416-project-admin] Calling method '.version_select at 0x7f46f3cdda60>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:59.054042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:59.055563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:59.083347 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-20194e06-0ecd-4501-b13f-90ae3be8d38a tempest-NetworksTest-74752416 tempest-NetworksTest-74752416-project-admin] 10.222.0.66 "GET /compute/v2.1/os-networks" status: 200 len: 6734 microversion: 2.1 time: 0.646536 Aug 04 13:59:59.084782 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 758/1536] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 13:59:58 2022] GET /compute/v2.1/os-networks => generated 6734 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:59.119201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c99d8bfe-b0cd-4b3e-86d5-c1a8dbd71833 tempest-NetworksTest-74752416 tempest-NetworksTest-74752416-project-admin] Calling method '.version_select at 0x7f46f3cddd30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:59.149563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:59.150371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:59.151846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:59.152945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:59.343237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 13:59:59.780237 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c99d8bfe-b0cd-4b3e-86d5-c1a8dbd71833 tempest-NetworksTest-74752416 tempest-NetworksTest-74752416-project-admin] 10.222.0.66 "GET /compute/v2.1/os-networks/27abc51e-1bf4-456c-85a8-74112db16a3e" status: 200 len: 652 microversion: 2.1 time: 0.688381 Aug 04 13:59:59.789437 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 759/1537] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 13:59:59 2022] GET /compute/v2.1/os-networks/27abc51e-1bf4-456c-85a8-74112db16a3e => generated 652 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 13:59:59.801554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1779218f-9042-4e3d-a61b-b63c0151a1da tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47007e5e50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:59.877810 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1779218f-9042-4e3d-a61b-b63c0151a1da tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1461 microversion: 2.1 time: 0.086344 Aug 04 13:59:59.879833 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 760/1538] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 13:59:59 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1461 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 13:59:59.896473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3543b976-dfe6-42b7-9a4b-480a615e039c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 13:59:59.897675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3543b976-dfe6-42b7-9a4b-480a615e039c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 13:59:59.907009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3543b976-dfe6-42b7-9a4b-480a615e039c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:59.907859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3543b976-dfe6-42b7-9a4b-480a615e039c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 13:59:59.909256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3543b976-dfe6-42b7-9a4b-480a615e039c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 13:59:59.910632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3543b976-dfe6-42b7-9a4b-480a615e039c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:00.602319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3543b976-dfe6-42b7-9a4b-480a615e039c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:00.647237 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3543b976-dfe6-42b7-9a4b-480a615e039c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1274 microversion: 2.1 time: 0.753813 Aug 04 14:00:00.657357 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 761/1539] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 13:59:59 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1274 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:00.671630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:00.696625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:00.702616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:00.708006 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-86a8caeb-5ba9-4dfc-877a-90da91b039de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 1.663079 Aug 04 14:00:00.709136 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 779/1540] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 13:59:59 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:00:00.724275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7392f5fa-ba0f-4995-9569-9dbd5934ba0f tempest-NetworksTest-74752416 tempest-NetworksTest-74752416-project-admin] Calling method '.version_select at 0x7f4700491430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:00.837933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1494073430", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "6d686b9e-cdea-4698-acf7-93f34e28847e"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:00.862229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:00.958496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] validate_networks() for [('6d686b9e-cdea-4698-acf7-93f34e28847e', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:00:01.646762 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7392f5fa-ba0f-4995-9569-9dbd5934ba0f tempest-NetworksTest-74752416 tempest-NetworksTest-74752416-project-admin] 10.222.0.66 "GET /compute/v2.1/os-networks" status: 200 len: 7415 microversion: 2.1 time: 0.934840 Aug 04 14:00:01.648222 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 780/1541] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:00:00 2022] GET /compute/v2.1/os-networks => generated 7415 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:01.689589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0c17a4f-1a45-452e-bbc6-daaef4120ba1 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3fb4280>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:01.823148 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0c17a4f-1a45-452e-bbc6-daaef4120ba1 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 200 len: 1461 microversion: 2.1 time: 0.170501 Aug 04 14:00:01.825479 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 781/1542] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:01 2022] GET /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 1461 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:01.843559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5ed6b8e6-d706-424b-b81d-286b330954e6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:01.845436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5ed6b8e6-d706-424b-b81d-286b330954e6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:01.864390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ed6b8e6-d706-424b-b81d-286b330954e6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:01.865136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ed6b8e6-d706-424b-b81d-286b330954e6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:01.866979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ed6b8e6-d706-424b-b81d-286b330954e6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:01.870503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ed6b8e6-d706-424b-b81d-286b330954e6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:02.514768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5ed6b8e6-d706-424b-b81d-286b330954e6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:02.541111 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5ed6b8e6-d706-424b-b81d-286b330954e6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1316 microversion: 2.1 time: 0.713491 Aug 04 14:00:02.541735 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 782/1543] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:01 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:02.547481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:02.548135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:02.566745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:02.567214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:02.568028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:02.568483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:03.168919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:03.212975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:03.218744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:03.220745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-50ccbc4e-881e-46d6-8000-81c9d69c7666 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 0.677979 Aug 04 14:00:03.228009 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 783/1544] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:00:02 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:00:03.233300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf3016d0-191e-47fb-8c63-ee4d89de567f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:03.233989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf3016d0-191e-47fb-8c63-ee4d89de567f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:03.277246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf3016d0-191e-47fb-8c63-ee4d89de567f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:03.284799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf3016d0-191e-47fb-8c63-ee4d89de567f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:03.288012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf3016d0-191e-47fb-8c63-ee4d89de567f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:03.301127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:00:03.304137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:00:03.305777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:00:03.307023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:00:03.308134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:00:03.311385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf3016d0-191e-47fb-8c63-ee4d89de567f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:03.358421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:03.373089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:03.378899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:03.380080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:03.440249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:03.501258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Getting quotas for project 2c78c75d748a4fe29f1bcdbe40d280a9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:00:03.521594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Getting quotas for user 69f66d07b9ed48d0b9e2763d9659df3f and project 2c78c75d748a4fe29f1bcdbe40d280a9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:00:03.560492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:00:03.569896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:00:03.755960 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca3cd991-240e-423a-b5fe-cc2f11fd9635 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.096855 Aug 04 14:00:03.776210 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 762/1545] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:00:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:00:03.812017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3454d79c-f765-4d86-aae8-b1bc8be69b65 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:03.820480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3454d79c-f765-4d86-aae8-b1bc8be69b65 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:03.865891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3454d79c-f765-4d86-aae8-b1bc8be69b65 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:03.869720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3454d79c-f765-4d86-aae8-b1bc8be69b65 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:03.871853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3454d79c-f765-4d86-aae8-b1bc8be69b65 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:03.875570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3454d79c-f765-4d86-aae8-b1bc8be69b65 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:06.003691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bf3016d0-191e-47fb-8c63-ee4d89de567f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:06.041068 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf3016d0-191e-47fb-8c63-ee4d89de567f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1468 microversion: 2.1 time: 2.811297 Aug 04 14:00:06.056631 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 784/1546] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:03 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1468 bytes in 2828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:06.084005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a1ddeec4-2483-4067-a0b2-04e980797df8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:06.085252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a1ddeec4-2483-4067-a0b2-04e980797df8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:06.144457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1ddeec4-2483-4067-a0b2-04e980797df8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:06.145564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1ddeec4-2483-4067-a0b2-04e980797df8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:06.157570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1ddeec4-2483-4067-a0b2-04e980797df8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:06.158879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1ddeec4-2483-4067-a0b2-04e980797df8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:06.386733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3454d79c-f765-4d86-aae8-b1bc8be69b65 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:06.405077 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3454d79c-f765-4d86-aae8-b1bc8be69b65 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1316 microversion: 2.1 time: 2.613607 Aug 04 14:00:06.408901 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 763/1547] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:03 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1316 bytes in 2622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:06.422186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-453c73e9-fe30-4349-95b9-2df61451e130 req-398ede6e-5e75-45f7-912a-200ef0935c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211b9e89-0c4b-45f2-8324-77aee2accf38", "tag": "6c34e394-956e-49e5-ab8f-27259b03d8a3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:06.475949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-453c73e9-fe30-4349-95b9-2df61451e130 req-398ede6e-5e75-45f7-912a-200ef0935c86 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:06.477192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-453c73e9-fe30-4349-95b9-2df61451e130 req-398ede6e-5e75-45f7-912a-200ef0935c86 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:06.581899 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-453c73e9-fe30-4349-95b9-2df61451e130 req-398ede6e-5e75-45f7-912a-200ef0935c86 service nova] Creating event network-changed:6c34e394-956e-49e5-ab8f-27259b03d8a3 for instance 211b9e89-0c4b-45f2-8324-77aee2accf38 on n-h2-844627-10 Aug 04 14:00:06.605812 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-453c73e9-fe30-4349-95b9-2df61451e130 req-398ede6e-5e75-45f7-912a-200ef0935c86 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191528 Aug 04 14:00:06.609926 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 764/1548] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:06.996045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a1ddeec4-2483-4067-a0b2-04e980797df8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:07.040033 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a1ddeec4-2483-4067-a0b2-04e980797df8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1204 microversion: 2.1 time: 0.981124 Aug 04 14:00:07.082663 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 785/1549] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:06 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1204 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:07.121453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-bd27bac8-f121-4aba-8fb5-a7f700c2468d req-91d61038-9975-4530-81c9-ec6a69f8382c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691963ac-14bf-4d48-9c45-643a5efa71aa", "name": "network-vif-unplugged", "status": "completed", "tag": "bf8eeb52-7009-43e9-97bf-d0b34751ba4f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:07.130664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:07.131504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:07.153473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:07.179516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bd27bac8-f121-4aba-8fb5-a7f700c2468d req-91d61038-9975-4530-81c9-ec6a69f8382c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:07.180146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:07.180334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bd27bac8-f121-4aba-8fb5-a7f700c2468d req-91d61038-9975-4530-81c9-ec6a69f8382c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:07.180631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:07.181425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:07.181871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:07.246874 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bd27bac8-f121-4aba-8fb5-a7f700c2468d req-91d61038-9975-4530-81c9-ec6a69f8382c service nova] Creating event network-vif-unplugged:bf8eeb52-7009-43e9-97bf-d0b34751ba4f for instance 691963ac-14bf-4d48-9c45-643a5efa71aa on n-h2-844627-10 Aug 04 14:00:07.302565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-bd27bac8-f121-4aba-8fb5-a7f700c2468d req-91d61038-9975-4530-81c9-ec6a69f8382c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.213155 Aug 04 14:00:07.303644 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 786/1550] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:07.337507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-009db8c5-c15f-4400-981c-1a547c76bf79 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2063859933"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:07.367132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-009db8c5-c15f-4400-981c-1a547c76bf79 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:07.405651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-009db8c5-c15f-4400-981c-1a547c76bf79 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:07.409347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-009db8c5-c15f-4400-981c-1a547c76bf79 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:07.420065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-009db8c5-c15f-4400-981c-1a547c76bf79 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:07.423282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-009db8c5-c15f-4400-981c-1a547c76bf79 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:08.044189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-009db8c5-c15f-4400-981c-1a547c76bf79 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "POST /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507/action" status: 202 len: 0 microversion: 2.1 time: 0.722931 Aug 04 14:00:08.056637 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 787/1551] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:00:07 2022] POST /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:00:08.072270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01a06f75-29d3-4957-883d-55684a7e3ce8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:08.081901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-01a06f75-29d3-4957-883d-55684a7e3ce8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:08.113396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01a06f75-29d3-4957-883d-55684a7e3ce8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:08.114484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01a06f75-29d3-4957-883d-55684a7e3ce8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:08.116279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01a06f75-29d3-4957-883d-55684a7e3ce8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:08.117112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01a06f75-29d3-4957-883d-55684a7e3ce8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:09.137970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:09.198152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:09.206810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:09.208641 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d67b229b-728e-48c7-9ec0-79b61175f98a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 2.596633 Aug 04 14:00:09.210547 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 765/1552] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:00:06 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 2600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:00:09.215941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c39bd8b-f184-4cfe-8d8d-bef92e0c545e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3ce9160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:09.291615 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c39bd8b-f184-4cfe-8d8d-bef92e0c545e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.079578 Aug 04 14:00:09.297808 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 766/1553] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:09 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:09.303122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae657802-1342-4244-9046-5ccff0b80362 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:09.303747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ae657802-1342-4244-9046-5ccff0b80362 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:09.333114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae657802-1342-4244-9046-5ccff0b80362 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:09.333846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae657802-1342-4244-9046-5ccff0b80362 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:09.335284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae657802-1342-4244-9046-5ccff0b80362 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:09.343191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae657802-1342-4244-9046-5ccff0b80362 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:09.509244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-01a06f75-29d3-4957-883d-55684a7e3ce8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:09.542901 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-01a06f75-29d3-4957-883d-55684a7e3ce8 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1316 microversion: 2.1 time: 1.467585 Aug 04 14:00:09.544594 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 788/1554] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:08 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1316 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:09.725399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ae657802-1342-4244-9046-5ccff0b80362 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:09.737023 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae657802-1342-4244-9046-5ccff0b80362 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1266 microversion: 2.1 time: 0.437873 Aug 04 14:00:09.745837 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 767/1555] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:09 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1266 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:10.252452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:10.253244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:10.275930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:10.277291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:10.279623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:10.286361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:10.313201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bab40fce-f126-42e3-9983-57c13bccd5f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3ce9b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:10.427394 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bab40fce-f126-42e3-9983-57c13bccd5f4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.108644 Aug 04 14:00:10.430319 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 768/1556] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:10 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:00:10.566889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ccc5205-fb45-40cc-9258-1a660170b73f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:10.567711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ccc5205-fb45-40cc-9258-1a660170b73f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:10.597610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ccc5205-fb45-40cc-9258-1a660170b73f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:10.598088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ccc5205-fb45-40cc-9258-1a660170b73f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:10.598937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ccc5205-fb45-40cc-9258-1a660170b73f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:10.599388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ccc5205-fb45-40cc-9258-1a660170b73f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:12.977050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ccc5205-fb45-40cc-9258-1a660170b73f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:13.004707 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ccc5205-fb45-40cc-9258-1a660170b73f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1316 microversion: 2.1 time: 2.441324 Aug 04 14:00:13.008313 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 769/1557] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:10 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1316 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:13.023234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4f80f816-c7c1-4888-ab5e-f838f8910016 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:13.028926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4f80f816-c7c1-4888-ab5e-f838f8910016 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:13.050304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f80f816-c7c1-4888-ab5e-f838f8910016 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:13.053045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f80f816-c7c1-4888-ab5e-f838f8910016 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:13.056440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f80f816-c7c1-4888-ab5e-f838f8910016 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:13.057098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f80f816-c7c1-4888-ab5e-f838f8910016 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:13.144356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:13.164917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:13.173803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:13.186164 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-57311f25-314b-4694-a0e3-b4131c8a46e8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1813 microversion: 2.25 time: 2.938257 Aug 04 14:00:13.201057 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 789/1558] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:00:10 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1813 bytes in 2942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:00:13.201057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e6f0081-7fef-4ff1-abbc-af9fd78e3f6d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3f51d30>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:13.406890 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e6f0081-7fef-4ff1-abbc-af9fd78e3f6d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.216220 Aug 04 14:00:13.407603 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 790/1559] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:13 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:13.431069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:13.544476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:14.210010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eff3775f-1892-4c48-af9a-273fe778849d tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f470093f0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-807435638", "description": "tempest-description-1053060902"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:14.981907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4f80f816-c7c1-4888-ab5e-f838f8910016 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:15.008369 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4f80f816-c7c1-4888-ab5e-f838f8910016 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1308 microversion: 2.1 time: 1.995607 Aug 04 14:00:15.009432 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 770/1560] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:13 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1308 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:15.029271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-143d995d-719e-475d-ac27-9d29dacf4351 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:15.030665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-143d995d-719e-475d-ac27-9d29dacf4351 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:15.056421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-143d995d-719e-475d-ac27-9d29dacf4351 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:15.064313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-143d995d-719e-475d-ac27-9d29dacf4351 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:15.066025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-143d995d-719e-475d-ac27-9d29dacf4351 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:15.066779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-143d995d-719e-475d-ac27-9d29dacf4351 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:17.075946 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eff3775f-1892-4c48-af9a-273fe778849d tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 3.651743 Aug 04 14:00:17.079066 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 791/1561] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:00:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 3671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:17.094552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:17.097987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:17.122638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:17.126613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:17.132184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:17.135879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:17.305288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-143d995d-719e-475d-ac27-9d29dacf4351 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:17.338909 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-143d995d-719e-475d-ac27-9d29dacf4351 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1316 microversion: 2.1 time: 2.327577 Aug 04 14:00:17.339558 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 771/1562] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:15 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1316 bytes in 2330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:17.759539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-198c3e57-14fb-492a-8fc0-4daf648f746a tempest-QuotaClassesAdmin257Test-691956245 tempest-QuotaClassesAdmin257Test-691956245-project-admin] Calling method '.version_select at 0x7f47002e70d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:17.762952 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:00:17.762952 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:00:17.772857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:17.822062 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-198c3e57-14fb-492a-8fc0-4daf648f746a tempest-QuotaClassesAdmin257Test-691956245 tempest-QuotaClassesAdmin257Test-691956245-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.480700 Aug 04 14:00:17.829807 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 772/1563] 10.222.0.66 () {60 vars in 1226 bytes} [Thu Aug 4 14:00:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:17.853664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b58ce5d1-f7b7-4aa3-98fb-aeb8768bbba4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002b15e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:17.969944 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b58ce5d1-f7b7-4aa3-98fb-aeb8768bbba4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.137916 Aug 04 14:00:17.989830 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 773/1564] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:17 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:18.013962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-cc003a7f-d94f-4d5d-886d-b00ed9c80e75 req-4fb3b10e-1b66-4d93-9c38-572bd176a732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211b9e89-0c4b-45f2-8324-77aee2accf38", "name": "network-vif-plugged", "status": "completed", "tag": "6c34e394-956e-49e5-ab8f-27259b03d8a3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:18.061690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cc003a7f-d94f-4d5d-886d-b00ed9c80e75 req-4fb3b10e-1b66-4d93-9c38-572bd176a732 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:18.062573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cc003a7f-d94f-4d5d-886d-b00ed9c80e75 req-4fb3b10e-1b66-4d93-9c38-572bd176a732 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:18.108654 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-cc003a7f-d94f-4d5d-886d-b00ed9c80e75 req-4fb3b10e-1b66-4d93-9c38-572bd176a732 service nova] Creating event network-vif-plugged:6c34e394-956e-49e5-ab8f-27259b03d8a3 for instance 211b9e89-0c4b-45f2-8324-77aee2accf38 on n-h2-844627-10 Aug 04 14:00:18.138858 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-cc003a7f-d94f-4d5d-886d-b00ed9c80e75 req-4fb3b10e-1b66-4d93-9c38-572bd176a732 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143053 Aug 04 14:00:18.139540 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 774/1565] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:18.254894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:18.285940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:18.295072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1137185226", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "a6fe3b0e-589f-4137-b3da-0f7664c12e01"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:18.313429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:18.326866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:18.342008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5021cff6-994b-4424-9496-ec61b107cf45 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1803 microversion: 2.25 time: 1.260606 Aug 04 14:00:18.343941 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 792/1566] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:00:17 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1803 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:00:18.382469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d8b5db2-93b5-4cd8-950f-da29db9533dd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:18.383761 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d8b5db2-93b5-4cd8-950f-da29db9533dd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:18.428332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8b5db2-93b5-4cd8-950f-da29db9533dd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:18.432247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8b5db2-93b5-4cd8-950f-da29db9533dd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:18.436086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8b5db2-93b5-4cd8-950f-da29db9533dd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:18.439726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8b5db2-93b5-4cd8-950f-da29db9533dd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:18.450070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] validate_networks() for [('a6fe3b0e-589f-4137-b3da-0f7664c12e01', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:00:19.886343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d8b5db2-93b5-4cd8-950f-da29db9533dd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:19.932100 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d8b5db2-93b5-4cd8-950f-da29db9533dd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1308 microversion: 2.1 time: 1.575106 Aug 04 14:00:19.935481 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 793/1567] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:18 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1308 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:19.973395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e5b31a67-2ed6-4747-b5b1-d1f62770cd11 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f4705660940>, body: {"security_group_rule": {"parent_group_id": "221feb57-2015-4cea-9931-c5d83522df73", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:21.247847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:00:21.250862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:00:21.251954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:00:21.252985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:00:21.254042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:00:21.296585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:21.311664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:21.317260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:21.318612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:21.406852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:00:21.441141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for user dd1aacb549b74c21a13b9f3ca2df840c and project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:00:21.486709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:00:21.491812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:00:21.690355 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5efe4a88-3557-447f-a2dd-06df111743d0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.545316 Aug 04 14:00:21.705504 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 775/1568] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:00:21.757182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab42235c-7bb9-44f2-bbf7-1c3cc87f5c90 tempest-QuotaClassesAdmin257Test-691956245 tempest-QuotaClassesAdmin257Test-691956245-project-admin] Action: 'update', calling method: .version_select at 0x7f46f3ce9ee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:21.760622 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:00:21.760622 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:00:21.982504 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e5b31a67-2ed6-4747-b5b1-d1f62770cd11 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.029232 Aug 04 14:00:21.985409 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 794/1569] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:00:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:21.990698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-357b5d2b-8560-499a-b3c6-13a3f13305ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:21.991793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-357b5d2b-8560-499a-b3c6-13a3f13305ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:22.023106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-357b5d2b-8560-499a-b3c6-13a3f13305ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:22.030246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-357b5d2b-8560-499a-b3c6-13a3f13305ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:22.031661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-357b5d2b-8560-499a-b3c6-13a3f13305ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:22.032124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-357b5d2b-8560-499a-b3c6-13a3f13305ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:22.133702 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab42235c-7bb9-44f2-bbf7-1c3cc87f5c90 tempest-QuotaClassesAdmin257Test-691956245 tempest-QuotaClassesAdmin257Test-691956245-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.426047 Aug 04 14:00:22.142897 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 776/1570] 10.222.0.66 () {62 vars in 1247 bytes} [Thu Aug 4 14:00:21 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:22.167088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d1867cdd-cf28-44b3-a817-3606c0534699 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '.version_select at 0x7f46f3ceadc0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:22.188562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1867cdd-cf28-44b3-a817-3606c0534699 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:22.189462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1867cdd-cf28-44b3-a817-3606c0534699 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:22.233279 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d1867cdd-cf28-44b3-a817-3606c0534699 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 1288 microversion: 2.25 time: 0.088014 Aug 04 14:00:22.234942 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 777/1571] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Aug 4 14:00:22 2022] GET /compute/v2.1/os-migrations => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:00:22.275831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-07a02ebb-cb9e-4337-8bf2-2c4dd8b65e53 req-27bfc7af-fda2-434f-8237-0c014f7b83a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7ebe867-4b9d-485d-8966-8f8ba3004e79", "tag": "146e5ef7-a016-4406-86bd-d67bec04de40"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:22.366871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-07a02ebb-cb9e-4337-8bf2-2c4dd8b65e53 req-27bfc7af-fda2-434f-8237-0c014f7b83a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:22.369335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-07a02ebb-cb9e-4337-8bf2-2c4dd8b65e53 req-27bfc7af-fda2-434f-8237-0c014f7b83a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:22.458318 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-07a02ebb-cb9e-4337-8bf2-2c4dd8b65e53 req-27bfc7af-fda2-434f-8237-0c014f7b83a4 service nova] Creating event network-changed:146e5ef7-a016-4406-86bd-d67bec04de40 for instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 on n-h1-844627-10 Aug 04 14:00:22.494022 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-07a02ebb-cb9e-4337-8bf2-2c4dd8b65e53 req-27bfc7af-fda2-434f-8237-0c014f7b83a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249525 Aug 04 14:00:22.498238 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 778/1572] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:22.529661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-57c4805e-f3a0-44c1-be46-fb40eb402926 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3d3ca60>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:22.699351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-357b5d2b-8560-499a-b3c6-13a3f13305ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:22.707918 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-357b5d2b-8560-499a-b3c6-13a3f13305ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1504 microversion: 2.1 time: 0.721094 Aug 04 14:00:22.716783 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 795/1573] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:21 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1504 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:22.720327 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-57c4805e-f3a0-44c1-be46-fb40eb402926 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.218590 Aug 04 14:00:22.737994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-55919c1f-03c4-4a2c-aa30-f1762a1c806a req-f1c9d3df-96d0-491e-af16-6850a27eadce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ca2cc-3cdb-477e-9166-c915de5fc507", "name": "network-vif-plugged", "status": "completed", "tag": "3725cfe1-eef7-4aa9-8c08-89a978079195"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:22.739994 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 779/1574] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:22 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:22.773898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-55919c1f-03c4-4a2c-aa30-f1762a1c806a req-f1c9d3df-96d0-491e-af16-6850a27eadce service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:22.775198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f8ab0e99-742e-4f2d-bd07-f94a497e8bde tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:22.783239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f8ab0e99-742e-4f2d-bd07-f94a497e8bde tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:22.787389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-55919c1f-03c4-4a2c-aa30-f1762a1c806a req-f1c9d3df-96d0-491e-af16-6850a27eadce service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:22.816309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8ab0e99-742e-4f2d-bd07-f94a497e8bde tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:22.822385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8ab0e99-742e-4f2d-bd07-f94a497e8bde tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:22.830757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8ab0e99-742e-4f2d-bd07-f94a497e8bde tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:22.832098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8ab0e99-742e-4f2d-bd07-f94a497e8bde tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:22.877157 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-55919c1f-03c4-4a2c-aa30-f1762a1c806a req-f1c9d3df-96d0-491e-af16-6850a27eadce service nova] Creating event network-vif-plugged:3725cfe1-eef7-4aa9-8c08-89a978079195 for instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 on n-h2-844627-10 Aug 04 14:00:22.896578 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-55919c1f-03c4-4a2c-aa30-f1762a1c806a req-f1c9d3df-96d0-491e-af16-6850a27eadce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178044 Aug 04 14:00:22.903883 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 796/1575] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:22.963341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-62add1c2-43a2-4860-97b5-d892fcfbc20c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:22.966354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-62add1c2-43a2-4860-97b5-d892fcfbc20c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:23.364992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-62add1c2-43a2-4860-97b5-d892fcfbc20c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:23.392923 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-62add1c2-43a2-4860-97b5-d892fcfbc20c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1211 microversion: 2.1 time: 0.487067 Aug 04 14:00:23.427950 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 797/1576] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:22 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1211 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:23.482464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-911a8750-a54c-4474-baf8-e24562a337ae tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f4700688a60>, body: {"security_group_rule": {"parent_group_id": "221feb57-2015-4cea-9931-c5d83522df73", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:23.619286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f8ab0e99-742e-4f2d-bd07-f94a497e8bde tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:23.650852 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f8ab0e99-742e-4f2d-bd07-f94a497e8bde tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1308 microversion: 2.1 time: 0.906702 Aug 04 14:00:23.658627 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 780/1577] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:22 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1308 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:23.684950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-891135ed-9a21-44d8-8e19-c7e1092bc335 tempest-QuotaClassesAdmin257Test-691956245 tempest-QuotaClassesAdmin257Test-691956245-project-admin] Calling method '.version_select at 0x7f46f3cc79d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:23.689335 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:00:23.689335 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:00:23.758425 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-891135ed-9a21-44d8-8e19-c7e1092bc335 tempest-QuotaClassesAdmin257Test-691956245 tempest-QuotaClassesAdmin257Test-691956245-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.096297 Aug 04 14:00:23.759563 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 781/1578] 10.222.0.66 () {60 vars in 1226 bytes} [Thu Aug 4 14:00:23 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:23.795206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c76580c2-f63e-4be1-adea-7f1ad6bbab10 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:23.797161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c76580c2-f63e-4be1-adea-7f1ad6bbab10 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:23.829589 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-911a8750-a54c-4474-baf8-e24562a337ae tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] HTTP exception thrown: This rule already exists in group 221feb57-2015-4cea-9931-c5d83522df73 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-911a8750-a54c-4474-baf8-e24562a337ae tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Request method failure captured: Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 138 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Drypj8tm07yrywYUI7r6kyGMio9CasZQsra_VvA5jN1qMoKKZWfldAolbFBZSSkrbCrE3rWmN-FPAJqdr_cSci5fBBA29SLyAyaZFSZAnoUEmCKkE_Qr-f7wlcGsaw411vrex6c1agwIuWZk9Nfiz_-rdOVrvtxNmenuZ4KoBGejA Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}] Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7275c7bee8fc47beb9c0500b557ed7f6 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: {"security_group_rule": {"parent_group_id": "221feb57-2015-4cea-9931-c5d83522df73", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: exception: This rule already exists in group 221feb57-2015-4cea-9931-c5d83522df73 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'security_group_rule': {'parent_group_id': '221feb57-2015-4cea-9931-c5d83522df73', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 221feb57-2015-4cea-9931-c5d83522df73 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 221feb57-2015-4cea-9931-c5d83522df73 Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:23.832194 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:23.837978 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:23.837978 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:23.837978 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 221feb57-2015-4cea-9931-c5d83522df73 Aug 04 14:00:23.837978 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:23.837978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-911a8750-a54c-4474-baf8-e24562a337ae tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Returning 400 to user: This rule already exists in group 221feb57-2015-4cea-9931-c5d83522df73 {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:23.837978 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-911a8750-a54c-4474-baf8-e24562a337ae tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.403406 Aug 04 14:00:23.838991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c76580c2-f63e-4be1-adea-7f1ad6bbab10 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:23.838991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c76580c2-f63e-4be1-adea-7f1ad6bbab10 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:23.839304 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 798/1579] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:00:23 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 409 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:00:23.839456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c76580c2-f63e-4be1-adea-7f1ad6bbab10 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:23.839621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c76580c2-f63e-4be1-adea-7f1ad6bbab10 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:23.843804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5aacd275-a5f4-43f7-b4f5-0de48e7edc1f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-178366884"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:23.844369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5aacd275-a5f4-43f7-b4f5-0de48e7edc1f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:23.898632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5aacd275-a5f4-43f7-b4f5-0de48e7edc1f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:23.900272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5aacd275-a5f4-43f7-b4f5-0de48e7edc1f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:23.902110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5aacd275-a5f4-43f7-b4f5-0de48e7edc1f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:23.903812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5aacd275-a5f4-43f7-b4f5-0de48e7edc1f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:24.636268 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.network.security_group_api [None req-5aacd275-a5f4-43f7-b4f5-0de48e7edc1f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Adding security group 91999569-a08b-4b07-89ee-194f06fa9633 to port 6c34e394-956e-49e5-ab8f-27259b03d8a3 Aug 04 14:00:24.665352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-c76580c2-f63e-4be1-adea-7f1ad6bbab10 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid ca56d355-4e66-4634-99fb-9ed160b6bc4b {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:00:24.790736 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c76580c2-f63e-4be1-adea-7f1ad6bbab10 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 2424 microversion: 2.25 time: 1.027907 Aug 04 14:00:24.890225 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 782/1580] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:00:23 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 2424 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:00:24.903711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8ae4bd5b-2988-4812-9e8b-42434d67d548 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3cdd820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:25.006528 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8ae4bd5b-2988-4812-9e8b-42434d67d548 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.114404 Aug 04 14:00:25.007784 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 783/1581] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:24 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:25.022620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06a6d203-b942-496c-a34e-01b2e7d9b8ae tempest-QuotaClassesAdmin257Test-691956245 tempest-QuotaClassesAdmin257Test-691956245-project-admin] Action: 'update', calling method: .version_select at 0x7f47002e1280>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:25.029529 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:00:25.029529 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:00:25.168228 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-06a6d203-b942-496c-a34e-01b2e7d9b8ae tempest-QuotaClassesAdmin257Test-691956245 tempest-QuotaClassesAdmin257Test-691956245-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.158632 Aug 04 14:00:25.169119 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 784/1582] 10.222.0.66 () {62 vars in 1247 bytes} [Thu Aug 4 14:00:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:25.185473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b697d510-4b24-4b1f-9520-00f4405ca577 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Calling method '.version_select at 0x7f46f3cd8280>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:26.321490 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b697d510-4b24-4b1f-9520-00f4405ca577 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-group-rules/0975c4f9-dd4a-4440-b0c4-e8f40117ab26" status: 202 len: 0 microversion: 2.1 time: 1.148620 Aug 04 14:00:26.324311 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 785/1583] 10.222.0.66 () {58 vars in 1287 bytes} [Thu Aug 4 14:00:25 2022] DELETE /compute/v2.1/os-security-group-rules/0975c4f9-dd4a-4440-b0c4-e8f40117ab26 => generated 0 bytes in 1154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:26.348036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1e2cf3d-f549-4e26-91e1-a44a202c2dd3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:26.351710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1e2cf3d-f549-4e26-91e1-a44a202c2dd3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:26.384963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1e2cf3d-f549-4e26-91e1-a44a202c2dd3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:26.390662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1e2cf3d-f549-4e26-91e1-a44a202c2dd3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:26.393662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1e2cf3d-f549-4e26-91e1-a44a202c2dd3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:26.414473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1e2cf3d-f549-4e26-91e1-a44a202c2dd3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:26.914556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c1e2cf3d-f549-4e26-91e1-a44a202c2dd3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:26.938881 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1e2cf3d-f549-4e26-91e1-a44a202c2dd3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1269 microversion: 2.1 time: 0.611292 Aug 04 14:00:26.950812 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 786/1584] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:26 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1269 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:26.968750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6050f7e1-790c-4c7c-980f-ae485fee3bb8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:26.975986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6050f7e1-790c-4c7c-980f-ae485fee3bb8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:27.004351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6050f7e1-790c-4c7c-980f-ae485fee3bb8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:27.007232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6050f7e1-790c-4c7c-980f-ae485fee3bb8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:27.013174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6050f7e1-790c-4c7c-980f-ae485fee3bb8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:27.014533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6050f7e1-790c-4c7c-980f-ae485fee3bb8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:27.040735 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5aacd275-a5f4-43f7-b4f5-0de48e7edc1f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38/action" status: 202 len: 0 microversion: 2.1 time: 3.201452 Aug 04 14:00:27.041867 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 799/1585] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:00:23 2022] POST /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38/action => generated 0 bytes in 3203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:28.001187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f6224fe-e0a4-45b9-a472-7584578cd463 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:28.002014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9f6224fe-e0a4-45b9-a472-7584578cd463 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:28.025435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f6224fe-e0a4-45b9-a472-7584578cd463 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:28.026371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f6224fe-e0a4-45b9-a472-7584578cd463 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:28.027917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f6224fe-e0a4-45b9-a472-7584578cd463 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:28.028670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f6224fe-e0a4-45b9-a472-7584578cd463 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:28.388912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6050f7e1-790c-4c7c-980f-ae485fee3bb8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:28.407548 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6050f7e1-790c-4c7c-980f-ae485fee3bb8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1308 microversion: 2.1 time: 1.454915 Aug 04 14:00:28.412489 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 787/1586] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:26 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1308 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:28.421371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c436d26-c305-4bb4-a81b-6f75ab9660b8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3cd8ca0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:28.610594 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c436d26-c305-4bb4-a81b-6f75ab9660b8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.196252 Aug 04 14:00:28.614991 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 788/1587] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:28 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:28.622791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0442ba94-0274-4739-8b87-dc0eb1509636 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f46f3cf49d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-673754637", "description": "tempest-description-211567835"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:28.628046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-9f6224fe-e0a4-45b9-a472-7584578cd463 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid ca56d355-4e66-4634-99fb-9ed160b6bc4b {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:00:28.676338 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9f6224fe-e0a4-45b9-a472-7584578cd463 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 2424 microversion: 2.25 time: 1.633033 Aug 04 14:00:28.677160 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 800/1588] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:00:27 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 2424 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:00:28.713179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52066826-5f25-4c56-aa3c-50484e29f6d9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f4700bb7af0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:29.128832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-52066826-5f25-4c56-aa3c-50484e29f6d9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 91999569-a08b-4b07-89ee-194f06fa9633 in use.", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:00:29.130185 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-52066826-5f25-4c56-aa3c-50484e29f6d9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security Group 91999569-a08b-4b07-89ee-194f06fa9633 in use. Aug 04 14:00:29.130185 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-1f9806b6-5817-4f37-b706-4427f6478c5f'] Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52066826-5f25-4c56-aa3c-50484e29f6d9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-security-groups/91999569-a08b-4b07-89ee-194f06fa9633 HTTP/1.1 Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: exception: Security Group 91999569-a08b-4b07-89ee-194f06fa9633 in use. Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-1f9806b6-5817-4f37-b706-4427f6478c5f'] Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '91999569-a08b-4b07-89ee-194f06fa9633'} Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:00:29.135340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 91999569-a08b-4b07-89ee-194f06fa9633 in use. Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f9806b6-5817-4f37-b706-4427f6478c5f'] Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 91999569-a08b-4b07-89ee-194f06fa9633 in use. Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f9806b6-5817-4f37-b706-4427f6478c5f'] Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 91999569-a08b-4b07-89ee-194f06fa9633 in use. Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f9806b6-5817-4f37-b706-4427f6478c5f'] Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 91999569-a08b-4b07-89ee-194f06fa9633 in use. Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f9806b6-5817-4f37-b706-4427f6478c5f'] Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52066826-5f25-4c56-aa3c-50484e29f6d9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 400 to user: Security Group 91999569-a08b-4b07-89ee-194f06fa9633 in use. Aug 04 14:00:29.143629 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-1f9806b6-5817-4f37-b706-4427f6478c5f'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:29.173111 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-52066826-5f25-4c56-aa3c-50484e29f6d9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/91999569-a08b-4b07-89ee-194f06fa9633" status: 400 len: 185 microversion: 2.1 time: 0.440826 Aug 04 14:00:29.174250 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 801/1589] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:00:28 2022] DELETE /compute/v2.1/os-security-groups/91999569-a08b-4b07-89ee-194f06fa9633 => generated 185 bytes in 477 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:00:29.198899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b1d56956-706b-43d1-85f2-5817a0281929 req-e614b490-5786-4a60-a7ca-4bd2bab8e9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211b9e89-0c4b-45f2-8324-77aee2accf38", "tag": "6c34e394-956e-49e5-ab8f-27259b03d8a3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:29.271098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b1d56956-706b-43d1-85f2-5817a0281929 req-e614b490-5786-4a60-a7ca-4bd2bab8e9d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:29.271900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b1d56956-706b-43d1-85f2-5817a0281929 req-e614b490-5786-4a60-a7ca-4bd2bab8e9d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:29.337525 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0442ba94-0274-4739-8b87-dc0eb1509636 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.721223 Aug 04 14:00:29.349099 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 789/1590] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:00:28 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:29.351705 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b1d56956-706b-43d1-85f2-5817a0281929 req-e614b490-5786-4a60-a7ca-4bd2bab8e9d1 service nova] Creating event network-changed:6c34e394-956e-49e5-ab8f-27259b03d8a3 for instance 211b9e89-0c4b-45f2-8324-77aee2accf38 on n-h2-844627-10 Aug 04 14:00:29.355021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-abe46190-882c-4c43-9cc6-5afeae22d427 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:29.355855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-abe46190-882c-4c43-9cc6-5afeae22d427 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:29.383183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe46190-882c-4c43-9cc6-5afeae22d427 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:29.388637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe46190-882c-4c43-9cc6-5afeae22d427 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:29.390315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe46190-882c-4c43-9cc6-5afeae22d427 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:29.391239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe46190-882c-4c43-9cc6-5afeae22d427 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:29.399109 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b1d56956-706b-43d1-85f2-5817a0281929 req-e614b490-5786-4a60-a7ca-4bd2bab8e9d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214642 Aug 04 14:00:29.409431 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 802/1591] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:29.435065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f206e4b-932b-4c2d-96aa-af9aacc867de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:29.438939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9f206e4b-932b-4c2d-96aa-af9aacc867de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:29.455909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f206e4b-932b-4c2d-96aa-af9aacc867de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:29.457708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f206e4b-932b-4c2d-96aa-af9aacc867de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:29.459428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f206e4b-932b-4c2d-96aa-af9aacc867de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:29.460560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f206e4b-932b-4c2d-96aa-af9aacc867de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:29.545831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-abe46190-882c-4c43-9cc6-5afeae22d427 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:29.559900 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-abe46190-882c-4c43-9cc6-5afeae22d427 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1269 microversion: 2.1 time: 0.209363 Aug 04 14:00:29.563293 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 790/1592] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:29 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1269 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:29.576436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd9e8fba-7378-4ad6-92b7-3497cba6e54a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:29.583860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cd9e8fba-7378-4ad6-92b7-3497cba6e54a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:29.603115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd9e8fba-7378-4ad6-92b7-3497cba6e54a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:29.614621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd9e8fba-7378-4ad6-92b7-3497cba6e54a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:29.617784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd9e8fba-7378-4ad6-92b7-3497cba6e54a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:29.620138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd9e8fba-7378-4ad6-92b7-3497cba6e54a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:29.705737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-9f206e4b-932b-4c2d-96aa-af9aacc867de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lazy-loading 'services' on Instance uuid ca56d355-4e66-4634-99fb-9ed160b6bc4b {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:00:29.837985 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cd9e8fba-7378-4ad6-92b7-3497cba6e54a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38/action" status: 202 len: 0 microversion: 2.1 time: 0.272269 Aug 04 14:00:29.841898 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 791/1593] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:00:29 2022] POST /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:29.861010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b6a087ca-3ec1-4201-9260-226149f42ca6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f46f3cd8280>, body: {"security_group_rule": {"parent_group_id": "4ce51662-412c-4315-9737-0e407bfa5a0b", "ip_protocol": "tcp", "from_port": 677426856, "to_port": 22}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:29.981738 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9f206e4b-932b-4c2d-96aa-af9aacc867de tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments/59086d6f-5184-4367-af6c-34c2aff78662" status: 202 len: 0 microversion: 2.25 time: 0.567342 Aug 04 14:00:29.988845 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 803/1594] 10.222.0.66 () {60 vars in 1457 bytes} [Thu Aug 4 14:00:29 2022] DELETE /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments/59086d6f-5184-4367-af6c-34c2aff78662 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:00:30.005821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e2400a4-85c2-495c-8c9d-5750c140b8f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:30.007271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e2400a4-85c2-495c-8c9d-5750c140b8f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:30.024261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e2400a4-85c2-495c-8c9d-5750c140b8f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:30.026651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e2400a4-85c2-495c-8c9d-5750c140b8f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:30.028407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e2400a4-85c2-495c-8c9d-5750c140b8f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:30.033400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e2400a4-85c2-495c-8c9d-5750c140b8f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:30.133064 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-b6a087ca-3ec1-4201-9260-226149f42ca6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] HTTP exception thrown: Invalid port range 677426856:22. Former value cannot be greater than the later Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b6a087ca-3ec1-4201-9260-226149f42ca6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Request method failure captured: Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 145 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Drypj8tm07yrywYUI7r6kyGMio9CasZQsra_VvA5jN1qMoKKZWfldAolbFBZSSkrbCrE3rWmN-FPAJqdr_cSci5fBBA29SLyAyaZFSZAnoUEmCKkE_Qr-f7wlcGsaw411vrex6c1agwIuWZk9Nfiz_-rdOVrvtxNmenuZ4KoBGejA Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}] Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 7275c7bee8fc47beb9c0500b557ed7f6 Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: {"security_group_rule": {"parent_group_id": "4ce51662-412c-4315-9737-0e407bfa5a0b", "ip_protocol": "tcp", "from_port": 677426856, "to_port": 22}} Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid port range 677426856:22. Former value cannot be greater than the later Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4ce51662-412c-4315-9737-0e407bfa5a0b', 'ip_protocol': 'tcp', 'from_port': 677426856, 'to_port': 22}}} Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 677426856:22. Former value cannot be greater than the later Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 677426856:22. Former value cannot be greater than the later Aug 04 14:00:30.136742 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:00:30.149578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:30.149578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:00:30.149578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:30.149578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:30.149578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:30.149578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:30.149578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:30.149578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 677426856:22. Former value cannot be greater than the later Aug 04 14:00:30.149578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:00:30.155991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b6a087ca-3ec1-4201-9260-226149f42ca6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Returning 400 to user: Invalid port range 677426856:22. Former value cannot be greater than the later {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:30.162461 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b6a087ca-3ec1-4201-9260-226149f42ca6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.308570 Aug 04 14:00:30.177382 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 792/1595] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:00:29 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 334 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:00:30.189059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e36b18a1-c42a-459e-91da-f32acc0ae10d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3cd1d30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:30.402746 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e36b18a1-c42a-459e-91da-f32acc0ae10d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.222941 Aug 04 14:00:30.410368 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 793/1596] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:30 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:30.446141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-36a34b42-63e3-4841-983d-b177cac37056 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:30.447751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-36a34b42-63e3-4841-983d-b177cac37056 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:30.466920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36a34b42-63e3-4841-983d-b177cac37056 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:30.467436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36a34b42-63e3-4841-983d-b177cac37056 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:30.469239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36a34b42-63e3-4841-983d-b177cac37056 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:30.469680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36a34b42-63e3-4841-983d-b177cac37056 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:31.169220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-36a34b42-63e3-4841-983d-b177cac37056 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:31.180997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-36a34b42-63e3-4841-983d-b177cac37056 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1574 microversion: 2.1 time: 0.767997 Aug 04 14:00:31.203118 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 794/1597] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:30 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1574 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:31.214572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5e2400a4-85c2-495c-8c9d-5750c140b8f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:31.220230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2270ba51-c425-4e0c-905e-8c80f75ab3a9 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:31.228137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2270ba51-c425-4e0c-905e-8c80f75ab3a9 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:31.248605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2270ba51-c425-4e0c-905e-8c80f75ab3a9 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:31.249466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2270ba51-c425-4e0c-905e-8c80f75ab3a9 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:31.250475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2270ba51-c425-4e0c-905e-8c80f75ab3a9 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:31.251102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2270ba51-c425-4e0c-905e-8c80f75ab3a9 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:31.291138 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e2400a4-85c2-495c-8c9d-5750c140b8f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1308 microversion: 2.1 time: 1.297807 Aug 04 14:00:31.303478 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 804/1598] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:29 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1308 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:31.323059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c591194-1e18-44e9-84a3-e99d564facb6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f47007cdc10>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2083022781", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:31.340241 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-0c591194-1e18-44e9-84a3-e99d564facb6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] HTTP exception thrown: Security group id should be uuid Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c591194-1e18-44e9-84a3-e99d564facb6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Request method failure captured: Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 131 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Drypj8tm07yrywYUI7r6kyGMio9CasZQsra_VvA5jN1qMoKKZWfldAolbFBZSSkrbCrE3rWmN-FPAJqdr_cSci5fBBA29SLyAyaZFSZAnoUEmCKkE_Qr-f7wlcGsaw411vrex6c1agwIuWZk9Nfiz_-rdOVrvtxNmenuZ4KoBGejA Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}] Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7275c7bee8fc47beb9c0500b557ed7f6 Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2083022781", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: exception: Security group id should be uuid Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2083022781', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:31.366676 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:31.378324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 04 14:00:31.378324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:31.378324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c591194-1e18-44e9-84a3-e99d564facb6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Returning 400 to user: Security group id should be uuid {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:31.378324 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c591194-1e18-44e9-84a3-e99d564facb6 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.063283 Aug 04 14:00:31.378324 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 805/1599] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:00:31 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 14:00:31.393981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:31.397153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:31.400044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b229ec68-4661-4397-a642-7f1c2513f686 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:31.400900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b229ec68-4661-4397-a642-7f1c2513f686 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:31.440694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b229ec68-4661-4397-a642-7f1c2513f686 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:31.446289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b229ec68-4661-4397-a642-7f1c2513f686 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:31.448850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b229ec68-4661-4397-a642-7f1c2513f686 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:31.453266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b229ec68-4661-4397-a642-7f1c2513f686 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:31.488260 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2270ba51-c425-4e0c-905e-8c80f75ab3a9 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.275677 Aug 04 14:00:31.490692 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 795/1600] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:00:31 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments => generated 197 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:31.548700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c942609-95cb-4379-ad6d-310c06e6009a tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f46f3cf4c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1669924114", "description": "tempest-description-1434471338"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:32.476038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b229ec68-4661-4397-a642-7f1c2513f686 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:32.531134 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b229ec68-4661-4397-a642-7f1c2513f686 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1311 microversion: 2.1 time: 1.142814 Aug 04 14:00:32.537474 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 806/1601] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:31 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1311 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:32.583586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-200a406d-88f7-4d32-ae85-5ab2e507562a tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4705660700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:32.778228 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-200a406d-88f7-4d32-ae85-5ab2e507562a tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.233469 Aug 04 14:00:32.786632 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 807/1602] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:32 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:32.798551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c851d5c-61f3-4df0-878a-f88f70298a90 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:32.802837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c851d5c-61f3-4df0-878a-f88f70298a90 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:32.821601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c851d5c-61f3-4df0-878a-f88f70298a90 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:32.822907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c851d5c-61f3-4df0-878a-f88f70298a90 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:32.826005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c851d5c-61f3-4df0-878a-f88f70298a90 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:32.828305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c851d5c-61f3-4df0-878a-f88f70298a90 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:33.079894 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c942609-95cb-4379-ad6d-310c06e6009a tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.576226 Aug 04 14:00:33.081743 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 796/1603] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:00:31 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:33.087089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a2e31ff-cf73-4e1b-9498-9077e8098532 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:33.089174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a2e31ff-cf73-4e1b-9498-9077e8098532 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:33.127718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a2e31ff-cf73-4e1b-9498-9077e8098532 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:33.129846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a2e31ff-cf73-4e1b-9498-9077e8098532 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:33.136655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a2e31ff-cf73-4e1b-9498-9077e8098532 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:33.151917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a2e31ff-cf73-4e1b-9498-9077e8098532 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:33.380053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:33.877415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9c851d5c-61f3-4df0-878a-f88f70298a90 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:33.904301 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c851d5c-61f3-4df0-878a-f88f70298a90 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1574 microversion: 2.1 time: 1.102282 Aug 04 14:00:33.911594 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 808/1604] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:32 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1574 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:33.942025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a59b94f-7113-4723-9ab8-8f942319511a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:33.958055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a59b94f-7113-4723-9ab8-8f942319511a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:33.997438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a59b94f-7113-4723-9ab8-8f942319511a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:33.998925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a59b94f-7113-4723-9ab8-8f942319511a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:34.008842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a59b94f-7113-4723-9ab8-8f942319511a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:34.013879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a59b94f-7113-4723-9ab8-8f942319511a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:34.184671 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a59b94f-7113-4723-9ab8-8f942319511a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.267239 Aug 04 14:00:34.194848 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 809/1605] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:00:33 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments => generated 197 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:34.219508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76b85eca-3866-4a78-be95-64273d6cf029 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f4700935ca0>, body: {"security_group_rule": {"parent_group_id": "19a313d9-0285-4865-bd43-ee3b5b7bc3f9", "ip_protocol": "tempest-999-1267980705", "from_port": 22, "to_port": 22}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:34.780754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a2e31ff-cf73-4e1b-9498-9077e8098532 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:34.792890 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a2e31ff-cf73-4e1b-9498-9077e8098532 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1308 microversion: 2.1 time: 1.706167 Aug 04 14:00:34.793923 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 797/1606] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:33 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1308 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:34.808636 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-76b85eca-3866-4a78-be95-64273d6cf029 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] HTTP exception thrown: Invalid IP protocol tempest-999-1267980705. Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76b85eca-3866-4a78-be95-64273d6cf029 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Request method failure captured: Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 157 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Drypj8tm07yrywYUI7r6kyGMio9CasZQsra_VvA5jN1qMoKKZWfldAolbFBZSSkrbCrE3rWmN-FPAJqdr_cSci5fBBA29SLyAyaZFSZAnoUEmCKkE_Qr-f7wlcGsaw411vrex6c1agwIuWZk9Nfiz_-rdOVrvtxNmenuZ4KoBGejA Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}] Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7275c7bee8fc47beb9c0500b557ed7f6 Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: {"security_group_rule": {"parent_group_id": "19a313d9-0285-4865-bd43-ee3b5b7bc3f9", "ip_protocol": "tempest-999-1267980705", "from_port": 22, "to_port": 22}} Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid IP protocol tempest-999-1267980705. Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'security_group_rule': {'parent_group_id': '19a313d9-0285-4865-bd43-ee3b5b7bc3f9', 'ip_protocol': 'tempest-999-1267980705', 'from_port': 22, 'to_port': 22}}} Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1267980705. Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1267980705. Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:34.812181 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:34.816920 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:34.816920 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:34.816920 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:34.816920 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:34.816920 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:34.816920 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:34.816920 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1267980705. Aug 04 14:00:34.816920 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:34.825305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76b85eca-3866-4a78-be95-64273d6cf029 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Returning 400 to user: Invalid IP protocol tempest-999-1267980705. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:34.826635 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76b85eca-3866-4a78-be95-64273d6cf029 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.630387 Aug 04 14:00:34.829009 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 810/1607] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:00:34 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 633 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 14:00:34.840236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61325dce-4850-44ed-83d6-c62a3d8e13a2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4705660f70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:34.844371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-25b5f5dc-f912-405a-9794-87f595145b2c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:34.846009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-25b5f5dc-f912-405a-9794-87f595145b2c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:34.872748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25b5f5dc-f912-405a-9794-87f595145b2c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:34.876286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25b5f5dc-f912-405a-9794-87f595145b2c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:34.880407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25b5f5dc-f912-405a-9794-87f595145b2c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:34.881145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25b5f5dc-f912-405a-9794-87f595145b2c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:34.990971 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61325dce-4850-44ed-83d6-c62a3d8e13a2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.148703 Aug 04 14:00:34.993654 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 811/1608] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:34 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:35.038083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aba75b96-204d-4486-b6c3-bd78ff07e785 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f46f3f5bb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-560749649", "description": "tempest-description-1394160224"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:35.162025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:35.545689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-25b5f5dc-f912-405a-9794-87f595145b2c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:35.560335 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-25b5f5dc-f912-405a-9794-87f595145b2c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1311 microversion: 2.1 time: 0.763292 Aug 04 14:00:35.579258 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 798/1609] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:34 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1311 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:35.593712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-57c980b9-5939-4e2f-a141-68ebc6b9ce80 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:35.594352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-57c980b9-5939-4e2f-a141-68ebc6b9ce80 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:35.613877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57c980b9-5939-4e2f-a141-68ebc6b9ce80 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:35.614302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57c980b9-5939-4e2f-a141-68ebc6b9ce80 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:35.619266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57c980b9-5939-4e2f-a141-68ebc6b9ce80 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:35.621296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57c980b9-5939-4e2f-a141-68ebc6b9ce80 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:35.984114 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aba75b96-204d-4486-b6c3-bd78ff07e785 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.987091 Aug 04 14:00:35.985745 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 812/1610] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:00:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:36.002406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-56014043-d806-4434-8cfe-57d07fc83d24 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:36.019409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-56014043-d806-4434-8cfe-57d07fc83d24 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:36.054476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56014043-d806-4434-8cfe-57d07fc83d24 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:36.055854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56014043-d806-4434-8cfe-57d07fc83d24 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:36.059650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56014043-d806-4434-8cfe-57d07fc83d24 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:36.060698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56014043-d806-4434-8cfe-57d07fc83d24 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:36.149569 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-56014043-d806-4434-8cfe-57d07fc83d24 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.162097 Aug 04 14:00:36.160156 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 813/1611] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:00:35 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:36.172517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-13e4d80d-f810-42c1-9539-9988b6b3c421 req-f5def556-02c9-4fd2-b5e1-ab6aa4a8c56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ebe867-4b9d-485d-8966-8f8ba3004e79", "name": "network-vif-plugged", "status": "completed", "tag": "146e5ef7-a016-4406-86bd-d67bec04de40"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:36.196918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-13e4d80d-f810-42c1-9539-9988b6b3c421 req-f5def556-02c9-4fd2-b5e1-ab6aa4a8c56f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:36.197439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-13e4d80d-f810-42c1-9539-9988b6b3c421 req-f5def556-02c9-4fd2-b5e1-ab6aa4a8c56f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:36.231942 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-13e4d80d-f810-42c1-9539-9988b6b3c421 req-f5def556-02c9-4fd2-b5e1-ab6aa4a8c56f service nova] Creating event network-vif-plugged:146e5ef7-a016-4406-86bd-d67bec04de40 for instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 on n-h1-844627-10 Aug 04 14:00:36.239994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-57c980b9-5939-4e2f-a141-68ebc6b9ce80 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:36.257928 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-57c980b9-5939-4e2f-a141-68ebc6b9ce80 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1574 microversion: 2.1 time: 0.670172 Aug 04 14:00:36.258898 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 799/1612] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:35 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1574 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:36.270437 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-13e4d80d-f810-42c1-9539-9988b6b3c421 req-f5def556-02c9-4fd2-b5e1-ab6aa4a8c56f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103159 Aug 04 14:00:36.273943 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 814/1613] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:36.281029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81602305-5af8-4411-8d12-17dbac845b6b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:36.282037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81602305-5af8-4411-8d12-17dbac845b6b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:36.302705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ffa8b1d-cb09-4580-b5f7-101e6c3edf3e tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f46f3f51820>, body: {"security_group_rule": {"parent_group_id": "b8b03da5-bc1b-41ff-bea2-cf2ae4f85c9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:36.307961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81602305-5af8-4411-8d12-17dbac845b6b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:36.308798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81602305-5af8-4411-8d12-17dbac845b6b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:36.322960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81602305-5af8-4411-8d12-17dbac845b6b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:36.325236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81602305-5af8-4411-8d12-17dbac845b6b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:36.598994 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8ffa8b1d-cb09-4580-b5f7-101e6c3edf3e tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ffa8b1d-cb09-4580-b5f7-101e6c3edf3e tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Request method failure captured: Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 138 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Drypj8tm07yrywYUI7r6kyGMio9CasZQsra_VvA5jN1qMoKKZWfldAolbFBZSSkrbCrE3rWmN-FPAJqdr_cSci5fBBA29SLyAyaZFSZAnoUEmCKkE_Qr-f7wlcGsaw411vrex6c1agwIuWZk9Nfiz_-rdOVrvtxNmenuZ4KoBGejA Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}] Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7275c7bee8fc47beb9c0500b557ed7f6 Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: {"security_group_rule": {"parent_group_id": "b8b03da5-bc1b-41ff-bea2-cf2ae4f85c9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b8b03da5-bc1b-41ff-bea2-cf2ae4f85c9d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 14:00:36.601480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ffa8b1d-cb09-4580-b5f7-101e6c3edf3e tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:36.605980 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ffa8b1d-cb09-4580-b5f7-101e6c3edf3e tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.327787 Aug 04 14:00:36.610605 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 815/1614] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:00:36 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 336 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:00:36.617777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-891785aa-7b92-404f-be25-570c85bd16da tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4705687940>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:36.823593 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-891785aa-7b92-404f-be25-570c85bd16da tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.204409 Aug 04 14:00:36.836237 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 816/1615] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:36 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:36.871916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-15adeab9-b80b-4351-bdaf-d3fd5e507086 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:36.886705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-15adeab9-b80b-4351-bdaf-d3fd5e507086 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:36.907843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15adeab9-b80b-4351-bdaf-d3fd5e507086 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:36.908650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15adeab9-b80b-4351-bdaf-d3fd5e507086 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:36.910315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15adeab9-b80b-4351-bdaf-d3fd5e507086 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:36.911113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15adeab9-b80b-4351-bdaf-d3fd5e507086 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:37.023171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-81602305-5af8-4411-8d12-17dbac845b6b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:37.041252 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81602305-5af8-4411-8d12-17dbac845b6b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1308 microversion: 2.1 time: 0.780606 Aug 04 14:00:37.047142 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 800/1616] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:36 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1308 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:37.073799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab339d1b-7815-454e-8da3-be2200c67198 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f47002e74c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1536479803", "description": "tempest-description-1244566499"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:37.435557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-15adeab9-b80b-4351-bdaf-d3fd5e507086 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:37.452444 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-15adeab9-b80b-4351-bdaf-d3fd5e507086 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1311 microversion: 2.1 time: 0.613648 Aug 04 14:00:37.457960 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 817/1617] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:36 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1311 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:37.481733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3b71b54-9230-4ed6-b4a3-0f1c5ed1949e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:37.485789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a3b71b54-9230-4ed6-b4a3-0f1c5ed1949e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:37.524614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=42 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:37.530680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3b71b54-9230-4ed6-b4a3-0f1c5ed1949e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:37.533639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3b71b54-9230-4ed6-b4a3-0f1c5ed1949e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:37.535054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3b71b54-9230-4ed6-b4a3-0f1c5ed1949e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:37.546502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3b71b54-9230-4ed6-b4a3-0f1c5ed1949e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:37.634355 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3b71b54-9230-4ed6-b4a3-0f1c5ed1949e tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.172395 Aug 04 14:00:37.644175 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 818/1618] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:00:37 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:37.655143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dc06edcb-92e8-4b92-8181-3c44cdf1643f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:37.665122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dc06edcb-92e8-4b92-8181-3c44cdf1643f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:37.692176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc06edcb-92e8-4b92-8181-3c44cdf1643f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:37.692805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc06edcb-92e8-4b92-8181-3c44cdf1643f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:37.693811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc06edcb-92e8-4b92-8181-3c44cdf1643f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:37.702256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc06edcb-92e8-4b92-8181-3c44cdf1643f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:39.162458 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab339d1b-7815-454e-8da3-be2200c67198 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.113744 Aug 04 14:00:39.163926 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 801/1619] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:00:37 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:39.186260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7dbaddcf-5eed-4147-bbd1-43920e2717f8 req-307e0e1c-d014-4403-adf4-e75e17333f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc80476-6b5a-4dd1-922d-cce84e21d111", "tag": "5e940ed8-002c-484c-96fa-0461c38ab548"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:39.283177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7dbaddcf-5eed-4147-bbd1-43920e2717f8 req-307e0e1c-d014-4403-adf4-e75e17333f28 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:39.286808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7dbaddcf-5eed-4147-bbd1-43920e2717f8 req-307e0e1c-d014-4403-adf4-e75e17333f28 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:39.374388 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7dbaddcf-5eed-4147-bbd1-43920e2717f8 req-307e0e1c-d014-4403-adf4-e75e17333f28 service nova] Creating event network-changed:5e940ed8-002c-484c-96fa-0461c38ab548 for instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 on n-h2-844627-10 Aug 04 14:00:39.388144 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7dbaddcf-5eed-4147-bbd1-43920e2717f8 req-307e0e1c-d014-4403-adf4-e75e17333f28 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222140 Aug 04 14:00:39.391059 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 802/1620] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:39.397659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c3c8b8f1-eb94-49a2-bef7-373b6647472b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3cd88b0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:39.448299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dc06edcb-92e8-4b92-8181-3c44cdf1643f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:39.467631 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dc06edcb-92e8-4b92-8181-3c44cdf1643f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1572 microversion: 2.1 time: 1.818498 Aug 04 14:00:39.471687 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 819/1621] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:37 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1572 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:39.488095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dcba145f-5da9-4dfd-8b57-51463f277dab tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:39.490219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dcba145f-5da9-4dfd-8b57-51463f277dab tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:39.507284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcba145f-5da9-4dfd-8b57-51463f277dab tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:39.508426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcba145f-5da9-4dfd-8b57-51463f277dab tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:39.509740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcba145f-5da9-4dfd-8b57-51463f277dab tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:39.510741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcba145f-5da9-4dfd-8b57-51463f277dab tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:39.527013 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c3c8b8f1-eb94-49a2-bef7-373b6647472b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.133958 Aug 04 14:00:39.531587 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 803/1622] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:39 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:39.876403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dcba145f-5da9-4dfd-8b57-51463f277dab tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:39.888174 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dcba145f-5da9-4dfd-8b57-51463f277dab tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1488 microversion: 2.1 time: 0.412142 Aug 04 14:00:39.888777 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 820/1623] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:39 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1488 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:39.902009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9e074cb-d6aa-48d3-9a3b-7ee87553a2bf tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:39.903298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f9e074cb-d6aa-48d3-9a3b-7ee87553a2bf tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:39.916333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9e074cb-d6aa-48d3-9a3b-7ee87553a2bf tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:39.917163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9e074cb-d6aa-48d3-9a3b-7ee87553a2bf tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:39.919569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9e074cb-d6aa-48d3-9a3b-7ee87553a2bf tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:39.921182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9e074cb-d6aa-48d3-9a3b-7ee87553a2bf tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:39.983113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1021283612", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:40.188298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f9e074cb-d6aa-48d3-9a3b-7ee87553a2bf tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:40.201987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:40.209434 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f9e074cb-d6aa-48d3-9a3b-7ee87553a2bf tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1311 microversion: 2.1 time: 0.313783 Aug 04 14:00:40.212861 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 821/1624] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:39 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:40.253372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6386de50-25cf-42ad-bf72-86f85852a85d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:40.257648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6386de50-25cf-42ad-bf72-86f85852a85d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:40.272203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:00:40.280438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6386de50-25cf-42ad-bf72-86f85852a85d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:40.298777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6386de50-25cf-42ad-bf72-86f85852a85d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:40.301840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6386de50-25cf-42ad-bf72-86f85852a85d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:40.306608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6386de50-25cf-42ad-bf72-86f85852a85d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:40.446618 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6386de50-25cf-42ad-bf72-86f85852a85d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.231366 Aug 04 14:00:40.448819 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 822/1625] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:00:40 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:00:40.473854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8aef6338-e2ab-4019-8040-d449054dfe18 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f46f3fb1160>, body: {"security_group_rule": {"parent_group_id": "35cd8542-0e5d-4094-ad39-f8b38ce5f2a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 1636918862}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:40.915762 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8aef6338-e2ab-4019-8040-d449054dfe18 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] HTTP exception thrown: Invalid port range 22:1636918862. Valid TCP ports should be between 1-65535 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8aef6338-e2ab-4019-8040-d449054dfe18 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Request method failure captured: Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 146 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Drypj8tm07yrywYUI7r6kyGMio9CasZQsra_VvA5jN1qMoKKZWfldAolbFBZSSkrbCrE3rWmN-FPAJqdr_cSci5fBBA29SLyAyaZFSZAnoUEmCKkE_Qr-f7wlcGsaw411vrex6c1agwIuWZk9Nfiz_-rdOVrvtxNmenuZ4KoBGejA Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}] Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7275c7bee8fc47beb9c0500b557ed7f6 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: {"security_group_rule": {"parent_group_id": "35cd8542-0e5d-4094-ad39-f8b38ce5f2a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 1636918862}} Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid port range 22:1636918862. Valid TCP ports should be between 1-65535 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'security_group_rule': {'parent_group_id': '35cd8542-0e5d-4094-ad39-f8b38ce5f2a1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1636918862}}} Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1636918862. Valid TCP ports should be between 1-65535 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1636918862. Valid TCP ports should be between 1-65535 Aug 04 14:00:40.918888 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:40.923860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:40.923860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:40.923860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:40.923860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:40.923860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:40.923860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:40.923860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:40.923860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1636918862. Valid TCP ports should be between 1-65535 Aug 04 14:00:40.923860 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:40.925514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8aef6338-e2ab-4019-8040-d449054dfe18 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Returning 400 to user: Invalid port range 22:1636918862. Valid TCP ports should be between 1-65535 {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:40.932728 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8aef6338-e2ab-4019-8040-d449054dfe18 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.477348 Aug 04 14:00:40.949480 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 823/1626] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:00:40 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 499 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:00:40.958854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ce9e0ec3-5203-4f9c-8666-2caafbfe3261 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1482059320"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:40.970178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ce9e0ec3-5203-4f9c-8666-2caafbfe3261 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:40.996615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce9e0ec3-5203-4f9c-8666-2caafbfe3261 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:40.997412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce9e0ec3-5203-4f9c-8666-2caafbfe3261 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:40.999597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce9e0ec3-5203-4f9c-8666-2caafbfe3261 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:41.010134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce9e0ec3-5203-4f9c-8666-2caafbfe3261 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:41.343821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:00:41.344418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:00:41.344786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:00:41.345240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:00:41.345664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:00:41.369852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:41.370322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:41.371320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:41.376073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:41.418315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:00:41.430076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:00:41.453690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:00:41.459971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:00:41.493693 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.network.security_group_api [None req-ce9e0ec3-5203-4f9c-8666-2caafbfe3261 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Adding security group dfa8b08e-4986-4def-aeec-a3d19b28da55 to port 6c34e394-956e-49e5-ab8f-27259b03d8a3 Aug 04 14:00:41.506087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:UPDATE=14 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:41.568747 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b8222389-f17c-4af3-964b-6b1525391511 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.035871 Aug 04 14:00:41.574627 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 804/1627] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:00:41.603022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d3a53b2b-863c-4bae-ac52-aa1d06194072 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:41.603883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d3a53b2b-863c-4bae-ac52-aa1d06194072 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:41.645921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3a53b2b-863c-4bae-ac52-aa1d06194072 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:41.647509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3a53b2b-863c-4bae-ac52-aa1d06194072 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:41.649255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3a53b2b-863c-4bae-ac52-aa1d06194072 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:41.650314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3a53b2b-863c-4bae-ac52-aa1d06194072 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:41.969819 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d3a53b2b-863c-4bae-ac52-aa1d06194072 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79/action" status: 202 len: 0 microversion: 2.1 time: 0.389413 Aug 04 14:00:41.988591 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 805/1628] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:00:41 2022] POST /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:42.040287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-44783827-218c-4dda-a2b8-2fb749e7cc7d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3cd1e50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:42.141162 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-44783827-218c-4dda-a2b8-2fb749e7cc7d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.146655 Aug 04 14:00:42.142101 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 806/1629] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:41 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:42.165099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-791945182", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "0175b1e9-d188-4380-bfdc-642cf47ea0f5"}, {"uuid": "d9481d3a-7c94-4035-8ab3-5ee5afe732aa"}, {"uuid": "0175b1e9-d188-4380-bfdc-642cf47ea0f5"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:42.353700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] validate_networks() for [('0175b1e9-d188-4380-bfdc-642cf47ea0f5', None, None, None, None, None), ('d9481d3a-7c94-4035-8ab3-5ee5afe732aa', None, None, None, None, None), ('0175b1e9-d188-4380-bfdc-642cf47ea0f5', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:00:42.703896 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ce9e0ec3-5203-4f9c-8666-2caafbfe3261 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38/action" status: 202 len: 0 microversion: 2.1 time: 1.752319 Aug 04 14:00:42.711160 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 824/1630] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:00:40 2022] POST /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38/action => generated 0 bytes in 1761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:42.731782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a1c2a01-6a41-4ad1-873b-bc9b05c8d2a9 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Action: 'create', calling method: .version_select at 0x7f46f3f4fc10>, body: {"security_group_rule": {"parent_group_id": "2c1ce627-744d-47ce-a077-f173f4149424", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:42.828234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-2a1c2a01-6a41-4ad1-873b-bc9b05c8d2a9 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2c1ce627-744d-47ce-a077-f173f4149424 does not exist", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:00:42.829301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.security_group_api [None req-2a1c2a01-6a41-4ad1-873b-bc9b05c8d2a9 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Neutron security group 2c1ce627-744d-47ce-a077-f173f4149424 not found {{(pid=130961) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:00:42.830382 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2a1c2a01-6a41-4ad1-873b-bc9b05c8d2a9 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] HTTP exception thrown: Security group 2c1ce627-744d-47ce-a077-f173f4149424 does not exist Aug 04 14:00:42.830382 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-5db3cf9e-12ee-411e-9df8-f1ab9467cc68'] Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a1c2a01-6a41-4ad1-873b-bc9b05c8d2a9 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Request method failure captured: Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 138 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Drypj8tm07yrywYUI7r6kyGMio9CasZQsra_VvA5jN1qMoKKZWfldAolbFBZSSkrbCrE3rWmN-FPAJqdr_cSci5fBBA29SLyAyaZFSZAnoUEmCKkE_Qr-f7wlcGsaw411vrex6c1agwIuWZk9Nfiz_-rdOVrvtxNmenuZ4KoBGejA Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}] Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7275c7bee8fc47beb9c0500b557ed7f6 Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: {"security_group_rule": {"parent_group_id": "2c1ce627-744d-47ce-a077-f173f4149424", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: exception: Security group 2c1ce627-744d-47ce-a077-f173f4149424 does not exist Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-5db3cf9e-12ee-411e-9df8-f1ab9467cc68'] Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2c1ce627-744d-47ce-a077-f173f4149424', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:00:42.835183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2c1ce627-744d-47ce-a077-f173f4149424 does not exist Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5db3cf9e-12ee-411e-9df8-f1ab9467cc68'] Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2c1ce627-744d-47ce-a077-f173f4149424 does not exist Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5db3cf9e-12ee-411e-9df8-f1ab9467cc68'] Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2c1ce627-744d-47ce-a077-f173f4149424 does not exist Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5db3cf9e-12ee-411e-9df8-f1ab9467cc68'] Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2c1ce627-744d-47ce-a077-f173f4149424 does not exist Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5db3cf9e-12ee-411e-9df8-f1ab9467cc68'] Aug 04 14:00:42.839837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:42.847775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a1c2a01-6a41-4ad1-873b-bc9b05c8d2a9 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Returning 404 to user: Security group 2c1ce627-744d-47ce-a077-f173f4149424 does not exist Aug 04 14:00:42.847775 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-5db3cf9e-12ee-411e-9df8-f1ab9467cc68'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:42.849391 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a1c2a01-6a41-4ad1-873b-bc9b05c8d2a9 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.136216 Aug 04 14:00:42.860057 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 825/1631] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:00:42 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:00:42.880811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-143221eb-fedb-4006-98b6-964e72f68320 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:42.913474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-143221eb-fedb-4006-98b6-964e72f68320 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:42.929501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-143221eb-fedb-4006-98b6-964e72f68320 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:42.930758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-143221eb-fedb-4006-98b6-964e72f68320 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:42.932977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-143221eb-fedb-4006-98b6-964e72f68320 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:42.965525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-143221eb-fedb-4006-98b6-964e72f68320 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:43.514501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-143221eb-fedb-4006-98b6-964e72f68320 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:43.524932 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-143221eb-fedb-4006-98b6-964e72f68320 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1311 microversion: 2.1 time: 0.661820 Aug 04 14:00:43.537512 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 826/1632] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:42 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1311 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:43.546848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf197377-f918-4e05-87dd-f0bdfde57bfe tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:43.550157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf197377-f918-4e05-87dd-f0bdfde57bfe tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:43.557921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf197377-f918-4e05-87dd-f0bdfde57bfe tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:43.558987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf197377-f918-4e05-87dd-f0bdfde57bfe tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:43.560203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf197377-f918-4e05-87dd-f0bdfde57bfe tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:43.561616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf197377-f918-4e05-87dd-f0bdfde57bfe tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:43.640378 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf197377-f918-4e05-87dd-f0bdfde57bfe tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.100707 Aug 04 14:00:43.643134 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 827/1633] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:00:43 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:43.658311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb865d0d-aa40-469c-a4e4-fc5c620b5449 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:43.659963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb865d0d-aa40-469c-a4e4-fc5c620b5449 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:43.671576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb865d0d-aa40-469c-a4e4-fc5c620b5449 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:43.672708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb865d0d-aa40-469c-a4e4-fc5c620b5449 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:43.674250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb865d0d-aa40-469c-a4e4-fc5c620b5449 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:43.675264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb865d0d-aa40-469c-a4e4-fc5c620b5449 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:43.841880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cb865d0d-aa40-469c-a4e4-fc5c620b5449 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:43.874573 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb865d0d-aa40-469c-a4e4-fc5c620b5449 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1269 microversion: 2.1 time: 0.227720 Aug 04 14:00:43.912927 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 828/1634] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:43 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1269 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:43.913286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a4d0cf9-9dc9-47e5-82b3-a9bf06f80ade tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:43.941552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a4d0cf9-9dc9-47e5-82b3-a9bf06f80ade tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:43.961958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a4d0cf9-9dc9-47e5-82b3-a9bf06f80ade tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:43.962537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a4d0cf9-9dc9-47e5-82b3-a9bf06f80ade tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:43.963595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a4d0cf9-9dc9-47e5-82b3-a9bf06f80ade tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:43.964271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a4d0cf9-9dc9-47e5-82b3-a9bf06f80ade tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:44.361859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7a4d0cf9-9dc9-47e5-82b3-a9bf06f80ade tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:44.371745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a4d0cf9-9dc9-47e5-82b3-a9bf06f80ade tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 200 len: 1473 microversion: 2.1 time: 0.464501 Aug 04 14:00:44.389418 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 829/1635] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:43 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 1473 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:44.412248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76b045ea-54ac-4706-9412-218cc6b04eef tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f47005385e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:45.340234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:00:45.341112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:00:45.341723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:00:45.342763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:00:45.343182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:00:45.398562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:45.399374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:45.400972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:45.401763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:45.415236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-76b045ea-54ac-4706-9412-218cc6b04eef tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group dfa8b08e-4986-4def-aeec-a3d19b28da55 in use.", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:00:45.417519 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-76b045ea-54ac-4706-9412-218cc6b04eef tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security Group dfa8b08e-4986-4def-aeec-a3d19b28da55 in use. Aug 04 14:00:45.417519 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-962003b4-9fa1-4a3c-892b-8e71607525f1'] Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76b045ea-54ac-4706-9412-218cc6b04eef tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-security-groups/dfa8b08e-4986-4def-aeec-a3d19b28da55 HTTP/1.1 Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: exception: Security Group dfa8b08e-4986-4def-aeec-a3d19b28da55 in use. Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-962003b4-9fa1-4a3c-892b-8e71607525f1'] Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dfa8b08e-4986-4def-aeec-a3d19b28da55'} Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:00:45.421924 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group dfa8b08e-4986-4def-aeec-a3d19b28da55 in use. Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-962003b4-9fa1-4a3c-892b-8e71607525f1'] Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group dfa8b08e-4986-4def-aeec-a3d19b28da55 in use. Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-962003b4-9fa1-4a3c-892b-8e71607525f1'] Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group dfa8b08e-4986-4def-aeec-a3d19b28da55 in use. Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-962003b4-9fa1-4a3c-892b-8e71607525f1'] Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group dfa8b08e-4986-4def-aeec-a3d19b28da55 in use. Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-962003b4-9fa1-4a3c-892b-8e71607525f1'] Aug 04 14:00:45.429904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.443212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76b045ea-54ac-4706-9412-218cc6b04eef tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 400 to user: Security Group dfa8b08e-4986-4def-aeec-a3d19b28da55 in use. Aug 04 14:00:45.443212 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-962003b4-9fa1-4a3c-892b-8e71607525f1'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:45.446854 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76b045ea-54ac-4706-9412-218cc6b04eef tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/dfa8b08e-4986-4def-aeec-a3d19b28da55" status: 400 len: 185 microversion: 2.1 time: 1.055608 Aug 04 14:00:45.452383 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 830/1636] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:00:44 2022] DELETE /compute/v2.1/os-security-groups/dfa8b08e-4986-4def-aeec-a3d19b28da55 => generated 185 bytes in 1061 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:00:45.466658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f8dc2f3c-1d44-437c-bf2b-258166049fb2 req-d1de39ba-0d8b-4c8b-8f4c-2cfd7e56021b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "211b9e89-0c4b-45f2-8324-77aee2accf38", "tag": "6c34e394-956e-49e5-ab8f-27259b03d8a3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:45.493750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f8dc2f3c-1d44-437c-bf2b-258166049fb2 req-d1de39ba-0d8b-4c8b-8f4c-2cfd7e56021b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:45.494731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f8dc2f3c-1d44-437c-bf2b-258166049fb2 req-d1de39ba-0d8b-4c8b-8f4c-2cfd7e56021b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:45.513263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f8dc2f3c-1d44-437c-bf2b-258166049fb2 req-d1de39ba-0d8b-4c8b-8f4c-2cfd7e56021b service nova] Creating event network-changed:6c34e394-956e-49e5-ab8f-27259b03d8a3 for instance 211b9e89-0c4b-45f2-8324-77aee2accf38 on n-h2-844627-10 Aug 04 14:00:45.535128 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f8dc2f3c-1d44-437c-bf2b-258166049fb2 req-d1de39ba-0d8b-4c8b-8f4c-2cfd7e56021b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079594 Aug 04 14:00:45.538564 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 831/1637] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:45.559731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f756963-b30f-497e-85a8-5387e7612d45 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Calling method '.version_select at 0x7f4700865a60>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:45.609947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Getting quotas for project 4a247be28b5c4f73be8526e19b9a0b91. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:00:45.636823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-1f756963-b30f-497e-85a8-5387e7612d45 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 does not exist", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:00:45.637513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.security_group_api [None req-1f756963-b30f-497e-85a8-5387e7612d45 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Neutron security group rule dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 not found {{(pid=130961) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 04 14:00:45.638247 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1f756963-b30f-497e-85a8-5387e7612d45 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] HTTP exception thrown: Security group rule dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 does not exist Aug 04 14:00:45.638247 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-62daa88d-cdb9-41f6-8cd1-e514b065c506'] Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f756963-b30f-497e-85a8-5387e7612d45 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Request method failure captured: Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-security-group-rules/dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 HTTP/1.1 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Drypj8tm07yrywYUI7r6kyGMio9CasZQsra_VvA5jN1qMoKKZWfldAolbFBZSSkrbCrE3rWmN-FPAJqdr_cSci5fBBA29SLyAyaZFSZAnoUEmCKkE_Qr-f7wlcGsaw411vrex6c1agwIuWZk9Nfiz_-rdOVrvtxNmenuZ4KoBGejA Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34c51ee2f74a427cb52c9e9e9d17d813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34c51ee2f74a427cb52c9e9e9d17d813"}]}] Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 34c51ee2f74a427cb52c9e9e9d17d813 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 7275c7bee8fc47beb9c0500b557ed7f6 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-947776257-project Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: exception: Security group rule dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 does not exist Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-62daa88d-cdb9-41f6-8cd1-e514b065c506'] Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17'} Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:00:45.642016 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 does not exist Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62daa88d-cdb9-41f6-8cd1-e514b065c506'] Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 does not exist Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62daa88d-cdb9-41f6-8cd1-e514b065c506'] Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 does not exist Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62daa88d-cdb9-41f6-8cd1-e514b065c506'] Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 does not exist Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62daa88d-cdb9-41f6-8cd1-e514b065c506'] Aug 04 14:00:45.647410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:45.657005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f756963-b30f-497e-85a8-5387e7612d45 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Returning 404 to user: Security group rule dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 does not exist Aug 04 14:00:45.657005 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-62daa88d-cdb9-41f6-8cd1-e514b065c506'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:45.657005 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f756963-b30f-497e-85a8-5387e7612d45 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-group-rules/dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17" status: 404 len: 199 microversion: 2.1 time: 0.109204 Aug 04 14:00:45.657005 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 832/1638] 10.222.0.66 () {58 vars in 1287 bytes} [Thu Aug 4 14:00:45 2022] DELETE /compute/v2.1/os-security-group-rules/dc10f6e9-c6e6-4d4b-9782-ddf2567d1d17 => generated 199 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:00:45.658013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Getting quotas for user f0f7db7c684842e998aaf40a738ee665 and project 4a247be28b5c4f73be8526e19b9a0b91. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:00:45.685256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-865d195f-94b9-4864-8276-439223c1d94a tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002e20d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:45.722661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:00:45.731162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:00:45.861266 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-865d195f-94b9-4864-8276-439223c1d94a tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1453 microversion: 2.1 time: 0.197082 Aug 04 14:00:45.867732 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 833/1639] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:45 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1453 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:45.912746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-879c8336-0d5a-4320-b8f2-1ce9de297ec0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2105518077"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:45.914308 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-32f9eeb6-df9d-4ff7-a776-ea212ea70159 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.752017 Aug 04 14:00:45.923701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-879c8336-0d5a-4320-b8f2-1ce9de297ec0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:45.924613 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 807/1640] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:00:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:00:45.933079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a035f525-fc0f-44fd-b571-46b61ade3ea0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:45.938633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a035f525-fc0f-44fd-b571-46b61ade3ea0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:45.962063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-879c8336-0d5a-4320-b8f2-1ce9de297ec0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:45.962556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-879c8336-0d5a-4320-b8f2-1ce9de297ec0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:45.964006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-879c8336-0d5a-4320-b8f2-1ce9de297ec0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:45.964469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-879c8336-0d5a-4320-b8f2-1ce9de297ec0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:45.968133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a035f525-fc0f-44fd-b571-46b61ade3ea0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:45.968673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a035f525-fc0f-44fd-b571-46b61ade3ea0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:45.969873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a035f525-fc0f-44fd-b571-46b61ade3ea0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:45.970760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a035f525-fc0f-44fd-b571-46b61ade3ea0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:46.282126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a035f525-fc0f-44fd-b571-46b61ade3ea0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:46.315957 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a035f525-fc0f-44fd-b571-46b61ade3ea0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1311 microversion: 2.1 time: 0.386310 Aug 04 14:00:46.316644 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 808/1641] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:45 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1311 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:46.332472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c600aae-a414-42e0-9b4a-4a3a7bd60d61 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:46.334819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c600aae-a414-42e0-9b4a-4a3a7bd60d61 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:46.357018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c600aae-a414-42e0-9b4a-4a3a7bd60d61 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:46.358907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c600aae-a414-42e0-9b4a-4a3a7bd60d61 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:46.362121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c600aae-a414-42e0-9b4a-4a3a7bd60d61 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:46.365965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c600aae-a414-42e0-9b4a-4a3a7bd60d61 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:46.525365 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-879c8336-0d5a-4320-b8f2-1ce9de297ec0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79/action" status: 202 len: 0 microversion: 2.1 time: 0.651294 Aug 04 14:00:46.571238 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 834/1642] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:00:45 2022] POST /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79/action => generated 0 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:00:46.599945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfe604e0-a07e-42c4-a44d-e95b709916bc tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:46.609101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cfe604e0-a07e-42c4-a44d-e95b709916bc tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:46.630572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfe604e0-a07e-42c4-a44d-e95b709916bc tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:46.638346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfe604e0-a07e-42c4-a44d-e95b709916bc tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:46.640555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfe604e0-a07e-42c4-a44d-e95b709916bc tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:46.644094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfe604e0-a07e-42c4-a44d-e95b709916bc tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:46.744933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cfe604e0-a07e-42c4-a44d-e95b709916bc tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:00:47.059495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c600aae-a414-42e0-9b4a-4a3a7bd60d61 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:47.144001 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c600aae-a414-42e0-9b4a-4a3a7bd60d61 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1317 microversion: 2.1 time: 0.825900 Aug 04 14:00:47.145805 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 809/1643] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:46 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1317 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:47.163556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d78f8516-c281-4324-a6af-77cb8f78e9a9 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Calling method '.version_select at 0x7f46f3cc7e50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:47.355085 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cfe604e0-a07e-42c4-a44d-e95b709916bc tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 204 len: 0 microversion: 2.1 time: 0.772490 Aug 04 14:00:47.358330 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 835/1644] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:00:46 2022] DELETE /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:00:47.393201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3483ccdf-2ace-4eb9-8c3d-e671e90dc65a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:47.397202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3483ccdf-2ace-4eb9-8c3d-e671e90dc65a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:47.728059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3483ccdf-2ace-4eb9-8c3d-e671e90dc65a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:47.752547 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3483ccdf-2ace-4eb9-8c3d-e671e90dc65a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1212 microversion: 2.1 time: 0.385633 Aug 04 14:00:47.776196 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 836/1645] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:47 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1212 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:47.798672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7cd366a4-0467-4cc1-8a62-d3344e6ada81 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f4705660940>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:48.144408 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d78f8516-c281-4324-a6af-77cb8f78e9a9 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/35cd8542-0e5d-4094-ad39-f8b38ce5f2a1" status: 202 len: 0 microversion: 2.1 time: 0.996173 Aug 04 14:00:48.150583 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 810/1646] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:00:47 2022] DELETE /compute/v2.1/os-security-groups/35cd8542-0e5d-4094-ad39-f8b38ce5f2a1 => generated 0 bytes in 1004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:48.166243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4c6ae6d3-f215-4f49-8690-f9ee4cae0224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3cd8040>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:50.086297 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7cd366a4-0467-4cc1-8a62-d3344e6ada81 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1412 microversion: 2.1 time: 2.289903 Aug 04 14:00:50.086297 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 837/1647] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:47 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1412 bytes in 2294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:50.087105 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4c6ae6d3-f215-4f49-8690-f9ee4cae0224 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1462 microversion: 2.1 time: 1.921250 Aug 04 14:00:50.087105 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 811/1648] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:48 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1462 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:50.087903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da6495ca-b6ed-48d3-a96c-a4f88cd40efb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:50.087903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-da6495ca-b6ed-48d3-a96c-a4f88cd40efb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:50.100041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da6495ca-b6ed-48d3-a96c-a4f88cd40efb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:50.100241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da6495ca-b6ed-48d3-a96c-a4f88cd40efb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:50.101036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da6495ca-b6ed-48d3-a96c-a4f88cd40efb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:50.101490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da6495ca-b6ed-48d3-a96c-a4f88cd40efb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:50.106501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc34d70f-4041-44f1-b6cb-6ccbeb008041 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:50.106501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc34d70f-4041-44f1-b6cb-6ccbeb008041 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:50.142177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc34d70f-4041-44f1-b6cb-6ccbeb008041 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:50.145317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc34d70f-4041-44f1-b6cb-6ccbeb008041 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:50.150285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc34d70f-4041-44f1-b6cb-6ccbeb008041 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:50.160589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc34d70f-4041-44f1-b6cb-6ccbeb008041 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:50.628733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-da6495ca-b6ed-48d3-a96c-a4f88cd40efb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:50.651192 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-da6495ca-b6ed-48d3-a96c-a4f88cd40efb tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1647 microversion: 2.1 time: 0.578505 Aug 04 14:00:50.667179 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 838/1649] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:50 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1647 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:50.694008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e15fd8be-764d-4fa2-bf84-3e1f7797fd7e tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Calling method '.version_select at 0x7f46f3f51dc0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:50.714806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc34d70f-4041-44f1-b6cb-6ccbeb008041 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:50.739416 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc34d70f-4041-44f1-b6cb-6ccbeb008041 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1311 microversion: 2.1 time: 0.655335 Aug 04 14:00:50.745258 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 812/1650] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:50 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1311 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:50.771213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3c33244-3129-49b5-876b-852b6065137d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:50.772180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3c33244-3129-49b5-876b-852b6065137d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:50.783712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3c33244-3129-49b5-876b-852b6065137d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:50.785589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3c33244-3129-49b5-876b-852b6065137d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:50.786906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3c33244-3129-49b5-876b-852b6065137d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:50.787713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3c33244-3129-49b5-876b-852b6065137d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:51.123668 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e15fd8be-764d-4fa2-bf84-3e1f7797fd7e tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/b8b03da5-bc1b-41ff-bea2-cf2ae4f85c9d" status: 202 len: 0 microversion: 2.1 time: 0.454663 Aug 04 14:00:51.124669 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 839/1651] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:00:50 2022] DELETE /compute/v2.1/os-security-groups/b8b03da5-bc1b-41ff-bea2-cf2ae4f85c9d => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:51.130115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-68d38f87-00af-4105-857e-e58a4e24f51b req-a30c4e35-f4d4-44d2-92f6-02abd411af5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc80476-6b5a-4dd1-922d-cce84e21d111", "name": "network-vif-plugged", "status": "completed", "tag": "5e940ed8-002c-484c-96fa-0461c38ab548"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:51.152550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-68d38f87-00af-4105-857e-e58a4e24f51b req-a30c4e35-f4d4-44d2-92f6-02abd411af5a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:51.153504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-68d38f87-00af-4105-857e-e58a4e24f51b req-a30c4e35-f4d4-44d2-92f6-02abd411af5a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:51.184734 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-68d38f87-00af-4105-857e-e58a4e24f51b req-a30c4e35-f4d4-44d2-92f6-02abd411af5a service nova] Creating event network-vif-plugged:5e940ed8-002c-484c-96fa-0461c38ab548 for instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 on n-h2-844627-10 Aug 04 14:00:51.192515 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-68d38f87-00af-4105-857e-e58a4e24f51b req-a30c4e35-f4d4-44d2-92f6-02abd411af5a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066426 Aug 04 14:00:51.194028 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 840/1652] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:51.203373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-93ec795b-de90-46ae-84b1-14757ff47db9 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:51.204800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-93ec795b-de90-46ae-84b1-14757ff47db9 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:51.214947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93ec795b-de90-46ae-84b1-14757ff47db9 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:51.215904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93ec795b-de90-46ae-84b1-14757ff47db9 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:51.220717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93ec795b-de90-46ae-84b1-14757ff47db9 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:51.222615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93ec795b-de90-46ae-84b1-14757ff47db9 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:51.445164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-93ec795b-de90-46ae-84b1-14757ff47db9 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:51.455861 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-93ec795b-de90-46ae-84b1-14757ff47db9 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1270 microversion: 2.1 time: 0.259468 Aug 04 14:00:51.458013 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 841/1653] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:51 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1270 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:51.464127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e0db174-f305-4c8e-b8b1-3a49783304a3 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002e2040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:51.465301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3c33244-3129-49b5-876b-852b6065137d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:51.477219 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3c33244-3129-49b5-876b-852b6065137d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1317 microversion: 2.1 time: 0.730325 Aug 04 14:00:51.485218 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 813/1654] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:50 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1317 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:51.491312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-59f330e7-2666-4c83-bc57-1796d82a36c5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3c8d790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:51.641424 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e0db174-f305-4c8e-b8b1-3a49783304a3 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 200 len: 1462 microversion: 2.1 time: 0.180477 Aug 04 14:00:51.643197 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-59f330e7-2666-4c83-bc57-1796d82a36c5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1412 microversion: 2.1 time: 0.156436 Aug 04 14:00:51.643795 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 814/1655] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:51 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:51.644532 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 842/1656] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:51 2022] GET /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 1462 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:51.651945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a1d061db-98aa-4d55-9024-bc5c2786876c req-2d5debfa-2702-4865-bd65-de509f879c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7984a6d3-8edb-45ab-a340-bc9df16df6f3", "tag": "90affd07-aec2-4cef-95ed-8a5823b3ed7d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:51.671440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aec78110-a56b-4117-8b76-35e1eaa6c848 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Calling method '.version_select at 0x7f46f3fb1b80>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:51.681321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a1d061db-98aa-4d55-9024-bc5c2786876c req-2d5debfa-2702-4865-bd65-de509f879c43 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:51.681772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a1d061db-98aa-4d55-9024-bc5c2786876c req-2d5debfa-2702-4865-bd65-de509f879c43 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:51.715259 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a1d061db-98aa-4d55-9024-bc5c2786876c req-2d5debfa-2702-4865-bd65-de509f879c43 service nova] Creating event network-changed:90affd07-aec2-4cef-95ed-8a5823b3ed7d for instance 7984a6d3-8edb-45ab-a340-bc9df16df6f3 on n-h1-844627-10 Aug 04 14:00:51.726415 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a1d061db-98aa-4d55-9024-bc5c2786876c req-2d5debfa-2702-4865-bd65-de509f879c43 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080328 Aug 04 14:00:51.727357 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 815/1657] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:51.733651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1019944f-bbbc-4bf0-b625-00e0735f95c4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:51.739050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1019944f-bbbc-4bf0-b625-00e0735f95c4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:51.755553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1019944f-bbbc-4bf0-b625-00e0735f95c4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:51.758002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1019944f-bbbc-4bf0-b625-00e0735f95c4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:51.758002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1019944f-bbbc-4bf0-b625-00e0735f95c4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:51.758002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1019944f-bbbc-4bf0-b625-00e0735f95c4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:52.197334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1019944f-bbbc-4bf0-b625-00e0735f95c4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:52.219368 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1019944f-bbbc-4bf0-b625-00e0735f95c4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507" status: 200 len: 1468 microversion: 2.1 time: 0.490067 Aug 04 14:00:52.222478 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 816/1658] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:51 2022] GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507 => generated 1468 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:52.230502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb09a813-02da-4279-aca7-10fafc5bccc4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:52.232144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb09a813-02da-4279-aca7-10fafc5bccc4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:52.248589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb09a813-02da-4279-aca7-10fafc5bccc4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:52.250031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb09a813-02da-4279-aca7-10fafc5bccc4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:52.254023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb09a813-02da-4279-aca7-10fafc5bccc4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:52.255481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb09a813-02da-4279-aca7-10fafc5bccc4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:52.285769 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aec78110-a56b-4117-8b76-35e1eaa6c848 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/19a313d9-0285-4865-bd43-ee3b5b7bc3f9" status: 202 len: 0 microversion: 2.1 time: 0.627730 Aug 04 14:00:52.287918 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 843/1659] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:00:51 2022] DELETE /compute/v2.1/os-security-groups/19a313d9-0285-4865-bd43-ee3b5b7bc3f9 => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:52.314330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a8123777-dcc7-429a-b3ea-d4907a2fe269 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:52.316111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a8123777-dcc7-429a-b3ea-d4907a2fe269 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:52.351331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8123777-dcc7-429a-b3ea-d4907a2fe269 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:52.355117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8123777-dcc7-429a-b3ea-d4907a2fe269 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:52.358404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8123777-dcc7-429a-b3ea-d4907a2fe269 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:52.360080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8123777-dcc7-429a-b3ea-d4907a2fe269 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:52.528863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bb09a813-02da-4279-aca7-10fafc5bccc4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:52.548664 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb09a813-02da-4279-aca7-10fafc5bccc4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 200 len: 1468 microversion: 2.1 time: 0.323841 Aug 04 14:00:52.550541 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 817/1660] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:52 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 1468 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:52.563606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4dcb78ea-efdf-478f-8d59-41f124bda758 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3c9a430>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:52.813787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a8123777-dcc7-429a-b3ea-d4907a2fe269 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:52.842401 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a8123777-dcc7-429a-b3ea-d4907a2fe269 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1311 microversion: 2.1 time: 0.551235 Aug 04 14:00:52.846527 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 844/1661] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:52 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1311 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:52.862198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6529de01-25db-42ab-a7c3-2b1513be5888 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Calling method '.version_select at 0x7f46f3fb4160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:52.930937 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4dcb78ea-efdf-478f-8d59-41f124bda758 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images?changes-since=2022-08-04T13%3A58%3A00Z" status: 200 len: 2374 microversion: 2.1 time: 0.377890 Aug 04 14:00:52.933968 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 818/1662] 10.222.0.66 () {58 vars in 1199 bytes} [Thu Aug 4 14:00:52 2022] GET /compute/v2.1/images?changes-since=2022-08-04T13%3A58%3A00Z => generated 2374 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:52.948006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd6d95e3-920b-480d-a0ef-612e590f2c0e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:52.951662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cd6d95e3-920b-480d-a0ef-612e590f2c0e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:52.968649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd6d95e3-920b-480d-a0ef-612e590f2c0e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:52.970151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd6d95e3-920b-480d-a0ef-612e590f2c0e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:52.971952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd6d95e3-920b-480d-a0ef-612e590f2c0e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:52.973208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd6d95e3-920b-480d-a0ef-612e590f2c0e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:53.346440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cd6d95e3-920b-480d-a0ef-612e590f2c0e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:53.372810 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cd6d95e3-920b-480d-a0ef-612e590f2c0e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1317 microversion: 2.1 time: 0.435827 Aug 04 14:00:53.415475 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6529de01-25db-42ab-a7c3-2b1513be5888 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/4ce51662-412c-4315-9737-0e407bfa5a0b" status: 202 len: 0 microversion: 2.1 time: 0.566972 Aug 04 14:00:53.416703 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 845/1663] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:00:52 2022] DELETE /compute/v2.1/os-security-groups/4ce51662-412c-4315-9737-0e407bfa5a0b => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:53.421603 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 819/1664] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:52 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:53.426675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa2e3ced-938f-4cb9-b5e2-5ef73310c0af tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:53.428160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa2e3ced-938f-4cb9-b5e2-5ef73310c0af tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:53.432076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fc6b44b7-4c4d-4408-bacf-c0d804ab9c42 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3cdd820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:53.447313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa2e3ced-938f-4cb9-b5e2-5ef73310c0af tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:53.447785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa2e3ced-938f-4cb9-b5e2-5ef73310c0af tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:53.448596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa2e3ced-938f-4cb9-b5e2-5ef73310c0af tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:53.458021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa2e3ced-938f-4cb9-b5e2-5ef73310c0af tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:53.660229 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fc6b44b7-4c4d-4408-bacf-c0d804ab9c42 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1412 microversion: 2.1 time: 0.235528 Aug 04 14:00:53.669967 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 820/1665] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:53 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1412 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:53.694962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-481bce93-5d1e-4a85-a730-0cd14d21378c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3c8dee0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:53.885396 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-481bce93-5d1e-4a85-a730-0cd14d21378c tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-235089836" status: 200 len: 484 microversion: 2.1 time: 0.202001 Aug 04 14:00:53.891624 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 821/1666] 10.222.0.66 () {58 vars in 1229 bytes} [Thu Aug 4 14:00:53 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-235089836 => generated 484 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:53.917811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-41f85c0c-97d8-4f9b-b765-e5dcd91a0c45 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] Calling method '.version_select at 0x7f46f3caf940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:53.929424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa2e3ced-938f-4cb9-b5e2-5ef73310c0af tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:53.948601 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa2e3ced-938f-4cb9-b5e2-5ef73310c0af tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1312 microversion: 2.1 time: 0.526369 Aug 04 14:00:53.950106 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 846/1667] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:53 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1312 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:53.963172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cea37b73-9cae-4dda-a4f9-61326ddd747d req-f2e117ad-303b-4320-8b14-dbca2cae0bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ebe867-4b9d-485d-8966-8f8ba3004e79", "name": "network-vif-plugged", "status": "completed", "tag": "146e5ef7-a016-4406-86bd-d67bec04de40"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:53.994792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cea37b73-9cae-4dda-a4f9-61326ddd747d req-f2e117ad-303b-4320-8b14-dbca2cae0bea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:53.996091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cea37b73-9cae-4dda-a4f9-61326ddd747d req-f2e117ad-303b-4320-8b14-dbca2cae0bea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:54.030142 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cea37b73-9cae-4dda-a4f9-61326ddd747d req-f2e117ad-303b-4320-8b14-dbca2cae0bea service nova] Creating event network-vif-plugged:146e5ef7-a016-4406-86bd-d67bec04de40 for instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 on n-h1-844627-10 Aug 04 14:00:54.050738 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cea37b73-9cae-4dda-a4f9-61326ddd747d req-f2e117ad-303b-4320-8b14-dbca2cae0bea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097364 Aug 04 14:00:54.052285 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 847/1668] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:54.059064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:54.060043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:54.067787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:54.068345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:54.069240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:54.069767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:54.093169 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 HTTP/1.1 Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '211b9e89-0c4b-45f2-8324-77aee2accf38'} Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:00:54.096558 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:54.106134 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:00:54.106134 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:00:54.106134 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:00:54.106134 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:00:54.106134 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:00:54.106134 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:00:54.106134 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:00:54.112908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:00:54.112908 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a415073-7589-4a40-890f-062cfdf32379 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 404 len: 111 microversion: 2.1 time: 0.056885 Aug 04 14:00:54.112908 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 848/1669] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:54 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:00:54.121679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-dd6f8155-702a-4d8a-8d56-16d104459cdb req-daf877df-dc9e-4977-9082-3671e30d4b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "211b9e89-0c4b-45f2-8324-77aee2accf38", "name": "network-vif-deleted", "tag": "6c34e394-956e-49e5-ab8f-27259b03d8a3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:54.141234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-dd6f8155-702a-4d8a-8d56-16d104459cdb req-daf877df-dc9e-4977-9082-3671e30d4b04 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:54.142093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-dd6f8155-702a-4d8a-8d56-16d104459cdb req-daf877df-dc9e-4977-9082-3671e30d4b04 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:54.168010 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-dd6f8155-702a-4d8a-8d56-16d104459cdb req-daf877df-dc9e-4977-9082-3671e30d4b04 service nova] Creating event network-vif-deleted:6c34e394-956e-49e5-ab8f-27259b03d8a3 for instance 211b9e89-0c4b-45f2-8324-77aee2accf38 on n-h2-844627-10 Aug 04 14:00:54.177853 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-dd6f8155-702a-4d8a-8d56-16d104459cdb req-daf877df-dc9e-4977-9082-3671e30d4b04 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064049 Aug 04 14:00:54.179497 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 849/1670] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:54.189746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d913d821-68f5-41f3-a046-b3e214e968cd tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:54.191010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d913d821-68f5-41f3-a046-b3e214e968cd tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:54.201759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d913d821-68f5-41f3-a046-b3e214e968cd tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:54.202353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d913d821-68f5-41f3-a046-b3e214e968cd tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:54.203467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d913d821-68f5-41f3-a046-b3e214e968cd tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:54.204028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d913d821-68f5-41f3-a046-b3e214e968cd tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:54.234494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:54.391581 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-41f85c0c-97d8-4f9b-b765-e5dcd91a0c45 tempest-SecurityGroupRulesNegativeTestJSON-947776257 tempest-SecurityGroupRulesNegativeTestJSON-947776257-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/221feb57-2015-4cea-9931-c5d83522df73" status: 202 len: 0 microversion: 2.1 time: 0.498347 Aug 04 14:00:54.392504 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 822/1671] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:00:53 2022] DELETE /compute/v2.1/os-security-groups/221feb57-2015-4cea-9931-c5d83522df73 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:54.397543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3dfa0ae-c25a-42f2-bce3-b8ea0df0616e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3caf3a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:54.508472 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3dfa0ae-c25a-42f2-bce3-b8ea0df0616e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images?server=9a6ca2cc-3cdb-477e-9166-c915de5fc507" status: 200 len: 957 microversion: 2.1 time: 0.114722 Aug 04 14:00:54.509729 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 823/1672] 10.222.0.66 () {58 vars in 1209 bytes} [Thu Aug 4 14:00:54 2022] GET /compute/v2.1/images?server=9a6ca2cc-3cdb-477e-9166-c915de5fc507 => generated 957 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:54.516484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bedf34bd-251d-4e09-a35e-c0b5280f3ff2 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3c9a9d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:54.589216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d913d821-68f5-41f3-a046-b3e214e968cd tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:54.621257 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d913d821-68f5-41f3-a046-b3e214e968cd tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1494 microversion: 2.1 time: 0.438774 Aug 04 14:00:54.625735 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 850/1673] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:54 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1494 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:54.656820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2985f02e-0a3c-4bf0-8c17-58506e87aa2f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:54.658399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2985f02e-0a3c-4bf0-8c17-58506e87aa2f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:54.690323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2985f02e-0a3c-4bf0-8c17-58506e87aa2f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:54.690836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2985f02e-0a3c-4bf0-8c17-58506e87aa2f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:54.691712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2985f02e-0a3c-4bf0-8c17-58506e87aa2f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:54.693391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2985f02e-0a3c-4bf0-8c17-58506e87aa2f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:54.926424 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bedf34bd-251d-4e09-a35e-c0b5280f3ff2 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/91999569-a08b-4b07-89ee-194f06fa9633" status: 202 len: 0 microversion: 2.1 time: 0.414291 Aug 04 14:00:54.933990 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 824/1674] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:00:54 2022] DELETE /compute/v2.1/os-security-groups/91999569-a08b-4b07-89ee-194f06fa9633 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:54.944849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0d4d050f-8000-4272-964b-b92b902823d9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3c9a550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:55.017762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2985f02e-0a3c-4bf0-8c17-58506e87aa2f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:55.034665 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2985f02e-0a3c-4bf0-8c17-58506e87aa2f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1317 microversion: 2.1 time: 0.397750 Aug 04 14:00:55.036545 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 851/1675] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:54 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:55.167881 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0d4d050f-8000-4272-964b-b92b902823d9 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fv2.1%2Fservers%2F691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 484 microversion: 2.1 time: 0.231177 Aug 04 14:00:55.174181 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 825/1676] 10.222.0.66 () {58 vars in 1317 bytes} [Thu Aug 4 14:00:54 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fv2.1%2Fservers%2F691963ac-14bf-4d48-9c45-643a5efa71aa => generated 484 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:55.193766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b6868a5-500d-40f0-88df-9858b698594d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3cc7f70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:55.287115 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b6868a5-500d-40f0-88df-9858b698594d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1412 microversion: 2.1 time: 0.109076 Aug 04 14:00:55.290823 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 826/1677] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:55 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:55.303815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-51695c46-6118-4dfd-8aff-184a4f79a14f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3cafb80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:55.491948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6da2dd4e-b6f4-47d2-aac0-69b87835a118 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:55.502505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6da2dd4e-b6f4-47d2-aac0-69b87835a118 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:55.530574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:55.535423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6da2dd4e-b6f4-47d2-aac0-69b87835a118 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:55.546355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6da2dd4e-b6f4-47d2-aac0-69b87835a118 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:55.548381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6da2dd4e-b6f4-47d2-aac0-69b87835a118 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:55.549588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6da2dd4e-b6f4-47d2-aac0-69b87835a118 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:55.678194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:55.798358 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-51695c46-6118-4dfd-8aff-184a4f79a14f tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/dfa8b08e-4986-4def-aeec-a3d19b28da55" status: 202 len: 0 microversion: 2.1 time: 0.505519 Aug 04 14:00:55.799760 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 827/1678] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:00:55 2022] DELETE /compute/v2.1/os-security-groups/dfa8b08e-4986-4def-aeec-a3d19b28da55 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:00:55.814050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-275fcc2e-2280-4d39-9cbb-5a08e4ad8d15 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:55.824663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-275fcc2e-2280-4d39-9cbb-5a08e4ad8d15 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:55.839228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-275fcc2e-2280-4d39-9cbb-5a08e4ad8d15 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:55.840545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-275fcc2e-2280-4d39-9cbb-5a08e4ad8d15 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:55.842777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-275fcc2e-2280-4d39-9cbb-5a08e4ad8d15 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:55.843977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-275fcc2e-2280-4d39-9cbb-5a08e4ad8d15 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:56.063938 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6da2dd4e-b6f4-47d2-aac0-69b87835a118 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1647 microversion: 2.1 time: 1.018948 Aug 04 14:00:56.091199 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 852/1679] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:55 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1647 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:56.103144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4525a1b-8f66-498a-92e1-7e7f22be4436 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3f51160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:56.137627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-275fcc2e-2280-4d39-9cbb-5a08e4ad8d15 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:56.150120 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-275fcc2e-2280-4d39-9cbb-5a08e4ad8d15 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1333 microversion: 2.1 time: 0.345702 Aug 04 14:00:56.150925 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 828/1680] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:55 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1333 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:56.156686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-755686ab-a33e-4cc4-aaec-7f56825571a9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'create', calling method: .version_select at 0x7f46f3cdd430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94673990", "description": "tempest-description-1184244405"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:56.457989 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-755686ab-a33e-4cc4-aaec-7f56825571a9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.305424 Aug 04 14:00:56.460267 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 829/1681] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:00:56 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:56.467245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1f6ed977-7aeb-4022-8fd9-1698b311306d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:56.469870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1f6ed977-7aeb-4022-8fd9-1698b311306d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:56.477197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f6ed977-7aeb-4022-8fd9-1698b311306d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:56.478074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f6ed977-7aeb-4022-8fd9-1698b311306d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:56.479259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f6ed977-7aeb-4022-8fd9-1698b311306d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:56.479956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f6ed977-7aeb-4022-8fd9-1698b311306d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:56.696764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1f6ed977-7aeb-4022-8fd9-1698b311306d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:00:56.699568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:00:56.711035 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1f6ed977-7aeb-4022-8fd9-1698b311306d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1317 microversion: 2.1 time: 0.248002 Aug 04 14:00:56.712140 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 830/1682] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:56 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:56.725965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-befeed08-c995-4203-9262-008d29396196 req-218e3954-49f2-4a1e-835b-d75a0f292883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ca2cc-3cdb-477e-9166-c915de5fc507", "name": "network-vif-unplugged", "status": "completed", "tag": "3725cfe1-eef7-4aa9-8c08-89a978079195"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:00:56.740634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-befeed08-c995-4203-9262-008d29396196 req-218e3954-49f2-4a1e-835b-d75a0f292883 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:56.741276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-befeed08-c995-4203-9262-008d29396196 req-218e3954-49f2-4a1e-835b-d75a0f292883 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:56.757348 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-befeed08-c995-4203-9262-008d29396196 req-218e3954-49f2-4a1e-835b-d75a0f292883 service nova] Creating event network-vif-unplugged:3725cfe1-eef7-4aa9-8c08-89a978079195 for instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 on n-h2-844627-10 Aug 04 14:00:56.765692 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-befeed08-c995-4203-9262-008d29396196 req-218e3954-49f2-4a1e-835b-d75a0f292883 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052202 Aug 04 14:00:56.766753 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 831/1683] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:00:56.773851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20614a93-e9ee-4eb8-a8cf-387a17689ab0 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:56.775010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-20614a93-e9ee-4eb8-a8cf-387a17689ab0 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:00:56.786137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20614a93-e9ee-4eb8-a8cf-387a17689ab0 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:56.787029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20614a93-e9ee-4eb8-a8cf-387a17689ab0 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:56.788674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20614a93-e9ee-4eb8-a8cf-387a17689ab0 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:00:56.789871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20614a93-e9ee-4eb8-a8cf-387a17689ab0 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:00:57.077806 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-20614a93-e9ee-4eb8-a8cf-387a17689ab0 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1647 microversion: 2.1 time: 0.309506 Aug 04 14:00:57.079111 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 832/1684] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:00:56 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1647 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:00:57.089710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6aeab8bc-ba2e-4c1d-ab9c-7b1c9d88f19f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3c9ab80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:00:57.752243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:05.533960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:06.055008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=17 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:06.780533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=39 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:07.070008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=9 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:11.042133 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4525a1b-8f66-498a-92e1-7e7f22be4436 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fservers%2F691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 484 microversion: 2.1 time: 14.949522 Aug 04 14:01:11.045690 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 853/1685] 10.222.0.66 () {58 vars in 1303 bytes} [Thu Aug 4 14:00:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fservers%2F691963ac-14bf-4d48-9c45-643a5efa71aa => generated 484 bytes in 14955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:11.051574 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6aeab8bc-ba2e-4c1d-ab9c-7b1c9d88f19f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1412 microversion: 2.1 time: 13.970864 Aug 04 14:01:11.066351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eaa0c122-ae81-42c1-ab98-fe7dd8b56a9e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Action: 'update', calling method: .version_select at 0x7f4705687160>, body: {"security_group": {"name": "tempest-sg-hth-1272815952", "description": "tempest-description-hth-1311152737"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:11.068446 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 833/1686] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:00:57 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1412 bytes in 13989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:11.119315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5819309f-bfff-4b8b-b706-842e246a98d6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:11.157412 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:01:11.157412 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:01:11.175382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5819309f-bfff-4b8b-b706-842e246a98d6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:11.175872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5819309f-bfff-4b8b-b706-842e246a98d6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:11.176822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5819309f-bfff-4b8b-b706-842e246a98d6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:11.197989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5819309f-bfff-4b8b-b706-842e246a98d6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:11.271070 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5819309f-bfff-4b8b-b706-842e246a98d6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.199973 Aug 04 14:01:11.273618 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 834/1687] 10.222.0.66 () {58 vars in 1176 bytes} [Thu Aug 4 14:01:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:11.290740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-010a6e47-856e-4847-8ad6-b63e4f24e214 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:11.293496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-010a6e47-856e-4847-8ad6-b63e4f24e214 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:11.313229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-010a6e47-856e-4847-8ad6-b63e4f24e214 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:11.313736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-010a6e47-856e-4847-8ad6-b63e4f24e214 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:11.314510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-010a6e47-856e-4847-8ad6-b63e4f24e214 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:11.314918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-010a6e47-856e-4847-8ad6-b63e4f24e214 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:11.804297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-010a6e47-856e-4847-8ad6-b63e4f24e214 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:11.830487 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-010a6e47-856e-4847-8ad6-b63e4f24e214 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1354 microversion: 2.1 time: 0.554349 Aug 04 14:01:11.840996 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 835/1688] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:11 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1354 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:11.852187 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eaa0c122-ae81-42c1-ab98-fe7dd8b56a9e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "PUT /compute/v2.1/os-security-groups/82993e8a-db61-4cf0-b5b6-2b3e48148430" status: 200 len: 218 microversion: 2.1 time: 0.802484 Aug 04 14:01:11.854327 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 854/1689] 10.222.0.66 () {60 vars in 1290 bytes} [Thu Aug 4 14:01:11 2022] PUT /compute/v2.1/os-security-groups/82993e8a-db61-4cf0-b5b6-2b3e48148430 => generated 218 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:11.864620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4fdb7fa0-52cd-441b-911b-e4a70340ef2b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:11.889553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c7e35d70-19bd-448a-b5b4-c2a0ec02d5af req-6742634b-4d2d-4162-86a9-206f02e2956b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7984a6d3-8edb-45ab-a340-bc9df16df6f3", "name": "network-vif-plugged", "status": "completed", "tag": "90affd07-aec2-4cef-95ed-8a5823b3ed7d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:11.903299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4fdb7fa0-52cd-441b-911b-e4a70340ef2b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:11.926473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c7e35d70-19bd-448a-b5b4-c2a0ec02d5af req-6742634b-4d2d-4162-86a9-206f02e2956b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:11.930617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c7e35d70-19bd-448a-b5b4-c2a0ec02d5af req-6742634b-4d2d-4162-86a9-206f02e2956b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:11.942137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fdb7fa0-52cd-441b-911b-e4a70340ef2b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:11.943104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fdb7fa0-52cd-441b-911b-e4a70340ef2b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:11.945462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fdb7fa0-52cd-441b-911b-e4a70340ef2b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:11.946256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fdb7fa0-52cd-441b-911b-e4a70340ef2b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:11.963713 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c7e35d70-19bd-448a-b5b4-c2a0ec02d5af req-6742634b-4d2d-4162-86a9-206f02e2956b service nova] Creating event network-vif-plugged:90affd07-aec2-4cef-95ed-8a5823b3ed7d for instance 7984a6d3-8edb-45ab-a340-bc9df16df6f3 on n-h1-844627-10 Aug 04 14:01:11.980185 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c7e35d70-19bd-448a-b5b4-c2a0ec02d5af req-6742634b-4d2d-4162-86a9-206f02e2956b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122979 Aug 04 14:01:11.982160 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 855/1690] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:11.995396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-33e890ff-e3d8-472a-b0e7-b910522da6b3 req-5d098948-1156-4210-8cab-0983747f208d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "tag": "e930bb33-75cd-4b4d-8598-7349c9f87499"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:12.082166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-33e890ff-e3d8-472a-b0e7-b910522da6b3 req-5d098948-1156-4210-8cab-0983747f208d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:12.083208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-33e890ff-e3d8-472a-b0e7-b910522da6b3 req-5d098948-1156-4210-8cab-0983747f208d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:12.138571 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-33e890ff-e3d8-472a-b0e7-b910522da6b3 req-5d098948-1156-4210-8cab-0983747f208d service nova] Creating event network-changed:e930bb33-75cd-4b4d-8598-7349c9f87499 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:12.161485 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-33e890ff-e3d8-472a-b0e7-b910522da6b3 req-5d098948-1156-4210-8cab-0983747f208d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173126 Aug 04 14:01:12.172283 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 856/1691] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:12.186636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc8da5ae-0952-4f10-a069-edd2944afdc7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700a61160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:12.691404 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bc8da5ae-0952-4f10-a069-edd2944afdc7 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.508477 Aug 04 14:01:12.692058 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 857/1692] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 14:01:12 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:12.730161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b40d43be-42e3-4fec-99c9-d67c41b33527 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844627-10", "block_migration": true, "disk_over_commit": false}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:12.738733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b40d43be-42e3-4fec-99c9-d67c41b33527 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:12.762215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b40d43be-42e3-4fec-99c9-d67c41b33527 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:12.763492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b40d43be-42e3-4fec-99c9-d67c41b33527 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:12.768841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b40d43be-42e3-4fec-99c9-d67c41b33527 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:12.769572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b40d43be-42e3-4fec-99c9-d67c41b33527 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:12.805605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-b40d43be-42e3-4fec-99c9-d67c41b33527 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lazy-loading 'flavor' on Instance uuid 6cc80476-6b5a-4dd1-922d-cce84e21d111 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:01:12.822910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b40d43be-42e3-4fec-99c9-d67c41b33527 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Going to try to live migrate instance to n-h1-844627-10 {{(pid=130961) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 14:01:12.975199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4fdb7fa0-52cd-441b-911b-e4a70340ef2b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:12.995283 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4fdb7fa0-52cd-441b-911b-e4a70340ef2b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1317 microversion: 2.1 time: 1.144191 Aug 04 14:01:12.996543 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 836/1693] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:11 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1317 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:13.002912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b682446f-3c9b-4634-ba58-159f05f973ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3c43a60>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.303471 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b682446f-3c9b-4634-ba58-159f05f973ee tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/82993e8a-db61-4cf0-b5b6-2b3e48148430" status: 200 len: 218 microversion: 2.1 time: 0.304439 Aug 04 14:01:13.304319 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 837/1694] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 14:01:12 2022] GET /compute/v2.1/os-security-groups/82993e8a-db61-4cf0-b5b6-2b3e48148430 => generated 218 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:13.313237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-08ba3c15-1c92-4636-a9e9-d07b9df43fc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47002b19d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.497699 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-08ba3c15-1c92-4636-a9e9-d07b9df43fc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1412 microversion: 2.1 time: 0.191596 Aug 04 14:01:13.502661 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 838/1695] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:01:13 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1412 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:13.509026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3477d6ca-3130-4c31-afbf-b35597961aed tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3cc7ee0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.721739 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3477d6ca-3130-4c31-afbf-b35597961aed tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.214823 Aug 04 14:01:13.727427 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 839/1696] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 14:01:13 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:13.750842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d344d76-2e37-4eae-b244-0cbfb5595aea tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:13.752121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d344d76-2e37-4eae-b244-0cbfb5595aea tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:13.781892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d344d76-2e37-4eae-b244-0cbfb5595aea tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:13.783329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d344d76-2e37-4eae-b244-0cbfb5595aea tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:13.785296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d344d76-2e37-4eae-b244-0cbfb5595aea tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:13.787311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d344d76-2e37-4eae-b244-0cbfb5595aea tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:14.327527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d344d76-2e37-4eae-b244-0cbfb5595aea tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:14.400711 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d344d76-2e37-4eae-b244-0cbfb5595aea tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1354 microversion: 2.1 time: 0.670503 Aug 04 14:01:14.418927 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 840/1697] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:13 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1354 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:14.455649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-24216370-3221-4bd4-adfa-60d87ce2e759 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3cd14c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:16.372754 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b40d43be-42e3-4fec-99c9-d67c41b33527 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111/action" status: 202 len: 0 microversion: 2.1 time: 3.678948 Aug 04 14:01:16.375184 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 858/1698] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:01:12 2022] POST /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111/action => generated 0 bytes in 3683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:16.392626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e31ef91b-27d1-4a65-84ef-c555dcd356fe tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470569d790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:16.683763 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-24216370-3221-4bd4-adfa-60d87ce2e759 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/82993e8a-db61-4cf0-b5b6-2b3e48148430" status: 202 len: 0 microversion: 2.1 time: 2.262304 Aug 04 14:01:16.686345 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 841/1699] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:01:14 2022] DELETE /compute/v2.1/os-security-groups/82993e8a-db61-4cf0-b5b6-2b3e48148430 => generated 0 bytes in 2266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:16.713236 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e31ef91b-27d1-4a65-84ef-c555dcd356fe tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.336205 Aug 04 14:01:16.725620 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 859/1700] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:01:16 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:16.726348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca5d9b7f-3782-4aff-ad3d-a66619062ee9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:16.732271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cb3db391-eaa2-4b36-9696-76923c3433dd req-348de37f-e35f-4120-bdd6-1a218eb1d624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "tag": "d65c8838-3acf-43d6-b270-66d7dd7ce838"}, {"name": "network-changed", "server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "tag": "a00f1532-d8af-42b6-a5fa-0d4361f45248"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:16.733333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ca5d9b7f-3782-4aff-ad3d-a66619062ee9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:16.761410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cb3db391-eaa2-4b36-9696-76923c3433dd req-348de37f-e35f-4120-bdd6-1a218eb1d624 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:16.762283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cb3db391-eaa2-4b36-9696-76923c3433dd req-348de37f-e35f-4120-bdd6-1a218eb1d624 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:16.787289 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cb3db391-eaa2-4b36-9696-76923c3433dd req-348de37f-e35f-4120-bdd6-1a218eb1d624 service nova] Creating event network-changed:d65c8838-3acf-43d6-b270-66d7dd7ce838 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:16.790006 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cb3db391-eaa2-4b36-9696-76923c3433dd req-348de37f-e35f-4120-bdd6-1a218eb1d624 service nova] Creating event network-changed:a00f1532-d8af-42b6-a5fa-0d4361f45248 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:16.796219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca5d9b7f-3782-4aff-ad3d-a66619062ee9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:16.818118 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cb3db391-eaa2-4b36-9696-76923c3433dd req-348de37f-e35f-4120-bdd6-1a218eb1d624 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.087318 Aug 04 14:01:16.819525 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 860/1701] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:16.824671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca5d9b7f-3782-4aff-ad3d-a66619062ee9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:16.826479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca5d9b7f-3782-4aff-ad3d-a66619062ee9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:16.827279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca5d9b7f-3782-4aff-ad3d-a66619062ee9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:16.840010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9474c1d6-0bbd-44b8-8715-695d5a1101d2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f470569d9d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:16.931991 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9474c1d6-0bbd-44b8-8715-695d5a1101d2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1412 microversion: 2.1 time: 0.106129 Aug 04 14:01:16.940260 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 861/1702] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:01:16 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:16.953459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e04a540-9c2b-40e1-bccd-5a7192e90759 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:16.954547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e04a540-9c2b-40e1-bccd-5a7192e90759 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:16.964276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e04a540-9c2b-40e1-bccd-5a7192e90759 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:16.965043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e04a540-9c2b-40e1-bccd-5a7192e90759 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:16.966623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e04a540-9c2b-40e1-bccd-5a7192e90759 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:16.967253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e04a540-9c2b-40e1-bccd-5a7192e90759 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:17.817800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3e04a540-9c2b-40e1-bccd-5a7192e90759 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:17.831189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e04a540-9c2b-40e1-bccd-5a7192e90759 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1354 microversion: 2.1 time: 0.889593 Aug 04 14:01:17.837060 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 862/1703] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:16 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1354 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:17.846281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7b5ad349-70d8-4d7d-9407-ec7fe4c61182 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:17.850139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7b5ad349-70d8-4d7d-9407-ec7fe4c61182 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:17.867361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b5ad349-70d8-4d7d-9407-ec7fe4c61182 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:17.869454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b5ad349-70d8-4d7d-9407-ec7fe4c61182 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:17.874675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b5ad349-70d8-4d7d-9407-ec7fe4c61182 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:17.875107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b5ad349-70d8-4d7d-9407-ec7fe4c61182 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:18.127024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ca5d9b7f-3782-4aff-ad3d-a66619062ee9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:18.136789 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca5d9b7f-3782-4aff-ad3d-a66619062ee9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1466 microversion: 2.1 time: 1.447556 Aug 04 14:01:18.138718 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 842/1704] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:16 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1466 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:18.145132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:18.145953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:18.154977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:18.155842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:18.157019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:18.157641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:18.178722 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 HTTP/1.1 Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '211b9e89-0c4b-45f2-8324-77aee2accf38'} Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:01:18.180952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.186971 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.189400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:18.190492 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0f183d0c-f162-4705-9f25-0ac70106978a tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 404 len: 111 microversion: 2.1 time: 0.049983 Aug 04 14:01:18.192145 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 843/1705] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:01:18 2022] DELETE /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:18.201080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-92e6d339-f018-4f29-9a8b-eab59193536a tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002e7c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:18.431170 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-92e6d339-f018-4f29-9a8b-eab59193536a tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/detail?changes-since=2022-08-04T13%3A57%3A55Z" status: 200 len: 6326 microversion: 2.1 time: 0.234546 Aug 04 14:01:18.433695 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 844/1706] 10.222.0.66 () {58 vars in 1220 bytes} [Thu Aug 4 14:01:18 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-04T13%3A57%3A55Z => generated 6326 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:18.446809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f71bc5fd-53de-4dd0-ba5c-31495a884419 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3c438b0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:18.550034 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f71bc5fd-53de-4dd0-ba5c-31495a884419 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1412 microversion: 2.1 time: 0.112615 Aug 04 14:01:18.558372 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 845/1707] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:01:18 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:18.744200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7b5ad349-70d8-4d7d-9407-ec7fe4c61182 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:18.763024 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7b5ad349-70d8-4d7d-9407-ec7fe4c61182 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1504 microversion: 2.1 time: 0.921724 Aug 04 14:01:18.764086 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 863/1708] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:17 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1504 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:18.779170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:18.780721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 211b9e89-0c4b-45f2-8324-77aee2accf38] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:18.799561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:18.801633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:18.802651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:18.803112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:18.848178 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 HTTP/1.1 Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '211b9e89-0c4b-45f2-8324-77aee2accf38'} Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:18.852752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.858443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:18.858443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:18.858443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:18.858443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:18.858443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:18.858443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. Aug 04 14:01:18.858443 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:18.862693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Instance 211b9e89-0c4b-45f2-8324-77aee2accf38 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:18.867167 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a8044811-b95c-4a0c-8250-9dcfcf38ea4e tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38" status: 404 len: 111 microversion: 2.1 time: 0.099952 Aug 04 14:01:18.871476 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 864/1709] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:18 2022] GET /compute/v2.1/servers/211b9e89-0c4b-45f2-8324-77aee2accf38 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:18.904992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-77ff546a-46a7-4f31-b58d-8474b48e073d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4705629280>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:19.104784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aba650a2-0ff2-400a-a8d0-c327ebaf7ff3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:19.108455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aba650a2-0ff2-400a-a8d0-c327ebaf7ff3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:19.181158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aba650a2-0ff2-400a-a8d0-c327ebaf7ff3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:19.184061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aba650a2-0ff2-400a-a8d0-c327ebaf7ff3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:19.188037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aba650a2-0ff2-400a-a8d0-c327ebaf7ff3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:19.189058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aba650a2-0ff2-400a-a8d0-c327ebaf7ff3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:19.203723 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-77ff546a-46a7-4f31-b58d-8474b48e073d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-235089836" status: 200 len: 664 microversion: 2.1 time: 0.324587 Aug 04 14:01:19.216917 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 865/1710] 10.222.0.66 () {58 vars in 1250 bytes} [Thu Aug 4 14:01:18 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-235089836 => generated 664 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:19.235442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-affc258f-b5ac-461c-a708-a14011ce49b8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:19.236772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-affc258f-b5ac-461c-a708-a14011ce49b8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:19.269521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-affc258f-b5ac-461c-a708-a14011ce49b8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:19.272749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-affc258f-b5ac-461c-a708-a14011ce49b8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:19.283176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-affc258f-b5ac-461c-a708-a14011ce49b8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:19.285041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-affc258f-b5ac-461c-a708-a14011ce49b8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:20.251072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-affc258f-b5ac-461c-a708-a14011ce49b8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:20.260914 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-affc258f-b5ac-461c-a708-a14011ce49b8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1354 microversion: 2.1 time: 1.049748 Aug 04 14:01:20.266151 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 866/1711] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:19 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1354 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:20.271722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e28b831-048e-4fc3-aebf-cdb2de25b9a4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f4705629040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:20.336370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-4e28b831-048e-4fc3-aebf-cdb2de25b9a4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dfa8b08e-4986-4def-aeec-a3d19b28da55 does not exist", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:01:20.337207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.security_group_api [None req-4e28b831-048e-4fc3-aebf-cdb2de25b9a4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group dfa8b08e-4986-4def-aeec-a3d19b28da55 not found {{(pid=130961) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:01:20.337760 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-4e28b831-048e-4fc3-aebf-cdb2de25b9a4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group dfa8b08e-4986-4def-aeec-a3d19b28da55 does not exist Aug 04 14:01:20.337760 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-96cd2d94-e45f-4999-b809-44f135abafdc'] Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e28b831-048e-4fc3-aebf-cdb2de25b9a4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-security-groups/dfa8b08e-4986-4def-aeec-a3d19b28da55 HTTP/1.1 Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: exception: Security group dfa8b08e-4986-4def-aeec-a3d19b28da55 does not exist Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-96cd2d94-e45f-4999-b809-44f135abafdc'] Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dfa8b08e-4986-4def-aeec-a3d19b28da55'} Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:01:20.339821 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dfa8b08e-4986-4def-aeec-a3d19b28da55 does not exist Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96cd2d94-e45f-4999-b809-44f135abafdc'] Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dfa8b08e-4986-4def-aeec-a3d19b28da55 does not exist Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96cd2d94-e45f-4999-b809-44f135abafdc'] Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dfa8b08e-4986-4def-aeec-a3d19b28da55 does not exist Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96cd2d94-e45f-4999-b809-44f135abafdc'] Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dfa8b08e-4986-4def-aeec-a3d19b28da55 does not exist Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96cd2d94-e45f-4999-b809-44f135abafdc'] Aug 04 14:01:20.345415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.354291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e28b831-048e-4fc3-aebf-cdb2de25b9a4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group dfa8b08e-4986-4def-aeec-a3d19b28da55 does not exist Aug 04 14:01:20.354291 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-96cd2d94-e45f-4999-b809-44f135abafdc'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:20.354291 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e28b831-048e-4fc3-aebf-cdb2de25b9a4 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/dfa8b08e-4986-4def-aeec-a3d19b28da55" status: 404 len: 194 microversion: 2.1 time: 0.082871 Aug 04 14:01:20.354291 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 867/1712] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:01:20 2022] DELETE /compute/v2.1/os-security-groups/dfa8b08e-4986-4def-aeec-a3d19b28da55 => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:20.364573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c98610f-fee5-48bf-9125-eae355736ba1 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47056605e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:20.491683 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c98610f-fee5-48bf-9125-eae355736ba1 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fv2.1%2Fservers%2F691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1464 microversion: 2.1 time: 0.134994 Aug 04 14:01:20.493845 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 868/1713] 10.222.0.66 () {58 vars in 1338 bytes} [Thu Aug 4 14:01:20 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fv2.1%2Fservers%2F691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1464 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:20.519434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c1016483-186f-4173-9438-4556119aad16 req-1d26f112-bc05-4f0d-8ed5-63e6e4166a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "name": "network-vif-plugged", "status": "completed", "tag": "a00f1532-d8af-42b6-a5fa-0d4361f45248"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:20.551347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c1016483-186f-4173-9438-4556119aad16 req-1d26f112-bc05-4f0d-8ed5-63e6e4166a3c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:20.552806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c1016483-186f-4173-9438-4556119aad16 req-1d26f112-bc05-4f0d-8ed5-63e6e4166a3c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:20.590003 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c1016483-186f-4173-9438-4556119aad16 req-1d26f112-bc05-4f0d-8ed5-63e6e4166a3c service nova] Creating event network-vif-plugged:a00f1532-d8af-42b6-a5fa-0d4361f45248 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:20.607539 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c1016483-186f-4173-9438-4556119aad16 req-1d26f112-bc05-4f0d-8ed5-63e6e4166a3c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104292 Aug 04 14:01:20.618547 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 869/1714] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:20.625003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d146994f-1a50-49c1-a382-023eef150431 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f470567ac10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:20.710519 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d146994f-1a50-49c1-a382-023eef150431 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1421 microversion: 2.1 time: 0.090357 Aug 04 14:01:20.711028 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 870/1715] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:01:20 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1421 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:20.736456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-835ff7de-1710-4e23-b6da-608e28695b46 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:20.737121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-835ff7de-1710-4e23-b6da-608e28695b46 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:20.744575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-835ff7de-1710-4e23-b6da-608e28695b46 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:20.748353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-835ff7de-1710-4e23-b6da-608e28695b46 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:20.750574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-835ff7de-1710-4e23-b6da-608e28695b46 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:20.751244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-835ff7de-1710-4e23-b6da-608e28695b46 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:20.761523 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aba650a2-0ff2-400a-a8d0-c327ebaf7ff3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1619 microversion: 2.1 time: 2.205742 Aug 04 14:01:20.769410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 846/1716] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:18 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1619 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:20.785156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4442d17c-7696-4434-b56c-8185acd215b9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3cc48b0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:20.860570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-4442d17c-7696-4434-b56c-8185acd215b9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91999569-a08b-4b07-89ee-194f06fa9633 does not exist", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:01:20.861633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.security_group_api [None req-4442d17c-7696-4434-b56c-8185acd215b9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group 91999569-a08b-4b07-89ee-194f06fa9633 not found {{(pid=130960) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:01:20.862847 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-4442d17c-7696-4434-b56c-8185acd215b9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group 91999569-a08b-4b07-89ee-194f06fa9633 does not exist Aug 04 14:01:20.862847 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-3eb20c80-bed4-476e-b6f9-e60fd49e46f7'] Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4442d17c-7696-4434-b56c-8185acd215b9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-security-groups/91999569-a08b-4b07-89ee-194f06fa9633 HTTP/1.1 Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: exception: Security group 91999569-a08b-4b07-89ee-194f06fa9633 does not exist Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-3eb20c80-bed4-476e-b6f9-e60fd49e46f7'] Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '91999569-a08b-4b07-89ee-194f06fa9633'} Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:01:20.867407 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91999569-a08b-4b07-89ee-194f06fa9633 does not exist Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3eb20c80-bed4-476e-b6f9-e60fd49e46f7'] Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91999569-a08b-4b07-89ee-194f06fa9633 does not exist Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3eb20c80-bed4-476e-b6f9-e60fd49e46f7'] Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91999569-a08b-4b07-89ee-194f06fa9633 does not exist Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3eb20c80-bed4-476e-b6f9-e60fd49e46f7'] Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91999569-a08b-4b07-89ee-194f06fa9633 does not exist Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3eb20c80-bed4-476e-b6f9-e60fd49e46f7'] Aug 04 14:01:20.876061 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:20.887171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4442d17c-7696-4434-b56c-8185acd215b9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group 91999569-a08b-4b07-89ee-194f06fa9633 does not exist Aug 04 14:01:20.887171 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-3eb20c80-bed4-476e-b6f9-e60fd49e46f7'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:20.887171 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4442d17c-7696-4434-b56c-8185acd215b9 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/91999569-a08b-4b07-89ee-194f06fa9633" status: 404 len: 194 microversion: 2.1 time: 0.109202 Aug 04 14:01:20.889671 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 847/1717] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:01:20 2022] DELETE /compute/v2.1/os-security-groups/91999569-a08b-4b07-89ee-194f06fa9633 => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:20.901496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75dcc271-4688-468f-9628-0fae43dbd61d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47002b19d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:21.016055 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75dcc271-4688-468f-9628-0fae43dbd61d tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fservers%2F691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1464 microversion: 2.1 time: 0.124064 Aug 04 14:01:21.017210 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 848/1718] 10.222.0.66 () {58 vars in 1324 bytes} [Thu Aug 4 14:01:20 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.66%2Fcompute%2Fservers%2F691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1464 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:21.026051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3334650a-48e5-431a-b3c0-6b3ff1ba93f1 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3caf790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:21.142694 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3334650a-48e5-431a-b3c0-6b3ff1ba93f1 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 200 len: 1421 microversion: 2.1 time: 0.123635 Aug 04 14:01:21.143649 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 849/1719] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:01:21 2022] GET /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:21.160847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-50cd77f9-df6d-471a-8fac-484028ce171f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Action: 'create', calling method: .version_select at 0x7f46f3cddee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-234583996", "policies": ["affinity"]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:21.178354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-835ff7de-1710-4e23-b6da-608e28695b46 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:21.200816 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-835ff7de-1710-4e23-b6da-608e28695b46 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1504 microversion: 2.1 time: 0.474864 Aug 04 14:01:21.208094 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 871/1720] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:20 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:21.210905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-50cd77f9-df6d-471a-8fac-484028ce171f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:21.223205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-50cd77f9-df6d-471a-8fac-484028ce171f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:21.227695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0103935f-4db5-4a4b-9a8d-b97d812a6672 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3f519d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:21.229638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:21.318780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-0103935f-4db5-4a4b-9a8d-b97d812a6672 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:01:21.320664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.security_group_api [None req-0103935f-4db5-4a4b-9a8d-b97d812a6672 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 not found {{(pid=130961) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:01:21.321735 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-0103935f-4db5-4a4b-9a8d-b97d812a6672 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 14:01:21.321735 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-020c9fc0-bbd4-4796-8250-439b402c8aa5'] Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0103935f-4db5-4a4b-9a8d-b97d812a6672 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-security-groups/fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 HTTP/1.1 Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: exception: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-020c9fc0-bbd4-4796-8250-439b402c8aa5'] Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'fa7c53d2-1b98-4b63-a8c8-08b1a87872a1'} Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:01:21.330262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-020c9fc0-bbd4-4796-8250-439b402c8aa5'] Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-020c9fc0-bbd4-4796-8250-439b402c8aa5'] Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-020c9fc0-bbd4-4796-8250-439b402c8aa5'] Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-020c9fc0-bbd4-4796-8250-439b402c8aa5'] Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0103935f-4db5-4a4b-9a8d-b97d812a6672 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 does not exist Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-020c9fc0-bbd4-4796-8250-439b402c8aa5'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:21.339171 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0103935f-4db5-4a4b-9a8d-b97d812a6672 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/fa7c53d2-1b98-4b63-a8c8-08b1a87872a1" status: 404 len: 194 microversion: 2.1 time: 0.124936 Aug 04 14:01:21.350484 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 872/1721] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:01:21 2022] DELETE /compute/v2.1/os-security-groups/fa7c53d2-1b98-4b63-a8c8-08b1a87872a1 => generated 194 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:21.367648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fe726731-4f79-479f-8215-80e1fcc3c19a tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f47056d73a0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:21.383503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-50cd77f9-df6d-471a-8fac-484028ce171f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:21.396474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-50cd77f9-df6d-471a-8fac-484028ce171f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:21.442502 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-50cd77f9-df6d-471a-8fac-484028ce171f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.297398 Aug 04 14:01:21.450489 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 850/1722] 10.222.0.66 () {60 vars in 1174 bytes} [Thu Aug 4 14:01:21 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:21.477212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0fa38037-635a-4f76-97a7-abfe7706eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3cdd790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:21.619542 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fe726731-4f79-479f-8215-80e1fcc3c19a tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.268689 Aug 04 14:01:21.620518 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 873/1723] 10.222.0.66 () {58 vars in 1170 bytes} [Thu Aug 4 14:01:21 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:21.629688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e7076ba-a5bf-4daa-bf70-e0ac58bfb963 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:21.630335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e7076ba-a5bf-4daa-bf70-e0ac58bfb963 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:21.640957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e7076ba-a5bf-4daa-bf70-e0ac58bfb963 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:21.641433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e7076ba-a5bf-4daa-bf70-e0ac58bfb963 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:21.642268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e7076ba-a5bf-4daa-bf70-e0ac58bfb963 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:21.642719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e7076ba-a5bf-4daa-bf70-e0ac58bfb963 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:22.342604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6e7076ba-a5bf-4daa-bf70-e0ac58bfb963 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:22.372895 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e7076ba-a5bf-4daa-bf70-e0ac58bfb963 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1354 microversion: 2.1 time: 0.746102 Aug 04 14:01:22.376014 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 874/1724] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:21 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1354 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:22.411226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9b58802-f822-431f-8eec-2f59711c393c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f4705629ca0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:22.539011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-b9b58802-f822-431f-8eec-2f59711c393c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:01:22.539771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.security_group_api [None req-b9b58802-f822-431f-8eec-2f59711c393c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group d25e802d-087e-4d6b-a6a8-566b2b631138 not found {{(pid=130961) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:01:22.540355 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-b9b58802-f822-431f-8eec-2f59711c393c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 14:01:22.540355 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-fa9c1ef6-b36a-4a62-b3e0-46e187436846'] Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9b58802-f822-431f-8eec-2f59711c393c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-security-groups/d25e802d-087e-4d6b-a6a8-566b2b631138 HTTP/1.1 Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: exception: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-fa9c1ef6-b36a-4a62-b3e0-46e187436846'] Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd25e802d-087e-4d6b-a6a8-566b2b631138'} Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:01:22.548027 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa9c1ef6-b36a-4a62-b3e0-46e187436846'] Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa9c1ef6-b36a-4a62-b3e0-46e187436846'] Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa9c1ef6-b36a-4a62-b3e0-46e187436846'] Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa9c1ef6-b36a-4a62-b3e0-46e187436846'] Aug 04 14:01:22.552947 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:22.563914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9b58802-f822-431f-8eec-2f59711c393c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group d25e802d-087e-4d6b-a6a8-566b2b631138 does not exist Aug 04 14:01:22.563914 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-fa9c1ef6-b36a-4a62-b3e0-46e187436846'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:22.566306 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b9b58802-f822-431f-8eec-2f59711c393c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/d25e802d-087e-4d6b-a6a8-566b2b631138" status: 404 len: 194 microversion: 2.1 time: 0.186660 Aug 04 14:01:22.568686 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 875/1725] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:01:22 2022] DELETE /compute/v2.1/os-security-groups/d25e802d-087e-4d6b-a6a8-566b2b631138 => generated 194 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:22.580134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa001439-edd6-4e72-b3d3-9076447710c0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3f51430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:22.705423 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa001439-edd6-4e72-b3d3-9076447710c0 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.135175 Aug 04 14:01:22.728176 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 876/1726] 10.222.0.66 () {58 vars in 1170 bytes} [Thu Aug 4 14:01:22 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:22.734288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-406117957", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "70017779-d671-4b8e-9682-dcb519c6a5ec"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:22.841905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:01:23.246743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:01:23.247763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:01:23.248355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:01:23.248912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:01:23.249438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:01:23.311631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:23.312168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:23.313420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:23.314261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:23.370709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:23.378530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:23.414825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Going to run 2 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:01:23.433860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 51ec0807-aa9c-4f56-a110-1aaf8083233e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:01:23.448924 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0fa38037-635a-4f76-97a7-abfe7706eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 204 len: 0 microversion: 2.1 time: 1.999531 Aug 04 14:01:23.455068 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 851/1727] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:21 2022] DELETE /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 0 bytes in 2002 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:23.472766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4b35d36-d18b-42c2-98aa-7434e50fbef7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:23.474804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b4b35d36-d18b-42c2-98aa-7434e50fbef7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:23.504924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4b35d36-d18b-42c2-98aa-7434e50fbef7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:23.506224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4b35d36-d18b-42c2-98aa-7434e50fbef7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:23.509432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4b35d36-d18b-42c2-98aa-7434e50fbef7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:23.510773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4b35d36-d18b-42c2-98aa-7434e50fbef7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:23.521555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=130961) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 04 14:01:23.557910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:23.584287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:23.732570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:23.753504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:23.798197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=51ec0807-aa9c-4f56-a110-1aaf8083233e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:01:23.806462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b4b35d36-d18b-42c2-98aa-7434e50fbef7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:23.817301 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b4b35d36-d18b-42c2-98aa-7434e50fbef7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1504 microversion: 2.1 time: 0.360256 Aug 04 14:01:23.837154 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 852/1728] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:23 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:23.843420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9e61d9a6-17ea-486d-b1ac-aa70d2e32247 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3d3c700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:23.869024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-9e61d9a6-17ea-486d-b1ac-aa70d2e32247 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:01:23.870237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.security_group_api [None req-9e61d9a6-17ea-486d-b1ac-aa70d2e32247 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 not found {{(pid=130960) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:01:23.870952 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-9e61d9a6-17ea-486d-b1ac-aa70d2e32247 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 14:01:23.870952 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-092b965a-0226-4608-a922-00a38aad8612'] Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9e61d9a6-17ea-486d-b1ac-aa70d2e32247 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-security-groups/d3fa67d9-f973-4dfc-814d-e42862bb22d5 HTTP/1.1 Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: exception: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-092b965a-0226-4608-a922-00a38aad8612'] Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'd3fa67d9-f973-4dfc-814d-e42862bb22d5'} Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:01:23.873229 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-092b965a-0226-4608-a922-00a38aad8612'] Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-092b965a-0226-4608-a922-00a38aad8612'] Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-092b965a-0226-4608-a922-00a38aad8612'] Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-092b965a-0226-4608-a922-00a38aad8612'] Aug 04 14:01:23.877783 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:23.884894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9e61d9a6-17ea-486d-b1ac-aa70d2e32247 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group d3fa67d9-f973-4dfc-814d-e42862bb22d5 does not exist Aug 04 14:01:23.884894 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-092b965a-0226-4608-a922-00a38aad8612'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:23.884894 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9e61d9a6-17ea-486d-b1ac-aa70d2e32247 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/d3fa67d9-f973-4dfc-814d-e42862bb22d5" status: 404 len: 194 microversion: 2.1 time: 0.045583 Aug 04 14:01:23.884894 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 853/1729] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:01:23 2022] DELETE /compute/v2.1/os-security-groups/d3fa67d9-f973-4dfc-814d-e42862bb22d5 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:23.893142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf7b236e-61d4-4516-a012-cbc0722290f3 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3c8d160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:23.933344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:23.950680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:23.961851 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf7b236e-61d4-4516-a012-cbc0722290f3 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/bd2a109f-56ba-4543-91dd-d0a2429000b9" status: 200 len: 784 microversion: 2.1 time: 0.074069 Aug 04 14:01:23.983869 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 854/1730] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:01:23 2022] GET /compute/v2.1/images/bd2a109f-56ba-4543-91dd-d0a2429000b9 => generated 784 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:23.995136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-54c1152a-fdcc-45ee-a0b5-e7c539d91654 req-1085be08-528c-48cf-9b69-7ed5542eb273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "name": "network-vif-plugged", "status": "completed", "tag": "e930bb33-75cd-4b4d-8598-7349c9f87499"}, {"server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "name": "network-vif-plugged", "status": "completed", "tag": "d65c8838-3acf-43d6-b270-66d7dd7ce838"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:24.012109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-54c1152a-fdcc-45ee-a0b5-e7c539d91654 req-1085be08-528c-48cf-9b69-7ed5542eb273 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:24.013892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-54c1152a-fdcc-45ee-a0b5-e7c539d91654 req-1085be08-528c-48cf-9b69-7ed5542eb273 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:24.032910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-54c1152a-fdcc-45ee-a0b5-e7c539d91654 req-1085be08-528c-48cf-9b69-7ed5542eb273 service nova] Creating event network-vif-plugged:e930bb33-75cd-4b4d-8598-7349c9f87499 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:24.037910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-54c1152a-fdcc-45ee-a0b5-e7c539d91654 req-1085be08-528c-48cf-9b69-7ed5542eb273 service nova] Creating event network-vif-plugged:d65c8838-3acf-43d6-b270-66d7dd7ce838 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:24.046582 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-54c1152a-fdcc-45ee-a0b5-e7c539d91654 req-1085be08-528c-48cf-9b69-7ed5542eb273 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067308 Aug 04 14:01:24.047394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 855/1731] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:24.055652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-92d2f70d-96fc-4fdb-91eb-a0f244f3d28d req-ffd53b4c-6351-4ceb-8aed-96a731d28498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc80476-6b5a-4dd1-922d-cce84e21d111", "name": "network-vif-unplugged", "status": "completed", "tag": "5e940ed8-002c-484c-96fa-0461c38ab548"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:24.067950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-92d2f70d-96fc-4fdb-91eb-a0f244f3d28d req-ffd53b4c-6351-4ceb-8aed-96a731d28498 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:24.068703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-92d2f70d-96fc-4fdb-91eb-a0f244f3d28d req-ffd53b4c-6351-4ceb-8aed-96a731d28498 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:24.093609 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-92d2f70d-96fc-4fdb-91eb-a0f244f3d28d req-ffd53b4c-6351-4ceb-8aed-96a731d28498 service nova] Creating event network-vif-unplugged:5e940ed8-002c-484c-96fa-0461c38ab548 for instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 on n-h2-844627-10 Aug 04 14:01:24.103281 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-92d2f70d-96fc-4fdb-91eb-a0f244f3d28d req-ffd53b4c-6351-4ceb-8aed-96a731d28498 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053807 Aug 04 14:01:24.104765 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 856/1732] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:24.116921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cf5898c-5205-4d48-9bd6-6ab8b02c3741 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:24.118081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8cf5898c-5205-4d48-9bd6-6ab8b02c3741 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:24.126059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cf5898c-5205-4d48-9bd6-6ab8b02c3741 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:24.126955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cf5898c-5205-4d48-9bd6-6ab8b02c3741 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:24.128184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cf5898c-5205-4d48-9bd6-6ab8b02c3741 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:24.128906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cf5898c-5205-4d48-9bd6-6ab8b02c3741 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:24.207420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:24.214421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:24.342683 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-54387341-1ea3-4f91-9b05-81cbb7a0955e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.612724 Aug 04 14:01:24.343658 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 877/1733] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:01:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1615 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:01:24.353443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a4e12602-5fa7-484c-a9ab-ab859cd63640 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:24.354545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a4e12602-5fa7-484c-a9ab-ab859cd63640 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:24.377519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4e12602-5fa7-484c-a9ab-ab859cd63640 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:24.378372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4e12602-5fa7-484c-a9ab-ab859cd63640 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:24.381020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4e12602-5fa7-484c-a9ab-ab859cd63640 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:24.381686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4e12602-5fa7-484c-a9ab-ab859cd63640 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:24.410495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8cf5898c-5205-4d48-9bd6-6ab8b02c3741 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:24.430712 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8cf5898c-5205-4d48-9bd6-6ab8b02c3741 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1354 microversion: 2.1 time: 0.323856 Aug 04 14:01:24.432689 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 857/1734] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:24 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1354 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:24.437663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a4e12602-5fa7-484c-a9ab-ab859cd63640 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:01:24.553937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:24.635138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b13226b6-ad53-4f21-af70-fc46d60400d5 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Action: 'create', calling method: .version_select at 0x7f46f3cac5e0>, body: {"keypair": {"name": "tempest-keypair-639420115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2PWOEoEaCTHQnZl5OJibFS5pGCC8WjWnPhCaLldrFJVRJw2w0zeNq9QyoJZ2hzjE3fm8lBOQm0XSgG8zcRABu3csYjB2SevfPN5tffJy0YN6JgRzgyeL4JmIUQaHlAQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:24.646785 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a4e12602-5fa7-484c-a9ab-ab859cd63640 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 204 len: 0 microversion: 2.1 time: 0.301237 Aug 04 14:01:24.646785 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 878/1735] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:01:24 2022] DELETE /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:24.668104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e25511a0-e62a-442b-83ac-13e023d1ec94 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f470567aee0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:24.737504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b13226b6-ad53-4f21-af70-fc46d60400d5 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Getting quotas for project 1b1dd46f08d443288c68e2439b02f407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:24.767692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b13226b6-ad53-4f21-af70-fc46d60400d5 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Getting quotas for user 82728e57699e4154a1f2961e2801eb17 and project 1b1dd46f08d443288c68e2439b02f407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:24.806407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-e25511a0-e62a-442b-83ac-13e023d1ec94 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:01:24.807605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.security_group_api [None req-e25511a0-e62a-442b-83ac-13e023d1ec94 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Neutron security group be6a309d-91b7-4960-b649-5f06ed26b8c1 not found {{(pid=130961) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:01:24.808547 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e25511a0-e62a-442b-83ac-13e023d1ec94 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 14:01:24.808547 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-738d278a-8b0e-4017-9789-a6ff1c8b5bf3'] Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e25511a0-e62a-442b-83ac-13e023d1ec94 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1 HTTP/1.1 Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: exception: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-738d278a-8b0e-4017-9789-a6ff1c8b5bf3'] Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'be6a309d-91b7-4960-b649-5f06ed26b8c1'} Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:01:24.811275 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-738d278a-8b0e-4017-9789-a6ff1c8b5bf3'] Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-738d278a-8b0e-4017-9789-a6ff1c8b5bf3'] Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-738d278a-8b0e-4017-9789-a6ff1c8b5bf3'] Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-738d278a-8b0e-4017-9789-a6ff1c8b5bf3'] Aug 04 14:01:24.816062 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:24.819911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e25511a0-e62a-442b-83ac-13e023d1ec94 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Security group be6a309d-91b7-4960-b649-5f06ed26b8c1 does not exist Aug 04 14:01:24.819911 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-738d278a-8b0e-4017-9789-a6ff1c8b5bf3'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:24.821386 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e25511a0-e62a-442b-83ac-13e023d1ec94 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1" status: 404 len: 194 microversion: 2.1 time: 0.172977 Aug 04 14:01:24.822586 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 879/1736] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:01:24 2022] DELETE /compute/v2.1/os-security-groups/be6a309d-91b7-4960-b649-5f06ed26b8c1 => generated 194 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:24.843140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e183f678-323d-4ce7-bca5-8c296f12a7b8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4700a61160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:24.894339 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b13226b6-ad53-4f21-af70-fc46d60400d5 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.456897 Aug 04 14:01:24.897238 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 858/1737] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:01:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:24.925025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e1a237c-e3fc-4dfb-9b60-5078fae696bc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:24.937933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7e1a237c-e3fc-4dfb-9b60-5078fae696bc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:24.939628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7e1a237c-e3fc-4dfb-9b60-5078fae696bc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Searching by: {'deleted': False, 'project_id': 'ac3308acf403461d902ba64604e3382e'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:01:25.000560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e1a237c-e3fc-4dfb-9b60-5078fae696bc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:25.003400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e1a237c-e3fc-4dfb-9b60-5078fae696bc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:25.006047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e1a237c-e3fc-4dfb-9b60-5078fae696bc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:25.008513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e1a237c-e3fc-4dfb-9b60-5078fae696bc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:25.080537 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e183f678-323d-4ce7-bca5-8c296f12a7b8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.241880 Aug 04 14:01:25.098376 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 880/1738] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 14:01:24 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:25.133812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4c83e51c-0d2f-4e27-b7e4-8825ba770975 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:25.134683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c83e51c-0d2f-4e27-b7e4-8825ba770975 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:25.148464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c83e51c-0d2f-4e27-b7e4-8825ba770975 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:25.149296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c83e51c-0d2f-4e27-b7e4-8825ba770975 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:25.150375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c83e51c-0d2f-4e27-b7e4-8825ba770975 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:25.150997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c83e51c-0d2f-4e27-b7e4-8825ba770975 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:25.222038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c83e51c-0d2f-4e27-b7e4-8825ba770975 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:01:25.376703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-7e1a237c-e3fc-4dfb-9b60-5078fae696bc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:01:25.396058 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4c83e51c-0d2f-4e27-b7e4-8825ba770975 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 204 len: 0 microversion: 2.1 time: 0.295968 Aug 04 14:01:25.400172 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 881/1739] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:01:25 2022] DELETE /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:25.416363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e75b306-26c5-425d-bb84-4e7fb0f47ce7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:25.417516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e75b306-26c5-425d-bb84-4e7fb0f47ce7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:25.518311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e75b306-26c5-425d-bb84-4e7fb0f47ce7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:25.519144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e75b306-26c5-425d-bb84-4e7fb0f47ce7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:25.520591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e75b306-26c5-425d-bb84-4e7fb0f47ce7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:25.521421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e75b306-26c5-425d-bb84-4e7fb0f47ce7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:25.568660 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7e1a237c-e3fc-4dfb-9b60-5078fae696bc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.656583 Aug 04 14:01:25.570211 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 859/1740] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:01:24 2022] GET /compute/v2.1/servers => generated 1002 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:25.591007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2026932903", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "6d686b9e-cdea-4698-acf7-93f34e28847e"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:25.803968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] validate_networks() for [('6d686b9e-cdea-4698-acf7-93f34e28847e', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:01:26.319176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e75b306-26c5-425d-bb84-4e7fb0f47ce7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:26.354863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e75b306-26c5-425d-bb84-4e7fb0f47ce7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1504 microversion: 2.1 time: 0.952436 Aug 04 14:01:26.359936 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 882/1741] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:25 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1504 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:26.384311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae1b696e-a7d8-452e-a5d6-b2eb4c3ff314 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f470567af70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:27.558858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:01:27.561880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:01:27.563492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:01:27.565153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:01:27.566345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:01:27.587714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:27.589054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:27.591343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:27.592671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:27.600174 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae1b696e-a7d8-452e-a5d6-b2eb4c3ff314 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "DELETE /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49" status: 204 len: 0 microversion: 2.1 time: 1.235940 Aug 04 14:01:27.602224 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 883/1742] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:26 2022] DELETE /compute/v2.1/images/a6109e80-a9f7-48bf-9723-eb2e41e48a49 => generated 0 bytes in 1241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:27.619877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b3dcd2d-98e1-4d00-b7be-639732aba34c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:27.621845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b3dcd2d-98e1-4d00-b7be-639732aba34c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:27.653502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b3dcd2d-98e1-4d00-b7be-639732aba34c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:27.657388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b3dcd2d-98e1-4d00-b7be-639732aba34c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:27.661733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b3dcd2d-98e1-4d00-b7be-639732aba34c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:27.664602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b3dcd2d-98e1-4d00-b7be-639732aba34c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:27.687960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Getting quotas for project 2c78c75d748a4fe29f1bcdbe40d280a9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:27.691765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:27.715086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Getting quotas for user 69f66d07b9ed48d0b9e2763d9659df3f and project 2c78c75d748a4fe29f1bcdbe40d280a9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:27.794249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:01:27.800620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:01:28.052439 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e92060cb-9e7c-4c51-be8c-42ffb6bfe0fe tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480379 Aug 04 14:01:28.055631 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 860/1743] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:01:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:01:28.068356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0cf3b9d8-00c1-4209-8018-2b66cce71e48 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:28.070419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0cf3b9d8-00c1-4209-8018-2b66cce71e48 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:28.086293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cf3b9d8-00c1-4209-8018-2b66cce71e48 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:28.087312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cf3b9d8-00c1-4209-8018-2b66cce71e48 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:28.089078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cf3b9d8-00c1-4209-8018-2b66cce71e48 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:28.090042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cf3b9d8-00c1-4209-8018-2b66cce71e48 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:28.627181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4b3dcd2d-98e1-4d00-b7be-639732aba34c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:28.646969 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4b3dcd2d-98e1-4d00-b7be-639732aba34c tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1648 microversion: 2.1 time: 1.042764 Aug 04 14:01:28.668089 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 884/1744] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:27 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1648 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:28.693313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0e5da031-a416-4062-af5b-1926db24c6f9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:28.694112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0e5da031-a416-4062-af5b-1926db24c6f9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:28.711475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e5da031-a416-4062-af5b-1926db24c6f9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:28.713585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e5da031-a416-4062-af5b-1926db24c6f9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:28.717893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e5da031-a416-4062-af5b-1926db24c6f9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:28.719728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e5da031-a416-4062-af5b-1926db24c6f9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:29.109022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0e5da031-a416-4062-af5b-1926db24c6f9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:29.173340 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0e5da031-a416-4062-af5b-1926db24c6f9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1278 microversion: 2.1 time: 0.480466 Aug 04 14:01:29.177478 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 885/1745] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:28 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1278 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:29.211930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0cf3b9d8-00c1-4209-8018-2b66cce71e48 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:29.216244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5a07a04f-eff6-4201-8b7a-993bc2d7f0a6 req-f4d3201a-f706-4627-bf2c-b9956874e53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ebe867-4b9d-485d-8966-8f8ba3004e79", "name": "network-vif-unplugged", "status": "completed", "tag": "146e5ef7-a016-4406-86bd-d67bec04de40"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:29.225417 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0cf3b9d8-00c1-4209-8018-2b66cce71e48 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1805 microversion: 2.1 time: 1.165207 Aug 04 14:01:29.226887 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 861/1746] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:28 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1805 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:29.239944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3a2029a4-68d6-49f6-b9f4-5c293dac8192 req-57d04545-9cd1-4353-bc43-9fe01dca6905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc80476-6b5a-4dd1-922d-cce84e21d111", "tag": "5e940ed8-002c-484c-96fa-0461c38ab548"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:29.271603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3a2029a4-68d6-49f6-b9f4-5c293dac8192 req-57d04545-9cd1-4353-bc43-9fe01dca6905 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:29.273826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3a2029a4-68d6-49f6-b9f4-5c293dac8192 req-57d04545-9cd1-4353-bc43-9fe01dca6905 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:29.287551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5a07a04f-eff6-4201-8b7a-993bc2d7f0a6 req-f4d3201a-f706-4627-bf2c-b9956874e53d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:29.288037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5a07a04f-eff6-4201-8b7a-993bc2d7f0a6 req-f4d3201a-f706-4627-bf2c-b9956874e53d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:29.298299 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3a2029a4-68d6-49f6-b9f4-5c293dac8192 req-57d04545-9cd1-4353-bc43-9fe01dca6905 service nova] Creating event network-changed:5e940ed8-002c-484c-96fa-0461c38ab548 for instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 on n-h2-844627-10 Aug 04 14:01:29.304162 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3a2029a4-68d6-49f6-b9f4-5c293dac8192 req-57d04545-9cd1-4353-bc43-9fe01dca6905 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073409 Aug 04 14:01:29.305998 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 862/1747] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:29.312035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b208a360-898b-47b2-843a-deefb9890aac tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:29.312858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b208a360-898b-47b2-843a-deefb9890aac tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:29.338723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b208a360-898b-47b2-843a-deefb9890aac tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:29.339406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b208a360-898b-47b2-843a-deefb9890aac tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:29.340506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b208a360-898b-47b2-843a-deefb9890aac tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:29.341215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b208a360-898b-47b2-843a-deefb9890aac tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:29.341448 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5a07a04f-eff6-4201-8b7a-993bc2d7f0a6 req-f4d3201a-f706-4627-bf2c-b9956874e53d service nova] Creating event network-vif-unplugged:146e5ef7-a016-4406-86bd-d67bec04de40 for instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 on n-h1-844627-10 Aug 04 14:01:29.367766 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5a07a04f-eff6-4201-8b7a-993bc2d7f0a6 req-f4d3201a-f706-4627-bf2c-b9956874e53d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173821 Aug 04 14:01:29.373834 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 886/1748] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:29.395357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-589970ac-e915-4ad9-beaa-1b38cfabcb38 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4705609c10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:29.769373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b208a360-898b-47b2-843a-deefb9890aac tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:29.822524 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b208a360-898b-47b2-843a-deefb9890aac tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1504 microversion: 2.1 time: 0.514497 Aug 04 14:01:29.823602 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 863/1749] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:29 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:29.873189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-74b15b41-b3f0-4ae7-a983-ca8383d4b247 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:29.875606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-74b15b41-b3f0-4ae7-a983-ca8383d4b247 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:29.915091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74b15b41-b3f0-4ae7-a983-ca8383d4b247 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:29.917026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74b15b41-b3f0-4ae7-a983-ca8383d4b247 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:29.918982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74b15b41-b3f0-4ae7-a983-ca8383d4b247 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:29.920602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74b15b41-b3f0-4ae7-a983-ca8383d4b247 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:30.115657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74b15b41-b3f0-4ae7-a983-ca8383d4b247 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:30.176979 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-74b15b41-b3f0-4ae7-a983-ca8383d4b247 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1204 microversion: 2.1 time: 0.333292 Aug 04 14:01:30.180214 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 864/1750] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:29 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1204 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:30.196091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-916559565", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "16aa4d93-210e-4f85-a9b8-18b7b6afc7af"}], "block_device_mapping_v2": [{"uuid": "0703077b-125a-4790-9fce-4c9bae4fb36b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:30.380890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] validate_networks() for [('16aa4d93-210e-4f85-a9b8-18b7b6afc7af', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:01:30.578059 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-589970ac-e915-4ad9-beaa-1b38cfabcb38 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "DELETE /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa" status: 204 len: 0 microversion: 2.1 time: 1.199090 Aug 04 14:01:30.581002 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 887/1751] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:29 2022] DELETE /compute/v2.1/images/3a29545e-14ee-4046-963f-8f3e391d7eaa => generated 0 bytes in 1206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:30.602181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-60672506-3eff-49b7-855a-ac6859cabc23 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:30.605646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-60672506-3eff-49b7-855a-ac6859cabc23 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:30.621830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60672506-3eff-49b7-855a-ac6859cabc23 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:30.623297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60672506-3eff-49b7-855a-ac6859cabc23 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:30.626534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60672506-3eff-49b7-855a-ac6859cabc23 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:30.630006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60672506-3eff-49b7-855a-ac6859cabc23 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:30.703881 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-60672506-3eff-49b7-855a-ac6859cabc23 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a/ips" status: 200 len: 219 microversion: 2.1 time: 0.119342 Aug 04 14:01:30.705060 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 888/1752] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:01:30 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a/ips => generated 219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:30.711478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3dceec8-3662-4487-a351-9a7ff9c700f6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:30.712818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b3dceec8-3662-4487-a351-9a7ff9c700f6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:30.721606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3dceec8-3662-4487-a351-9a7ff9c700f6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:30.722358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3dceec8-3662-4487-a351-9a7ff9c700f6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:30.723836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3dceec8-3662-4487-a351-9a7ff9c700f6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:30.724790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3dceec8-3662-4487-a351-9a7ff9c700f6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:31.574069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b3dceec8-3662-4487-a351-9a7ff9c700f6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8010f6da241841b793874beedd1b8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55ed93281454b88b28fd3f6c24fc35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:31.585709 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3dceec8-3662-4487-a351-9a7ff9c700f6 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 200 len: 1648 microversion: 2.1 time: 0.877526 Aug 04 14:01:31.625125 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 889/1753] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:30 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 1648 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:31.643704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b78785db-8773-4bfd-90a0-baff495ae96e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:31.644753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b78785db-8773-4bfd-90a0-baff495ae96e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:31.665823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b78785db-8773-4bfd-90a0-baff495ae96e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:31.668008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b78785db-8773-4bfd-90a0-baff495ae96e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:31.669688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b78785db-8773-4bfd-90a0-baff495ae96e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:31.676277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b78785db-8773-4bfd-90a0-baff495ae96e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:31.950197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b78785db-8773-4bfd-90a0-baff495ae96e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:31.983935 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b78785db-8773-4bfd-90a0-baff495ae96e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1276 microversion: 2.1 time: 0.356780 Aug 04 14:01:31.996901 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 890/1754] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:31 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1276 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:32.005542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-364b1ab6-2bd3-44a8-93d1-1515f0c83aa2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f4705629310>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:33.025559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:01:33.026310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:01:33.027682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:01:33.028149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:01:33.028787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:01:33.078923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:33.081313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:33.089824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:33.093284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:33.232491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:33.279088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Getting quotas for user d9613691b93147d48d9f1a51bf5767c9 and project 5366e08e3ba74d8382c899c9a584bd4b. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:33.329085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:33.376074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:33.435339 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-364b1ab6-2bd3-44a8-93d1-1515f0c83aa2 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "DELETE /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39" status: 204 len: 0 microversion: 2.1 time: 1.447708 Aug 04 14:01:33.436012 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 891/1755] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:31 2022] DELETE /compute/v2.1/images/d5adfb2a-7aaf-4a1a-bd9e-74a27a610d39 => generated 0 bytes in 1450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:33.444368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a98c08c0-04a2-4dd7-b8c4-b4b6d34e0f13 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:33.445467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a98c08c0-04a2-4dd7-b8c4-b4b6d34e0f13 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:33.453494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a98c08c0-04a2-4dd7-b8c4-b4b6d34e0f13 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:33.454246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a98c08c0-04a2-4dd7-b8c4-b4b6d34e0f13 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:33.468629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a98c08c0-04a2-4dd7-b8c4-b4b6d34e0f13 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:33.469665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a98c08c0-04a2-4dd7-b8c4-b4b6d34e0f13 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:33.508902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a98c08c0-04a2-4dd7-b8c4-b4b6d34e0f13 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:01:33.559998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:01:33.565402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0703077b-125a-4790-9fce-4c9bae4fb36b',volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:01:33.668983 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a98c08c0-04a2-4dd7-b8c4-b4b6d34e0f13 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 204 len: 0 microversion: 2.1 time: 0.228785 Aug 04 14:01:33.670174 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 892/1756] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:01:33 2022] DELETE /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:33.686113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-45faaadd-e352-41c9-8c60-4885904c2c48 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:33.686113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-45faaadd-e352-41c9-8c60-4885904c2c48 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:33.695232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45faaadd-e352-41c9-8c60-4885904c2c48 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:33.696210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45faaadd-e352-41c9-8c60-4885904c2c48 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:33.697279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45faaadd-e352-41c9-8c60-4885904c2c48 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:33.697967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45faaadd-e352-41c9-8c60-4885904c2c48 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:33.999859 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e407542c-03d3-40c1-95c0-5f2739965dd2 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.816590 Aug 04 14:01:34.001002 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 865/1757] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:01:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3819 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:01:34.006766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1469722507", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7c037508-6409-4dae-8882-cadffa907fb1"}], "security_groups": [{"name": "tempest-securitygroup--1578829077"}], "key_name": "tempest-keypair-639420115", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:34.095043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-45faaadd-e352-41c9-8c60-4885904c2c48 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:34.111375 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-45faaadd-e352-41c9-8c60-4885904c2c48 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1504 microversion: 2.1 time: 0.437059 Aug 04 14:01:34.112805 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 893/1758] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:33 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:34.131661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-43b1bc78-6fe2-48bc-993c-e90f8ab1a14b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:34.133348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-43b1bc78-6fe2-48bc-993c-e90f8ab1a14b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:34.145763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43b1bc78-6fe2-48bc-993c-e90f8ab1a14b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:34.148506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43b1bc78-6fe2-48bc-993c-e90f8ab1a14b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:34.149615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43b1bc78-6fe2-48bc-993c-e90f8ab1a14b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:34.154196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43b1bc78-6fe2-48bc-993c-e90f8ab1a14b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:34.250924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=22 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:34.399593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] validate_networks() for [('7c037508-6409-4dae-8882-cadffa907fb1', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:01:35.240444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-43b1bc78-6fe2-48bc-993c-e90f8ab1a14b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:35.255498 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-43b1bc78-6fe2-48bc-993c-e90f8ab1a14b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1308 microversion: 2.1 time: 1.140066 Aug 04 14:01:35.256861 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 894/1759] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:34 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1308 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:35.268821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-1a4bbb35-0b44-4f81-b4da-f43ef904bccd req-fa5f4e60-2d5e-432c-b83a-87e36ad1019e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8", "name": "network-vif-deleted", "tag": "4b94338f-38f6-4326-98aa-c6b294584f3d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:35.299727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1a4bbb35-0b44-4f81-b4da-f43ef904bccd req-fa5f4e60-2d5e-432c-b83a-87e36ad1019e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:35.300214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1a4bbb35-0b44-4f81-b4da-f43ef904bccd req-fa5f4e60-2d5e-432c-b83a-87e36ad1019e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:35.344210 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-1a4bbb35-0b44-4f81-b4da-f43ef904bccd req-fa5f4e60-2d5e-432c-b83a-87e36ad1019e service nova] Creating event network-vif-deleted:4b94338f-38f6-4326-98aa-c6b294584f3d for instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 on n-h1-844627-10 Aug 04 14:01:35.357521 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-1a4bbb35-0b44-4f81-b4da-f43ef904bccd req-fa5f4e60-2d5e-432c-b83a-87e36ad1019e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096070 Aug 04 14:01:35.359139 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 895/1760] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:35.370945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f09a6508-da1f-4f82-9926-89bc12f42fd5 req-0573796c-c6cd-4439-9991-78cf129a18c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7ebe867-4b9d-485d-8966-8f8ba3004e79", "name": "network-vif-deleted", "tag": "146e5ef7-a016-4406-86bd-d67bec04de40"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:35.398186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f09a6508-da1f-4f82-9926-89bc12f42fd5 req-0573796c-c6cd-4439-9991-78cf129a18c7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:35.399251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f09a6508-da1f-4f82-9926-89bc12f42fd5 req-0573796c-c6cd-4439-9991-78cf129a18c7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:35.420388 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f09a6508-da1f-4f82-9926-89bc12f42fd5 req-0573796c-c6cd-4439-9991-78cf129a18c7 service nova] Creating event network-vif-deleted:146e5ef7-a016-4406-86bd-d67bec04de40 for instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 on n-h1-844627-10 Aug 04 14:01:35.431366 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f09a6508-da1f-4f82-9926-89bc12f42fd5 req-0573796c-c6cd-4439-9991-78cf129a18c7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067508 Aug 04 14:01:35.433226 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 896/1761] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:35.442206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:35.443565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] [instance: 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:35.455141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:35.455741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:35.456828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:35.457518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:35.479131 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] HTTP exception thrown: Instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 could not be found. Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Request method failure captured: Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 HTTP/1.1 Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69CJuTY2gD9rFPJcor3Q-6M9kbRAWKBPIZmXO6FdpmYu74vM-xiurxIy23KhPNlJKRIOSukBE2cxSH6LWFZLVLK7_dpr1pk0PEvuRRmWLQ4iPbVCWz6Or_itU0GKReeHki5z69cdHmgOmHsPLK1aYbAmX4umCOPfvPexQMv5qVGwA2A Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c55ed93281454b88b28fd3f6c24fc35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c55ed93281454b88b28fd3f6c24fc35f"}]}] Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c55ed93281454b88b28fd3f6c24fc35f Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1829122517 Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8010f6da241841b793874beedd1b8585 Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsTestJSON-1829122517-project Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 could not be found. Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8'} Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 could not be found. Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 could not be found. Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:35.482929 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:35.487973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:35.487973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:35.487973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:35.487973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:35.487973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:35.487973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 could not be found. Aug 04 14:01:35.487973 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:35.489945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Returning 404 to user: Instance 264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:35.491212 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-808472ba-b538-4990-833c-fd77a5a51a14 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8" status: 404 len: 111 microversion: 2.1 time: 0.055341 Aug 04 14:01:35.492564 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 897/1762] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:35 2022] GET /compute/v2.1/servers/264d3d7b-5d21-4eb1-8bfb-d41cdf0ccec8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:35.502701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d8c7ad3-a29e-47e1-90a5-f08de4ff56fd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:35.503526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d8c7ad3-a29e-47e1-90a5-f08de4ff56fd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:35.516246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ad3-a29e-47e1-90a5-f08de4ff56fd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:35.517224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ad3-a29e-47e1-90a5-f08de4ff56fd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:35.522131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ad3-a29e-47e1-90a5-f08de4ff56fd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:35.524289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8c7ad3-a29e-47e1-90a5-f08de4ff56fd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:36.107868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d8c7ad3-a29e-47e1-90a5-f08de4ff56fd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:36.126760 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d8c7ad3-a29e-47e1-90a5-f08de4ff56fd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1318 microversion: 2.1 time: 0.631987 Aug 04 14:01:36.127934 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 898/1763] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:35 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:36.192943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-743e2d49-e378-4d59-a337-aad3b51321e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:36.194699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-743e2d49-e378-4d59-a337-aad3b51321e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:36.205391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-743e2d49-e378-4d59-a337-aad3b51321e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:36.206231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-743e2d49-e378-4d59-a337-aad3b51321e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:36.213201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-743e2d49-e378-4d59-a337-aad3b51321e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:36.214085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-743e2d49-e378-4d59-a337-aad3b51321e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:36.376982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-743e2d49-e378-4d59-a337-aad3b51321e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:01:36.514537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Getting quotas for project 1b1dd46f08d443288c68e2439b02f407. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:36.525296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Getting quotas for user 82728e57699e4154a1f2961e2801eb17 and project 1b1dd46f08d443288c68e2439b02f407. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:36.544062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:01:36.545035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:01:36.545695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:01:36.546374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:01:36.546966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:01:36.561463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:36.562357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:36.563526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:36.564269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:36.598193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Getting quotas for project 1b1dd46f08d443288c68e2439b02f407. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:36.642133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Getting quotas for user 82728e57699e4154a1f2961e2801eb17 and project 1b1dd46f08d443288c68e2439b02f407. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:36.665733 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-743e2d49-e378-4d59-a337-aad3b51321e4 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "DELETE /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 204 len: 0 microversion: 2.1 time: 0.494367 Aug 04 14:01:36.671519 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 899/1764] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:01:36 2022] DELETE /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:36.682539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:01:36.686745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:01:36.689803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e248933-e983-4d13-95b3-b4d6ec1688d8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:36.690958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8e248933-e983-4d13-95b3-b4d6ec1688d8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:36.706349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e248933-e983-4d13-95b3-b4d6ec1688d8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:36.707320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e248933-e983-4d13-95b3-b4d6ec1688d8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:36.708978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e248933-e983-4d13-95b3-b4d6ec1688d8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:36.709904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e248933-e983-4d13-95b3-b4d6ec1688d8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:36.796685 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-83096e0f-2df6-4a76-9413-00f2d4fc53ae tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.793897 Aug 04 14:01:36.808358 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 866/1765] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:01:34 2022] POST /compute/v2.1/servers => generated 407 bytes in 2806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:01:36.821226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:36.822843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:36.846113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:36.850422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:36.852151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:36.858960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:37.304303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:37.316306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=89 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:37.328893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:37.333891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:37.335122 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a63b75d2-60fa-42c4-bfb2-46672ee9cae7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1250 microversion: 2.25 time: 0.524750 Aug 04 14:01:37.352108 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 867/1766] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:01:36 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1250 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:37.360018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a41fed49-37a6-49d5-a106-d53571e5f3d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:37.363582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a41fed49-37a6-49d5-a106-d53571e5f3d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:37.381474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a41fed49-37a6-49d5-a106-d53571e5f3d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:37.384594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a41fed49-37a6-49d5-a106-d53571e5f3d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:37.388951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a41fed49-37a6-49d5-a106-d53571e5f3d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:37.390815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a41fed49-37a6-49d5-a106-d53571e5f3d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:38.382102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8e248933-e983-4d13-95b3-b4d6ec1688d8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:38.395014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e248933-e983-4d13-95b3-b4d6ec1688d8 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1790 microversion: 2.1 time: 1.724113 Aug 04 14:01:38.417063 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 900/1767] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:36 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1790 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:38.431930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4219878c-4187-435a-a707-268c9ba68462 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f47055feca0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:38.877822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a41fed49-37a6-49d5-a106-d53571e5f3d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:38.907222 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a41fed49-37a6-49d5-a106-d53571e5f3d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1504 microversion: 2.1 time: 1.565219 Aug 04 14:01:38.907941 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 868/1768] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:37 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1504 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:38.925352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eb437c2d-7066-4f08-b6a2-8e05eee90879 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:38.928402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eb437c2d-7066-4f08-b6a2-8e05eee90879 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:38.953276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb437c2d-7066-4f08-b6a2-8e05eee90879 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:38.954078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb437c2d-7066-4f08-b6a2-8e05eee90879 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:38.955023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb437c2d-7066-4f08-b6a2-8e05eee90879 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:38.955477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb437c2d-7066-4f08-b6a2-8e05eee90879 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:39.682929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eb437c2d-7066-4f08-b6a2-8e05eee90879 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:39.697722 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eb437c2d-7066-4f08-b6a2-8e05eee90879 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1308 microversion: 2.1 time: 0.786655 Aug 04 14:01:39.699967 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 869/1769] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:38 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1308 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:39.711160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3ab64b3-a921-470d-8222-ca2c3bb61cab tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:39.713893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3ab64b3-a921-470d-8222-ca2c3bb61cab tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:39.736369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3ab64b3-a921-470d-8222-ca2c3bb61cab tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:39.736907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3ab64b3-a921-470d-8222-ca2c3bb61cab tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:39.737754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3ab64b3-a921-470d-8222-ca2c3bb61cab tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:39.738132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3ab64b3-a921-470d-8222-ca2c3bb61cab tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:40.124000 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4219878c-4187-435a-a707-268c9ba68462 tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/563d8499-c779-4e25-81f1-bd0714e70c34" status: 202 len: 0 microversion: 2.1 time: 1.704640 Aug 04 14:01:40.126469 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 901/1770] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:01:38 2022] DELETE /compute/v2.1/os-security-groups/563d8499-c779-4e25-81f1-bd0714e70c34 => generated 0 bytes in 1709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:40.135931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d95c4f85-a822-4d40-aab2-3ba8000a2c3b tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:40.137160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d95c4f85-a822-4d40-aab2-3ba8000a2c3b tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:40.182148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d95c4f85-a822-4d40-aab2-3ba8000a2c3b tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:40.186826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d95c4f85-a822-4d40-aab2-3ba8000a2c3b tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:40.188077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d95c4f85-a822-4d40-aab2-3ba8000a2c3b tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:40.189682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d95c4f85-a822-4d40-aab2-3ba8000a2c3b tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:40.453079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d95c4f85-a822-4d40-aab2-3ba8000a2c3b tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:40.471669 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d95c4f85-a822-4d40-aab2-3ba8000a2c3b tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1327 microversion: 2.1 time: 0.342726 Aug 04 14:01:40.478182 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 902/1771] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:40 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1327 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:40.493499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bae9b5a3-7b93-4033-8f88-a2d8bba31835 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:40.494527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bae9b5a3-7b93-4033-8f88-a2d8bba31835 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:40.510957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bae9b5a3-7b93-4033-8f88-a2d8bba31835 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:40.511473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bae9b5a3-7b93-4033-8f88-a2d8bba31835 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:40.512959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bae9b5a3-7b93-4033-8f88-a2d8bba31835 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:40.513474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bae9b5a3-7b93-4033-8f88-a2d8bba31835 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:40.562446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:40.569859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3ab64b3-a921-470d-8222-ca2c3bb61cab tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:40.589584 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3ab64b3-a921-470d-8222-ca2c3bb61cab tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 200 len: 1474 microversion: 2.1 time: 0.886527 Aug 04 14:01:40.590861 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 870/1772] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:39 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 1474 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:40.608660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-fed4d3ac-7b5d-425b-b2d9-6459b5cc6a33 req-cd56728a-1337-4dc4-b893-a35fd7d3d4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "name": "network-vif-deleted", "tag": "a00f1532-d8af-42b6-a5fa-0d4361f45248"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:40.622938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fed4d3ac-7b5d-425b-b2d9-6459b5cc6a33 req-cd56728a-1337-4dc4-b893-a35fd7d3d4f4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:40.623750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fed4d3ac-7b5d-425b-b2d9-6459b5cc6a33 req-cd56728a-1337-4dc4-b893-a35fd7d3d4f4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:40.641254 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fed4d3ac-7b5d-425b-b2d9-6459b5cc6a33 req-cd56728a-1337-4dc4-b893-a35fd7d3d4f4 service nova] Creating event network-vif-deleted:a00f1532-d8af-42b6-a5fa-0d4361f45248 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:40.648774 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-fed4d3ac-7b5d-425b-b2d9-6459b5cc6a33 req-cd56728a-1337-4dc4-b893-a35fd7d3d4f4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051211 Aug 04 14:01:40.650065 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 871/1773] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:40.659278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f2031b92-247b-44e7-9f05-ce0e7aa3cc02 req-b6d4fddb-7d21-4ed1-b986-087a91d89d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ec0807-aa9c-4f56-a110-1aaf8083233e", "tag": "2fdbab1d-a877-44d3-967f-8d1cbd4cd82d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:40.676483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f2031b92-247b-44e7-9f05-ce0e7aa3cc02 req-b6d4fddb-7d21-4ed1-b986-087a91d89d14 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:40.677335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f2031b92-247b-44e7-9f05-ce0e7aa3cc02 req-b6d4fddb-7d21-4ed1-b986-087a91d89d14 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:40.692703 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f2031b92-247b-44e7-9f05-ce0e7aa3cc02 req-b6d4fddb-7d21-4ed1-b986-087a91d89d14 service nova] Creating event network-changed:2fdbab1d-a877-44d3-967f-8d1cbd4cd82d for instance 51ec0807-aa9c-4f56-a110-1aaf8083233e on n-h2-844627-10 Aug 04 14:01:40.699994 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f2031b92-247b-44e7-9f05-ce0e7aa3cc02 req-b6d4fddb-7d21-4ed1-b986-087a91d89d14 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048266 Aug 04 14:01:40.701923 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 872/1774] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:40.708916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-fad88598-947e-4e65-9bef-00a9439214b5 req-9466ba12-461b-4b45-9632-b2cad46d1959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "name": "network-vif-unplugged", "status": "completed", "tag": "e930bb33-75cd-4b4d-8598-7349c9f87499"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:40.723438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fad88598-947e-4e65-9bef-00a9439214b5 req-9466ba12-461b-4b45-9632-b2cad46d1959 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:40.724414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fad88598-947e-4e65-9bef-00a9439214b5 req-9466ba12-461b-4b45-9632-b2cad46d1959 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:40.744336 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fad88598-947e-4e65-9bef-00a9439214b5 req-9466ba12-461b-4b45-9632-b2cad46d1959 service nova] Creating event network-vif-unplugged:e930bb33-75cd-4b4d-8598-7349c9f87499 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:40.753403 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-fad88598-947e-4e65-9bef-00a9439214b5 req-9466ba12-461b-4b45-9632-b2cad46d1959 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048815 Aug 04 14:01:40.763573 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 873/1775] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:40.773359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:40.774545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:40.790434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:40.791353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:40.792420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:40.793180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:41.648264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bae9b5a3-7b93-4033-8f88-a2d8bba31835 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:41.660004 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bae9b5a3-7b93-4033-8f88-a2d8bba31835 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1318 microversion: 2.1 time: 1.180308 Aug 04 14:01:41.660619 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 903/1776] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:40 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1318 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:41.671975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dbfdefc4-7c55-425b-ac24-c0ca659ee7e5 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:41.673022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dbfdefc4-7c55-425b-ac24-c0ca659ee7e5 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:41.681035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbfdefc4-7c55-425b-ac24-c0ca659ee7e5 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:41.681562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbfdefc4-7c55-425b-ac24-c0ca659ee7e5 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:41.682382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbfdefc4-7c55-425b-ac24-c0ca659ee7e5 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:41.682838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbfdefc4-7c55-425b-ac24-c0ca659ee7e5 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:41.723616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:41.733248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:41.735566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:41.737203 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a977c1ba-929e-4397-87c3-62cd49f19e74 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1292 microversion: 2.25 time: 0.972056 Aug 04 14:01:41.738414 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 874/1777] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:01:40 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1292 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:41.743516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-12558487-86ba-4247-94be-8890140f10d9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:41.744483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-12558487-86ba-4247-94be-8890140f10d9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:41.752452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12558487-86ba-4247-94be-8890140f10d9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:41.753361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12558487-86ba-4247-94be-8890140f10d9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:41.754417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12558487-86ba-4247-94be-8890140f10d9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:41.755133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12558487-86ba-4247-94be-8890140f10d9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:42.704707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-12558487-86ba-4247-94be-8890140f10d9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:42.713783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dbfdefc4-7c55-425b-ac24-c0ca659ee7e5 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:42.725505 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-12558487-86ba-4247-94be-8890140f10d9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1504 microversion: 2.1 time: 0.985708 Aug 04 14:01:42.726136 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dbfdefc4-7c55-425b-ac24-c0ca659ee7e5 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 200 len: 1655 microversion: 2.1 time: 1.060840 Aug 04 14:01:42.727329 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 875/1779] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:41 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1504 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:42.727546 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 904/1779] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:41 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 1655 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:42.733538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f4715b00-2159-4743-9f7f-f34ae729ffcd tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] Calling method '.version_select at 0x7f46f3c9a700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:42.744535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-660db477-1c49-4583-a2be-b4bdbe85869e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:42.745332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-660db477-1c49-4583-a2be-b4bdbe85869e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:42.755070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-660db477-1c49-4583-a2be-b4bdbe85869e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:42.757550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-660db477-1c49-4583-a2be-b4bdbe85869e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:42.759488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-660db477-1c49-4583-a2be-b4bdbe85869e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:42.760318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-660db477-1c49-4583-a2be-b4bdbe85869e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:43.443375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-660db477-1c49-4583-a2be-b4bdbe85869e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:43.469183 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-660db477-1c49-4583-a2be-b4bdbe85869e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1308 microversion: 2.1 time: 0.739805 Aug 04 14:01:43.470667 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 905/1780] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:42 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1308 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:43.490726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84d654cc-8862-4fac-9fcc-1c54c8481f9d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:43.491841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84d654cc-8862-4fac-9fcc-1c54c8481f9d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:43.514853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d654cc-8862-4fac-9fcc-1c54c8481f9d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:43.515618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d654cc-8862-4fac-9fcc-1c54c8481f9d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:43.523061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d654cc-8862-4fac-9fcc-1c54c8481f9d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:43.524009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d654cc-8862-4fac-9fcc-1c54c8481f9d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:43.749973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84d654cc-8862-4fac-9fcc-1c54c8481f9d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:43.785943 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84d654cc-8862-4fac-9fcc-1c54c8481f9d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1327 microversion: 2.1 time: 0.313146 Aug 04 14:01:43.787858 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 906/1781] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:43 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1327 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:43.801387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:43.814637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 691963ac-14bf-4d48-9c45-643a5efa71aa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:43.841890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:43.843195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:43.845259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:43.846429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:43.911163 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] HTTP exception thrown: Instance 691963ac-14bf-4d48-9c45-643a5efa71aa could not be found. Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Request method failure captured: Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa HTTP/1.1 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69BiEzxBH4Su4b_ymv2cFRmjPTncbfvqxCbbaB5EKhbWMIaKDIAfsetmIBB-fF4p_tqm7ACkPZwdSvBZSUww9C5QNopjXLObLCkn7ejlcIj_-pO9_gCe7D0y57ydjZDMWd-fKIgZkBpEoLijoOGJeDzFYXTui1V96Ws5qBUKDdrwdd0 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1b0e9ddfb4d04991834cb85bc7693736 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListImageFiltersTestJSON-268912769 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b0e9ddfb4d04991834cb85bc7693736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1b0e9ddfb4d04991834cb85bc7693736"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1b0e9ddfb4d04991834cb85bc7693736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b0e9ddfb4d04991834cb85bc7693736"}]}] Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListImageFiltersTestJSON-268912769 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1b0e9ddfb4d04991834cb85bc7693736 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-268912769 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListImageFiltersTestJSON-268912769-project Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 352ca66812034cceb38694b98993fab5 Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListImageFiltersTestJSON-268912769-project Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 691963ac-14bf-4d48-9c45-643a5efa71aa could not be found. Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '691963ac-14bf-4d48-9c45-643a5efa71aa'} Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 691963ac-14bf-4d48-9c45-643a5efa71aa could not be found. Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 691963ac-14bf-4d48-9c45-643a5efa71aa could not be found. Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:43.920490 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:43.930262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:43.930262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:43.930262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:43.930262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:43.930262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:43.930262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 691963ac-14bf-4d48-9c45-643a5efa71aa could not be found. Aug 04 14:01:43.930262 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:43.935027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Returning 404 to user: Instance 691963ac-14bf-4d48-9c45-643a5efa71aa could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:43.937082 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d45f35de-be00-4518-b817-132f4029dd9f tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa" status: 404 len: 111 microversion: 2.1 time: 0.146946 Aug 04 14:01:43.943460 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 907/1782] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:43 2022] GET /compute/v2.1/servers/691963ac-14bf-4d48-9c45-643a5efa71aa => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:43.953358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1624125c-b49d-4650-9e61-3e1ef41a5ef8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:43.954976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1624125c-b49d-4650-9e61-3e1ef41a5ef8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:43.983321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1624125c-b49d-4650-9e61-3e1ef41a5ef8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:43.983783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1624125c-b49d-4650-9e61-3e1ef41a5ef8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:43.984621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1624125c-b49d-4650-9e61-3e1ef41a5ef8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:43.985250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1624125c-b49d-4650-9e61-3e1ef41a5ef8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:44.164922 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f4715b00-2159-4743-9f7f-f34ae729ffcd tempest-SecurityGroupsTestJSON-1829122517 tempest-SecurityGroupsTestJSON-1829122517-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/a320af46-7eb5-4529-9c22-a37a270abdc4" status: 202 len: 0 microversion: 2.1 time: 1.435503 Aug 04 14:01:44.170770 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 876/1783] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:01:42 2022] DELETE /compute/v2.1/os-security-groups/a320af46-7eb5-4529-9c22-a37a270abdc4 => generated 0 bytes in 1439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:44.189068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7f268f3e-36ec-465b-ae21-d9212516727b req-9ed328ac-2a0f-4535-ab50-724c354edccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff40e66-7ec3-44cd-b16b-c45f94bd0b77", "tag": "c12ce3a2-3807-40e9-ae8f-407560c1b4ab"}, {"server_uuid": "691963ac-14bf-4d48-9c45-643a5efa71aa", "name": "network-vif-deleted", "tag": "bf8eeb52-7009-43e9-97bf-d0b34751ba4f"}, {"server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "name": "network-vif-deleted", "tag": "e930bb33-75cd-4b4d-8598-7349c9f87499"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:44.211224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7f268f3e-36ec-465b-ae21-d9212516727b req-9ed328ac-2a0f-4535-ab50-724c354edccf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:44.211975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7f268f3e-36ec-465b-ae21-d9212516727b req-9ed328ac-2a0f-4535-ab50-724c354edccf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:44.249561 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7f268f3e-36ec-465b-ae21-d9212516727b req-9ed328ac-2a0f-4535-ab50-724c354edccf service nova] Creating event network-changed:c12ce3a2-3807-40e9-ae8f-407560c1b4ab for instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 on n-h1-844627-10 Aug 04 14:01:44.251340 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7f268f3e-36ec-465b-ae21-d9212516727b req-9ed328ac-2a0f-4535-ab50-724c354edccf service nova] Creating event network-vif-deleted:bf8eeb52-7009-43e9-97bf-d0b34751ba4f for instance 691963ac-14bf-4d48-9c45-643a5efa71aa on n-h2-844627-10 Aug 04 14:01:44.253095 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7f268f3e-36ec-465b-ae21-d9212516727b req-9ed328ac-2a0f-4535-ab50-724c354edccf service nova] Creating event network-vif-deleted:e930bb33-75cd-4b4d-8598-7349c9f87499 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:44.293520 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7f268f3e-36ec-465b-ae21-d9212516727b req-9ed328ac-2a0f-4535-ab50-724c354edccf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.122617 Aug 04 14:01:44.295250 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 877/1784] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:44.305926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f4172d5b-19bc-4306-8a73-4e3ee09437a1 req-87a601d2-4b9b-4074-8221-ba0459346346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7b62d1-dac8-455d-a695-9fc845814ee6", "tag": "2051b507-b0c9-477e-8ef6-8fdbf26c7ad5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:44.333894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f4172d5b-19bc-4306-8a73-4e3ee09437a1 req-87a601d2-4b9b-4074-8221-ba0459346346 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:44.335505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f4172d5b-19bc-4306-8a73-4e3ee09437a1 req-87a601d2-4b9b-4074-8221-ba0459346346 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:44.363502 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f4172d5b-19bc-4306-8a73-4e3ee09437a1 req-87a601d2-4b9b-4074-8221-ba0459346346 service nova] Creating event network-changed:2051b507-b0c9-477e-8ef6-8fdbf26c7ad5 for instance fa7b62d1-dac8-455d-a695-9fc845814ee6 on n-h2-844627-10 Aug 04 14:01:44.393145 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f4172d5b-19bc-4306-8a73-4e3ee09437a1 req-87a601d2-4b9b-4074-8221-ba0459346346 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095986 Aug 04 14:01:44.396270 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 878/1785] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:44.405366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:44.406380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:44.419072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:44.420169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:44.422410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:44.423091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:45.004927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1624125c-b49d-4650-9e61-3e1ef41a5ef8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:45.019769 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1624125c-b49d-4650-9e61-3e1ef41a5ef8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1318 microversion: 2.1 time: 1.073230 Aug 04 14:01:45.021410 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 908/1786] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:43 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1318 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:45.046821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-deb3e4e3-ab05-43e0-a1e8-bec3113d87ce req-44cb9185-9214-4009-b525-1516f42801c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "name": "network-vif-unplugged", "status": "completed", "tag": "d65c8838-3acf-43d6-b270-66d7dd7ce838"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:45.066311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-deb3e4e3-ab05-43e0-a1e8-bec3113d87ce req-44cb9185-9214-4009-b525-1516f42801c9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:45.069109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-deb3e4e3-ab05-43e0-a1e8-bec3113d87ce req-44cb9185-9214-4009-b525-1516f42801c9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:45.087000 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-deb3e4e3-ab05-43e0-a1e8-bec3113d87ce req-44cb9185-9214-4009-b525-1516f42801c9 service nova] Creating event network-vif-unplugged:d65c8838-3acf-43d6-b270-66d7dd7ce838 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:45.095755 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-deb3e4e3-ab05-43e0-a1e8-bec3113d87ce req-44cb9185-9214-4009-b525-1516f42801c9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072576 Aug 04 14:01:45.097251 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 909/1787] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:45.104189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-82678be5-0522-4425-9294-5bbc4b9d6dc8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:45.105411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-82678be5-0522-4425-9294-5bbc4b9d6dc8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:45.114640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82678be5-0522-4425-9294-5bbc4b9d6dc8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:45.115407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82678be5-0522-4425-9294-5bbc4b9d6dc8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:45.116443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82678be5-0522-4425-9294-5bbc4b9d6dc8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:45.117170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82678be5-0522-4425-9294-5bbc4b9d6dc8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:45.892211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:45.918445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:45.923020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:45.925389 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9ac54b0d-6989-4f04-adf0-a873b9b1e99b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1292 microversion: 2.25 time: 1.527309 Aug 04 14:01:45.927613 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 879/1788] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:01:44 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1292 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:45.936302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:45.938202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:45.948175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:45.949129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:45.950342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:45.951397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:46.021496 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] HTTP exception thrown: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Request method failure captured: Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a HTTP/1.1 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69D-F1tJWtwbtqay1-L97ENGkD52ZUtd9PRDGh-eJzsM2ajAYovg4WBbZoK3Y2qbzCuIudw-vezuJqW5ozYkShbssOXz97jz6OSai_7p8O0Asx6B0oRxvpUW3hLTWBCBMgVzYayZPrQJLsTjb1AKgGwx30c9Rh9gN3Y6Uj94Fs5YM6g Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}] Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestMultiNic-1859673299 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f0f7db7c684842e998aaf40a738ee665 Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a'} Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:46.024187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:46.030139 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:46.030139 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:46.030139 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:46.030139 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:46.030139 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:46.030139 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:01:46.030139 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:01:46.034302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Returning 404 to user: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:46.035560 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-33516e3e-b94e-40d2-86ce-1e76cf58c5c7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 404 len: 111 microversion: 2.1 time: 0.106470 Aug 04 14:01:46.037473 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 880/1789] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:45 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:46.044369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7005844a-868e-431d-b5bb-f9f91b345684 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:46.045306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7005844a-868e-431d-b5bb-f9f91b345684 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:46.055394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7005844a-868e-431d-b5bb-f9f91b345684 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:46.056099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7005844a-868e-431d-b5bb-f9f91b345684 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:46.058188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7005844a-868e-431d-b5bb-f9f91b345684 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:46.059595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7005844a-868e-431d-b5bb-f9f91b345684 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:46.101710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7005844a-868e-431d-b5bb-f9f91b345684 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:01:46.311207 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7005844a-868e-431d-b5bb-f9f91b345684 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507" status: 204 len: 0 microversion: 2.1 time: 0.271102 Aug 04 14:01:46.317013 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 881/1790] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:01:46 2022] DELETE /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:46.322309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-792f6c7b-3b51-4097-abee-5b5de533e021 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:46.323327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-792f6c7b-3b51-4097-abee-5b5de533e021 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:46.333714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-792f6c7b-3b51-4097-abee-5b5de533e021 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:46.334581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-792f6c7b-3b51-4097-abee-5b5de533e021 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:46.336312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-792f6c7b-3b51-4097-abee-5b5de533e021 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:46.336973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-792f6c7b-3b51-4097-abee-5b5de533e021 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:46.568826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-82678be5-0522-4425-9294-5bbc4b9d6dc8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:46.578683 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-82678be5-0522-4425-9294-5bbc4b9d6dc8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1494 microversion: 2.1 time: 1.479652 Aug 04 14:01:46.580209 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 910/1791] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:45 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1494 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:46.585159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:46.585907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b5ee6efe-b230-471e-aac7-8ad7e79c949f tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:46.586829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b5ee6efe-b230-471e-aac7-8ad7e79c949f tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:46.601265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5ee6efe-b230-471e-aac7-8ad7e79c949f tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:46.602532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5ee6efe-b230-471e-aac7-8ad7e79c949f tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:46.606279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5ee6efe-b230-471e-aac7-8ad7e79c949f tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:46.607139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5ee6efe-b230-471e-aac7-8ad7e79c949f tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:46.669422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=34 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:47.186799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-792f6c7b-3b51-4097-abee-5b5de533e021 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:47.201846 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-792f6c7b-3b51-4097-abee-5b5de533e021 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1308 microversion: 2.1 time: 0.887886 Aug 04 14:01:47.202842 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 882/1792] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:46 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1308 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:47.212468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-532cb344-f458-4737-9535-70f2f2aa3323 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:47.214309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-532cb344-f458-4737-9535-70f2f2aa3323 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:47.228248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-532cb344-f458-4737-9535-70f2f2aa3323 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:47.229779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-532cb344-f458-4737-9535-70f2f2aa3323 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:47.232928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-532cb344-f458-4737-9535-70f2f2aa3323 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:47.233641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-532cb344-f458-4737-9535-70f2f2aa3323 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:47.362528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b5ee6efe-b230-471e-aac7-8ad7e79c949f tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:47.379801 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b5ee6efe-b230-471e-aac7-8ad7e79c949f tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1395 microversion: 2.1 time: 0.797934 Aug 04 14:01:47.386549 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 911/1793] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:46 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1395 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:47.396899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-39de6c62-aa5a-4b68-bef5-f2359cb6d49b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:47.397894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-39de6c62-aa5a-4b68-bef5-f2359cb6d49b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:47.425565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39de6c62-aa5a-4b68-bef5-f2359cb6d49b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:47.426474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39de6c62-aa5a-4b68-bef5-f2359cb6d49b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:47.427587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39de6c62-aa5a-4b68-bef5-f2359cb6d49b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:47.428220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39de6c62-aa5a-4b68-bef5-f2359cb6d49b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:48.380053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-532cb344-f458-4737-9535-70f2f2aa3323 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:48.389869 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-532cb344-f458-4737-9535-70f2f2aa3323 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1318 microversion: 2.1 time: 1.185030 Aug 04 14:01:48.390600 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 883/1794] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:47 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1318 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:48.396784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ca3289bb-87a8-4d22-b7fc-745bfbadef66 req-643eda7a-30ad-4ec5-b3a0-9232eb5f1ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933d36e2-d798-4136-8f33-ce878c78dbe8", "tag": "1d4c4e52-3e24-4f0c-98af-9f15be4642dd"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:48.411645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ca3289bb-87a8-4d22-b7fc-745bfbadef66 req-643eda7a-30ad-4ec5-b3a0-9232eb5f1ba7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:48.412388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ca3289bb-87a8-4d22-b7fc-745bfbadef66 req-643eda7a-30ad-4ec5-b3a0-9232eb5f1ba7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:48.429988 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ca3289bb-87a8-4d22-b7fc-745bfbadef66 req-643eda7a-30ad-4ec5-b3a0-9232eb5f1ba7 service nova] Creating event network-changed:1d4c4e52-3e24-4f0c-98af-9f15be4642dd for instance 933d36e2-d798-4136-8f33-ce878c78dbe8 on n-h1-844627-10 Aug 04 14:01:48.436967 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ca3289bb-87a8-4d22-b7fc-745bfbadef66 req-643eda7a-30ad-4ec5-b3a0-9232eb5f1ba7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044919 Aug 04 14:01:48.437957 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 884/1795] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:48.444999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f5c78316-f44f-4cf7-b92e-88c2bac2c94e req-edd19506-0078-4d33-82b2-44ee177cab05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a", "name": "network-vif-deleted", "tag": "d65c8838-3acf-43d6-b270-66d7dd7ce838"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:48.456618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f5c78316-f44f-4cf7-b92e-88c2bac2c94e req-edd19506-0078-4d33-82b2-44ee177cab05 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:48.457107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f5c78316-f44f-4cf7-b92e-88c2bac2c94e req-edd19506-0078-4d33-82b2-44ee177cab05 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:48.470961 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f5c78316-f44f-4cf7-b92e-88c2bac2c94e req-edd19506-0078-4d33-82b2-44ee177cab05 service nova] Creating event network-vif-deleted:d65c8838-3acf-43d6-b270-66d7dd7ce838 for instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a on n-h2-844627-10 Aug 04 14:01:48.476805 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f5c78316-f44f-4cf7-b92e-88c2bac2c94e req-edd19506-0078-4d33-82b2-44ee177cab05 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036629 Aug 04 14:01:48.477470 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 885/1796] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:48.483216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-922154f9-6f90-4ac5-8ec1-6843e24e8410 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '.version_select at 0x7f46f3d3c820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:48.487814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-922154f9-6f90-4ac5-8ec1-6843e24e8410 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:48.488272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-922154f9-6f90-4ac5-8ec1-6843e24e8410 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:48.500322 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-922154f9-6f90-4ac5-8ec1-6843e24e8410 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.021260 Aug 04 14:01:48.501322 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 886/1797] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 14:01:48 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:48.508653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:48.510012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:48.523288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:48.524300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:48.525983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:48.527517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:48.897088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-39de6c62-aa5a-4b68-bef5-f2359cb6d49b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:48.928780 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-39de6c62-aa5a-4b68-bef5-f2359cb6d49b tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507" status: 200 len: 1474 microversion: 2.1 time: 1.529312 Aug 04 14:01:48.932398 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 912/1798] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:47 2022] GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507 => generated 1474 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:48.940834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-33db7a6b-2761-4a19-8241-87fed2b188d8 req-0d8828aa-1b25-4a47-bf0d-49966f64d3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff40e66-7ec3-44cd-b16b-c45f94bd0b77", "name": "network-vif-plugged", "status": "completed", "tag": "c12ce3a2-3807-40e9-ae8f-407560c1b4ab"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:48.957823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-33db7a6b-2761-4a19-8241-87fed2b188d8 req-0d8828aa-1b25-4a47-bf0d-49966f64d3f2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:48.958989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-33db7a6b-2761-4a19-8241-87fed2b188d8 req-0d8828aa-1b25-4a47-bf0d-49966f64d3f2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:48.990963 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-33db7a6b-2761-4a19-8241-87fed2b188d8 req-0d8828aa-1b25-4a47-bf0d-49966f64d3f2 service nova] Creating event network-vif-plugged:c12ce3a2-3807-40e9-ae8f-407560c1b4ab for instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 on n-h1-844627-10 Aug 04 14:01:49.001194 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-33db7a6b-2761-4a19-8241-87fed2b188d8 req-0d8828aa-1b25-4a47-bf0d-49966f64d3f2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066296 Aug 04 14:01:49.008214 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 913/1799] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:49.021518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1847431c-1bde-4824-8fda-8b4e657da51e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:49.022533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1847431c-1bde-4824-8fda-8b4e657da51e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:49.034590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1847431c-1bde-4824-8fda-8b4e657da51e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:49.036361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1847431c-1bde-4824-8fda-8b4e657da51e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:49.038266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1847431c-1bde-4824-8fda-8b4e657da51e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:49.039463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1847431c-1bde-4824-8fda-8b4e657da51e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:50.083388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:50.096928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:50.099253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:50.101083 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c4fffba-8062-4f18-a82a-9e87bf4bd363 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1280 microversion: 2.25 time: 1.597550 Aug 04 14:01:50.102213 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 887/1800] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:01:48 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1280 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:50.112507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1179d89f-f591-4b83-a58a-0427f5d91bf4 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:50.114694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1179d89f-f591-4b83-a58a-0427f5d91bf4 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:50.128934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1179d89f-f591-4b83-a58a-0427f5d91bf4 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:50.130130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1179d89f-f591-4b83-a58a-0427f5d91bf4 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:50.132228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1179d89f-f591-4b83-a58a-0427f5d91bf4 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:50.133692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1179d89f-f591-4b83-a58a-0427f5d91bf4 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:50.464159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1847431c-1bde-4824-8fda-8b4e657da51e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:50.478969 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1847431c-1bde-4824-8fda-8b4e657da51e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1308 microversion: 2.1 time: 1.467706 Aug 04 14:01:50.480594 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 914/1801] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:49 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1308 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:50.488802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-747d1e48-66ef-4aee-8bda-d7b7f3d6953c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:50.489727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-747d1e48-66ef-4aee-8bda-d7b7f3d6953c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:50.501451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-747d1e48-66ef-4aee-8bda-d7b7f3d6953c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:50.502690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-747d1e48-66ef-4aee-8bda-d7b7f3d6953c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:50.508462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-747d1e48-66ef-4aee-8bda-d7b7f3d6953c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:50.509826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-747d1e48-66ef-4aee-8bda-d7b7f3d6953c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:50.972192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1179d89f-f591-4b83-a58a-0427f5d91bf4 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:50.998277 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1179d89f-f591-4b83-a58a-0427f5d91bf4 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1395 microversion: 2.1 time: 0.893836 Aug 04 14:01:50.999307 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 888/1802] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:50 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1395 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:51.024146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-94fbc9d1-6176-401d-bee0-9bcd2b8ba2b0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:51.025334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-94fbc9d1-6176-401d-bee0-9bcd2b8ba2b0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:51.053933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94fbc9d1-6176-401d-bee0-9bcd2b8ba2b0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:51.054854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94fbc9d1-6176-401d-bee0-9bcd2b8ba2b0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:51.056823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94fbc9d1-6176-401d-bee0-9bcd2b8ba2b0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:51.058985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94fbc9d1-6176-401d-bee0-9bcd2b8ba2b0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:51.244667 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-747d1e48-66ef-4aee-8bda-d7b7f3d6953c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1647 microversion: 2.1 time: 0.760823 Aug 04 14:01:51.246437 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 915/1803] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:50 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1647 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:51.301913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbd38036-69ce-4ead-aaaa-0b5e50a20981 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:51.303167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cbd38036-69ce-4ead-aaaa-0b5e50a20981 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:51.316674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbd38036-69ce-4ead-aaaa-0b5e50a20981 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:51.318271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbd38036-69ce-4ead-aaaa-0b5e50a20981 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:51.320639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbd38036-69ce-4ead-aaaa-0b5e50a20981 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:51.321907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbd38036-69ce-4ead-aaaa-0b5e50a20981 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:52.138096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-94fbc9d1-6176-401d-bee0-9bcd2b8ba2b0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:52.168140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbd38036-69ce-4ead-aaaa-0b5e50a20981 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352ca66812034cceb38694b98993fab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0e9ddfb4d04991834cb85bc7693736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:52.188473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:52.197704 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-94fbc9d1-6176-401d-bee0-9bcd2b8ba2b0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1318 microversion: 2.1 time: 1.187696 Aug 04 14:01:52.226206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbd38036-69ce-4ead-aaaa-0b5e50a20981 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507" status: 200 len: 1474 microversion: 2.1 time: 0.933654 Aug 04 14:01:52.229048 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 889/1804] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:51 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1318 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:52.232782 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 916/1805] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:51 2022] GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507 => generated 1474 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:52.254003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:52.254928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-4f0a42bd-137b-4b02-877c-50e4d93331ac req-707cec91-b249-479e-b830-ac4c6b77d38d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6a3bbe-676f-418d-ba74-6219d71f306f", "tag": "5e800a4e-6a5e-4cd1-91ba-17a672f04e77"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:52.259312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:52.285708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:52.290775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:52.294734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:52.298041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:52.301693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4f0a42bd-137b-4b02-877c-50e4d93331ac req-707cec91-b249-479e-b830-ac4c6b77d38d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:52.307108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4f0a42bd-137b-4b02-877c-50e4d93331ac req-707cec91-b249-479e-b830-ac4c6b77d38d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:52.338616 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-4f0a42bd-137b-4b02-877c-50e4d93331ac req-707cec91-b249-479e-b830-ac4c6b77d38d service nova] Creating event network-changed:5e800a4e-6a5e-4cd1-91ba-17a672f04e77 for instance ee6a3bbe-676f-418d-ba74-6219d71f306f on n-h1-844627-10 Aug 04 14:01:52.361182 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-4f0a42bd-137b-4b02-877c-50e4d93331ac req-707cec91-b249-479e-b830-ac4c6b77d38d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129314 Aug 04 14:01:52.364512 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 890/1806] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:52.375887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-855dcb88-23cf-494e-8cf5-6e54a8d7c90a req-4a27c48e-0508-4170-ae41-6bc0ae724504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ec0807-aa9c-4f56-a110-1aaf8083233e", "name": "network-vif-plugged", "status": "completed", "tag": "2fdbab1d-a877-44d3-967f-8d1cbd4cd82d"}, {"server_uuid": "fa7b62d1-dac8-455d-a695-9fc845814ee6", "name": "network-vif-plugged", "status": "completed", "tag": "2051b507-b0c9-477e-8ef6-8fdbf26c7ad5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:52.416270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-855dcb88-23cf-494e-8cf5-6e54a8d7c90a req-4a27c48e-0508-4170-ae41-6bc0ae724504 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:52.417077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-855dcb88-23cf-494e-8cf5-6e54a8d7c90a req-4a27c48e-0508-4170-ae41-6bc0ae724504 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:52.458612 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-855dcb88-23cf-494e-8cf5-6e54a8d7c90a req-4a27c48e-0508-4170-ae41-6bc0ae724504 service nova] Creating event network-vif-plugged:2fdbab1d-a877-44d3-967f-8d1cbd4cd82d for instance 51ec0807-aa9c-4f56-a110-1aaf8083233e on n-h2-844627-10 Aug 04 14:01:52.461327 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-855dcb88-23cf-494e-8cf5-6e54a8d7c90a req-4a27c48e-0508-4170-ae41-6bc0ae724504 service nova] Creating event network-vif-plugged:2051b507-b0c9-477e-8ef6-8fdbf26c7ad5 for instance fa7b62d1-dac8-455d-a695-9fc845814ee6 on n-h2-844627-10 Aug 04 14:01:52.475404 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-855dcb88-23cf-494e-8cf5-6e54a8d7c90a req-4a27c48e-0508-4170-ae41-6bc0ae724504 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.107839 Aug 04 14:01:52.476978 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 891/1807] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:52.488290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3eb6d0a-736a-4e1b-8e38-d33076328bac tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:52.489404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3eb6d0a-736a-4e1b-8e38-d33076328bac tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:52.499561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3eb6d0a-736a-4e1b-8e38-d33076328bac tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:52.500230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3eb6d0a-736a-4e1b-8e38-d33076328bac tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:52.501282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3eb6d0a-736a-4e1b-8e38-d33076328bac tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:52.502097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3eb6d0a-736a-4e1b-8e38-d33076328bac tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:53.497763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f3eb6d0a-736a-4e1b-8e38-d33076328bac tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:53.513120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:53.517241 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3eb6d0a-736a-4e1b-8e38-d33076328bac tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1488 microversion: 2.1 time: 1.036640 Aug 04 14:01:53.518735 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 892/1808] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:52 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1488 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:53.530146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1026869583", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "a6fe3b0e-589f-4137-b3da-0f7664c12e01"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:53.540465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:53.545529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:53.548668 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dd96a865-dc3e-47aa-97b7-97520caa0d84 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1280 microversion: 2.25 time: 1.313698 Aug 04 14:01:53.551447 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 917/1809] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:01:52 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1280 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:53.575349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75622a54-4cd2-4a27-8666-ee15a8f9ca70 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:53.576529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-75622a54-4cd2-4a27-8666-ee15a8f9ca70 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:53.585222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75622a54-4cd2-4a27-8666-ee15a8f9ca70 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:53.586007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75622a54-4cd2-4a27-8666-ee15a8f9ca70 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:53.587242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75622a54-4cd2-4a27-8666-ee15a8f9ca70 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:53.587726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75622a54-4cd2-4a27-8666-ee15a8f9ca70 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:53.612091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] validate_networks() for [('a6fe3b0e-589f-4137-b3da-0f7664c12e01', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:01:54.558444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75622a54-4cd2-4a27-8666-ee15a8f9ca70 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:54.572220 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75622a54-4cd2-4a27-8666-ee15a8f9ca70 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1395 microversion: 2.1 time: 0.998836 Aug 04 14:01:54.573212 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 918/1810] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:53 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1395 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:54.597623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7c42f3d-8350-4ba8-a8b7-0ab6ffa5de49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:54.599616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7c42f3d-8350-4ba8-a8b7-0ab6ffa5de49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:54.616687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7c42f3d-8350-4ba8-a8b7-0ab6ffa5de49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:54.618487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7c42f3d-8350-4ba8-a8b7-0ab6ffa5de49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:54.624942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7c42f3d-8350-4ba8-a8b7-0ab6ffa5de49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:54.625643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7c42f3d-8350-4ba8-a8b7-0ab6ffa5de49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:55.213235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7c42f3d-8350-4ba8-a8b7-0ab6ffa5de49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:55.235730 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7c42f3d-8350-4ba8-a8b7-0ab6ffa5de49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1318 microversion: 2.1 time: 0.659853 Aug 04 14:01:55.236366 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 919/1811] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:54 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:55.256854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:55.257583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] [instance: 9a6ca2cc-3cdb-477e-9166-c915de5fc507] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:55.260050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:55.277766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:55.278234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:55.279079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:55.279532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:55.312635 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] HTTP exception thrown: Instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 could not be found. Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Request method failure captured: Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507 HTTP/1.1 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69BiEzxBH4Su4b_ymv2cFRmjPTncbfvqxCbbaB5EKhbWMIaKDIAfsetmIBB-fF4p_tqm7ACkPZwdSvBZSUww9C5QNopjXLObLCkn7ejlcIj_-pO9_gCe7D0y57ydjZDMWd-fKIgZkBpEoLijoOGJeDzFYXTui1V96Ws5qBUKDdrwdd0 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1b0e9ddfb4d04991834cb85bc7693736 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListImageFiltersTestJSON-268912769 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b0e9ddfb4d04991834cb85bc7693736"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1b0e9ddfb4d04991834cb85bc7693736"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1b0e9ddfb4d04991834cb85bc7693736"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b0e9ddfb4d04991834cb85bc7693736"}]}] Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListImageFiltersTestJSON-268912769 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1b0e9ddfb4d04991834cb85bc7693736 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-268912769 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListImageFiltersTestJSON-268912769-project Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 352ca66812034cceb38694b98993fab5 Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListImageFiltersTestJSON-268912769-project Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 could not be found. Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9a6ca2cc-3cdb-477e-9166-c915de5fc507'} Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 could not be found. Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 could not be found. Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:01:55.315990 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:55.321479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:01:55.321479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:01:55.321479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:01:55.321479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:01:55.321479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:01:55.321479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 could not be found. Aug 04 14:01:55.321479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:01:55.321479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Returning 404 to user: Instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:01:55.326024 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd147f1a-85f1-4a9e-b659-991236df3bf8 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507" status: 404 len: 111 microversion: 2.1 time: 0.073608 Aug 04 14:01:55.326553 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 920/1812] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:55 2022] GET /compute/v2.1/servers/9a6ca2cc-3cdb-477e-9166-c915de5fc507 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:01:55.332469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-46a64d63-34cd-458f-b616-c4a84a28fd50 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:55.351235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46a64d63-34cd-458f-b616-c4a84a28fd50 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:55.354143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46a64d63-34cd-458f-b616-c4a84a28fd50 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:55.465750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:01:55.467004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:01:55.467694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:01:55.468275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:01:55.469048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:01:55.469348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-46a64d63-34cd-458f-b616-c4a84a28fd50 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Going to try to stop instance {{(pid=130961) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 14:01:55.490264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:55.491435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:55.492606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:55.493440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:55.527688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:01:55.538793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for user dd1aacb549b74c21a13b9f3ca2df840c and project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:01:55.556753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:01:55.561152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:01:55.563625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:55.586565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-46a64d63-34cd-458f-b616-c4a84a28fd50 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77/action" status: 202 len: 0 microversion: 2.1 time: 0.258490 Aug 04 14:01:55.587135 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 921/1813] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:01:55 2022] POST /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:01:55.592995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:01:55.595500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:55.596259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:55.616197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:55.622841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:55.624038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:55.625167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:55.652413 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b4ebffa-accc-4650-888b-f13d381b2d73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.131428 Aug 04 14:01:55.653429 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 893/1814] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:01:55.662483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-53235541-4f5d-4113-af66-4d61ffac773c req-9e09275a-58e9-4894-b3e3-c718b2b0846d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6ca2cc-3cdb-477e-9166-c915de5fc507", "name": "network-vif-deleted", "tag": "3725cfe1-eef7-4aa9-8c08-89a978079195"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:55.677575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-53235541-4f5d-4113-af66-4d61ffac773c req-9e09275a-58e9-4894-b3e3-c718b2b0846d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:55.679394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-53235541-4f5d-4113-af66-4d61ffac773c req-9e09275a-58e9-4894-b3e3-c718b2b0846d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:55.698545 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-53235541-4f5d-4113-af66-4d61ffac773c req-9e09275a-58e9-4894-b3e3-c718b2b0846d service nova] Creating event network-vif-deleted:3725cfe1-eef7-4aa9-8c08-89a978079195 for instance 9a6ca2cc-3cdb-477e-9166-c915de5fc507 on n-h2-844627-10 Aug 04 14:01:55.706587 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-53235541-4f5d-4113-af66-4d61ffac773c req-9e09275a-58e9-4894-b3e3-c718b2b0846d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051397 Aug 04 14:01:55.707944 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 894/1815] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:01:55.715443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe2d1470-df3b-4511-91c0-5eb9b6087e8e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3bf61f0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:55.945553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:55.962337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:55.964029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:55.989866 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6f2b0e59-ef75-4c65-b0b0-a7b0e9b426a1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1280 microversion: 2.25 time: 0.401409 Aug 04 14:01:56.009266 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 922/1816] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:01:55 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1280 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:56.021240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a1a8884e-2619-49f3-ace4-b1234ea67fe3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:56.022271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a1a8884e-2619-49f3-ace4-b1234ea67fe3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:56.080521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1a8884e-2619-49f3-ace4-b1234ea67fe3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:56.082557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1a8884e-2619-49f3-ace4-b1234ea67fe3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:56.092822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1a8884e-2619-49f3-ace4-b1234ea67fe3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:56.098806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1a8884e-2619-49f3-ace4-b1234ea67fe3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:56.174202 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe2d1470-df3b-4511-91c0-5eb9b6087e8e tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "DELETE /compute/v2.1/images/e7b6a0ac-f8b4-4e7b-952b-6f7487898421" status: 204 len: 0 microversion: 2.1 time: 0.461762 Aug 04 14:01:56.179139 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 895/1817] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:55 2022] DELETE /compute/v2.1/images/e7b6a0ac-f8b4-4e7b-952b-6f7487898421 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:56.188789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1fffddb5-a031-4316-b626-fc2bfe36da61 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:56.190075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1fffddb5-a031-4316-b626-fc2bfe36da61 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:56.214999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fffddb5-a031-4316-b626-fc2bfe36da61 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:56.217555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fffddb5-a031-4316-b626-fc2bfe36da61 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:56.218680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fffddb5-a031-4316-b626-fc2bfe36da61 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:56.219837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fffddb5-a031-4316-b626-fc2bfe36da61 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:56.541344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a1a8884e-2619-49f3-ace4-b1234ea67fe3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:56.543152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1fffddb5-a031-4316-b626-fc2bfe36da61 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:56.551979 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1fffddb5-a031-4316-b626-fc2bfe36da61 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1395 microversion: 2.1 time: 0.371051 Aug 04 14:01:56.552587 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 896/1818] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:56 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1395 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:56.562898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d45b1b33-d2e6-4a35-881c-a5426f9b04af tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:56.563940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d45b1b33-d2e6-4a35-881c-a5426f9b04af tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:56.579379 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a1a8884e-2619-49f3-ace4-b1234ea67fe3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.566253 Aug 04 14:01:56.590969 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 923/1819] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:56 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:56.639383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-559586242", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "2e73184c-2e43-48b7-87d1-794b5f7764f3"}, {"uuid": "92dde37f-d3d4-4bb1-a847-997bfbf75953"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:01:56.696765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d45b1b33-d2e6-4a35-881c-a5426f9b04af tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:56.716625 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d45b1b33-d2e6-4a35-881c-a5426f9b04af tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1211 microversion: 2.1 time: 0.156771 Aug 04 14:01:56.720622 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 897/1820] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:56 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:56.732317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd156a66-7447-405d-9be4-1c8e478086da tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3b59d30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:56.797683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] validate_networks() for [('2e73184c-2e43-48b7-87d1-794b5f7764f3', None, None, None, None, None), ('92dde37f-d3d4-4bb1-a847-997bfbf75953', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:01:57.320776 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd156a66-7447-405d-9be4-1c8e478086da tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "DELETE /compute/v2.1/images/e91b2da9-9fbd-4d1a-af9d-00db1e226576" status: 204 len: 0 microversion: 2.1 time: 0.596879 Aug 04 14:01:57.330394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 898/1821] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:56 2022] DELETE /compute/v2.1/images/e91b2da9-9fbd-4d1a-af9d-00db1e226576 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:01:57.345211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-66e414de-5a7d-4c30-941d-c61bed71c452 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:57.354154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-66e414de-5a7d-4c30-941d-c61bed71c452 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:57.394418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66e414de-5a7d-4c30-941d-c61bed71c452 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:57.398689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66e414de-5a7d-4c30-941d-c61bed71c452 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:57.405564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66e414de-5a7d-4c30-941d-c61bed71c452 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:57.406561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66e414de-5a7d-4c30-941d-c61bed71c452 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:58.588769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-66e414de-5a7d-4c30-941d-c61bed71c452 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:58.624621 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-66e414de-5a7d-4c30-941d-c61bed71c452 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1467 microversion: 2.1 time: 1.294822 Aug 04 14:01:58.627489 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 899/1822] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:57 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1467 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:01:58.660987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:01:58.662534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:01:58.679743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:58.682086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:58.686270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:01:58.687455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:01:59.503149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:59.536327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:59.539769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:01:59.545910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d407a596-d7dd-4435-979a-9669a9bc36a7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1280 microversion: 2.25 time: 0.916640 Aug 04 14:01:59.546836 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 900/1823] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:01:58 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1280 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:01:59.560261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-96c24913-09b7-43ff-9907-6e23283fb6f6 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] Calling method '.version_select at 0x7f46f3c4eaf0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:00.371876 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-96c24913-09b7-43ff-9907-6e23283fb6f6 tempest-ListImageFiltersTestJSON-268912769 tempest-ListImageFiltersTestJSON-268912769-project] 10.222.0.66 "DELETE /compute/v2.1/images/615f1491-5cf3-4b9f-9520-b146a1af5881" status: 204 len: 0 microversion: 2.1 time: 0.820175 Aug 04 14:02:00.373404 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 901/1824] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:01:59 2022] DELETE /compute/v2.1/images/615f1491-5cf3-4b9f-9520-b146a1af5881 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:00.379902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebec5d56-b196-4bdd-8a3d-7e27e28aee27 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:00.381142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ebec5d56-b196-4bdd-8a3d-7e27e28aee27 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:00.389720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebec5d56-b196-4bdd-8a3d-7e27e28aee27 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:00.390204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebec5d56-b196-4bdd-8a3d-7e27e28aee27 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:00.391049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebec5d56-b196-4bdd-8a3d-7e27e28aee27 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:00.391500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebec5d56-b196-4bdd-8a3d-7e27e28aee27 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:00.476270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:02:00.479131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:02:00.481434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:02:00.482790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:02:00.483397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:02:00.521198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:00.523970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:00.525913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:00.526993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:00.611578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Getting quotas for project 4a247be28b5c4f73be8526e19b9a0b91. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:00.639530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Getting quotas for user f0f7db7c684842e998aaf40a738ee665 and project 4a247be28b5c4f73be8526e19b9a0b91. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:00.685629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:02:00.688554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:02:00.784622 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ee97d4ea-5651-4ad2-ba70-4e06cadb028e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.180839 Aug 04 14:02:00.795379 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 924/1825] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:01:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:02:00.795379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3f075115-da59-4afd-b6cf-aca985fa0846 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:00.796450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3f075115-da59-4afd-b6cf-aca985fa0846 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:00.817183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ebec5d56-b196-4bdd-8a3d-7e27e28aee27 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:00.828743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f075115-da59-4afd-b6cf-aca985fa0846 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:00.831529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f075115-da59-4afd-b6cf-aca985fa0846 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:00.835326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f075115-da59-4afd-b6cf-aca985fa0846 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:00.842903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f075115-da59-4afd-b6cf-aca985fa0846 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:00.862447 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ebec5d56-b196-4bdd-8a3d-7e27e28aee27 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1395 microversion: 2.1 time: 0.485881 Aug 04 14:02:00.866018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 902/1826] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:00 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1395 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:00.894092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f19c540-04a5-4325-8e95-2edec56d7df8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:00.896412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f19c540-04a5-4325-8e95-2edec56d7df8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:00.927032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f19c540-04a5-4325-8e95-2edec56d7df8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:00.927880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f19c540-04a5-4325-8e95-2edec56d7df8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:00.929365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f19c540-04a5-4325-8e95-2edec56d7df8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:00.930139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f19c540-04a5-4325-8e95-2edec56d7df8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:01.271765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9f19c540-04a5-4325-8e95-2edec56d7df8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:01.286314 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f19c540-04a5-4325-8e95-2edec56d7df8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1269 microversion: 2.1 time: 0.413019 Aug 04 14:02:01.305521 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 903/1827] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:00 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1269 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:01.316420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06bcd00d-4c8d-421e-9911-cd72a2f0ad1e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:01.318339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-06bcd00d-4c8d-421e-9911-cd72a2f0ad1e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 51ec0807-aa9c-4f56-a110-1aaf8083233e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:01.337065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06bcd00d-4c8d-421e-9911-cd72a2f0ad1e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:01.338204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06bcd00d-4c8d-421e-9911-cd72a2f0ad1e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:01.342568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06bcd00d-4c8d-421e-9911-cd72a2f0ad1e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:01.345879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06bcd00d-4c8d-421e-9911-cd72a2f0ad1e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:01.478008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3f075115-da59-4afd-b6cf-aca985fa0846 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:01.491215 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3f075115-da59-4afd-b6cf-aca985fa0846 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.703961 Aug 04 14:02:01.495758 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 925/1828] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:00 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:01.508116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-959c26fd-056a-4486-9f57-87f280d5c43d req-ac40de6f-2b85-4da0-b70c-42042e47a109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933d36e2-d798-4136-8f33-ce878c78dbe8", "name": "network-vif-plugged", "status": "completed", "tag": "1d4c4e52-3e24-4f0c-98af-9f15be4642dd"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:01.539093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-959c26fd-056a-4486-9f57-87f280d5c43d req-ac40de6f-2b85-4da0-b70c-42042e47a109 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:01.541738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-959c26fd-056a-4486-9f57-87f280d5c43d req-ac40de6f-2b85-4da0-b70c-42042e47a109 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:01.592992 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-959c26fd-056a-4486-9f57-87f280d5c43d req-ac40de6f-2b85-4da0-b70c-42042e47a109 service nova] Creating event network-vif-plugged:1d4c4e52-3e24-4f0c-98af-9f15be4642dd for instance 933d36e2-d798-4136-8f33-ce878c78dbe8 on n-h1-844627-10 Aug 04 14:02:01.603807 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-959c26fd-056a-4486-9f57-87f280d5c43d req-ac40de6f-2b85-4da0-b70c-42042e47a109 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106467 Aug 04 14:02:01.608266 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 926/1829] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:01.629212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:01.631309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:01.639758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:01.640546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:01.641689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:01.642490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:02.414691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-06bcd00d-4c8d-421e-9911-cd72a2f0ad1e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:02.450535 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-06bcd00d-4c8d-421e-9911-cd72a2f0ad1e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e" status: 200 len: 1468 microversion: 2.1 time: 1.143389 Aug 04 14:02:02.463015 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 904/1830] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:01 2022] GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e => generated 1468 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:02.478726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-abe09759-4fcc-4e4b-90f7-294b267eb4fc tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:02.482337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-abe09759-4fcc-4e4b-90f7-294b267eb4fc tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:02.510344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe09759-4fcc-4e4b-90f7-294b267eb4fc tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:02.510670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe09759-4fcc-4e4b-90f7-294b267eb4fc tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:02.512213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe09759-4fcc-4e4b-90f7-294b267eb4fc tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:02.513102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe09759-4fcc-4e4b-90f7-294b267eb4fc tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:02.521054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:02.567195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:02.575873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:02.581162 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c23776b6-c0cf-432e-8867-18bb275db3fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1280 microversion: 2.25 time: 0.969419 Aug 04 14:02:02.600757 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 927/1831] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:01 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1280 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:02.619906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c5b1f16-f38b-483d-b4e0-721ce36f9690 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:02.636754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1c5b1f16-f38b-483d-b4e0-721ce36f9690 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:02.663119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c5b1f16-f38b-483d-b4e0-721ce36f9690 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:02.663923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c5b1f16-f38b-483d-b4e0-721ce36f9690 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:02.666205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c5b1f16-f38b-483d-b4e0-721ce36f9690 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:02.668889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c5b1f16-f38b-483d-b4e0-721ce36f9690 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:02.802662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-abe09759-4fcc-4e4b-90f7-294b267eb4fc tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:02.835862 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-abe09759-4fcc-4e4b-90f7-294b267eb4fc tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1208 microversion: 2.1 time: 0.367496 Aug 04 14:02:02.840151 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 905/1832] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:02 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1208 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:02.849600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-03123be5-a901-462a-81a9-36fdc4faab77 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:02.853852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03123be5-a901-462a-81a9-36fdc4faab77 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:02.869463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03123be5-a901-462a-81a9-36fdc4faab77 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:02.874819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03123be5-a901-462a-81a9-36fdc4faab77 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:02.875866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03123be5-a901-462a-81a9-36fdc4faab77 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:02.876928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03123be5-a901-462a-81a9-36fdc4faab77 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:03.490938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c5b1f16-f38b-483d-b4e0-721ce36f9690 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:03.510282 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1c5b1f16-f38b-483d-b4e0-721ce36f9690 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1395 microversion: 2.1 time: 0.905326 Aug 04 14:02:03.511893 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 928/1833] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:02 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1395 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:03.522117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:03.533955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:03.537042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Searching by: {'reservation_id': 'r-mq112yr4', 'deleted': False, 'project_id': 'ac3308acf403461d902ba64604e3382e'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:02:03.553221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:03.554365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:03.556808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:03.558140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:03.596338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-03123be5-a901-462a-81a9-36fdc4faab77 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:03.608322 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-03123be5-a901-462a-81a9-36fdc4faab77 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1311 microversion: 2.1 time: 0.766529 Aug 04 14:02:03.610400 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 906/1834] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:02 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1311 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:03.617959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dba25501-ffd6-4b4d-8563-89d11dfc9309 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:03.619078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dba25501-ffd6-4b4d-8563-89d11dfc9309 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:03.631340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dba25501-ffd6-4b4d-8563-89d11dfc9309 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:03.632641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dba25501-ffd6-4b4d-8563-89d11dfc9309 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:03.634171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dba25501-ffd6-4b4d-8563-89d11dfc9309 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:03.635438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dba25501-ffd6-4b4d-8563-89d11dfc9309 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:03.750580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:02:03.833417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:03.843119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:03.843903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:04.213278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dba25501-ffd6-4b4d-8563-89d11dfc9309 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:04.222763 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dba25501-ffd6-4b4d-8563-89d11dfc9309 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.610662 Aug 04 14:02:04.223410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 907/1835] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:03 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:04.351910 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-731e2c3d-ca50-4089-8b37-7190679f12ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?reservation_id=r-mq112yr4" status: 200 len: 2928 microversion: 2.1 time: 0.835642 Aug 04 14:02:04.353364 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 929/1836] 10.222.0.66 () {58 vars in 1197 bytes} [Thu Aug 4 14:02:03 2022] GET /compute/v2.1/servers/detail?reservation_id=r-mq112yr4 => generated 2928 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:04.365785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:04.367630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:04.380532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:04.381818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:04.383916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:04.385511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:04.433488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cbd8cbbe-2b3c-4cec-9a56-8c430bfdc417 tempest-ListImagesTestJSON-744729065 tempest-ListImagesTestJSON-744729065-project] Calling method '.version_select at 0x7f46f3cacc10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:04.490433 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cbd8cbbe-2b3c-4cec-9a56-8c430bfdc417 tempest-ListImagesTestJSON-744729065 tempest-ListImagesTestJSON-744729065-project] 10.222.0.66 "GET /compute/v2.1/images/bd2a109f-56ba-4543-91dd-d0a2429000b9" status: 200 len: 784 microversion: 2.1 time: 0.265891 Aug 04 14:02:04.492105 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 908/1837] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:04 2022] GET /compute/v2.1/images/bd2a109f-56ba-4543-91dd-d0a2429000b9 => generated 784 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:04.498035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-fbcd2c97-34a9-4ac0-bcf6-af99b23dd00b req-c724be0f-9f77-4eae-ae57-d9013b195f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a3bbe-676f-418d-ba74-6219d71f306f", "name": "network-vif-plugged", "status": "completed", "tag": "5e800a4e-6a5e-4cd1-91ba-17a672f04e77"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:04.514937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fbcd2c97-34a9-4ac0-bcf6-af99b23dd00b req-c724be0f-9f77-4eae-ae57-d9013b195f6b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:04.515489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fbcd2c97-34a9-4ac0-bcf6-af99b23dd00b req-c724be0f-9f77-4eae-ae57-d9013b195f6b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:04.528097 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fbcd2c97-34a9-4ac0-bcf6-af99b23dd00b req-c724be0f-9f77-4eae-ae57-d9013b195f6b service nova] Creating event network-vif-plugged:5e800a4e-6a5e-4cd1-91ba-17a672f04e77 for instance ee6a3bbe-676f-418d-ba74-6219d71f306f on n-h1-844627-10 Aug 04 14:02:04.533858 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-fbcd2c97-34a9-4ac0-bcf6-af99b23dd00b req-c724be0f-9f77-4eae-ae57-d9013b195f6b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040260 Aug 04 14:02:04.534816 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 909/1838] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:04.540169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f8ebc698-e7e1-4bf7-8df0-dd5e48da4e8e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:04.540903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f8ebc698-e7e1-4bf7-8df0-dd5e48da4e8e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:04.548428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8ebc698-e7e1-4bf7-8df0-dd5e48da4e8e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:04.548903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8ebc698-e7e1-4bf7-8df0-dd5e48da4e8e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:04.549700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8ebc698-e7e1-4bf7-8df0-dd5e48da4e8e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:04.550145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8ebc698-e7e1-4bf7-8df0-dd5e48da4e8e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:04.724249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f8ebc698-e7e1-4bf7-8df0-dd5e48da4e8e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:04.744082 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f8ebc698-e7e1-4bf7-8df0-dd5e48da4e8e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1270 microversion: 2.1 time: 0.207001 Aug 04 14:02:04.746070 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 910/1839] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:04 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:04.767102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-984b927c-8d8b-4373-8914-6af5dfb22104 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:04.825606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.compute.server_groups [None req-984b927c-8d8b-4373-8914-6af5dfb22104 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Querying cell bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) for 2 instances {{(pid=130960) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 14:02:04.827717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-984b927c-8d8b-4373-8914-6af5dfb22104 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:04.828686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-984b927c-8d8b-4373-8914-6af5dfb22104 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:04.891891 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-984b927c-8d8b-4373-8914-6af5dfb22104 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/70017779-d671-4b8e-9682-dcb519c6a5ec" status: 200 len: 265 microversion: 2.1 time: 0.142455 Aug 04 14:02:04.893554 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 911/1840] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:02:04 2022] GET /compute/v2.1/os-server-groups/70017779-d671-4b8e-9682-dcb519c6a5ec => generated 265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:04.902914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d58e0773-9000-4a0f-b47d-25538210f580 tempest-ListImagesTestJSON-744729065 tempest-ListImagesTestJSON-744729065-project] Calling method '.version_select at 0x7f46f3cdd790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:04.996650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:05.002861 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d58e0773-9000-4a0f-b47d-25538210f580 tempest-ListImagesTestJSON-744729065 tempest-ListImagesTestJSON-744729065-project] 10.222.0.66 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.107084 Aug 04 14:02:05.004890 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 912/1841] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Aug 4 14:02:04 2022] GET /compute/v2.1/images => generated 445 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:05.014427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c32f7b1e-c60d-473a-a42e-ade5981f3db0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:05.016455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c32f7b1e-c60d-473a-a42e-ade5981f3db0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:05.024814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:05.028898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c32f7b1e-c60d-473a-a42e-ade5981f3db0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:05.029809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c32f7b1e-c60d-473a-a42e-ade5981f3db0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:05.031048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:05.031436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c32f7b1e-c60d-473a-a42e-ade5981f3db0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:05.032349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c32f7b1e-c60d-473a-a42e-ade5981f3db0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:05.034818 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c3ebf1bb-904f-47b3-b4b5-1be0c7c40ece tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1476 microversion: 2.25 time: 0.678206 Aug 04 14:02:05.050112 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 930/1842] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:04 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1476 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:05.079036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8a51fa20-de2e-4374-aefd-fa680a7a3cd9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:05.080536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8a51fa20-de2e-4374-aefd-fa680a7a3cd9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:05.091525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a51fa20-de2e-4374-aefd-fa680a7a3cd9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:05.092648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a51fa20-de2e-4374-aefd-fa680a7a3cd9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:05.094247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a51fa20-de2e-4374-aefd-fa680a7a3cd9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:05.095229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a51fa20-de2e-4374-aefd-fa680a7a3cd9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:05.508157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:05.567472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c32f7b1e-c60d-473a-a42e-ade5981f3db0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:05.610163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8a51fa20-de2e-4374-aefd-fa680a7a3cd9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:05.612051 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c32f7b1e-c60d-473a-a42e-ade5981f3db0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1395 microversion: 2.1 time: 0.600749 Aug 04 14:02:05.614213 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 913/1843] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:05 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1395 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:05.632425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f94508f7-a71e-4720-875c-0a5a0be20c8e tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:05.641168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f94508f7-a71e-4720-875c-0a5a0be20c8e tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] [instance: 51ec0807-aa9c-4f56-a110-1aaf8083233e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:05.654286 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8a51fa20-de2e-4374-aefd-fa680a7a3cd9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1311 microversion: 2.1 time: 0.602249 Aug 04 14:02:05.655135 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 931/1844] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:05 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1311 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:05.663058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f94508f7-a71e-4720-875c-0a5a0be20c8e tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:05.664761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f94508f7-a71e-4720-875c-0a5a0be20c8e tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:05.665823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f94508f7-a71e-4720-875c-0a5a0be20c8e tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:05.667770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f94508f7-a71e-4720-875c-0a5a0be20c8e tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:05.675125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b202b1b2-a111-4a7b-8b7f-59e55415978b tempest-ListImagesTestJSON-744729065 tempest-ListImagesTestJSON-744729065-project] Calling method '.version_select at 0x7f470559a4c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:05.795860 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b202b1b2-a111-4a7b-8b7f-59e55415978b tempest-ListImagesTestJSON-744729065 tempest-ListImagesTestJSON-744729065-project] 10.222.0.66 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.132976 Aug 04 14:02:05.808862 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 932/1845] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 14:02:05 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:05.840279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-92877ec7-fcb7-41ab-9ceb-689e2fce54b9 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:05.843196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-92877ec7-fcb7-41ab-9ceb-689e2fce54b9 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:05.909549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92877ec7-fcb7-41ab-9ceb-689e2fce54b9 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:05.923183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92877ec7-fcb7-41ab-9ceb-689e2fce54b9 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:05.931970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92877ec7-fcb7-41ab-9ceb-689e2fce54b9 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:05.944616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92877ec7-fcb7-41ab-9ceb-689e2fce54b9 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:06.703154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:07.528133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-92877ec7-fcb7-41ab-9ceb-689e2fce54b9 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid 933d36e2-d798-4136-8f33-ce878c78dbe8 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:02:07.569068 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-92877ec7-fcb7-41ab-9ceb-689e2fce54b9 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1970 microversion: 2.25 time: 1.758076 Aug 04 14:02:07.570840 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 933/1846] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:05 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1970 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:07.625398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6f0baaba-5ffc-48ae-8a5f-2f94ad361647 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:07.627581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6f0baaba-5ffc-48ae-8a5f-2f94ad361647 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:07.641941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f0baaba-5ffc-48ae-8a5f-2f94ad361647 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:07.642921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f0baaba-5ffc-48ae-8a5f-2f94ad361647 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:07.644148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f0baaba-5ffc-48ae-8a5f-2f94ad361647 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:07.644780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f0baaba-5ffc-48ae-8a5f-2f94ad361647 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:07.803301 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f94508f7-a71e-4720-875c-0a5a0be20c8e tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e" status: 200 len: 1621 microversion: 2.1 time: 2.183765 Aug 04 14:02:07.806883 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 914/1847] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:05 2022] GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e => generated 1621 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:07.825238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1510dfb3-740f-44a5-8522-9559c4bdca8a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:07.825881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1510dfb3-740f-44a5-8522-9559c4bdca8a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:07.867059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1510dfb3-740f-44a5-8522-9559c4bdca8a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:07.867852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1510dfb3-740f-44a5-8522-9559c4bdca8a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:07.869393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1510dfb3-740f-44a5-8522-9559c4bdca8a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:07.870227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1510dfb3-740f-44a5-8522-9559c4bdca8a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:08.416401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1510dfb3-740f-44a5-8522-9559c4bdca8a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:08.437523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f0baaba-5ffc-48ae-8a5f-2f94ad361647 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:08.446389 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1510dfb3-740f-44a5-8522-9559c4bdca8a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1312 microversion: 2.1 time: 0.637350 Aug 04 14:02:08.452369 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 915/1848] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:07 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1312 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:08.460862 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6f0baaba-5ffc-48ae-8a5f-2f94ad361647 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.887750 Aug 04 14:02:08.466158 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 934/1849] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:07 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:08.486997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e3b9c7a5-3d18-4d97-8ac6-c713872ad3c7 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:08.492995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e3b9c7a5-3d18-4d97-8ac6-c713872ad3c7 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:08.497601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-8850bcc2-af5b-4d7e-858b-661dd066b6e0 req-069a26fa-c6a1-4af9-8b9b-53056c0d1061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04cd7bcc-5635-4672-a8f2-b0091f35752a", "tag": "a399b070-0ad8-49b2-aa93-590fb1803bc8"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:08.510700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8850bcc2-af5b-4d7e-858b-661dd066b6e0 req-069a26fa-c6a1-4af9-8b9b-53056c0d1061 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:08.513739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8850bcc2-af5b-4d7e-858b-661dd066b6e0 req-069a26fa-c6a1-4af9-8b9b-53056c0d1061 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:08.517472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3b9c7a5-3d18-4d97-8ac6-c713872ad3c7 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:08.518449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3b9c7a5-3d18-4d97-8ac6-c713872ad3c7 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:08.519982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3b9c7a5-3d18-4d97-8ac6-c713872ad3c7 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:08.521764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3b9c7a5-3d18-4d97-8ac6-c713872ad3c7 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:08.524588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:08.552358 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-8850bcc2-af5b-4d7e-858b-661dd066b6e0 req-069a26fa-c6a1-4af9-8b9b-53056c0d1061 service nova] Creating event network-changed:a399b070-0ad8-49b2-aa93-590fb1803bc8 for instance 04cd7bcc-5635-4672-a8f2-b0091f35752a on n-h2-844627-10 Aug 04 14:02:08.564193 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-8850bcc2-af5b-4d7e-858b-661dd066b6e0 req-069a26fa-c6a1-4af9-8b9b-53056c0d1061 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104331 Aug 04 14:02:08.565750 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 916/1850] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:08.578364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7edc668-135a-43b3-b308-d40c9f5d080f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:08.585867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7edc668-135a-43b3-b308-d40c9f5d080f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:08.595955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7edc668-135a-43b3-b308-d40c9f5d080f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:08.597987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7edc668-135a-43b3-b308-d40c9f5d080f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:08.599531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7edc668-135a-43b3-b308-d40c9f5d080f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:08.600408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7edc668-135a-43b3-b308-d40c9f5d080f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.243833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f7edc668-135a-43b3-b308-d40c9f5d080f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:09.264544 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7edc668-135a-43b3-b308-d40c9f5d080f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1311 microversion: 2.1 time: 0.695562 Aug 04 14:02:09.268401 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 917/1851] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:08 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1311 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:09.281440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e3b9c7a5-3d18-4d97-8ac6-c713872ad3c7 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:09.287606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-36ab35ac-59a2-441a-80cd-6ac7160eff9d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:09.289500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-36ab35ac-59a2-441a-80cd-6ac7160eff9d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:09.299711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36ab35ac-59a2-441a-80cd-6ac7160eff9d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.300757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36ab35ac-59a2-441a-80cd-6ac7160eff9d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.302332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36ab35ac-59a2-441a-80cd-6ac7160eff9d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.303006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36ab35ac-59a2-441a-80cd-6ac7160eff9d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.305259 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e3b9c7a5-3d18-4d97-8ac6-c713872ad3c7 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1576 microversion: 2.1 time: 0.833941 Aug 04 14:02:09.306981 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 935/1852] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:08 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1576 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:09.316839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-54021d2a-1a9a-4aba-ad82-020b112150d3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:09.318469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-54021d2a-1a9a-4aba-ad82-020b112150d3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:09.330790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54021d2a-1a9a-4aba-ad82-020b112150d3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.331820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54021d2a-1a9a-4aba-ad82-020b112150d3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.333523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54021d2a-1a9a-4aba-ad82-020b112150d3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.334750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54021d2a-1a9a-4aba-ad82-020b112150d3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.640303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-36ab35ac-59a2-441a-80cd-6ac7160eff9d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid 933d36e2-d798-4136-8f33-ce878c78dbe8 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:02:09.677708 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-36ab35ac-59a2-441a-80cd-6ac7160eff9d tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1970 microversion: 2.25 time: 0.405396 Aug 04 14:02:09.680915 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 918/1853] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:09 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1970 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:09.691436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-812f56c4-eca0-4f66-b7fc-b4538fd0b5a8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:09.693108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-812f56c4-eca0-4f66-b7fc-b4538fd0b5a8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:09.723332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-812f56c4-eca0-4f66-b7fc-b4538fd0b5a8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.723791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-812f56c4-eca0-4f66-b7fc-b4538fd0b5a8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.724628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-812f56c4-eca0-4f66-b7fc-b4538fd0b5a8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.725199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-812f56c4-eca0-4f66-b7fc-b4538fd0b5a8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.732531 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-54021d2a-1a9a-4aba-ad82-020b112150d3 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 200 len: 1620 microversion: 2.1 time: 0.423490 Aug 04 14:02:09.734403 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 936/1854] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:09 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 1620 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:09.743716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2b970f5d-45ce-4242-bfca-2513ba3fa720 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:09.751333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2b970f5d-45ce-4242-bfca-2513ba3fa720 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:09.771548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b970f5d-45ce-4242-bfca-2513ba3fa720 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.772037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b970f5d-45ce-4242-bfca-2513ba3fa720 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.772893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b970f5d-45ce-4242-bfca-2513ba3fa720 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.773508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b970f5d-45ce-4242-bfca-2513ba3fa720 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.946788 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-812f56c4-eca0-4f66-b7fc-b4538fd0b5a8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.263506 Aug 04 14:02:09.948121 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 919/1855] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:02:09 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f/os-interface => generated 285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:09.955600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-80fd9af5-cd8f-4a84-9c86-77a10fc7caeb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:09.957544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-80fd9af5-cd8f-4a84-9c86-77a10fc7caeb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:09.970738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80fd9af5-cd8f-4a84-9c86-77a10fc7caeb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.972432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80fd9af5-cd8f-4a84-9c86-77a10fc7caeb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:09.974074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80fd9af5-cd8f-4a84-9c86-77a10fc7caeb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:09.975152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80fd9af5-cd8f-4a84-9c86-77a10fc7caeb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:10.546964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-80fd9af5-cd8f-4a84-9c86-77a10fc7caeb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:10.559708 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-80fd9af5-cd8f-4a84-9c86-77a10fc7caeb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.610262 Aug 04 14:02:10.573920 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 920/1856] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:09 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:10.615403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2b970f5d-45ce-4242-bfca-2513ba3fa720 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:10.632126 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2b970f5d-45ce-4242-bfca-2513ba3fa720 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.895615 Aug 04 14:02:10.632771 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 937/1857] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:09 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:10.654620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b014497f-c482-4bed-9824-b09f39f82a78 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:10.662245 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:02:10.662245 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:02:10.666630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b014497f-c482-4bed-9824-b09f39f82a78 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:10.668069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b014497f-c482-4bed-9824-b09f39f82a78 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:10.669906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b014497f-c482-4bed-9824-b09f39f82a78 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:10.670852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b014497f-c482-4bed-9824-b09f39f82a78 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:10.718408 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b014497f-c482-4bed-9824-b09f39f82a78 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.084250 Aug 04 14:02:10.719716 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 938/1858] 10.222.0.66 () {60 vars in 1217 bytes} [Thu Aug 4 14:02:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:02:10.728483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d51694f8-0543-49e6-9214-1f981ba62476 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Action: 'create', calling method: .version_select at 0x7f47055dfd30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2058672309", "policies": ["anti-affinity"]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:10.750946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a09f724-3032-4267-9fda-bdba1d2ac778 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Action: 'create', calling method: .version_select at 0x7f46f3b67e50>, body: {"keypair": {"name": "tempest-keypair-2038696986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI48EI3hkR/OA80m5jZCd/ahs7W6RyEem/FMrqsjhZl12QjO3PldbWMEaF/aTRcqBwg/ezzViAywLCoHqOj45D+NsGLwDkBZhjun1BIMGYGRGSXyOhjgf3F4k4eD9/erQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:10.764536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d51694f8-0543-49e6-9214-1f981ba62476 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:10.789934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d51694f8-0543-49e6-9214-1f981ba62476 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:10.829411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-0a09f724-3032-4267-9fda-bdba1d2ac778 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:10.842738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-0a09f724-3032-4267-9fda-bdba1d2ac778 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for user 86cfd30c2b8242e6895736f926b225e2 and project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:10.876636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d51694f8-0543-49e6-9214-1f981ba62476 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:10.885996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d51694f8-0543-49e6-9214-1f981ba62476 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:10.908798 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d51694f8-0543-49e6-9214-1f981ba62476 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.187447 Aug 04 14:02:10.911016 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 939/1859] 10.222.0.66 () {60 vars in 1174 bytes} [Thu Aug 4 14:02:10 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:10.917549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d55c8013-d698-409e-a010-5bf91f9837ec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:10.919183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d55c8013-d698-409e-a010-5bf91f9837ec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:10.929628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d55c8013-d698-409e-a010-5bf91f9837ec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:10.930939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d55c8013-d698-409e-a010-5bf91f9837ec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:10.932081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d55c8013-d698-409e-a010-5bf91f9837ec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:10.933549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d55c8013-d698-409e-a010-5bf91f9837ec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:10.955918 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a09f724-3032-4267-9fda-bdba1d2ac778 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.379792 Aug 04 14:02:10.957072 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 921/1860] 10.222.0.66 () {62 vars in 1199 bytes} [Thu Aug 4 14:02:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 382 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:02:11.009055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1c43d8a-0510-458b-a17c-3f6fb7b9d6d3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844627-10", "block_migration": "auto"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:11.017955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1c43d8a-0510-458b-a17c-3f6fb7b9d6d3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:11.046939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1c43d8a-0510-458b-a17c-3f6fb7b9d6d3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:11.048625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1c43d8a-0510-458b-a17c-3f6fb7b9d6d3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:11.053934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1c43d8a-0510-458b-a17c-3f6fb7b9d6d3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:11.057086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1c43d8a-0510-458b-a17c-3f6fb7b9d6d3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:11.122631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-c1c43d8a-0510-458b-a17c-3f6fb7b9d6d3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'flavor' on Instance uuid 933d36e2-d798-4136-8f33-ce878c78dbe8 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:02:11.162165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1c43d8a-0510-458b-a17c-3f6fb7b9d6d3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Going to try to live migrate instance to n-h2-844627-10 {{(pid=130960) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 14:02:11.955860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d55c8013-d698-409e-a010-5bf91f9837ec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:11.973620 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d55c8013-d698-409e-a010-5bf91f9837ec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1311 microversion: 2.1 time: 1.060821 Aug 04 14:02:11.980463 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 940/1861] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:10 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1311 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:11.995860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f460b367-0b58-4e55-bb59-0bfab7b49a05 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f470560fd30>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:12.034923 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f460b367-0b58-4e55-bb59-0bfab7b49a05 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-2038696986" status: 200 len: 513 microversion: 2.2 time: 0.051161 Aug 04 14:02:12.037553 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 941/1862] 10.222.0.66 () {60 vars in 1258 bytes} [Thu Aug 4 14:02:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2038696986 => generated 513 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:12.044961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-906334200", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "28cafe75-8be0-440c-824d-c26796a4a2fb"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:12.130367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:02:13.031456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:02:13.032532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:02:13.032532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:02:13.032993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:02:13.033991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:02:13.054998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:13.055498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:13.056302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:13.056750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:13.091695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:13.098985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:13.149368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Going to run 2 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:02:13.155960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:02:13.217864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:13.345798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:13.359942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:13.421371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:13.443413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:13.494446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=3452877a-59f7-4d14-8e74-967bd9736cf9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:02:13.651913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:13.668539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:13.797198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:13.807017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:13.897705 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4b73b340-85a2-4d10-936e-769c0b2c28f5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.857407 Aug 04 14:02:13.902016 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 942/1863] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:02:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 1863 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:02:13.913792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34957cc6-6580-45f3-859b-4fcb056a7ece tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:13.917367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-34957cc6-6580-45f3-859b-4fcb056a7ece tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:13.935369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34957cc6-6580-45f3-859b-4fcb056a7ece tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:13.935948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34957cc6-6580-45f3-859b-4fcb056a7ece tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:13.937494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34957cc6-6580-45f3-859b-4fcb056a7ece tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:13.941223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34957cc6-6580-45f3-859b-4fcb056a7ece tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:13.949249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:14.661574 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1c43d8a-0510-458b-a17c-3f6fb7b9d6d3 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8/action" status: 202 len: 0 microversion: 2.25 time: 3.679059 Aug 04 14:02:14.662295 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 922/1864] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 14:02:10 2022] POST /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8/action => generated 0 bytes in 3681 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:14.671825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-355556c9-a420-45a9-8585-004bfe09ef1d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:14.672612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-355556c9-a420-45a9-8585-004bfe09ef1d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:14.681799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-355556c9-a420-45a9-8585-004bfe09ef1d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:14.683457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-34957cc6-6580-45f3-859b-4fcb056a7ece tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:14.698015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-355556c9-a420-45a9-8585-004bfe09ef1d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:14.715859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-355556c9-a420-45a9-8585-004bfe09ef1d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:14.727589 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-34957cc6-6580-45f3-859b-4fcb056a7ece tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.823354 Aug 04 14:02:14.728326 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 943/1865] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:13 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:14.741023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d9f84650-6ffe-4838-b844-d5316657fabd tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f470547c310>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:14.761112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-355556c9-a420-45a9-8585-004bfe09ef1d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:14.791375 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d9f84650-6ffe-4838-b844-d5316657fabd tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038696986" status: 204 len: 0 microversion: 2.2 time: 0.059686 Aug 04 14:02:14.800254 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 944/1866] 10.222.0.66 () {60 vars in 1261 bytes} [Thu Aug 4 14:02:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038696986 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:14.814698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-99dccca7-591c-4297-a2f0-0134ffbfeb9f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:14.817116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-99dccca7-591c-4297-a2f0-0134ffbfeb9f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:14.841004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99dccca7-591c-4297-a2f0-0134ffbfeb9f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:14.841502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99dccca7-591c-4297-a2f0-0134ffbfeb9f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:14.842338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99dccca7-591c-4297-a2f0-0134ffbfeb9f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:14.846724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99dccca7-591c-4297-a2f0-0134ffbfeb9f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:15.628818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-99dccca7-591c-4297-a2f0-0134ffbfeb9f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:15.643131 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-99dccca7-591c-4297-a2f0-0134ffbfeb9f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1311 microversion: 2.1 time: 0.841329 Aug 04 14:02:15.646490 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 945/1867] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:14 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1311 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:15.660287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2df65aba-4f4d-4d57-96b6-ac0dbfb9dba8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:15.660789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2df65aba-4f4d-4d57-96b6-ac0dbfb9dba8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:15.683473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2df65aba-4f4d-4d57-96b6-ac0dbfb9dba8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:15.693033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2df65aba-4f4d-4d57-96b6-ac0dbfb9dba8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:15.693990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2df65aba-4f4d-4d57-96b6-ac0dbfb9dba8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:15.694454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2df65aba-4f4d-4d57-96b6-ac0dbfb9dba8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:16.422327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-355556c9-a420-45a9-8585-004bfe09ef1d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:16.442693 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-355556c9-a420-45a9-8585-004bfe09ef1d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 1.774930 Aug 04 14:02:16.445729 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 923/1868] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:14 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:16.455012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c197c366-cbb3-4861-86f0-85760df50753 req-22393910-c208-4d3c-8aea-1a4cd4467cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6a3bbe-676f-418d-ba74-6219d71f306f", "tag": "5e800a4e-6a5e-4cd1-91ba-17a672f04e77"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:16.469704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c197c366-cbb3-4861-86f0-85760df50753 req-22393910-c208-4d3c-8aea-1a4cd4467cce service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:16.470722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c197c366-cbb3-4861-86f0-85760df50753 req-22393910-c208-4d3c-8aea-1a4cd4467cce service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:16.528346 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c197c366-cbb3-4861-86f0-85760df50753 req-22393910-c208-4d3c-8aea-1a4cd4467cce service nova] Creating event network-changed:5e800a4e-6a5e-4cd1-91ba-17a672f04e77 for instance ee6a3bbe-676f-418d-ba74-6219d71f306f on n-h1-844627-10 Aug 04 14:02:16.550848 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c197c366-cbb3-4861-86f0-85760df50753 req-22393910-c208-4d3c-8aea-1a4cd4467cce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103300 Aug 04 14:02:16.561302 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 924/1869] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:16.567027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-383eb76c-72dc-49ec-8f61-e4c8489774b0 req-b220817b-a8ad-4163-8ba3-601add9fbd78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7578dbfd-3c29-4085-bd8f-cd7cf53db3c6", "tag": "b31fc341-4893-4d87-9f76-50471c9d03ad"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:16.592606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-383eb76c-72dc-49ec-8f61-e4c8489774b0 req-b220817b-a8ad-4163-8ba3-601add9fbd78 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:16.593099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-383eb76c-72dc-49ec-8f61-e4c8489774b0 req-b220817b-a8ad-4163-8ba3-601add9fbd78 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:16.623400 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-383eb76c-72dc-49ec-8f61-e4c8489774b0 req-b220817b-a8ad-4163-8ba3-601add9fbd78 service nova] Creating event network-changed:b31fc341-4893-4d87-9f76-50471c9d03ad for instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 on n-h2-844627-10 Aug 04 14:02:16.638819 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-383eb76c-72dc-49ec-8f61-e4c8489774b0 req-b220817b-a8ad-4163-8ba3-601add9fbd78 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075876 Aug 04 14:02:16.640210 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 925/1870] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:16.645965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b365c3a0-1dfb-4bc9-89e6-81ae922d36ab tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:16.651341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b365c3a0-1dfb-4bc9-89e6-81ae922d36ab tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:16.658516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b365c3a0-1dfb-4bc9-89e6-81ae922d36ab tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Searching by: {'deleted': False, 'project_id': 'ac3308acf403461d902ba64604e3382e'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:02:16.675271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b365c3a0-1dfb-4bc9-89e6-81ae922d36ab tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:16.676011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b365c3a0-1dfb-4bc9-89e6-81ae922d36ab tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:16.676843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b365c3a0-1dfb-4bc9-89e6-81ae922d36ab tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:16.677313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b365c3a0-1dfb-4bc9-89e6-81ae922d36ab tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:16.745628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-b365c3a0-1dfb-4bc9-89e6-81ae922d36ab tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:02:16.803708 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b365c3a0-1dfb-4bc9-89e6-81ae922d36ab tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.161691 Aug 04 14:02:16.829298 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 926/1871] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:02:16 2022] GET /compute/v2.1/servers => generated 1662 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:16.834506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:16.835283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:16.852991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:16.860612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:16.861861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:16.863518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:16.959786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2df65aba-4f4d-4d57-96b6-ac0dbfb9dba8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:16.971727 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2df65aba-4f4d-4d57-96b6-ac0dbfb9dba8 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1576 microversion: 2.1 time: 1.319252 Aug 04 14:02:16.976204 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 946/1872] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:15 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1576 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:16.984012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b0802fd3-f8f2-451c-9537-18d1961089fb tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Action: 'create', calling method: .version_select at 0x7f47055dfc10>, body: {"keypair": {"name": "tempest-keypair-1811797870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2rdDVDyeFcbxWhKaCZDbYFvikYDj6cqtIekcjZNs2mqMasZYt1qQQL4ZzX3TsY+lJfrZd926Qr1iy6QFXjJTJqxzempuC5WEBASL9LeyGpVoqJalKyQfqorLTh4AiKwA=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:17.032236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b0802fd3-f8f2-451c-9537-18d1961089fb tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:17.054016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b0802fd3-f8f2-451c-9537-18d1961089fb tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for user 86cfd30c2b8242e6895736f926b225e2 and project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:17.150447 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b0802fd3-f8f2-451c-9537-18d1961089fb tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.170985 Aug 04 14:02:17.151626 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 947/1873] 10.222.0.66 () {62 vars in 1199 bytes} [Thu Aug 4 14:02:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:02:17.172159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c1efcb14-21bc-4bd6-a020-3a10c5fb7c54 req-3460a62e-c2bd-4b5b-9466-8497ceab98e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cd7bcc-5635-4672-a8f2-b0091f35752a", "name": "network-vif-plugged", "status": "completed", "tag": "a399b070-0ad8-49b2-aa93-590fb1803bc8"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:17.211250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c1efcb14-21bc-4bd6-a020-3a10c5fb7c54 req-3460a62e-c2bd-4b5b-9466-8497ceab98e9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:17.212081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c1efcb14-21bc-4bd6-a020-3a10c5fb7c54 req-3460a62e-c2bd-4b5b-9466-8497ceab98e9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:17.246091 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c1efcb14-21bc-4bd6-a020-3a10c5fb7c54 req-3460a62e-c2bd-4b5b-9466-8497ceab98e9 service nova] Creating event network-vif-plugged:a399b070-0ad8-49b2-aa93-590fb1803bc8 for instance 04cd7bcc-5635-4672-a8f2-b0091f35752a on n-h2-844627-10 Aug 04 14:02:17.261952 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c1efcb14-21bc-4bd6-a020-3a10c5fb7c54 req-3460a62e-c2bd-4b5b-9466-8497ceab98e9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104660 Aug 04 14:02:17.264202 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 948/1874] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:17.382159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1715207621", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "3a3de2e9-6bd4-46c5-af0f-3fd4917a21fe"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:17.492688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] validate_networks() for [('3a3de2e9-6bd4-46c5-af0f-3fd4917a21fe', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:02:17.642293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:17.652628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:17.659824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:17.664526 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-153d138b-60cd-49a0-b6b9-de817438526f tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.833951 Aug 04 14:02:17.685878 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 927/1875] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:16 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:17.685878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc7d04b1-e123-4c1f-8f0c-b6a4464f7c30 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:17.685878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc7d04b1-e123-4c1f-8f0c-b6a4464f7c30 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:17.690958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc7d04b1-e123-4c1f-8f0c-b6a4464f7c30 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:17.693384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc7d04b1-e123-4c1f-8f0c-b6a4464f7c30 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:17.694438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc7d04b1-e123-4c1f-8f0c-b6a4464f7c30 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:17.697454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc7d04b1-e123-4c1f-8f0c-b6a4464f7c30 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:18.955534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc7d04b1-e123-4c1f-8f0c-b6a4464f7c30 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:18.980925 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc7d04b1-e123-4c1f-8f0c-b6a4464f7c30 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 1.286178 Aug 04 14:02:18.980925 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 928/1876] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:17 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:18.987270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5ed19f5-5db5-4def-a45e-cfae13f251d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:18.987270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5ed19f5-5db5-4def-a45e-cfae13f251d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:19.018772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5ed19f5-5db5-4def-a45e-cfae13f251d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:19.021625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5ed19f5-5db5-4def-a45e-cfae13f251d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:19.022717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5ed19f5-5db5-4def-a45e-cfae13f251d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:19.027912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5ed19f5-5db5-4def-a45e-cfae13f251d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:20.544525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5ed19f5-5db5-4def-a45e-cfae13f251d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:20.555988 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5ed19f5-5db5-4def-a45e-cfae13f251d1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1495 microversion: 2.1 time: 1.583329 Aug 04 14:02:20.556810 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 929/1877] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:18 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1495 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:20.570165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-03e1c141-d223-4df3-b827-23ff7dff44ed tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:20.574741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03e1c141-d223-4df3-b827-23ff7dff44ed tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:20.587859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03e1c141-d223-4df3-b827-23ff7dff44ed tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:20.588822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03e1c141-d223-4df3-b827-23ff7dff44ed tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:20.589649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03e1c141-d223-4df3-b827-23ff7dff44ed tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:20.590087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03e1c141-d223-4df3-b827-23ff7dff44ed tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:20.716422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:02:20.718180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:02:20.720270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:02:20.720987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:02:20.721845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:02:20.737944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:20.738789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:20.741681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:20.743189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:20.783918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Getting quotas for project ce1b43a53a7c4b66a6cd1aea18aabaf1. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:20.797054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Getting quotas for user ee4658e74eb048559566a4e0e379f1d0 and project ce1b43a53a7c4b66a6cd1aea18aabaf1. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:20.825233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:02:20.831307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:02:20.879176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:20.923052 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d39f7784-310d-4500-a0bb-4f41e7b618ca tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.655860 Aug 04 14:02:20.924222 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 949/1878] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3658 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:02:20.930524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9dfb1592-8c24-419c-a3ed-5d7a79d26fe5 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f46f3a0d160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:20.955011 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9dfb1592-8c24-419c-a3ed-5d7a79d26fe5 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1811797870" status: 204 len: 0 microversion: 2.2 time: 0.029346 Aug 04 14:02:20.960827 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 950/1879] 10.222.0.66 () {60 vars in 1261 bytes} [Thu Aug 4 14:02:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1811797870 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:20.965494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c718813c-0eb6-457b-a946-b7ee89bcd04a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:20.966034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c718813c-0eb6-457b-a946-b7ee89bcd04a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:20.969551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=11,nova_api:DELETE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:20.974717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c718813c-0eb6-457b-a946-b7ee89bcd04a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:20.975177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c718813c-0eb6-457b-a946-b7ee89bcd04a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:20.976203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c718813c-0eb6-457b-a946-b7ee89bcd04a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:20.977472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c718813c-0eb6-457b-a946-b7ee89bcd04a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:20.980156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-03e1c141-d223-4df3-b827-23ff7dff44ed tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:20.994911 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-03e1c141-d223-4df3-b827-23ff7dff44ed tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9" status: 200 len: 1318 microversion: 2.1 time: 0.431851 Aug 04 14:02:20.996023 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 930/1880] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:20 2022] GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:21.002782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:21.005481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:21.015815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:21.016811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:21.018547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:21.021426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:21.425018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c718813c-0eb6-457b-a946-b7ee89bcd04a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:21.435249 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c718813c-0eb6-457b-a946-b7ee89bcd04a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.477935 Aug 04 14:02:21.440977 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 951/1881] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:20 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:21.455662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-da373424-956e-4481-8867-88ddfb70ae47 req-e6b64a0d-30c0-43c8-8eb3-9a7d987b061d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7578dbfd-3c29-4085-bd8f-cd7cf53db3c6", "tag": "1c233164-a500-4d80-8bbc-b54d232151a6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:21.481095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-da373424-956e-4481-8867-88ddfb70ae47 req-e6b64a0d-30c0-43c8-8eb3-9a7d987b061d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:21.481989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-da373424-956e-4481-8867-88ddfb70ae47 req-e6b64a0d-30c0-43c8-8eb3-9a7d987b061d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:21.500957 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-da373424-956e-4481-8867-88ddfb70ae47 req-e6b64a0d-30c0-43c8-8eb3-9a7d987b061d service nova] Creating event network-changed:1c233164-a500-4d80-8bbc-b54d232151a6 for instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 on n-h2-844627-10 Aug 04 14:02:21.514465 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-da373424-956e-4481-8867-88ddfb70ae47 req-e6b64a0d-30c0-43c8-8eb3-9a7d987b061d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071207 Aug 04 14:02:21.520918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:21.525680 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 952/1882] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:21.545319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:21.551339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-369c1e50-c3db-41f8-97e4-dab06f30f06b req-f3d2d9aa-9113-4b59-83ad-8e59b97f2128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3452877a-59f7-4d14-8e74-967bd9736cf9", "tag": "13847d8d-66df-465d-b3f2-fca69e45b7e9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:21.552164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:21.553652 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd0c7b45-2d71-4884-9e39-1711b368477c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.556079 Aug 04 14:02:21.561776 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 931/1883] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:20 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:21.567169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-959514e1-226d-43aa-877d-9bc4f77bbe85 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:21.574053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-959514e1-226d-43aa-877d-9bc4f77bbe85 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:21.601336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-959514e1-226d-43aa-877d-9bc4f77bbe85 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:21.606217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-959514e1-226d-43aa-877d-9bc4f77bbe85 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:21.606915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-369c1e50-c3db-41f8-97e4-dab06f30f06b req-f3d2d9aa-9113-4b59-83ad-8e59b97f2128 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:21.607051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-959514e1-226d-43aa-877d-9bc4f77bbe85 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:21.607501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-959514e1-226d-43aa-877d-9bc4f77bbe85 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:21.607998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-369c1e50-c3db-41f8-97e4-dab06f30f06b req-f3d2d9aa-9113-4b59-83ad-8e59b97f2128 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:21.630014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-369c1e50-c3db-41f8-97e4-dab06f30f06b req-f3d2d9aa-9113-4b59-83ad-8e59b97f2128 service nova] Creating event network-changed:13847d8d-66df-465d-b3f2-fca69e45b7e9 for instance 3452877a-59f7-4d14-8e74-967bd9736cf9 on n-h2-844627-10 Aug 04 14:02:21.712676 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-369c1e50-c3db-41f8-97e4-dab06f30f06b req-f3d2d9aa-9113-4b59-83ad-8e59b97f2128 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177602 Aug 04 14:02:21.740844 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 953/1884] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:21.762662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dcd71920-04f0-4a19-a398-cb01fea5ab87 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:21.763529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dcd71920-04f0-4a19-a398-cb01fea5ab87 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:21.780610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcd71920-04f0-4a19-a398-cb01fea5ab87 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:21.781499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcd71920-04f0-4a19-a398-cb01fea5ab87 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:21.782642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcd71920-04f0-4a19-a398-cb01fea5ab87 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:21.785274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcd71920-04f0-4a19-a398-cb01fea5ab87 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:22.318992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-959514e1-226d-43aa-877d-9bc4f77bbe85 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:22.334483 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-959514e1-226d-43aa-877d-9bc4f77bbe85 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.769260 Aug 04 14:02:22.348642 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 932/1885] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:21 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:22.348642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:22.349387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:22.371775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:22.372290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:22.373260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:22.373759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:22.417653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:22.471157 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dcd71920-04f0-4a19-a398-cb01fea5ab87 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1648 microversion: 2.1 time: 0.726643 Aug 04 14:02:22.472679 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 954/1886] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:21 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1648 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:22.488618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b017f2cd-3669-4a4f-8b79-ed587a22972c tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Action: 'create', calling method: .version_select at 0x7f470559e160>, body: {"keypair": {"name": "tempest-keypair-431694209", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:22.533458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b017f2cd-3669-4a4f-8b79-ed587a22972c tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:22.541048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b017f2cd-3669-4a4f-8b79-ed587a22972c tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for user 86cfd30c2b8242e6895736f926b225e2 and project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:22.562001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:22.573698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:22.576382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:22.578379 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c965dd0b-e1c4-44ad-8d32-a0ef0cbc9dbd tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1311 microversion: 2.21 time: 0.241630 Aug 04 14:02:22.580300 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 933/1887] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:22 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1311 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:22.587573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b88be9ca-b2a5-4d3b-a4b3-1c038d79e3be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:22.589502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b88be9ca-b2a5-4d3b-a4b3-1c038d79e3be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:22.598443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b88be9ca-b2a5-4d3b-a4b3-1c038d79e3be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:22.599659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b88be9ca-b2a5-4d3b-a4b3-1c038d79e3be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:22.601345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b88be9ca-b2a5-4d3b-a4b3-1c038d79e3be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:22.602559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b88be9ca-b2a5-4d3b-a4b3-1c038d79e3be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:22.605797 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b017f2cd-3669-4a4f-8b79-ed587a22972c tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.128052 Aug 04 14:02:22.606922 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 955/1888] 10.222.0.66 () {62 vars in 1199 bytes} [Thu Aug 4 14:02:22 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:02:22.618429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-967be198-8137-47a4-9b7e-0943b507b00e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:22.620288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-967be198-8137-47a4-9b7e-0943b507b00e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:22.628747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-967be198-8137-47a4-9b7e-0943b507b00e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:22.629796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-967be198-8137-47a4-9b7e-0943b507b00e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:22.631033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-967be198-8137-47a4-9b7e-0943b507b00e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:22.631767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-967be198-8137-47a4-9b7e-0943b507b00e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:23.469951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-967be198-8137-47a4-9b7e-0943b507b00e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:23.483422 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-967be198-8137-47a4-9b7e-0943b507b00e tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.875309 Aug 04 14:02:23.497006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b88be9ca-b2a5-4d3b-a4b3-1c038d79e3be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:23.498643 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 956/1889] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:22 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:23.503604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3ca9a57-74c2-4403-814d-89b90731f467 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:23.505952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a3ca9a57-74c2-4403-814d-89b90731f467 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:23.506610 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b88be9ca-b2a5-4d3b-a4b3-1c038d79e3be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9" status: 200 len: 1318 microversion: 2.1 time: 0.924290 Aug 04 14:02:23.521171 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 934/1890] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:22 2022] GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9 => generated 1318 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:23.521714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3ca9a57-74c2-4403-814d-89b90731f467 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:23.523373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3ca9a57-74c2-4403-814d-89b90731f467 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:23.525312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3ca9a57-74c2-4403-814d-89b90731f467 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:23.526638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3ca9a57-74c2-4403-814d-89b90731f467 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:23.534531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:23.535344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:23.543681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:23.544135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:23.544967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:23.545603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:24.132639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.157946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.162314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.165059 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0990c3ef-5d52-463a-b1d3-72fce6f4f2fb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.642508 Aug 04 14:02:24.167064 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 935/1891] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:23 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:24.190005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-10903a37-fa35-4895-abfe-192b4f879939 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f46f3b78940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:24.227815 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-10903a37-fa35-4895-abfe-192b4f879939 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-431694209" status: 204 len: 0 microversion: 2.2 time: 0.058354 Aug 04 14:02:24.228645 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 936/1892] 10.222.0.66 () {60 vars in 1258 bytes} [Thu Aug 4 14:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-431694209 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:24.237952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9990c0bf-343a-41a8-8f60-10e8ec125869 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:24.237952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9990c0bf-343a-41a8-8f60-10e8ec125869 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:24.245624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9990c0bf-343a-41a8-8f60-10e8ec125869 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:24.246099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9990c0bf-343a-41a8-8f60-10e8ec125869 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:24.246914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9990c0bf-343a-41a8-8f60-10e8ec125869 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:24.247374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9990c0bf-343a-41a8-8f60-10e8ec125869 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:24.577652 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3ca9a57-74c2-4403-814d-89b90731f467 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1648 microversion: 2.1 time: 1.070628 Aug 04 14:02:24.599215 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 957/1893] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:23 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1648 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:24.611330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:24.612493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:24.625513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:24.626312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:24.627376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:24.628133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:24.826418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.851922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.857159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.860322 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-389a830b-7701-48e8-9df3-0173cb451823 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1317 microversion: 2.21 time: 0.259454 Aug 04 14:02:24.863928 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 958/1894] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:24 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:24.879987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-48c70b72-728a-432e-a106-2925ba4d9475 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Action: 'create', calling method: .version_select at 0x7f46f3a29b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-739875898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGu2+1d3RzPMmuqx/3VqrkveYNcIDv8MrdfyiqfzFSOiQgaI4/wjZISAsp4q/Gc9HeOwAzEEqiCmOtua94rIlQOup4NRGKLH+0fcH8kl5gRQrIHBJSry8PYUD511+LWChw=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:24.924113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=53 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:24.929765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-48c70b72-728a-432e-a106-2925ba4d9475 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:24.940855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-48c70b72-728a-432e-a106-2925ba4d9475 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for user 86cfd30c2b8242e6895736f926b225e2 and project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:24.969318 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-48c70b72-728a-432e-a106-2925ba4d9475 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.103043 Aug 04 14:02:24.970496 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 959/1895] 10.222.0.66 () {62 vars in 1199 bytes} [Thu Aug 4 14:02:24 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:02:24.976350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9990c0bf-343a-41a8-8f60-10e8ec125869 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:24.987551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1cb64bd0-e172-4a5f-94a8-5d83dbc2f509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:24.987823 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9990c0bf-343a-41a8-8f60-10e8ec125869 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.756863 Aug 04 14:02:24.988392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1cb64bd0-e172-4a5f-94a8-5d83dbc2f509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:24.989477 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 937/1896] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:24 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:24.995329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-12019f44-b539-4691-af9c-39d03948d3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:24.996338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-12019f44-b539-4691-af9c-39d03948d3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:24.996956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1cb64bd0-e172-4a5f-94a8-5d83dbc2f509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:24.997485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1cb64bd0-e172-4a5f-94a8-5d83dbc2f509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:24.998520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1cb64bd0-e172-4a5f-94a8-5d83dbc2f509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:24.999046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1cb64bd0-e172-4a5f-94a8-5d83dbc2f509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.012668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12019f44-b539-4691-af9c-39d03948d3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.013155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12019f44-b539-4691-af9c-39d03948d3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.014008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12019f44-b539-4691-af9c-39d03948d3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.014543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12019f44-b539-4691-af9c-39d03948d3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.495004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-12019f44-b539-4691-af9c-39d03948d3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:25.499280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1cb64bd0-e172-4a5f-94a8-5d83dbc2f509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:25.509658 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-12019f44-b539-4691-af9c-39d03948d3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9" status: 200 len: 1318 microversion: 2.1 time: 0.518786 Aug 04 14:02:25.511638 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 938/1897] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:24 2022] GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9 => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:25.519094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7cbfa5c7-6127-46c4-a78f-4ae6ab651356 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:25.526797 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:02:25.526797 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:02:25.527804 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1cb64bd0-e172-4a5f-94a8-5d83dbc2f509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.555613 Aug 04 14:02:25.530294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cbfa5c7-6127-46c4-a78f-4ae6ab651356 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.533588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cbfa5c7-6127-46c4-a78f-4ae6ab651356 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.538045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cbfa5c7-6127-46c4-a78f-4ae6ab651356 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.540962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cbfa5c7-6127-46c4-a78f-4ae6ab651356 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.542717 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 960/1898] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:24 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:25.548685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4934565-08b4-4be7-8793-1e3e22444b85 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Action: 'create', calling method: .version_select at 0x7f47055fe670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1660915700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6gpBMpxUgC1CkRYquG7nxFWgj7jRvLVHLKtwOtCq9EadvqEaGd8yWPWLMZNBzYTqCF7QHfzvN5L2dAf7rZ06thibc+rbPD4TYxzVWmAjpxaEwmbueKOs/6i1HMir4z/Q=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:25.567183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e4934565-08b4-4be7-8793-1e3e22444b85 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:25.575162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e4934565-08b4-4be7-8793-1e3e22444b85 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for user 86cfd30c2b8242e6895736f926b225e2 and project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:25.594990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:25.615392 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e4934565-08b4-4be7-8793-1e3e22444b85 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.071403 Aug 04 14:02:25.616426 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 961/1899] 10.222.0.66 () {62 vars in 1199 bytes} [Thu Aug 4 14:02:25 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:02:25.622321 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7cbfa5c7-6127-46c4-a78f-4ae6ab651356 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.108727 Aug 04 14:02:25.622944 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 939/1900] 10.222.0.66 () {58 vars in 1176 bytes} [Thu Aug 4 14:02:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:25.623526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:25.628383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:25.632804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-801fc157-84fe-4f9e-85cf-fa05b9798a77 req-52ce5dfb-d645-406a-a171-896de999f2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f07f51-132c-40fa-94ab-83647c1f5093", "tag": "8b87c498-3d50-4642-b4a6-4f7414343c2b"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:25.643341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-801fc157-84fe-4f9e-85cf-fa05b9798a77 req-52ce5dfb-d645-406a-a171-896de999f2da service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.644008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-801fc157-84fe-4f9e-85cf-fa05b9798a77 req-52ce5dfb-d645-406a-a171-896de999f2da service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.644551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.645304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.646222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.646817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.658209 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-801fc157-84fe-4f9e-85cf-fa05b9798a77 req-52ce5dfb-d645-406a-a171-896de999f2da service nova] Creating event network-changed:8b87c498-3d50-4642-b4a6-4f7414343c2b for instance 63f07f51-132c-40fa-94ab-83647c1f5093 on n-h1-844627-10 Aug 04 14:02:25.663552 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-801fc157-84fe-4f9e-85cf-fa05b9798a77 req-52ce5dfb-d645-406a-a171-896de999f2da service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038427 Aug 04 14:02:25.664841 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 940/1901] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:25.672280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c0e8ab1e-cfcf-4fe1-8e47-c5e59af0220f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:25.673198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c0e8ab1e-cfcf-4fe1-8e47-c5e59af0220f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:25.680822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0e8ab1e-cfcf-4fe1-8e47-c5e59af0220f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.681753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0e8ab1e-cfcf-4fe1-8e47-c5e59af0220f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.683294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0e8ab1e-cfcf-4fe1-8e47-c5e59af0220f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.683925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0e8ab1e-cfcf-4fe1-8e47-c5e59af0220f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.796088 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c0e8ab1e-cfcf-4fe1-8e47-c5e59af0220f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a/action" status: 202 len: 0 microversion: 2.1 time: 0.129306 Aug 04 14:02:25.797165 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 941/1902] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:02:25 2022] POST /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:02:25.803007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-896b5992-215d-4d9f-b19c-b8a4a8c06b5f tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Action: 'create', calling method: .version_select at 0x7f46f3b260d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1437928646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4LAVm+5AOQpQf5JQc14qwTPyJVMxlilBmh140gQJe9C3OEX+LQEyCjm0svhXG7xDAmO/Ckkz1n7JxC9LtUZh4BQFKL0mfYmWaYZLvp21j5SX7P78sgqJmT5nkVhP1EkQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:25.823889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-896b5992-215d-4d9f-b19c-b8a4a8c06b5f tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:25.831267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-896b5992-215d-4d9f-b19c-b8a4a8c06b5f tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for user 86cfd30c2b8242e6895736f926b225e2 and project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:25.868684 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-896b5992-215d-4d9f-b19c-b8a4a8c06b5f tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.069188 Aug 04 14:02:25.871524 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 942/1903] 10.222.0.66 () {62 vars in 1199 bytes} [Thu Aug 4 14:02:25 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:02:25.889233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7419aff7-7868-4ff0-be67-f80ad5bc839d tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:25.893405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7419aff7-7868-4ff0-be67-f80ad5bc839d tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:25.908440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7419aff7-7868-4ff0-be67-f80ad5bc839d tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.909764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7419aff7-7868-4ff0-be67-f80ad5bc839d tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:25.911582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7419aff7-7868-4ff0-be67-f80ad5bc839d tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:25.912848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7419aff7-7868-4ff0-be67-f80ad5bc839d tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:26.402530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:26.423594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:26.426443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:26.428609 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2bdd5ba2-23d1-4aab-827b-90d1c69edb5a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.811155 Aug 04 14:02:26.429983 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 962/1904] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:25 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:26.438524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-047878dd-92ef-46e1-9780-0029d17e6511 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f47055fe700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:26.446067 n-d-844627-10 devstack@n-api.service[130961]: WARNING oslo_db.sqlalchemy.utils [None req-047878dd-92ef-46e1-9780-0029d17e6511 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 14:02:26.457587 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-047878dd-92ef-46e1-9780-0029d17e6511 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.025364 Aug 04 14:02:26.459485 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 963/1905] 10.222.0.66 () {60 vars in 1177 bytes} [Thu Aug 4 14:02:26 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:26.471165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:26.472747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:26.483633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:26.484744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:26.487108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:26.488199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:26.583377 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7419aff7-7868-4ff0-be67-f80ad5bc839d tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1653 microversion: 2.1 time: 0.709363 Aug 04 14:02:26.584927 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 943/1906] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:25 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1653 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:26.594946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aca4f61e-ee4e-4185-96fb-d9cdb4f600eb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:26.596304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aca4f61e-ee4e-4185-96fb-d9cdb4f600eb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:26.607856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aca4f61e-ee4e-4185-96fb-d9cdb4f600eb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:26.608852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aca4f61e-ee4e-4185-96fb-d9cdb4f600eb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:26.610743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aca4f61e-ee4e-4185-96fb-d9cdb4f600eb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:26.611952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aca4f61e-ee4e-4185-96fb-d9cdb4f600eb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:27.074332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:27.089303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:27.091112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:27.092420 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d6ef3c7e-fc96-42e9-afaa-2ecc7df82ac6 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1359 microversion: 2.21 time: 0.631081 Aug 04 14:02:27.093130 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 964/1907] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:26 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1359 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:27.114550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-442b38a3-bc20-4a0c-bac3-57a5800e39ee req-5170b6c1-2f8d-40ff-9867-cce63376cba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3452877a-59f7-4d14-8e74-967bd9736cf9", "name": "network-vif-plugged", "status": "completed", "tag": "13847d8d-66df-465d-b3f2-fca69e45b7e9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:27.132076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-442b38a3-bc20-4a0c-bac3-57a5800e39ee req-5170b6c1-2f8d-40ff-9867-cce63376cba2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:27.133012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-442b38a3-bc20-4a0c-bac3-57a5800e39ee req-5170b6c1-2f8d-40ff-9867-cce63376cba2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:27.160474 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-442b38a3-bc20-4a0c-bac3-57a5800e39ee req-5170b6c1-2f8d-40ff-9867-cce63376cba2 service nova] Creating event network-vif-plugged:13847d8d-66df-465d-b3f2-fca69e45b7e9 for instance 3452877a-59f7-4d14-8e74-967bd9736cf9 on n-h2-844627-10 Aug 04 14:02:27.172654 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-442b38a3-bc20-4a0c-bac3-57a5800e39ee req-5170b6c1-2f8d-40ff-9867-cce63376cba2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065452 Aug 04 14:02:27.175573 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 965/1908] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:27.187417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d97d7237-be2e-4dc8-aff9-db28fc33f902 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f4705474790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:27.198125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aca4f61e-ee4e-4185-96fb-d9cdb4f600eb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:27.220946 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aca4f61e-ee4e-4185-96fb-d9cdb4f600eb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.633111 Aug 04 14:02:27.223134 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 944/1909] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:26 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:27.248340 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d97d7237-be2e-4dc8-aff9-db28fc33f902 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1437928646" status: 204 len: 0 microversion: 2.2 time: 0.072011 Aug 04 14:02:27.250873 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 966/1910] 10.222.0.66 () {60 vars in 1321 bytes} [Thu Aug 4 14:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1437928646 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:27.269961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-213484a9-437b-4595-8065-9f654133b383 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:27.271195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-213484a9-437b-4595-8065-9f654133b383 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:27.275349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-199c581f-3ea5-4c98-81a1-bf4c2f2fd675 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:27.277119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-199c581f-3ea5-4c98-81a1-bf4c2f2fd675 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:27.286044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-199c581f-3ea5-4c98-81a1-bf4c2f2fd675 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:27.286857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-199c581f-3ea5-4c98-81a1-bf4c2f2fd675 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:27.287795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-213484a9-437b-4595-8065-9f654133b383 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:27.288080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-199c581f-3ea5-4c98-81a1-bf4c2f2fd675 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:27.288621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-213484a9-437b-4595-8065-9f654133b383 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:27.288959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-199c581f-3ea5-4c98-81a1-bf4c2f2fd675 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:27.290074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-213484a9-437b-4595-8065-9f654133b383 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:27.290908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-213484a9-437b-4595-8065-9f654133b383 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:27.696914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-199c581f-3ea5-4c98-81a1-bf4c2f2fd675 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:27.710096 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-199c581f-3ea5-4c98-81a1-bf4c2f2fd675 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.457707 Aug 04 14:02:27.711525 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 967/1911] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:27 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:27.717817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1bdaf147-2ae4-44b4-b508-87dc58161649 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f46f3a0d1f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:27.757062 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1bdaf147-2ae4-44b4-b508-87dc58161649 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1660915700" status: 204 len: 0 microversion: 2.2 time: 0.044357 Aug 04 14:02:27.762409 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 968/1912] 10.222.0.66 () {60 vars in 1321 bytes} [Thu Aug 4 14:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1660915700 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:27.765154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:27.766112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:27.775512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:27.776267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-213484a9-437b-4595-8065-9f654133b383 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:27.777795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:27.778613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:27.779252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:27.786224 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-213484a9-437b-4595-8065-9f654133b383 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9" status: 200 len: 1318 microversion: 2.1 time: 0.545276 Aug 04 14:02:27.789182 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 945/1913] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:27 2022] GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:27.794335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fd39d837-b2a5-4730-a5f6-5ead2d73d80f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:27.794961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fd39d837-b2a5-4730-a5f6-5ead2d73d80f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:27.806857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd39d837-b2a5-4730-a5f6-5ead2d73d80f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:27.807313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd39d837-b2a5-4730-a5f6-5ead2d73d80f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:27.808106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd39d837-b2a5-4730-a5f6-5ead2d73d80f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:27.808541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd39d837-b2a5-4730-a5f6-5ead2d73d80f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:28.356071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:28.367515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:28.369469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:28.371257 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-327a2695-3bc9-430a-9df8-a8efbbc0c10a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.611714 Aug 04 14:02:28.381620 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 969/1914] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:27 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:28.396381 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fd39d837-b2a5-4730-a5f6-5ead2d73d80f tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1633 microversion: 2.1 time: 0.605384 Aug 04 14:02:28.398260 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 946/1915] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:27 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1633 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:28.400316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-53016dbc-146d-461c-9c13-4cd346b58090 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f46f3a29040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:28.417512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:28.419970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:28.433473 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-53016dbc-146d-461c-9c13-4cd346b58090 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-739875898" status: 204 len: 0 microversion: 2.2 time: 0.046476 Aug 04 14:02:28.434791 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 970/1916] 10.222.0.66 () {60 vars in 1318 bytes} [Thu Aug 4 14:02:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-739875898 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:28.443017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-54d93fbe-a5c0-404e-aa98-c0a0203072fb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:28.444262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-54d93fbe-a5c0-404e-aa98-c0a0203072fb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:28.444818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:28.446267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:28.448299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:28.449134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:28.453984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54d93fbe-a5c0-404e-aa98-c0a0203072fb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:28.454719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54d93fbe-a5c0-404e-aa98-c0a0203072fb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:28.455928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54d93fbe-a5c0-404e-aa98-c0a0203072fb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:28.456204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54d93fbe-a5c0-404e-aa98-c0a0203072fb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:29.162759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:29.173600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:29.175536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:29.176976 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d483e58a-330e-4e75-977a-6ec6df657ac5 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1359 microversion: 2.21 time: 0.771288 Aug 04 14:02:29.183909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-54d93fbe-a5c0-404e-aa98-c0a0203072fb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:29.191288 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 947/1917] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:28 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1359 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:29.198469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe354322-05ea-4b0e-9906-85de589755f6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844627-10", "block_migration": true, "disk_over_commit": false}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:29.199826 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-54d93fbe-a5c0-404e-aa98-c0a0203072fb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1498 microversion: 2.1 time: 0.761459 Aug 04 14:02:29.201509 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 971/1918] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:28 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1498 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:29.201691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe354322-05ea-4b0e-9906-85de589755f6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:29.208921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe354322-05ea-4b0e-9906-85de589755f6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:29.209851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe354322-05ea-4b0e-9906-85de589755f6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:29.210545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1eeda79f-5125-4ce7-9b98-45aac6c78fad tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Action: 'create', calling method: .version_select at 0x7f46f3a195e0>, body: {"keypair": {"name": "tempest-keypair-2015407855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN9XJ13fzD82GlnBv9N2/YUqWyLXesOWK4DtASOC/JFjusFKj+i2zY4W9ux/hJ8iA8YJjmD76EohvPBhgpaNCLAnP88ZS3AWlzKV9DsfhASSpovfZAZpZyfhOx28OtKMA=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:29.211329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe354322-05ea-4b0e-9906-85de589755f6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:29.211991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe354322-05ea-4b0e-9906-85de589755f6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:29.234744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-1eeda79f-5125-4ce7-9b98-45aac6c78fad tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:29.241182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-1eeda79f-5125-4ce7-9b98-45aac6c78fad tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for user 86cfd30c2b8242e6895736f926b225e2 and project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:29.243738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-fe354322-05ea-4b0e-9906-85de589755f6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lazy-loading 'flavor' on Instance uuid 04cd7bcc-5635-4672-a8f2-b0091f35752a {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:02:29.263820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe354322-05ea-4b0e-9906-85de589755f6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Going to try to live migrate instance to n-h1-844627-10 {{(pid=130960) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 14:02:29.274038 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1eeda79f-5125-4ce7-9b98-45aac6c78fad tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.070822 Aug 04 14:02:29.275371 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 972/1919] 10.222.0.66 () {62 vars in 1199 bytes} [Thu Aug 4 14:02:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:02:29.282369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8c6f8e43-7335-4ea4-93ae-7bdc45cf81b7 req-506b5713-e973-4f47-9c95-a0794e651a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b025da80-9fce-4e40-8969-df41d441bc83", "tag": "7fc6fd22-3a61-4f1d-b8b2-cf103080040f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:29.295252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8c6f8e43-7335-4ea4-93ae-7bdc45cf81b7 req-506b5713-e973-4f47-9c95-a0794e651a26 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:29.295917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8c6f8e43-7335-4ea4-93ae-7bdc45cf81b7 req-506b5713-e973-4f47-9c95-a0794e651a26 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:29.307598 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8c6f8e43-7335-4ea4-93ae-7bdc45cf81b7 req-506b5713-e973-4f47-9c95-a0794e651a26 service nova] Creating event network-changed:7fc6fd22-3a61-4f1d-b8b2-cf103080040f for instance b025da80-9fce-4e40-8969-df41d441bc83 on n-h2-844627-10 Aug 04 14:02:29.313331 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8c6f8e43-7335-4ea4-93ae-7bdc45cf81b7 req-506b5713-e973-4f47-9c95-a0794e651a26 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035397 Aug 04 14:02:29.314362 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 973/1920] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:29.320090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0812b428-0a8a-4c2f-8aac-dbf22a0ae509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:29.321297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0812b428-0a8a-4c2f-8aac-dbf22a0ae509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:29.330040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0812b428-0a8a-4c2f-8aac-dbf22a0ae509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:29.330832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0812b428-0a8a-4c2f-8aac-dbf22a0ae509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:29.332650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0812b428-0a8a-4c2f-8aac-dbf22a0ae509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:29.333863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0812b428-0a8a-4c2f-8aac-dbf22a0ae509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:29.701824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0812b428-0a8a-4c2f-8aac-dbf22a0ae509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:29.708201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:29.721071 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0812b428-0a8a-4c2f-8aac-dbf22a0ae509 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.404699 Aug 04 14:02:29.722804 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 974/1921] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:29 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:29.733030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01b6f86c-e1c9-4d6e-9d07-694cba813b7e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:29.734177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-01b6f86c-e1c9-4d6e-9d07-694cba813b7e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:29.745557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01b6f86c-e1c9-4d6e-9d07-694cba813b7e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:29.746374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01b6f86c-e1c9-4d6e-9d07-694cba813b7e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:29.747737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01b6f86c-e1c9-4d6e-9d07-694cba813b7e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:29.749169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01b6f86c-e1c9-4d6e-9d07-694cba813b7e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:29.987864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-01b6f86c-e1c9-4d6e-9d07-694cba813b7e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:30.005115 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-01b6f86c-e1c9-4d6e-9d07-694cba813b7e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9" status: 200 len: 1467 microversion: 2.1 time: 0.280138 Aug 04 14:02:30.007560 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 975/1922] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:29 2022] GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9 => generated 1467 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:30.017497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75792a10-99d1-42fe-8d40-202bdbd1b6de tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f47055df430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:30.045623 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75792a10-99d1-42fe-8d40-202bdbd1b6de tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-2015407855" status: 200 len: 513 microversion: 2.2 time: 0.035362 Aug 04 14:02:30.056239 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 976/1923] 10.222.0.66 () {60 vars in 1258 bytes} [Thu Aug 4 14:02:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2015407855 => generated 513 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:30.057517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:30.058717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:30.066904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:30.067540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:30.068540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:30.069180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:30.427856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:30.437610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:30.439188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:30.440380 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1ad801b1-ff0a-4b43-b313-2ce9582330c1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.391544 Aug 04 14:02:30.440974 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 977/1924] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:30 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:30.445613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbb6ecd1-7204-41e6-932c-54d3dc6ba5e6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:30.446235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cbb6ecd1-7204-41e6-932c-54d3dc6ba5e6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:30.449449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:30.453350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbb6ecd1-7204-41e6-932c-54d3dc6ba5e6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:30.453892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbb6ecd1-7204-41e6-932c-54d3dc6ba5e6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:30.454753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbb6ecd1-7204-41e6-932c-54d3dc6ba5e6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:30.455265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbb6ecd1-7204-41e6-932c-54d3dc6ba5e6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:30.703312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbb6ecd1-7204-41e6-932c-54d3dc6ba5e6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:30.730990 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbb6ecd1-7204-41e6-932c-54d3dc6ba5e6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1318 microversion: 2.1 time: 0.288699 Aug 04 14:02:30.741167 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 978/1925] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:30 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:30.741167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7367445-a780-4ea1-9654-9c7d2e1776c2 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f47055df940>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:30.743734 n-d-844627-10 devstack@n-api.service[130961]: WARNING oslo_db.sqlalchemy.utils [None req-d7367445-a780-4ea1-9654-9c7d2e1776c2 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 14:02:30.753956 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7367445-a780-4ea1-9654-9c7d2e1776c2 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.020798 Aug 04 14:02:30.754592 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 979/1926] 10.222.0.66 () {60 vars in 1177 bytes} [Thu Aug 4 14:02:30 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:30.762419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:30.763432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:30.766671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=10 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:30.776929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:30.777668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:30.778852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:30.781252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:31.192075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:31.224310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:31.236652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:31.239203 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c9d88ccf-3902-4d78-900d-f30875076e20 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1359 microversion: 2.21 time: 0.483352 Aug 04 14:02:31.241101 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 980/1927] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:30 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1359 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:31.265435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37dc2d08-b7a5-4784-b681-d16723d00ddb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:31.268372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-37dc2d08-b7a5-4784-b681-d16723d00ddb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:31.287915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37dc2d08-b7a5-4784-b681-d16723d00ddb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:31.289402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37dc2d08-b7a5-4784-b681-d16723d00ddb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:31.292639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37dc2d08-b7a5-4784-b681-d16723d00ddb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:31.293835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37dc2d08-b7a5-4784-b681-d16723d00ddb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:31.647796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-37dc2d08-b7a5-4784-b681-d16723d00ddb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:31.673272 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37dc2d08-b7a5-4784-b681-d16723d00ddb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 200 len: 1475 microversion: 2.1 time: 0.425886 Aug 04 14:02:31.691169 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 981/1928] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:31 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 1475 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:31.726850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42ade29a-b3e4-4ae0-a998-58671484ee3d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:31.730289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-42ade29a-b3e4-4ae0-a998-58671484ee3d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:31.757815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42ade29a-b3e4-4ae0-a998-58671484ee3d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:31.759006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42ade29a-b3e4-4ae0-a998-58671484ee3d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:31.761636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42ade29a-b3e4-4ae0-a998-58671484ee3d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:31.764389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42ade29a-b3e4-4ae0-a998-58671484ee3d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.054174 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe354322-05ea-4b0e-9906-85de589755f6 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a/action" status: 202 len: 0 microversion: 2.1 time: 2.860959 Aug 04 14:02:32.055515 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 948/1929] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:02:29 2022] POST /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a/action => generated 0 bytes in 2864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:02:32.056657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-42ade29a-b3e4-4ae0-a998-58671484ee3d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:32.067283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c57db76c-4d84-4d0f-b7ee-65c323f1058d tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f46f3aca5e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:32.093317 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-42ade29a-b3e4-4ae0-a998-58671484ee3d tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.377716 Aug 04 14:02:32.104904 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 982/1930] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:31 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:32.113451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f34a9c80-b937-464d-bb68-60d3151ea45e req-5f8315c4-e82f-43cc-b04a-7de1d0df37a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7578dbfd-3c29-4085-bd8f-cd7cf53db3c6", "name": "network-vif-plugged", "status": "completed", "tag": "1c233164-a500-4d80-8bbc-b54d232151a6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:32.135817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f34a9c80-b937-464d-bb68-60d3151ea45e req-5f8315c4-e82f-43cc-b04a-7de1d0df37a8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.136323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f34a9c80-b937-464d-bb68-60d3151ea45e req-5f8315c4-e82f-43cc-b04a-7de1d0df37a8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.139393 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c57db76c-4d84-4d0f-b7ee-65c323f1058d tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015407855" status: 204 len: 0 microversion: 2.2 time: 0.080584 Aug 04 14:02:32.140777 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 949/1931] 10.222.0.66 () {60 vars in 1261 bytes} [Thu Aug 4 14:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015407855 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:32.154589 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f34a9c80-b937-464d-bb68-60d3151ea45e req-5f8315c4-e82f-43cc-b04a-7de1d0df37a8 service nova] Creating event network-vif-plugged:1c233164-a500-4d80-8bbc-b54d232151a6 for instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 on n-h2-844627-10 Aug 04 14:02:32.162601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:32.164107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:32.170625 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f34a9c80-b937-464d-bb68-60d3151ea45e req-5f8315c4-e82f-43cc-b04a-7de1d0df37a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067451 Aug 04 14:02:32.171470 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 983/1932] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:32.176745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.177516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.178476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-04ed7e19-a178-463b-97a7-6de06c5faa4e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1387393470"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:32.179642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.181384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.181576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-04ed7e19-a178-463b-97a7-6de06c5faa4e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:32.191001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04ed7e19-a178-463b-97a7-6de06c5faa4e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.191470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04ed7e19-a178-463b-97a7-6de06c5faa4e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.192301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04ed7e19-a178-463b-97a7-6de06c5faa4e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.192745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04ed7e19-a178-463b-97a7-6de06c5faa4e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.468906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:32.473258 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-04ed7e19-a178-463b-97a7-6de06c5faa4e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77/action" status: 202 len: 0 microversion: 2.1 time: 0.299370 Aug 04 14:02:32.474947 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 984/1933] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:02:32 2022] POST /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:02:32.485425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3ae49b0-c9f1-4229-942d-065b772683dd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:32.486939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a3ae49b0-c9f1-4229-942d-065b772683dd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:32.488098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:32.491226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:32.493524 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8908766f-c413-4b51-aee0-3763b0bddddf tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.350151 Aug 04 14:02:32.495219 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 950/1934] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:32 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:32.501225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a050e7b2-030f-47b8-9b3e-564c83e4e2f8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:32.501846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a050e7b2-030f-47b8-9b3e-564c83e4e2f8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:32.508684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a050e7b2-030f-47b8-9b3e-564c83e4e2f8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.509512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a050e7b2-030f-47b8-9b3e-564c83e4e2f8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.510668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a050e7b2-030f-47b8-9b3e-564c83e4e2f8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.511120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a050e7b2-030f-47b8-9b3e-564c83e4e2f8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.513213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3ae49b0-c9f1-4229-942d-065b772683dd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.514148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3ae49b0-c9f1-4229-942d-065b772683dd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.515751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3ae49b0-c9f1-4229-942d-065b772683dd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.517065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3ae49b0-c9f1-4229-942d-065b772683dd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.530058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:32.761851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a050e7b2-030f-47b8-9b3e-564c83e4e2f8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:32.774663 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a050e7b2-030f-47b8-9b3e-564c83e4e2f8 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1505 microversion: 2.1 time: 0.277451 Aug 04 14:02:32.776901 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 951/1935] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:32 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:32.783321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a3ae49b0-c9f1-4229-942d-065b772683dd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:32.788888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Action: 'create', calling method: .version_select at 0x7f46f3af58b0>, body: {"keypair": {"name": "tempest-keypair-933042261", "type": "x509"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:32.802522 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3ae49b0-c9f1-4229-942d-065b772683dd tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1318 microversion: 2.1 time: 0.324312 Aug 04 14:02:32.805270 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 985/1936] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:32 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:32.812230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:32.813190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:32.820158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:32.829166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.829813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.830848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:32.831313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:32.832520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for user 86cfd30c2b8242e6895736f926b225e2 and project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:32.856905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.processutils [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpc7rbsvbj/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpc7rbsvbj/temp.key -subj /CN=86cfd30c2b8242e6895736f926b225e2 -extensions v3_req_client {{(pid=130960) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 04 14:02:32.952727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.processutils [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpc7rbsvbj/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpc7rbsvbj/temp.key -subj /CN=86cfd30c2b8242e6895736f926b225e2 -extensions v3_req_client" returned: 0 in 0.094s {{(pid=130960) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 04 14:02:32.956001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.processutils [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpc7rbsvbj/temp.key -password pass: {{(pid=130960) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 04 14:02:33.012018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.processutils [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpc7rbsvbj/temp.key -password pass:" returned: 0 in 0.056s {{(pid=130960) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 04 14:02:33.059938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:33.076337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:33.079491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:33.081607 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-566acbb2-d764-48b7-afa9-f2b0103c323b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1359 microversion: 2.21 time: 0.275081 Aug 04 14:02:33.082759 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 986/1937] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:32 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:33.093160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6266535a-cb9e-4ca2-8bed-83c3d25da059 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47055fe160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:33.129635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:33.148551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Getting quotas for user 86cfd30c2b8242e6895736f926b225e2 and project ae181e77a2ff47bda29a023272085b1b. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:33.164313 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6266535a-cb9e-4ca2-8bed-83c3d25da059 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.079468 Aug 04 14:02:33.164815 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 987/1938] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:33 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:33.176976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-574a979b-f640-4974-bd00-1d8b471d85fe tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:33.177830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-574a979b-f640-4974-bd00-1d8b471d85fe tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:33.185525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-574a979b-f640-4974-bd00-1d8b471d85fe tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:33.185987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-574a979b-f640-4974-bd00-1d8b471d85fe tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:33.186804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-574a979b-f640-4974-bd00-1d8b471d85fe tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:33.187593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-574a979b-f640-4974-bd00-1d8b471d85fe tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:33.195940 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d5c6430-ad93-4d89-8cc4-1b0acbc2d806 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.416430 Aug 04 14:02:33.205415 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 952/1939] 10.222.0.66 () {62 vars in 1198 bytes} [Thu Aug 4 14:02:32 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 428 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:33.221136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-af24cf0b-a53b-4c07-b2cb-233c32c7e682 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f46f3b59ee0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:33.239214 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-af24cf0b-a53b-4c07-b2cb-233c32c7e682 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-933042261" status: 200 len: 1533 microversion: 2.2 time: 0.028220 Aug 04 14:02:33.240805 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 953/1940] 10.222.0.66 () {60 vars in 1255 bytes} [Thu Aug 4 14:02:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-933042261 => generated 1533 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:33.262332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-73270ff4-dba2-4ea5-bb9f-52e77a86f149 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f46f3cdd820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:33.270406 n-d-844627-10 devstack@n-api.service[130960]: WARNING oslo_db.sqlalchemy.utils [None req-73270ff4-dba2-4ea5-bb9f-52e77a86f149 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 14:02:33.285379 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-73270ff4-dba2-4ea5-bb9f-52e77a86f149 tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.030690 Aug 04 14:02:33.286553 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 954/1941] 10.222.0.66 () {60 vars in 1177 bytes} [Thu Aug 4 14:02:33 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:33.306460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5c46493-2655-491e-b37e-8551df968a9b tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] Calling method '.version_select at 0x7f46f3a84550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:33.341293 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5c46493-2655-491e-b37e-8551df968a9b tempest-KeyPairsV22TestJSON-318004645 tempest-KeyPairsV22TestJSON-318004645-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933042261" status: 204 len: 0 microversion: 2.2 time: 0.042627 Aug 04 14:02:33.342240 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 955/1942] 10.222.0.66 () {60 vars in 1258 bytes} [Thu Aug 4 14:02:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933042261 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:02:33.520072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:33.521462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:33.533912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:33.534960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:33.536591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:33.537347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:33.652590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-574a979b-f640-4974-bd00-1d8b471d85fe tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:33.671878 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-574a979b-f640-4974-bd00-1d8b471d85fe tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.505127 Aug 04 14:02:33.674470 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 988/1943] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:33 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:33.802706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d974fcb-9591-44f4-8a4b-cce278d41481 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:33.804080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6d974fcb-9591-44f4-8a4b-cce278d41481 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:33.813369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d974fcb-9591-44f4-8a4b-cce278d41481 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:33.813944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d974fcb-9591-44f4-8a4b-cce278d41481 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:33.814964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d974fcb-9591-44f4-8a4b-cce278d41481 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:33.815720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d974fcb-9591-44f4-8a4b-cce278d41481 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:33.992428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.012184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.015098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.016966 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9031fad0-c552-4659-b07c-b6b5bfa36fda tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.501814 Aug 04 14:02:34.036112 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 956/1944] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:33 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:34.045255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-41fc157d-0a92-4300-86bf-6f6ded675890 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:34.046868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-41fc157d-0a92-4300-86bf-6f6ded675890 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:34.056110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41fc157d-0a92-4300-86bf-6f6ded675890 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:34.057592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41fc157d-0a92-4300-86bf-6f6ded675890 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:34.058697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41fc157d-0a92-4300-86bf-6f6ded675890 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:34.059507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41fc157d-0a92-4300-86bf-6f6ded675890 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:34.202693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d974fcb-9591-44f4-8a4b-cce278d41481 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.221417 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d974fcb-9591-44f4-8a4b-cce278d41481 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1505 microversion: 2.1 time: 0.424787 Aug 04 14:02:34.235530 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 989/1945] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:33 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:34.256320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:34.257634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:34.268969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:34.269768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:34.270726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:34.271182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:34.839710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-41fc157d-0a92-4300-86bf-6f6ded675890 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.859036 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-41fc157d-0a92-4300-86bf-6f6ded675890 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1318 microversion: 2.1 time: 0.818625 Aug 04 14:02:34.872903 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 957/1946] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:34 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1318 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:34.872903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8bf439f8-4849-4e39-9331-d48a17cc0cf5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3c8d4c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:34.968414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.975873 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8bf439f8-4849-4e39-9331-d48a17cc0cf5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.112220 Aug 04 14:02:34.977473 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 958/1947] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:34 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:34.989201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.991141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:34.992638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-17736ae7-8907-447c-a709-d3bcc4a259d6 req-14c15c9e-12ea-4859-9c4d-470528ae749a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7578dbfd-3c29-4085-bd8f-cd7cf53db3c6", "name": "network-vif-plugged", "status": "completed", "tag": "b31fc341-4893-4d87-9f76-50471c9d03ad"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:34.994079 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d87f524-3b88-4057-bca4-940930020f44 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1359 microversion: 2.21 time: 0.750519 Aug 04 14:02:35.011641 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 990/1948] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:34 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1359 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:35.019949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cb4c126c-3eb6-4f05-8f4a-bcdbdacf46be req-e4680439-2278-4f84-9c6f-9eb64959c16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933d36e2-d798-4136-8f33-ce878c78dbe8", "name": "network-vif-unplugged", "status": "completed", "tag": "1d4c4e52-3e24-4f0c-98af-9f15be4642dd"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:35.033235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cb4c126c-3eb6-4f05-8f4a-bcdbdacf46be req-e4680439-2278-4f84-9c6f-9eb64959c16a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.033687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cb4c126c-3eb6-4f05-8f4a-bcdbdacf46be req-e4680439-2278-4f84-9c6f-9eb64959c16a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:35.034038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-17736ae7-8907-447c-a709-d3bcc4a259d6 req-14c15c9e-12ea-4859-9c4d-470528ae749a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.035042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-17736ae7-8907-447c-a709-d3bcc4a259d6 req-14c15c9e-12ea-4859-9c4d-470528ae749a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:35.054426 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cb4c126c-3eb6-4f05-8f4a-bcdbdacf46be req-e4680439-2278-4f84-9c6f-9eb64959c16a service nova] Creating event network-vif-unplugged:1d4c4e52-3e24-4f0c-98af-9f15be4642dd for instance 933d36e2-d798-4136-8f33-ce878c78dbe8 on n-h1-844627-10 Aug 04 14:02:35.062880 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-17736ae7-8907-447c-a709-d3bcc4a259d6 req-14c15c9e-12ea-4859-9c4d-470528ae749a service nova] Creating event network-vif-plugged:b31fc341-4893-4d87-9f76-50471c9d03ad for instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 on n-h2-844627-10 Aug 04 14:02:35.064751 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cb4c126c-3eb6-4f05-8f4a-bcdbdacf46be req-e4680439-2278-4f84-9c6f-9eb64959c16a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051549 Aug 04 14:02:35.066334 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 991/1949] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:35.074142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f518688c-7b9d-4834-a2a9-35a82588ece7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:35.075142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f518688c-7b9d-4834-a2a9-35a82588ece7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:35.079008 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-17736ae7-8907-447c-a709-d3bcc4a259d6 req-14c15c9e-12ea-4859-9c4d-470528ae749a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098957 Aug 04 14:02:35.080791 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 959/1950] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:35.084997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f518688c-7b9d-4834-a2a9-35a82588ece7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.085731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f518688c-7b9d-4834-a2a9-35a82588ece7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:35.086823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f518688c-7b9d-4834-a2a9-35a82588ece7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.087469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f518688c-7b9d-4834-a2a9-35a82588ece7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:35.101242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:35.105202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:35.127417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.129551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:35.132168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.133279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:35.571453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:35.667199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f518688c-7b9d-4834-a2a9-35a82588ece7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:35.675135 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f518688c-7b9d-4834-a2a9-35a82588ece7 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.607164 Aug 04 14:02:35.680099 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 992/1951] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:35 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:35.698240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e12945a-b491-4eec-969a-35c2a21a6f1b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:35.698890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4e12945a-b491-4eec-969a-35c2a21a6f1b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:35.705437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e12945a-b491-4eec-969a-35c2a21a6f1b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.706211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e12945a-b491-4eec-969a-35c2a21a6f1b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:35.707320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e12945a-b491-4eec-969a-35c2a21a6f1b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.707940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e12945a-b491-4eec-969a-35c2a21a6f1b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:35.729773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:35.745414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:35.746601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:35.747853 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fa4ae582-840a-47d8-8fa2-bf8eeb654e3a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.663646 Aug 04 14:02:35.767402 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 960/1952] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:35 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:35.885948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f99ae09e-4155-4456-a2ff-dbd0813bed78 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:35.887387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f99ae09e-4155-4456-a2ff-dbd0813bed78 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:35.894864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f99ae09e-4155-4456-a2ff-dbd0813bed78 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.895614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f99ae09e-4155-4456-a2ff-dbd0813bed78 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:35.896641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f99ae09e-4155-4456-a2ff-dbd0813bed78 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:35.897309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f99ae09e-4155-4456-a2ff-dbd0813bed78 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:36.186629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e12945a-b491-4eec-969a-35c2a21a6f1b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:36.200287 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e12945a-b491-4eec-969a-35c2a21a6f1b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1505 microversion: 2.1 time: 0.518429 Aug 04 14:02:36.201213 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 993/1953] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:35 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:36.217185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7bf6b7af-0f3e-44a6-8f28-53d163a4b92b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f4705608f70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:36.287632 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7bf6b7af-0f3e-44a6-8f28-53d163a4b92b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.084555 Aug 04 14:02:36.288675 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 994/1954] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:36 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:36.299127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:36.300230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:36.311760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f99ae09e-4155-4456-a2ff-dbd0813bed78 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:36.312213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:36.312812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:36.314504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:36.315508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:36.340742 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f99ae09e-4155-4456-a2ff-dbd0813bed78 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1318 microversion: 2.1 time: 0.455184 Aug 04 14:02:36.347340 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 961/1955] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:35 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:36.361638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:36.741775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7f8fe15-932f-4e5a-b2ff-cf8152d5f576 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:36.747471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7f8fe15-932f-4e5a-b2ff-cf8152d5f576 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:36.776756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7f8fe15-932f-4e5a-b2ff-cf8152d5f576 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:36.778101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7f8fe15-932f-4e5a-b2ff-cf8152d5f576 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:36.780312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7f8fe15-932f-4e5a-b2ff-cf8152d5f576 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:36.781951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7f8fe15-932f-4e5a-b2ff-cf8152d5f576 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:36.835105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:36.869479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:36.875463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:36.885655 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4736f5c6-cf72-40f3-a597-64ab56114425 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1359 microversion: 2.21 time: 0.590361 Aug 04 14:02:36.889676 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 995/1956] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:36 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1359 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:36.913933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:36.915268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:36.926961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:36.927982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:36.929102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:36.929665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:37.525112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f7f8fe15-932f-4e5a-b2ff-cf8152d5f576 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:37.528320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:37.542372 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7f8fe15-932f-4e5a-b2ff-cf8152d5f576 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1333 microversion: 2.1 time: 0.833159 Aug 04 14:02:37.550952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:37.554136 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 962/1957] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:36 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1333 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:37.559205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:37.560929 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a94d70e2-42c0-4559-be23-08bf09212961 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.669317 Aug 04 14:02:37.565787 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 996/1958] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:36 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:37.568291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3dc118c2-6389-4ea4-8616-6f8e67e68c79 req-8448970b-bcc0-4689-b940-9d84cd2218fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933d36e2-d798-4136-8f33-ce878c78dbe8", "tag": "1d4c4e52-3e24-4f0c-98af-9f15be4642dd"}, {"server_uuid": "04cd7bcc-5635-4672-a8f2-b0091f35752a", "name": "network-vif-unplugged", "status": "completed", "tag": "a399b070-0ad8-49b2-aa93-590fb1803bc8"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:37.579311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b6c104ba-7471-44b2-868b-a3c9000bbd98 req-cbf6df2c-e157-4994-9679-cbcf6ab17508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b025da80-9fce-4e40-8969-df41d441bc83", "name": "network-vif-plugged", "status": "completed", "tag": "7fc6fd22-3a61-4f1d-b8b2-cf103080040f"}, {"server_uuid": "63f07f51-132c-40fa-94ab-83647c1f5093", "name": "network-vif-plugged", "status": "completed", "tag": "8b87c498-3d50-4642-b4a6-4f7414343c2b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:37.599253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3dc118c2-6389-4ea4-8616-6f8e67e68c79 req-8448970b-bcc0-4689-b940-9d84cd2218fb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:37.600044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3dc118c2-6389-4ea4-8616-6f8e67e68c79 req-8448970b-bcc0-4689-b940-9d84cd2218fb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:37.608547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b6c104ba-7471-44b2-868b-a3c9000bbd98 req-cbf6df2c-e157-4994-9679-cbcf6ab17508 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:37.610059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b6c104ba-7471-44b2-868b-a3c9000bbd98 req-cbf6df2c-e157-4994-9679-cbcf6ab17508 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:37.640784 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3dc118c2-6389-4ea4-8616-6f8e67e68c79 req-8448970b-bcc0-4689-b940-9d84cd2218fb service nova] Creating event network-changed:1d4c4e52-3e24-4f0c-98af-9f15be4642dd for instance 933d36e2-d798-4136-8f33-ce878c78dbe8 on n-h1-844627-10 Aug 04 14:02:37.641794 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3dc118c2-6389-4ea4-8616-6f8e67e68c79 req-8448970b-bcc0-4689-b940-9d84cd2218fb service nova] Creating event network-vif-unplugged:a399b070-0ad8-49b2-aa93-590fb1803bc8 for instance 04cd7bcc-5635-4672-a8f2-b0091f35752a on n-h2-844627-10 Aug 04 14:02:37.646011 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b6c104ba-7471-44b2-868b-a3c9000bbd98 req-cbf6df2c-e157-4994-9679-cbcf6ab17508 service nova] Creating event network-vif-plugged:7fc6fd22-3a61-4f1d-b8b2-cf103080040f for instance b025da80-9fce-4e40-8969-df41d441bc83 on n-h2-844627-10 Aug 04 14:02:37.647011 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b6c104ba-7471-44b2-868b-a3c9000bbd98 req-cbf6df2c-e157-4994-9679-cbcf6ab17508 service nova] Creating event network-vif-plugged:8b87c498-3d50-4642-b4a6-4f7414343c2b for instance 63f07f51-132c-40fa-94ab-83647c1f5093 on n-h1-844627-10 Aug 04 14:02:37.657769 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b6c104ba-7471-44b2-868b-a3c9000bbd98 req-cbf6df2c-e157-4994-9679-cbcf6ab17508 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090350 Aug 04 14:02:37.660285 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 997/1959] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:37.668578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b24880a5-b794-4ca6-8254-7a7ab968b94a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:37.668788 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3dc118c2-6389-4ea4-8616-6f8e67e68c79 req-8448970b-bcc0-4689-b940-9d84cd2218fb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.112634 Aug 04 14:02:37.669491 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 963/1960] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:37.669745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b24880a5-b794-4ca6-8254-7a7ab968b94a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:37.677131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b24880a5-b794-4ca6-8254-7a7ab968b94a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:37.678045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b24880a5-b794-4ca6-8254-7a7ab968b94a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:37.679260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b24880a5-b794-4ca6-8254-7a7ab968b94a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:37.680234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b24880a5-b794-4ca6-8254-7a7ab968b94a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:37.688492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43f3d974-9b6e-4986-922b-e58860c858e8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3b26550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:37.843723 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-43f3d974-9b6e-4986-922b-e58860c858e8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.161657 Aug 04 14:02:37.844927 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 964/1961] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:37 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:37.859016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-032a94cf-9c7e-4359-940a-c0b11b1fe16d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:37.859988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-032a94cf-9c7e-4359-940a-c0b11b1fe16d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:37.869819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-032a94cf-9c7e-4359-940a-c0b11b1fe16d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:37.870424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-032a94cf-9c7e-4359-940a-c0b11b1fe16d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:37.871347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-032a94cf-9c7e-4359-940a-c0b11b1fe16d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:37.872088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-032a94cf-9c7e-4359-940a-c0b11b1fe16d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:38.414813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b24880a5-b794-4ca6-8254-7a7ab968b94a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:38.433177 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b24880a5-b794-4ca6-8254-7a7ab968b94a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1505 microversion: 2.1 time: 0.770564 Aug 04 14:02:38.434691 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 998/1962] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:37 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1505 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:38.444670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:38.446507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:38.460267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:38.461234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:38.463546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:38.464400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:38.503537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-032a94cf-9c7e-4359-940a-c0b11b1fe16d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:38.532363 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-032a94cf-9c7e-4359-940a-c0b11b1fe16d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1318 microversion: 2.1 time: 0.678197 Aug 04 14:02:38.544974 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 965/1963] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:37 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1318 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:38.596690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:38.597626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:38.606179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:38.606995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:38.608117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:38.608755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:39.249542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=11 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:39.364438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.384438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.388593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.391455 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bddc5dc3-89da-41ae-a730-5f7b62355554 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1359 microversion: 2.21 time: 0.954830 Aug 04 14:02:39.392822 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 999/1964] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:38 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1359 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:39.399338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.416514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b391d956-cc9e-42f7-ad1c-fa916673ffc3 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:39.417539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b391d956-cc9e-42f7-ad1c-fa916673ffc3 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:39.424776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.425258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b391d956-cc9e-42f7-ad1c-fa916673ffc3 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:39.425851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b391d956-cc9e-42f7-ad1c-fa916673ffc3 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:39.426747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b391d956-cc9e-42f7-ad1c-fa916673ffc3 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:39.427412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b391d956-cc9e-42f7-ad1c-fa916673ffc3 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:39.428603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.431127 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-44efce54-30df-4502-9283-7765b449de42 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.838961 Aug 04 14:02:39.433043 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 966/1965] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:38 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:39.442343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-005c1bbf-b4c3-455c-bbce-b48c7c87043d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3c8d160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:39.524208 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-005c1bbf-b4c3-455c-bbce-b48c7c87043d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.088958 Aug 04 14:02:39.525117 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 967/1966] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:39 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:39.531199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-194c09eb-c31c-4a65-ba63-2e65f362f26f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:39.531975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-194c09eb-c31c-4a65-ba63-2e65f362f26f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:39.539550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-194c09eb-c31c-4a65-ba63-2e65f362f26f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:39.540636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-194c09eb-c31c-4a65-ba63-2e65f362f26f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:39.541473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-194c09eb-c31c-4a65-ba63-2e65f362f26f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:39.542124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-194c09eb-c31c-4a65-ba63-2e65f362f26f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:39.773910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b391d956-cc9e-42f7-ad1c-fa916673ffc3 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.813617 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b391d956-cc9e-42f7-ad1c-fa916673ffc3 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1668 microversion: 2.1 time: 0.407965 Aug 04 14:02:39.829997 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1000/1967] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:39 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1668 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:39.866307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ad46a1ce-8bbd-478d-93ee-ef9a13b27daa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:39.867463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ad46a1ce-8bbd-478d-93ee-ef9a13b27daa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:39.884147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad46a1ce-8bbd-478d-93ee-ef9a13b27daa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:39.885503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad46a1ce-8bbd-478d-93ee-ef9a13b27daa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:39.887470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad46a1ce-8bbd-478d-93ee-ef9a13b27daa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:39.888179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad46a1ce-8bbd-478d-93ee-ef9a13b27daa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:39.939405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-194c09eb-c31c-4a65-ba63-2e65f362f26f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:39.955021 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-194c09eb-c31c-4a65-ba63-2e65f362f26f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1505 microversion: 2.1 time: 0.427672 Aug 04 14:02:39.979787 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 968/1968] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:39 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:39.991726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b09d22b1-69c3-4dc4-b0e5-323228a0c002 req-9cf599ac-075d-4fce-a126-4b086613a84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04cd7bcc-5635-4672-a8f2-b0091f35752a", "tag": "a399b070-0ad8-49b2-aa93-590fb1803bc8"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:40.019396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b09d22b1-69c3-4dc4-b0e5-323228a0c002 req-9cf599ac-075d-4fce-a126-4b086613a84b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:40.020176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b09d22b1-69c3-4dc4-b0e5-323228a0c002 req-9cf599ac-075d-4fce-a126-4b086613a84b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:40.036631 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b09d22b1-69c3-4dc4-b0e5-323228a0c002 req-9cf599ac-075d-4fce-a126-4b086613a84b service nova] Creating event network-changed:a399b070-0ad8-49b2-aa93-590fb1803bc8 for instance 04cd7bcc-5635-4672-a8f2-b0091f35752a on n-h2-844627-10 Aug 04 14:02:40.043414 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b09d22b1-69c3-4dc4-b0e5-323228a0c002 req-9cf599ac-075d-4fce-a126-4b086613a84b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060898 Aug 04 14:02:40.044677 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 969/1969] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:40.051656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-09c2b387-854b-46d0-8820-bfb7de443802 req-21b3beff-d7c0-44f7-8157-1537510f4289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff40e66-7ec3-44cd-b16b-c45f94bd0b77", "name": "network-vif-plugged", "status": "completed", "tag": "c12ce3a2-3807-40e9-ae8f-407560c1b4ab"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:40.073200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-09c2b387-854b-46d0-8820-bfb7de443802 req-21b3beff-d7c0-44f7-8157-1537510f4289 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:40.073497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-09c2b387-854b-46d0-8820-bfb7de443802 req-21b3beff-d7c0-44f7-8157-1537510f4289 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:40.093137 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-09c2b387-854b-46d0-8820-bfb7de443802 req-21b3beff-d7c0-44f7-8157-1537510f4289 service nova] Creating event network-vif-plugged:c12ce3a2-3807-40e9-ae8f-407560c1b4ab for instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 on n-h1-844627-10 Aug 04 14:02:40.101739 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-09c2b387-854b-46d0-8820-bfb7de443802 req-21b3beff-d7c0-44f7-8157-1537510f4289 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055072 Aug 04 14:02:40.102484 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 970/1970] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:40.109591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b2171e71-59f0-4a13-ad33-99edb0b3e08b tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:40.110434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b2171e71-59f0-4a13-ad33-99edb0b3e08b tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:40.120164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2171e71-59f0-4a13-ad33-99edb0b3e08b tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:40.120774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2171e71-59f0-4a13-ad33-99edb0b3e08b tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:40.122201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2171e71-59f0-4a13-ad33-99edb0b3e08b tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:40.122901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2171e71-59f0-4a13-ad33-99edb0b3e08b tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:40.219298 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b2171e71-59f0-4a13-ad33-99edb0b3e08b tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6/ips" status: 200 len: 179 microversion: 2.1 time: 0.114552 Aug 04 14:02:40.224170 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 971/1971] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:02:40 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6/ips => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:40.253836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9e62b375-4e4a-4292-9935-f5597b271a4a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:40.254311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9e62b375-4e4a-4292-9935-f5597b271a4a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:40.264097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e62b375-4e4a-4292-9935-f5597b271a4a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:40.264635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e62b375-4e4a-4292-9935-f5597b271a4a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:40.265907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e62b375-4e4a-4292-9935-f5597b271a4a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:40.266575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e62b375-4e4a-4292-9935-f5597b271a4a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:40.307142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9e62b375-4e4a-4292-9935-f5597b271a4a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:02:40.475025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:40.550916 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9e62b375-4e4a-4292-9935-f5597b271a4a tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 204 len: 0 microversion: 2.1 time: 0.275729 Aug 04 14:02:40.558612 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 972/1972] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:02:40 2022] DELETE /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:02:40.586573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:40.589947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:40.643104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:40.646251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:40.657078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:40.660931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:41.160727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ad46a1ce-8bbd-478d-93ee-ef9a13b27daa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:41.194622 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ad46a1ce-8bbd-478d-93ee-ef9a13b27daa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1318 microversion: 2.1 time: 1.356801 Aug 04 14:02:41.197754 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1001/1973] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:39 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1318 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:41.229916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:41.232684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:41.248130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:41.249697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:41.251613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:41.252834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:41.804449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:41.834442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:41.837822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:41.842032 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3e022cbc-2c5c-4544-824d-67c29db8c3f2 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1552 microversion: 2.21 time: 1.274864 Aug 04 14:02:41.843311 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 973/1974] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:40 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1552 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:41.852792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-649b4315-c720-4a2f-b624-2d532a992fe5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3a9cd30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:42.017169 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-649b4315-c720-4a2f-b624-2d532a992fe5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.171438 Aug 04 14:02:42.019717 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 974/1975] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:41 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:42.045355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-168af9d9-fc29-42a2-a6b7-63c52f4755ef tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:42.047356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-168af9d9-fc29-42a2-a6b7-63c52f4755ef tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:42.087099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-168af9d9-fc29-42a2-a6b7-63c52f4755ef tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:42.091334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-168af9d9-fc29-42a2-a6b7-63c52f4755ef tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:42.093334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-168af9d9-fc29-42a2-a6b7-63c52f4755ef tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:42.093912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-168af9d9-fc29-42a2-a6b7-63c52f4755ef tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:42.138557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:42.158949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:42.163492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:42.169081 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61b1644c-252b-401b-a58b-8b97c7047383 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.965754 Aug 04 14:02:42.170377 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1002/1976] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:41 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:42.190225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbc94dc2-692e-4554-b769-341ee4684214 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:42.191808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fbc94dc2-692e-4554-b769-341ee4684214 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:42.228381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbc94dc2-692e-4554-b769-341ee4684214 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:42.230952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbc94dc2-692e-4554-b769-341ee4684214 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:42.235488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbc94dc2-692e-4554-b769-341ee4684214 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:42.238585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbc94dc2-692e-4554-b769-341ee4684214 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:43.063581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-168af9d9-fc29-42a2-a6b7-63c52f4755ef tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:43.096234 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-168af9d9-fc29-42a2-a6b7-63c52f4755ef tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1674 microversion: 2.1 time: 1.074262 Aug 04 14:02:43.102994 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 975/1977] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:42 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1674 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:43.127891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6b5846d-815b-4130-a529-e37343dcaaf4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:43.129350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6b5846d-815b-4130-a529-e37343dcaaf4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:43.153704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6b5846d-815b-4130-a529-e37343dcaaf4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:43.155978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6b5846d-815b-4130-a529-e37343dcaaf4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:43.165948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6b5846d-815b-4130-a529-e37343dcaaf4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:43.167131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6b5846d-815b-4130-a529-e37343dcaaf4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:43.188952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:43.265680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6b5846d-815b-4130-a529-e37343dcaaf4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:02:43.344115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:43.427931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fbc94dc2-692e-4554-b769-341ee4684214 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:43.459541 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fbc94dc2-692e-4554-b769-341ee4684214 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1505 microversion: 2.1 time: 1.269042 Aug 04 14:02:43.466709 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1003/1978] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:42 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1505 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:43.489518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da38f2a9-639d-41b5-b2df-2ce3ccd62bc5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:43.494367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-da38f2a9-639d-41b5-b2df-2ce3ccd62bc5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:43.499543 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6b5846d-815b-4130-a529-e37343dcaaf4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 204 len: 0 microversion: 2.21 time: 0.393037 Aug 04 14:02:43.500860 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 976/1979] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:02:43 2022] DELETE /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:02:43.517895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da38f2a9-639d-41b5-b2df-2ce3ccd62bc5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:43.518984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da38f2a9-639d-41b5-b2df-2ce3ccd62bc5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:43.519951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa22ca4d-63bb-452f-af0b-b568ce7b365b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3c4e700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:43.520989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da38f2a9-639d-41b5-b2df-2ce3ccd62bc5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:43.521994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da38f2a9-639d-41b5-b2df-2ce3ccd62bc5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:43.627802 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fa22ca4d-63bb-452f-af0b-b568ce7b365b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.122661 Aug 04 14:02:43.629484 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 977/1980] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:43 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:43.641896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:43.642911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:43.652639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:43.653235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:43.654595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:43.655221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:44.702766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-da38f2a9-639d-41b5-b2df-2ce3ccd62bc5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:44.709334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:44.723950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:44.725593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:44.726775 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a69cb371-654f-4463-8ee4-4999639e84a5 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 1.095452 Aug 04 14:02:44.728981 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 978/1981] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:43 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:44.739248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:44.740243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:44.752390 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-da38f2a9-639d-41b5-b2df-2ce3ccd62bc5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1467 microversion: 2.1 time: 1.280861 Aug 04 14:02:44.772755 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1004/1982] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:43 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1467 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:44.780279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:44.781499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:44.782766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:44.783623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:44.813396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0cfe8981-96c7-46dc-9385-6fb4008127b1 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:44.816151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0cfe8981-96c7-46dc-9385-6fb4008127b1 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:44.846461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cfe8981-96c7-46dc-9385-6fb4008127b1 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:44.848331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cfe8981-96c7-46dc-9385-6fb4008127b1 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:44.856400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cfe8981-96c7-46dc-9385-6fb4008127b1 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:44.862136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cfe8981-96c7-46dc-9385-6fb4008127b1 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:45.558734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0cfe8981-96c7-46dc-9385-6fb4008127b1 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:45.567998 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0cfe8981-96c7-46dc-9385-6fb4008127b1 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1674 microversion: 2.1 time: 0.781254 Aug 04 14:02:45.574040 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1005/1983] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:44 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1674 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:45.579692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3d62ee6-88db-4d46-a5bd-55fbb7dde434 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:45.590161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b3d62ee6-88db-4d46-a5bd-55fbb7dde434 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:45.613411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3d62ee6-88db-4d46-a5bd-55fbb7dde434 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:45.615018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3d62ee6-88db-4d46-a5bd-55fbb7dde434 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:45.625866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3d62ee6-88db-4d46-a5bd-55fbb7dde434 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:45.628408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3d62ee6-88db-4d46-a5bd-55fbb7dde434 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:45.642791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:45.653538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:45.661654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:45.663286 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0e216276-fd88-4d35-abce-3389e8645393 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1558 microversion: 2.21 time: 0.932976 Aug 04 14:02:45.670133 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 979/1984] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:44 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1558 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:45.675426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d40ab31b-c9d4-4873-a620-2f24c529cef5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3c43af0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:45.757671 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d40ab31b-c9d4-4873-a620-2f24c529cef5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.086030 Aug 04 14:02:45.758717 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 980/1985] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:45 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:45.772269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:45.804459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:45.806199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Searching by: {'reservation_id': 'r-s020p0tu', 'deleted': False, 'project_id': 'ac3308acf403461d902ba64604e3382e'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:02:45.820093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:45.828393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:45.831965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:45.845651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:46.105930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:02:46.242232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:46.258538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:46.259323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:46.441341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b3d62ee6-88db-4d46-a5bd-55fbb7dde434 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:46.454234 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3d62ee6-88db-4d46-a5bd-55fbb7dde434 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1505 microversion: 2.1 time: 0.878594 Aug 04 14:02:46.457631 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1006/1986] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:45 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1505 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:46.471259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-52315f7d-804f-407d-b30b-9be9fb71e23a req-03c6ebba-98c0-46ee-8d27-3cfaba1fd499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7578dbfd-3c29-4085-bd8f-cd7cf53db3c6", "name": "network-vif-deleted", "tag": "b31fc341-4893-4d87-9f76-50471c9d03ad"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:46.496044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-52315f7d-804f-407d-b30b-9be9fb71e23a req-03c6ebba-98c0-46ee-8d27-3cfaba1fd499 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:46.496837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-52315f7d-804f-407d-b30b-9be9fb71e23a req-03c6ebba-98c0-46ee-8d27-3cfaba1fd499 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:46.529146 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-52315f7d-804f-407d-b30b-9be9fb71e23a req-03c6ebba-98c0-46ee-8d27-3cfaba1fd499 service nova] Creating event network-vif-deleted:b31fc341-4893-4d87-9f76-50471c9d03ad for instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 on n-h2-844627-10 Aug 04 14:02:46.541985 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-52315f7d-804f-407d-b30b-9be9fb71e23a req-03c6ebba-98c0-46ee-8d27-3cfaba1fd499 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082570 Aug 04 14:02:46.543387 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1007/1987] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:46.550775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:46.555885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:46.585405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:46.587725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:46.589838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:46.603161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:47.340761 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:47.388459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:47.391944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:47.402218 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c04a3484-42ac-4245-8b7b-984e2d64b01d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 0.856870 Aug 04 14:02:47.414979 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1008/1988] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:46 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:47.480850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb93534f-3dd6-46c6-b6f4-08e30a229dfb tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:47.484430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb93534f-3dd6-46c6-b6f4-08e30a229dfb tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:47.500588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb93534f-3dd6-46c6-b6f4-08e30a229dfb tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:47.502871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb93534f-3dd6-46c6-b6f4-08e30a229dfb tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:47.504841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb93534f-3dd6-46c6-b6f4-08e30a229dfb tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:47.506319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb93534f-3dd6-46c6-b6f4-08e30a229dfb tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:48.108707 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3f47d145-34f7-4447-8309-e71a07cd43f4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?reservation_id=r-s020p0tu" status: 200 len: 2927 microversion: 2.1 time: 2.341356 Aug 04 14:02:48.110034 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 981/1989] 10.222.0.66 () {58 vars in 1197 bytes} [Thu Aug 4 14:02:45 2022] GET /compute/v2.1/servers/detail?reservation_id=r-s020p0tu => generated 2927 bytes in 2351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:48.147526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-32ed104c-dedd-436f-8c35-85a7a12969a0 req-afb06f1b-9013-423a-aa84-e8a6edba660e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7578dbfd-3c29-4085-bd8f-cd7cf53db3c6", "name": "network-vif-unplugged", "status": "completed", "tag": "1c233164-a500-4d80-8bbc-b54d232151a6"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:48.201494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-32ed104c-dedd-436f-8c35-85a7a12969a0 req-afb06f1b-9013-423a-aa84-e8a6edba660e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:48.202319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-32ed104c-dedd-436f-8c35-85a7a12969a0 req-afb06f1b-9013-423a-aa84-e8a6edba660e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:48.251178 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-32ed104c-dedd-436f-8c35-85a7a12969a0 req-afb06f1b-9013-423a-aa84-e8a6edba660e service nova] Creating event network-vif-unplugged:1c233164-a500-4d80-8bbc-b54d232151a6 for instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 on n-h2-844627-10 Aug 04 14:02:48.285052 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-32ed104c-dedd-436f-8c35-85a7a12969a0 req-afb06f1b-9013-423a-aa84-e8a6edba660e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172230 Aug 04 14:02:48.303457 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 982/1990] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:48.350406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:48.353752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:48.379970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:48.384766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:48.386950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:48.390461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:48.791510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb93534f-3dd6-46c6-b6f4-08e30a229dfb tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:48.800685 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb93534f-3dd6-46c6-b6f4-08e30a229dfb tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1494 microversion: 2.1 time: 1.336112 Aug 04 14:02:48.807508 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1009/1991] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:47 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1494 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:48.818102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8185cd00-56a4-468e-8879-2dc677829e0d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47055333a0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:48.945856 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8185cd00-56a4-468e-8879-2dc677829e0d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.137036 Aug 04 14:02:48.947202 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1010/1992] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:48 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:48.959900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2ef66b1d-5fb8-4fee-b9f1-1f5e611d1bf3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:48.969881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2ef66b1d-5fb8-4fee-b9f1-1f5e611d1bf3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:48.989705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ef66b1d-5fb8-4fee-b9f1-1f5e611d1bf3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:48.990288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ef66b1d-5fb8-4fee-b9f1-1f5e611d1bf3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:48.991354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ef66b1d-5fb8-4fee-b9f1-1f5e611d1bf3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:48.992000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ef66b1d-5fb8-4fee-b9f1-1f5e611d1bf3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:49.626178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2ef66b1d-5fb8-4fee-b9f1-1f5e611d1bf3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:49.643881 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2ef66b1d-5fb8-4fee-b9f1-1f5e611d1bf3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1505 microversion: 2.1 time: 0.693854 Aug 04 14:02:49.645280 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1011/1993] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:48 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1505 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:49.650441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:49.677681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9506142a-f0a9-45b7-99e1-1e63515bea91 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:49.678260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:49.680359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee4658e74eb048559566a4e0e379f1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1b43a53a7c4b66a6cd1aea18aabaf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:49.697280 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-10f66c89-d8b4-45ad-b2a9-a09ad7a31e6f tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 200 len: 1558 microversion: 2.21 time: 1.388454 Aug 04 14:02:49.707793 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 983/1994] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:48 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 1558 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:49.717064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:49.721067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:49.732460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.compute.server_groups [None req-9506142a-f0a9-45b7-99e1-1e63515bea91 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Querying cell bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) for 2 instances {{(pid=130961) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 14:02:49.737314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9506142a-f0a9-45b7-99e1-1e63515bea91 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:49.738016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:49.738763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9506142a-f0a9-45b7-99e1-1e63515bea91 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:49.739484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:49.741628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:49.747054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:49.860015 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9506142a-f0a9-45b7-99e1-1e63515bea91 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/28cafe75-8be0-440c-824d-c26796a4a2fb" status: 200 len: 271 microversion: 2.1 time: 0.205017 Aug 04 14:02:49.866849 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1012/1995] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:02:49 2022] GET /compute/v2.1/os-server-groups/28cafe75-8be0-440c-824d-c26796a4a2fb => generated 271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:49.891765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cc657312-1774-4c9e-b94b-d73ee3a670d7 req-5067d68f-efbe-43a2-ab3a-16050246d261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7578dbfd-3c29-4085-bd8f-cd7cf53db3c6", "name": "network-vif-deleted", "tag": "1c233164-a500-4d80-8bbc-b54d232151a6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:49.926626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cc657312-1774-4c9e-b94b-d73ee3a670d7 req-5067d68f-efbe-43a2-ab3a-16050246d261 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:49.927458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cc657312-1774-4c9e-b94b-d73ee3a670d7 req-5067d68f-efbe-43a2-ab3a-16050246d261 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:49.960914 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cc657312-1774-4c9e-b94b-d73ee3a670d7 req-5067d68f-efbe-43a2-ab3a-16050246d261 service nova] Creating event network-vif-deleted:1c233164-a500-4d80-8bbc-b54d232151a6 for instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 on n-h2-844627-10 Aug 04 14:02:49.994357 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cc657312-1774-4c9e-b94b-d73ee3a670d7 req-5067d68f-efbe-43a2-ab3a-16050246d261 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118729 Aug 04 14:02:50.002254 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1013/1996] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:50.011020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:50.012329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:50.023807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:50.024817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:50.025949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:50.026726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:50.077463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:50.078634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:50.079445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lazy-loading 'fault' on Instance uuid 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:02:50.843763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f7db7c684842e998aaf40a738ee665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a247be28b5c4f73be8526e19b9a0b91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:50.860505 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e0ee65a9-6cec-468c-81f9-557f5a5ee1ce tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 200 len: 1302 microversion: 2.1 time: 0.851868 Aug 04 14:02:50.865480 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1014/1997] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:50 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 1302 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:50.881240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-00ee58ed-91e7-4416-8231-7f3e492e2509 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:50.883611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-00ee58ed-91e7-4416-8231-7f3e492e2509 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:50.916241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00ee58ed-91e7-4416-8231-7f3e492e2509 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:50.920667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00ee58ed-91e7-4416-8231-7f3e492e2509 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:50.930058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00ee58ed-91e7-4416-8231-7f3e492e2509 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:50.937890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00ee58ed-91e7-4416-8231-7f3e492e2509 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:51.150973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:51.167757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:51.170211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:51.179427 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0e652dd9-d913-464e-981c-bf0d29eacd62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1486 microversion: 2.25 time: 1.470068 Aug 04 14:02:51.180624 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 984/1998] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:49 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1486 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:51.185734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21437d90-820e-4be8-bfb0-980f56392653 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3ab0f70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:51.269569 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-21437d90-820e-4be8-bfb0-980f56392653 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.087482 Aug 04 14:02:51.271203 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 985/1999] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:51 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:51.285164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e2469e6e-21d5-436e-ad4e-c8c28696a18e req-9cb18b32-0d72-4483-84b7-6c0bfac7eab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b025da80-9fce-4e40-8969-df41d441bc83", "name": "network-vif-unplugged", "status": "completed", "tag": "7fc6fd22-3a61-4f1d-b8b2-cf103080040f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:51.316740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e2469e6e-21d5-436e-ad4e-c8c28696a18e req-9cb18b32-0d72-4483-84b7-6c0bfac7eab3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:51.318725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e2469e6e-21d5-436e-ad4e-c8c28696a18e req-9cb18b32-0d72-4483-84b7-6c0bfac7eab3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:51.350564 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e2469e6e-21d5-436e-ad4e-c8c28696a18e req-9cb18b32-0d72-4483-84b7-6c0bfac7eab3 service nova] Creating event network-vif-unplugged:7fc6fd22-3a61-4f1d-b8b2-cf103080040f for instance b025da80-9fce-4e40-8969-df41d441bc83 on n-h2-844627-10 Aug 04 14:02:51.360775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:51.363729 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e2469e6e-21d5-436e-ad4e-c8c28696a18e req-9cb18b32-0d72-4483-84b7-6c0bfac7eab3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090387 Aug 04 14:02:51.369655 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 986/2000] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:51.701381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f0f695aa-7890-47b5-ab80-1114407c0331 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Action: 'create', calling method: .version_select at 0x7f46f39e70d0>, body: {"keypair": {"name": "tempest-keypair-259315134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjRTHjOyYgUBVeGf1GanofYQQy8Dy5HyaoYwekXFKsQ7vjPFHsca/r7oZCrGezAbmdG7W02c6j+0Ok7BKftpIeybLlyANeQVFKw4ybaUiDW6OraTdnUPLJYHJk5fiQ60g=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:51.716239 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-00ee58ed-91e7-4416-8231-7f3e492e2509 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9" status: 200 len: 1620 microversion: 2.1 time: 0.847493 Aug 04 14:02:51.729278 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1015/2001] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:50 2022] GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9 => generated 1620 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:51.739251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-11dc8f40-d97e-4832-801e-5cb5a8981dec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:51.739896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-11dc8f40-d97e-4832-801e-5cb5a8981dec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:51.749091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-11dc8f40-d97e-4832-801e-5cb5a8981dec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:51.749592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-11dc8f40-d97e-4832-801e-5cb5a8981dec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:51.750726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-11dc8f40-d97e-4832-801e-5cb5a8981dec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:51.751423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-11dc8f40-d97e-4832-801e-5cb5a8981dec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:51.787173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f0f695aa-7890-47b5-ab80-1114407c0331 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Getting quotas for project 5f3ebad11a3e4f4995cfa039f1c3c9fc. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:51.794998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f0f695aa-7890-47b5-ab80-1114407c0331 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Getting quotas for user a62b7ec7d8554b7dba75dcac4dfa5bc9 and project 5f3ebad11a3e4f4995cfa039f1c3c9fc. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:51.873686 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f0f695aa-7890-47b5-ab80-1114407c0331 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.499832 Aug 04 14:02:51.874425 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 987/2002] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:02:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:51.908594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:51.926224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:51.963449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:51.989912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:51.991421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:51.992300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.080586 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] HTTP exception thrown: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Request method failure captured: Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 HTTP/1.1 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69FnMCNZWSr2iJpSx_D6eCGDg-I7R9VkEpsGdyuGLqf80v430063b7Z5l4atA5J199gX9lKwO2ejz95RH4IbLMrvcKeg_T_CxyMiZ25Pu8zEtN54Ch3SjWpzQ_Q3vs3yEfjw_dxM-SnoX4yIb30421aaurTxDawIJkQ9AaOluNngp4Y Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ce1b43a53a7c4b66a6cd1aea18aabaf1 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-InstanceActionsV221TestJSON-839972419 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}] Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-InstanceActionsV221TestJSON-839972419 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ce1b43a53a7c4b66a6cd1aea18aabaf1 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-839972419 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-InstanceActionsV221TestJSON-839972419-project Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: ee4658e74eb048559566a4e0e379f1d0 Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-InstanceActionsV221TestJSON-839972419-project Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b025da80-9fce-4e40-8969-df41d441bc83'} Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.091244 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:02:52.109057 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.109057 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:52.109057 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:02:52.109057 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:02:52.109057 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:02:52.109057 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:02:52.109057 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.109057 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.109057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Returning 404 to user: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:02:52.111627 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9db5d65b-c620-4cbe-b51f-263039ba1bb4 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 404 len: 111 microversion: 2.21 time: 0.220943 Aug 04 14:02:52.111827 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 988/2003] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:51 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:02:52.124151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc248df1-c7b6-49dc-b8cd-b0e2c8efad68 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:52.124751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bc248df1-c7b6-49dc-b8cd-b0e2c8efad68 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:52.141703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc248df1-c7b6-49dc-b8cd-b0e2c8efad68 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.142157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc248df1-c7b6-49dc-b8cd-b0e2c8efad68 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.142964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc248df1-c7b6-49dc-b8cd-b0e2c8efad68 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.143405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc248df1-c7b6-49dc-b8cd-b0e2c8efad68 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.241260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-11dc8f40-d97e-4832-801e-5cb5a8981dec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:52.251855 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-11dc8f40-d97e-4832-801e-5cb5a8981dec tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1505 microversion: 2.1 time: 0.520329 Aug 04 14:02:52.255811 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1016/2004] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:51 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:52.269102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:52.270379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:52.286825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.290481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.294222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.295475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.332551 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] HTTP exception thrown: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Request method failure captured: Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 HTTP/1.1 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69D-F1tJWtwbtqay1-L97ENGkD52ZUtd9PRDGh-eJzsM2ajAYovg4WBbZoK3Y2qbzCuIudw-vezuJqW5ozYkShbssOXz97jz6OSai_7p8O0Asx6B0oRxvpUW3hLTWBCBMgVzYayZPrQJLsTjb1AKgGwx30c9Rh9gN3Y6Uj94Fs5YM6g Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}] Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestMultiNic-1859673299 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f0f7db7c684842e998aaf40a738ee665 Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7578dbfd-3c29-4085-bd8f-cd7cf53db3c6'} Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:02:52.338756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.344688 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:52.344688 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:02:52.344688 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:02:52.344688 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:02:52.344688 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:02:52.344688 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:02:52.344688 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.347957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Returning 404 to user: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:02:52.349969 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2e3055c6-a2c6-43a9-aa67-d33f00bf2335 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 404 len: 111 microversion: 2.1 time: 0.090092 Aug 04 14:02:52.354535 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1017/2005] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:52 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:02:52.374857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-35a524df-d94d-423b-acec-7ff2fd391f47 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '.version_select at 0x7f46f3a370d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:52.375507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-35a524df-d94d-423b-acec-7ff2fd391f47 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:52.406697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35a524df-d94d-423b-acec-7ff2fd391f47 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.407264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35a524df-d94d-423b-acec-7ff2fd391f47 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.415105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35a524df-d94d-423b-acec-7ff2fd391f47 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.416155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35a524df-d94d-423b-acec-7ff2fd391f47 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.643903 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bc248df1-c7b6-49dc-b8cd-b0e2c8efad68 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1620 microversion: 2.1 time: 0.523374 Aug 04 14:02:52.645632 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-35a524df-d94d-423b-acec-7ff2fd391f47 tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.289534 Aug 04 14:02:52.651130 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1018/2006] 10.222.0.66 () {60 vars in 1337 bytes} [Thu Aug 4 14:02:52 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83/os-instance-actions => generated 611 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:02:52.659341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:52.659988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:52.663068 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 989/2007] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:52 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1620 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:52.678556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.679172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.679531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-397a2693-15ef-4638-aa20-e7c9cc8bce4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3bbb5e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:52.680116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.683694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.769024 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-397a2693-15ef-4638-aa20-e7c9cc8bce4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.104609 Aug 04 14:02:52.773275 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 990/2008] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:52 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:52.790150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7777ef7c-8019-4697-af05-368dca6f9132 req-15d54db8-d8c2-424c-95e6-3ffbddb293f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b025da80-9fce-4e40-8969-df41d441bc83", "name": "network-vif-deleted", "tag": "7fc6fd22-3a61-4f1d-b8b2-cf103080040f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:52.819399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7777ef7c-8019-4697-af05-368dca6f9132 req-15d54db8-d8c2-424c-95e6-3ffbddb293f3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.820308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7777ef7c-8019-4697-af05-368dca6f9132 req-15d54db8-d8c2-424c-95e6-3ffbddb293f3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.851620 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7777ef7c-8019-4697-af05-368dca6f9132 req-15d54db8-d8c2-424c-95e6-3ffbddb293f3 service nova] Creating event network-vif-deleted:7fc6fd22-3a61-4f1d-b8b2-cf103080040f for instance b025da80-9fce-4e40-8969-df41d441bc83 on n-h2-844627-10 Aug 04 14:02:52.864423 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7777ef7c-8019-4697-af05-368dca6f9132 req-15d54db8-d8c2-424c-95e6-3ffbddb293f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087811 Aug 04 14:02:52.879438 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 991/2009] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:52.909222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:52.912969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:52.934014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.934859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.935763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:52.936220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:52.958759 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] HTTP exception thrown: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Request method failure captured: Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 HTTP/1.1 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69FnMCNZWSr2iJpSx_D6eCGDg-I7R9VkEpsGdyuGLqf80v430063b7Z5l4atA5J199gX9lKwO2ejz95RH4IbLMrvcKeg_T_CxyMiZ25Pu8zEtN54Ch3SjWpzQ_Q3vs3yEfjw_dxM-SnoX4yIb30421aaurTxDawIJkQ9AaOluNngp4Y Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ce1b43a53a7c4b66a6cd1aea18aabaf1 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-InstanceActionsV221TestJSON-839972419 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}] Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-InstanceActionsV221TestJSON-839972419 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ce1b43a53a7c4b66a6cd1aea18aabaf1 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-839972419 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-InstanceActionsV221TestJSON-839972419-project Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: ee4658e74eb048559566a4e0e379f1d0 Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-InstanceActionsV221TestJSON-839972419-project Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b025da80-9fce-4e40-8969-df41d441bc83'} Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:02:52.963655 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Returning 404 to user: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-09c0a29b-0196-4c28-88e4-1a4e18a3690b tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 404 len: 111 microversion: 2.21 time: 0.085107 Aug 04 14:02:52.970172 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 992/2010] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:02:52 2022] DELETE /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:02:52.977654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-900572142", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "7984a6d3-8edb-45ab-a340-bc9df16df6f3"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:53.076191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:02:53.300162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:53.318086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:53.319671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:53.323692 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-52a4c0fb-f4dd-42d0-8dfc-03094f7c8087 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1476 microversion: 2.25 time: 0.671373 Aug 04 14:02:53.324272 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1019/2011] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:52 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1476 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:53.333915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:53.340776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] [instance: b025da80-9fce-4e40-8969-df41d441bc83] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:53.361394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:53.362311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:53.363135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:53.367367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:53.394178 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] HTTP exception thrown: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Request method failure captured: Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 HTTP/1.1 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69FnMCNZWSr2iJpSx_D6eCGDg-I7R9VkEpsGdyuGLqf80v430063b7Z5l4atA5J199gX9lKwO2ejz95RH4IbLMrvcKeg_T_CxyMiZ25Pu8zEtN54Ch3SjWpzQ_Q3vs3yEfjw_dxM-SnoX4yIb30421aaurTxDawIJkQ9AaOluNngp4Y Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: ce1b43a53a7c4b66a6cd1aea18aabaf1 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-InstanceActionsV221TestJSON-839972419 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ce1b43a53a7c4b66a6cd1aea18aabaf1"}]}] Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-InstanceActionsV221TestJSON-839972419 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: ce1b43a53a7c4b66a6cd1aea18aabaf1 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-839972419 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-InstanceActionsV221TestJSON-839972419-project Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: ee4658e74eb048559566a4e0e379f1d0 Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-InstanceActionsV221TestJSON-839972419-project Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b025da80-9fce-4e40-8969-df41d441bc83'} Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:53.396429 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:02:53.405019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:53.405019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:02:53.405019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:02:53.405019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:02:53.405019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:02:53.405019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:02:53.405019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. Aug 04 14:02:53.405019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:02:53.410031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] Returning 404 to user: Instance b025da80-9fce-4e40-8969-df41d441bc83 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:02:53.411441 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-65c6f1a6-c595-4fea-a137-c9a6eb42596d tempest-InstanceActionsV221TestJSON-839972419 tempest-InstanceActionsV221TestJSON-839972419-project] 10.222.0.66 "GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83" status: 404 len: 111 microversion: 2.21 time: 0.082881 Aug 04 14:02:53.413497 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1020/2012] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:53 2022] GET /compute/v2.1/servers/b025da80-9fce-4e40-8969-df41d441bc83 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:02:53.437966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1bb87639-58a4-4c2a-8dd4-1dbc7d6d2fc3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:53.441419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1bb87639-58a4-4c2a-8dd4-1dbc7d6d2fc3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:53.450706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bb87639-58a4-4c2a-8dd4-1dbc7d6d2fc3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:53.451577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bb87639-58a4-4c2a-8dd4-1dbc7d6d2fc3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:53.452834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bb87639-58a4-4c2a-8dd4-1dbc7d6d2fc3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:53.454365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bb87639-58a4-4c2a-8dd4-1dbc7d6d2fc3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:53.649263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:02:53.651125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:02:53.651843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:02:53.652737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:02:53.653412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:02:53.684595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:53.685466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:53.686602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:53.687281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:53.724351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:53.749684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:53.814780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:02:53.817389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:02:53.980633 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-11d9decc-835c-4443-ba9b-9121caa2e6b2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009351 Aug 04 14:02:53.983946 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 993/2013] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:02:54.015985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f085ddeb-e5f5-424b-97ef-194d2bca1e06 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '.version_select at 0x7f46f39e7160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:54.032967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f085ddeb-e5f5-424b-97ef-194d2bca1e06 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:54.034980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f085ddeb-e5f5-424b-97ef-194d2bca1e06 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:54.079232 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f085ddeb-e5f5-424b-97ef-194d2bca1e06 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 2805 microversion: 2.25 time: 0.090762 Aug 04 14:02:54.096026 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 994/2014] 10.222.0.66 () {60 vars in 1184 bytes} [Thu Aug 4 14:02:53 2022] GET /compute/v2.1/os-migrations => generated 2805 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:54.107984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e53c705a-b803-44d1-a60e-630f298d9f94 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3ae7f70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:54.180510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1bb87639-58a4-4c2a-8dd4-1dbc7d6d2fc3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:54.236368 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1bb87639-58a4-4c2a-8dd4-1dbc7d6d2fc3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1480 microversion: 2.1 time: 0.821335 Aug 04 14:02:54.236997 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1021/2015] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:53 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1480 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:54.253795 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e53c705a-b803-44d1-a60e-630f298d9f94 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.155631 Aug 04 14:02:54.259300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8a960c64-abaf-4373-9138-1917db556c53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:54.260194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8a960c64-abaf-4373-9138-1917db556c53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:54.262040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 995/2016] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:54 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:54.276769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c55e3513-7f76-48e0-83c8-c1c80f34eca6 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:54.283407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c55e3513-7f76-48e0-83c8-c1c80f34eca6 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:54.345578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c55e3513-7f76-48e0-83c8-c1c80f34eca6 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:54.346117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c55e3513-7f76-48e0-83c8-c1c80f34eca6 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:54.352656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c55e3513-7f76-48e0-83c8-c1c80f34eca6 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:54.356310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c55e3513-7f76-48e0-83c8-c1c80f34eca6 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:54.680986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8a960c64-abaf-4373-9138-1917db556c53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:54.721905 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8a960c64-abaf-4373-9138-1917db556c53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1216 microversion: 2.1 time: 0.474996 Aug 04 14:02:54.723632 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1022/2017] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:54 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1216 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:54.743577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d3a34cbf-64a8-4d65-9950-46a293e73a6b tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '.version_select at 0x7f470559e3a0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:54.762573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3a34cbf-64a8-4d65-9950-46a293e73a6b tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:54.765186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3a34cbf-64a8-4d65-9950-46a293e73a6b tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:54.815005 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d3a34cbf-64a8-4d65-9950-46a293e73a6b tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 2345 microversion: 2.1 time: 0.084501 Aug 04 14:02:54.818473 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1023/2018] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 14:02:54 2022] GET /compute/v2.1/os-migrations => generated 2345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:54.836534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd1d7826-618f-4e5b-82ce-276a1cd8a9fb tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:54.845435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd1d7826-618f-4e5b-82ce-276a1cd8a9fb tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:54.869173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd1d7826-618f-4e5b-82ce-276a1cd8a9fb tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:54.875054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd1d7826-618f-4e5b-82ce-276a1cd8a9fb tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:54.876833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd1d7826-618f-4e5b-82ce-276a1cd8a9fb tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:54.877670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd1d7826-618f-4e5b-82ce-276a1cd8a9fb tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:54.955943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-c55e3513-7f76-48e0-83c8-c1c80f34eca6 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] Lazy-loading 'services' on Instance uuid 933d36e2-d798-4136-8f33-ce878c78dbe8 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:02:54.996983 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c55e3513-7f76-48e0-83c8-c1c80f34eca6 tempest-LiveAutoBlockMigrationV225Test-1270978955 tempest-LiveAutoBlockMigrationV225Test-1270978955-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1970 microversion: 2.25 time: 0.732951 Aug 04 14:02:55.009691 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 996/2019] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:54 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1970 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:55.053828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8fc32275-021b-4f5a-b02d-da3541dde6d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:55.056984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8fc32275-021b-4f5a-b02d-da3541dde6d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:55.069485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fc32275-021b-4f5a-b02d-da3541dde6d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:55.070811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fc32275-021b-4f5a-b02d-da3541dde6d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:55.072651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fc32275-021b-4f5a-b02d-da3541dde6d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:55.073814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fc32275-021b-4f5a-b02d-da3541dde6d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:55.193821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8fc32275-021b-4f5a-b02d-da3541dde6d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:02:55.456366 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8fc32275-021b-4f5a-b02d-da3541dde6d1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "DELETE /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 204 len: 0 microversion: 2.25 time: 0.410777 Aug 04 14:02:55.457821 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 997/2020] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:02:55 2022] DELETE /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:02:55.468205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a98ce326-919d-4c28-a9bd-aba3f158cae7 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f39e73a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:55.478970 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd1d7826-618f-4e5b-82ce-276a1cd8a9fb tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1633 microversion: 2.1 time: 0.649124 Aug 04 14:02:55.480795 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1024/2021] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:54 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1633 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:55.523238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:55.532739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:55.563107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:55.564427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:55.565841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:55.570403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:55.588514 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a98ce326-919d-4c28-a9bd-aba3f158cae7 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.129173 Aug 04 14:02:55.608010 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 998/2022] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:55 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:55.608010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-85e9d92a-4657-4920-b164-0da579a2296c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Action: 'create', calling method: .version_select at 0x7f46f3b59700>, body: {"keypair": {"name": "tempest-keypair-1212214566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7kw/Wc+loF2sRmexinIQYnRRatcuR/vFQ0mMTjx2GGxeQ1n7PkRUtjHoogFjUbb1qoBDv4YmR+aErkO6DqGa1GCPg3wVSAL1NK6sErlllAza2wk+EczYceo/vUkYofxw=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:55.688372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-85e9d92a-4657-4920-b164-0da579a2296c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:02:55.717291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-85e9d92a-4657-4920-b164-0da579a2296c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for user dd1aacb549b74c21a13b9f3ca2df840c and project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:02:55.772037 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-85e9d92a-4657-4920-b164-0da579a2296c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173552 Aug 04 14:02:55.782299 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 999/2023] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:02:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:55.807089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f762246b-bfc2-402d-b7ce-1e1298aa2747 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:55.808070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f762246b-bfc2-402d-b7ce-1e1298aa2747 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:55.830697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f762246b-bfc2-402d-b7ce-1e1298aa2747 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:55.831866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f762246b-bfc2-402d-b7ce-1e1298aa2747 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:55.834434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f762246b-bfc2-402d-b7ce-1e1298aa2747 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:55.840138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f762246b-bfc2-402d-b7ce-1e1298aa2747 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:56.124163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f762246b-bfc2-402d-b7ce-1e1298aa2747 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:56.170225 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f762246b-bfc2-402d-b7ce-1e1298aa2747 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1268 microversion: 2.1 time: 0.386425 Aug 04 14:02:56.188369 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1000/2024] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:55 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1268 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:56.360567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:56.376968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:56.378841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:56.380118 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb7e5295-ba5c-4390-bf8a-ddcdfbedb69a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1482 microversion: 2.25 time: 0.885444 Aug 04 14:02:56.380694 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1025/2025] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:55 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1482 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:56.631307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b555fa1f-f504-40f2-870a-256139baf2d7 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f39d2b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:56.760626 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b555fa1f-f504-40f2-870a-256139baf2d7 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.133198 Aug 04 14:02:56.774844 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1001/2026] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:56 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:57.196329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e83ff117-e9b0-49bc-9f3b-1d2149abccfa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:57.197164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e83ff117-e9b0-49bc-9f3b-1d2149abccfa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:57.215262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e83ff117-e9b0-49bc-9f3b-1d2149abccfa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:57.215846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e83ff117-e9b0-49bc-9f3b-1d2149abccfa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:57.222993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e83ff117-e9b0-49bc-9f3b-1d2149abccfa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:57.223591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e83ff117-e9b0-49bc-9f3b-1d2149abccfa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:57.434877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:57.436604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:57.472065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:57.500973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:57.510360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:57.510896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:57.527296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e83ff117-e9b0-49bc-9f3b-1d2149abccfa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:57.554403 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e83ff117-e9b0-49bc-9f3b-1d2149abccfa tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1274 microversion: 2.1 time: 0.362335 Aug 04 14:02:57.557794 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1026/2027] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:57 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1274 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:57.787007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c68850f-e96d-47e2-9d62-fec712a796aa tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f470560f040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:57.930092 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8c68850f-e96d-47e2-9d62-fec712a796aa tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.152677 Aug 04 14:02:57.931070 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1027/2028] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:57 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:02:58.319266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:58.345659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:58.366575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:58.367827 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2cabbecf-6d18-44de-8bb3-08777bbf2878 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1482 microversion: 2.25 time: 0.939502 Aug 04 14:02:58.374930 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1002/2029] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:57 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1482 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:02:58.585886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-23f6b765-c3d3-4057-82a9-606bf41b340e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:58.586754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-23f6b765-c3d3-4057-82a9-606bf41b340e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:58.608041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23f6b765-c3d3-4057-82a9-606bf41b340e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:58.608499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23f6b765-c3d3-4057-82a9-606bf41b340e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:58.623152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23f6b765-c3d3-4057-82a9-606bf41b340e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:58.623626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23f6b765-c3d3-4057-82a9-606bf41b340e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:58.820685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-23f6b765-c3d3-4057-82a9-606bf41b340e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:02:58.854026 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-23f6b765-c3d3-4057-82a9-606bf41b340e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1274 microversion: 2.1 time: 0.277519 Aug 04 14:02:58.859158 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1028/2030] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:02:58 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1274 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:58.947604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7feb67a-aa98-4758-82c1-92088a5be052 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3a9c5e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:59.084241 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7feb67a-aa98-4758-82c1-92088a5be052 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.142238 Aug 04 14:02:59.093619 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1003/2031] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:02:58 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:02:59.246111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2f21b74d-3b32-4101-b450-18999d9e3c6f req-816fc39f-845e-4128-b54b-c8c5b20749b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933d36e2-d798-4136-8f33-ce878c78dbe8", "name": "network-vif-deleted", "tag": "1d4c4e52-3e24-4f0c-98af-9f15be4642dd"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:59.263903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2f21b74d-3b32-4101-b450-18999d9e3c6f req-816fc39f-845e-4128-b54b-c8c5b20749b4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:59.265489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2f21b74d-3b32-4101-b450-18999d9e3c6f req-816fc39f-845e-4128-b54b-c8c5b20749b4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:59.294118 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2f21b74d-3b32-4101-b450-18999d9e3c6f req-816fc39f-845e-4128-b54b-c8c5b20749b4 service nova] Creating event network-vif-deleted:1d4c4e52-3e24-4f0c-98af-9f15be4642dd for instance 933d36e2-d798-4136-8f33-ce878c78dbe8 on n-h2-844627-10 Aug 04 14:02:59.304964 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2f21b74d-3b32-4101-b450-18999d9e3c6f req-816fc39f-845e-4128-b54b-c8c5b20749b4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071738 Aug 04 14:02:59.306488 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1029/2032] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:02:59.400942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:02:59.401936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:02:59.420515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:59.421435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:59.423475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:02:59.424830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:02:59.501715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:02:59.574574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8c5fe0e1-abef-46fb-8076-b537b8fe88c9"}], "security_groups": [{"name": "tempest-securitygroup--955363328"}], "key_name": "tempest-keypair-259315134", "user_data": "}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:02:59.590384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:00.118014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.144657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.150492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.155737 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3362da6e-51d0-4189-ba81-0eb22722a4e3 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1265 microversion: 2.25 time: 0.759607 Aug 04 14:03:00.157561 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1004/2033] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:02:59 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1265 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:03:00.166212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8afe366f-a067-4d23-9ab9-769877b00194 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:00.167712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8afe366f-a067-4d23-9ab9-769877b00194 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:00.182047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8afe366f-a067-4d23-9ab9-769877b00194 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:00.183258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8afe366f-a067-4d23-9ab9-769877b00194 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:00.185461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8afe366f-a067-4d23-9ab9-769877b00194 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:00.186349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8afe366f-a067-4d23-9ab9-769877b00194 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:00.405738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8afe366f-a067-4d23-9ab9-769877b00194 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:00.439058 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8afe366f-a067-4d23-9ab9-769877b00194 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1274 microversion: 2.1 time: 0.277823 Aug 04 14:03:00.442057 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1005/2034] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:00 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1274 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:00.462038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-587f3d05-636f-4b23-8746-007e40023c8d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3ba2c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:00.469254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] validate_networks() for [('8c5fe0e1-abef-46fb-8076-b537b8fe88c9', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:03:00.607233 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-587f3d05-636f-4b23-8746-007e40023c8d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.162417 Aug 04 14:03:00.608788 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1006/2035] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:00 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:00.958929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:00.960318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:00.973715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=5 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:01.027713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:01.028714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:01.037021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:01.037961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:01.161084 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] HTTP exception thrown: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Request method failure captured: Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 HTTP/1.1 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69D-F1tJWtwbtqay1-L97ENGkD52ZUtd9PRDGh-eJzsM2ajAYovg4WBbZoK3Y2qbzCuIudw-vezuJqW5ozYkShbssOXz97jz6OSai_7p8O0Asx6B0oRxvpUW3hLTWBCBMgVzYayZPrQJLsTjb1AKgGwx30c9Rh9gN3Y6Uj94Fs5YM6g Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}] Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f0f7db7c684842e998aaf40a738ee665 Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '7578dbfd-3c29-4085-bd8f-cd7cf53db3c6'} Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:03:01.169792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.175211 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.183005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Returning 404 to user: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:03:01.198984 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b48fe3f7-e64f-4169-a845-83dd29866b79 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 404 len: 111 microversion: 2.1 time: 0.248163 Aug 04 14:03:01.206190 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1007/2036] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:03:00 2022] DELETE /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:03:01.211955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:01.225882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:01.233434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:01.234352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:01.235350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:01.236005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:01.394304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:01.456159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:01.463038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:01.468468 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4eb4459a-9ae7-44fc-b91f-65f52ef0ea6b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1265 microversion: 2.25 time: 0.260347 Aug 04 14:03:01.511094 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1008/2037] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:01 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:01.522603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:01.528229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:01.545203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:01.550576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:01.554204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:01.554925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:01.598111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] HTTP exception thrown: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Request method failure captured: Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 HTTP/1.1 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69D-F1tJWtwbtqay1-L97ENGkD52ZUtd9PRDGh-eJzsM2ajAYovg4WBbZoK3Y2qbzCuIudw-vezuJqW5ozYkShbssOXz97jz6OSai_7p8O0Asx6B0oRxvpUW3hLTWBCBMgVzYayZPrQJLsTjb1AKgGwx30c9Rh9gN3Y6Uj94Fs5YM6g Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}] Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f0f7db7c684842e998aaf40a738ee665 Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '7578dbfd-3c29-4085-bd8f-cd7cf53db3c6'} Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:01.606074 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.613445 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:01.613445 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:01.613445 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:01.613445 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:03:01.613445 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:03:01.613445 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. Aug 04 14:03:01.613445 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:01.615087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Returning 404 to user: Instance 7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:03:01.616460 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-71f45399-de9a-47b7-8b88-4b7621a9f5fa tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6" status: 404 len: 111 microversion: 2.1 time: 0.104009 Aug 04 14:03:01.617638 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1009/2038] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:01 2022] GET /compute/v2.1/servers/7578dbfd-3c29-4085-bd8f-cd7cf53db3c6 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:03:01.627684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-289f0905-03c0-4471-a3a3-62f8cf71b3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:01.630999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-289f0905-03c0-4471-a3a3-62f8cf71b3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:01.657123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-289f0905-03c0-4471-a3a3-62f8cf71b3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:01.658090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-289f0905-03c0-4471-a3a3-62f8cf71b3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:01.659112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-289f0905-03c0-4471-a3a3-62f8cf71b3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:01.659845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-289f0905-03c0-4471-a3a3-62f8cf71b3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:02.495356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:03:02.495922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:03:02.496461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:03:02.496762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:03:02.497246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:03:02.524388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:02.533803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:02.537687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:02.541884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:02.643125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Getting quotas for project 5f3ebad11a3e4f4995cfa039f1c3c9fc. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:03:02.669558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Getting quotas for user a62b7ec7d8554b7dba75dcac4dfa5bc9 and project 5f3ebad11a3e4f4995cfa039f1c3c9fc. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:03:02.741186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:03:02.744369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:03:02.881906 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-156bc1df-fed1-46b8-91b3-ef64ae854d9b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.310948 Aug 04 14:03:02.890275 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1030/2039] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:02:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 3321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:03:02.896395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:02.897373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:02.914021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:02.918819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:02.921674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:02.951739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:02.952898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-289f0905-03c0-4471-a3a3-62f8cf71b3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:02.973829 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-289f0905-03c0-4471-a3a3-62f8cf71b3a9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1316 microversion: 2.1 time: 1.351828 Aug 04 14:03:02.987400 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1010/2040] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:01 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1316 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:02.996569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebe9bc34-5a36-4e32-84c2-5742f094d742 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3b67280>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:03.022781 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] HTTP exception thrown: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Request method failure captured: Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a HTTP/1.1 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69D-F1tJWtwbtqay1-L97ENGkD52ZUtd9PRDGh-eJzsM2ajAYovg4WBbZoK3Y2qbzCuIudw-vezuJqW5ozYkShbssOXz97jz6OSai_7p8O0Asx6B0oRxvpUW3hLTWBCBMgVzYayZPrQJLsTjb1AKgGwx30c9Rh9gN3Y6Uj94Fs5YM6g Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}] Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f0f7db7c684842e998aaf40a738ee665 Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a'} Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:03:03.024902 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Returning 404 to user: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e2d1bf3-1938-49ca-8fb8-6ae702eb1074 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 404 len: 111 microversion: 2.1 time: 0.134872 Aug 04 14:03:03.034322 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1031/2041] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:03:02 2022] DELETE /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:03:03.039139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:03.041897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:03.074883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:03.078339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:03.080458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:03.087778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:03.138046 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ebe9bc34-5a36-4e32-84c2-5742f094d742 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.158682 Aug 04 14:03:03.138748 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1011/2042] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:02 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:03.152344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c81256ff-789e-4fe5-9d44-d91c16a10125 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:03.158620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c81256ff-789e-4fe5-9d44-d91c16a10125 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:03.276267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.300950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.302511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.303764 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b7a8c658-8ea9-4dc9-91c7-92d57dd00814 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1265 microversion: 2.25 time: 0.275363 Aug 04 14:03:03.304340 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1032/2043] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:03 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:03.331889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:03.332811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] [instance: 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:03.351843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:03.354670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:03.356450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:03.359617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:03.423603 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] HTTP exception thrown: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Request method failure captured: Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a HTTP/1.1 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69D-F1tJWtwbtqay1-L97ENGkD52ZUtd9PRDGh-eJzsM2ajAYovg4WBbZoK3Y2qbzCuIudw-vezuJqW5ozYkShbssOXz97jz6OSai_7p8O0Asx6B0oRxvpUW3hLTWBCBMgVzYayZPrQJLsTjb1AKgGwx30c9Rh9gN3Y6Uj94Fs5YM6g Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4a247be28b5c4f73be8526e19b9a0b91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4a247be28b5c4f73be8526e19b9a0b91"}]}] Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 4a247be28b5c4f73be8526e19b9a0b91 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestMultiNic-1859673299 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f0f7db7c684842e998aaf40a738ee665 Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestMultiNic-1859673299-project Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a'} Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:03.425268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.435779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:03.435779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:03.435779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:03.435779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:03:03.435779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:03:03.435779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. Aug 04 14:03:03.435779 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:03.435779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] Returning 404 to user: Instance 3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:03:03.442197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6946405e-9339-4bf9-b616-5dea92203725 tempest-ServersTestMultiNic-1859673299 tempest-ServersTestMultiNic-1859673299-project] 10.222.0.66 "GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a" status: 404 len: 111 microversion: 2.1 time: 0.106899 Aug 04 14:03:03.442197 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1033/2044] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:03 2022] GET /compute/v2.1/servers/3d6ba9b7-48b4-4da5-88d0-0cc496dd5d4a => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:03:03.619605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c81256ff-789e-4fe5-9d44-d91c16a10125 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:03.648569 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c81256ff-789e-4fe5-9d44-d91c16a10125 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1225 microversion: 2.1 time: 0.505461 Aug 04 14:03:03.652299 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1012/2045] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:03 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1225 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:03.759691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1452961381", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "a6fe3b0e-589f-4137-b3da-0f7664c12e01"}], "security_groups": [{"name": "tempest-securitygroup--1432452114"}], "key_name": "tempest-keypair-1212214566", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:03.999485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-241288c8-6844-4218-8703-8ed83ffbe7ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:04.004024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-241288c8-6844-4218-8703-8ed83ffbe7ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:04.009481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:04.042764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-241288c8-6844-4218-8703-8ed83ffbe7ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:04.043795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-241288c8-6844-4218-8703-8ed83ffbe7ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:04.045385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-241288c8-6844-4218-8703-8ed83ffbe7ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:04.046077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-241288c8-6844-4218-8703-8ed83ffbe7ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:04.609172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] validate_networks() for [('a6fe3b0e-589f-4137-b3da-0f7664c12e01', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:03:05.506213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-241288c8-6844-4218-8703-8ed83ffbe7ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:05.539845 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-241288c8-6844-4218-8703-8ed83ffbe7ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1316 microversion: 2.1 time: 1.547767 Aug 04 14:03:05.540998 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1013/2046] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:03 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1316 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:05.546147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-749c78cb-d6cc-49ce-b738-47f3510df817 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f39a0310>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:05.636645 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-749c78cb-d6cc-49ce-b738-47f3510df817 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1412 microversion: 2.1 time: 0.094114 Aug 04 14:03:05.640667 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1014/2047] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:05 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:05.659599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:05.668920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:05.685049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:05.689455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:05.690686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:05.691396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:06.030739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.045770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.057212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.058871 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-67e6704e-65fc-4847-a798-78a9d683c0c4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1265 microversion: 2.25 time: 0.409605 Aug 04 14:03:06.060231 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1015/2048] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:05 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1265 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:06.079070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e5097f7-ea13-481a-bf30-a25df6790359 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:06.079987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7e5097f7-ea13-481a-bf30-a25df6790359 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:06.088122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e5097f7-ea13-481a-bf30-a25df6790359 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:06.093727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e5097f7-ea13-481a-bf30-a25df6790359 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:06.094880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e5097f7-ea13-481a-bf30-a25df6790359 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:06.103931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e5097f7-ea13-481a-bf30-a25df6790359 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:06.322418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7e5097f7-ea13-481a-bf30-a25df6790359 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:06.339211 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7e5097f7-ea13-481a-bf30-a25df6790359 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1283 microversion: 2.1 time: 0.277422 Aug 04 14:03:06.341709 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1016/2049] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:06 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1283 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:06.577582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1f5499de-1c13-4d4f-8798-886fa70bb578 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:06.579633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1f5499de-1c13-4d4f-8798-886fa70bb578 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:06.588308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f5499de-1c13-4d4f-8798-886fa70bb578 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:06.588899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f5499de-1c13-4d4f-8798-886fa70bb578 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:06.589663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f5499de-1c13-4d4f-8798-886fa70bb578 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:06.590111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f5499de-1c13-4d4f-8798-886fa70bb578 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:07.760416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1f5499de-1c13-4d4f-8798-886fa70bb578 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:07.789482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:03:07.790200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:03:07.790465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:03:07.790885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:03:07.791308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:03:07.807696 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1f5499de-1c13-4d4f-8798-886fa70bb578 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1316 microversion: 2.1 time: 1.234946 Aug 04 14:03:07.808897 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1017/2050] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:06 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1316 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:07.814902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:07.815626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:07.816654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:07.816979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e8940310-139f-49f6-b9fc-1af63d48fc8a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3944280>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:07.817869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:07.855031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:03:07.862204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for user dd1aacb549b74c21a13b9f3ca2df840c and project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:03:07.878221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:03:07.882113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:03:07.927084 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e8940310-139f-49f6-b9fc-1af63d48fc8a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1421 microversion: 2.1 time: 0.116778 Aug 04 14:03:07.937599 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1018/2051] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:07 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1421 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:07.942791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:07.943423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:07.963855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:07.965033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:07.976922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:07.977840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:07.999386 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4d77eb2f-6d09-4658-b347-0a5bb846c4de tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.245453 Aug 04 14:03:08.000754 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1034/2052] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:03:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 4248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:03:08.012982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-27351396-6734-49f5-bfc6-90e1094dd849 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:08.014040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-27351396-6734-49f5-bfc6-90e1094dd849 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:08.023171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27351396-6734-49f5-bfc6-90e1094dd849 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:08.024242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27351396-6734-49f5-bfc6-90e1094dd849 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:08.026116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27351396-6734-49f5-bfc6-90e1094dd849 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:08.026780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27351396-6734-49f5-bfc6-90e1094dd849 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:08.208007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.229864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.231477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.233191 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-166ffe60-cd21-4bcb-9192-a56d6e96973d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 200 len: 1265 microversion: 2.25 time: 0.294379 Aug 04 14:03:08.250008 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1019/2053] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:07 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:08.256531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-74e4d7f3-55c9-46d2-bc5a-be7ede42a774 req-956dc3a1-4a6e-4533-96c3-15964aefaa99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07", "tag": "32c2024a-da50-4c37-8155-c09ff79e916f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:08.269548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-74e4d7f3-55c9-46d2-bc5a-be7ede42a774 req-956dc3a1-4a6e-4533-96c3-15964aefaa99 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:08.270204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-74e4d7f3-55c9-46d2-bc5a-be7ede42a774 req-956dc3a1-4a6e-4533-96c3-15964aefaa99 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:08.293655 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-74e4d7f3-55c9-46d2-bc5a-be7ede42a774 req-956dc3a1-4a6e-4533-96c3-15964aefaa99 service nova] Creating event network-changed:32c2024a-da50-4c37-8155-c09ff79e916f for instance a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 on n-h2-844627-10 Aug 04 14:03:08.300140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-27351396-6734-49f5-bfc6-90e1094dd849 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.319875 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-27351396-6734-49f5-bfc6-90e1094dd849 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1283 microversion: 2.1 time: 0.316597 Aug 04 14:03:08.341571 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1035/2054] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:08 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1283 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:08.343910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-74e4d7f3-55c9-46d2-bc5a-be7ede42a774 req-956dc3a1-4a6e-4533-96c3-15964aefaa99 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089581 Aug 04 14:03:08.346204 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1020/2055] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:08.365258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-17ec778a-6c08-4bf7-856d-17e45cbeb1f8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3a29160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:08.380552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a40085ca-cede-4eff-8224-81131956338a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:08.389864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a40085ca-cede-4eff-8224-81131956338a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:08.446696 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-17ec778a-6c08-4bf7-856d-17e45cbeb1f8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 200 len: 1421 microversion: 2.1 time: 0.100692 Aug 04 14:03:08.447106 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1036/2056] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:08 2022] GET /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 1421 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:08.465640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-029ea7f0-ac49-48ca-b8b5-e90c715978fc tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f470560f280>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:08.604215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a40085ca-cede-4eff-8224-81131956338a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:08.641116 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a40085ca-cede-4eff-8224-81131956338a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1235 microversion: 2.1 time: 0.291961 Aug 04 14:03:08.642846 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1021/2057] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:08 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1235 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:08.845772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cf940cb8-2be4-43d5-9674-aa4eb1f3dc49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:08.848210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cf940cb8-2be4-43d5-9674-aa4eb1f3dc49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:08.861502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf940cb8-2be4-43d5-9674-aa4eb1f3dc49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:08.863014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf940cb8-2be4-43d5-9674-aa4eb1f3dc49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:08.865526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf940cb8-2be4-43d5-9674-aa4eb1f3dc49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:08.866213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf940cb8-2be4-43d5-9674-aa4eb1f3dc49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:09.200943 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-029ea7f0-ac49-48ca-b8b5-e90c715978fc tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 204 len: 0 microversion: 2.1 time: 0.742312 Aug 04 14:03:09.204929 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1037/2058] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:08 2022] DELETE /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:03:09.210895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ce6a8bbf-a9d0-48fc-823a-adf4cd5d1cc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:09.211418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ce6a8bbf-a9d0-48fc-823a-adf4cd5d1cc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:09.222889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce6a8bbf-a9d0-48fc-823a-adf4cd5d1cc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:09.223656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce6a8bbf-a9d0-48fc-823a-adf4cd5d1cc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:09.224745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce6a8bbf-a9d0-48fc-823a-adf4cd5d1cc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:09.225226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce6a8bbf-a9d0-48fc-823a-adf4cd5d1cc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:09.256988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ce6a8bbf-a9d0-48fc-823a-adf4cd5d1cc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:03:09.364961 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ce6a8bbf-a9d0-48fc-823a-adf4cd5d1cc3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 204 len: 0 microversion: 2.1 time: 0.157531 Aug 04 14:03:09.366051 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1038/2059] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:03:09 2022] DELETE /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:03:09.382498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:09.385211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: 933d36e2-d798-4136-8f33-ce878c78dbe8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:09.398708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:09.400380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:09.401943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:09.413515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:09.445871 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] HTTP exception thrown: Instance 933d36e2-d798-4136-8f33-ce878c78dbe8 could not be found. Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Request method failure captured: Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 HTTP/1.1 Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-cY-ywvSWQ74t4zf9GLTZbbqSuItV3gGPm2NvK3XrGC8KXZhqcuVXSjVqJ1Bh3y7IEfhtXVDrhXXRn9SswM6rH_oCGa__iAs9lReeKFYd7RYyQpD6-s9POLWndLT6nT7p28z6Te-PLy-T9C9skEn02oDucmZq4adCi0QVOG1DveFc Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 5366e08e3ba74d8382c899c9a584bd4b Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5366e08e3ba74d8382c899c9a584bd4b"}]}] Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 5366e08e3ba74d8382c899c9a584bd4b Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-LiveAutoBlockMigrationV225Test-829399796-project Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d9613691b93147d48d9f1a51bf5767c9 Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-829399796-project Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 933d36e2-d798-4136-8f33-ce878c78dbe8 could not be found. Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '933d36e2-d798-4136-8f33-ce878c78dbe8'} Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933d36e2-d798-4136-8f33-ce878c78dbe8 could not be found. Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933d36e2-d798-4136-8f33-ce878c78dbe8 could not be found. Aug 04 14:03:09.447876 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933d36e2-d798-4136-8f33-ce878c78dbe8 could not be found. Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Returning 404 to user: Instance 933d36e2-d798-4136-8f33-ce878c78dbe8 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fc05a42-d5fc-47d8-a47c-466526263920 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8" status: 404 len: 111 microversion: 2.25 time: 0.079225 Aug 04 14:03:09.455989 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1039/2060] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:09 2022] GET /compute/v2.1/servers/933d36e2-d798-4136-8f33-ce878c78dbe8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:03:09.460791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e2d0f42b-4e4a-4d24-b176-4afad01f4fa0 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:09.461506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e2d0f42b-4e4a-4d24-b176-4afad01f4fa0 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:09.470291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2d0f42b-4e4a-4d24-b176-4afad01f4fa0 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:09.470667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2d0f42b-4e4a-4d24-b176-4afad01f4fa0 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:09.472150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2d0f42b-4e4a-4d24-b176-4afad01f4fa0 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:09.472629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2d0f42b-4e4a-4d24-b176-4afad01f4fa0 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:09.479670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:09.665151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e2d0f42b-4e4a-4d24-b176-4afad01f4fa0 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:09.674904 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e2d0f42b-4e4a-4d24-b176-4afad01f4fa0 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1283 microversion: 2.1 time: 0.219303 Aug 04 14:03:09.677361 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1040/2061] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:09 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1283 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:09.700919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-871826569", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "6d686b9e-cdea-4698-acf7-93f34e28847e"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:09.795384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] validate_networks() for [('6d686b9e-cdea-4698-acf7-93f34e28847e', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:03:10.288435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cf940cb8-2be4-43d5-9674-aa4eb1f3dc49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:10.315215 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cf940cb8-2be4-43d5-9674-aa4eb1f3dc49 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1316 microversion: 2.1 time: 1.488471 Aug 04 14:03:10.318453 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1022/2062] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:08 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1316 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:10.339037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b3ff8be5-ed48-4a9f-99ab-3b4e3d63c794 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:10.344802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b3ff8be5-ed48-4a9f-99ab-3b4e3d63c794 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:10.378336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3ff8be5-ed48-4a9f-99ab-3b4e3d63c794 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:10.379774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3ff8be5-ed48-4a9f-99ab-3b4e3d63c794 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:10.381445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3ff8be5-ed48-4a9f-99ab-3b4e3d63c794 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:10.382665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3ff8be5-ed48-4a9f-99ab-3b4e3d63c794 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:10.783064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b3ff8be5-ed48-4a9f-99ab-3b4e3d63c794 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:10.802941 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b3ff8be5-ed48-4a9f-99ab-3b4e3d63c794 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1293 microversion: 2.1 time: 0.473063 Aug 04 14:03:10.806902 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1023/2063] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:10 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1293 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:10.830508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fbfd0673-4ae6-4a34-a86f-7662ed777c3d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:10.831584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fbfd0673-4ae6-4a34-a86f-7662ed777c3d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:10.856377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbfd0673-4ae6-4a34-a86f-7662ed777c3d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:10.858484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbfd0673-4ae6-4a34-a86f-7662ed777c3d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:10.860462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbfd0673-4ae6-4a34-a86f-7662ed777c3d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:10.866520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbfd0673-4ae6-4a34-a86f-7662ed777c3d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:11.302645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fbfd0673-4ae6-4a34-a86f-7662ed777c3d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:11.319920 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fbfd0673-4ae6-4a34-a86f-7662ed777c3d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1283 microversion: 2.1 time: 0.507408 Aug 04 14:03:11.333991 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1024/2064] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:10 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1283 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:11.340559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4695daf0-699d-4b53-9496-0f1fdf4dc40c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:11.341387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4695daf0-699d-4b53-9496-0f1fdf4dc40c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:11.353949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4695daf0-699d-4b53-9496-0f1fdf4dc40c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:11.355799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4695daf0-699d-4b53-9496-0f1fdf4dc40c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:11.356892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4695daf0-699d-4b53-9496-0f1fdf4dc40c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:11.360040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4695daf0-699d-4b53-9496-0f1fdf4dc40c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:12.264106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:03:12.264615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:03:12.265714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:03:12.266294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:03:12.266735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:03:12.283883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:12.284345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:12.285243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:12.285838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:12.338253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Getting quotas for project 2c78c75d748a4fe29f1bcdbe40d280a9. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:03:12.357652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Getting quotas for user 69f66d07b9ed48d0b9e2763d9659df3f and project 2c78c75d748a4fe29f1bcdbe40d280a9. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:03:12.397241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:03:12.406263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:03:12.495361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4695daf0-699d-4b53-9496-0f1fdf4dc40c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:12.517893 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4695daf0-699d-4b53-9496-0f1fdf4dc40c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1316 microversion: 2.1 time: 1.176678 Aug 04 14:03:12.519597 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1025/2065] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:11 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1316 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:12.529358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0812a3a4-c079-49e5-9b90-da01370bf185 req-811539d9-7056-4624-882e-0c87dc51d519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff40e66-7ec3-44cd-b16b-c45f94bd0b77", "name": "network-vif-unplugged", "status": "completed", "tag": "c12ce3a2-3807-40e9-ae8f-407560c1b4ab"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:12.566370 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c08d8c6-38db-4b62-a579-1d11d0c202e6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.887818 Aug 04 14:03:12.566765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0812a3a4-c079-49e5-9b90-da01370bf185 req-811539d9-7056-4624-882e-0c87dc51d519 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:12.568976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0812a3a4-c079-49e5-9b90-da01370bf185 req-811539d9-7056-4624-882e-0c87dc51d519 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:12.577233 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1041/2066] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:03:12.588552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1738148-358f-4af1-93dc-9c9f98c2d407 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:12.591960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f1738148-358f-4af1-93dc-9c9f98c2d407 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:12.605764 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0812a3a4-c079-49e5-9b90-da01370bf185 req-811539d9-7056-4624-882e-0c87dc51d519 service nova] Creating event network-vif-unplugged:c12ce3a2-3807-40e9-ae8f-407560c1b4ab for instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 on n-h1-844627-10 Aug 04 14:03:12.610567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1738148-358f-4af1-93dc-9c9f98c2d407 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:12.611913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1738148-358f-4af1-93dc-9c9f98c2d407 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:12.613076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1738148-358f-4af1-93dc-9c9f98c2d407 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:12.615123 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0812a3a4-c079-49e5-9b90-da01370bf185 req-811539d9-7056-4624-882e-0c87dc51d519 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092762 Aug 04 14:03:12.615759 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1026/2067] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:12.616087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1738148-358f-4af1-93dc-9c9f98c2d407 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:12.642148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6e8516b0-4cc4-407d-b6ff-26fed7531252 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:12.642988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6e8516b0-4cc4-407d-b6ff-26fed7531252 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:12.666791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e8516b0-4cc4-407d-b6ff-26fed7531252 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:12.669264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e8516b0-4cc4-407d-b6ff-26fed7531252 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:12.674240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e8516b0-4cc4-407d-b6ff-26fed7531252 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:12.675004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e8516b0-4cc4-407d-b6ff-26fed7531252 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:13.030201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f1738148-358f-4af1-93dc-9c9f98c2d407 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:13.041598 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f1738148-358f-4af1-93dc-9c9f98c2d407 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1361 microversion: 2.1 time: 0.463034 Aug 04 14:03:13.042182 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1042/2068] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:12 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1361 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:13.068659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a9a22d12-5868-4150-8d66-3302867d5734 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:13.069333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a9a22d12-5868-4150-8d66-3302867d5734 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:13.382156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a9a22d12-5868-4150-8d66-3302867d5734 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:13.396069 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a9a22d12-5868-4150-8d66-3302867d5734 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1207 microversion: 2.1 time: 0.352738 Aug 04 14:03:13.398273 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1043/2069] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:13 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1207 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:13.549227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a10d2f7-46eb-4eba-8e76-04f354860fe2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:13.550227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a10d2f7-46eb-4eba-8e76-04f354860fe2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:13.569890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a10d2f7-46eb-4eba-8e76-04f354860fe2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:13.570350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a10d2f7-46eb-4eba-8e76-04f354860fe2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:13.571889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a10d2f7-46eb-4eba-8e76-04f354860fe2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:13.572516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a10d2f7-46eb-4eba-8e76-04f354860fe2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:14.462284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6e8516b0-4cc4-407d-b6ff-26fed7531252 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:14.474617 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6e8516b0-4cc4-407d-b6ff-26fed7531252 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1350 microversion: 2.1 time: 1.852486 Aug 04 14:03:14.475275 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1027/2070] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:12 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1350 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:14.497576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4178db47-4678-4612-bfa7-97bab4b44275 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:14.498252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4178db47-4678-4612-bfa7-97bab4b44275 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:14.517172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4178db47-4678-4612-bfa7-97bab4b44275 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:14.523822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4178db47-4678-4612-bfa7-97bab4b44275 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:14.525986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4178db47-4678-4612-bfa7-97bab4b44275 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:14.529893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4178db47-4678-4612-bfa7-97bab4b44275 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:15.264149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a10d2f7-46eb-4eba-8e76-04f354860fe2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:15.278195 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a10d2f7-46eb-4eba-8e76-04f354860fe2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1316 microversion: 2.1 time: 1.731186 Aug 04 14:03:15.280647 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1044/2071] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:13 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1316 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:15.302693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-62723bf6-1a89-497c-9b9f-24999822d67e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:15.304608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-62723bf6-1a89-497c-9b9f-24999822d67e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:15.318889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62723bf6-1a89-497c-9b9f-24999822d67e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:15.321932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62723bf6-1a89-497c-9b9f-24999822d67e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:15.322912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62723bf6-1a89-497c-9b9f-24999822d67e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:15.326098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62723bf6-1a89-497c-9b9f-24999822d67e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:15.613098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-62723bf6-1a89-497c-9b9f-24999822d67e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:15.621245 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-62723bf6-1a89-497c-9b9f-24999822d67e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1265 microversion: 2.1 time: 0.336594 Aug 04 14:03:15.625241 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1045/2072] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:15 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1265 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:15.632520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-07b9b0fc-bf3b-4c01-a70d-27e9f6a94384 req-ab35bcf3-10b7-4dad-9f1f-797098b1c43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739d0629-de24-4a72-83a0-2f443e0af803", "tag": "dceb6721-526a-47cd-9222-7311c255822d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:15.663123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-07b9b0fc-bf3b-4c01-a70d-27e9f6a94384 req-ab35bcf3-10b7-4dad-9f1f-797098b1c43b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:15.666068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-07b9b0fc-bf3b-4c01-a70d-27e9f6a94384 req-ab35bcf3-10b7-4dad-9f1f-797098b1c43b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:15.698659 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-07b9b0fc-bf3b-4c01-a70d-27e9f6a94384 req-ab35bcf3-10b7-4dad-9f1f-797098b1c43b service nova] Creating event network-changed:dceb6721-526a-47cd-9222-7311c255822d for instance 739d0629-de24-4a72-83a0-2f443e0af803 on n-h2-844627-10 Aug 04 14:03:15.714818 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-07b9b0fc-bf3b-4c01-a70d-27e9f6a94384 req-ab35bcf3-10b7-4dad-9f1f-797098b1c43b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088184 Aug 04 14:03:15.715706 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1046/2073] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:15.721631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3bb6dff6-2aaf-45f0-8751-4cea5603b351 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:15.722535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3bb6dff6-2aaf-45f0-8751-4cea5603b351 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:15.737429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3bb6dff6-2aaf-45f0-8751-4cea5603b351 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:15.738107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3bb6dff6-2aaf-45f0-8751-4cea5603b351 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:15.739310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3bb6dff6-2aaf-45f0-8751-4cea5603b351 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:15.739988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3bb6dff6-2aaf-45f0-8751-4cea5603b351 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:15.763772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4178db47-4678-4612-bfa7-97bab4b44275 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:15.782512 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4178db47-4678-4612-bfa7-97bab4b44275 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1361 microversion: 2.1 time: 1.305969 Aug 04 14:03:15.785764 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1028/2074] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:14 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1361 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:15.806694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c138595a-207c-4c78-a889-1e529f6775d5 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:15.811356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c138595a-207c-4c78-a889-1e529f6775d5 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:15.817298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3bb6dff6-2aaf-45f0-8751-4cea5603b351 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:03:15.836905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c138595a-207c-4c78-a889-1e529f6775d5 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:15.839440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c138595a-207c-4c78-a889-1e529f6775d5 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:15.843813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c138595a-207c-4c78-a889-1e529f6775d5 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:15.845052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c138595a-207c-4c78-a889-1e529f6775d5 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:15.999839 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3bb6dff6-2aaf-45f0-8751-4cea5603b351 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 204 len: 0 microversion: 2.25 time: 0.281749 Aug 04 14:03:16.000799 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1047/2075] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:03:15 2022] DELETE /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:03:16.007530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7d275e75-8e16-4852-926b-73f3f4ee6db0 req-2a8eb018-d60c-47d9-9336-503a0511415b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff40e66-7ec3-44cd-b16b-c45f94bd0b77", "name": "network-vif-deleted", "tag": "c12ce3a2-3807-40e9-ae8f-407560c1b4ab"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:16.021456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7d275e75-8e16-4852-926b-73f3f4ee6db0 req-2a8eb018-d60c-47d9-9336-503a0511415b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:16.022336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7d275e75-8e16-4852-926b-73f3f4ee6db0 req-2a8eb018-d60c-47d9-9336-503a0511415b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:16.038294 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7d275e75-8e16-4852-926b-73f3f4ee6db0 req-2a8eb018-d60c-47d9-9336-503a0511415b service nova] Creating event network-vif-deleted:c12ce3a2-3807-40e9-ae8f-407560c1b4ab for instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 on n-h1-844627-10 Aug 04 14:03:16.046676 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7d275e75-8e16-4852-926b-73f3f4ee6db0 req-2a8eb018-d60c-47d9-9336-503a0511415b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044065 Aug 04 14:03:16.047974 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1048/2076] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:16.054249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:16.055138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:16.064181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:16.064950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:16.065973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:16.066599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:16.390980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c138595a-207c-4c78-a889-1e529f6775d5 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:16.393237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:16.399457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:16.403996 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c138595a-207c-4c78-a889-1e529f6775d5 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1350 microversion: 2.1 time: 0.616383 Aug 04 14:03:16.408915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:16.410092 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1029/2077] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:15 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1350 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:16.412121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:16.417278 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1b891588-1acd-4e15-a60f-952c11138ec4 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1731 microversion: 2.25 time: 0.367853 Aug 04 14:03:16.418135 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1049/2078] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:16 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1731 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:16.426949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ecc123b2-6e15-4740-b6b7-41158bdde9f0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:16.435314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ecc123b2-6e15-4740-b6b7-41158bdde9f0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:16.455138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecc123b2-6e15-4740-b6b7-41158bdde9f0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:16.456276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecc123b2-6e15-4740-b6b7-41158bdde9f0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:16.457944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecc123b2-6e15-4740-b6b7-41158bdde9f0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:16.458971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecc123b2-6e15-4740-b6b7-41158bdde9f0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:16.648247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-126366cb-46a9-4e31-b308-86ebd5976482 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:16.656312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-126366cb-46a9-4e31-b308-86ebd5976482 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:16.675340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-126366cb-46a9-4e31-b308-86ebd5976482 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:16.676067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-126366cb-46a9-4e31-b308-86ebd5976482 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:16.677378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-126366cb-46a9-4e31-b308-86ebd5976482 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:16.678168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-126366cb-46a9-4e31-b308-86ebd5976482 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:17.026920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-126366cb-46a9-4e31-b308-86ebd5976482 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:17.041041 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-126366cb-46a9-4e31-b308-86ebd5976482 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1265 microversion: 2.1 time: 0.397901 Aug 04 14:03:17.055175 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1050/2079] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:16 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1265 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:17.081217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8bcc9388-807a-4083-af65-8a0e0282c28c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:17.082565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8bcc9388-807a-4083-af65-8a0e0282c28c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:17.094997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bcc9388-807a-4083-af65-8a0e0282c28c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:17.096203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bcc9388-807a-4083-af65-8a0e0282c28c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:17.100665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bcc9388-807a-4083-af65-8a0e0282c28c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:17.101836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bcc9388-807a-4083-af65-8a0e0282c28c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:17.277297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ecc123b2-6e15-4740-b6b7-41158bdde9f0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:17.310232 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ecc123b2-6e15-4740-b6b7-41158bdde9f0 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1316 microversion: 2.1 time: 0.897608 Aug 04 14:03:17.311574 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1030/2080] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:16 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1316 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:17.333941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5e45370e-5eeb-4e83-8153-9f1fb3958507 req-c55fb833-36d8-4e31-ad3f-e688f89667e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07", "name": "network-vif-plugged", "status": "completed", "tag": "32c2024a-da50-4c37-8155-c09ff79e916f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:17.350313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5e45370e-5eeb-4e83-8153-9f1fb3958507 req-c55fb833-36d8-4e31-ad3f-e688f89667e6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:17.351290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5e45370e-5eeb-4e83-8153-9f1fb3958507 req-c55fb833-36d8-4e31-ad3f-e688f89667e6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:17.382709 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5e45370e-5eeb-4e83-8153-9f1fb3958507 req-c55fb833-36d8-4e31-ad3f-e688f89667e6 service nova] Creating event network-vif-plugged:32c2024a-da50-4c37-8155-c09ff79e916f for instance a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 on n-h2-844627-10 Aug 04 14:03:17.398233 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5e45370e-5eeb-4e83-8153-9f1fb3958507 req-c55fb833-36d8-4e31-ad3f-e688f89667e6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084334 Aug 04 14:03:17.402097 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1031/2081] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:17.432197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-45ea5b4b-1973-439f-b019-018e77ec7697 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:17.433434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-45ea5b4b-1973-439f-b019-018e77ec7697 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:17.449797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45ea5b4b-1973-439f-b019-018e77ec7697 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:17.451433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45ea5b4b-1973-439f-b019-018e77ec7697 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:17.453748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45ea5b4b-1973-439f-b019-018e77ec7697 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:17.456916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45ea5b4b-1973-439f-b019-018e77ec7697 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:17.642122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8bcc9388-807a-4083-af65-8a0e0282c28c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:17.659822 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8bcc9388-807a-4083-af65-8a0e0282c28c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1361 microversion: 2.1 time: 0.605489 Aug 04 14:03:17.661960 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1051/2082] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:17 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1361 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:17.671033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:17.677107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:17.685306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:17.688966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:17.689867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:17.690981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:17.691694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:17.944002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-45ea5b4b-1973-439f-b019-018e77ec7697 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:17.957922 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-45ea5b4b-1973-439f-b019-018e77ec7697 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1350 microversion: 2.1 time: 0.531012 Aug 04 14:03:17.970255 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1032/2083] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:17 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1350 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:18.067092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5374595e-aaab-4a3e-861d-3cd840674e87 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:18.068205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5374595e-aaab-4a3e-861d-3cd840674e87 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:18.089909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5374595e-aaab-4a3e-861d-3cd840674e87 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:18.090295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5374595e-aaab-4a3e-861d-3cd840674e87 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:18.091086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5374595e-aaab-4a3e-861d-3cd840674e87 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:18.091522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5374595e-aaab-4a3e-861d-3cd840674e87 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:18.626188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=20 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:19.339048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.373607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.380996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.384753 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6007a152-6aba-4615-b3cf-bf59aa7eb5b7 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1731 microversion: 2.25 time: 1.720310 Aug 04 14:03:19.389623 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1052/2084] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:17 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1731 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:19.398773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ee219216-0147-4bcc-8bea-dc7c3cee572d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:19.400646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ee219216-0147-4bcc-8bea-dc7c3cee572d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:19.410157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee219216-0147-4bcc-8bea-dc7c3cee572d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:19.411157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee219216-0147-4bcc-8bea-dc7c3cee572d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:19.412236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee219216-0147-4bcc-8bea-dc7c3cee572d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:19.413217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee219216-0147-4bcc-8bea-dc7c3cee572d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:19.544312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5374595e-aaab-4a3e-861d-3cd840674e87 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:19.556743 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5374595e-aaab-4a3e-861d-3cd840674e87 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 1.497299 Aug 04 14:03:19.558492 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1033/2085] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:18 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:19.582223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b1f103d-55ee-4b8f-b42c-238faa63b982 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:19.583913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b1f103d-55ee-4b8f-b42c-238faa63b982 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:19.608217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b1f103d-55ee-4b8f-b42c-238faa63b982 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:19.610735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b1f103d-55ee-4b8f-b42c-238faa63b982 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:19.612662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b1f103d-55ee-4b8f-b42c-238faa63b982 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:19.615712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b1f103d-55ee-4b8f-b42c-238faa63b982 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:19.998020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ee219216-0147-4bcc-8bea-dc7c3cee572d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:20.010816 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ee219216-0147-4bcc-8bea-dc7c3cee572d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1316 microversion: 2.1 time: 0.617514 Aug 04 14:03:20.013138 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1053/2086] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:19 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:20.025073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f00ff48-9960-4dcc-84f3-fa14259c46bb tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:20.028436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f00ff48-9960-4dcc-84f3-fa14259c46bb tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:20.055291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f00ff48-9960-4dcc-84f3-fa14259c46bb tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:20.058795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f00ff48-9960-4dcc-84f3-fa14259c46bb tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:20.059866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f00ff48-9960-4dcc-84f3-fa14259c46bb tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:20.060490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f00ff48-9960-4dcc-84f3-fa14259c46bb tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:20.467668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b1f103d-55ee-4b8f-b42c-238faa63b982 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:20.507091 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b1f103d-55ee-4b8f-b42c-238faa63b982 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1361 microversion: 2.1 time: 0.945500 Aug 04 14:03:20.512938 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1034/2087] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:19 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1361 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:20.524939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-082bcf76-c4a8-45f0-9409-2ee82ea95bbb req-1110b09f-045f-4a9a-a405-ce9678196ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19bbecb-ac45-485a-b0ca-9ee56b5628ce", "tag": "28c2253a-6f45-4cfd-bba6-a91c0cc27e5e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:20.579143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-082bcf76-c4a8-45f0-9409-2ee82ea95bbb req-1110b09f-045f-4a9a-a405-ce9678196ae9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:20.581340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-082bcf76-c4a8-45f0-9409-2ee82ea95bbb req-1110b09f-045f-4a9a-a405-ce9678196ae9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:20.629113 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-082bcf76-c4a8-45f0-9409-2ee82ea95bbb req-1110b09f-045f-4a9a-a405-ce9678196ae9 service nova] Creating event network-changed:28c2253a-6f45-4cfd-bba6-a91c0cc27e5e for instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce on n-h1-844627-10 Aug 04 14:03:20.643602 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-082bcf76-c4a8-45f0-9409-2ee82ea95bbb req-1110b09f-045f-4a9a-a405-ce9678196ae9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130980 Aug 04 14:03:20.646001 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1035/2088] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:20.657268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:20.659010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:20.681649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:20.683301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:20.685015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:20.685983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:21.037362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:21.069348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:21.076806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:21.078641 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ecab6144-4d58-4ae2-afaf-c2e4c4c5234c tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1664 microversion: 2.25 time: 0.430648 Aug 04 14:03:21.082883 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1036/2089] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:20 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1664 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:21.094142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-496afbad-e632-4ed2-a977-f7647825d1b6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:21.098183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-496afbad-e632-4ed2-a977-f7647825d1b6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:21.115819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-496afbad-e632-4ed2-a977-f7647825d1b6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:21.116697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-496afbad-e632-4ed2-a977-f7647825d1b6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:21.118882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-496afbad-e632-4ed2-a977-f7647825d1b6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:21.119523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-496afbad-e632-4ed2-a977-f7647825d1b6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:21.363666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f00ff48-9960-4dcc-84f3-fa14259c46bb tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:21.395344 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f00ff48-9960-4dcc-84f3-fa14259c46bb tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1350 microversion: 2.1 time: 1.380152 Aug 04 14:03:21.412605 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1054/2090] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:20 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1350 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:21.426938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2b525baf-87b9-4dba-8deb-6369ff80ae07 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:21.426938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2b525baf-87b9-4dba-8deb-6369ff80ae07 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:21.463923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b525baf-87b9-4dba-8deb-6369ff80ae07 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:21.465200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b525baf-87b9-4dba-8deb-6369ff80ae07 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:21.467113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b525baf-87b9-4dba-8deb-6369ff80ae07 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:21.468063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b525baf-87b9-4dba-8deb-6369ff80ae07 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:22.234457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-496afbad-e632-4ed2-a977-f7647825d1b6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.257530 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-496afbad-e632-4ed2-a977-f7647825d1b6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 1.172204 Aug 04 14:03:22.258736 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1037/2091] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:21 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:22.267486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-638640a6-c3fb-41de-a9b4-82321126a266 req-1518f28b-59f1-46d6-8d31-a013c80b6639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f7a6c65-5f80-48bb-a324-23c01af35738", "tag": "847a36f8-843d-46a5-9321-5c09ee823490"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:22.297709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2b525baf-87b9-4dba-8deb-6369ff80ae07 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.319406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-638640a6-c3fb-41de-a9b4-82321126a266 req-1518f28b-59f1-46d6-8d31-a013c80b6639 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:22.321249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:22.322458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-638640a6-c3fb-41de-a9b4-82321126a266 req-1518f28b-59f1-46d6-8d31-a013c80b6639 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:22.336946 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2b525baf-87b9-4dba-8deb-6369ff80ae07 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1466 microversion: 2.1 time: 0.933518 Aug 04 14:03:22.338333 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1055/2092] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:21 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1466 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:22.373387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3ef46792-dc72-4145-9351-4f4979bf9330 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:22.381601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3ef46792-dc72-4145-9351-4f4979bf9330 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:22.401671 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-638640a6-c3fb-41de-a9b4-82321126a266 req-1518f28b-59f1-46d6-8d31-a013c80b6639 service nova] Creating event network-changed:847a36f8-843d-46a5-9321-5c09ee823490 for instance 4f7a6c65-5f80-48bb-a324-23c01af35738 on n-h1-844627-10 Aug 04 14:03:22.405794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ef46792-dc72-4145-9351-4f4979bf9330 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:22.407274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ef46792-dc72-4145-9351-4f4979bf9330 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:22.410895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ef46792-dc72-4145-9351-4f4979bf9330 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:22.415233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ef46792-dc72-4145-9351-4f4979bf9330 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:22.420767 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-638640a6-c3fb-41de-a9b4-82321126a266 req-1518f28b-59f1-46d6-8d31-a013c80b6639 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152687 Aug 04 14:03:22.422234 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1038/2093] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:22.439044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:22.441897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:22.456856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:22.458135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:22.459863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:22.461307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:22.778230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.811218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.825888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:22.832310 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-02808e4d-b438-42a3-9600-8a87951b69f1 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 200 len: 1664 microversion: 2.25 time: 0.406110 Aug 04 14:03:22.835794 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1039/2094] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:22 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 1664 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:22.857433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9edacb74-af04-48dc-b228-514de441d805 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:22.861485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9edacb74-af04-48dc-b228-514de441d805 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:22.897097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9edacb74-af04-48dc-b228-514de441d805 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:22.904213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9edacb74-af04-48dc-b228-514de441d805 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:22.906912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9edacb74-af04-48dc-b228-514de441d805 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:22.908731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9edacb74-af04-48dc-b228-514de441d805 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:23.083022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3ef46792-dc72-4145-9351-4f4979bf9330 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:23.108100 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3ef46792-dc72-4145-9351-4f4979bf9330 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1361 microversion: 2.1 time: 0.767046 Aug 04 14:03:23.112069 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1056/2095] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:22 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1361 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:23.125215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-443230ec-b1df-4831-9b05-35090b7951c2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:23.126796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-443230ec-b1df-4831-9b05-35090b7951c2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:23.141720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-443230ec-b1df-4831-9b05-35090b7951c2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:23.142989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-443230ec-b1df-4831-9b05-35090b7951c2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:23.144773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-443230ec-b1df-4831-9b05-35090b7951c2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:23.145925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-443230ec-b1df-4831-9b05-35090b7951c2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:23.270483 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9edacb74-af04-48dc-b228-514de441d805 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1619 microversion: 2.1 time: 0.429626 Aug 04 14:03:23.272247 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1040/2096] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:22 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1619 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:23.277611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0d38f4e8-a3d5-46f7-8c55-34574b93d0e8 req-8780746f-01a2-48e6-872c-708320041fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca56d355-4e66-4634-99fb-9ed160b6bc4b", "name": "network-vif-deleted", "tag": "05c9a902-25a1-4f84-9f03-64cea87afd6f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:23.327204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0d38f4e8-a3d5-46f7-8c55-34574b93d0e8 req-8780746f-01a2-48e6-872c-708320041fb1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:23.327857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0d38f4e8-a3d5-46f7-8c55-34574b93d0e8 req-8780746f-01a2-48e6-872c-708320041fb1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:23.347055 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0d38f4e8-a3d5-46f7-8c55-34574b93d0e8 req-8780746f-01a2-48e6-872c-708320041fb1 service nova] Creating event network-vif-deleted:05c9a902-25a1-4f84-9f03-64cea87afd6f for instance ca56d355-4e66-4634-99fb-9ed160b6bc4b on n-h2-844627-10 Aug 04 14:03:23.358088 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0d38f4e8-a3d5-46f7-8c55-34574b93d0e8 req-8780746f-01a2-48e6-872c-708320041fb1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083547 Aug 04 14:03:23.359225 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1041/2097] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:23.368047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-beac56d1-7538-46ae-9277-be67aacb924f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:23.368987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-beac56d1-7538-46ae-9277-be67aacb924f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:23.382425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beac56d1-7538-46ae-9277-be67aacb924f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:23.386161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beac56d1-7538-46ae-9277-be67aacb924f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:23.387631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beac56d1-7538-46ae-9277-be67aacb924f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:23.388522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beac56d1-7538-46ae-9277-be67aacb924f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:23.392620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=22 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:23.975457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-443230ec-b1df-4831-9b05-35090b7951c2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:24.020319 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-443230ec-b1df-4831-9b05-35090b7951c2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1350 microversion: 2.1 time: 0.904821 Aug 04 14:03:24.028521 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1057/2098] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:23 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1350 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:24.047264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1253899455", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["7984a6d3-8edb-45ab-a340-bc9df16df6f3"]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:24.053140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-beac56d1-7538-46ae-9277-be67aacb924f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:24.072446 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-beac56d1-7538-46ae-9277-be67aacb924f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 0.711052 Aug 04 14:03:24.073553 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1042/2099] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:23 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:24.080578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f3d05543-43a1-463d-a87a-9a1206ba6025 req-058c38e7-5394-40af-8bff-0d0b0d553a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d0629-de24-4a72-83a0-2f443e0af803", "name": "network-vif-plugged", "status": "completed", "tag": "dceb6721-526a-47cd-9222-7311c255822d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:24.118102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f3d05543-43a1-463d-a87a-9a1206ba6025 req-058c38e7-5394-40af-8bff-0d0b0d553a42 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:24.118927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f3d05543-43a1-463d-a87a-9a1206ba6025 req-058c38e7-5394-40af-8bff-0d0b0d553a42 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:24.172933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:03:24.173811 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f3d05543-43a1-463d-a87a-9a1206ba6025 req-058c38e7-5394-40af-8bff-0d0b0d553a42 service nova] Creating event network-vif-plugged:dceb6721-526a-47cd-9222-7311c255822d for instance 739d0629-de24-4a72-83a0-2f443e0af803 on n-h2-844627-10 Aug 04 14:03:24.185034 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f3d05543-43a1-463d-a87a-9a1206ba6025 req-058c38e7-5394-40af-8bff-0d0b0d553a42 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109301 Aug 04 14:03:24.191857 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1043/2100] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:24.204807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:24.208517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: ca56d355-4e66-4634-99fb-9ed160b6bc4b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:24.218146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:24.218603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:24.219655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:24.220104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:24.270989 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] HTTP exception thrown: Instance ca56d355-4e66-4634-99fb-9ed160b6bc4b could not be found. Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Request method failure captured: Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b HTTP/1.1 Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi68-cY-ywvSWQ74t4zf9GLTZbbqSuItV3gGPm2NvK3XrGC8KXZhqcuVXSjVqJ1Bh3y7IEfhtXVDrhXXRn9SswM6rH_oCGa__iAs9lReeKFYd7RYyQpD6-s9POLWndLT6nT7p28z6Te-PLy-T9C9skEn02oDucmZq4adCi0QVOG1DveFc Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 5366e08e3ba74d8382c899c9a584bd4b Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5366e08e3ba74d8382c899c9a584bd4b"}]}] Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 5366e08e3ba74d8382c899c9a584bd4b Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-LiveAutoBlockMigrationV225Test-829399796-project Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d9613691b93147d48d9f1a51bf5767c9 Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-829399796-project Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance ca56d355-4e66-4634-99fb-9ed160b6bc4b could not be found. Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'ca56d355-4e66-4634-99fb-9ed160b6bc4b'} Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca56d355-4e66-4634-99fb-9ed160b6bc4b could not be found. Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca56d355-4e66-4634-99fb-9ed160b6bc4b could not be found. Aug 04 14:03:24.278723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca56d355-4e66-4634-99fb-9ed160b6bc4b could not be found. Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:24.285702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Returning 404 to user: Instance ca56d355-4e66-4634-99fb-9ed160b6bc4b could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:03:24.287825 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3aa527d5-2b11-4cd8-a27c-a89a376a85cd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b" status: 404 len: 111 microversion: 2.25 time: 0.093634 Aug 04 14:03:24.289837 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1044/2101] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:24 2022] GET /compute/v2.1/servers/ca56d355-4e66-4634-99fb-9ed160b6bc4b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:03:24.300061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c95d1cb0-e47a-4fd4-b8c3-9394952ca62e tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:24.301333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c95d1cb0-e47a-4fd4-b8c3-9394952ca62e tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:24.310818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c95d1cb0-e47a-4fd4-b8c3-9394952ca62e tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:24.311376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c95d1cb0-e47a-4fd4-b8c3-9394952ca62e tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:24.312252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c95d1cb0-e47a-4fd4-b8c3-9394952ca62e tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:24.313022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c95d1cb0-e47a-4fd4-b8c3-9394952ca62e tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:25.008652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c95d1cb0-e47a-4fd4-b8c3-9394952ca62e tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:25.026090 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c95d1cb0-e47a-4fd4-b8c3-9394952ca62e tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1361 microversion: 2.1 time: 0.734015 Aug 04 14:03:25.037768 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1045/2102] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:24 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1361 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:25.037768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2752a52f-55b7-43c8-849d-0c021508dbeb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '.version_select at 0x7f46f395ff70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:25.068229 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2752a52f-55b7-43c8-849d-0c021508dbeb tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-715557252" status: 204 len: 0 microversion: 2.25 time: 0.040030 Aug 04 14:03:25.074188 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1046/2103] 10.222.0.66 () {60 vars in 1259 bytes} [Thu Aug 4 14:03:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-715557252 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:03:25.074728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7572e392-90dc-4b82-b2e8-3aab8a53c57c tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:25.075250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7572e392-90dc-4b82-b2e8-3aab8a53c57c tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:25.091404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7572e392-90dc-4b82-b2e8-3aab8a53c57c tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:25.094627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7572e392-90dc-4b82-b2e8-3aab8a53c57c tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:25.095985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7572e392-90dc-4b82-b2e8-3aab8a53c57c tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:25.096680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7572e392-90dc-4b82-b2e8-3aab8a53c57c tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:25.142836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:03:25.155523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:03:25.157209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:03:25.160253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:03:25.164251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:03:25.182706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:25.183540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:25.184685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:25.185377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:25.194829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:25.226028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:03:25.235476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:03:25.263715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:03:25.267280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:03:25.387298 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-db740417-38e7-413d-94aa-ccb575ad0f74 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356910 Aug 04 14:03:25.388423 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1058/2104] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:03:25.394232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd578a3a-2cd6-44f9-a41d-dcd3dc6c711c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:25.395516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd578a3a-2cd6-44f9-a41d-dcd3dc6c711c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:25.415886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd578a3a-2cd6-44f9-a41d-dcd3dc6c711c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:25.416345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd578a3a-2cd6-44f9-a41d-dcd3dc6c711c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:25.417540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd578a3a-2cd6-44f9-a41d-dcd3dc6c711c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:25.418307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd578a3a-2cd6-44f9-a41d-dcd3dc6c711c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:25.755945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7572e392-90dc-4b82-b2e8-3aab8a53c57c tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:25.782390 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7572e392-90dc-4b82-b2e8-3aab8a53c57c tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1350 microversion: 2.1 time: 0.711592 Aug 04 14:03:25.809456 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1047/2105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:25 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1350 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:25.821901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c8d53ab3-1b77-4ed6-b42e-a2620badeb7d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:25.822884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c8d53ab3-1b77-4ed6-b42e-a2620badeb7d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:25.823037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fd578a3a-2cd6-44f9-a41d-dcd3dc6c711c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:25.839369 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd578a3a-2cd6-44f9-a41d-dcd3dc6c711c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 0.448977 Aug 04 14:03:25.858708 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1059/2106] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:25 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:25.979437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c8d53ab3-1b77-4ed6-b42e-a2620badeb7d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:26.002111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c8d53ab3-1b77-4ed6-b42e-a2620badeb7d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1217 microversion: 2.1 time: 0.190214 Aug 04 14:03:26.005546 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1048/2107] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:25 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:26.086810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d09b823-70a1-49c5-a362-96862a6fe493 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:26.105728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6d09b823-70a1-49c5-a362-96862a6fe493 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:26.131493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d09b823-70a1-49c5-a362-96862a6fe493 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:26.136277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d09b823-70a1-49c5-a362-96862a6fe493 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:26.138052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d09b823-70a1-49c5-a362-96862a6fe493 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:26.147650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d09b823-70a1-49c5-a362-96862a6fe493 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:26.460020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d09b823-70a1-49c5-a362-96862a6fe493 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:26.480072 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d09b823-70a1-49c5-a362-96862a6fe493 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1361 microversion: 2.1 time: 0.432745 Aug 04 14:03:26.486354 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1060/2108] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:26 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:26.829170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e5c697b1-7138-4f3e-a643-8e8315cc9853 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:26.835623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e5c697b1-7138-4f3e-a643-8e8315cc9853 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:26.870566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-00ddecc1-f34f-490c-af3e-4c4fc9d9d1f3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:26.873114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-00ddecc1-f34f-490c-af3e-4c4fc9d9d1f3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:26.874037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5c697b1-7138-4f3e-a643-8e8315cc9853 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:26.874987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5c697b1-7138-4f3e-a643-8e8315cc9853 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:26.877541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5c697b1-7138-4f3e-a643-8e8315cc9853 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:26.878602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5c697b1-7138-4f3e-a643-8e8315cc9853 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:26.923743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00ddecc1-f34f-490c-af3e-4c4fc9d9d1f3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:26.924743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00ddecc1-f34f-490c-af3e-4c4fc9d9d1f3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:26.926289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00ddecc1-f34f-490c-af3e-4c4fc9d9d1f3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:26.935318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00ddecc1-f34f-490c-af3e-4c4fc9d9d1f3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:28.171534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-00ddecc1-f34f-490c-af3e-4c4fc9d9d1f3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:28.184757 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-00ddecc1-f34f-490c-af3e-4c4fc9d9d1f3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 1.322445 Aug 04 14:03:28.185406 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1061/2109] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:26 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:28.219472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74cc6cc1-aaf2-49be-ba02-6506e8a3c181 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:28.221356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-74cc6cc1-aaf2-49be-ba02-6506e8a3c181 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:28.240668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74cc6cc1-aaf2-49be-ba02-6506e8a3c181 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:28.241857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74cc6cc1-aaf2-49be-ba02-6506e8a3c181 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:28.244699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74cc6cc1-aaf2-49be-ba02-6506e8a3c181 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:28.245973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74cc6cc1-aaf2-49be-ba02-6506e8a3c181 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:28.493656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-74cc6cc1-aaf2-49be-ba02-6506e8a3c181 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:28.507379 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-74cc6cc1-aaf2-49be-ba02-6506e8a3c181 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1277 microversion: 2.1 time: 0.316028 Aug 04 14:03:28.515054 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1062/2110] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:28 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1277 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:28.524302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6c64b825-173d-49ae-89d7-d60d9d4a5274 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:28.530209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6c64b825-173d-49ae-89d7-d60d9d4a5274 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:28.551086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c64b825-173d-49ae-89d7-d60d9d4a5274 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:28.551553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c64b825-173d-49ae-89d7-d60d9d4a5274 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:28.556685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c64b825-173d-49ae-89d7-d60d9d4a5274 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:28.561255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c64b825-173d-49ae-89d7-d60d9d4a5274 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:29.331868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e5c697b1-7138-4f3e-a643-8e8315cc9853 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:29.348379 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e5c697b1-7138-4f3e-a643-8e8315cc9853 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1350 microversion: 2.1 time: 2.540464 Aug 04 14:03:29.350420 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1049/2111] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:26 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1350 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:29.368748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6c64b825-173d-49ae-89d7-d60d9d4a5274 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:29.394117 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6c64b825-173d-49ae-89d7-d60d9d4a5274 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1544 microversion: 2.1 time: 0.877156 Aug 04 14:03:29.396787 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1063/2112] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:28 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1544 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:29.410881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c119c4d1-b96c-4d0d-99a1-ecbaf2e8a967 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:29.412675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c119c4d1-b96c-4d0d-99a1-ecbaf2e8a967 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:29.423288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c119c4d1-b96c-4d0d-99a1-ecbaf2e8a967 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:29.424196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c119c4d1-b96c-4d0d-99a1-ecbaf2e8a967 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:29.425460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c119c4d1-b96c-4d0d-99a1-ecbaf2e8a967 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:29.426225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c119c4d1-b96c-4d0d-99a1-ecbaf2e8a967 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:29.495762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c119c4d1-b96c-4d0d-99a1-ecbaf2e8a967 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:03:29.501545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2036903815", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "028d7a32-b3ee-4a86-86f2-863959448144"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:29.707820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] validate_networks() for [('028d7a32-b3ee-4a86-86f2-863959448144', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:03:29.780492 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c119c4d1-b96c-4d0d-99a1-ecbaf2e8a967 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 204 len: 0 microversion: 2.25 time: 0.370305 Aug 04 14:03:29.781585 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1064/2113] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:03:29 2022] DELETE /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:03:29.793671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-966e94ef-9ea7-452a-ab5b-714e4433114f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:29.794976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-966e94ef-9ea7-452a-ab5b-714e4433114f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:29.810214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966e94ef-9ea7-452a-ab5b-714e4433114f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:29.811738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966e94ef-9ea7-452a-ab5b-714e4433114f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:29.812951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966e94ef-9ea7-452a-ab5b-714e4433114f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:29.813617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966e94ef-9ea7-452a-ab5b-714e4433114f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:30.450001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-966e94ef-9ea7-452a-ab5b-714e4433114f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:30.482217 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-966e94ef-9ea7-452a-ab5b-714e4433114f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 0.695423 Aug 04 14:03:30.485351 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1065/2114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:29 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:30.510993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e8f04ed-18c2-4396-b207-5564a99fb701 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:30.523146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e8f04ed-18c2-4396-b207-5564a99fb701 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:30.559542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e8f04ed-18c2-4396-b207-5564a99fb701 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:30.577996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e8f04ed-18c2-4396-b207-5564a99fb701 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:30.586316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e8f04ed-18c2-4396-b207-5564a99fb701 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:30.588291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e8f04ed-18c2-4396-b207-5564a99fb701 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:30.930175 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e8f04ed-18c2-4396-b207-5564a99fb701 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.433302 Aug 04 14:03:30.931786 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1066/2115] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:03:30 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-interface => generated 284 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:30.946277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5412150a-544e-47c3-8712-7c60dc3c8c94 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:30.947406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5412150a-544e-47c3-8712-7c60dc3c8c94 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:30.987814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5412150a-544e-47c3-8712-7c60dc3c8c94 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:30.989053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5412150a-544e-47c3-8712-7c60dc3c8c94 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:30.990827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5412150a-544e-47c3-8712-7c60dc3c8c94 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:30.991907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5412150a-544e-47c3-8712-7c60dc3c8c94 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:31.291227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:03:31.292507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:03:31.293269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:03:31.293921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:03:31.294690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:03:31.300102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:31.314673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:31.315545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:31.317700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:31.318640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:31.387754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Getting quotas for project 6ecbc8173fa949f1913669488544658d. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:03:31.408582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Getting quotas for user c2c25041b4da41dea0448b9c9b418aa4 and project 6ecbc8173fa949f1913669488544658d. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:03:31.441476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Going to run 3 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:03:31.446231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:03:31.503876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=c1e295fc-0888-455d-b1b2-24d11d238044,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:03:31.554801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5412150a-544e-47c3-8712-7c60dc3c8c94 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:31.569205 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5412150a-544e-47c3-8712-7c60dc3c8c94 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1317 microversion: 2.1 time: 0.635721 Aug 04 14:03:31.570470 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1067/2116] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:30 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:31.589263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:31.589651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: ab0715c8-e967-444f-bb46-6e5043791203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=1204865f-4b5f-41f3-8f2c-27f15aaa938e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:03:31.589901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:31.608260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:31.608721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:31.609797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:31.610445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:31.745853 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f0a3b10d-5a5f-46f4-8163-395b30dd2f62 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.392885 Aug 04 14:03:31.756236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:31.770314 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1050/2117] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:03:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:03:31.771563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:31.780828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:31.784300 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e8333284-37f8-4ead-beef-15cc848b6219 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 200 len: 1506 microversion: 2.25 time: 0.202177 Aug 04 14:03:31.787253 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1068/2118] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:31 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:31.797452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e24f2e5d-ecef-40bd-b6a3-86c478507662 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:31.800207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e24f2e5d-ecef-40bd-b6a3-86c478507662 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:31.817808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e24f2e5d-ecef-40bd-b6a3-86c478507662 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:31.820530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e24f2e5d-ecef-40bd-b6a3-86c478507662 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:31.823883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e24f2e5d-ecef-40bd-b6a3-86c478507662 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:31.824614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e24f2e5d-ecef-40bd-b6a3-86c478507662 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:31.841146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aa89782e-d471-4590-8b25-e76dc8df12a8 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:31.842279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aa89782e-d471-4590-8b25-e76dc8df12a8 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:31.861252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa89782e-d471-4590-8b25-e76dc8df12a8 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:31.862050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa89782e-d471-4590-8b25-e76dc8df12a8 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:31.863825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa89782e-d471-4590-8b25-e76dc8df12a8 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:31.866472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa89782e-d471-4590-8b25-e76dc8df12a8 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:33.768098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aa89782e-d471-4590-8b25-e76dc8df12a8 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:33.787009 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aa89782e-d471-4590-8b25-e76dc8df12a8 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1350 microversion: 2.1 time: 2.013009 Aug 04 14:03:33.809829 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1051/2119] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:31 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1350 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:33.845839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-53dcaae4-86c3-4b21-a22f-c69c9b29ad94 req-8120301d-cb3f-475b-af8f-dc9172d51430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c10284-3c28-4847-b418-8aa77c90a92a", "name": "network-vif-deleted", "tag": "5ac920bb-6091-4fef-9386-511d0cf7d506"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:33.904450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-53dcaae4-86c3-4b21-a22f-c69c9b29ad94 req-8120301d-cb3f-475b-af8f-dc9172d51430 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:33.924323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-53dcaae4-86c3-4b21-a22f-c69c9b29ad94 req-8120301d-cb3f-475b-af8f-dc9172d51430 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:33.998648 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-53dcaae4-86c3-4b21-a22f-c69c9b29ad94 req-8120301d-cb3f-475b-af8f-dc9172d51430 service nova] Creating event network-vif-deleted:5ac920bb-6091-4fef-9386-511d0cf7d506 for instance e9c10284-3c28-4847-b418-8aa77c90a92a on n-h1-844627-10 Aug 04 14:03:34.025553 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-53dcaae4-86c3-4b21-a22f-c69c9b29ad94 req-8120301d-cb3f-475b-af8f-dc9172d51430 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213359 Aug 04 14:03:34.032467 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1052/2120] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:34.054298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3193aae-920a-4e42-b131-1b34c7366af2 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:34.084841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f3193aae-920a-4e42-b131-1b34c7366af2 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:34.088764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3193aae-920a-4e42-b131-1b34c7366af2 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Searching by: {'deleted': False, 'project_id': '1b1dd46f08d443288c68e2439b02f407'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:03:34.121071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3193aae-920a-4e42-b131-1b34c7366af2 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:34.135149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3193aae-920a-4e42-b131-1b34c7366af2 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:34.137344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3193aae-920a-4e42-b131-1b34c7366af2 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:34.138479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3193aae-920a-4e42-b131-1b34c7366af2 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:34.226654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-f3193aae-920a-4e42-b131-1b34c7366af2 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:03:34.241856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:34.243542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e24f2e5d-ecef-40bd-b6a3-86c478507662 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:34.270876 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e24f2e5d-ecef-40bd-b6a3-86c478507662 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 2.481585 Aug 04 14:03:34.281482 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1069/2121] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:31 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 2493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:34.304128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-545de36e-e5f6-4422-865e-fed6a5e8ed13 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:34.311066 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3193aae-920a-4e42-b131-1b34c7366af2 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.276400 Aug 04 14:03:34.314248 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1053/2122] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:03:34 2022] GET /compute/v2.1/servers => generated 334 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:34.323372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4baa1224-ccf2-4b49-a4e6-29b9e5080cc2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:34.330001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4baa1224-ccf2-4b49-a4e6-29b9e5080cc2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:34.331198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-545de36e-e5f6-4422-865e-fed6a5e8ed13 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:34.337529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-545de36e-e5f6-4422-865e-fed6a5e8ed13 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Searching by: {'deleted': False, 'project_id': '6ecbc8173fa949f1913669488544658d'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:03:34.347752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4baa1224-ccf2-4b49-a4e6-29b9e5080cc2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:34.349937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4baa1224-ccf2-4b49-a4e6-29b9e5080cc2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:34.353462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4baa1224-ccf2-4b49-a4e6-29b9e5080cc2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:34.357142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4baa1224-ccf2-4b49-a4e6-29b9e5080cc2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:34.365214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-545de36e-e5f6-4422-865e-fed6a5e8ed13 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:34.366253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-545de36e-e5f6-4422-865e-fed6a5e8ed13 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:34.368650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-545de36e-e5f6-4422-865e-fed6a5e8ed13 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:34.369803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-545de36e-e5f6-4422-865e-fed6a5e8ed13 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:34.737960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-545de36e-e5f6-4422-865e-fed6a5e8ed13 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:03:34.883820 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-545de36e-e5f6-4422-865e-fed6a5e8ed13 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.600226 Aug 04 14:03:34.891924 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1070/2123] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:03:34 2022] GET /compute/v2.1/servers => generated 1018 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:34.899698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:34.903267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: e9c10284-3c28-4847-b418-8aa77c90a92a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:34.932611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:34.933845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:34.936017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:34.937068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:34.959531 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] HTTP exception thrown: Instance e9c10284-3c28-4847-b418-8aa77c90a92a could not be found. Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Request method failure captured: Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a HTTP/1.1 Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-cY-ywvSWQ74t4zf9GLTZbbqSuItV3gGPm2NvK3XrGC8KXZhqcuVXSjVqJ1Bh3y7IEfhtXVDrhXXRn9SswM6rH_oCGa__iAs9lReeKFYd7RYyQpD6-s9POLWndLT6nT7p28z6Te-PLy-T9C9skEn02oDucmZq4adCi0QVOG1DveFc Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 5366e08e3ba74d8382c899c9a584bd4b Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5366e08e3ba74d8382c899c9a584bd4b"}]}] Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 5366e08e3ba74d8382c899c9a584bd4b Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-LiveAutoBlockMigrationV225Test-829399796-project Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d9613691b93147d48d9f1a51bf5767c9 Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-829399796-project Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e9c10284-3c28-4847-b418-8aa77c90a92a could not be found. Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e9c10284-3c28-4847-b418-8aa77c90a92a'} Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9c10284-3c28-4847-b418-8aa77c90a92a could not be found. Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9c10284-3c28-4847-b418-8aa77c90a92a could not be found. Aug 04 14:03:34.962917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:34.967939 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:34.967939 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:34.967939 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:34.967939 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:34.967939 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:34.967939 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:03:34.967939 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:03:34.967939 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9c10284-3c28-4847-b418-8aa77c90a92a could not be found. Aug 04 14:03:34.967939 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:34.976727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Returning 404 to user: Instance e9c10284-3c28-4847-b418-8aa77c90a92a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:03:34.978108 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-979bc687-cbfd-43fe-afa1-dcc0daba8c62 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a" status: 404 len: 111 microversion: 2.25 time: 0.084655 Aug 04 14:03:34.979555 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1071/2124] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:34 2022] GET /compute/v2.1/servers/e9c10284-3c28-4847-b418-8aa77c90a92a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:03:34.986563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-274abddf-8b5e-42a5-b706-677ecc55022d req-9defde92-a885-4952-bf03-332a2ed7312c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19bbecb-ac45-485a-b0ca-9ee56b5628ce", "name": "network-vif-plugged", "status": "completed", "tag": "28c2253a-6f45-4cfd-bba6-a91c0cc27e5e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:35.013792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-274abddf-8b5e-42a5-b706-677ecc55022d req-9defde92-a885-4952-bf03-332a2ed7312c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:35.015484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-274abddf-8b5e-42a5-b706-677ecc55022d req-9defde92-a885-4952-bf03-332a2ed7312c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:35.048977 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-274abddf-8b5e-42a5-b706-677ecc55022d req-9defde92-a885-4952-bf03-332a2ed7312c service nova] Creating event network-vif-plugged:28c2253a-6f45-4cfd-bba6-a91c0cc27e5e for instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce on n-h1-844627-10 Aug 04 14:03:35.061159 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-274abddf-8b5e-42a5-b706-677ecc55022d req-9defde92-a885-4952-bf03-332a2ed7312c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079831 Aug 04 14:03:35.062575 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1072/2125] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:35.073821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:35.080517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:35.081966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Searching by: {'deleted': False, 'project_id': '1b1dd46f08d443288c68e2439b02f407'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:03:35.090137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:35.090997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:35.092167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:35.093221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:35.174694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:03:35.282912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:35.359844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:35.379304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:35.380151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:35.631299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4baa1224-ccf2-4b49-a4e6-29b9e5080cc2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:35.648524 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4baa1224-ccf2-4b49-a4e6-29b9e5080cc2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1317 microversion: 2.1 time: 1.331539 Aug 04 14:03:35.650501 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1054/2126] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:34 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1317 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:35.656209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3b8714f1-4311-45d2-8d6d-76648b1d9cdd tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:35.661748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3b8714f1-4311-45d2-8d6d-76648b1d9cdd tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:35.695241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b8714f1-4311-45d2-8d6d-76648b1d9cdd tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:35.696117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b8714f1-4311-45d2-8d6d-76648b1d9cdd tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:35.697311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b8714f1-4311-45d2-8d6d-76648b1d9cdd tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:35.697981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b8714f1-4311-45d2-8d6d-76648b1d9cdd tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:36.581265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3b8714f1-4311-45d2-8d6d-76648b1d9cdd tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:36.622694 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3b8714f1-4311-45d2-8d6d-76648b1d9cdd tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1350 microversion: 2.1 time: 0.970510 Aug 04 14:03:36.634025 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1055/2127] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:35 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1350 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:36.684957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eef6610c-469b-4c30-86f9-6691eaca4874 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:36.686195 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d76ced99-f8e4-469b-a793-e89d43012a35 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 1.590370 Aug 04 14:03:36.686195 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1073/2128] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:03:35 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:36.689111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eef6610c-469b-4c30-86f9-6691eaca4874 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:36.689870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e1edfd8-1ee3-4dd0-9001-5d39279b0fc8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:36.689870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e1edfd8-1ee3-4dd0-9001-5d39279b0fc8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:36.695164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef6610c-469b-4c30-86f9-6691eaca4874 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:36.697986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef6610c-469b-4c30-86f9-6691eaca4874 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:36.701607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef6610c-469b-4c30-86f9-6691eaca4874 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:36.701607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eef6610c-469b-4c30-86f9-6691eaca4874 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:36.715145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e1edfd8-1ee3-4dd0-9001-5d39279b0fc8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:36.716123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e1edfd8-1ee3-4dd0-9001-5d39279b0fc8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:36.717701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e1edfd8-1ee3-4dd0-9001-5d39279b0fc8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:36.718511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e1edfd8-1ee3-4dd0-9001-5d39279b0fc8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:36.824339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:36.878683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e1edfd8-1ee3-4dd0-9001-5d39279b0fc8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:03:37.057422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eef6610c-469b-4c30-86f9-6691eaca4874 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:37.092962 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eef6610c-469b-4c30-86f9-6691eaca4874 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1281 microversion: 2.1 time: 0.445257 Aug 04 14:03:37.105382 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1056/2129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:36 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1281 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:37.114235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eb706c01-be3e-46ce-a89a-05b8e152d197 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:37.114852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eb706c01-be3e-46ce-a89a-05b8e152d197 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:37.147222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb706c01-be3e-46ce-a89a-05b8e152d197 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:37.147764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb706c01-be3e-46ce-a89a-05b8e152d197 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:37.154929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb706c01-be3e-46ce-a89a-05b8e152d197 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:37.158890 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e1edfd8-1ee3-4dd0-9001-5d39279b0fc8 tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 204 len: 0 microversion: 2.25 time: 0.500280 Aug 04 14:03:37.159831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb706c01-be3e-46ce-a89a-05b8e152d197 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:37.167308 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1074/2130] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:03:36 2022] DELETE /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:03:37.189704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec883e09-de56-404d-a42f-12087606cb0c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:37.190824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ec883e09-de56-404d-a42f-12087606cb0c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:37.207877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec883e09-de56-404d-a42f-12087606cb0c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:37.208324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec883e09-de56-404d-a42f-12087606cb0c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:37.209205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec883e09-de56-404d-a42f-12087606cb0c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:37.209654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec883e09-de56-404d-a42f-12087606cb0c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:38.554790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ec883e09-de56-404d-a42f-12087606cb0c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:38.565064 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec883e09-de56-404d-a42f-12087606cb0c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1317 microversion: 2.1 time: 1.396190 Aug 04 14:03:38.566289 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1075/2131] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:37 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1317 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:38.586959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19bf3883-c8cb-4ded-b3fd-3760ee80371e tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:38.605536 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19bf3883-c8cb-4ded-b3fd-3760ee80371e tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035623 Aug 04 14:03:38.615542 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1076/2132] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:03:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:38.616455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eb706c01-be3e-46ce-a89a-05b8e152d197 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:38.630949 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eb706c01-be3e-46ce-a89a-05b8e152d197 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 1.524156 Aug 04 14:03:38.631610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-02ff6fa7-cf7a-4b27-b0f9-17e314c78cb9 req-20cbf7da-20a7-4a7c-b006-cc94349541d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739d0629-de24-4a72-83a0-2f443e0af803", "tag": "dceb6721-526a-47cd-9222-7311c255822d"}, {"name": "network-changed", "server_uuid": "2ef4772e-29b4-455f-8f48-9d9011226e91", "tag": "dc89b1d8-aee1-4467-a5f3-d98a32bb14b7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:38.633576 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1057/2133] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:37 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:38.643712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:38.647736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:38.666280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:38.668823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:38.669971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:38.672279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:38.673872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-02ff6fa7-cf7a-4b27-b0f9-17e314c78cb9 req-20cbf7da-20a7-4a7c-b006-cc94349541d0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:38.674584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-02ff6fa7-cf7a-4b27-b0f9-17e314c78cb9 req-20cbf7da-20a7-4a7c-b006-cc94349541d0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:38.727752 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-02ff6fa7-cf7a-4b27-b0f9-17e314c78cb9 req-20cbf7da-20a7-4a7c-b006-cc94349541d0 service nova] Creating event network-changed:dceb6721-526a-47cd-9222-7311c255822d for instance 739d0629-de24-4a72-83a0-2f443e0af803 on n-h2-844627-10 Aug 04 14:03:38.736374 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-02ff6fa7-cf7a-4b27-b0f9-17e314c78cb9 req-20cbf7da-20a7-4a7c-b006-cc94349541d0 service nova] Creating event network-changed:dc89b1d8-aee1-4467-a5f3-d98a32bb14b7 for instance 2ef4772e-29b4-455f-8f48-9d9011226e91 on n-h2-844627-10 Aug 04 14:03:38.767976 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-02ff6fa7-cf7a-4b27-b0f9-17e314c78cb9 req-20cbf7da-20a7-4a7c-b006-cc94349541d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.150760 Aug 04 14:03:38.770169 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1077/2134] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:38.788555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2484f073-bac3-43f5-8295-cf4b9e1e62d4 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:38.790339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2484f073-bac3-43f5-8295-cf4b9e1e62d4 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:38.810837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2484f073-bac3-43f5-8295-cf4b9e1e62d4 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:38.814163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2484f073-bac3-43f5-8295-cf4b9e1e62d4 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:38.815249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2484f073-bac3-43f5-8295-cf4b9e1e62d4 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:38.815848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2484f073-bac3-43f5-8295-cf4b9e1e62d4 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:39.580753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2484f073-bac3-43f5-8295-cf4b9e1e62d4 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:39.591618 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2484f073-bac3-43f5-8295-cf4b9e1e62d4 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1541 microversion: 2.1 time: 0.819951 Aug 04 14:03:39.592234 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1078/2135] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:38 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1541 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:39.618033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba1aa13b-c6f7-4a1c-86d8-a00686df8de3 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:39.618674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ba1aa13b-c6f7-4a1c-86d8-a00686df8de3 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:39.632083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:39.644067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba1aa13b-c6f7-4a1c-86d8-a00686df8de3 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:39.644725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba1aa13b-c6f7-4a1c-86d8-a00686df8de3 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:39.646725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba1aa13b-c6f7-4a1c-86d8-a00686df8de3 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:39.650518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba1aa13b-c6f7-4a1c-86d8-a00686df8de3 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:39.670268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:39.674669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:39.684223 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bdc6432b-ce03-43a4-9d85-48b635c4f9dd tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1563 microversion: 2.25 time: 1.047726 Aug 04 14:03:39.688726 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1058/2136] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:38 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1563 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:39.722449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2ec33e7-8466-411c-be2f-dc9d4c2292a0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:39.727713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e2ec33e7-8466-411c-be2f-dc9d4c2292a0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:39.746557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2ec33e7-8466-411c-be2f-dc9d4c2292a0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:39.747143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2ec33e7-8466-411c-be2f-dc9d4c2292a0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:39.747853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2ec33e7-8466-411c-be2f-dc9d4c2292a0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:39.748312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2ec33e7-8466-411c-be2f-dc9d4c2292a0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:39.812684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e2ec33e7-8466-411c-be2f-dc9d4c2292a0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:03:39.909566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ba1aa13b-c6f7-4a1c-86d8-a00686df8de3 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:39.924224 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ba1aa13b-c6f7-4a1c-86d8-a00686df8de3 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1281 microversion: 2.1 time: 0.310057 Aug 04 14:03:39.939550 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1079/2137] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:39 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1281 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:39.945066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0614b0e4-1cc3-4b78-b15d-71e6a9cea2f5 req-dd77a9a4-96a0-4701-be91-1e71101af324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7a6c65-5f80-48bb-a324-23c01af35738", "name": "network-vif-plugged", "status": "completed", "tag": "847a36f8-843d-46a5-9321-5c09ee823490"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:39.957792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0614b0e4-1cc3-4b78-b15d-71e6a9cea2f5 req-dd77a9a4-96a0-4701-be91-1e71101af324 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:39.958443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0614b0e4-1cc3-4b78-b15d-71e6a9cea2f5 req-dd77a9a4-96a0-4701-be91-1e71101af324 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:39.980431 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0614b0e4-1cc3-4b78-b15d-71e6a9cea2f5 req-dd77a9a4-96a0-4701-be91-1e71101af324 service nova] Creating event network-vif-plugged:847a36f8-843d-46a5-9321-5c09ee823490 for instance 4f7a6c65-5f80-48bb-a324-23c01af35738 on n-h1-844627-10 Aug 04 14:03:40.001219 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0614b0e4-1cc3-4b78-b15d-71e6a9cea2f5 req-dd77a9a4-96a0-4701-be91-1e71101af324 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058506 Aug 04 14:03:40.001702 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1080/2138] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:40.014252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-850e1dd8-f190-4d92-ab30-b4e87333ccee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:40.015025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-850e1dd8-f190-4d92-ab30-b4e87333ccee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:40.031764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-850e1dd8-f190-4d92-ab30-b4e87333ccee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.038204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-850e1dd8-f190-4d92-ab30-b4e87333ccee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:40.039287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-850e1dd8-f190-4d92-ab30-b4e87333ccee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.039763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-850e1dd8-f190-4d92-ab30-b4e87333ccee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:40.135310 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e2ec33e7-8466-411c-be2f-dc9d4c2292a0 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 204 len: 0 microversion: 2.1 time: 0.442429 Aug 04 14:03:40.142149 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1059/2139] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:03:39 2022] DELETE /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:03:40.179360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b29f708-ec48-42a5-88b0-f163676b7e39 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:40.182457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b29f708-ec48-42a5-88b0-f163676b7e39 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:40.200090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b29f708-ec48-42a5-88b0-f163676b7e39 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.201660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b29f708-ec48-42a5-88b0-f163676b7e39 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:40.203779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b29f708-ec48-42a5-88b0-f163676b7e39 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.205263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b29f708-ec48-42a5-88b0-f163676b7e39 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:40.498559 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b29f708-ec48-42a5-88b0-f163676b7e39 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.353206 Aug 04 14:03:40.499572 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1060/2140] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:03:40 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce/os-interface => generated 285 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:40.506821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3388fee6-9f44-4e34-b9cf-3f0260e70509 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:40.507616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3388fee6-9f44-4e34-b9cf-3f0260e70509 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:40.524125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3388fee6-9f44-4e34-b9cf-3f0260e70509 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.527093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3388fee6-9f44-4e34-b9cf-3f0260e70509 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:40.532665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3388fee6-9f44-4e34-b9cf-3f0260e70509 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.533354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3388fee6-9f44-4e34-b9cf-3f0260e70509 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:40.755333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-850e1dd8-f190-4d92-ab30-b4e87333ccee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:40.793781 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-850e1dd8-f190-4d92-ab30-b4e87333ccee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1317 microversion: 2.1 time: 0.790699 Aug 04 14:03:40.800387 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1081/2141] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:40 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1317 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:40.835088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d738c1d-a4fa-4956-8e0e-a31cce2a0ead tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:40.836212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d738c1d-a4fa-4956-8e0e-a31cce2a0ead tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:40.846575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d738c1d-a4fa-4956-8e0e-a31cce2a0ead tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.847775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d738c1d-a4fa-4956-8e0e-a31cce2a0ead tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:40.850540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d738c1d-a4fa-4956-8e0e-a31cce2a0ead tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.851621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d738c1d-a4fa-4956-8e0e-a31cce2a0ead tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:40.934371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3388fee6-9f44-4e34-b9cf-3f0260e70509 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:40.961848 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3388fee6-9f44-4e34-b9cf-3f0260e70509 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 0.460124 Aug 04 14:03:40.963360 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1061/2142] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:40 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:40.968837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:40.969699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:40.979258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.979947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:40.980913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:40.981497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:41.235056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:41.288229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:41.292007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:41.294163 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e8a56346-a310-4966-a9d4-cf6706e94b9d tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1521 microversion: 2.25 time: 0.329613 Aug 04 14:03:41.295394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1062/2143] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:40 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:41.430661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:41.471818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-46f851d2-36ed-4a41-b3dd-74b756e8551d req-311498e7-a797-4ae3-89dc-a524b0100c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3861160-fd38-4411-9578-cbe56e26a0f7", "name": "network-vif-deleted", "tag": "00402c6c-b47f-4ddd-a152-4636377d16c8"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:41.487037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-46f851d2-36ed-4a41-b3dd-74b756e8551d req-311498e7-a797-4ae3-89dc-a524b0100c54 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:41.488155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-46f851d2-36ed-4a41-b3dd-74b756e8551d req-311498e7-a797-4ae3-89dc-a524b0100c54 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:41.511863 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-46f851d2-36ed-4a41-b3dd-74b756e8551d req-311498e7-a797-4ae3-89dc-a524b0100c54 service nova] Creating event network-vif-deleted:00402c6c-b47f-4ddd-a152-4636377d16c8 for instance d3861160-fd38-4411-9578-cbe56e26a0f7 on n-h1-844627-10 Aug 04 14:03:41.519550 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-46f851d2-36ed-4a41-b3dd-74b756e8551d req-311498e7-a797-4ae3-89dc-a524b0100c54 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221703 Aug 04 14:03:41.521262 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1063/2144] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:41.532277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f4aad8e6-16a9-4e30-bdac-8909a1563022 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:41.533204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f4aad8e6-16a9-4e30-bdac-8909a1563022 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:41.542955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4aad8e6-16a9-4e30-bdac-8909a1563022 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:41.543607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4aad8e6-16a9-4e30-bdac-8909a1563022 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:41.544532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4aad8e6-16a9-4e30-bdac-8909a1563022 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:41.545820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4aad8e6-16a9-4e30-bdac-8909a1563022 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:41.783255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f4aad8e6-16a9-4e30-bdac-8909a1563022 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:41.801534 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f4aad8e6-16a9-4e30-bdac-8909a1563022 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1281 microversion: 2.1 time: 0.278630 Aug 04 14:03:41.802862 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1064/2145] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:41 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1281 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:41.819655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30222f4f-83e2-4bef-a30f-31b7024fb849 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:41.821844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-30222f4f-83e2-4bef-a30f-31b7024fb849 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:41.833819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30222f4f-83e2-4bef-a30f-31b7024fb849 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:41.834485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30222f4f-83e2-4bef-a30f-31b7024fb849 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:41.835779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30222f4f-83e2-4bef-a30f-31b7024fb849 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:41.836568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30222f4f-83e2-4bef-a30f-31b7024fb849 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:41.886720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d738c1d-a4fa-4956-8e0e-a31cce2a0ead tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:41.904431 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d738c1d-a4fa-4956-8e0e-a31cce2a0ead tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1701 microversion: 2.1 time: 1.102525 Aug 04 14:03:41.905477 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1082/2146] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:40 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1701 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:42.006516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ee53e4da-e826-48d6-8d36-2614b2bed32d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:42.007365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ee53e4da-e826-48d6-8d36-2614b2bed32d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:42.018922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee53e4da-e826-48d6-8d36-2614b2bed32d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:42.019553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee53e4da-e826-48d6-8d36-2614b2bed32d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:42.020509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee53e4da-e826-48d6-8d36-2614b2bed32d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:42.021105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee53e4da-e826-48d6-8d36-2614b2bed32d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:42.205462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-30222f4f-83e2-4bef-a30f-31b7024fb849 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:42.216222 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30222f4f-83e2-4bef-a30f-31b7024fb849 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1317 microversion: 2.1 time: 0.401516 Aug 04 14:03:42.229525 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1065/2147] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:41 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:42.344953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:42.346230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:42.355958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:42.356655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:42.361275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:42.361972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:42.508982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:42.509693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:42.512281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lazy-loading 'fault' on Instance uuid d3861160-fd38-4411-9578-cbe56e26a0f7 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:03:42.589103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ee53e4da-e826-48d6-8d36-2614b2bed32d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:42.598369 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ee53e4da-e826-48d6-8d36-2614b2bed32d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 0.596141 Aug 04 14:03:42.599246 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1083/2148] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:42 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:42.769212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:42.783059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:42.784664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9613691b93147d48d9f1a51bf5767c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5366e08e3ba74d8382c899c9a584bd4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:42.792228 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1356fe64-32fe-4050-873b-00698556129a tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 200 len: 1351 microversion: 2.25 time: 0.456491 Aug 04 14:03:42.796084 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1066/2149] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:42 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 1351 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:03:42.830482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0a826284-bdf9-48f7-9265-b5ead18403b7 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:42.831577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0a826284-bdf9-48f7-9265-b5ead18403b7 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:42.860180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a826284-bdf9-48f7-9265-b5ead18403b7 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:42.866213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a826284-bdf9-48f7-9265-b5ead18403b7 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:42.868121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a826284-bdf9-48f7-9265-b5ead18403b7 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:42.868979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a826284-bdf9-48f7-9265-b5ead18403b7 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:42.942132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d431525a-3a9f-48a5-8b77-69a249c8954d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:42.943148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d431525a-3a9f-48a5-8b77-69a249c8954d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:42.970965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d431525a-3a9f-48a5-8b77-69a249c8954d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:42.971439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d431525a-3a9f-48a5-8b77-69a249c8954d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:42.972271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d431525a-3a9f-48a5-8b77-69a249c8954d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:42.973500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d431525a-3a9f-48a5-8b77-69a249c8954d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:43.184137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0a826284-bdf9-48f7-9265-b5ead18403b7 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:43.203856 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0a826284-bdf9-48f7-9265-b5ead18403b7 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1281 microversion: 2.1 time: 0.383404 Aug 04 14:03:43.204590 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1084/2150] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:42 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1281 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:43.240950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df131fc4-0cad-4118-b8ca-5c2866c37aae tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:43.241670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-df131fc4-0cad-4118-b8ca-5c2866c37aae tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:43.257145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df131fc4-0cad-4118-b8ca-5c2866c37aae tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:43.257983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df131fc4-0cad-4118-b8ca-5c2866c37aae tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:43.259006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df131fc4-0cad-4118-b8ca-5c2866c37aae tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:43.259674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df131fc4-0cad-4118-b8ca-5c2866c37aae tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:43.549178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d431525a-3a9f-48a5-8b77-69a249c8954d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:43.595200 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d431525a-3a9f-48a5-8b77-69a249c8954d tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1701 microversion: 2.1 time: 0.670894 Aug 04 14:03:43.598808 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1067/2151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:42 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1701 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:43.646276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f0d18d0-f57e-4640-a475-38fe6e040c6f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:43.653697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f0d18d0-f57e-4640-a475-38fe6e040c6f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:43.671864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f0d18d0-f57e-4640-a475-38fe6e040c6f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:43.672718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f0d18d0-f57e-4640-a475-38fe6e040c6f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:43.678511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f0d18d0-f57e-4640-a475-38fe6e040c6f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:43.679629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f0d18d0-f57e-4640-a475-38fe6e040c6f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:43.699160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-df131fc4-0cad-4118-b8ca-5c2866c37aae tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:43.713668 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-df131fc4-0cad-4118-b8ca-5c2866c37aae tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1317 microversion: 2.1 time: 0.476739 Aug 04 14:03:43.716715 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1085/2152] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:43 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:43.821934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:43.823797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] [instance: d3861160-fd38-4411-9578-cbe56e26a0f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:43.835478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:43.850363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:43.851416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:43.852430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:43.900601 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] HTTP exception thrown: Instance d3861160-fd38-4411-9578-cbe56e26a0f7 could not be found. Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Request method failure captured: Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 HTTP/1.1 Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi68-cY-ywvSWQ74t4zf9GLTZbbqSuItV3gGPm2NvK3XrGC8KXZhqcuVXSjVqJ1Bh3y7IEfhtXVDrhXXRn9SswM6rH_oCGa__iAs9lReeKFYd7RYyQpD6-s9POLWndLT6nT7p28z6Te-PLy-T9C9skEn02oDucmZq4adCi0QVOG1DveFc Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 5366e08e3ba74d8382c899c9a584bd4b Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5366e08e3ba74d8382c899c9a584bd4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5366e08e3ba74d8382c899c9a584bd4b"}]}] Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 5366e08e3ba74d8382c899c9a584bd4b Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-829399796 Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-LiveAutoBlockMigrationV225Test-829399796-project Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d9613691b93147d48d9f1a51bf5767c9 Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-829399796-project Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d3861160-fd38-4411-9578-cbe56e26a0f7 could not be found. Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd3861160-fd38-4411-9578-cbe56e26a0f7'} Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3861160-fd38-4411-9578-cbe56e26a0f7 could not be found. Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3861160-fd38-4411-9578-cbe56e26a0f7 could not be found. Aug 04 14:03:43.909404 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3861160-fd38-4411-9578-cbe56e26a0f7 could not be found. Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] Returning 404 to user: Instance d3861160-fd38-4411-9578-cbe56e26a0f7 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:03:43.912805 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a758d16-25f9-4d8e-bcaa-0bb272bbb43b tempest-LiveAutoBlockMigrationV225Test-829399796 tempest-LiveAutoBlockMigrationV225Test-829399796-project] 10.222.0.66 "GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7" status: 404 len: 111 microversion: 2.25 time: 0.093914 Aug 04 14:03:43.914611 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1086/2153] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:03:43 2022] GET /compute/v2.1/servers/d3861160-fd38-4411-9578-cbe56e26a0f7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:03:44.183287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5f0d18d0-f57e-4640-a475-38fe6e040c6f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:44.191388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:44.196117 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f0d18d0-f57e-4640-a475-38fe6e040c6f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1307 microversion: 2.1 time: 0.573759 Aug 04 14:03:44.197637 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1068/2154] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:43 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1307 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:44.216762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-197999229", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "dd9e8a70-9b6c-446a-a4d7-d687623de957"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:44.247626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-991a6e24-1508-432c-bafd-c2c4b08b1d9d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:44.248463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-991a6e24-1508-432c-bafd-c2c4b08b1d9d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:44.256605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-991a6e24-1508-432c-bafd-c2c4b08b1d9d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:44.257669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-991a6e24-1508-432c-bafd-c2c4b08b1d9d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:44.259236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-991a6e24-1508-432c-bafd-c2c4b08b1d9d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:44.259895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-991a6e24-1508-432c-bafd-c2c4b08b1d9d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:44.266169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:44.285040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] validate_networks() for [('dd9e8a70-9b6c-446a-a4d7-d687623de957', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:03:44.423921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-991a6e24-1508-432c-bafd-c2c4b08b1d9d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:44.447056 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-991a6e24-1508-432c-bafd-c2c4b08b1d9d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1281 microversion: 2.1 time: 0.206506 Aug 04 14:03:44.448700 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1069/2155] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:44 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1281 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:44.657113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e5575b48-97fa-4915-b2f9-82fd1cf5dfab tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:44.670468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e5575b48-97fa-4915-b2f9-82fd1cf5dfab tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:44.693381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5575b48-97fa-4915-b2f9-82fd1cf5dfab tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:44.703965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5575b48-97fa-4915-b2f9-82fd1cf5dfab tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:44.704945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5575b48-97fa-4915-b2f9-82fd1cf5dfab tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:44.705900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5575b48-97fa-4915-b2f9-82fd1cf5dfab tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:44.955285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e5575b48-97fa-4915-b2f9-82fd1cf5dfab tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82728e57699e4154a1f2961e2801eb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1dd46f08d443288c68e2439b02f407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:44.978755 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e5575b48-97fa-4915-b2f9-82fd1cf5dfab tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 200 len: 1633 microversion: 2.1 time: 0.333982 Aug 04 14:03:44.979923 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1070/2156] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:44 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 1633 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:44.993853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e1ccfc8e-c8ca-416f-844f-037818e617ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:44.995351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e1ccfc8e-c8ca-416f-844f-037818e617ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:45.011261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1ccfc8e-c8ca-416f-844f-037818e617ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:45.012074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1ccfc8e-c8ca-416f-844f-037818e617ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:45.013568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1ccfc8e-c8ca-416f-844f-037818e617ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:45.014233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1ccfc8e-c8ca-416f-844f-037818e617ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:45.113961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:45.358788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:46.323998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:03:46.325175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:03:46.325677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:03:46.326101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:03:46.326548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:03:46.344223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:46.359270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:46.360314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:46.360562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:46.377935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:46.418054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Getting quotas for project 56a04f49378d4eef9534b011602c4bcc. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:03:46.454634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Getting quotas for user 70a90dfdb45d4ab280dbff8f2fcca948 and project 56a04f49378d4eef9534b011602c4bcc. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:03:46.474027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:03:46.476497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:03:46.604971 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b91aaeac-a839-4536-b004-9c0f3acea25d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.504445 Aug 04 14:03:46.606505 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1087/2157] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:03:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:03:46.612562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b01d03dc-6836-4453-8c8f-7d7c22bfa684 req-eda6bddb-29a3-4f9a-859a-7a294094f491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a3bbe-676f-418d-ba74-6219d71f306f", "name": "network-vif-deleted", "tag": "5e800a4e-6a5e-4cd1-91ba-17a672f04e77"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:46.629689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b01d03dc-6836-4453-8c8f-7d7c22bfa684 req-eda6bddb-29a3-4f9a-859a-7a294094f491 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:46.630500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b01d03dc-6836-4453-8c8f-7d7c22bfa684 req-eda6bddb-29a3-4f9a-859a-7a294094f491 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:46.660243 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b01d03dc-6836-4453-8c8f-7d7c22bfa684 req-eda6bddb-29a3-4f9a-859a-7a294094f491 service nova] Creating event network-vif-deleted:5e800a4e-6a5e-4cd1-91ba-17a672f04e77 for instance ee6a3bbe-676f-418d-ba74-6219d71f306f on n-h1-844627-10 Aug 04 14:03:46.676504 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b01d03dc-6836-4453-8c8f-7d7c22bfa684 req-eda6bddb-29a3-4f9a-859a-7a294094f491 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068377 Aug 04 14:03:46.680906 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1088/2158] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:46.705277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3de58635-e5c9-4dd6-937e-51d3f5174f4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:46.706718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3de58635-e5c9-4dd6-937e-51d3f5174f4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:46.725902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3de58635-e5c9-4dd6-937e-51d3f5174f4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:46.726626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3de58635-e5c9-4dd6-937e-51d3f5174f4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:46.728781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3de58635-e5c9-4dd6-937e-51d3f5174f4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:46.741360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3de58635-e5c9-4dd6-937e-51d3f5174f4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:46.827869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e1ccfc8e-c8ca-416f-844f-037818e617ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:46.842190 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e1ccfc8e-c8ca-416f-844f-037818e617ee tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1317 microversion: 2.1 time: 1.860855 Aug 04 14:03:46.843047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1071/2159] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:44 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1317 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:46.874821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4f83ac40-ebaa-4407-b9cd-d739d7e547cc tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:46.880310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4f83ac40-ebaa-4407-b9cd-d739d7e547cc tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:46.903383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f83ac40-ebaa-4407-b9cd-d739d7e547cc tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:46.906343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f83ac40-ebaa-4407-b9cd-d739d7e547cc tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:46.909093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f83ac40-ebaa-4407-b9cd-d739d7e547cc tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:46.912798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f83ac40-ebaa-4407-b9cd-d739d7e547cc tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:47.420575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4f83ac40-ebaa-4407-b9cd-d739d7e547cc tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:47.435908 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4f83ac40-ebaa-4407-b9cd-d739d7e547cc tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 0.591056 Aug 04 14:03:47.437975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3de58635-e5c9-4dd6-937e-51d3f5174f4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:47.439620 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1072/2160] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:46 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:47.448385 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3de58635-e5c9-4dd6-937e-51d3f5174f4c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1487 microversion: 2.1 time: 0.762690 Aug 04 14:03:47.451556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:47.455231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] [instance: ee6a3bbe-676f-418d-ba74-6219d71f306f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:47.469449 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1089/2161] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:46 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1487 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:47.471699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:47.475667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:47.477428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-015ddf3a-4f99-492f-a3f0-4e5357e34a2e req-8f8f5804-481b-4311-8e5d-45cb3ede4e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef4772e-29b4-455f-8f48-9d9011226e91", "name": "network-vif-plugged", "status": "completed", "tag": "dc89b1d8-aee1-4467-a5f3-d98a32bb14b7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:47.479323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:47.481138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:47.506266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-015ddf3a-4f99-492f-a3f0-4e5357e34a2e req-8f8f5804-481b-4311-8e5d-45cb3ede4e41 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:47.508255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-015ddf3a-4f99-492f-a3f0-4e5357e34a2e req-8f8f5804-481b-4311-8e5d-45cb3ede4e41 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:47.543380 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] HTTP exception thrown: Instance ee6a3bbe-676f-418d-ba74-6219d71f306f could not be found. Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Request method failure captured: Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f HTTP/1.1 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69EzHQtnLKpVwwJDZBc_T9mSEIhh-QW5cTc0DZuh5mQ5w0OgnGuOqdH7bf22n3lYUcp-IZsx0aF0jUY8M2-AdD9dCoDXJ4e-aDUNI8x1Selvsp1MF7QtbR16lmtsEkvH3RCZzgdfjlVoJk4fSDdfzc9zXFxF-ki45Vw5lSPEaC6ZHIs Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1b1dd46f08d443288c68e2439b02f407 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-657932554 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b1dd46f08d443288c68e2439b02f407"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1b1dd46f08d443288c68e2439b02f407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1b1dd46f08d443288c68e2439b02f407"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b1dd46f08d443288c68e2439b02f407"}]}] Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-657932554 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1b1dd46f08d443288c68e2439b02f407 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-657932554 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-657932554-project Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 82728e57699e4154a1f2961e2801eb17 Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-657932554-project Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance ee6a3bbe-676f-418d-ba74-6219d71f306f could not be found. Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'ee6a3bbe-676f-418d-ba74-6219d71f306f'} Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6a3bbe-676f-418d-ba74-6219d71f306f could not be found. Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6a3bbe-676f-418d-ba74-6219d71f306f could not be found. Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:47.547486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:03:47.558948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:03:47.558948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:03:47.558948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:03:47.558948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:03:47.558948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6a3bbe-676f-418d-ba74-6219d71f306f could not be found. Aug 04 14:03:47.558948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:03:47.558948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Returning 404 to user: Instance ee6a3bbe-676f-418d-ba74-6219d71f306f could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:03:47.560690 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c296bdaa-5ed9-4c1c-8241-0d295a99ab72 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f" status: 404 len: 111 microversion: 2.1 time: 0.117651 Aug 04 14:03:47.566955 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1073/2162] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:47 2022] GET /compute/v2.1/servers/ee6a3bbe-676f-418d-ba74-6219d71f306f => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:03:47.567235 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-015ddf3a-4f99-492f-a3f0-4e5357e34a2e req-8f8f5804-481b-4311-8e5d-45cb3ede4e41 service nova] Creating event network-vif-plugged:dc89b1d8-aee1-4467-a5f3-d98a32bb14b7 for instance 2ef4772e-29b4-455f-8f48-9d9011226e91 on n-h2-844627-10 Aug 04 14:03:47.580941 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-015ddf3a-4f99-492f-a3f0-4e5357e34a2e req-8f8f5804-481b-4311-8e5d-45cb3ede4e41 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108908 Aug 04 14:03:47.583884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-01600f76-81db-4720-8645-eb4ed7cfac89 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:47.587796 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1090/2163] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:47.599578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-01600f76-81db-4720-8645-eb4ed7cfac89 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:47.625193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-978208cf-7b90-4fec-8f4f-bab5042d54cb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:47.634019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-978208cf-7b90-4fec-8f4f-bab5042d54cb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:47.658233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978208cf-7b90-4fec-8f4f-bab5042d54cb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:47.658678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978208cf-7b90-4fec-8f4f-bab5042d54cb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:47.659493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978208cf-7b90-4fec-8f4f-bab5042d54cb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:47.659996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978208cf-7b90-4fec-8f4f-bab5042d54cb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:47.752818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-978208cf-7b90-4fec-8f4f-bab5042d54cb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lazy-loading 'flavor' on Instance uuid 4f7a6c65-5f80-48bb-a324-23c01af35738 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:03:47.855831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01600f76-81db-4720-8645-eb4ed7cfac89 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:47.874232 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-01600f76-81db-4720-8645-eb4ed7cfac89 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1216 microversion: 2.1 time: 0.299999 Aug 04 14:03:47.875464 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1074/2164] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:47 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1216 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:47.899349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5136333d-114b-44d9-8a36-34ab8b52cef1 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] Calling method '.version_select at 0x7f46f3926ca0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:47.950031 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5136333d-114b-44d9-8a36-34ab8b52cef1 tempest-ServersTestJSON-657932554 tempest-ServersTestJSON-657932554-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639420115" status: 202 len: 0 microversion: 2.1 time: 0.071811 Aug 04 14:03:47.953388 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1075/2165] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 14:03:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639420115 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:03:47.966073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-68103fb1-18fc-442a-81d2-2342c28ccfde tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:47.967545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-68103fb1-18fc-442a-81d2-2342c28ccfde tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:47.989174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68103fb1-18fc-442a-81d2-2342c28ccfde tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:47.989944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68103fb1-18fc-442a-81d2-2342c28ccfde tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:47.991176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68103fb1-18fc-442a-81d2-2342c28ccfde tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:47.993061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68103fb1-18fc-442a-81d2-2342c28ccfde tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:48.210236 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-978208cf-7b90-4fec-8f4f-bab5042d54cb tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738/action" status: 202 len: 0 microversion: 2.1 time: 0.615366 Aug 04 14:03:48.214124 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1091/2166] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:03:47 2022] POST /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:03:48.227899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-382f234d-cbe2-4c35-a655-e20cbcbaf30f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:48.229634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-382f234d-cbe2-4c35-a655-e20cbcbaf30f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:48.250724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382f234d-cbe2-4c35-a655-e20cbcbaf30f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:48.251783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382f234d-cbe2-4c35-a655-e20cbcbaf30f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:48.253482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382f234d-cbe2-4c35-a655-e20cbcbaf30f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:48.256499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382f234d-cbe2-4c35-a655-e20cbcbaf30f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:49.098558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-68103fb1-18fc-442a-81d2-2342c28ccfde tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:49.123274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-382f234d-cbe2-4c35-a655-e20cbcbaf30f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:49.132308 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-68103fb1-18fc-442a-81d2-2342c28ccfde tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1317 microversion: 2.1 time: 1.174845 Aug 04 14:03:49.133593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:49.140162 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1076/2167] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:47 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1317 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:49.145312 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-382f234d-cbe2-4c35-a655-e20cbcbaf30f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1495 microversion: 2.1 time: 0.922034 Aug 04 14:03:49.146740 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1092/2168] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:48 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1495 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:49.153402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-61ee627a-4e7e-4fe6-a4ae-ba9605b5456e req-eeafdd28-b0ac-4d4c-894d-4c961a377782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e295fc-0888-455d-b1b2-24d11d238044", "tag": "f72015d3-8ae8-43ae-8514-488809548829"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:49.184233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-61ee627a-4e7e-4fe6-a4ae-ba9605b5456e req-eeafdd28-b0ac-4d4c-894d-4c961a377782 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:49.186759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-83c3191a-a6b5-486e-85a2-e65f69decc1b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:49.188606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-61ee627a-4e7e-4fe6-a4ae-ba9605b5456e req-eeafdd28-b0ac-4d4c-894d-4c961a377782 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:49.193184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-83c3191a-a6b5-486e-85a2-e65f69decc1b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:49.222943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83c3191a-a6b5-486e-85a2-e65f69decc1b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:49.224107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83c3191a-a6b5-486e-85a2-e65f69decc1b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:49.225437 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-61ee627a-4e7e-4fe6-a4ae-ba9605b5456e req-eeafdd28-b0ac-4d4c-894d-4c961a377782 service nova] Creating event network-changed:f72015d3-8ae8-43ae-8514-488809548829 for instance c1e295fc-0888-455d-b1b2-24d11d238044 on n-h2-844627-10 Aug 04 14:03:49.239864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83c3191a-a6b5-486e-85a2-e65f69decc1b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:49.240769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83c3191a-a6b5-486e-85a2-e65f69decc1b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:49.243041 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-61ee627a-4e7e-4fe6-a4ae-ba9605b5456e req-eeafdd28-b0ac-4d4c-894d-4c961a377782 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093977 Aug 04 14:03:49.243651 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1093/2169] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:49.249723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6c56469e-75ef-4a67-9fd7-5b44e5039154 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:49.262036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6c56469e-75ef-4a67-9fd7-5b44e5039154 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:49.275689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c56469e-75ef-4a67-9fd7-5b44e5039154 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:49.276143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c56469e-75ef-4a67-9fd7-5b44e5039154 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:49.276969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c56469e-75ef-4a67-9fd7-5b44e5039154 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:49.277422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c56469e-75ef-4a67-9fd7-5b44e5039154 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:49.575888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6c56469e-75ef-4a67-9fd7-5b44e5039154 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:49.610601 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6c56469e-75ef-4a67-9fd7-5b44e5039154 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1268 microversion: 2.1 time: 0.363728 Aug 04 14:03:49.614157 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1094/2170] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:49 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1268 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:49.636549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6cba6669-b641-4ab2-8f6a-c85d3d71479a req-4b62131f-aac1-49b2-a63f-fb4ed529e00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19bbecb-ac45-485a-b0ca-9ee56b5628ce", "tag": "28c2253a-6f45-4cfd-bba6-a91c0cc27e5e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:49.665730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6cba6669-b641-4ab2-8f6a-c85d3d71479a req-4b62131f-aac1-49b2-a63f-fb4ed529e00e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:49.668657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6cba6669-b641-4ab2-8f6a-c85d3d71479a req-4b62131f-aac1-49b2-a63f-fb4ed529e00e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:49.696457 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6cba6669-b641-4ab2-8f6a-c85d3d71479a req-4b62131f-aac1-49b2-a63f-fb4ed529e00e service nova] Creating event network-changed:28c2253a-6f45-4cfd-bba6-a91c0cc27e5e for instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce on n-h1-844627-10 Aug 04 14:03:49.710127 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6cba6669-b641-4ab2-8f6a-c85d3d71479a req-4b62131f-aac1-49b2-a63f-fb4ed529e00e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088065 Aug 04 14:03:49.713387 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1095/2171] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:50.179030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-67ac0f44-c5b1-4de0-bede-ad0f032e0cd6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:50.182429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-67ac0f44-c5b1-4de0-bede-ad0f032e0cd6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:50.197172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67ac0f44-c5b1-4de0-bede-ad0f032e0cd6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:50.200288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67ac0f44-c5b1-4de0-bede-ad0f032e0cd6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:50.203217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67ac0f44-c5b1-4de0-bede-ad0f032e0cd6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:50.204655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67ac0f44-c5b1-4de0-bede-ad0f032e0cd6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:50.243396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-83c3191a-a6b5-486e-85a2-e65f69decc1b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:50.268662 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-83c3191a-a6b5-486e-85a2-e65f69decc1b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 1.121716 Aug 04 14:03:50.273483 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1077/2172] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:49 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:50.287782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-91dffb82-6a46-4d02-80b8-dac2332d304d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:50.294281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-91dffb82-6a46-4d02-80b8-dac2332d304d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:50.324894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91dffb82-6a46-4d02-80b8-dac2332d304d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:50.325998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91dffb82-6a46-4d02-80b8-dac2332d304d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:50.327004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91dffb82-6a46-4d02-80b8-dac2332d304d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:50.328189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91dffb82-6a46-4d02-80b8-dac2332d304d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:51.276528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-67ac0f44-c5b1-4de0-bede-ad0f032e0cd6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:51.286640 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-67ac0f44-c5b1-4de0-bede-ad0f032e0cd6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1317 microversion: 2.1 time: 1.117560 Aug 04 14:03:51.287496 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1096/2173] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:50 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1317 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:51.307231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4d540444-17c2-4022-9ecd-644cf6232c8a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:51.308517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4d540444-17c2-4022-9ecd-644cf6232c8a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:51.319241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d540444-17c2-4022-9ecd-644cf6232c8a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:51.319709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d540444-17c2-4022-9ecd-644cf6232c8a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:51.320782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d540444-17c2-4022-9ecd-644cf6232c8a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:51.321275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d540444-17c2-4022-9ecd-644cf6232c8a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:51.392676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-91dffb82-6a46-4d02-80b8-dac2332d304d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:51.433876 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-91dffb82-6a46-4d02-80b8-dac2332d304d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 200 len: 1478 microversion: 2.1 time: 1.158236 Aug 04 14:03:51.445368 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1078/2174] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:50 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 1478 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:51.461977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-79b01521-166f-4439-9cd8-d9b8414045a8 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:51.463082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-79b01521-166f-4439-9cd8-d9b8414045a8 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:51.484807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79b01521-166f-4439-9cd8-d9b8414045a8 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:51.485614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79b01521-166f-4439-9cd8-d9b8414045a8 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:51.488906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79b01521-166f-4439-9cd8-d9b8414045a8 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:51.489651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79b01521-166f-4439-9cd8-d9b8414045a8 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:51.573449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4d540444-17c2-4022-9ecd-644cf6232c8a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:51.584820 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4d540444-17c2-4022-9ecd-644cf6232c8a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1274 microversion: 2.1 time: 0.296043 Aug 04 14:03:51.600914 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1097/2175] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:51 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1274 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:51.606859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-59733dac-a7eb-475d-ad04-d6aa10244011 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1306579658"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:51.620445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-59733dac-a7eb-475d-ad04-d6aa10244011 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:51.638789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59733dac-a7eb-475d-ad04-d6aa10244011 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:51.639528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59733dac-a7eb-475d-ad04-d6aa10244011 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:51.640792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59733dac-a7eb-475d-ad04-d6aa10244011 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:51.641542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59733dac-a7eb-475d-ad04-d6aa10244011 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:52.185656 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-59733dac-a7eb-475d-ad04-d6aa10244011 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738/action" status: 202 len: 0 microversion: 2.1 time: 0.582501 Aug 04 14:03:52.186642 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1098/2176] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:03:51 2022] POST /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:03:52.193704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-45dd7399-14ec-4963-8619-83f98bf45fd7 req-07ea476f-ecaa-45c9-986b-ae773030cb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab0715c8-e967-444f-bb46-6e5043791203", "tag": "1097e6b8-3b63-4bbe-9ad8-f070202698fd"}, {"name": "network-changed", "server_uuid": "1204865f-4b5f-41f3-8f2c-27f15aaa938e", "tag": "ecfd3a75-5d1b-4c2a-9299-4dd1c69e9faa"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:52.227172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-45dd7399-14ec-4963-8619-83f98bf45fd7 req-07ea476f-ecaa-45c9-986b-ae773030cb4e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:52.228211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-45dd7399-14ec-4963-8619-83f98bf45fd7 req-07ea476f-ecaa-45c9-986b-ae773030cb4e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:52.248240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-45dd7399-14ec-4963-8619-83f98bf45fd7 req-07ea476f-ecaa-45c9-986b-ae773030cb4e service nova] Creating event network-changed:1097e6b8-3b63-4bbe-9ad8-f070202698fd for instance ab0715c8-e967-444f-bb46-6e5043791203 on n-h2-844627-10 Aug 04 14:03:52.249987 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-45dd7399-14ec-4963-8619-83f98bf45fd7 req-07ea476f-ecaa-45c9-986b-ae773030cb4e service nova] Creating event network-changed:ecfd3a75-5d1b-4c2a-9299-4dd1c69e9faa for instance 1204865f-4b5f-41f3-8f2c-27f15aaa938e on n-h1-844627-10 Aug 04 14:03:52.261524 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-45dd7399-14ec-4963-8619-83f98bf45fd7 req-07ea476f-ecaa-45c9-986b-ae773030cb4e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.071757 Aug 04 14:03:52.262484 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1099/2177] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:52.269806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d8e8f994-e699-4f6f-b823-cfbf0b61b11e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3fb40d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:52.329194 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d8e8f994-e699-4f6f-b823-cfbf0b61b11e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.065147 Aug 04 14:03:52.330895 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1100/2178] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:52 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:52.337234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f7f21104-b4e3-4fa7-a90f-1d163e682eb2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:52.338492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f7f21104-b4e3-4fa7-a90f-1d163e682eb2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:52.357355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7f21104-b4e3-4fa7-a90f-1d163e682eb2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:52.358021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7f21104-b4e3-4fa7-a90f-1d163e682eb2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:52.358979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7f21104-b4e3-4fa7-a90f-1d163e682eb2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:52.359657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7f21104-b4e3-4fa7-a90f-1d163e682eb2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:52.739464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-79b01521-166f-4439-9cd8-d9b8414045a8 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:52.759643 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-79b01521-166f-4439-9cd8-d9b8414045a8 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 1.312111 Aug 04 14:03:52.761470 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1079/2179] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:51 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:52.774498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-17349d9a-be5e-4121-9eac-bd6994383723 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:52.775498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-17349d9a-be5e-4121-9eac-bd6994383723 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:52.787807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17349d9a-be5e-4121-9eac-bd6994383723 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:52.788741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17349d9a-be5e-4121-9eac-bd6994383723 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:52.789891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17349d9a-be5e-4121-9eac-bd6994383723 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:52.790599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17349d9a-be5e-4121-9eac-bd6994383723 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:52.951577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-17349d9a-be5e-4121-9eac-bd6994383723 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:52.963685 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-17349d9a-be5e-4121-9eac-bd6994383723 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1274 microversion: 2.1 time: 0.199469 Aug 04 14:03:52.965513 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1080/2180] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:52 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:53.106951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f7f21104-b4e3-4fa7-a90f-1d163e682eb2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:53.120122 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f7f21104-b4e3-4fa7-a90f-1d163e682eb2 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1467 microversion: 2.1 time: 0.787434 Aug 04 14:03:53.127574 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1101/2181] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:52 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1467 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:53.152478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fd6d12fe-72df-4566-999a-49a1d56216d2 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:53.153488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fd6d12fe-72df-4566-999a-49a1d56216d2 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:53.170577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd6d12fe-72df-4566-999a-49a1d56216d2 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:53.171735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd6d12fe-72df-4566-999a-49a1d56216d2 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:53.173124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd6d12fe-72df-4566-999a-49a1d56216d2 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:53.173809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd6d12fe-72df-4566-999a-49a1d56216d2 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:53.346633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-956d0c74-c1d1-40d7-b5c0-cbb9c0445812 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3fb40d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:53.458146 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-956d0c74-c1d1-40d7-b5c0-cbb9c0445812 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.115667 Aug 04 14:03:53.464390 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1102/2182] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:53 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:53.560295 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fd6d12fe-72df-4566-999a-49a1d56216d2 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1620 microversion: 2.1 time: 0.412326 Aug 04 14:03:53.564958 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1081/2183] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:53 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1620 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:53.697548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1261430879", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7984a6d3-8edb-45ab-a340-bc9df16df6f3"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:53.770090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:03:53.789470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-deb6992f-4491-4992-9c0b-67a7f4808cf0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:53.790853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-deb6992f-4491-4992-9c0b-67a7f4808cf0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:53.798849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb6992f-4491-4992-9c0b-67a7f4808cf0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:53.800726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb6992f-4491-4992-9c0b-67a7f4808cf0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:53.801875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb6992f-4491-4992-9c0b-67a7f4808cf0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:53.802528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deb6992f-4491-4992-9c0b-67a7f4808cf0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:54.178990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-deb6992f-4491-4992-9c0b-67a7f4808cf0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:54.192173 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-deb6992f-4491-4992-9c0b-67a7f4808cf0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 0.408810 Aug 04 14:03:54.206511 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1082/2184] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:53 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:54.209140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c8b01e98-529c-41bb-a9c7-b5da21e5341a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:54.212899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c8b01e98-529c-41bb-a9c7-b5da21e5341a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:54.218563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8b01e98-529c-41bb-a9c7-b5da21e5341a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:54.219234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8b01e98-529c-41bb-a9c7-b5da21e5341a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:54.221110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8b01e98-529c-41bb-a9c7-b5da21e5341a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:54.221734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8b01e98-529c-41bb-a9c7-b5da21e5341a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:54.371774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:03:54.373731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:03:54.374869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:03:54.375770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:03:54.376651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:03:54.410188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:54.410987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:54.412318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:54.413065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:54.435351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c8b01e98-529c-41bb-a9c7-b5da21e5341a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:54.447605 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c8b01e98-529c-41bb-a9c7-b5da21e5341a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.242457 Aug 04 14:03:54.452858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:03:54.461921 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1083/2185] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:54 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:54.466445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Getting quotas for user 5674b62dd99144ab9663d24b0762c907 and project ac3308acf403461d902ba64604e3382e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:03:54.480514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-66ab9273-0ac7-410f-bf0b-098eda84687a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f38ccd30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:54.485966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:03:54.488558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:03:54.552741 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-66ab9273-0ac7-410f-bf0b-098eda84687a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.077204 Aug 04 14:03:54.554224 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1084/2186] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:54 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:54.581613 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c7469e5-f59a-4415-9a07-ff49470a0bfc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888192 Aug 04 14:03:54.582601 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1103/2187] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:03:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:03:54.594728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac7e6ed0-5478-4b99-88c6-2566b9fe1c53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:54.595343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac7e6ed0-5478-4b99-88c6-2566b9fe1c53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:54.602773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:03:54.726113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac7e6ed0-5478-4b99-88c6-2566b9fe1c53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:54.761946 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac7e6ed0-5478-4b99-88c6-2566b9fe1c53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1217 microversion: 2.1 time: 0.171518 Aug 04 14:03:54.762560 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1085/2188] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:54 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:55.215377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-948d0e66-083e-4ad6-ae49-6a197214fff9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:55.216008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-948d0e66-083e-4ad6-ae49-6a197214fff9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:55.226881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-948d0e66-083e-4ad6-ae49-6a197214fff9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:55.228354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-948d0e66-083e-4ad6-ae49-6a197214fff9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:55.229246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-948d0e66-083e-4ad6-ae49-6a197214fff9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:55.229873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-948d0e66-083e-4ad6-ae49-6a197214fff9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:55.475466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-948d0e66-083e-4ad6-ae49-6a197214fff9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:55.478030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-019608a0-150f-45f6-8d72-6f09bfe8509a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:55.478821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-019608a0-150f-45f6-8d72-6f09bfe8509a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:55.502242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-019608a0-150f-45f6-8d72-6f09bfe8509a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:55.503096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-019608a0-150f-45f6-8d72-6f09bfe8509a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:55.504218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-019608a0-150f-45f6-8d72-6f09bfe8509a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:55.505145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-019608a0-150f-45f6-8d72-6f09bfe8509a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:55.507340 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-948d0e66-083e-4ad6-ae49-6a197214fff9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 0.296235 Aug 04 14:03:55.530444 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1104/2189] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:55 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:55.717587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-39cd664a-426a-4591-8c49-a1f7a1b9a6a5 req-fbdc3cbc-5f07-49d6-b93e-8d7de369b956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e295fc-0888-455d-b1b2-24d11d238044", "name": "network-vif-plugged", "status": "completed", "tag": "f72015d3-8ae8-43ae-8514-488809548829"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:55.734038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-39cd664a-426a-4591-8c49-a1f7a1b9a6a5 req-fbdc3cbc-5f07-49d6-b93e-8d7de369b956 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:55.734701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-39cd664a-426a-4591-8c49-a1f7a1b9a6a5 req-fbdc3cbc-5f07-49d6-b93e-8d7de369b956 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:55.759469 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-39cd664a-426a-4591-8c49-a1f7a1b9a6a5 req-fbdc3cbc-5f07-49d6-b93e-8d7de369b956 service nova] Creating event network-vif-plugged:f72015d3-8ae8-43ae-8514-488809548829 for instance c1e295fc-0888-455d-b1b2-24d11d238044 on n-h2-844627-10 Aug 04 14:03:55.768969 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-39cd664a-426a-4591-8c49-a1f7a1b9a6a5 req-fbdc3cbc-5f07-49d6-b93e-8d7de369b956 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236342 Aug 04 14:03:55.771792 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1105/2190] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:55.790905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-44e2c8a0-4874-4718-ba5b-2cbc23cc63d5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47056d7e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:55.870679 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-44e2c8a0-4874-4718-ba5b-2cbc23cc63d5 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.093290 Aug 04 14:03:55.871797 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1106/2191] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:55 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:55.889300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ac3b38b-eac2-4107-a9cc-cf92f60242d8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:55.891167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0ac3b38b-eac2-4107-a9cc-cf92f60242d8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:55.922130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac3b38b-eac2-4107-a9cc-cf92f60242d8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:55.923210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac3b38b-eac2-4107-a9cc-cf92f60242d8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:55.924812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac3b38b-eac2-4107-a9cc-cf92f60242d8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:55.925493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac3b38b-eac2-4107-a9cc-cf92f60242d8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:56.111915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-019608a0-150f-45f6-8d72-6f09bfe8509a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:56.124347 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-019608a0-150f-45f6-8d72-6f09bfe8509a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.657058 Aug 04 14:03:56.125082 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1086/2192] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:55 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:56.159232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0ac3b38b-eac2-4107-a9cc-cf92f60242d8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:56.174347 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0ac3b38b-eac2-4107-a9cc-cf92f60242d8 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1213 microversion: 2.1 time: 0.300178 Aug 04 14:03:56.191508 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1107/2193] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:55 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1213 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:56.555261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b0399a36-a22c-4ac0-9ba7-28eb6ac49ae6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:56.556682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b0399a36-a22c-4ac0-9ba7-28eb6ac49ae6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:56.572095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0399a36-a22c-4ac0-9ba7-28eb6ac49ae6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:56.576921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0399a36-a22c-4ac0-9ba7-28eb6ac49ae6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:56.578457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0399a36-a22c-4ac0-9ba7-28eb6ac49ae6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:56.579155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0399a36-a22c-4ac0-9ba7-28eb6ac49ae6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:56.889003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d8f9804-a712-4e69-8ea4-4b3d7177b138 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3fb4160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:56.992335 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d8f9804-a712-4e69-8ea4-4b3d7177b138 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.109736 Aug 04 14:03:56.993555 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1108/2194] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:56 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:57.146541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c2c22f4c-4269-4b0c-bb32-7ef7955caa78 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:57.147196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c2c22f4c-4269-4b0c-bb32-7ef7955caa78 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:57.181496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2c22f4c-4269-4b0c-bb32-7ef7955caa78 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:57.182702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2c22f4c-4269-4b0c-bb32-7ef7955caa78 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:57.184412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2c22f4c-4269-4b0c-bb32-7ef7955caa78 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:57.185603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2c22f4c-4269-4b0c-bb32-7ef7955caa78 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:57.206599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b0399a36-a22c-4ac0-9ba7-28eb6ac49ae6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:57.231324 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b0399a36-a22c-4ac0-9ba7-28eb6ac49ae6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 0.681202 Aug 04 14:03:57.248424 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1087/2195] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:56 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:57.256689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e69ca327-0ae5-4571-ab05-66519fb3ac17 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:57.260233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e69ca327-0ae5-4571-ab05-66519fb3ac17 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:57.267991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e69ca327-0ae5-4571-ab05-66519fb3ac17 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:57.269106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e69ca327-0ae5-4571-ab05-66519fb3ac17 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:57.270185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e69ca327-0ae5-4571-ab05-66519fb3ac17 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:57.282711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e69ca327-0ae5-4571-ab05-66519fb3ac17 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:57.438477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e69ca327-0ae5-4571-ab05-66519fb3ac17 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:57.457046 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e69ca327-0ae5-4571-ab05-66519fb3ac17 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1275 microversion: 2.1 time: 0.206550 Aug 04 14:03:57.476939 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1088/2196] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:57 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:57.508265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-4d2975e6-77bf-422b-8ec9-ca114b22af56 req-9510b9fc-4076-4851-90e1-a18416488cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffff8320-14dc-48bb-bc34-edaafdc741a5", "tag": "ba538cbc-fc43-4471-ad91-b07277b3aa1e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:03:57.541217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4d2975e6-77bf-422b-8ec9-ca114b22af56 req-9510b9fc-4076-4851-90e1-a18416488cbc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:57.542359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4d2975e6-77bf-422b-8ec9-ca114b22af56 req-9510b9fc-4076-4851-90e1-a18416488cbc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:57.576585 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-4d2975e6-77bf-422b-8ec9-ca114b22af56 req-9510b9fc-4076-4851-90e1-a18416488cbc service nova] Creating event network-changed:ba538cbc-fc43-4471-ad91-b07277b3aa1e for instance ffff8320-14dc-48bb-bc34-edaafdc741a5 on n-h1-844627-10 Aug 04 14:03:57.590973 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-4d2975e6-77bf-422b-8ec9-ca114b22af56 req-9510b9fc-4076-4851-90e1-a18416488cbc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099859 Aug 04 14:03:57.592124 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1089/2197] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:03:57.630798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c2c22f4c-4269-4b0c-bb32-7ef7955caa78 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:57.644081 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c2c22f4c-4269-4b0c-bb32-7ef7955caa78 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.501643 Aug 04 14:03:57.657471 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1109/2198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:57 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:03:58.009251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2637a571-eeba-48fd-9f66-392ab3cd0278 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3926b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:58.065051 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2637a571-eeba-48fd-9f66-392ab3cd0278 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.060676 Aug 04 14:03:58.073901 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1090/2199] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:58 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:58.253757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-77cfd9cc-742c-4407-91ff-4ab63d8a34d6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:58.255175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-77cfd9cc-742c-4407-91ff-4ab63d8a34d6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:58.262867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77cfd9cc-742c-4407-91ff-4ab63d8a34d6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:58.263564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77cfd9cc-742c-4407-91ff-4ab63d8a34d6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:58.264535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77cfd9cc-742c-4407-91ff-4ab63d8a34d6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:58.265279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77cfd9cc-742c-4407-91ff-4ab63d8a34d6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:58.514378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-68338248-d6b0-4ad3-b283-8fe66666e5be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:58.515527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-68338248-d6b0-4ad3-b283-8fe66666e5be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:58.530080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68338248-d6b0-4ad3-b283-8fe66666e5be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:58.534235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68338248-d6b0-4ad3-b283-8fe66666e5be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:58.544833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68338248-d6b0-4ad3-b283-8fe66666e5be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:58.546205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68338248-d6b0-4ad3-b283-8fe66666e5be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:59.420771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-77cfd9cc-742c-4407-91ff-4ab63d8a34d6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:59.438116 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-77cfd9cc-742c-4407-91ff-4ab63d8a34d6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 1.188152 Aug 04 14:03:59.438919 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1110/2200] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:58 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:59.443969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-24808940-866c-4ce7-80dd-d18aec076a08 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:59.450071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-24808940-866c-4ce7-80dd-d18aec076a08 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:03:59.466955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24808940-866c-4ce7-80dd-d18aec076a08 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:59.467680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24808940-866c-4ce7-80dd-d18aec076a08 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:59.468892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24808940-866c-4ce7-80dd-d18aec076a08 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:03:59.469569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24808940-866c-4ce7-80dd-d18aec076a08 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:03:59.556377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-68338248-d6b0-4ad3-b283-8fe66666e5be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:03:59.604443 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-68338248-d6b0-4ad3-b283-8fe66666e5be tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 1.095297 Aug 04 14:03:59.608015 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1091/2201] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:58 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:03:59.637240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ef97c3e-780a-430a-8140-e267c7d12696 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3930ee0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:03:59.803995 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ef97c3e-780a-430a-8140-e267c7d12696 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.193064 Aug 04 14:03:59.807018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1092/2202] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:03:59 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:00.024659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-24808940-866c-4ce7-80dd-d18aec076a08 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:00.042230 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-24808940-866c-4ce7-80dd-d18aec076a08 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.601813 Aug 04 14:04:00.058236 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1111/2203] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:03:59 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:00.464325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64ed788f-cb73-45c4-a332-97cc3289a5ce tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:00.465162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64ed788f-cb73-45c4-a332-97cc3289a5ce tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:00.480007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64ed788f-cb73-45c4-a332-97cc3289a5ce tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:00.480899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64ed788f-cb73-45c4-a332-97cc3289a5ce tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:00.482146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64ed788f-cb73-45c4-a332-97cc3289a5ce tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:00.482751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64ed788f-cb73-45c4-a332-97cc3289a5ce tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:00.492588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:00.685625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5e80e71-d4fc-4ad6-b175-1aec2a330edb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:00.686579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d5e80e71-d4fc-4ad6-b175-1aec2a330edb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:00.730594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5e80e71-d4fc-4ad6-b175-1aec2a330edb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:00.732159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5e80e71-d4fc-4ad6-b175-1aec2a330edb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:00.734367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5e80e71-d4fc-4ad6-b175-1aec2a330edb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:00.735442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5e80e71-d4fc-4ad6-b175-1aec2a330edb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:01.292022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-64ed788f-cb73-45c4-a332-97cc3289a5ce tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:01.302634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d5e80e71-d4fc-4ad6-b175-1aec2a330edb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:01.308831 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-64ed788f-cb73-45c4-a332-97cc3289a5ce tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 0.852473 Aug 04 14:04:01.310689 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1093/2204] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:00 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:01.315483 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d5e80e71-d4fc-4ad6-b175-1aec2a330edb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 0.662837 Aug 04 14:04:01.317959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae4be111-f74f-4a1f-9e84-6199caff2d14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f38d5280>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:01.327325 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1112/2205] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:00 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:01.338692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0be89641-a8df-4657-a26a-e13dfc244d07 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:01.339323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0be89641-a8df-4657-a26a-e13dfc244d07 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:01.358922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be89641-a8df-4657-a26a-e13dfc244d07 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:01.359393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be89641-a8df-4657-a26a-e13dfc244d07 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:01.360285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be89641-a8df-4657-a26a-e13dfc244d07 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:01.360781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be89641-a8df-4657-a26a-e13dfc244d07 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:01.416139 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae4be111-f74f-4a1f-9e84-6199caff2d14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.102468 Aug 04 14:04:01.416920 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1094/2206] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:01 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:01.433323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-03b387b3-69ae-44c4-9530-583ad0e85f64 req-23b005ec-1d24-44ba-ba26-1d59dd041c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7a6c65-5f80-48bb-a324-23c01af35738", "name": "network-vif-plugged", "status": "completed", "tag": "847a36f8-843d-46a5-9321-5c09ee823490"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:01.464375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-03b387b3-69ae-44c4-9530-583ad0e85f64 req-23b005ec-1d24-44ba-ba26-1d59dd041c78 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:01.466188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-03b387b3-69ae-44c4-9530-583ad0e85f64 req-23b005ec-1d24-44ba-ba26-1d59dd041c78 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:01.481953 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-03b387b3-69ae-44c4-9530-583ad0e85f64 req-23b005ec-1d24-44ba-ba26-1d59dd041c78 service nova] Creating event network-vif-plugged:847a36f8-843d-46a5-9321-5c09ee823490 for instance 4f7a6c65-5f80-48bb-a324-23c01af35738 on n-h1-844627-10 Aug 04 14:04:01.489233 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-03b387b3-69ae-44c4-9530-583ad0e85f64 req-23b005ec-1d24-44ba-ba26-1d59dd041c78 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059669 Aug 04 14:04:01.490109 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1095/2207] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:01.780276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0be89641-a8df-4657-a26a-e13dfc244d07 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:01.791431 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0be89641-a8df-4657-a26a-e13dfc244d07 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.457229 Aug 04 14:04:01.797181 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1113/2208] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:01 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:01.994322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a144c261-ff06-4479-820d-339a799ddf81 req-c22043ce-2082-44c5-a2d8-903f2a091081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f8971b-488d-4f79-aabb-16c5e68290dc", "tag": "5d6f6d60-d9c1-4e53-9a9b-a07468882b74"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:02.005102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a144c261-ff06-4479-820d-339a799ddf81 req-c22043ce-2082-44c5-a2d8-903f2a091081 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:02.005444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a144c261-ff06-4479-820d-339a799ddf81 req-c22043ce-2082-44c5-a2d8-903f2a091081 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:02.020583 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a144c261-ff06-4479-820d-339a799ddf81 req-c22043ce-2082-44c5-a2d8-903f2a091081 service nova] Creating event network-changed:5d6f6d60-d9c1-4e53-9a9b-a07468882b74 for instance 05f8971b-488d-4f79-aabb-16c5e68290dc on n-h1-844627-10 Aug 04 14:04:02.026213 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a144c261-ff06-4479-820d-339a799ddf81 req-c22043ce-2082-44c5-a2d8-903f2a091081 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038084 Aug 04 14:04:02.026848 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1096/2209] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:04:02.369760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5950e98f-35be-4df0-8918-3320324700c2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:02.371369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9e0a5241-95bc-4c00-a4ea-e5b32790aec4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:02.375915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5950e98f-35be-4df0-8918-3320324700c2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:02.378417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9e0a5241-95bc-4c00-a4ea-e5b32790aec4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:02.409456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5950e98f-35be-4df0-8918-3320324700c2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:02.410931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5950e98f-35be-4df0-8918-3320324700c2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:02.411333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e0a5241-95bc-4c00-a4ea-e5b32790aec4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:02.415105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e0a5241-95bc-4c00-a4ea-e5b32790aec4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:02.415443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5950e98f-35be-4df0-8918-3320324700c2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:02.416033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5950e98f-35be-4df0-8918-3320324700c2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:02.416813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e0a5241-95bc-4c00-a4ea-e5b32790aec4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:02.417872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e0a5241-95bc-4c00-a4ea-e5b32790aec4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:03.439197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5950e98f-35be-4df0-8918-3320324700c2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:03.453784 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5950e98f-35be-4df0-8918-3320324700c2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 1.120962 Aug 04 14:04:03.455434 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1114/2210] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:02 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:03.468559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8dea583f-7db5-48b2-b65d-887f552e6faf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f470567a550>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:03.555764 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8dea583f-7db5-48b2-b65d-887f552e6faf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.097788 Aug 04 14:04:03.558056 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1115/2211] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:03 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:03.574222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61515510-eebb-4e3b-a04f-2c6164e26591 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:03.575008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61515510-eebb-4e3b-a04f-2c6164e26591 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:03.588415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61515510-eebb-4e3b-a04f-2c6164e26591 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:03.589782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61515510-eebb-4e3b-a04f-2c6164e26591 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:03.590771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61515510-eebb-4e3b-a04f-2c6164e26591 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:03.591373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61515510-eebb-4e3b-a04f-2c6164e26591 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:03.630671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:03.663530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9e0a5241-95bc-4c00-a4ea-e5b32790aec4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:03.677467 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9e0a5241-95bc-4c00-a4ea-e5b32790aec4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 1.336134 Aug 04 14:04:03.678515 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1097/2212] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:02 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:03.693156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-9a10cba1-2058-4f7a-8d65-4b23686dac15 req-c4e70058-fded-4b75-9654-6fe6eae09a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0715c8-e967-444f-bb46-6e5043791203", "name": "network-vif-plugged", "status": "completed", "tag": "1097e6b8-3b63-4bbe-9ad8-f070202698fd"}, {"server_uuid": "1204865f-4b5f-41f3-8f2c-27f15aaa938e", "name": "network-vif-plugged", "status": "completed", "tag": "ecfd3a75-5d1b-4c2a-9299-4dd1c69e9faa"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:03.706568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9a10cba1-2058-4f7a-8d65-4b23686dac15 req-c4e70058-fded-4b75-9654-6fe6eae09a1c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:03.707330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9a10cba1-2058-4f7a-8d65-4b23686dac15 req-c4e70058-fded-4b75-9654-6fe6eae09a1c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:03.726043 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9a10cba1-2058-4f7a-8d65-4b23686dac15 req-c4e70058-fded-4b75-9654-6fe6eae09a1c service nova] Creating event network-vif-plugged:1097e6b8-3b63-4bbe-9ad8-f070202698fd for instance ab0715c8-e967-444f-bb46-6e5043791203 on n-h2-844627-10 Aug 04 14:04:03.727454 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9a10cba1-2058-4f7a-8d65-4b23686dac15 req-c4e70058-fded-4b75-9654-6fe6eae09a1c service nova] Creating event network-vif-plugged:ecfd3a75-5d1b-4c2a-9299-4dd1c69e9faa for instance 1204865f-4b5f-41f3-8f2c-27f15aaa938e on n-h1-844627-10 Aug 04 14:04:03.740028 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-9a10cba1-2058-4f7a-8d65-4b23686dac15 req-c4e70058-fded-4b75-9654-6fe6eae09a1c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060546 Aug 04 14:04:03.741465 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1098/2213] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:04.232936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61515510-eebb-4e3b-a04f-2c6164e26591 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:04.249756 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61515510-eebb-4e3b-a04f-2c6164e26591 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.690282 Aug 04 14:04:04.250594 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1116/2214] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:03 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:04.478780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-578a61f8-2744-4ccd-8ffc-f2706a3856f6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:04.479943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-578a61f8-2744-4ccd-8ffc-f2706a3856f6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:04.492107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-578a61f8-2744-4ccd-8ffc-f2706a3856f6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:04.492844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-578a61f8-2744-4ccd-8ffc-f2706a3856f6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:04.497801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-578a61f8-2744-4ccd-8ffc-f2706a3856f6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:04.498536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-578a61f8-2744-4ccd-8ffc-f2706a3856f6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:04.584943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d285225f-0793-48d5-a2b3-08097f229459 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f39eadc0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:04.617119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:04.628270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:04.749158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:04.833181 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d285225f-0793-48d5-a2b3-08097f229459 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.256336 Aug 04 14:04:04.839825 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1117/2215] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:04 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:04.865791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-329d9e4a-62fc-40b5-a3cf-8edb9b62771c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:04.872380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-329d9e4a-62fc-40b5-a3cf-8edb9b62771c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:04.926382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-329d9e4a-62fc-40b5-a3cf-8edb9b62771c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:04.927594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-329d9e4a-62fc-40b5-a3cf-8edb9b62771c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:04.930150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-329d9e4a-62fc-40b5-a3cf-8edb9b62771c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:04.940370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-329d9e4a-62fc-40b5-a3cf-8edb9b62771c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:05.278489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-578a61f8-2744-4ccd-8ffc-f2706a3856f6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:05.305308 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-578a61f8-2744-4ccd-8ffc-f2706a3856f6 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 0.832377 Aug 04 14:04:05.306373 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1099/2216] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:04 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:05.352825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a27d327-5a82-4419-b247-3fdaaee15431 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:05.358485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3a27d327-5a82-4419-b247-3fdaaee15431 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:05.384491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a27d327-5a82-4419-b247-3fdaaee15431 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:05.391311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a27d327-5a82-4419-b247-3fdaaee15431 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:05.393597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a27d327-5a82-4419-b247-3fdaaee15431 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:05.411351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a27d327-5a82-4419-b247-3fdaaee15431 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:06.037262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3a27d327-5a82-4419-b247-3fdaaee15431 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:06.093054 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a27d327-5a82-4419-b247-3fdaaee15431 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.750480 Aug 04 14:04:06.094243 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1100/2217] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:05 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:06.133284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2e4dd93-0ef5-412b-ab03-a5281253223c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3a8b4c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:06.232767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-329d9e4a-62fc-40b5-a3cf-8edb9b62771c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:06.271592 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-329d9e4a-62fc-40b5-a3cf-8edb9b62771c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 1.429470 Aug 04 14:04:06.286448 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1118/2218] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:04 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:06.355740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-863f3352-87e5-4fa4-839c-99b7797a407f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:06.362012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-863f3352-87e5-4fa4-839c-99b7797a407f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:06.385392 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2e4dd93-0ef5-412b-ab03-a5281253223c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.281120 Aug 04 14:04:06.404525 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1101/2219] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:06 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:06.408743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-863f3352-87e5-4fa4-839c-99b7797a407f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:06.425354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-863f3352-87e5-4fa4-839c-99b7797a407f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:06.430280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-863f3352-87e5-4fa4-839c-99b7797a407f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:06.431623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-863f3352-87e5-4fa4-839c-99b7797a407f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:07.056312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-863f3352-87e5-4fa4-839c-99b7797a407f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:07.070375 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-863f3352-87e5-4fa4-839c-99b7797a407f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1323 microversion: 2.1 time: 0.724418 Aug 04 14:04:07.074318 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1119/2220] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:06 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1323 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:07.125739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1e5166ef-28ba-468d-a89a-99fc19f628f7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:07.129155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1e5166ef-28ba-468d-a89a-99fc19f628f7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:07.199289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e5166ef-28ba-468d-a89a-99fc19f628f7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:07.204899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e5166ef-28ba-468d-a89a-99fc19f628f7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:07.206593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e5166ef-28ba-468d-a89a-99fc19f628f7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:07.207455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e5166ef-28ba-468d-a89a-99fc19f628f7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:07.307779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f7599f47-7c66-4230-a4dc-7ea5c482bae4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:07.309770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f7599f47-7c66-4230-a4dc-7ea5c482bae4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:07.331896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7599f47-7c66-4230-a4dc-7ea5c482bae4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:07.332837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7599f47-7c66-4230-a4dc-7ea5c482bae4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:07.334438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7599f47-7c66-4230-a4dc-7ea5c482bae4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:07.336968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7599f47-7c66-4230-a4dc-7ea5c482bae4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:09.169851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1e5166ef-28ba-468d-a89a-99fc19f628f7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:09.192001 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1e5166ef-28ba-468d-a89a-99fc19f628f7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 2.078900 Aug 04 14:04:09.194030 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1102/2221] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:07 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:09.204457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3920d76-f6e1-47c2-84ad-a0bf86ad6f9c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3a8bc10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:09.356390 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3920d76-f6e1-47c2-84ad-a0bf86ad6f9c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.160080 Aug 04 14:04:09.374161 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1103/2222] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:09 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:09.409669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2dd34298-7144-4f49-a0ae-540853c58981 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:09.413061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2dd34298-7144-4f49-a0ae-540853c58981 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:09.451109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2dd34298-7144-4f49-a0ae-540853c58981 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:09.454255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2dd34298-7144-4f49-a0ae-540853c58981 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:09.458226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2dd34298-7144-4f49-a0ae-540853c58981 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:09.469208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2dd34298-7144-4f49-a0ae-540853c58981 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:09.669206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f7599f47-7c66-4230-a4dc-7ea5c482bae4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:09.774763 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f7599f47-7c66-4230-a4dc-7ea5c482bae4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 2.471840 Aug 04 14:04:09.792108 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1120/2223] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:07 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:09.814709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a07cf01d-0f24-4b9b-a582-d832d2f95d94 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:09.815692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a07cf01d-0f24-4b9b-a582-d832d2f95d94 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:09.825567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a07cf01d-0f24-4b9b-a582-d832d2f95d94 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:09.826340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a07cf01d-0f24-4b9b-a582-d832d2f95d94 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:09.827254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a07cf01d-0f24-4b9b-a582-d832d2f95d94 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:09.827714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a07cf01d-0f24-4b9b-a582-d832d2f95d94 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:10.260321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2dd34298-7144-4f49-a0ae-540853c58981 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:10.299720 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2dd34298-7144-4f49-a0ae-540853c58981 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 200 len: 1517 microversion: 2.1 time: 0.923488 Aug 04 14:04:10.305858 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1104/2224] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:09 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 1517 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:10.315898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-76a95dfd-445f-4252-92d3-21072b0eeb3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:10.317645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-76a95dfd-445f-4252-92d3-21072b0eeb3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:10.332473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76a95dfd-445f-4252-92d3-21072b0eeb3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:10.338221 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a07cf01d-0f24-4b9b-a582-d832d2f95d94 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1816 microversion: 2.1 time: 0.544150 Aug 04 14:04:10.339830 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1121/2225] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:09 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1816 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:10.341920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76a95dfd-445f-4252-92d3-21072b0eeb3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:10.343736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76a95dfd-445f-4252-92d3-21072b0eeb3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:10.351965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76a95dfd-445f-4252-92d3-21072b0eeb3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:10.356233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8aa27048-b220-4566-9d72-77051b900507 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:10.357843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8aa27048-b220-4566-9d72-77051b900507 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: ab0715c8-e967-444f-bb46-6e5043791203] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:10.393380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8aa27048-b220-4566-9d72-77051b900507 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:10.394517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8aa27048-b220-4566-9d72-77051b900507 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:10.396984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8aa27048-b220-4566-9d72-77051b900507 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:10.402950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8aa27048-b220-4566-9d72-77051b900507 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:11.094115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8aa27048-b220-4566-9d72-77051b900507 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:11.128167 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8aa27048-b220-4566-9d72-77051b900507 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203" status: 200 len: 1517 microversion: 2.1 time: 0.781710 Aug 04 14:04:11.157481 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1122/2226] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:10 2022] GET /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203 => generated 1517 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:11.172004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-844e8205-fc44-4a8c-a99b-def6740b1d48 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:11.183601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-76a95dfd-445f-4252-92d3-21072b0eeb3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:11.193994 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:04:11.193994 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:04:11.200323 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-76a95dfd-445f-4252-92d3-21072b0eeb3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.886646 Aug 04 14:04:11.201018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1105/2227] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:10 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:11.230412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc14a2fc-3f07-427d-8620-8bed42d44605 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3a84a60>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:11.231137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-844e8205-fc44-4a8c-a99b-def6740b1d48 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:11.232383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-844e8205-fc44-4a8c-a99b-def6740b1d48 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:11.234383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-844e8205-fc44-4a8c-a99b-def6740b1d48 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:11.235556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-844e8205-fc44-4a8c-a99b-def6740b1d48 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:11.298965 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-844e8205-fc44-4a8c-a99b-def6740b1d48 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.139605 Aug 04 14:04:11.325230 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc14a2fc-3f07-427d-8620-8bed42d44605 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.112328 Aug 04 14:04:11.325230 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1106/2228] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:11 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:11.325867 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1123/2229] 10.222.0.66 () {58 vars in 1176 bytes} [Thu Aug 4 14:04:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:11.329980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02b9d195-2466-4059-b3a4-c659195bfc1d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:11.331165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-02b9d195-2466-4059-b3a4-c659195bfc1d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:11.343260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02b9d195-2466-4059-b3a4-c659195bfc1d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:11.344074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02b9d195-2466-4059-b3a4-c659195bfc1d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:11.346104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-87d72987-fde6-48c2-8dc8-d0a53968f10a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:11.346782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-87d72987-fde6-48c2-8dc8-d0a53968f10a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:11.352718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02b9d195-2466-4059-b3a4-c659195bfc1d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:11.353789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02b9d195-2466-4059-b3a4-c659195bfc1d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:11.375288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87d72987-fde6-48c2-8dc8-d0a53968f10a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:11.375750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87d72987-fde6-48c2-8dc8-d0a53968f10a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:11.376566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87d72987-fde6-48c2-8dc8-d0a53968f10a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:11.377042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87d72987-fde6-48c2-8dc8-d0a53968f10a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:11.897889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-02b9d195-2466-4059-b3a4-c659195bfc1d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:11.923706 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-02b9d195-2466-4059-b3a4-c659195bfc1d tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044" status: 200 len: 1516 microversion: 2.1 time: 0.600789 Aug 04 14:04:11.946121 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1124/2230] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:11 2022] GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 => generated 1516 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:11.991287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5699914b-065d-43c2-ae25-8fd2a27baa2a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:12.002187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5699914b-065d-43c2-ae25-8fd2a27baa2a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:12.027423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5699914b-065d-43c2-ae25-8fd2a27baa2a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:12.041753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5699914b-065d-43c2-ae25-8fd2a27baa2a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:12.046431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5699914b-065d-43c2-ae25-8fd2a27baa2a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:12.047779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-87d72987-fde6-48c2-8dc8-d0a53968f10a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:12.049440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5699914b-065d-43c2-ae25-8fd2a27baa2a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:12.073541 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-87d72987-fde6-48c2-8dc8-d0a53968f10a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 0.749342 Aug 04 14:04:12.075668 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1107/2231] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:11 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:12.196649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5699914b-065d-43c2-ae25-8fd2a27baa2a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:12.245560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19c7ad75-4c07-4d63-b8ac-0860b3df482d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:12.246318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-19c7ad75-4c07-4d63-b8ac-0860b3df482d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:12.256122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19c7ad75-4c07-4d63-b8ac-0860b3df482d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:12.256936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19c7ad75-4c07-4d63-b8ac-0860b3df482d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:12.258010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19c7ad75-4c07-4d63-b8ac-0860b3df482d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:12.258636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19c7ad75-4c07-4d63-b8ac-0860b3df482d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:12.497352 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5699914b-065d-43c2-ae25-8fd2a27baa2a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044" status: 204 len: 0 microversion: 2.1 time: 0.528938 Aug 04 14:04:12.504594 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1125/2232] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:11 2022] DELETE /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:12.519804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0a4478dd-109a-4387-98ee-4b955348e27f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3fb4c10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:12.619188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-19c7ad75-4c07-4d63-b8ac-0860b3df482d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:12.633197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0a4478dd-109a-4387-98ee-4b955348e27f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.123826 Aug 04 14:04:12.641232 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1126/2233] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:12 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:12.644791 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-19c7ad75-4c07-4d63-b8ac-0860b3df482d tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.410696 Aug 04 14:04:12.646035 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1108/2234] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:12 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:12.660241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c125997-89cb-4bbf-8b1b-1f69c876459a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:12.662576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c125997-89cb-4bbf-8b1b-1f69c876459a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:12.686613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:12.700045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c125997-89cb-4bbf-8b1b-1f69c876459a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:12.701158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c125997-89cb-4bbf-8b1b-1f69c876459a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:12.702777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c125997-89cb-4bbf-8b1b-1f69c876459a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:12.703764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c125997-89cb-4bbf-8b1b-1f69c876459a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:13.099557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7708831a-53b7-4a2f-9412-f0ab1e7c00e9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:13.100517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7708831a-53b7-4a2f-9412-f0ab1e7c00e9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:13.113872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7708831a-53b7-4a2f-9412-f0ab1e7c00e9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:13.119565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7708831a-53b7-4a2f-9412-f0ab1e7c00e9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:13.120959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7708831a-53b7-4a2f-9412-f0ab1e7c00e9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:13.124252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7708831a-53b7-4a2f-9412-f0ab1e7c00e9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:13.156550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c125997-89cb-4bbf-8b1b-1f69c876459a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:13.177991 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c125997-89cb-4bbf-8b1b-1f69c876459a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044" status: 200 len: 1522 microversion: 2.1 time: 0.534213 Aug 04 14:04:13.180739 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1127/2235] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:12 2022] GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:13.187763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-06885aab-eb47-4751-a7f1-e31984933d07 req-598ca2c0-040b-4321-b85f-141f420e1075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffff8320-14dc-48bb-bc34-edaafdc741a5", "name": "network-vif-plugged", "status": "completed", "tag": "ba538cbc-fc43-4471-ad91-b07277b3aa1e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:13.244368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-06885aab-eb47-4751-a7f1-e31984933d07 req-598ca2c0-040b-4321-b85f-141f420e1075 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:13.246459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-06885aab-eb47-4751-a7f1-e31984933d07 req-598ca2c0-040b-4321-b85f-141f420e1075 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:13.360805 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-06885aab-eb47-4751-a7f1-e31984933d07 req-598ca2c0-040b-4321-b85f-141f420e1075 service nova] Creating event network-vif-plugged:ba538cbc-fc43-4471-ad91-b07277b3aa1e for instance ffff8320-14dc-48bb-bc34-edaafdc741a5 on n-h1-844627-10 Aug 04 14:04:13.401993 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-06885aab-eb47-4751-a7f1-e31984933d07 req-598ca2c0-040b-4321-b85f-141f420e1075 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218373 Aug 04 14:04:13.408776 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1128/2236] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:13.591127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7708831a-53b7-4a2f-9412-f0ab1e7c00e9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:13.614834 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7708831a-53b7-4a2f-9412-f0ab1e7c00e9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 0.520371 Aug 04 14:04:13.618094 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1109/2237] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:13 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:13.687670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-308ce372-7ec5-4bfe-be33-b7ebf01aed33 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f4700c67160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:13.702851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-096dd64e-a213-429d-bbbe-d4c3e32b57d5 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:13.703745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-096dd64e-a213-429d-bbbe-d4c3e32b57d5 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:13.726458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-096dd64e-a213-429d-bbbe-d4c3e32b57d5 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:13.727456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-096dd64e-a213-429d-bbbe-d4c3e32b57d5 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:13.732479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-096dd64e-a213-429d-bbbe-d4c3e32b57d5 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:13.733038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-096dd64e-a213-429d-bbbe-d4c3e32b57d5 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:13.838931 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-308ce372-7ec5-4bfe-be33-b7ebf01aed33 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.156493 Aug 04 14:04:13.839602 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1129/2238] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:13 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:14.220310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-71a860b0-9f2b-44f1-b2bf-bae3f32bbdae tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:14.221406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-71a860b0-9f2b-44f1-b2bf-bae3f32bbdae tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:14.237934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71a860b0-9f2b-44f1-b2bf-bae3f32bbdae tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:14.238175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-096dd64e-a213-429d-bbbe-d4c3e32b57d5 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:14.238401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71a860b0-9f2b-44f1-b2bf-bae3f32bbdae tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:14.244577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71a860b0-9f2b-44f1-b2bf-bae3f32bbdae tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:14.245647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71a860b0-9f2b-44f1-b2bf-bae3f32bbdae tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:14.252591 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-096dd64e-a213-429d-bbbe-d4c3e32b57d5 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.555344 Aug 04 14:04:14.253235 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1110/2239] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:13 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:14.652508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d12bb0f-50ce-4c5c-9e50-c00a2bf3b91e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:14.653826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3d12bb0f-50ce-4c5c-9e50-c00a2bf3b91e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:14.662096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d12bb0f-50ce-4c5c-9e50-c00a2bf3b91e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:14.663807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d12bb0f-50ce-4c5c-9e50-c00a2bf3b91e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:14.665054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d12bb0f-50ce-4c5c-9e50-c00a2bf3b91e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:14.666185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d12bb0f-50ce-4c5c-9e50-c00a2bf3b91e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:14.904137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-71a860b0-9f2b-44f1-b2bf-bae3f32bbdae tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:14.922079 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-71a860b0-9f2b-44f1-b2bf-bae3f32bbdae tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044" status: 200 len: 1522 microversion: 2.1 time: 0.708530 Aug 04 14:04:14.940462 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1130/2240] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:14 2022] GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:14.955817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70e0c05f-c36f-497c-b1a7-052d7ca06528 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f470547c700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:15.079796 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70e0c05f-c36f-497c-b1a7-052d7ca06528 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.136744 Aug 04 14:04:15.094789 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1131/2241] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:14 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:15.286106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3d12bb0f-50ce-4c5c-9e50-c00a2bf3b91e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:15.290406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e6a4bc6d-2c24-43b0-a681-fc71c7622069 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:15.291142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e6a4bc6d-2c24-43b0-a681-fc71c7622069 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:15.307983 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3d12bb0f-50ce-4c5c-9e50-c00a2bf3b91e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 0.657073 Aug 04 14:04:15.309627 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1111/2242] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:14 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:15.312574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6a4bc6d-2c24-43b0-a681-fc71c7622069 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:15.318485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6a4bc6d-2c24-43b0-a681-fc71c7622069 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:15.319470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6a4bc6d-2c24-43b0-a681-fc71c7622069 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:15.320023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6a4bc6d-2c24-43b0-a681-fc71c7622069 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:15.584641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8f396749-8518-4337-8e9b-ea776b0d51a5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f330167-1b84-4f27-a665-192515a0f018", "device": "/dev/xvdb"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:15.588314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8f396749-8518-4337-8e9b-ea776b0d51a5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:15.612602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8f396749-8518-4337-8e9b-ea776b0d51a5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:15.622769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8f396749-8518-4337-8e9b-ea776b0d51a5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:15.626359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8f396749-8518-4337-8e9b-ea776b0d51a5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:15.630916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8f396749-8518-4337-8e9b-ea776b0d51a5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:15.721031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e6a4bc6d-2c24-43b0-a681-fc71c7622069 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:15.735847 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e6a4bc6d-2c24-43b0-a681-fc71c7622069 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1316 microversion: 2.1 time: 0.454929 Aug 04 14:04:15.740055 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1132/2243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:15 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:15.916844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a89bf1ca-af6c-4285-bcf7-aa7159d157af req-8c8de009-bfed-4472-9499-9e5dd18df841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e295fc-0888-455d-b1b2-24d11d238044", "name": "network-vif-deleted", "tag": "f72015d3-8ae8-43ae-8514-488809548829"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:15.982481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a89bf1ca-af6c-4285-bcf7-aa7159d157af req-8c8de009-bfed-4472-9499-9e5dd18df841 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:15.982950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a89bf1ca-af6c-4285-bcf7-aa7159d157af req-8c8de009-bfed-4472-9499-9e5dd18df841 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:16.039995 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a89bf1ca-af6c-4285-bcf7-aa7159d157af req-8c8de009-bfed-4472-9499-9e5dd18df841 service nova] Creating event network-vif-deleted:f72015d3-8ae8-43ae-8514-488809548829 for instance c1e295fc-0888-455d-b1b2-24d11d238044 on n-h2-844627-10 Aug 04 14:04:16.050901 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a89bf1ca-af6c-4285-bcf7-aa7159d157af req-8c8de009-bfed-4472-9499-9e5dd18df841 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136816 Aug 04 14:04:16.053452 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1133/2244] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:04:16.064794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-35f66fd2-af72-4d08-9cb5-746f1a9a9f83 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:16.074278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-35f66fd2-af72-4d08-9cb5-746f1a9a9f83 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:16.092666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35f66fd2-af72-4d08-9cb5-746f1a9a9f83 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:16.108236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35f66fd2-af72-4d08-9cb5-746f1a9a9f83 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:16.112810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35f66fd2-af72-4d08-9cb5-746f1a9a9f83 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:16.113465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35f66fd2-af72-4d08-9cb5-746f1a9a9f83 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:16.279673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-35f66fd2-af72-4d08-9cb5-746f1a9a9f83 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:16.293796 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-35f66fd2-af72-4d08-9cb5-746f1a9a9f83 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044" status: 200 len: 1308 microversion: 2.1 time: 0.233954 Aug 04 14:04:16.295855 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1134/2245] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:16 2022] GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:16.301992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-458e721f-f0f2-4c5b-9caf-dcd29fcf8111 req-ef865a45-b39c-48b9-b207-7fc044b96ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f8971b-488d-4f79-aabb-16c5e68290dc", "name": "network-vif-plugged", "status": "completed", "tag": "5d6f6d60-d9c1-4e53-9a9b-a07468882b74"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:16.315777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-458e721f-f0f2-4c5b-9caf-dcd29fcf8111 req-ef865a45-b39c-48b9-b207-7fc044b96ce1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:16.316525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-458e721f-f0f2-4c5b-9caf-dcd29fcf8111 req-ef865a45-b39c-48b9-b207-7fc044b96ce1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:16.351816 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-458e721f-f0f2-4c5b-9caf-dcd29fcf8111 req-ef865a45-b39c-48b9-b207-7fc044b96ce1 service nova] Creating event network-vif-plugged:5d6f6d60-d9c1-4e53-9a9b-a07468882b74 for instance 05f8971b-488d-4f79-aabb-16c5e68290dc on n-h1-844627-10 Aug 04 14:04:16.377730 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-458e721f-f0f2-4c5b-9caf-dcd29fcf8111 req-ef865a45-b39c-48b9-b207-7fc044b96ce1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077421 Aug 04 14:04:16.379530 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1135/2246] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:16.393495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f1a9ab9-88a1-47f6-b6cf-f1810f214cf7 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47008689d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:16.473571 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f1a9ab9-88a1-47f6-b6cf-f1810f214cf7 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.090186 Aug 04 14:04:16.475398 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1136/2247] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:16 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:16.481597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a5ea4c5e-d990-47e6-94d6-a6c63ec394b6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:16.482673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a5ea4c5e-d990-47e6-94d6-a6c63ec394b6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:16.493344 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8f396749-8518-4337-8e9b-ea776b0d51a5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "POST /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912476 Aug 04 14:04:16.495923 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1112/2248] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:04:15 2022] POST /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:04:16.509950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5ea4c5e-d990-47e6-94d6-a6c63ec394b6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:16.510416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5ea4c5e-d990-47e6-94d6-a6c63ec394b6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:16.511207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5ea4c5e-d990-47e6-94d6-a6c63ec394b6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:16.511683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5ea4c5e-d990-47e6-94d6-a6c63ec394b6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:16.783072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7007802-5a19-49f0-87a5-9081d539ab3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:16.786861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d7007802-5a19-49f0-87a5-9081d539ab3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:16.839789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7007802-5a19-49f0-87a5-9081d539ab3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:16.841971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7007802-5a19-49f0-87a5-9081d539ab3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:16.847584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7007802-5a19-49f0-87a5-9081d539ab3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:16.848391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7007802-5a19-49f0-87a5-9081d539ab3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:17.493406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a5ea4c5e-d990-47e6-94d6-a6c63ec394b6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:17.509901 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a5ea4c5e-d990-47e6-94d6-a6c63ec394b6 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 1.033145 Aug 04 14:04:17.511338 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1137/2249] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:16 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:17.524214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:17.525332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:17.539397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:17.543462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:17.546787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:17.547487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:17.577955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d7007802-5a19-49f0-87a5-9081d539ab3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:17.589177 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] HTTP exception thrown: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Request method failure captured: Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 HTTP/1.1 Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69GvMhcLwgdDVIZ3SvKBFy-aGQ5sZ3IRQ54V6TsgGeAOIDbYqxaIKwXG5nJmdpGDEpK6oXZzE2W_n2ii-PjdU0B53n7qhX7tXRfPuv00FUjTAoNmfmhO5NN4a2AfOmovXoCnLt-_jGu1OdbjVOzIyhzJsUky964KqEal130kaTyX1AQ Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6ecbc8173fa949f1913669488544658d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6ecbc8173fa949f1913669488544658d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}] Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c2c25041b4da41dea0448b9c9b418aa4 Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'c1e295fc-0888-455d-b1b2-24d11d238044'} Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:17.591216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:17.595775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:17.595775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:17.595775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:17.595775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:17.595775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:17.595775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:17.595775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:17.595775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:17.596352 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d7007802-5a19-49f0-87a5-9081d539ab3f tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1504 microversion: 2.1 time: 0.831303 Aug 04 14:04:17.598357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Returning 404 to user: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:17.602860 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-38ca7046-a2e8-4a60-80ab-b250c558e00b tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044" status: 404 len: 111 microversion: 2.1 time: 0.087150 Aug 04 14:04:17.603989 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1138/2250] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:17 2022] GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:17.609766 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1113/2251] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:16 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1504 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:17.614472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-86e5e297-f1ba-4f0f-a8c9-54b8203b0265 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f470087d940>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:17.625851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-57143c67-802e-4263-bd49-d243a1d2da24 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:17.652487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-57143c67-802e-4263-bd49-d243a1d2da24 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:17.659328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-57143c67-802e-4263-bd49-d243a1d2da24 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '6ecbc8173fa949f1913669488544658d'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:04:17.681953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57143c67-802e-4263-bd49-d243a1d2da24 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:17.682407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57143c67-802e-4263-bd49-d243a1d2da24 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:17.683244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57143c67-802e-4263-bd49-d243a1d2da24 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:17.683683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57143c67-802e-4263-bd49-d243a1d2da24 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:17.734050 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-86e5e297-f1ba-4f0f-a8c9-54b8203b0265 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.128304 Aug 04 14:04:17.756547 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1139/2252] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:17 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:17.773217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52e091c7-0ba0-415e-a870-49ac4bdd0ebb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:17.773799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-52e091c7-0ba0-415e-a870-49ac4bdd0ebb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:17.791143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52e091c7-0ba0-415e-a870-49ac4bdd0ebb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:17.791819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52e091c7-0ba0-415e-a870-49ac4bdd0ebb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:17.795347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52e091c7-0ba0-415e-a870-49ac4bdd0ebb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:17.796647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52e091c7-0ba0-415e-a870-49ac4bdd0ebb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:17.914266 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-52e091c7-0ba0-415e-a870-49ac4bdd0ebb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5/ips" status: 200 len: 108 microversion: 2.1 time: 0.145051 Aug 04 14:04:17.915148 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1140/2253] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:04:17 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5/ips => generated 108 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:17.933787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac42a474-2ed0-4df0-a6e3-11a976a18773 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:17.940595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ac42a474-2ed0-4df0-a6e3-11a976a18773 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:17.974449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac42a474-2ed0-4df0-a6e3-11a976a18773 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:17.982521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac42a474-2ed0-4df0-a6e3-11a976a18773 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:17.986092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac42a474-2ed0-4df0-a6e3-11a976a18773 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:17.990739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac42a474-2ed0-4df0-a6e3-11a976a18773 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:17.995578 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-57143c67-802e-4263-bd49-d243a1d2da24 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.384234 Aug 04 14:04:17.997572 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1114/2254] 10.222.0.66 () {58 vars in 1230 bytes} [Thu Aug 4 14:04:17 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:04:18.026233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:18.035859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7cc5f1a1-6ccc-4720-a5a6-48ef0c858013 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7cc5f1a1-6ccc-4720-a5a6-48ef0c858013 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Request method failure captured: Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69GvMhcLwgdDVIZ3SvKBFy-aGQ5sZ3IRQ54V6TsgGeAOIDbYqxaIKwXG5nJmdpGDEpK6oXZzE2W_n2ii-PjdU0B53n7qhX7tXRfPuv00FUjTAoNmfmhO5NN4a2AfOmovXoCnLt-_jGu1OdbjVOzIyhzJsUky964KqEal130kaTyX1AQ Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6ecbc8173fa949f1913669488544658d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6ecbc8173fa949f1913669488544658d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}] Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c2c25041b4da41dea0448b9c9b418aa4 Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: action_args: {} Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 14:04:18.065412 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7cc5f1a1-6ccc-4720-a5a6-48ef0c858013 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7cc5f1a1-6ccc-4720-a5a6-48ef0c858013 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.057839 Aug 04 14:04:18.075872 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1115/2255] 10.222.0.66 () {58 vars in 1182 bytes} [Thu Aug 4 14:04:18 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:04:18.085394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e22a1830-f262-4c74-b955-84465ebc7176 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:18.100175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e22a1830-f262-4c74-b955-84465ebc7176 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:18.104360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e22a1830-f262-4c74-b955-84465ebc7176 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Searching by: {'deleted': False, 'project_id': '6ecbc8173fa949f1913669488544658d'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:04:18.124601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e22a1830-f262-4c74-b955-84465ebc7176 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.125308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e22a1830-f262-4c74-b955-84465ebc7176 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.132389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e22a1830-f262-4c74-b955-84465ebc7176 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.135423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e22a1830-f262-4c74-b955-84465ebc7176 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.183183 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac42a474-2ed0-4df0-a6e3-11a976a18773 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5/ips" status: 200 len: 108 microversion: 2.1 time: 0.246190 Aug 04 14:04:18.185170 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1141/2256] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:04:17 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5/ips => generated 108 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:18.206275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0b81e5a2-98f5-436a-8c59-72f198fe56d7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:18.218098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0b81e5a2-98f5-436a-8c59-72f198fe56d7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:18.231212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:18.285479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b81e5a2-98f5-436a-8c59-72f198fe56d7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.286489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b81e5a2-98f5-436a-8c59-72f198fe56d7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.287886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b81e5a2-98f5-436a-8c59-72f198fe56d7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.289141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b81e5a2-98f5-436a-8c59-72f198fe56d7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.326067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-e22a1830-f262-4c74-b955-84465ebc7176 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:04:18.432780 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0b81e5a2-98f5-436a-8c59-72f198fe56d7 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5/ips/tempest-ServerAddressesTestJSON-812790974-network" status: 200 len: 93 microversion: 2.1 time: 0.239889 Aug 04 14:04:18.440679 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1142/2257] 10.222.0.66 () {58 vars in 1398 bytes} [Thu Aug 4 14:04:18 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5/ips/tempest-ServerAddressesTestJSON-812790974-network => generated 93 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 14:04:18.455984 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e22a1830-f262-4c74-b955-84465ebc7176 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.373583 Aug 04 14:04:18.457936 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1116/2258] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:04:18 2022] GET /compute/v2.1/servers => generated 683 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:18.472428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:18.478785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b1212552-8c8b-4077-bb41-85f553e00deb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:18.480065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b1212552-8c8b-4077-bb41-85f553e00deb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:18.499007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:18.499512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.compute.servers [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Removing options 'limit' from query {{(pid=130960) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 14:04:18.500275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Searching by: {'deleted': False, 'project_id': '6ecbc8173fa949f1913669488544658d'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:04:18.505251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1212552-8c8b-4077-bb41-85f553e00deb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.506115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1212552-8c8b-4077-bb41-85f553e00deb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.513243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1212552-8c8b-4077-bb41-85f553e00deb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.513906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1212552-8c8b-4077-bb41-85f553e00deb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.524944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.528241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.537871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.538668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.609401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b1212552-8c8b-4077-bb41-85f553e00deb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:18.655130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:04:18.750753 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-99b85c07-07a3-41fc-b918-06fcf4305111 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.284295 Aug 04 14:04:18.761160 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1117/2259] 10.222.0.66 () {58 vars in 1144 bytes} [Thu Aug 4 14:04:18 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:18.775367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b0965356-3217-4e15-963c-7702e6eee3b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:18.776970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b0965356-3217-4e15-963c-7702e6eee3b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:18.799441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0965356-3217-4e15-963c-7702e6eee3b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.800513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0965356-3217-4e15-963c-7702e6eee3b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.805788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0965356-3217-4e15-963c-7702e6eee3b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:18.807959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0965356-3217-4e15-963c-7702e6eee3b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:18.843985 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b1212552-8c8b-4077-bb41-85f553e00deb tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 204 len: 0 microversion: 2.1 time: 0.393968 Aug 04 14:04:18.847744 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1143/2260] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:18 2022] DELETE /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:18.867351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a7a177a-b75c-4903-8cc1-cc820ab8b4ba tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a7a177a-b75c-4903-8cc1-cc820ab8b4ba tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Request method failure captured: Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69GvMhcLwgdDVIZ3SvKBFy-aGQ5sZ3IRQ54V6TsgGeAOIDbYqxaIKwXG5nJmdpGDEpK6oXZzE2W_n2ii-PjdU0B53n7qhX7tXRfPuv00FUjTAoNmfmhO5NN4a2AfOmovXoCnLt-_jGu1OdbjVOzIyhzJsUky964KqEal130kaTyX1AQ Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6ecbc8173fa949f1913669488544658d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6ecbc8173fa949f1913669488544658d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}] Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c2c25041b4da41dea0448b9c9b418aa4 Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: action_args: {} Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi '-1' Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 14:04:18.874772 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 14:04:18.878542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:18.880692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a7a177a-b75c-4903-8cc1-cc820ab8b4ba tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:18.883154 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a7a177a-b75c-4903-8cc1-cc820ab8b4ba tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.032742 Aug 04 14:04:18.884471 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1144/2261] 10.222.0.66 () {58 vars in 1142 bytes} [Thu Aug 4 14:04:18 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:04:18.915955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5df58e2-3ca4-4cd7-bf15-aef62154fb3f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47006d1820>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:19.032304 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d5df58e2-3ca4-4cd7-bf15-aef62154fb3f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.135994 Aug 04 14:04:19.042014 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1145/2262] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:18 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:19.067063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e9aa5a47-9d06-4ab8-9f58-9f5eda407483 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:19.080143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e9aa5a47-9d06-4ab8-9f58-9f5eda407483 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:19.098278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9aa5a47-9d06-4ab8-9f58-9f5eda407483 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:19.109700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9aa5a47-9d06-4ab8-9f58-9f5eda407483 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:19.110647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9aa5a47-9d06-4ab8-9f58-9f5eda407483 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:19.111116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9aa5a47-9d06-4ab8-9f58-9f5eda407483 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:19.485403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b0965356-3217-4e15-963c-7702e6eee3b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:19.498186 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b0965356-3217-4e15-963c-7702e6eee3b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1317 microversion: 2.1 time: 0.735604 Aug 04 14:04:19.499115 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1118/2263] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:18 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1317 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:19.504099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5ea5aa3a-5734-42a0-a99f-6cb56401d9e9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5ea5aa3a-5734-42a0-a99f-6cb56401d9e9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Request method failure captured: Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69GvMhcLwgdDVIZ3SvKBFy-aGQ5sZ3IRQ54V6TsgGeAOIDbYqxaIKwXG5nJmdpGDEpK6oXZzE2W_n2ii-PjdU0B53n7qhX7tXRfPuv00FUjTAoNmfmhO5NN4a2AfOmovXoCnLt-_jGu1OdbjVOzIyhzJsUky964KqEal130kaTyX1AQ Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6ecbc8173fa949f1913669488544658d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6ecbc8173fa949f1913669488544658d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}] Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c2c25041b4da41dea0448b9c9b418aa4 Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: action_args: {} Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'testing' Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 14:04:19.517347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 14:04:19.521145 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:19.528078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5ea5aa3a-5734-42a0-a99f-6cb56401d9e9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:19.529447 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5ea5aa3a-5734-42a0-a99f-6cb56401d9e9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.029188 Aug 04 14:04:19.533833 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1119/2264] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 14:04:19 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:04:19.567056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e9aa5a47-9d06-4ab8-9f58-9f5eda407483 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:19.594842 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e9aa5a47-9d06-4ab8-9f58-9f5eda407483 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1510 microversion: 2.1 time: 0.550581 Aug 04 14:04:19.609456 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1146/2265] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:19 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1510 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:19.623996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2ccefe71-9351-4f79-ac5f-12be2354de0f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:19.653211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2ccefe71-9351-4f79-ac5f-12be2354de0f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:19.654917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2ccefe71-9351-4f79-ac5f-12be2354de0f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '6ecbc8173fa949f1913669488544658d'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:04:19.689921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.compute.servers [None req-2ccefe71-9351-4f79-ac5f-12be2354de0f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Flavor 'non_existing_flavor' could not be found {{(pid=130961) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 04 14:04:19.691909 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2ccefe71-9351-4f79-ac5f-12be2354de0f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.080182 Aug 04 14:04:19.697608 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1147/2266] 10.222.0.66 () {58 vars in 1178 bytes} [Thu Aug 4 14:04:19 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:04:19.743103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dec3e98a-e57c-4849-8f15-6a80ec218cb9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:19.768911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dec3e98a-e57c-4849-8f15-6a80ec218cb9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:19.778952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dec3e98a-e57c-4849-8f15-6a80ec218cb9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '6ecbc8173fa949f1913669488544658d'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:04:19.796008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dec3e98a-e57c-4849-8f15-6a80ec218cb9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:19.797240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dec3e98a-e57c-4849-8f15-6a80ec218cb9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:19.799619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dec3e98a-e57c-4849-8f15-6a80ec218cb9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:19.800472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dec3e98a-e57c-4849-8f15-6a80ec218cb9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:20.173529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a975950d-4bb2-4e48-8da8-366d0d20acc6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Action: 'create', calling method: .version_select at 0x7f46f38d5ca0>, body: {"keypair": {"name": "tempest-keypair-1676829392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXNMg/hRXVGIC/0crJSHbkziwZC+qJcBEqNN/kKsIZFoxxlOJKDzAFkPmGe57mEqQCl+aRT41gVhuEgyKjBS+c94OPAIUXODhQD46/gTUhyaOgtCKFtNzMwxhItxxsC0w=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:20.224136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a975950d-4bb2-4e48-8da8-366d0d20acc6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Getting quotas for project dbf6a4f1744e46e3b3947663133a78c1. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:04:20.247867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a975950d-4bb2-4e48-8da8-366d0d20acc6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Getting quotas for user c9932e8de6124b578bf548756f749ef1 and project dbf6a4f1744e46e3b3947663133a78c1. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:04:20.300568 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dec3e98a-e57c-4849-8f15-6a80ec218cb9 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.574003 Aug 04 14:04:20.302533 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1148/2267] 10.222.0.66 () {58 vars in 1174 bytes} [Thu Aug 4 14:04:19 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:04:20.317957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0c6b71a-43fb-496b-9abd-d555a7a631bd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47056098b0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:20.349429 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a975950d-4bb2-4e48-8da8-366d0d20acc6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.814052 Aug 04 14:04:20.354367 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1120/2268] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:04:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:20.391189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-97e01b02-569b-4e5a-a18d-31cb8050b18a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:20.430454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-97e01b02-569b-4e5a-a18d-31cb8050b18a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:20.431421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-97e01b02-569b-4e5a-a18d-31cb8050b18a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '6ecbc8173fa949f1913669488544658d'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:04:20.456300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97e01b02-569b-4e5a-a18d-31cb8050b18a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:20.456766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97e01b02-569b-4e5a-a18d-31cb8050b18a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:20.458602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97e01b02-569b-4e5a-a18d-31cb8050b18a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:20.459035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97e01b02-569b-4e5a-a18d-31cb8050b18a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:20.496189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0c6b71a-43fb-496b-9abd-d555a7a631bd tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.191819 Aug 04 14:04:20.499896 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1149/2269] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:20 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:20.528998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a2a0ad5-4b94-4e65-b641-5eac25f1f791 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:20.531417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1a2a0ad5-4b94-4e65-b641-5eac25f1f791 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:20.547031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a2a0ad5-4b94-4e65-b641-5eac25f1f791 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:20.551937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a2a0ad5-4b94-4e65-b641-5eac25f1f791 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:20.554939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a2a0ad5-4b94-4e65-b641-5eac25f1f791 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:20.555889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a2a0ad5-4b94-4e65-b641-5eac25f1f791 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:20.703704 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-97e01b02-569b-4e5a-a18d-31cb8050b18a tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.344443 Aug 04 14:04:20.705188 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1121/2270] 10.222.0.66 () {58 vars in 1184 bytes} [Thu Aug 4 14:04:20 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:04:20.722880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ccabd2f-2359-4929-85ca-e1e549b66342 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:20.723575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4ccabd2f-2359-4929-85ca-e1e549b66342 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:20.743408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ccabd2f-2359-4929-85ca-e1e549b66342 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:20.743850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ccabd2f-2359-4929-85ca-e1e549b66342 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:20.745784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ccabd2f-2359-4929-85ca-e1e549b66342 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:20.746271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ccabd2f-2359-4929-85ca-e1e549b66342 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:21.439087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4ccabd2f-2359-4929-85ca-e1e549b66342 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:21.496154 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4ccabd2f-2359-4929-85ca-e1e549b66342 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1510 microversion: 2.1 time: 0.788922 Aug 04 14:04:21.515633 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1122/2271] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:20 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1510 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:21.527224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:21.559925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:21.564346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Searching by: {'deleted': False, 'project_id': '6ecbc8173fa949f1913669488544658d'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:04:21.583972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:21.585739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:21.588009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:21.589167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:21.708661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1a2a0ad5-4b94-4e65-b641-5eac25f1f791 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:21.713419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:04:21.719902 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a2a0ad5-4b94-4e65-b641-5eac25f1f791 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1466 microversion: 2.1 time: 1.202826 Aug 04 14:04:21.720424 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1150/2272] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:20 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1466 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:21.734962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-096a418a-2f24-49e8-8ed7-c9aaaab8506b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47056099d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:21.824567 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-096a418a-2f24-49e8-8ed7-c9aaaab8506b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.093552 Aug 04 14:04:21.837272 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1151/2273] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:21 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:21.850567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e54a6961-ce99-4bbb-9e8a-72f4b036e200 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:21.851807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e54a6961-ce99-4bbb-9e8a-72f4b036e200 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:21.875026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e54a6961-ce99-4bbb-9e8a-72f4b036e200 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:21.875492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e54a6961-ce99-4bbb-9e8a-72f4b036e200 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:21.876504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e54a6961-ce99-4bbb-9e8a-72f4b036e200 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:21.877146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e54a6961-ce99-4bbb-9e8a-72f4b036e200 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:22.152169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:22.180007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:22.198311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:22.692215 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e54a6961-ce99-4bbb-9e8a-72f4b036e200 tempest-ServersOnMultiNodesTest-337549023 tempest-ServersOnMultiNodesTest-337549023-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1619 microversion: 2.1 time: 0.853650 Aug 04 14:04:22.692937 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1152/2274] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:21 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1619 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:22.733226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b465a388-256f-4ccb-8a96-137e7008af90 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:22.734362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b465a388-256f-4ccb-8a96-137e7008af90 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:22.786168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b465a388-256f-4ccb-8a96-137e7008af90 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:22.786923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b465a388-256f-4ccb-8a96-137e7008af90 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:22.788217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b465a388-256f-4ccb-8a96-137e7008af90 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:22.789135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b465a388-256f-4ccb-8a96-137e7008af90 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:22.892446 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-45cb9bae-11f4-4b8a-a2a1-767c62263e94 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 3027 microversion: 2.1 time: 1.385870 Aug 04 14:04:22.893868 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1123/2275] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:04:21 2022] GET /compute/v2.1/servers/detail => generated 3027 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:22.898917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-712139e9-706c-4f09-8d3e-b5dbf695d700 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:22.900217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-712139e9-706c-4f09-8d3e-b5dbf695d700 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:22.937783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-712139e9-706c-4f09-8d3e-b5dbf695d700 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:22.937783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-712139e9-706c-4f09-8d3e-b5dbf695d700 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:22.937783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-712139e9-706c-4f09-8d3e-b5dbf695d700 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:22.957483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-712139e9-706c-4f09-8d3e-b5dbf695d700 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:23.015537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-712139e9-706c-4f09-8d3e-b5dbf695d700 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:23.099438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b465a388-256f-4ccb-8a96-137e7008af90 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:23.116637 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b465a388-256f-4ccb-8a96-137e7008af90 tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1468 microversion: 2.1 time: 0.408979 Aug 04 14:04:23.130807 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1153/2276] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:22 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1468 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:23.222186 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-712139e9-706c-4f09-8d3e-b5dbf695d700 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 204 len: 0 microversion: 2.1 time: 0.322334 Aug 04 14:04:23.223274 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1124/2277] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:22 2022] DELETE /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:23.247960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5c157daf-a51a-4934-b1f7-ddd1d3330b79 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f39e7d30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:23.358082 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5c157daf-a51a-4934-b1f7-ddd1d3330b79 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.132852 Aug 04 14:04:23.371308 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1125/2278] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:23 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:23.399607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-24e1eaa6-f684-464e-86f4-9c14fc669641 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:23.477641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-24e1eaa6-f684-464e-86f4-9c14fc669641 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:23.486029 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-24e1eaa6-f684-464e-86f4-9c14fc669641 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.118183 Aug 04 14:04:23.487174 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1126/2279] 10.222.0.66 () {58 vars in 1178 bytes} [Thu Aug 4 14:04:23 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:04:23.521977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-694a3241-4e70-4b73-8d85-89924ad35ac3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:23.523222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-694a3241-4e70-4b73-8d85-89924ad35ac3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:23.538815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-694a3241-4e70-4b73-8d85-89924ad35ac3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:23.540247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-694a3241-4e70-4b73-8d85-89924ad35ac3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:23.543281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-694a3241-4e70-4b73-8d85-89924ad35ac3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:23.544019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-694a3241-4e70-4b73-8d85-89924ad35ac3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:23.747368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf176621-87b5-4be0-8271-f13e5b2c5966 tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Action: 'update', calling method: .version_select at 0x7f47056870d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:23.942114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-694a3241-4e70-4b73-8d85-89924ad35ac3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:23.967607 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-694a3241-4e70-4b73-8d85-89924ad35ac3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1472 microversion: 2.1 time: 0.453911 Aug 04 14:04:23.973923 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1127/2280] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:23 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1472 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:23.991761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a44d4508-e23f-47ef-87db-a992c4b3330c req-e59259af-b520-4c68-ae4b-323046417c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffff8320-14dc-48bb-bc34-edaafdc741a5", "name": "network-vif-deleted", "tag": "ba538cbc-fc43-4471-ad91-b07277b3aa1e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:23.996222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf176621-87b5-4be0-8271-f13e5b2c5966 tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:23.997474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf176621-87b5-4be0-8271-f13e5b2c5966 tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:23.999450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf176621-87b5-4be0-8271-f13e5b2c5966 tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.007723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf176621-87b5-4be0-8271-f13e5b2c5966 tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.021149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a44d4508-e23f-47ef-87db-a992c4b3330c req-e59259af-b520-4c68-ae4b-323046417c26 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.021477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a44d4508-e23f-47ef-87db-a992c4b3330c req-e59259af-b520-4c68-ae4b-323046417c26 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.057094 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a44d4508-e23f-47ef-87db-a992c4b3330c req-e59259af-b520-4c68-ae4b-323046417c26 service nova] Creating event network-vif-deleted:ba538cbc-fc43-4471-ad91-b07277b3aa1e for instance ffff8320-14dc-48bb-bc34-edaafdc741a5 on n-h1-844627-10 Aug 04 14:04:24.067592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a44d4508-e23f-47ef-87db-a992c4b3330c req-e59259af-b520-4c68-ae4b-323046417c26 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088696 Aug 04 14:04:24.076981 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1128/2281] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:24.089727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ece5226-4026-4ee4-b7e7-397b8d0546b0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:24.104597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2ece5226-4026-4ee4-b7e7-397b8d0546b0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:24.107992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2ece5226-4026-4ee4-b7e7-397b8d0546b0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Searching by: {'deleted': False, 'project_id': '6ecbc8173fa949f1913669488544658d'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:04:24.129495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ece5226-4026-4ee4-b7e7-397b8d0546b0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.130713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ece5226-4026-4ee4-b7e7-397b8d0546b0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.132638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ece5226-4026-4ee4-b7e7-397b8d0546b0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.134482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ece5226-4026-4ee4-b7e7-397b8d0546b0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.221752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-2ece5226-4026-4ee4-b7e7-397b8d0546b0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:04:24.238946 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf176621-87b5-4be0-8271-f13e5b2c5966 tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/67068d8e5bc547a791cb4975fd122896" status: 200 len: 148 microversion: 2.57 time: 1.106208 Aug 04 14:04:24.241154 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1154/2282] 10.222.0.66 () {62 vars in 1303 bytes} [Thu Aug 4 14:04:23 2022] PUT /compute/v2.1/os-quota-sets/67068d8e5bc547a791cb4975fd122896 => generated 148 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:04:24.253762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-31f236eb-b288-4ee8-89b1-78180d734b2a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:24.256331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-31f236eb-b288-4ee8-89b1-78180d734b2a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:24.273932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31f236eb-b288-4ee8-89b1-78180d734b2a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.274386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31f236eb-b288-4ee8-89b1-78180d734b2a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.277047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31f236eb-b288-4ee8-89b1-78180d734b2a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.278431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31f236eb-b288-4ee8-89b1-78180d734b2a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.292551 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ece5226-4026-4ee4-b7e7-397b8d0546b0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.212348 Aug 04 14:04:24.293367 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1129/2283] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:04:24 2022] GET /compute/v2.1/servers => generated 683 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:24.307368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a12dbbf5-81df-48ed-92a6-1ebae489813c tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Calling method '.version_select at 0x7f46f38dc160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:24.473899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-31f236eb-b288-4ee8-89b1-78180d734b2a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a90dfdb45d4ab280dbff8f2fcca948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56a04f49378d4eef9534b011602c4bcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:24.485150 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-31f236eb-b288-4ee8-89b1-78180d734b2a tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 200 len: 1468 microversion: 2.1 time: 0.240974 Aug 04 14:04:24.486190 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1155/2284] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:24 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:24.493286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:24.494007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:24.552196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.552196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.552196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.552196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.552702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a12dbbf5-81df-48ed-92a6-1ebae489813c tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.552702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a12dbbf5-81df-48ed-92a6-1ebae489813c tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.567711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a12dbbf5-81df-48ed-92a6-1ebae489813c tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.571196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a12dbbf5-81df-48ed-92a6-1ebae489813c tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.598394 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] HTTP exception thrown: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Request method failure captured: Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 HTTP/1.1 Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69GvMhcLwgdDVIZ3SvKBFy-aGQ5sZ3IRQ54V6TsgGeAOIDbYqxaIKwXG5nJmdpGDEpK6oXZzE2W_n2ii-PjdU0B53n7qhX7tXRfPuv00FUjTAoNmfmhO5NN4a2AfOmovXoCnLt-_jGu1OdbjVOzIyhzJsUky964KqEal130kaTyX1AQ Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6ecbc8173fa949f1913669488544658d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6ecbc8173fa949f1913669488544658d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}] Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c2c25041b4da41dea0448b9c9b418aa4 Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'c1e295fc-0888-455d-b1b2-24d11d238044'} Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:24.601289 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:24.604737 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:24.609791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Returning 404 to user: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:24.612944 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3149444a-1291-4a44-9820-30cb28996667 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044" status: 404 len: 111 microversion: 2.1 time: 0.125285 Aug 04 14:04:24.616437 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1156/2285] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:24 2022] DELETE /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:24.628156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7b2cee6c-b294-42c4-9109-637120ef1393 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f4700932b80>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:24.761319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:24.821297 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a12dbbf5-81df-48ed-92a6-1ebae489813c tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/67068d8e5bc547a791cb4975fd122896/detail" status: 200 len: 463 microversion: 2.57 time: 0.518268 Aug 04 14:04:24.827150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1130/2286] 10.222.0.66 () {60 vars in 1304 bytes} [Thu Aug 4 14:04:24 2022] GET /compute/v2.1/os-quota-sets/67068d8e5bc547a791cb4975fd122896/detail => generated 463 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:04:24.850518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f8a5239-3d2a-43a9-931b-66aaae51ef8e tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:24.851592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f8a5239-3d2a-43a9-931b-66aaae51ef8e tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: ab0715c8-e967-444f-bb46-6e5043791203] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:24.868593 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7b2cee6c-b294-42c4-9109-637120ef1393 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.245455 Aug 04 14:04:24.868593 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1157/2287] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:24 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:24.885282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f8a5239-3d2a-43a9-931b-66aaae51ef8e tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.888111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f8a5239-3d2a-43a9-931b-66aaae51ef8e tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.895971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f8a5239-3d2a-43a9-931b-66aaae51ef8e tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:24.896739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f8a5239-3d2a-43a9-931b-66aaae51ef8e tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:24.994581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4904c590-a515-4e05-80bd-de93bf95c9eb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:24.995816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4904c590-a515-4e05-80bd-de93bf95c9eb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:25.010865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4904c590-a515-4e05-80bd-de93bf95c9eb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:25.028960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f8a5239-3d2a-43a9-931b-66aaae51ef8e tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: ab0715c8-e967-444f-bb46-6e5043791203] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:25.031347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4904c590-a515-4e05-80bd-de93bf95c9eb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:25.032816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4904c590-a515-4e05-80bd-de93bf95c9eb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:25.033620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4904c590-a515-4e05-80bd-de93bf95c9eb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:25.338930 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f8a5239-3d2a-43a9-931b-66aaae51ef8e tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203" status: 204 len: 0 microversion: 2.1 time: 0.506721 Aug 04 14:04:25.358966 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1131/2288] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:24 2022] DELETE /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:25.414588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-139381332", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "93512c99-9058-4d1e-a8c4-60ff332f6a75"}], "security_groups": [{"name": "tempest-securitygroup--84135963"}], "key_name": "tempest-keypair-1676829392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:25.883356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] validate_networks() for [('93512c99-9058-4d1e-a8c4-60ff332f6a75', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:04:25.958014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4904c590-a515-4e05-80bd-de93bf95c9eb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:25.970002 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4904c590-a515-4e05-80bd-de93bf95c9eb tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1472 microversion: 2.1 time: 0.980638 Aug 04 14:04:25.971011 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1158/2289] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:24 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1472 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:25.976319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4af3b37d-434f-4f90-8465-ba50afad213f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:25.977434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4af3b37d-434f-4f90-8465-ba50afad213f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:25.984689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4af3b37d-434f-4f90-8465-ba50afad213f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:25.985570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4af3b37d-434f-4f90-8465-ba50afad213f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:25.986670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4af3b37d-434f-4f90-8465-ba50afad213f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:25.987862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4af3b37d-434f-4f90-8465-ba50afad213f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:26.021135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4af3b37d-434f-4f90-8465-ba50afad213f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:26.167703 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4af3b37d-434f-4f90-8465-ba50afad213f tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 204 len: 0 microversion: 2.1 time: 0.195053 Aug 04 14:04:26.171797 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1159/2290] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:25 2022] DELETE /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:26.183988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Action: 'update', calling method: .version_select at 0x7f4705687040>, body: {"quota_set": {"ram": "2048"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:26.392143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:26.392953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:26.393909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:26.400726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:26.609630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:26.610635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:26.614661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:26.614978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:26.880827 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3458f3a2-15df-4a5a-8f78-c82a0d6d295d tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-quota-sets/67068d8e5bc547a791cb4975fd122896?user_id=2b6af24597614b3f827e2b500fb98406" status: 200 len: 148 microversion: 2.57 time: 0.707165 Aug 04 14:04:26.887672 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1160/2291] 10.222.0.66 () {62 vars in 1384 bytes} [Thu Aug 4 14:04:26 2022] PUT /compute/v2.1/os-quota-sets/67068d8e5bc547a791cb4975fd122896?user_id=2b6af24597614b3f827e2b500fb98406 => generated 148 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:04:26.887672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:26.889240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] [instance: ffff8320-14dc-48bb-bc34-edaafdc741a5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:26.896988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:26.897688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:26.899178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:26.899922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:26.981812 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] HTTP exception thrown: Instance ffff8320-14dc-48bb-bc34-edaafdc741a5 could not be found. Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Request method failure captured: Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 HTTP/1.1 Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69G_yonfd8QpFYLybdAKTnDjpm6xMg_lcBlB-KM7KTaCDc0A5qoq7i4cn0POO3lSnYdcLnBi0voxvrCb1MJ6FTFXLDxcrxTAkNz6ftFgt05WQAziwFO53vzLkbJHdqM377v-Wvhz1porWtq-2kE1BcQBBL6lvr7V8YWjnVcqU7xoHNA Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 56a04f49378d4eef9534b011602c4bcc Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerAddressesTestJSON-1975100286 Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/56a04f49378d4eef9534b011602c4bcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_56a04f49378d4eef9534b011602c4bcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/56a04f49378d4eef9534b011602c4bcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/56a04f49378d4eef9534b011602c4bcc"}]}] Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerAddressesTestJSON-1975100286 Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 56a04f49378d4eef9534b011602c4bcc Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1975100286 Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerAddressesTestJSON-1975100286-project Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 70a90dfdb45d4ab280dbff8f2fcca948 Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerAddressesTestJSON-1975100286-project Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance ffff8320-14dc-48bb-bc34-edaafdc741a5 could not be found. Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'ffff8320-14dc-48bb-bc34-edaafdc741a5'} Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffff8320-14dc-48bb-bc34-edaafdc741a5 could not be found. Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffff8320-14dc-48bb-bc34-edaafdc741a5 could not be found. Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:26.997406 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:27.001340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:27.001340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:27.001340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:27.001340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:27.001340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:27.001340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffff8320-14dc-48bb-bc34-edaafdc741a5 could not be found. Aug 04 14:04:27.001340 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:27.002727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] Returning 404 to user: Instance ffff8320-14dc-48bb-bc34-edaafdc741a5 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:27.003785 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a93b0add-0efe-4d8a-8238-0c32c21b129e tempest-ServerAddressesTestJSON-1975100286 tempest-ServerAddressesTestJSON-1975100286-project] 10.222.0.66 "GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5" status: 404 len: 111 microversion: 2.1 time: 0.120929 Aug 04 14:04:27.005324 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1161/2292] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:26 2022] GET /compute/v2.1/servers/ffff8320-14dc-48bb-bc34-edaafdc741a5 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:27.018857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-83371969-f61e-4d59-bb21-0540ba59301c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f4700837700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:27.148707 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-83371969-f61e-4d59-bb21-0540ba59301c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.141822 Aug 04 14:04:27.150256 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1162/2293] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:27 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:27.188361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:27.201927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: c1e295fc-0888-455d-b1b2-24d11d238044] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:27.222496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:27.222974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:27.223910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:27.224372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:27.265088 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] HTTP exception thrown: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Request method failure captured: Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 HTTP/1.1 Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69GvMhcLwgdDVIZ3SvKBFy-aGQ5sZ3IRQ54V6TsgGeAOIDbYqxaIKwXG5nJmdpGDEpK6oXZzE2W_n2ii-PjdU0B53n7qhX7tXRfPuv00FUjTAoNmfmhO5NN4a2AfOmovXoCnLt-_jGu1OdbjVOzIyhzJsUky964KqEal130kaTyX1AQ Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6ecbc8173fa949f1913669488544658d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6ecbc8173fa949f1913669488544658d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}] Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c2c25041b4da41dea0448b9c9b418aa4 Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'c1e295fc-0888-455d-b1b2-24d11d238044'} Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:27.267160 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Returning 404 to user: Instance c1e295fc-0888-455d-b1b2-24d11d238044 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:27.271173 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c980ec58-7b7a-4efa-b073-9e5b718c8ac1 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044" status: 404 len: 111 microversion: 2.1 time: 0.118288 Aug 04 14:04:27.281485 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1163/2294] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:27 2022] GET /compute/v2.1/servers/c1e295fc-0888-455d-b1b2-24d11d238044 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:27.302595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-1cab1801-cfb0-449b-8fed-739c11eec672 req-2232fb97-25bd-48de-8278-8f67c8bc6cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f8971b-488d-4f79-aabb-16c5e68290dc", "name": "network-vif-deleted", "tag": "5d6f6d60-d9c1-4e53-9a9b-a07468882b74"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:27.327167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1cab1801-cfb0-449b-8fed-739c11eec672 req-2232fb97-25bd-48de-8278-8f67c8bc6cd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:27.327630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1cab1801-cfb0-449b-8fed-739c11eec672 req-2232fb97-25bd-48de-8278-8f67c8bc6cd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:27.405298 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-1cab1801-cfb0-449b-8fed-739c11eec672 req-2232fb97-25bd-48de-8278-8f67c8bc6cd4 service nova] Creating event network-vif-deleted:5d6f6d60-d9c1-4e53-9a9b-a07468882b74 for instance 05f8971b-488d-4f79-aabb-16c5e68290dc on n-h1-844627-10 Aug 04 14:04:27.420610 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-1cab1801-cfb0-449b-8fed-739c11eec672 req-2232fb97-25bd-48de-8278-8f67c8bc6cd4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137857 Aug 04 14:04:27.423030 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1164/2295] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:27.444115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08f9dcbb-6b4c-4c3b-82d3-7f57e117fa4c tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] Calling method '.version_select at 0x7f47054840d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:27.606346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:27.701040 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08f9dcbb-6b4c-4c3b-82d3-7f57e117fa4c tempest-QuotasAdminTestV257-1671509583 tempest-QuotasAdminTestV257-1671509583-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/67068d8e5bc547a791cb4975fd122896?user_id=2b6af24597614b3f827e2b500fb98406" status: 200 len: 190 microversion: 2.57 time: 0.272548 Aug 04 14:04:27.705091 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1165/2296] 10.222.0.66 () {60 vars in 1364 bytes} [Thu Aug 4 14:04:27 2022] GET /compute/v2.1/os-quota-sets/67068d8e5bc547a791cb4975fd122896?user_id=2b6af24597614b3f827e2b500fb98406 => generated 190 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:04:27.726871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:27.729372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:27.756212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:27.757908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:27.764576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:27.767075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:27.926018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:27.934312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:27.942008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lazy-loading 'fault' on Instance uuid 05f8971b-488d-4f79-aabb-16c5e68290dc {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:04:28.794611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:28.811765 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aec0e1c2-5a31-4b00-bb73-0d641f531cc9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 200 len: 1307 microversion: 2.1 time: 1.102371 Aug 04 14:04:28.814950 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1166/2297] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:27 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 1307 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:28.831483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a74d900-5a67-40c5-b23c-93537b523df0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:28.832800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3a74d900-5a67-40c5-b23c-93537b523df0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: ab0715c8-e967-444f-bb46-6e5043791203] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:28.852728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a74d900-5a67-40c5-b23c-93537b523df0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:28.854840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a74d900-5a67-40c5-b23c-93537b523df0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:28.863534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a74d900-5a67-40c5-b23c-93537b523df0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:28.867735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a74d900-5a67-40c5-b23c-93537b523df0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:28.879848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:30.376200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Getting quotas for project dbf6a4f1744e46e3b3947663133a78c1. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:04:30.410925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Getting quotas for user c9932e8de6124b578bf548756f749ef1 and project dbf6a4f1744e46e3b3947663133a78c1. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:04:30.484545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:04:30.485543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:04:30.486228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:04:30.486967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:04:30.487568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:04:30.512136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:30.513142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:30.514518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:30.515237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:30.560000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Getting quotas for project dbf6a4f1744e46e3b3947663133a78c1. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:04:30.576116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Getting quotas for user c9932e8de6124b578bf548756f749ef1 and project dbf6a4f1744e46e3b3947663133a78c1. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:04:30.621251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:04:30.632891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:04:30.756286 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e033c55-dc12-4bba-8d71-099d1272e7e9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 5.394376 Aug 04 14:04:30.771651 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1132/2298] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:04:25 2022] POST /compute/v2.1/servers => generated 407 bytes in 5412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:04:30.784030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ffac5864-af7f-4f01-8247-36be91df6c8d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47007e50d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:31.024131 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ffac5864-af7f-4f01-8247-36be91df6c8d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.247993 Aug 04 14:04:31.030253 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1133/2299] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:30 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:31.047527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:31.048391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 05f8971b-488d-4f79-aabb-16c5e68290dc] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:31.076447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:31.077178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:31.078380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:31.079131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:31.176469 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] HTTP exception thrown: Instance 05f8971b-488d-4f79-aabb-16c5e68290dc could not be found. Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Request method failure captured: Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc HTTP/1.1 Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69EDWjk8b95tqGdbk18GPuGozwNZMHnePh4rGqInVpXlcsZxods5NSI8o2beHWOgPiYxYgeSdUzhBvKE7pxK4NAmY3Al7xCmT8xy6FlNEqgWhypwHE3yDplqLOcxBMcOEoKy-BDFU9hqjVvcfOpNoy2EyZRgsfDLWQnoJ5_ZUcPd2Uw Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ac3308acf403461d902ba64604e3382e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ac3308acf403461d902ba64604e3382e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}] Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 5674b62dd99144ab9663d24b0762c907 Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 05f8971b-488d-4f79-aabb-16c5e68290dc could not be found. Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '05f8971b-488d-4f79-aabb-16c5e68290dc'} Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f8971b-488d-4f79-aabb-16c5e68290dc could not be found. Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f8971b-488d-4f79-aabb-16c5e68290dc could not be found. Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:31.190270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:31.199940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:31.199940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:31.199940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:31.199940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:31.199940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:31.199940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f8971b-488d-4f79-aabb-16c5e68290dc could not be found. Aug 04 14:04:31.199940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:31.202164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Returning 404 to user: Instance 05f8971b-488d-4f79-aabb-16c5e68290dc could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:31.203997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fa1f11a0-8345-4fd4-81f9-d86f0937ede3 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc" status: 404 len: 111 microversion: 2.1 time: 0.168469 Aug 04 14:04:31.208525 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1134/2300] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:31 2022] GET /compute/v2.1/servers/05f8971b-488d-4f79-aabb-16c5e68290dc => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:31.230805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3def706-69e1-44a6-99d1-9c62ec6839b1 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:31.231454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3def706-69e1-44a6-99d1-9c62ec6839b1 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:31.580469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3a74d900-5a67-40c5-b23c-93537b523df0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:31.589972 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a74d900-5a67-40c5-b23c-93537b523df0 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203" status: 200 len: 1523 microversion: 2.1 time: 2.772378 Aug 04 14:04:31.597917 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1167/2301] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:28 2022] GET /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203 => generated 1523 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:31.603726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e90d0c78-c7d7-43ca-b80b-4f2fd322f555 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:31.614553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e90d0c78-c7d7-43ca-b80b-4f2fd322f555 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:31.635681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e90d0c78-c7d7-43ca-b80b-4f2fd322f555 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:31.655026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e90d0c78-c7d7-43ca-b80b-4f2fd322f555 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:31.656100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e90d0c78-c7d7-43ca-b80b-4f2fd322f555 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:31.658713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e90d0c78-c7d7-43ca-b80b-4f2fd322f555 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:31.678276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3def706-69e1-44a6-99d1-9c62ec6839b1 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:31.694902 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3def706-69e1-44a6-99d1-9c62ec6839b1 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1277 microversion: 2.1 time: 0.484242 Aug 04 14:04:31.704158 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1135/2302] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:31 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1277 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:31.798050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e90d0c78-c7d7-43ca-b80b-4f2fd322f555 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:31.825456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-02c5cddf-af4a-41f4-89f6-fa88f70df940 req-a2e5fac3-3796-4388-abc8-8d318ab0d9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1204865f-4b5f-41f3-8f2c-27f15aaa938e", "name": "network-vif-deleted", "tag": "ecfd3a75-5d1b-4c2a-9299-4dd1c69e9faa"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:31.859474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-02c5cddf-af4a-41f4-89f6-fa88f70df940 req-a2e5fac3-3796-4388-abc8-8d318ab0d9fc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:31.859930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-02c5cddf-af4a-41f4-89f6-fa88f70df940 req-a2e5fac3-3796-4388-abc8-8d318ab0d9fc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:31.895462 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-02c5cddf-af4a-41f4-89f6-fa88f70df940 req-a2e5fac3-3796-4388-abc8-8d318ab0d9fc service nova] Creating event network-vif-deleted:ecfd3a75-5d1b-4c2a-9299-4dd1c69e9faa for instance 1204865f-4b5f-41f3-8f2c-27f15aaa938e on n-h1-844627-10 Aug 04 14:04:31.950691 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-02c5cddf-af4a-41f4-89f6-fa88f70df940 req-a2e5fac3-3796-4388-abc8-8d318ab0d9fc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128948 Aug 04 14:04:31.966640 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1136/2303] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:04:32.046743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b7a9fa1-4450-4e04-a565-64d49f8380ec tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3b78280>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:32.174508 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1b7a9fa1-4450-4e04-a565-64d49f8380ec tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.129293 Aug 04 14:04:32.176538 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1137/2304] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:32 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:32.396470 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e90d0c78-c7d7-43ca-b80b-4f2fd322f555 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 204 len: 0 microversion: 2.1 time: 0.787761 Aug 04 14:04:32.409649 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1168/2305] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:31 2022] DELETE /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:32.418317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e32b04df-c97b-41ef-979b-376dfac35d64 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:32.419238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e32b04df-c97b-41ef-979b-376dfac35d64 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:32.438069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e32b04df-c97b-41ef-979b-376dfac35d64 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:32.449854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e32b04df-c97b-41ef-979b-376dfac35d64 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:32.451228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e32b04df-c97b-41ef-979b-376dfac35d64 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:32.455093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e32b04df-c97b-41ef-979b-376dfac35d64 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:32.646093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b52783c3-1539-4a65-aa3a-679332e7bcd4 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:32.672836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b52783c3-1539-4a65-aa3a-679332e7bcd4 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: ab0715c8-e967-444f-bb46-6e5043791203] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:32.743114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e32b04df-c97b-41ef-979b-376dfac35d64 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:32.746271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:32.751057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b52783c3-1539-4a65-aa3a-679332e7bcd4 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:32.757456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b52783c3-1539-4a65-aa3a-679332e7bcd4 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:32.768176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b52783c3-1539-4a65-aa3a-679332e7bcd4 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:32.770116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b52783c3-1539-4a65-aa3a-679332e7bcd4 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:32.775369 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e32b04df-c97b-41ef-979b-376dfac35d64 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1473 microversion: 2.1 time: 0.355144 Aug 04 14:04:32.777843 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1138/2306] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:32 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1473 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:32.798315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-01341d8e-71dd-4500-95cf-56b683fc395c tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:32.799301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-01341d8e-71dd-4500-95cf-56b683fc395c tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:32.823392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01341d8e-71dd-4500-95cf-56b683fc395c tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:32.824138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01341d8e-71dd-4500-95cf-56b683fc395c tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:32.831752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01341d8e-71dd-4500-95cf-56b683fc395c tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:32.835919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01341d8e-71dd-4500-95cf-56b683fc395c tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:33.128043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01341d8e-71dd-4500-95cf-56b683fc395c tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:33.164295 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-01341d8e-71dd-4500-95cf-56b683fc395c tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1281 microversion: 2.1 time: 0.374489 Aug 04 14:04:33.176962 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1139/2307] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:32 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1281 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:33.195146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e6de433d-593d-46a4-9c58-dcc9d275b42a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3cd8700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:33.217623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b52783c3-1539-4a65-aa3a-679332e7bcd4 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c25041b4da41dea0448b9c9b418aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ecbc8173fa949f1913669488544658d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:33.241844 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b52783c3-1539-4a65-aa3a-679332e7bcd4 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203" status: 200 len: 1481 microversion: 2.1 time: 0.607729 Aug 04 14:04:33.242518 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1169/2308] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:32 2022] GET /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203 => generated 1481 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:33.343031 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e6de433d-593d-46a4-9c58-dcc9d275b42a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.153751 Aug 04 14:04:33.352761 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1140/2309] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:33 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:33.826544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3f34cdfd-5122-4dbf-a415-2fce456ecea9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:33.832314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3f34cdfd-5122-4dbf-a415-2fce456ecea9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:33.870308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f34cdfd-5122-4dbf-a415-2fce456ecea9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:33.873902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f34cdfd-5122-4dbf-a415-2fce456ecea9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:33.875530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f34cdfd-5122-4dbf-a415-2fce456ecea9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:33.880943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f34cdfd-5122-4dbf-a415-2fce456ecea9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:34.196331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6126a889-8874-47bf-b4b7-466c04af5dcc tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:34.197227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6126a889-8874-47bf-b4b7-466c04af5dcc tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:34.221264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6126a889-8874-47bf-b4b7-466c04af5dcc tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:34.225669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6126a889-8874-47bf-b4b7-466c04af5dcc tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:34.227090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6126a889-8874-47bf-b4b7-466c04af5dcc tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:34.227812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6126a889-8874-47bf-b4b7-466c04af5dcc tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:34.529590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6126a889-8874-47bf-b4b7-466c04af5dcc tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:34.545568 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6126a889-8874-47bf-b4b7-466c04af5dcc tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1329 microversion: 2.1 time: 0.357408 Aug 04 14:04:34.556629 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1141/2310] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:34 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1329 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:34.579713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-4022ed85-2a9c-4f4b-a25c-69ab57d74a6d req-aec0975c-1832-4042-9873-15da4bc656df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0715c8-e967-444f-bb46-6e5043791203", "name": "network-vif-deleted", "tag": "1097e6b8-3b63-4bbe-9ad8-f070202698fd"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:34.597098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3f34cdfd-5122-4dbf-a415-2fce456ecea9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:34.612193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4022ed85-2a9c-4f4b-a25c-69ab57d74a6d req-aec0975c-1832-4042-9873-15da4bc656df service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:34.612952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4022ed85-2a9c-4f4b-a25c-69ab57d74a6d req-aec0975c-1832-4042-9873-15da4bc656df service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:34.628280 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3f34cdfd-5122-4dbf-a415-2fce456ecea9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1473 microversion: 2.1 time: 0.832920 Aug 04 14:04:34.636256 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1170/2311] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:33 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1473 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:34.652812 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-4022ed85-2a9c-4f4b-a25c-69ab57d74a6d req-aec0975c-1832-4042-9873-15da4bc656df service nova] Creating event network-vif-deleted:1097e6b8-3b63-4bbe-9ad8-f070202698fd for instance ab0715c8-e967-444f-bb46-6e5043791203 on n-h2-844627-10 Aug 04 14:04:34.658563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:34.660145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: ab0715c8-e967-444f-bb46-6e5043791203] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:34.667966 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-4022ed85-2a9c-4f4b-a25c-69ab57d74a6d req-aec0975c-1832-4042-9873-15da4bc656df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109625 Aug 04 14:04:34.674493 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1142/2312] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:34.683856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:34.686535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-382345b4-8529-44eb-a78e-609177b119e9 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3cd8b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:34.695363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:34.717521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:34.719000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:34.763262 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] HTTP exception thrown: Instance ab0715c8-e967-444f-bb46-6e5043791203 could not be found. Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Request method failure captured: Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203 HTTP/1.1 Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69GvMhcLwgdDVIZ3SvKBFy-aGQ5sZ3IRQ54V6TsgGeAOIDbYqxaIKwXG5nJmdpGDEpK6oXZzE2W_n2ii-PjdU0B53n7qhX7tXRfPuv00FUjTAoNmfmhO5NN4a2AfOmovXoCnLt-_jGu1OdbjVOzIyhzJsUky964KqEal130kaTyX1AQ Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6ecbc8173fa949f1913669488544658d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6ecbc8173fa949f1913669488544658d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}] Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c2c25041b4da41dea0448b9c9b418aa4 Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance ab0715c8-e967-444f-bb46-6e5043791203 could not be found. Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'ab0715c8-e967-444f-bb46-6e5043791203'} Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab0715c8-e967-444f-bb46-6e5043791203 could not be found. Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab0715c8-e967-444f-bb46-6e5043791203 could not be found. Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.766370 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:34.770235 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.770235 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:34.770235 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:34.770235 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:34.770235 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:34.770235 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:34.770235 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab0715c8-e967-444f-bb46-6e5043791203 could not be found. Aug 04 14:04:34.770235 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.770235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Returning 404 to user: Instance ab0715c8-e967-444f-bb46-6e5043791203 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:34.772139 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-88c37e67-75fe-4542-963b-4ca5a8dfe62c tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203" status: 404 len: 111 microversion: 2.1 time: 0.131981 Aug 04 14:04:34.772139 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1171/2313] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:34 2022] GET /compute/v2.1/servers/ab0715c8-e967-444f-bb46-6e5043791203 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:34.782707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:34.783429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] [instance: 1204865f-4b5f-41f3-8f2c-27f15aaa938e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:34.803317 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-382345b4-8529-44eb-a78e-609177b119e9 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.127305 Aug 04 14:04:34.804231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:34.804805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:34.805882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:34.806675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:34.812711 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1143/2314] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:34 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:34.855686 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] HTTP exception thrown: Instance 1204865f-4b5f-41f3-8f2c-27f15aaa938e could not be found. Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Request method failure captured: Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e HTTP/1.1 Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69GvMhcLwgdDVIZ3SvKBFy-aGQ5sZ3IRQ54V6TsgGeAOIDbYqxaIKwXG5nJmdpGDEpK6oXZzE2W_n2ii-PjdU0B53n7qhX7tXRfPuv00FUjTAoNmfmhO5NN4a2AfOmovXoCnLt-_jGu1OdbjVOzIyhzJsUky964KqEal130kaTyX1AQ Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_6ecbc8173fa949f1913669488544658d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/6ecbc8173fa949f1913669488544658d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/6ecbc8173fa949f1913669488544658d"}]}] Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 6ecbc8173fa949f1913669488544658d Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-401579436 Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c2c25041b4da41dea0448b9c9b418aa4 Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListServersNegativeTestJSON-401579436-project Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 1204865f-4b5f-41f3-8f2c-27f15aaa938e could not be found. Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '1204865f-4b5f-41f3-8f2c-27f15aaa938e'} Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1204865f-4b5f-41f3-8f2c-27f15aaa938e could not be found. Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1204865f-4b5f-41f3-8f2c-27f15aaa938e could not be found. Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.857955 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:34.861248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.861248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:34.861248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:34.861248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:34.861248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:34.861248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:34.861248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1204865f-4b5f-41f3-8f2c-27f15aaa938e could not be found. Aug 04 14:04:34.861248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:34.861248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] Returning 404 to user: Instance 1204865f-4b5f-41f3-8f2c-27f15aaa938e could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:34.861725 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fee78c34-d1bb-4947-b7e8-51f15ab040e2 tempest-ListServersNegativeTestJSON-401579436 tempest-ListServersNegativeTestJSON-401579436-project] 10.222.0.66 "GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e" status: 404 len: 111 microversion: 2.1 time: 0.082203 Aug 04 14:04:34.867573 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1172/2315] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:34 2022] GET /compute/v2.1/servers/1204865f-4b5f-41f3-8f2c-27f15aaa938e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:35.573397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1ffc820-2b56-4849-a6a3-e0b6f4233f75 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:35.574317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1ffc820-2b56-4849-a6a3-e0b6f4233f75 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:35.592514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1ffc820-2b56-4849-a6a3-e0b6f4233f75 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:35.592814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1ffc820-2b56-4849-a6a3-e0b6f4233f75 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:35.602759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1ffc820-2b56-4849-a6a3-e0b6f4233f75 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:35.605791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1ffc820-2b56-4849-a6a3-e0b6f4233f75 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:35.667916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:35.672288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:35.704407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:35.708365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:35.710672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:35.714475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:35.797164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:35.797998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:35.799765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lazy-loading 'fault' on Instance uuid 2ef4772e-29b4-455f-8f48-9d9011226e91 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:04:35.927055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:35.941175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1ffc820-2b56-4849-a6a3-e0b6f4233f75 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:35.954420 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e8a37d08-5838-4ff1-8c34-097d0666a052 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 200 len: 1307 microversion: 2.1 time: 0.300565 Aug 04 14:04:35.956380 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1173/2316] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:35 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 1307 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:35.967688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f604e03e-d2bc-4982-98d7-39ba70a2667f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47006d1e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:35.974672 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1ffc820-2b56-4849-a6a3-e0b6f4233f75 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1335 microversion: 2.1 time: 0.406329 Aug 04 14:04:35.978724 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1144/2317] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:35 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1335 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:36.204081 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f604e03e-d2bc-4982-98d7-39ba70a2667f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.239532 Aug 04 14:04:36.248753 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1174/2318] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:35 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:36.739537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d73fa0e6-b6ce-4ee6-8a84-084b35e6cc6d req-3d06fe92-09e9-4fc3-ad0c-352710edcb5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef4772e-29b4-455f-8f48-9d9011226e91", "name": "network-vif-deleted", "tag": "dc89b1d8-aee1-4467-a5f3-d98a32bb14b7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:36.760156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d73fa0e6-b6ce-4ee6-8a84-084b35e6cc6d req-3d06fe92-09e9-4fc3-ad0c-352710edcb5a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:36.769558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d73fa0e6-b6ce-4ee6-8a84-084b35e6cc6d req-3d06fe92-09e9-4fc3-ad0c-352710edcb5a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:36.800605 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d73fa0e6-b6ce-4ee6-8a84-084b35e6cc6d req-3d06fe92-09e9-4fc3-ad0c-352710edcb5a service nova] Creating event network-vif-deleted:dc89b1d8-aee1-4467-a5f3-d98a32bb14b7 for instance 2ef4772e-29b4-455f-8f48-9d9011226e91 on n-h2-844627-10 Aug 04 14:04:36.819943 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d73fa0e6-b6ce-4ee6-8a84-084b35e6cc6d req-3d06fe92-09e9-4fc3-ad0c-352710edcb5a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084675 Aug 04 14:04:36.825050 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1145/2319] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:36.976895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=11 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:36.982820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:36.983455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 2ef4772e-29b4-455f-8f48-9d9011226e91] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:37.004858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c7c094db-68c4-4fe8-b57d-5492dea4e615 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:37.006100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c7c094db-68c4-4fe8-b57d-5492dea4e615 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:37.015249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:37.019397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:37.026447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:37.026963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:37.034628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7c094db-68c4-4fe8-b57d-5492dea4e615 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:37.035092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7c094db-68c4-4fe8-b57d-5492dea4e615 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:37.035944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7c094db-68c4-4fe8-b57d-5492dea4e615 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:37.036405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7c094db-68c4-4fe8-b57d-5492dea4e615 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:37.072065 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] HTTP exception thrown: Instance 2ef4772e-29b4-455f-8f48-9d9011226e91 could not be found. Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Request method failure captured: Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 HTTP/1.1 Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69EDWjk8b95tqGdbk18GPuGozwNZMHnePh4rGqInVpXlcsZxods5NSI8o2beHWOgPiYxYgeSdUzhBvKE7pxK4NAmY3Al7xCmT8xy6FlNEqgWhypwHE3yDplqLOcxBMcOEoKy-BDFU9hqjVvcfOpNoy2EyZRgsfDLWQnoJ5_ZUcPd2Uw Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ac3308acf403461d902ba64604e3382e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ac3308acf403461d902ba64604e3382e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}] Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 5674b62dd99144ab9663d24b0762c907 Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 2ef4772e-29b4-455f-8f48-9d9011226e91 could not be found. Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '2ef4772e-29b4-455f-8f48-9d9011226e91'} Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef4772e-29b4-455f-8f48-9d9011226e91 could not be found. Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef4772e-29b4-455f-8f48-9d9011226e91 could not be found. Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:37.074089 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:37.077439 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:37.077439 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:37.077439 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:37.077439 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:37.077439 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:37.077439 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef4772e-29b4-455f-8f48-9d9011226e91 could not be found. Aug 04 14:04:37.077439 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:37.082381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Returning 404 to user: Instance 2ef4772e-29b4-455f-8f48-9d9011226e91 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:37.083618 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-493d39b6-5ec4-4bc9-8a51-510a858ae8b4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91" status: 404 len: 111 microversion: 2.1 time: 0.107601 Aug 04 14:04:37.091667 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1175/2320] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:36 2022] GET /compute/v2.1/servers/2ef4772e-29b4-455f-8f48-9d9011226e91 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:04:37.097065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f999796f-d6ed-4dab-8240-2621fb92b54c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:37.103344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f999796f-d6ed-4dab-8240-2621fb92b54c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:37.123801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f999796f-d6ed-4dab-8240-2621fb92b54c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:37.124589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f999796f-d6ed-4dab-8240-2621fb92b54c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:37.125681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f999796f-d6ed-4dab-8240-2621fb92b54c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:37.126343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f999796f-d6ed-4dab-8240-2621fb92b54c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:37.198336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f999796f-d6ed-4dab-8240-2621fb92b54c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:37.299404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c7c094db-68c4-4fe8-b57d-5492dea4e615 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:37.312853 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c7c094db-68c4-4fe8-b57d-5492dea4e615 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1335 microversion: 2.1 time: 0.312467 Aug 04 14:04:37.314173 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1146/2321] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:36 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1335 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:37.325255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ea7c888-6091-4104-be1c-ac4416637a16 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3a8b4c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:37.446921 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f999796f-d6ed-4dab-8240-2621fb92b54c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 204 len: 0 microversion: 2.1 time: 0.351215 Aug 04 14:04:37.448737 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1176/2322] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:37 2022] DELETE /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:37.465883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f049108-743e-49c0-a665-7c5809a72a51 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:37.466499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f049108-743e-49c0-a665-7c5809a72a51 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:37.490227 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ea7c888-6091-4104-be1c-ac4416637a16 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1438 microversion: 2.1 time: 0.174557 Aug 04 14:04:37.493237 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1147/2323] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:37 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1438 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:37.502574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f049108-743e-49c0-a665-7c5809a72a51 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:37.503025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f049108-743e-49c0-a665-7c5809a72a51 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:37.504053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f049108-743e-49c0-a665-7c5809a72a51 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:37.504670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f049108-743e-49c0-a665-7c5809a72a51 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:37.666294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=24 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:37.995477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f049108-743e-49c0-a665-7c5809a72a51 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:38.033209 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f049108-743e-49c0-a665-7c5809a72a51 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1472 microversion: 2.1 time: 0.570545 Aug 04 14:04:38.034041 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1177/2324] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:37 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1472 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:38.362428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4d3274a-bf3c-44b1-b2e2-b76467c64bcf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:38.363847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b4d3274a-bf3c-44b1-b2e2-b76467c64bcf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:38.373829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4d3274a-bf3c-44b1-b2e2-b76467c64bcf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:38.374980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4d3274a-bf3c-44b1-b2e2-b76467c64bcf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:38.376619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4d3274a-bf3c-44b1-b2e2-b76467c64bcf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:38.377524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4d3274a-bf3c-44b1-b2e2-b76467c64bcf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:38.531117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4d3274a-bf3c-44b1-b2e2-b76467c64bcf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:38.545863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4d3274a-bf3c-44b1-b2e2-b76467c64bcf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1335 microversion: 2.1 time: 0.192223 Aug 04 14:04:38.548440 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1178/2325] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:38 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1335 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:38.555414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f507ae16-6920-4fce-9d52-503aaf05bb67 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f4700503c10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:38.605163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8228ee5d-bfe8-4f03-9ea4-e7bde686ca81 tempest-FlavorsV2NegativeTest-2018022329 tempest-FlavorsV2NegativeTest-2018022329-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:38.624813 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8228ee5d-bfe8-4f03-9ea4-e7bde686ca81 tempest-FlavorsV2NegativeTest-2018022329 tempest-FlavorsV2NegativeTest-2018022329-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.282826 Aug 04 14:04:38.629707 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1148/2326] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:04:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:04:38.667618 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f507ae16-6920-4fce-9d52-503aaf05bb67 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1447 microversion: 2.1 time: 0.116763 Aug 04 14:04:38.677504 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1179/2327] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:38 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1447 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:38.702295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4cb2996-af29-4f08-8957-8decae6c8397 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3cea550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:38.808526 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4cb2996-af29-4f08-8957-8decae6c8397 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 200 len: 1447 microversion: 2.1 time: 0.111128 Aug 04 14:04:38.809627 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1149/2328] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:04:38 2022] GET /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 1447 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:38.824593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c9c8c1a1-146d-4459-9f0e-290b00af3cd2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3f4faf0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:39.062970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b7c89f70-7e12-4819-b8f6-9d43e1eb426c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:39.064721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b7c89f70-7e12-4819-b8f6-9d43e1eb426c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:39.095011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7c89f70-7e12-4819-b8f6-9d43e1eb426c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:39.096061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7c89f70-7e12-4819-b8f6-9d43e1eb426c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:39.101625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7c89f70-7e12-4819-b8f6-9d43e1eb426c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:39.109486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7c89f70-7e12-4819-b8f6-9d43e1eb426c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:39.692521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b7c89f70-7e12-4819-b8f6-9d43e1eb426c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:39.717107 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b7c89f70-7e12-4819-b8f6-9d43e1eb426c tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1472 microversion: 2.1 time: 0.664497 Aug 04 14:04:39.726383 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1150/2329] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:39 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1472 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:39.740060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5750050-8eb2-4c06-bbeb-1ca7ee7289b3 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:39.756043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d5750050-8eb2-4c06-bbeb-1ca7ee7289b3 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:39.775610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5750050-8eb2-4c06-bbeb-1ca7ee7289b3 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:39.781558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5750050-8eb2-4c06-bbeb-1ca7ee7289b3 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:39.783343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5750050-8eb2-4c06-bbeb-1ca7ee7289b3 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:39.784593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5750050-8eb2-4c06-bbeb-1ca7ee7289b3 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:40.385497 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c9c8c1a1-146d-4459-9f0e-290b00af3cd2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 204 len: 0 microversion: 2.1 time: 1.565913 Aug 04 14:04:40.393738 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1180/2330] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:38 2022] DELETE /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 0 bytes in 1568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:04:40.406230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ea65dcb5-c1fc-42d5-aaf4-c6a2d1f244c3 tempest-FlavorsV2NegativeTest-2018022329 tempest-FlavorsV2NegativeTest-2018022329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-315616744", "imageRef": "80cc8567-3433-483d-bfef-bd910e1d1b32", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:40.474162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d5750050-8eb2-4c06-bbeb-1ca7ee7289b3 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:40.486339 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5750050-8eb2-4c06-bbeb-1ca7ee7289b3 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1401 microversion: 2.1 time: 0.757993 Aug 04 14:04:40.489610 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1151/2331] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:39 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1401 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:40.513748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-ea65dcb5-c1fc-42d5-aaf4-c6a2d1f244c3 tempest-FlavorsV2NegativeTest-2018022329 tempest-FlavorsV2NegativeTest-2018022329-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:04:40.516257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-527db412-0f95-4859-b813-c8ab599708f4 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:40.518621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-527db412-0f95-4859-b813-c8ab599708f4 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:40.526118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-527db412-0f95-4859-b813-c8ab599708f4 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:40.526852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-527db412-0f95-4859-b813-c8ab599708f4 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:40.527704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-527db412-0f95-4859-b813-c8ab599708f4 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:40.528156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-527db412-0f95-4859-b813-c8ab599708f4 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:40.535258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=16 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:41.005353 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-ea65dcb5-c1fc-42d5-aaf4-c6a2d1f244c3 tempest-FlavorsV2NegativeTest-2018022329 tempest-FlavorsV2NegativeTest-2018022329-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ea65dcb5-c1fc-42d5-aaf4-c6a2d1f244c3 tempest-FlavorsV2NegativeTest-2018022329 tempest-FlavorsV2NegativeTest-2018022329-project] Request method failure captured: Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 142 Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69H2PMgNzgJF8hIM_iQkvGCs8Us5ZGHAPLroYsaApdEe2MPtooWPZIAl7if_C2N60oEEraKUxmxdfokuC4uILOsi6tdXe6q4GvOXZgiMzyUStFJDz4Xp7Ujt-NWFUMtvmU8CwuLT7UO8KSLuSm4uba5rJhEHul-kttxOZQpGLUgTDXE Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c0478e81449d430a9f7c96f7047192fe Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FlavorsV2NegativeTest-2018022329 Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0478e81449d430a9f7c96f7047192fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c0478e81449d430a9f7c96f7047192fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c0478e81449d430a9f7c96f7047192fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c0478e81449d430a9f7c96f7047192fe"}]}] Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FlavorsV2NegativeTest-2018022329 Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c0478e81449d430a9f7c96f7047192fe Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-2018022329 Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FlavorsV2NegativeTest-2018022329-project Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 82f913ed9b5d4abc93284ebc534816c9 Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FlavorsV2NegativeTest-2018022329-project Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-315616744", "imageRef": "80cc8567-3433-483d-bfef-bd910e1d1b32", "flavorRef": "452"}} Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: exception: Flavor's memory is too small for requested image. Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-315616744', 'imageRef': '80cc8567-3433-483d-bfef-bd910e1d1b32', 'flavorRef': '452'}}} Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:41.007775 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ea65dcb5-c1fc-42d5-aaf4-c6a2d1f244c3 tempest-FlavorsV2NegativeTest-2018022329 tempest-FlavorsV2NegativeTest-2018022329-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ea65dcb5-c1fc-42d5-aaf4-c6a2d1f244c3 tempest-FlavorsV2NegativeTest-2018022329 tempest-FlavorsV2NegativeTest-2018022329-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.613450 Aug 04 14:04:41.019808 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1181/2332] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:04:40 2022] POST /compute/v2.1/servers => generated 93 bytes in 619 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 14:04:41.027658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-85733a38-6e81-4a38-8afa-1ffd4896a392 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:41.027658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-85733a38-6e81-4a38-8afa-1ffd4896a392 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:41.042198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85733a38-6e81-4a38-8afa-1ffd4896a392 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.042670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85733a38-6e81-4a38-8afa-1ffd4896a392 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.043832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85733a38-6e81-4a38-8afa-1ffd4896a392 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.044326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85733a38-6e81-4a38-8afa-1ffd4896a392 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.067156 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-527db412-0f95-4859-b813-c8ab599708f4 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1862 microversion: 2.1 time: 0.574907 Aug 04 14:04:41.089629 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1152/2333] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:40 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1862 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:41.120356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:41.121549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:41.143058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.143775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.152040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.153025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.197521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-85733a38-6e81-4a38-8afa-1ffd4896a392 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:41.294192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.297323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.299225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lazy-loading 'fault' on Instance uuid a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:04:41.522076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:41.535286 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-12c7a890-065c-4b9b-8465-16bf13173d20 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 200 len: 1306 microversion: 2.1 time: 0.444061 Aug 04 14:04:41.536599 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1153/2334] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:41 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 1306 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:41.557981 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-85733a38-6e81-4a38-8afa-1ffd4896a392 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 204 len: 0 microversion: 2.1 time: 0.539991 Aug 04 14:04:41.565583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e5bb8911-cd8a-4866-9c5c-bedf6864dc29 req-d429997c-8985-4327-9e63-40eceb296ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07", "name": "network-vif-deleted", "tag": "32c2024a-da50-4c37-8155-c09ff79e916f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:41.568321 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1182/2335] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:41 2022] DELETE /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:41.603198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-156d2a3c-fc3c-4a1c-8075-ccb1ae04368a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844627-10", "block_migration": true, "disk_over_commit": false}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:41.605991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e5bb8911-cd8a-4866-9c5c-bedf6864dc29 req-d429997c-8985-4327-9e63-40eceb296ab4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.610479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e5bb8911-cd8a-4866-9c5c-bedf6864dc29 req-d429997c-8985-4327-9e63-40eceb296ab4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.615789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-156d2a3c-fc3c-4a1c-8075-ccb1ae04368a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:41.641479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156d2a3c-fc3c-4a1c-8075-ccb1ae04368a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.643577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156d2a3c-fc3c-4a1c-8075-ccb1ae04368a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.645750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156d2a3c-fc3c-4a1c-8075-ccb1ae04368a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.646855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156d2a3c-fc3c-4a1c-8075-ccb1ae04368a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.689050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=20 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:41.697939 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e5bb8911-cd8a-4866-9c5c-bedf6864dc29 req-d429997c-8985-4327-9e63-40eceb296ab4 service nova] Creating event network-vif-deleted:32c2024a-da50-4c37-8155-c09ff79e916f for instance a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 on n-h2-844627-10 Aug 04 14:04:41.726480 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e5bb8911-cd8a-4866-9c5c-bedf6864dc29 req-d429997c-8985-4327-9e63-40eceb296ab4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180526 Aug 04 14:04:41.729199 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1154/2336] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:41.760393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8d725fa9-53ef-4734-9145-131dbc42d6b6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:41.764217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8d725fa9-53ef-4734-9145-131dbc42d6b6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:41.797405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d725fa9-53ef-4734-9145-131dbc42d6b6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.798792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d725fa9-53ef-4734-9145-131dbc42d6b6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.801973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d725fa9-53ef-4734-9145-131dbc42d6b6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:41.802984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d725fa9-53ef-4734-9145-131dbc42d6b6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:41.826215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-156d2a3c-fc3c-4a1c-8075-ccb1ae04368a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lazy-loading 'flavor' on Instance uuid 739d0629-de24-4a72-83a0-2f443e0af803 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:04:41.875452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-156d2a3c-fc3c-4a1c-8075-ccb1ae04368a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Going to try to live migrate instance to n-h1-844627-10 {{(pid=130961) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 14:04:41.955232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:42.107414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d725fa9-53ef-4734-9145-131dbc42d6b6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:42.118048 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8d725fa9-53ef-4734-9145-131dbc42d6b6 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1401 microversion: 2.1 time: 0.379228 Aug 04 14:04:42.118955 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1155/2337] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:41 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1401 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:42.125203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1620883576", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "6d686b9e-cdea-4698-acf7-93f34e28847e"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:42.204593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] validate_networks() for [('6d686b9e-cdea-4698-acf7-93f34e28847e', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:04:43.110283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:04:43.110989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:04:43.111281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:04:43.111891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:04:43.112529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:04:43.131323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:43.135647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:43.138022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:43.145738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:43.188601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Getting quotas for project 2c78c75d748a4fe29f1bcdbe40d280a9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:04:43.199233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Getting quotas for user 69f66d07b9ed48d0b9e2763d9659df3f and project 2c78c75d748a4fe29f1bcdbe40d280a9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:04:43.232136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:04:43.237745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:04:43.322018 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e8e4d664-293a-49b6-afb0-ecfc70eacd5b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201365 Aug 04 14:04:43.325382 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1156/2338] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:04:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:04:43.338132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:43.339488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:43.366019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:43.368228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:43.371261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:43.372221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:43.417427 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] HTTP exception thrown: Instance a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 could not be found. Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Request method failure captured: Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 HTTP/1.1 Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69EDWjk8b95tqGdbk18GPuGozwNZMHnePh4rGqInVpXlcsZxods5NSI8o2beHWOgPiYxYgeSdUzhBvKE7pxK4NAmY3Al7xCmT8xy6FlNEqgWhypwHE3yDplqLOcxBMcOEoKy-BDFU9hqjVvcfOpNoy2EyZRgsfDLWQnoJ5_ZUcPd2Uw Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ac3308acf403461d902ba64604e3382e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ac3308acf403461d902ba64604e3382e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}] Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 5674b62dd99144ab9663d24b0762c907 Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 could not be found. Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07'} Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 could not be found. Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 could not be found. Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:43.431509 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:43.435162 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:43.435162 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:43.435162 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:43.435162 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:43.435162 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:43.435162 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 could not be found. Aug 04 14:04:43.435162 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:43.435162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Returning 404 to user: Instance a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:43.437244 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c45c0686-6ec1-4bdf-ab23-e5b17b5df20a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07" status: 404 len: 111 microversion: 2.1 time: 0.109261 Aug 04 14:04:43.441395 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1157/2339] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:43 2022] GET /compute/v2.1/servers/a7dc33f1-e9a4-4c2b-bc38-8c2a99275b07 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:44.047448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5754c0e4-8111-42ea-a17b-c954c798540d req-de883533-6407-46a7-870c-e843e9525d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce31a57-07b2-4d87-9822-58690ae581d6", "tag": "2b5dd98f-40d9-4142-b50c-f6c8fb356c9e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:44.091882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5754c0e4-8111-42ea-a17b-c954c798540d req-de883533-6407-46a7-870c-e843e9525d87 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:44.092333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5754c0e4-8111-42ea-a17b-c954c798540d req-de883533-6407-46a7-870c-e843e9525d87 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:44.124927 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5754c0e4-8111-42ea-a17b-c954c798540d req-de883533-6407-46a7-870c-e843e9525d87 service nova] Creating event network-changed:2b5dd98f-40d9-4142-b50c-f6c8fb356c9e for instance 5ce31a57-07b2-4d87-9822-58690ae581d6 on n-h2-844627-10 Aug 04 14:04:44.136645 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5754c0e4-8111-42ea-a17b-c954c798540d req-de883533-6407-46a7-870c-e843e9525d87 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.691683 Aug 04 14:04:44.138137 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1158/2340] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:44.149199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-8d80ebb0-0584-435d-a286-1e36678dc178 req-5a297e98-5f4a-4993-96b2-abd04e393698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7a6c65-5f80-48bb-a324-23c01af35738", "name": "network-vif-unplugged", "status": "completed", "tag": "847a36f8-843d-46a5-9321-5c09ee823490"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:44.177917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8d80ebb0-0584-435d-a286-1e36678dc178 req-5a297e98-5f4a-4993-96b2-abd04e393698 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:44.179871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8d80ebb0-0584-435d-a286-1e36678dc178 req-5a297e98-5f4a-4993-96b2-abd04e393698 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:44.211869 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-8d80ebb0-0584-435d-a286-1e36678dc178 req-5a297e98-5f4a-4993-96b2-abd04e393698 service nova] Creating event network-vif-unplugged:847a36f8-843d-46a5-9321-5c09ee823490 for instance 4f7a6c65-5f80-48bb-a324-23c01af35738 on n-h1-844627-10 Aug 04 14:04:44.222313 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-8d80ebb0-0584-435d-a286-1e36678dc178 req-5a297e98-5f4a-4993-96b2-abd04e393698 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082432 Aug 04 14:04:44.227026 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1159/2341] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:44.236984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0e30a77b-136c-4666-b7be-94ca1c4fd0bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:44.238819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0e30a77b-136c-4666-b7be-94ca1c4fd0bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:44.269208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e30a77b-136c-4666-b7be-94ca1c4fd0bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:44.271107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e30a77b-136c-4666-b7be-94ca1c4fd0bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:44.273986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e30a77b-136c-4666-b7be-94ca1c4fd0bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:44.275073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e30a77b-136c-4666-b7be-94ca1c4fd0bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:44.670193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e30a77b-136c-4666-b7be-94ca1c4fd0bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:44.702472 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0e30a77b-136c-4666-b7be-94ca1c4fd0bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1401 microversion: 2.1 time: 0.472451 Aug 04 14:04:44.718372 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1160/2342] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:44 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1401 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:44.737463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a420008-ff02-4e0b-b8c6-a1f1b885f048 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:44.739883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8a420008-ff02-4e0b-b8c6-a1f1b885f048 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:44.748823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:44.757030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a420008-ff02-4e0b-b8c6-a1f1b885f048 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:44.757127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a420008-ff02-4e0b-b8c6-a1f1b885f048 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:44.758055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a420008-ff02-4e0b-b8c6-a1f1b885f048 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:44.758651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a420008-ff02-4e0b-b8c6-a1f1b885f048 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:44.873273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a420008-ff02-4e0b-b8c6-a1f1b885f048 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:44.884534 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8a420008-ff02-4e0b-b8c6-a1f1b885f048 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1204 microversion: 2.1 time: 0.164397 Aug 04 14:04:44.886986 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1161/2343] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:44 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1204 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:44.894313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-34202792-be05-499d-a2d0-20a88d338245 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:44.895041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-34202792-be05-499d-a2d0-20a88d338245 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:44.907071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34202792-be05-499d-a2d0-20a88d338245 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:44.907735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34202792-be05-499d-a2d0-20a88d338245 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:44.909018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34202792-be05-499d-a2d0-20a88d338245 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:44.909709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34202792-be05-499d-a2d0-20a88d338245 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:44.989613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-34202792-be05-499d-a2d0-20a88d338245 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:45.237709 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-34202792-be05-499d-a2d0-20a88d338245 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 204 len: 0 microversion: 2.1 time: 0.348754 Aug 04 14:04:45.239345 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1162/2344] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:44 2022] DELETE /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:45.251204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-890cebe1-66c3-4c20-87b5-fe01a6c8a75b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:45.252444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-890cebe1-66c3-4c20-87b5-fe01a6c8a75b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:45.283568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-890cebe1-66c3-4c20-87b5-fe01a6c8a75b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:45.283950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-890cebe1-66c3-4c20-87b5-fe01a6c8a75b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:45.284955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-890cebe1-66c3-4c20-87b5-fe01a6c8a75b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:45.285557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-890cebe1-66c3-4c20-87b5-fe01a6c8a75b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:45.292519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:45.401585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-890cebe1-66c3-4c20-87b5-fe01a6c8a75b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:45.539104 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-890cebe1-66c3-4c20-87b5-fe01a6c8a75b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9" status: 204 len: 0 microversion: 2.1 time: 0.293718 Aug 04 14:04:45.542970 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1163/2345] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:45 2022] DELETE /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:04:45.554611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-96b5be8a-5feb-4b2a-ba8b-aba443e1be70 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:45.555759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-96b5be8a-5feb-4b2a-ba8b-aba443e1be70 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:45.570835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96b5be8a-5feb-4b2a-ba8b-aba443e1be70 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:45.571495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96b5be8a-5feb-4b2a-ba8b-aba443e1be70 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:45.572564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96b5be8a-5feb-4b2a-ba8b-aba443e1be70 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:45.573146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96b5be8a-5feb-4b2a-ba8b-aba443e1be70 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:45.786107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-96b5be8a-5feb-4b2a-ba8b-aba443e1be70 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:45.799737 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-96b5be8a-5feb-4b2a-ba8b-aba443e1be70 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1473 microversion: 2.1 time: 0.253576 Aug 04 14:04:45.814306 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1164/2346] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:45 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1473 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:45.821170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cec76b2-4766-4ba8-944f-dc9381e1bf20 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:45.822489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8cec76b2-4766-4ba8-944f-dc9381e1bf20 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:45.884922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cec76b2-4766-4ba8-944f-dc9381e1bf20 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:45.885709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cec76b2-4766-4ba8-944f-dc9381e1bf20 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:45.887368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cec76b2-4766-4ba8-944f-dc9381e1bf20 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:45.887839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cec76b2-4766-4ba8-944f-dc9381e1bf20 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:46.203093 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-156d2a3c-fc3c-4a1c-8075-ccb1ae04368a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/action" status: 202 len: 0 microversion: 2.1 time: 4.630198 Aug 04 14:04:46.203824 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1183/2347] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:04:41 2022] POST /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/action => generated 0 bytes in 4635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:04:46.217340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-40d73733-9aba-4ea1-91b0-1075040bd907 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:46.220829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-40d73733-9aba-4ea1-91b0-1075040bd907 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:46.252469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40d73733-9aba-4ea1-91b0-1075040bd907 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:46.259708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40d73733-9aba-4ea1-91b0-1075040bd907 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:46.264113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40d73733-9aba-4ea1-91b0-1075040bd907 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:46.265580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40d73733-9aba-4ea1-91b0-1075040bd907 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:46.350109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8cec76b2-4766-4ba8-944f-dc9381e1bf20 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:46.372309 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8cec76b2-4766-4ba8-944f-dc9381e1bf20 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1401 microversion: 2.1 time: 0.555711 Aug 04 14:04:46.373436 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1165/2348] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:45 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1401 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:46.414659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-40d73733-9aba-4ea1-91b0-1075040bd907 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:46.461832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9788d871-4ec8-447d-834a-f3e87e214f1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:46.466099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9788d871-4ec8-447d-834a-f3e87e214f1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:46.493956 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-40d73733-9aba-4ea1-91b0-1075040bd907 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1260 microversion: 2.1 time: 0.288717 Aug 04 14:04:46.502297 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1184/2349] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:46 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1260 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:46.516005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9788d871-4ec8-447d-834a-f3e87e214f1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:46.516974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9788d871-4ec8-447d-834a-f3e87e214f1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:46.536561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9788d871-4ec8-447d-834a-f3e87e214f1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:46.538366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9788d871-4ec8-447d-834a-f3e87e214f1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:46.543152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-bcd4be47-0e34-4d4c-99e7-bb84dd90594f req-209bfdf4-290d-4578-81a7-9149d6602966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f7a6c65-5f80-48bb-a324-23c01af35738", "name": "network-vif-deleted", "tag": "847a36f8-843d-46a5-9321-5c09ee823490"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:46.597457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bcd4be47-0e34-4d4c-99e7-bb84dd90594f req-209bfdf4-290d-4578-81a7-9149d6602966 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:46.605456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bcd4be47-0e34-4d4c-99e7-bb84dd90594f req-209bfdf4-290d-4578-81a7-9149d6602966 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:46.664034 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bcd4be47-0e34-4d4c-99e7-bb84dd90594f req-209bfdf4-290d-4578-81a7-9149d6602966 service nova] Creating event network-vif-deleted:847a36f8-843d-46a5-9321-5c09ee823490 for instance 4f7a6c65-5f80-48bb-a324-23c01af35738 on n-h1-844627-10 Aug 04 14:04:46.682063 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-bcd4be47-0e34-4d4c-99e7-bb84dd90594f req-209bfdf4-290d-4578-81a7-9149d6602966 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174433 Aug 04 14:04:46.683177 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1185/2350] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:46.828827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d43829bd-ee34-4c30-b02a-d2c3a863e49f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:46.831019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d43829bd-ee34-4c30-b02a-d2c3a863e49f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:46.843656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d43829bd-ee34-4c30-b02a-d2c3a863e49f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:46.844361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d43829bd-ee34-4c30-b02a-d2c3a863e49f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:46.845529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d43829bd-ee34-4c30-b02a-d2c3a863e49f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:46.846200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d43829bd-ee34-4c30-b02a-d2c3a863e49f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:46.910055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9788d871-4ec8-447d-834a-f3e87e214f1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:46.921841 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9788d871-4ec8-447d-834a-f3e87e214f1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 0.545817 Aug 04 14:04:46.923175 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1166/2351] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:46 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:47.352518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d43829bd-ee34-4c30-b02a-d2c3a863e49f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:47.368451 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d43829bd-ee34-4c30-b02a-d2c3a863e49f tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1473 microversion: 2.1 time: 0.549766 Aug 04 14:04:47.369452 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1186/2352] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:46 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1473 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:47.422996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8bceeca0-57bb-4005-8886-4751edadb59a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:47.422996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8bceeca0-57bb-4005-8886-4751edadb59a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:47.463628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bceeca0-57bb-4005-8886-4751edadb59a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:47.464458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bceeca0-57bb-4005-8886-4751edadb59a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:47.466028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bceeca0-57bb-4005-8886-4751edadb59a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:47.466836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bceeca0-57bb-4005-8886-4751edadb59a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:47.544125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8211a09b-d148-4073-9c10-9a677c7c6b71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:47.545033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8211a09b-d148-4073-9c10-9a677c7c6b71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:47.560537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8211a09b-d148-4073-9c10-9a677c7c6b71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:47.563524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8211a09b-d148-4073-9c10-9a677c7c6b71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:47.566096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8211a09b-d148-4073-9c10-9a677c7c6b71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:47.566815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8211a09b-d148-4073-9c10-9a677c7c6b71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:48.437289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8211a09b-d148-4073-9c10-9a677c7c6b71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:48.487520 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8211a09b-d148-4073-9c10-9a677c7c6b71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1266 microversion: 2.1 time: 0.944944 Aug 04 14:04:48.489070 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1187/2353] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:47 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1266 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:48.515804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6edf6156-7d61-4bb7-8679-2af42fee3987 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:48.516641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6edf6156-7d61-4bb7-8679-2af42fee3987 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:48.537560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6edf6156-7d61-4bb7-8679-2af42fee3987 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:48.539609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6edf6156-7d61-4bb7-8679-2af42fee3987 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:48.541965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6edf6156-7d61-4bb7-8679-2af42fee3987 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:48.543802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6edf6156-7d61-4bb7-8679-2af42fee3987 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:49.048235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8bceeca0-57bb-4005-8886-4751edadb59a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:49.072971 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8bceeca0-57bb-4005-8886-4751edadb59a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1401 microversion: 2.1 time: 1.663473 Aug 04 14:04:49.074987 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1167/2354] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:47 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1401 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:49.102382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7147cf95-1909-4211-9a83-078349e15ed5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:49.105987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7147cf95-1909-4211-9a83-078349e15ed5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:49.119719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7147cf95-1909-4211-9a83-078349e15ed5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:49.121022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7147cf95-1909-4211-9a83-078349e15ed5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:49.122837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7147cf95-1909-4211-9a83-078349e15ed5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:49.123990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7147cf95-1909-4211-9a83-078349e15ed5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:50.049944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6edf6156-7d61-4bb7-8679-2af42fee3987 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:50.069454 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6edf6156-7d61-4bb7-8679-2af42fee3987 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 1.574927 Aug 04 14:04:50.086244 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1188/2355] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:48 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:50.086244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-e7d25e67-e659-4c27-bebd-33e2df82ff5c req-10a7bd1c-7809-4f82-ac94-7b2ce4372980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce31a57-07b2-4d87-9822-58690ae581d6", "name": "network-vif-plugged", "status": "completed", "tag": "2b5dd98f-40d9-4142-b50c-f6c8fb356c9e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:50.110292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e7d25e67-e659-4c27-bebd-33e2df82ff5c req-10a7bd1c-7809-4f82-ac94-7b2ce4372980 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:50.110292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e7d25e67-e659-4c27-bebd-33e2df82ff5c req-10a7bd1c-7809-4f82-ac94-7b2ce4372980 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:50.135222 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-e7d25e67-e659-4c27-bebd-33e2df82ff5c req-10a7bd1c-7809-4f82-ac94-7b2ce4372980 service nova] Creating event network-vif-plugged:2b5dd98f-40d9-4142-b50c-f6c8fb356c9e for instance 5ce31a57-07b2-4d87-9822-58690ae581d6 on n-h2-844627-10 Aug 04 14:04:50.145765 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-e7d25e67-e659-4c27-bebd-33e2df82ff5c req-10a7bd1c-7809-4f82-ac94-7b2ce4372980 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071235 Aug 04 14:04:50.147579 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1189/2356] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:50.181834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2747b91f-2ba3-4eb0-87ea-7eb1a380302d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:50.183505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2747b91f-2ba3-4eb0-87ea-7eb1a380302d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:50.210048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2747b91f-2ba3-4eb0-87ea-7eb1a380302d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:50.215792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2747b91f-2ba3-4eb0-87ea-7eb1a380302d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:50.217248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2747b91f-2ba3-4eb0-87ea-7eb1a380302d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:50.232926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2747b91f-2ba3-4eb0-87ea-7eb1a380302d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:50.492471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7147cf95-1909-4211-9a83-078349e15ed5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:50.509385 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7147cf95-1909-4211-9a83-078349e15ed5 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1473 microversion: 2.1 time: 1.430480 Aug 04 14:04:50.511753 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1168/2357] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:49 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1473 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:50.525665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f1abb82c-06a3-4f46-a333-e004accc534e tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:50.527746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f1abb82c-06a3-4f46-a333-e004accc534e tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:50.564241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1abb82c-06a3-4f46-a333-e004accc534e tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:50.565336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1abb82c-06a3-4f46-a333-e004accc534e tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:50.567091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1abb82c-06a3-4f46-a333-e004accc534e tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:50.568115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1abb82c-06a3-4f46-a333-e004accc534e tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:51.118705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2747b91f-2ba3-4eb0-87ea-7eb1a380302d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:51.146165 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2747b91f-2ba3-4eb0-87ea-7eb1a380302d tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1308 microversion: 2.1 time: 0.992703 Aug 04 14:04:51.149001 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1190/2358] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:50 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1308 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:51.180574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ad32cb6e-d132-47bc-8d46-094d35e3d32c req-137dee3c-247d-4326-b6de-6ceb1b6dbf8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49465ca9-683b-4a99-9a82-7aa2bcba2578", "tag": "1e791548-8e9f-44c0-9da1-75166c21da9f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:51.211062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ad32cb6e-d132-47bc-8d46-094d35e3d32c req-137dee3c-247d-4326-b6de-6ceb1b6dbf8b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:51.212040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ad32cb6e-d132-47bc-8d46-094d35e3d32c req-137dee3c-247d-4326-b6de-6ceb1b6dbf8b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:51.234613 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ad32cb6e-d132-47bc-8d46-094d35e3d32c req-137dee3c-247d-4326-b6de-6ceb1b6dbf8b service nova] Creating event network-changed:1e791548-8e9f-44c0-9da1-75166c21da9f for instance 49465ca9-683b-4a99-9a82-7aa2bcba2578 on n-h1-844627-10 Aug 04 14:04:51.245161 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ad32cb6e-d132-47bc-8d46-094d35e3d32c req-137dee3c-247d-4326-b6de-6ceb1b6dbf8b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093214 Aug 04 14:04:51.246477 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1191/2359] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:51.258750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d1dde72e-afc0-4919-86b5-8dd0776083a6 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:51.261066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d1dde72e-afc0-4919-86b5-8dd0776083a6 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:51.275557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d1dde72e-afc0-4919-86b5-8dd0776083a6 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:51.276753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d1dde72e-afc0-4919-86b5-8dd0776083a6 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:51.278518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d1dde72e-afc0-4919-86b5-8dd0776083a6 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:51.279546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d1dde72e-afc0-4919-86b5-8dd0776083a6 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:51.473786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f1abb82c-06a3-4f46-a333-e004accc534e tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:51.485182 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f1abb82c-06a3-4f46-a333-e004accc534e tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1401 microversion: 2.1 time: 0.970764 Aug 04 14:04:51.501472 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1169/2360] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:50 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1401 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:51.561137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-01bc5633-1080-4957-b655-f0adfef9da3b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:51.564796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-01bc5633-1080-4957-b655-f0adfef9da3b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:51.576258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01bc5633-1080-4957-b655-f0adfef9da3b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:51.577080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01bc5633-1080-4957-b655-f0adfef9da3b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:51.578343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01bc5633-1080-4957-b655-f0adfef9da3b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:51.579444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01bc5633-1080-4957-b655-f0adfef9da3b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:52.310631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01bc5633-1080-4957-b655-f0adfef9da3b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:52.327563 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-01bc5633-1080-4957-b655-f0adfef9da3b tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1431 microversion: 2.1 time: 0.771347 Aug 04 14:04:52.348764 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1170/2361] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:51 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1431 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:52.364702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1ed0c26e-e44d-43e4-8e50-10464d99f4f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:52.365985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1ed0c26e-e44d-43e4-8e50-10464d99f4f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:52.373807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ed0c26e-e44d-43e4-8e50-10464d99f4f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:52.374262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ed0c26e-e44d-43e4-8e50-10464d99f4f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:52.375077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ed0c26e-e44d-43e4-8e50-10464d99f4f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:52.375524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ed0c26e-e44d-43e4-8e50-10464d99f4f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:52.541055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d1dde72e-afc0-4919-86b5-8dd0776083a6 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:52.555364 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d1dde72e-afc0-4919-86b5-8dd0776083a6 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 1.306216 Aug 04 14:04:52.556808 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1192/2362] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:51 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:52.566900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fe781255-f403-44d1-a2bd-a6d0b23a055a req-99389a67-e550-4cc4-b107-1a161e2922eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f07f51-132c-40fa-94ab-83647c1f5093", "name": "network-vif-unplugged", "status": "completed", "tag": "8b87c498-3d50-4642-b4a6-4f7414343c2b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:52.594424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fe781255-f403-44d1-a2bd-a6d0b23a055a req-99389a67-e550-4cc4-b107-1a161e2922eb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:52.595121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fe781255-f403-44d1-a2bd-a6d0b23a055a req-99389a67-e550-4cc4-b107-1a161e2922eb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:52.618324 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fe781255-f403-44d1-a2bd-a6d0b23a055a req-99389a67-e550-4cc4-b107-1a161e2922eb service nova] Creating event network-vif-unplugged:8b87c498-3d50-4642-b4a6-4f7414343c2b for instance 63f07f51-132c-40fa-94ab-83647c1f5093 on n-h1-844627-10 Aug 04 14:04:52.625391 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fe781255-f403-44d1-a2bd-a6d0b23a055a req-99389a67-e550-4cc4-b107-1a161e2922eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065023 Aug 04 14:04:52.626872 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1193/2363] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:52.635659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5c6595c9-6553-4835-8d07-44243c2cfe06 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:52.636567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5c6595c9-6553-4835-8d07-44243c2cfe06 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:52.645286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c6595c9-6553-4835-8d07-44243c2cfe06 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:52.645847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c6595c9-6553-4835-8d07-44243c2cfe06 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:52.646913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c6595c9-6553-4835-8d07-44243c2cfe06 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:52.647959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c6595c9-6553-4835-8d07-44243c2cfe06 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:52.881035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1ed0c26e-e44d-43e4-8e50-10464d99f4f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:52.894833 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1ed0c26e-e44d-43e4-8e50-10464d99f4f0 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1308 microversion: 2.1 time: 0.544213 Aug 04 14:04:52.895905 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1171/2364] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:52 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:52.903088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-78b683b9-4646-4f36-9148-91a5c419721e req-3aafed4e-f1ff-4644-947b-f89758e89ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f07f51-132c-40fa-94ab-83647c1f5093", "name": "network-vif-deleted", "tag": "8b87c498-3d50-4642-b4a6-4f7414343c2b"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:52.946482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-78b683b9-4646-4f36-9148-91a5c419721e req-3aafed4e-f1ff-4644-947b-f89758e89ffc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:52.947202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-78b683b9-4646-4f36-9148-91a5c419721e req-3aafed4e-f1ff-4644-947b-f89758e89ffc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:52.986563 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-78b683b9-4646-4f36-9148-91a5c419721e req-3aafed4e-f1ff-4644-947b-f89758e89ffc service nova] Creating event network-vif-deleted:8b87c498-3d50-4642-b4a6-4f7414343c2b for instance 63f07f51-132c-40fa-94ab-83647c1f5093 on n-h1-844627-10 Aug 04 14:04:53.004732 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-78b683b9-4646-4f36-9148-91a5c419721e req-3aafed4e-f1ff-4644-947b-f89758e89ffc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106210 Aug 04 14:04:53.008421 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1172/2365] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:53.065586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5c6595c9-6553-4835-8d07-44243c2cfe06 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:53.080841 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5c6595c9-6553-4835-8d07-44243c2cfe06 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1587 microversion: 2.1 time: 0.452044 Aug 04 14:04:53.082099 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1194/2366] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:52 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1587 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:53.110117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d295cd3d-ced4-4125-8581-3400e2b60042 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:53.111012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d295cd3d-ced4-4125-8581-3400e2b60042 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:53.131626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d295cd3d-ced4-4125-8581-3400e2b60042 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:53.132465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d295cd3d-ced4-4125-8581-3400e2b60042 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:53.133853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d295cd3d-ced4-4125-8581-3400e2b60042 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:53.137035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d295cd3d-ced4-4125-8581-3400e2b60042 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:53.175727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:53.237797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:53.379190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cd36ca2d-81b6-419c-ba86-2b98a02b31fc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:53.383921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cd36ca2d-81b6-419c-ba86-2b98a02b31fc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:53.415070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd36ca2d-81b6-419c-ba86-2b98a02b31fc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:53.415532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd36ca2d-81b6-419c-ba86-2b98a02b31fc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:53.417856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd36ca2d-81b6-419c-ba86-2b98a02b31fc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:53.446121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd36ca2d-81b6-419c-ba86-2b98a02b31fc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:53.602758 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d295cd3d-ced4-4125-8581-3400e2b60042 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.499651 Aug 04 14:04:53.603438 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1173/2367] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:04:53 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6/os-interface => generated 284 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:53.612254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5dad70f4-d420-43ab-ae2e-4a4b9ef91521 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:53.614866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cd36ca2d-81b6-419c-ba86-2b98a02b31fc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:53.615355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5dad70f4-d420-43ab-ae2e-4a4b9ef91521 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:53.630077 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cd36ca2d-81b6-419c-ba86-2b98a02b31fc tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1431 microversion: 2.1 time: 0.264036 Aug 04 14:04:53.634556 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1195/2368] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:53 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1431 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:53.638032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dad70f4-d420-43ab-ae2e-4a4b9ef91521 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:53.639174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dad70f4-d420-43ab-ae2e-4a4b9ef91521 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:53.640166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dad70f4-d420-43ab-ae2e-4a4b9ef91521 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:53.640630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dad70f4-d420-43ab-ae2e-4a4b9ef91521 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:53.920791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a554d84a-e2eb-4bc2-b0dd-a5de045912b2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:53.921459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a554d84a-e2eb-4bc2-b0dd-a5de045912b2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:53.933392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a554d84a-e2eb-4bc2-b0dd-a5de045912b2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:53.933982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a554d84a-e2eb-4bc2-b0dd-a5de045912b2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:53.934829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a554d84a-e2eb-4bc2-b0dd-a5de045912b2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:53.935284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a554d84a-e2eb-4bc2-b0dd-a5de045912b2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:54.300634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5dad70f4-d420-43ab-ae2e-4a4b9ef91521 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:54.345794 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5dad70f4-d420-43ab-ae2e-4a4b9ef91521 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 0.738415 Aug 04 14:04:54.396329 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1174/2369] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:53 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:54.813202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2db92365-a2ae-416f-876c-dce68b04f1e4 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-203450706", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:54.820856 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-2db92365-a2ae-416f-876c-dce68b04f1e4 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] HTTP exception thrown: min_count must be <= max_count Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2db92365-a2ae-416f-876c-dce68b04f1e4 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Request method failure captured: Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 183 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69IFUd_r82sXPwoHxHIrHCWgJVZa2HVikEeB7Bk8h8Ke_g9-5yHcPyY5IuMS7EeDQ7VDQsynoXSPE8vCqT2ij5FqBSw_JLpKhNGKB5uo4O3Sy95WRGo97n7PjvFLdiGJTQ8fTxuZJuuDBO22pKAf2bACGJhfhYDJtDmyL4x2u2XQC8Q Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}] Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 6b3762fdf5f14d1787647d0ba43131a5 Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-203450706", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: exception: min_count must be <= max_count Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-203450706', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 04 14:04:54.823554 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:54.832264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2db92365-a2ae-416f-876c-dce68b04f1e4 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Returning 400 to user: min_count must be <= max_count {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:54.834181 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2db92365-a2ae-416f-876c-dce68b04f1e4 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.334620 Aug 04 14:04:54.849505 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1175/2370] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:04:54 2022] POST /compute/v2.1/servers => generated 74 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 14:04:54.873051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:54.896078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:54.937876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:54.941512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:54.943438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:54.945938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:55.041462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:55.042473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:55.043467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lazy-loading 'fault' on Instance uuid 63f07f51-132c-40fa-94ab-83647c1f5093 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:04:55.104144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a554d84a-e2eb-4bc2-b0dd-a5de045912b2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:55.134125 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a554d84a-e2eb-4bc2-b0dd-a5de045912b2 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1308 microversion: 2.1 time: 1.218064 Aug 04 14:04:55.139767 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1196/2371] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:53 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1308 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:55.158684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1ec6c4f-4943-46a1-954e-11e41326e2a3 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1349749622", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "max_count": 0}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1ec6c4f-4943-46a1-954e-11e41326e2a3 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Request method failure captured: Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 168 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69IFUd_r82sXPwoHxHIrHCWgJVZa2HVikEeB7Bk8h8Ke_g9-5yHcPyY5IuMS7EeDQ7VDQsynoXSPE8vCqT2ij5FqBSw_JLpKhNGKB5uo4O3Sy95WRGo97n7PjvFLdiGJTQ8fTxuZJuuDBO22pKAf2bACGJhfhYDJtDmyL4x2u2XQC8Q Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}] Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6b3762fdf5f14d1787647d0ba43131a5 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1349749622", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "max_count": 0}} Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1349749622', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'max_count': 0}}} Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 0 Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:04:55.177223 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 14:04:55.181480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.188272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1ec6c4f-4943-46a1-954e-11e41326e2a3 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:55.193319 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f1ec6c4f-4943-46a1-954e-11e41326e2a3 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.049483 Aug 04 14:04:55.198567 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1197/2372] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:04:55 2022] POST /compute/v2.1/servers => generated 130 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:04:55.208462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2cda82d5-2a4f-4e53-939b-f3a141270312 req-67fdad8e-ab2e-454f-a2ea-e8d7f8d369ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3452877a-59f7-4d14-8e74-967bd9736cf9", "name": "network-vif-deleted", "tag": "13847d8d-66df-465d-b3f2-fca69e45b7e9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:55.210258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:55.228997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b7717a92-4c25-449f-97c8-d146e9256c12 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 200 len: 1308 microversion: 2.1 time: 0.376565 Aug 04 14:04:55.233709 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1176/2373] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:54 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 1308 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:55.249583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2cda82d5-2a4f-4e53-939b-f3a141270312 req-67fdad8e-ab2e-454f-a2ea-e8d7f8d369ba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:55.250215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2cda82d5-2a4f-4e53-939b-f3a141270312 req-67fdad8e-ab2e-454f-a2ea-e8d7f8d369ba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:55.273703 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2cda82d5-2a4f-4e53-939b-f3a141270312 req-67fdad8e-ab2e-454f-a2ea-e8d7f8d369ba service nova] Creating event network-vif-deleted:13847d8d-66df-465d-b3f2-fca69e45b7e9 for instance 3452877a-59f7-4d14-8e74-967bd9736cf9 on n-h2-844627-10 Aug 04 14:04:55.303679 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2cda82d5-2a4f-4e53-939b-f3a141270312 req-67fdad8e-ab2e-454f-a2ea-e8d7f8d369ba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100782 Aug 04 14:04:55.305820 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1198/2374] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:55.332618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-69609b05-4445-4e89-86b5-b775d39cd036 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1568818345", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "max_count": 2.5}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-69609b05-4445-4e89-86b5-b775d39cd036 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Request method failure captured: Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 170 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69IFUd_r82sXPwoHxHIrHCWgJVZa2HVikEeB7Bk8h8Ke_g9-5yHcPyY5IuMS7EeDQ7VDQsynoXSPE8vCqT2ij5FqBSw_JLpKhNGKB5uo4O3Sy95WRGo97n7PjvFLdiGJTQ8fTxuZJuuDBO22pKAf2bACGJhfhYDJtDmyL4x2u2XQC8Q Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}] Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 6b3762fdf5f14d1787647d0ba43131a5 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1568818345", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "max_count": 2.5}} Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1568818345', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'max_count': 2.5}}} Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 2.5 Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:04:55.339329 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 14:04:55.345095 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.347851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-69609b05-4445-4e89-86b5-b775d39cd036 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:55.349124 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-69609b05-4445-4e89-86b5-b775d39cd036 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021979 Aug 04 14:04:55.351065 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1177/2375] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:04:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:04:55.402025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-85554179-e1be-48ba-ad0f-15ab82b846c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:55.403047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-85554179-e1be-48ba-ad0f-15ab82b846c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:55.421355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85554179-e1be-48ba-ad0f-15ab82b846c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:55.423535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85554179-e1be-48ba-ad0f-15ab82b846c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:55.424529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85554179-e1be-48ba-ad0f-15ab82b846c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:55.426485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85554179-e1be-48ba-ad0f-15ab82b846c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:55.440224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a057aded-1094-4778-9614-05bea6022349 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1101875273", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 0}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a057aded-1094-4778-9614-05bea6022349 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Request method failure captured: Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 168 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69IFUd_r82sXPwoHxHIrHCWgJVZa2HVikEeB7Bk8h8Ke_g9-5yHcPyY5IuMS7EeDQ7VDQsynoXSPE8vCqT2ij5FqBSw_JLpKhNGKB5uo4O3Sy95WRGo97n7PjvFLdiGJTQ8fTxuZJuuDBO22pKAf2bACGJhfhYDJtDmyL4x2u2XQC8Q Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}] Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 6b3762fdf5f14d1787647d0ba43131a5 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1101875273", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 0}} Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1101875273', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'min_count': 0}}} Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 0 Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:04:55.450837 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a057aded-1094-4778-9614-05bea6022349 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:55.454633 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a057aded-1094-4778-9614-05bea6022349 tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020899 Aug 04 14:04:55.455975 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1178/2376] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:04:55 2022] POST /compute/v2.1/servers => generated 130 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 14:04:55.547664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc53688e-9664-4c84-bcdc-54b7c7d5eb4d tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-415928947", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 2.5}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc53688e-9664-4c84-bcdc-54b7c7d5eb4d tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Request method failure captured: Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 169 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69IFUd_r82sXPwoHxHIrHCWgJVZa2HVikEeB7Bk8h8Ke_g9-5yHcPyY5IuMS7EeDQ7VDQsynoXSPE8vCqT2ij5FqBSw_JLpKhNGKB5uo4O3Sy95WRGo97n7PjvFLdiGJTQ8fTxuZJuuDBO22pKAf2bACGJhfhYDJtDmyL4x2u2XQC8Q Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8530deb923ba47bcb6c499dacac8e185"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8530deb923ba47bcb6c499dacac8e185"}]}] Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 8530deb923ba47bcb6c499dacac8e185 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-119851152 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 6b3762fdf5f14d1787647d0ba43131a5 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-119851152-project Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-415928947", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 2.5}} Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-415928947', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'min_count': 2.5}}} Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 2.5 Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:04:55.562020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc53688e-9664-4c84-bcdc-54b7c7d5eb4d tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:55.565732 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bc53688e-9664-4c84-bcdc-54b7c7d5eb4d tempest-MultipleCreateNegativeTestJSON-119851152 tempest-MultipleCreateNegativeTestJSON-119851152-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023228 Aug 04 14:04:55.573620 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1179/2377] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:04:55 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:04:56.177262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2965db7c-54a0-44c5-a49a-f6e6aa133ccf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:56.178873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2965db7c-54a0-44c5-a49a-f6e6aa133ccf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:56.219159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2965db7c-54a0-44c5-a49a-f6e6aa133ccf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:56.226573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2965db7c-54a0-44c5-a49a-f6e6aa133ccf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:56.228816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2965db7c-54a0-44c5-a49a-f6e6aa133ccf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:56.231308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2965db7c-54a0-44c5-a49a-f6e6aa133ccf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:56.282186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-85554179-e1be-48ba-ad0f-15ab82b846c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:56.324720 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-85554179-e1be-48ba-ad0f-15ab82b846c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 0.927964 Aug 04 14:04:56.331241 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1199/2378] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:55 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:56.347018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:56.359171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 63f07f51-132c-40fa-94ab-83647c1f5093] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:56.379780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:56.380788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:56.382963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:56.383963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:56.427461 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] HTTP exception thrown: Instance 63f07f51-132c-40fa-94ab-83647c1f5093 could not be found. Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Request method failure captured: Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 HTTP/1.1 Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69EDWjk8b95tqGdbk18GPuGozwNZMHnePh4rGqInVpXlcsZxods5NSI8o2beHWOgPiYxYgeSdUzhBvKE7pxK4NAmY3Al7xCmT8xy6FlNEqgWhypwHE3yDplqLOcxBMcOEoKy-BDFU9hqjVvcfOpNoy2EyZRgsfDLWQnoJ5_ZUcPd2Uw Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ac3308acf403461d902ba64604e3382e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ac3308acf403461d902ba64604e3382e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}] Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 5674b62dd99144ab9663d24b0762c907 Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 63f07f51-132c-40fa-94ab-83647c1f5093 could not be found. Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '63f07f51-132c-40fa-94ab-83647c1f5093'} Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63f07f51-132c-40fa-94ab-83647c1f5093 could not be found. Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63f07f51-132c-40fa-94ab-83647c1f5093 could not be found. Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:56.431640 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.435372 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:56.435372 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:56.435372 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:56.435372 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:56.435372 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:56.435372 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63f07f51-132c-40fa-94ab-83647c1f5093 could not be found. Aug 04 14:04:56.435372 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.440164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Returning 404 to user: Instance 63f07f51-132c-40fa-94ab-83647c1f5093 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:56.445529 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-366ea3e4-ddfa-4c24-9f4a-0a45bdf51c9d tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093" status: 404 len: 111 microversion: 2.1 time: 0.111930 Aug 04 14:04:56.450325 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1200/2379] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:56 2022] GET /compute/v2.1/servers/63f07f51-132c-40fa-94ab-83647c1f5093 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:56.479252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:56.481023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 3452877a-59f7-4d14-8e74-967bd9736cf9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:56.515605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:56.516922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:56.523255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:56.524393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:56.609314 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] HTTP exception thrown: Instance 3452877a-59f7-4d14-8e74-967bd9736cf9 could not be found. Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Request method failure captured: Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9 HTTP/1.1 Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69EDWjk8b95tqGdbk18GPuGozwNZMHnePh4rGqInVpXlcsZxods5NSI8o2beHWOgPiYxYgeSdUzhBvKE7pxK4NAmY3Al7xCmT8xy6FlNEqgWhypwHE3yDplqLOcxBMcOEoKy-BDFU9hqjVvcfOpNoy2EyZRgsfDLWQnoJ5_ZUcPd2Uw Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ac3308acf403461d902ba64604e3382e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ac3308acf403461d902ba64604e3382e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}] Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 5674b62dd99144ab9663d24b0762c907 Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3452877a-59f7-4d14-8e74-967bd9736cf9 could not be found. Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3452877a-59f7-4d14-8e74-967bd9736cf9'} Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3452877a-59f7-4d14-8e74-967bd9736cf9 could not be found. Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3452877a-59f7-4d14-8e74-967bd9736cf9 could not be found. Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:04:56.614209 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.627117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:04:56.627117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:04:56.627117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:04:56.627117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:04:56.627117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:04:56.627117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3452877a-59f7-4d14-8e74-967bd9736cf9 could not be found. Aug 04 14:04:56.627117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:04:56.656285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Returning 404 to user: Instance 3452877a-59f7-4d14-8e74-967bd9736cf9 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:04:56.664228 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-332001ac-29cc-475a-82e0-e2dc6fa835ef tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9" status: 404 len: 111 microversion: 2.1 time: 0.206832 Aug 04 14:04:56.667463 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1201/2380] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:56 2022] GET /compute/v2.1/servers/3452877a-59f7-4d14-8e74-967bd9736cf9 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:04:56.686362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42ba0c4c-e2d8-44cb-bcdc-bd8fe7121b53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:56.851293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:56.910200 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-42ba0c4c-e2d8-44cb-bcdc-bd8fe7121b53 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/28cafe75-8be0-440c-824d-c26796a4a2fb" status: 204 len: 0 microversion: 2.1 time: 0.236435 Aug 04 14:04:56.911339 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1202/2381] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:04:56 2022] DELETE /compute/v2.1/os-server-groups/28cafe75-8be0-440c-824d-c26796a4a2fb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:56.993073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e740f3ce-525f-4f07-bcf8-47a7051b9c73 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:57.000306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e740f3ce-525f-4f07-bcf8-47a7051b9c73 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 51ec0807-aa9c-4f56-a110-1aaf8083233e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:57.022533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2965db7c-54a0-44c5-a49a-f6e6aa133ccf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:57.039049 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2965db7c-54a0-44c5-a49a-f6e6aa133ccf tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1308 microversion: 2.1 time: 0.870306 Aug 04 14:04:57.039285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e740f3ce-525f-4f07-bcf8-47a7051b9c73 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:57.040132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e740f3ce-525f-4f07-bcf8-47a7051b9c73 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:57.041601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e740f3ce-525f-4f07-bcf8-47a7051b9c73 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:57.042388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e740f3ce-525f-4f07-bcf8-47a7051b9c73 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:57.059363 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1180/2382] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:56 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1308 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:57.237924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e740f3ce-525f-4f07-bcf8-47a7051b9c73 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 51ec0807-aa9c-4f56-a110-1aaf8083233e] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:57.375444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9ea487a-f121-4438-a496-a650925fb923 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:57.376424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a9ea487a-f121-4438-a496-a650925fb923 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:57.390156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9ea487a-f121-4438-a496-a650925fb923 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:57.391079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9ea487a-f121-4438-a496-a650925fb923 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:57.394162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9ea487a-f121-4438-a496-a650925fb923 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:57.395874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9ea487a-f121-4438-a496-a650925fb923 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:57.596332 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e740f3ce-525f-4f07-bcf8-47a7051b9c73 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e" status: 204 len: 0 microversion: 2.1 time: 0.675630 Aug 04 14:04:57.599692 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1203/2383] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:56 2022] DELETE /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e => generated 0 bytes in 680 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:57.624570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4f1082d2-f6d6-416d-873a-5cff3ce849db tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:57.627015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4f1082d2-f6d6-416d-873a-5cff3ce849db tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:57.646891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f1082d2-f6d6-416d-873a-5cff3ce849db tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:57.647903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f1082d2-f6d6-416d-873a-5cff3ce849db tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:57.648758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f1082d2-f6d6-416d-873a-5cff3ce849db tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:57.649270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f1082d2-f6d6-416d-873a-5cff3ce849db tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:57.652628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:57.686104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4f1082d2-f6d6-416d-873a-5cff3ce849db tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:04:57.842152 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4f1082d2-f6d6-416d-873a-5cff3ce849db tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 204 len: 0 microversion: 2.1 time: 0.234547 Aug 04 14:04:57.846085 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1204/2384] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:04:57 2022] DELETE /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:04:57.855921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d2b1cecf-6874-4e4e-abbb-3f28c00c7f5e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:57.861155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d2b1cecf-6874-4e4e-abbb-3f28c00c7f5e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 51ec0807-aa9c-4f56-a110-1aaf8083233e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:57.877413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2b1cecf-6874-4e4e-abbb-3f28c00c7f5e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:57.877948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2b1cecf-6874-4e4e-abbb-3f28c00c7f5e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:57.879691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2b1cecf-6874-4e4e-abbb-3f28c00c7f5e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:57.883153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2b1cecf-6874-4e4e-abbb-3f28c00c7f5e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:58.480490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a9ea487a-f121-4438-a496-a650925fb923 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:58.494953 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a9ea487a-f121-4438-a496-a650925fb923 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 1.125117 Aug 04 14:04:58.511880 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1181/2385] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:57 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:58.523515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7790ca36-fce8-4a6f-aebb-007c4fb7fcd6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:58.524478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7790ca36-fce8-4a6f-aebb-007c4fb7fcd6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:58.533311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7790ca36-fce8-4a6f-aebb-007c4fb7fcd6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:58.534110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7790ca36-fce8-4a6f-aebb-007c4fb7fcd6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:58.535196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7790ca36-fce8-4a6f-aebb-007c4fb7fcd6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:58.536394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7790ca36-fce8-4a6f-aebb-007c4fb7fcd6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:58.866233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d2b1cecf-6874-4e4e-abbb-3f28c00c7f5e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:58.885105 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d2b1cecf-6874-4e4e-abbb-3f28c00c7f5e tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e" status: 200 len: 1474 microversion: 2.1 time: 1.035091 Aug 04 14:04:58.890037 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1205/2386] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:57 2022] GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e => generated 1474 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:04:58.930655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ece4bcc5-fec0-407c-9531-d56401cd2cc9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:58.931707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ece4bcc5-fec0-407c-9531-d56401cd2cc9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:58.953617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ece4bcc5-fec0-407c-9531-d56401cd2cc9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:58.957178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ece4bcc5-fec0-407c-9531-d56401cd2cc9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:58.961908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ece4bcc5-fec0-407c-9531-d56401cd2cc9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:58.964264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ece4bcc5-fec0-407c-9531-d56401cd2cc9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:59.366426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7790ca36-fce8-4a6f-aebb-007c4fb7fcd6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:04:59.368806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:04:59.396340 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7790ca36-fce8-4a6f-aebb-007c4fb7fcd6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1308 microversion: 2.1 time: 0.881593 Aug 04 14:04:59.399749 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1182/2387] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:58 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1308 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:04:59.420229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3ad069be-adad-400e-8184-aeab404125ac req-610f1103-6cb7-43a7-a15f-4f23cb569b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ce31a57-07b2-4d87-9822-58690ae581d6", "tag": "2b5dd98f-40d9-4142-b50c-f6c8fb356c9e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:04:59.447527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3ad069be-adad-400e-8184-aeab404125ac req-610f1103-6cb7-43a7-a15f-4f23cb569b41 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:59.447998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3ad069be-adad-400e-8184-aeab404125ac req-610f1103-6cb7-43a7-a15f-4f23cb569b41 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:59.510100 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3ad069be-adad-400e-8184-aeab404125ac req-610f1103-6cb7-43a7-a15f-4f23cb569b41 service nova] Creating event network-changed:2b5dd98f-40d9-4142-b50c-f6c8fb356c9e for instance 5ce31a57-07b2-4d87-9822-58690ae581d6 on n-h2-844627-10 Aug 04 14:04:59.530373 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3ad069be-adad-400e-8184-aeab404125ac req-610f1103-6cb7-43a7-a15f-4f23cb569b41 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128442 Aug 04 14:04:59.536493 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1183/2388] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:04:59.554137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ee83fdc-cb03-424c-8888-11a75a02eb72 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:04:59.557866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ee83fdc-cb03-424c-8888-11a75a02eb72 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:04:59.580355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ee83fdc-cb03-424c-8888-11a75a02eb72 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:59.583438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ee83fdc-cb03-424c-8888-11a75a02eb72 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:04:59.587522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ee83fdc-cb03-424c-8888-11a75a02eb72 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:04:59.589907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ee83fdc-cb03-424c-8888-11a75a02eb72 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:01.170140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ece4bcc5-fec0-407c-9531-d56401cd2cc9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:01.208149 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ece4bcc5-fec0-407c-9531-d56401cd2cc9 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1587 microversion: 2.1 time: 2.283145 Aug 04 14:05:01.219602 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1206/2389] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:58 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1587 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:01.244054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bfc39a11-2f88-4602-98dd-aab006885b34 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:01.248689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bfc39a11-2f88-4602-98dd-aab006885b34 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 51ec0807-aa9c-4f56-a110-1aaf8083233e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:01.288601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc39a11-2f88-4602-98dd-aab006885b34 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:01.291212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc39a11-2f88-4602-98dd-aab006885b34 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:01.294738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc39a11-2f88-4602-98dd-aab006885b34 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:01.298993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc39a11-2f88-4602-98dd-aab006885b34 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:01.735064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bfc39a11-2f88-4602-98dd-aab006885b34 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:01.779407 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bfc39a11-2f88-4602-98dd-aab006885b34 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e" status: 200 len: 1303 microversion: 2.1 time: 0.556858 Aug 04 14:05:01.813355 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1207/2390] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:01 2022] GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e => generated 1303 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:02.100756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ee83fdc-cb03-424c-8888-11a75a02eb72 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:02.118298 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ee83fdc-cb03-424c-8888-11a75a02eb72 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 2.573753 Aug 04 14:05:02.130268 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1184/2391] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:04:59 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:02.153651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-01055869-f617-446a-9a53-3d34bd93d80f tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:02.165924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-01055869-f617-446a-9a53-3d34bd93d80f tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:02.181496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01055869-f617-446a-9a53-3d34bd93d80f tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:02.182579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01055869-f617-446a-9a53-3d34bd93d80f tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:02.185019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01055869-f617-446a-9a53-3d34bd93d80f tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:02.187093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01055869-f617-446a-9a53-3d34bd93d80f tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:02.274265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-01055869-f617-446a-9a53-3d34bd93d80f tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:05:02.519002 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-01055869-f617-446a-9a53-3d34bd93d80f tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 204 len: 0 microversion: 2.1 time: 0.381343 Aug 04 14:05:02.519956 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1185/2392] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:02 2022] DELETE /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:02.535796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-52b9413d-3a4a-400f-a58c-245673c2ff6c req-f814eb09-66bb-40b9-a254-defd86602170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ec0807-aa9c-4f56-a110-1aaf8083233e", "name": "network-vif-deleted", "tag": "2fdbab1d-a877-44d3-967f-8d1cbd4cd82d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:02.559238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-52b9413d-3a4a-400f-a58c-245673c2ff6c req-f814eb09-66bb-40b9-a254-defd86602170 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:02.561553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-52b9413d-3a4a-400f-a58c-245673c2ff6c req-f814eb09-66bb-40b9-a254-defd86602170 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:02.606144 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-52b9413d-3a4a-400f-a58c-245673c2ff6c req-f814eb09-66bb-40b9-a254-defd86602170 service nova] Creating event network-vif-deleted:2fdbab1d-a877-44d3-967f-8d1cbd4cd82d for instance 51ec0807-aa9c-4f56-a110-1aaf8083233e on n-h2-844627-10 Aug 04 14:05:02.619137 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-52b9413d-3a4a-400f-a58c-245673c2ff6c req-f814eb09-66bb-40b9-a254-defd86602170 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091261 Aug 04 14:05:02.621023 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1186/2393] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:02.638612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-33ccf76f-d1ad-47bc-89a8-dfc2e530ad8b req-826c9956-cdee-47dd-bf37-441f01c99823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49465ca9-683b-4a99-9a82-7aa2bcba2578", "name": "network-vif-plugged", "status": "completed", "tag": "1e791548-8e9f-44c0-9da1-75166c21da9f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:02.674556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-33ccf76f-d1ad-47bc-89a8-dfc2e530ad8b req-826c9956-cdee-47dd-bf37-441f01c99823 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:02.675828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-33ccf76f-d1ad-47bc-89a8-dfc2e530ad8b req-826c9956-cdee-47dd-bf37-441f01c99823 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:02.748068 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-33ccf76f-d1ad-47bc-89a8-dfc2e530ad8b req-826c9956-cdee-47dd-bf37-441f01c99823 service nova] Creating event network-vif-plugged:1e791548-8e9f-44c0-9da1-75166c21da9f for instance 49465ca9-683b-4a99-9a82-7aa2bcba2578 on n-h1-844627-10 Aug 04 14:05:02.787612 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-33ccf76f-d1ad-47bc-89a8-dfc2e530ad8b req-826c9956-cdee-47dd-bf37-441f01c99823 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160962 Aug 04 14:05:02.791760 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1187/2394] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:02.802220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e24a169-5cd8-4d50-b9d2-93ee6a11a255 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:02.816709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e24a169-5cd8-4d50-b9d2-93ee6a11a255 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:02.824291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-42f0e853-0d0d-46b1-a51d-3b89cde0e964 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:02.828778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-42f0e853-0d0d-46b1-a51d-3b89cde0e964 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:02.863726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42f0e853-0d0d-46b1-a51d-3b89cde0e964 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:02.867634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42f0e853-0d0d-46b1-a51d-3b89cde0e964 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:02.872046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42f0e853-0d0d-46b1-a51d-3b89cde0e964 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:02.872858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e24a169-5cd8-4d50-b9d2-93ee6a11a255 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:02.874178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42f0e853-0d0d-46b1-a51d-3b89cde0e964 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:02.875371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e24a169-5cd8-4d50-b9d2-93ee6a11a255 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:02.886226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e24a169-5cd8-4d50-b9d2-93ee6a11a255 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:02.889288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e24a169-5cd8-4d50-b9d2-93ee6a11a255 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:03.578273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-42f0e853-0d0d-46b1-a51d-3b89cde0e964 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:03.622196 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-42f0e853-0d0d-46b1-a51d-3b89cde0e964 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1665 microversion: 2.1 time: 0.823182 Aug 04 14:05:03.626287 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1188/2395] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:02 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1665 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:03.646238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:03.646238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 51ec0807-aa9c-4f56-a110-1aaf8083233e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:03.683528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:03.684450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:03.685622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:03.687799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:03.739451 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] HTTP exception thrown: Instance 51ec0807-aa9c-4f56-a110-1aaf8083233e could not be found. Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Request method failure captured: Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e HTTP/1.1 Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69EDWjk8b95tqGdbk18GPuGozwNZMHnePh4rGqInVpXlcsZxods5NSI8o2beHWOgPiYxYgeSdUzhBvKE7pxK4NAmY3Al7xCmT8xy6FlNEqgWhypwHE3yDplqLOcxBMcOEoKy-BDFU9hqjVvcfOpNoy2EyZRgsfDLWQnoJ5_ZUcPd2Uw Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ac3308acf403461d902ba64604e3382e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ac3308acf403461d902ba64604e3382e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}] Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 5674b62dd99144ab9663d24b0762c907 Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 51ec0807-aa9c-4f56-a110-1aaf8083233e could not be found. Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '51ec0807-aa9c-4f56-a110-1aaf8083233e'} Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51ec0807-aa9c-4f56-a110-1aaf8083233e could not be found. Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51ec0807-aa9c-4f56-a110-1aaf8083233e could not be found. Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:03.751421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:03.758785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:03.758785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:03.758785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:03.758785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:03.758785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:03.758785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51ec0807-aa9c-4f56-a110-1aaf8083233e could not be found. Aug 04 14:05:03.758785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:03.766433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Returning 404 to user: Instance 51ec0807-aa9c-4f56-a110-1aaf8083233e could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:03.771284 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc4c070f-342e-4897-adf6-8b9be7336525 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e" status: 404 len: 111 microversion: 2.1 time: 0.143169 Aug 04 14:05:03.777338 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1189/2396] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:03 2022] GET /compute/v2.1/servers/51ec0807-aa9c-4f56-a110-1aaf8083233e => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:03.806329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c5cb98ed-6829-415d-ad56-8317a1e8420a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:03.810411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c5cb98ed-6829-415d-ad56-8317a1e8420a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:03.832907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5cb98ed-6829-415d-ad56-8317a1e8420a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:03.834899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5cb98ed-6829-415d-ad56-8317a1e8420a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:03.837416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5cb98ed-6829-415d-ad56-8317a1e8420a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:03.839044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5cb98ed-6829-415d-ad56-8317a1e8420a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:04.603304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7e24a169-5cd8-4d50-b9d2-93ee6a11a255 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:04.628206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e24a169-5cd8-4d50-b9d2-93ee6a11a255 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1308 microversion: 2.1 time: 2.811721 Aug 04 14:05:04.629113 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1208/2397] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:01 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1308 bytes in 2815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:04.681686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:04.683235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: fa7b62d1-dac8-455d-a695-9fc845814ee6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:04.711634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:04.712753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:04.716644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:04.722302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:04.787386 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] HTTP exception thrown: Instance fa7b62d1-dac8-455d-a695-9fc845814ee6 could not be found. Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Request method failure captured: Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 HTTP/1.1 Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69EDWjk8b95tqGdbk18GPuGozwNZMHnePh4rGqInVpXlcsZxods5NSI8o2beHWOgPiYxYgeSdUzhBvKE7pxK4NAmY3Al7xCmT8xy6FlNEqgWhypwHE3yDplqLOcxBMcOEoKy-BDFU9hqjVvcfOpNoy2EyZRgsfDLWQnoJ5_ZUcPd2Uw Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ac3308acf403461d902ba64604e3382e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ac3308acf403461d902ba64604e3382e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}] Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 5674b62dd99144ab9663d24b0762c907 Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance fa7b62d1-dac8-455d-a695-9fc845814ee6 could not be found. Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'fa7b62d1-dac8-455d-a695-9fc845814ee6'} Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa7b62d1-dac8-455d-a695-9fc845814ee6 could not be found. Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa7b62d1-dac8-455d-a695-9fc845814ee6 could not be found. Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:04.790810 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:04.800966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:04.800966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:04.800966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:04.800966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:04.800966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:04.800966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa7b62d1-dac8-455d-a695-9fc845814ee6 could not be found. Aug 04 14:05:04.800966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:04.808068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Returning 404 to user: Instance fa7b62d1-dac8-455d-a695-9fc845814ee6 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:04.810361 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f67ab2b-1acf-44fb-a071-f8874e303907 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6" status: 404 len: 111 microversion: 2.1 time: 0.173709 Aug 04 14:05:04.822922 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1209/2398] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:04 2022] GET /compute/v2.1/servers/fa7b62d1-dac8-455d-a695-9fc845814ee6 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:04.840538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3ede7e55-cecb-4281-8963-8495bdb779ba tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:04.842357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3ede7e55-cecb-4281-8963-8495bdb779ba tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:04.858347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ede7e55-cecb-4281-8963-8495bdb779ba tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:04.859665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ede7e55-cecb-4281-8963-8495bdb779ba tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:04.861603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ede7e55-cecb-4281-8963-8495bdb779ba tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:04.862813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ede7e55-cecb-4281-8963-8495bdb779ba tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:04.871299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c5cb98ed-6829-415d-ad56-8317a1e8420a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:04.880447 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c5cb98ed-6829-415d-ad56-8317a1e8420a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 1.101209 Aug 04 14:05:04.896754 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1190/2399] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:03 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:04.901889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-daad2100-6e4a-41e5-9575-77a55c37ca98 req-90e8c328-8baf-4613-a55f-ca7bdc388645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7b62d1-dac8-455d-a695-9fc845814ee6", "name": "network-vif-deleted", "tag": "2051b507-b0c9-477e-8ef6-8fdbf26c7ad5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:04.931136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-daad2100-6e4a-41e5-9575-77a55c37ca98 req-90e8c328-8baf-4613-a55f-ca7bdc388645 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:04.931861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-daad2100-6e4a-41e5-9575-77a55c37ca98 req-90e8c328-8baf-4613-a55f-ca7bdc388645 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:04.965571 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-daad2100-6e4a-41e5-9575-77a55c37ca98 req-90e8c328-8baf-4613-a55f-ca7bdc388645 service nova] Creating event network-vif-deleted:2051b507-b0c9-477e-8ef6-8fdbf26c7ad5 for instance fa7b62d1-dac8-455d-a695-9fc845814ee6 on n-h2-844627-10 Aug 04 14:05:04.972356 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-daad2100-6e4a-41e5-9575-77a55c37ca98 req-90e8c328-8baf-4613-a55f-ca7bdc388645 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074143 Aug 04 14:05:04.973683 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1191/2400] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:04.986838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-125bc59a-2a17-47bd-b951-4b50c534f9ec tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:05.034655 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-125bc59a-2a17-47bd-b951-4b50c534f9ec tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/70017779-d671-4b8e-9682-dcb519c6a5ec" status: 204 len: 0 microversion: 2.1 time: 0.059438 Aug 04 14:05:05.039450 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1192/2401] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:05:04 2022] DELETE /compute/v2.1/os-server-groups/70017779-d671-4b8e-9682-dcb519c6a5ec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:05.049585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5bfe09df-4e49-4afb-a1d1-248d097b55d9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:05.050533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5bfe09df-4e49-4afb-a1d1-248d097b55d9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:05.065606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bfe09df-4e49-4afb-a1d1-248d097b55d9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:05.066331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bfe09df-4e49-4afb-a1d1-248d097b55d9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:05.067582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bfe09df-4e49-4afb-a1d1-248d097b55d9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:05.068248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bfe09df-4e49-4afb-a1d1-248d097b55d9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:05.124620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5bfe09df-4e49-4afb-a1d1-248d097b55d9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:05:05.280927 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5bfe09df-4e49-4afb-a1d1-248d097b55d9 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 204 len: 0 microversion: 2.1 time: 0.235154 Aug 04 14:05:05.286291 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1193/2402] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:05 2022] DELETE /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:05.312576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b34eac9-77b7-43c9-b3fc-39cf94e5e462 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:05.315841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b34eac9-77b7-43c9-b3fc-39cf94e5e462 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:05.356323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b34eac9-77b7-43c9-b3fc-39cf94e5e462 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:05.356323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b34eac9-77b7-43c9-b3fc-39cf94e5e462 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:05.356323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b34eac9-77b7-43c9-b3fc-39cf94e5e462 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:05.356323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b34eac9-77b7-43c9-b3fc-39cf94e5e462 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:05.908599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3ede7e55-cecb-4281-8963-8495bdb779ba tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:05.953534 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3ede7e55-cecb-4281-8963-8495bdb779ba tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1665 microversion: 2.1 time: 1.127909 Aug 04 14:05:05.957799 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1210/2403] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:04 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1665 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:06.009810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f05daa5-6396-43bf-a1f2-f6d0ac242eb6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:06.011489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f05daa5-6396-43bf-a1f2-f6d0ac242eb6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:06.050912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f05daa5-6396-43bf-a1f2-f6d0ac242eb6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:06.054238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f05daa5-6396-43bf-a1f2-f6d0ac242eb6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:06.061667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f05daa5-6396-43bf-a1f2-f6d0ac242eb6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:06.064090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f05daa5-6396-43bf-a1f2-f6d0ac242eb6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:06.125518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b34eac9-77b7-43c9-b3fc-39cf94e5e462 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:06.149076 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b34eac9-77b7-43c9-b3fc-39cf94e5e462 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1472 microversion: 2.1 time: 0.845936 Aug 04 14:05:06.151351 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1194/2404] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:05 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1472 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:06.171459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d6f0dc9e-7891-493d-a9b2-e83c54ce4a80 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:06.180266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d6f0dc9e-7891-493d-a9b2-e83c54ce4a80 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:06.203181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6f0dc9e-7891-493d-a9b2-e83c54ce4a80 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:06.203951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6f0dc9e-7891-493d-a9b2-e83c54ce4a80 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:06.204909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6f0dc9e-7891-493d-a9b2-e83c54ce4a80 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:06.205482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6f0dc9e-7891-493d-a9b2-e83c54ce4a80 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:08.836739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d6f0dc9e-7891-493d-a9b2-e83c54ce4a80 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:08.847020 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d6f0dc9e-7891-493d-a9b2-e83c54ce4a80 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 2.694176 Aug 04 14:05:08.848742 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1195/2405] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:06 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:08.877933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8adae9bd-867d-4694-a80d-fd9c8b48449b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:08.878992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8adae9bd-867d-4694-a80d-fd9c8b48449b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:08.893604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8adae9bd-867d-4694-a80d-fd9c8b48449b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:08.898794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8adae9bd-867d-4694-a80d-fd9c8b48449b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:08.900361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8adae9bd-867d-4694-a80d-fd9c8b48449b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:08.901170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8adae9bd-867d-4694-a80d-fd9c8b48449b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:08.970189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f05daa5-6396-43bf-a1f2-f6d0ac242eb6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:09.017680 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f05daa5-6396-43bf-a1f2-f6d0ac242eb6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1308 microversion: 2.1 time: 3.031240 Aug 04 14:05:09.018751 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1211/2406] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:05 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1308 bytes in 3034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:09.036949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3dbe32ae-324f-485d-928e-8cd562f1146a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:09.038415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3dbe32ae-324f-485d-928e-8cd562f1146a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:09.049886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3dbe32ae-324f-485d-928e-8cd562f1146a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:09.050429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3dbe32ae-324f-485d-928e-8cd562f1146a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:09.051263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3dbe32ae-324f-485d-928e-8cd562f1146a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:09.051723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3dbe32ae-324f-485d-928e-8cd562f1146a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:09.295304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8adae9bd-867d-4694-a80d-fd9c8b48449b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:09.331832 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8adae9bd-867d-4694-a80d-fd9c8b48449b tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1598 microversion: 2.1 time: 0.465201 Aug 04 14:05:09.369720 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1196/2407] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:08 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1598 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:09.875824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-908a8b50-a1d9-49fd-a436-ce400037ed34 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:09.877343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-908a8b50-a1d9-49fd-a436-ce400037ed34 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:09.895390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-908a8b50-a1d9-49fd-a436-ce400037ed34 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:09.896180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-908a8b50-a1d9-49fd-a436-ce400037ed34 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:09.902623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-908a8b50-a1d9-49fd-a436-ce400037ed34 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:09.903453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-908a8b50-a1d9-49fd-a436-ce400037ed34 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:10.009104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3dbe32ae-324f-485d-928e-8cd562f1146a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:10.042950 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3dbe32ae-324f-485d-928e-8cd562f1146a tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1472 microversion: 2.1 time: 1.022428 Aug 04 14:05:10.048098 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1212/2408] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:09 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1472 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:10.069955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-983f3bad-3347-4b29-bdc3-94104f56ca8b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:10.071045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-983f3bad-3347-4b29-bdc3-94104f56ca8b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:10.082677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-983f3bad-3347-4b29-bdc3-94104f56ca8b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:10.084356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-983f3bad-3347-4b29-bdc3-94104f56ca8b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:10.084356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-983f3bad-3347-4b29-bdc3-94104f56ca8b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:10.084698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-983f3bad-3347-4b29-bdc3-94104f56ca8b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:11.161995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-908a8b50-a1d9-49fd-a436-ce400037ed34 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:11.209812 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-908a8b50-a1d9-49fd-a436-ce400037ed34 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 1.338356 Aug 04 14:05:11.218072 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1197/2409] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:09 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:11.246532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-92b96b8c-f25f-4e1b-9add-7ef8c9f8a67d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:11.254779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-92b96b8c-f25f-4e1b-9add-7ef8c9f8a67d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:11.281966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92b96b8c-f25f-4e1b-9add-7ef8c9f8a67d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:11.285961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92b96b8c-f25f-4e1b-9add-7ef8c9f8a67d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:11.286999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92b96b8c-f25f-4e1b-9add-7ef8c9f8a67d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:11.288267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92b96b8c-f25f-4e1b-9add-7ef8c9f8a67d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:11.659705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-92b96b8c-f25f-4e1b-9add-7ef8c9f8a67d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a62b7ec7d8554b7dba75dcac4dfa5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ebad11a3e4f4995cfa039f1c3c9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:11.680672 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-92b96b8c-f25f-4e1b-9add-7ef8c9f8a67d tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 200 len: 1598 microversion: 2.1 time: 0.456910 Aug 04 14:05:11.681406 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1198/2410] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:11 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 1598 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:11.690101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ecac17dc-4bcb-4509-a076-7c2660f0b227 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:11.691067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ecac17dc-4bcb-4509-a076-7c2660f0b227 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:11.693365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:11.702800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecac17dc-4bcb-4509-a076-7c2660f0b227 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:11.707372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecac17dc-4bcb-4509-a076-7c2660f0b227 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:11.710342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecac17dc-4bcb-4509-a076-7c2660f0b227 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:11.710855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecac17dc-4bcb-4509-a076-7c2660f0b227 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:11.735233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-983f3bad-3347-4b29-bdc3-94104f56ca8b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:11.762605 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-983f3bad-3347-4b29-bdc3-94104f56ca8b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1489 microversion: 2.1 time: 1.710191 Aug 04 14:05:11.778536 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1213/2411] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:10 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1489 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:12.053534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-45eb49eb-a497-4b83-941c-4677530d4940 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Action: 'create', calling method: .version_select at 0x7f4700491280>, body: {"pool": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:12.232678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ecac17dc-4bcb-4509-a076-7c2660f0b227 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5674b62dd99144ab9663d24b0762c907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3308acf403461d902ba64604e3382e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:12.282062 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ecac17dc-4bcb-4509-a076-7c2660f0b227 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 200 len: 1430 microversion: 2.1 time: 0.597763 Aug 04 14:05:12.301688 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1199/2412] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:11 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 1430 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:12.341352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02e0f2b5-7336-4f21-aaaa-a94866ae878e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-162388914"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:12.357918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-02e0f2b5-7336-4f21-aaaa-a94866ae878e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:12.383582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e0f2b5-7336-4f21-aaaa-a94866ae878e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:12.386830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e0f2b5-7336-4f21-aaaa-a94866ae878e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:12.395436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e0f2b5-7336-4f21-aaaa-a94866ae878e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:12.398082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e0f2b5-7336-4f21-aaaa-a94866ae878e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:12.534513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:13.077806 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-02e0f2b5-7336-4f21-aaaa-a94866ae878e tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "POST /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578/action" status: 202 len: 0 microversion: 2.1 time: 0.773042 Aug 04 14:05:13.079755 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1200/2413] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:05:12 2022] POST /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578/action => generated 0 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:05:13.091206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a610fe3b-c7ce-412f-99e6-63f0e759251c req-0ca23fe4-4c6a-4d3b-83b9-3c2369d10804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19bbecb-ac45-485a-b0ca-9ee56b5628ce", "name": "network-vif-deleted", "tag": "28c2253a-6f45-4cfd-bba6-a91c0cc27e5e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:13.116630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a610fe3b-c7ce-412f-99e6-63f0e759251c req-0ca23fe4-4c6a-4d3b-83b9-3c2369d10804 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:13.125269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a610fe3b-c7ce-412f-99e6-63f0e759251c req-0ca23fe4-4c6a-4d3b-83b9-3c2369d10804 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:13.151825 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a610fe3b-c7ce-412f-99e6-63f0e759251c req-0ca23fe4-4c6a-4d3b-83b9-3c2369d10804 service nova] Creating event network-vif-deleted:28c2253a-6f45-4cfd-bba6-a91c0cc27e5e for instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce on n-h1-844627-10 Aug 04 14:05:13.164198 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a610fe3b-c7ce-412f-99e6-63f0e759251c req-0ca23fe4-4c6a-4d3b-83b9-3c2369d10804 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078824 Aug 04 14:05:13.166203 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1201/2414] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:13.187376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a74c19bd-62ab-4e9c-99b7-53dfc45bad5f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:13.189277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a74c19bd-62ab-4e9c-99b7-53dfc45bad5f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:13.221868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a74c19bd-62ab-4e9c-99b7-53dfc45bad5f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:13.224832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a74c19bd-62ab-4e9c-99b7-53dfc45bad5f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:13.226865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a74c19bd-62ab-4e9c-99b7-53dfc45bad5f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:13.228211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a74c19bd-62ab-4e9c-99b7-53dfc45bad5f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:15.007533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a74c19bd-62ab-4e9c-99b7-53dfc45bad5f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:15.040614 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a74c19bd-62ab-4e9c-99b7-53dfc45bad5f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 1.871584 Aug 04 14:05:15.041591 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1202/2415] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:13 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:15.073153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:15.074333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] [instance: b19bbecb-ac45-485a-b0ca-9ee56b5628ce] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:15.101114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:15.101983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:15.103603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:15.104396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:15.176436 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] HTTP exception thrown: Instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce could not be found. Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Request method failure captured: Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce HTTP/1.1 Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69GKD4Vt1UPVkPcCSAJJDlm8_ebQEIN0ysYi33QfARbNVUMD6KFUHoFZRTlMevaNy6uJslsq_-D4zcmbik1Vjjiukm8QFxjN2fFw7kOLOMDNiUZDwuhOnYj3QtkBkobAkksv3oEE1q0-fYRhUPjVTuU3hPmAdKdauFOkT8NTzMo0Ajw Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 5f3ebad11a3e4f4995cfa039f1c3c9fc Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestFqdnHostnames-719917251 Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f3ebad11a3e4f4995cfa039f1c3c9fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5f3ebad11a3e4f4995cfa039f1c3c9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5f3ebad11a3e4f4995cfa039f1c3c9fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5f3ebad11a3e4f4995cfa039f1c3c9fc"}]}] Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestFqdnHostnames-719917251 Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 5f3ebad11a3e4f4995cfa039f1c3c9fc Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-719917251 Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestFqdnHostnames-719917251-project Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a62b7ec7d8554b7dba75dcac4dfa5bc9 Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestFqdnHostnames-719917251-project Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce could not be found. Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b19bbecb-ac45-485a-b0ca-9ee56b5628ce'} Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce could not be found. Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce could not be found. Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:15.180357 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.188460 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:15.188460 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:15.188460 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:15.188460 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:15.188460 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:15.188460 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce could not be found. Aug 04 14:05:15.188460 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.199420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Returning 404 to user: Instance b19bbecb-ac45-485a-b0ca-9ee56b5628ce could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:15.201500 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4e1f556c-8eb8-4d1f-b955-812e3de500b2 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce" status: 404 len: 111 microversion: 2.1 time: 0.152417 Aug 04 14:05:15.203786 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1203/2416] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:15 2022] GET /compute/v2.1/servers/b19bbecb-ac45-485a-b0ca-9ee56b5628ce => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:15.216463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-74338d9e-5580-43b2-a747-3eda0937456c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3b78940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:15.334584 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-74338d9e-5580-43b2-a747-3eda0937456c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a" status: 200 len: 1411 microversion: 2.1 time: 0.128010 Aug 04 14:05:15.335588 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1204/2417] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:05:15 2022] GET /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a => generated 1411 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:15.353027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:15.353027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] [instance: 7984a6d3-8edb-45ab-a340-bc9df16df6f3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:15.377498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:15.378102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:15.381824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:15.382293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:15.419985 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] HTTP exception thrown: Instance 7984a6d3-8edb-45ab-a340-bc9df16df6f3 could not be found. Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Request method failure captured: Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 HTTP/1.1 Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69EDWjk8b95tqGdbk18GPuGozwNZMHnePh4rGqInVpXlcsZxods5NSI8o2beHWOgPiYxYgeSdUzhBvKE7pxK4NAmY3Al7xCmT8xy6FlNEqgWhypwHE3yDplqLOcxBMcOEoKy-BDFU9hqjVvcfOpNoy2EyZRgsfDLWQnoJ5_ZUcPd2Uw Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ac3308acf403461d902ba64604e3382e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ac3308acf403461d902ba64604e3382e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ac3308acf403461d902ba64604e3382e"}]}] Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ac3308acf403461d902ba64604e3382e Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-144239825 Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 5674b62dd99144ab9663d24b0762c907 Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersOnMultiNodesTest-144239825-project Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 7984a6d3-8edb-45ab-a340-bc9df16df6f3 could not be found. Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '7984a6d3-8edb-45ab-a340-bc9df16df6f3'} Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7984a6d3-8edb-45ab-a340-bc9df16df6f3 could not be found. Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7984a6d3-8edb-45ab-a340-bc9df16df6f3 could not be found. Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:15.424522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.430022 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:15.430022 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:15.430022 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:15.430022 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:15.430022 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:15.430022 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7984a6d3-8edb-45ab-a340-bc9df16df6f3 could not be found. Aug 04 14:05:15.430022 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:15.430022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] Returning 404 to user: Instance 7984a6d3-8edb-45ab-a340-bc9df16df6f3 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:15.430555 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-591cd430-af21-4875-a81d-e6a5d2d463c4 tempest-ServersOnMultiNodesTest-144239825 tempest-ServersOnMultiNodesTest-144239825-project] 10.222.0.66 "GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3" status: 404 len: 111 microversion: 2.1 time: 0.093539 Aug 04 14:05:15.433938 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1205/2418] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:15 2022] GET /compute/v2.1/servers/7984a6d3-8edb-45ab-a340-bc9df16df6f3 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:15.447408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae1be9a7-958e-45e5-b96e-3e8f5c9083e1 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] Calling method '.version_select at 0x7f46f3cd8790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:15.495769 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae1be9a7-958e-45e5-b96e-3e8f5c9083e1 tempest-ServersTestFqdnHostnames-719917251 tempest-ServersTestFqdnHostnames-719917251-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259315134" status: 202 len: 0 microversion: 2.1 time: 0.060498 Aug 04 14:05:15.500762 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1206/2419] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 14:05:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259315134 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:15.518708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c6387af4-fdc3-4719-adde-eccc51cb6893 req-728c3142-7f01-4d4f-a629-df7aeb5e70b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7984a6d3-8edb-45ab-a340-bc9df16df6f3", "name": "network-vif-deleted", "tag": "90affd07-aec2-4cef-95ed-8a5823b3ed7d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:15.634696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c6387af4-fdc3-4719-adde-eccc51cb6893 req-728c3142-7f01-4d4f-a629-df7aeb5e70b1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:15.636696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c6387af4-fdc3-4719-adde-eccc51cb6893 req-728c3142-7f01-4d4f-a629-df7aeb5e70b1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:15.706949 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c6387af4-fdc3-4719-adde-eccc51cb6893 req-728c3142-7f01-4d4f-a629-df7aeb5e70b1 service nova] Creating event network-vif-deleted:90affd07-aec2-4cef-95ed-8a5823b3ed7d for instance 7984a6d3-8edb-45ab-a340-bc9df16df6f3 on n-h1-844627-10 Aug 04 14:05:15.742725 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c6387af4-fdc3-4719-adde-eccc51cb6893 req-728c3142-7f01-4d4f-a629-df7aeb5e70b1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236908 Aug 04 14:05:15.758201 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1207/2420] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:15.820275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae64047a-d861-4033-b54b-851914108a3b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3cc45e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:16.041569 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae64047a-d861-4033-b54b-851914108a3b tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a" status: 200 len: 1411 microversion: 2.1 time: 0.278754 Aug 04 14:05:16.043159 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1208/2421] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:05:15 2022] GET /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a => generated 1411 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:16.912038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-631903317", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "f8bbdf30-0b69-4f8c-933f-9f3bf8918abe"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:17.057694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] validate_networks() for [('f8bbdf30-0b69-4f8c-933f-9f3bf8918abe', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:05:19.771322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:05:19.772853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:05:19.773441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:05:19.774161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:05:19.774899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:05:19.825190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:19.826074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:19.827729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:19.828494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:19.900246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Getting quotas for project bb2fa679cfa341498c0665efdaf70c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:05:19.924265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Getting quotas for user 705c1752c9e642aeba041eb7ea7f6b02 and project bb2fa679cfa341498c0665efdaf70c3d. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:05:19.984813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:05:19.997511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:05:20.082258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:20.165571 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b259ef5d-cd54-4120-a753-b820444d6e11 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.119870 Aug 04 14:05:20.180538 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1209/2422] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:05:20.209495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9cd0bf9d-c12f-422b-8feb-84fa52b23117 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3cf4310>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:20.700479 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9cd0bf9d-c12f-422b-8feb-84fa52b23117 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a" status: 204 len: 0 microversion: 2.1 time: 0.517872 Aug 04 14:05:20.701258 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1210/2423] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:20 2022] DELETE /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:21.154340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e64c9260-ec5a-4674-bee0-cd0ee5971b05 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:21.157149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e64c9260-ec5a-4674-bee0-cd0ee5971b05 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:21.201957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e64c9260-ec5a-4674-bee0-cd0ee5971b05 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:21.204530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e64c9260-ec5a-4674-bee0-cd0ee5971b05 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:21.207394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e64c9260-ec5a-4674-bee0-cd0ee5971b05 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:21.208245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e64c9260-ec5a-4674-bee0-cd0ee5971b05 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:21.260434 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-45eb49eb-a497-4b83-941c-4677530d4940 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.480576 Aug 04 14:05:21.261081 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1214/2424] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 14:05:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:21.268056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a77f58c9-ba81-4baa-9dcd-0db9224cda50 req-e8e5a20b-1a26-4880-b8a8-52c9b73870e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d0629-de24-4a72-83a0-2f443e0af803", "name": "network-vif-unplugged", "status": "completed", "tag": "dceb6721-526a-47cd-9222-7311c255822d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:21.290306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a77f58c9-ba81-4baa-9dcd-0db9224cda50 req-e8e5a20b-1a26-4880-b8a8-52c9b73870e7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:21.290757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a77f58c9-ba81-4baa-9dcd-0db9224cda50 req-e8e5a20b-1a26-4880-b8a8-52c9b73870e7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:21.330191 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a77f58c9-ba81-4baa-9dcd-0db9224cda50 req-e8e5a20b-1a26-4880-b8a8-52c9b73870e7 service nova] Creating event network-vif-unplugged:dceb6721-526a-47cd-9222-7311c255822d for instance 739d0629-de24-4a72-83a0-2f443e0af803 on n-h2-844627-10 Aug 04 14:05:21.345639 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a77f58c9-ba81-4baa-9dcd-0db9224cda50 req-e8e5a20b-1a26-4880-b8a8-52c9b73870e7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082064 Aug 04 14:05:21.352148 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1215/2425] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:21.367166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e308f69-192e-41b9-a4cd-36bc8eb78557 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:21.367909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8e308f69-192e-41b9-a4cd-36bc8eb78557 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:21.566339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8e308f69-192e-41b9-a4cd-36bc8eb78557 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:21.579844 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e308f69-192e-41b9-a4cd-36bc8eb78557 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1224 microversion: 2.1 time: 0.225547 Aug 04 14:05:21.580855 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1216/2426] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:21 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1224 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:21.590907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c278c691-2ed3-406e-a05d-e57f80951a52 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f470031ae50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:21.631376 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-c278c691-2ed3-406e-a05d-e57f80951a52 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Image not found. Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c278c691-2ed3-406e-a05d-e57f80951a52 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a HTTP/1.1 Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e96259fe-20aa-4559-82ae-4af4ac765b5a'} Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e96259fe-20aa-4559-82ae-4af4ac765b5a Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 14:05:21.635459 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e96259fe-20aa-4559-82ae-4af4ac765b5a could not be found. Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:05:21.639705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:21.649542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c278c691-2ed3-406e-a05d-e57f80951a52 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:21.650821 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c278c691-2ed3-406e-a05d-e57f80951a52 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a" status: 404 len: 62 microversion: 2.1 time: 0.068772 Aug 04 14:05:21.653942 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1217/2427] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:05:21 2022] GET /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:05:21.661081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-732d40fb-0643-49f3-bc8b-9432130bac49 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Calling method '.version_select at 0x7f47006d1040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:21.804613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e64c9260-ec5a-4674-bee0-cd0ee5971b05 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:21.821290 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e64c9260-ec5a-4674-bee0-cd0ee5971b05 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 1.118727 Aug 04 14:05:21.833423 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1211/2428] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:20 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:21.843960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6113fd3-0249-48c2-9af5-cddbf7d3fc89 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:21.845241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6113fd3-0249-48c2-9af5-cddbf7d3fc89 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:21.865828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6113fd3-0249-48c2-9af5-cddbf7d3fc89 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:21.866524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6113fd3-0249-48c2-9af5-cddbf7d3fc89 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:21.868841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6113fd3-0249-48c2-9af5-cddbf7d3fc89 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:21.869519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6113fd3-0249-48c2-9af5-cddbf7d3fc89 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:22.378152 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-732d40fb-0643-49f3-bc8b-9432130bac49 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/791e5963-4fe0-4813-b70a-e1e183d122d9" status: 200 len: 142 microversion: 2.1 time: 0.721436 Aug 04 14:05:22.379131 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1218/2429] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 14:05:21 2022] GET /compute/v2.1/os-floating-ips/791e5963-4fe0-4813-b70a-e1e183d122d9 => generated 142 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:22.404797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e0faf54-6ee0-44b6-81aa-f40a28f82e71 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Calling method '.version_select at 0x7f4700264ee0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:22.472528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6113fd3-0249-48c2-9af5-cddbf7d3fc89 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:22.512484 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6113fd3-0249-48c2-9af5-cddbf7d3fc89 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1502 microversion: 2.1 time: 0.676576 Aug 04 14:05:22.525166 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1212/2430] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:21 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1502 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:22.603131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5094ef9c-7f1a-4c84-bb65-7e86b9c12216 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:22.604099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5094ef9c-7f1a-4c84-bb65-7e86b9c12216 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:22.632265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5094ef9c-7f1a-4c84-bb65-7e86b9c12216 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:22.637128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5094ef9c-7f1a-4c84-bb65-7e86b9c12216 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:22.641634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5094ef9c-7f1a-4c84-bb65-7e86b9c12216 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:22.644401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5094ef9c-7f1a-4c84-bb65-7e86b9c12216 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:22.969144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5094ef9c-7f1a-4c84-bb65-7e86b9c12216 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:23.013865 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5094ef9c-7f1a-4c84-bb65-7e86b9c12216 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1284 microversion: 2.1 time: 0.409971 Aug 04 14:05:23.019051 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1213/2431] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:22 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1284 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:23.055267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b9ed9eda-3e48-4170-84d1-c8542472572a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:23.059418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b9ed9eda-3e48-4170-84d1-c8542472572a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:23.126280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9ed9eda-3e48-4170-84d1-c8542472572a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:23.134137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9ed9eda-3e48-4170-84d1-c8542472572a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:23.138505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9ed9eda-3e48-4170-84d1-c8542472572a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:23.142536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9ed9eda-3e48-4170-84d1-c8542472572a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:23.569195 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e0faf54-6ee0-44b6-81aa-f40a28f82e71 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.169155 Aug 04 14:05:23.569195 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1219/2432] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 14:05:22 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:05:23.610142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b27ba39b-6d3f-4e6d-84ee-5bc79359eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:23.627834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b27ba39b-6d3f-4e6d-84ee-5bc79359eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:23.683235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b9ed9eda-3e48-4170-84d1-c8542472572a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:23.685678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b27ba39b-6d3f-4e6d-84ee-5bc79359eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:23.686830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b27ba39b-6d3f-4e6d-84ee-5bc79359eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:23.692952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b27ba39b-6d3f-4e6d-84ee-5bc79359eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:23.693800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b27ba39b-6d3f-4e6d-84ee-5bc79359eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:23.743760 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b9ed9eda-3e48-4170-84d1-c8542472572a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 0.716803 Aug 04 14:05:23.743760 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1214/2433] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:23 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:23.799303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a419b5ca-3773-45ca-93c7-c4299623821e req-d7828422-1bb1-4968-b819-e165cdc377b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739d0629-de24-4a72-83a0-2f443e0af803", "tag": "dceb6721-526a-47cd-9222-7311c255822d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:23.877746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a419b5ca-3773-45ca-93c7-c4299623821e req-d7828422-1bb1-4968-b819-e165cdc377b0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:23.878870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a419b5ca-3773-45ca-93c7-c4299623821e req-d7828422-1bb1-4968-b819-e165cdc377b0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:23.951218 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a419b5ca-3773-45ca-93c7-c4299623821e req-d7828422-1bb1-4968-b819-e165cdc377b0 service nova] Creating event network-changed:dceb6721-526a-47cd-9222-7311c255822d for instance 739d0629-de24-4a72-83a0-2f443e0af803 on n-h2-844627-10 Aug 04 14:05:23.968782 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a419b5ca-3773-45ca-93c7-c4299623821e req-d7828422-1bb1-4968-b819-e165cdc377b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217962 Aug 04 14:05:23.970378 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1215/2434] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:23.985805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4c001a3-68b7-4659-8107-a94ac2711f85 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Calling method '.version_select at 0x7f46f3cc45e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:24.797931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b27ba39b-6d3f-4e6d-84ee-5bc79359eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f66d07b9ed48d0b9e2763d9659df3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c78c75d748a4fe29f1bcdbe40d280a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:24.806610 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b27ba39b-6d3f-4e6d-84ee-5bc79359eb71 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 200 len: 1489 microversion: 2.1 time: 1.226371 Aug 04 14:05:24.822317 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1220/2435] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:23 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 1489 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:25.269049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1804728013", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "dac05aa9-7a7a-4e8b-98e2-2626c38ab216"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:25.385974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] validate_networks() for [('dac05aa9-7a7a-4e8b-98e2-2626c38ab216', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:05:26.647333 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e4c001a3-68b7-4659-8107-a94ac2711f85 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/791e5963-4fe0-4813-b70a-e1e183d122d9" status: 202 len: 0 microversion: 2.1 time: 2.673452 Aug 04 14:05:26.648673 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1216/2436] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:05:23 2022] DELETE /compute/v2.1/os-floating-ips/791e5963-4fe0-4813-b70a-e1e183d122d9 => generated 0 bytes in 2677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:26.664188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5b850355-a6e9-48fe-946a-af7bccce1e90 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:26.665195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b850355-a6e9-48fe-946a-af7bccce1e90 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:26.672749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b850355-a6e9-48fe-946a-af7bccce1e90 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:26.673503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b850355-a6e9-48fe-946a-af7bccce1e90 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:26.674535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b850355-a6e9-48fe-946a-af7bccce1e90 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:26.675868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b850355-a6e9-48fe-946a-af7bccce1e90 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:27.262457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5b850355-a6e9-48fe-946a-af7bccce1e90 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:27.270070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:05:27.277426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:05:27.282714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:05:27.284279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:05:27.285829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:05:27.286334 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5b850355-a6e9-48fe-946a-af7bccce1e90 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1324 microversion: 2.1 time: 0.627757 Aug 04 14:05:27.289476 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1217/2437] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:26 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:27.344059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:27.346783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:27.349669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:27.350430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:27.394429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Getting quotas for project c3aa866572c3417e9bca492afeac35d3. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:05:27.415827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1130367227", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:27.428255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Getting quotas for user 833a4a12a9f94068a92d73bdc54fabbf and project c3aa866572c3417e9bca492afeac35d3. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:05:27.456236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:05:27.462313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:05:27.508243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:05:27.542864 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d6dcbd50-15dd-4d32-abea-1ade3f93b7b2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.718993 Aug 04 14:05:27.544119 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1221/2438] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:05:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:05:27.549313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d44a7f4c-02a8-4fe1-8281-3d5e183a3d20 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:27.550215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d44a7f4c-02a8-4fe1-8281-3d5e183a3d20 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:27.561005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d44a7f4c-02a8-4fe1-8281-3d5e183a3d20 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:27.561794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d44a7f4c-02a8-4fe1-8281-3d5e183a3d20 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:27.562818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d44a7f4c-02a8-4fe1-8281-3d5e183a3d20 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:27.563429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d44a7f4c-02a8-4fe1-8281-3d5e183a3d20 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:28.078834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d44a7f4c-02a8-4fe1-8281-3d5e183a3d20 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:28.095248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:28.124540 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d44a7f4c-02a8-4fe1-8281-3d5e183a3d20 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 0.578733 Aug 04 14:05:28.151268 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1222/2439] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:27 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:28.164946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ea464b61-596f-4237-9fb3-662eac9a3b14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:28.166421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ea464b61-596f-4237-9fb3-662eac9a3b14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:28.180743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea464b61-596f-4237-9fb3-662eac9a3b14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:28.181957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea464b61-596f-4237-9fb3-662eac9a3b14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:28.183830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea464b61-596f-4237-9fb3-662eac9a3b14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:28.184926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea464b61-596f-4237-9fb3-662eac9a3b14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:28.232536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ea464b61-596f-4237-9fb3-662eac9a3b14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:05:28.290509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:05:28.295733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:05:28.297030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:05:28.300429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:05:28.306748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:05:28.352479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:28.353111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:28.354062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:28.357190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:28.433243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Getting quotas for project 13e5d227e702414c96a9032e1936a646. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:05:28.442396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Getting quotas for user f148d43e0f75405a81dd0c502ee3fc19 and project 13e5d227e702414c96a9032e1936a646. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:05:28.482746 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ea464b61-596f-4237-9fb3-662eac9a3b14 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 204 len: 0 microversion: 2.1 time: 0.328013 Aug 04 14:05:28.489858 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1223/2440] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:28 2022] DELETE /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:28.490842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:05:28.498365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:05:28.505429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6cb7dcaf-2338-4a50-9ca7-faf0e88e971b tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Action: 'create', calling method: .version_select at 0x7f47001cf160>, body: {"pool": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:28.594797 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-189fb8a4-8027-42fb-a580-3319e82227b3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303905 Aug 04 14:05:28.604744 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1218/2441] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:05:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:05:28.610356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:28.610999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:28.655907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:28.656368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:28.659630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:28.660166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:29.204159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:29.228821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:29.244791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:29.247997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-201f6fef-136b-4a9a-bee0-494725f2c9cb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 200 len: 1258 microversion: 2.26 time: 0.641597 Aug 04 14:05:29.252701 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1219/2442] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:05:28 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 1258 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:29.286116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc567fce-63fe-4f57-8278-1c7b2d02a14c tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:29.305861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dc567fce-63fe-4f57-8278-1c7b2d02a14c tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:29.332229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc567fce-63fe-4f57-8278-1c7b2d02a14c tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:29.333276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc567fce-63fe-4f57-8278-1c7b2d02a14c tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:29.344965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc567fce-63fe-4f57-8278-1c7b2d02a14c tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:29.345949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc567fce-63fe-4f57-8278-1c7b2d02a14c tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:31.020301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dc567fce-63fe-4f57-8278-1c7b2d02a14c tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:31.049316 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc567fce-63fe-4f57-8278-1c7b2d02a14c tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1324 microversion: 2.1 time: 1.794364 Aug 04 14:05:31.054171 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1220/2443] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:29 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1324 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:31.066455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e8f585ac-00be-4836-b098-7342d2eb44c6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f46f3cc7940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:31.175927 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-e8f585ac-00be-4836-b098-7342d2eb44c6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Image not found. Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e8f585ac-00be-4836-b098-7342d2eb44c6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a HTTP/1.1 Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'e96259fe-20aa-4559-82ae-4af4ac765b5a'} Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e96259fe-20aa-4559-82ae-4af4ac765b5a to delete Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e96259fe-20aa-4559-82ae-4af4ac765b5a could not be found. Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:31.186766 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:31.190860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e8f585ac-00be-4836-b098-7342d2eb44c6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:31.200381 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e8f585ac-00be-4836-b098-7342d2eb44c6 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a" status: 404 len: 62 microversion: 2.1 time: 0.133240 Aug 04 14:05:31.201736 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1221/2444] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:31 2022] DELETE /compute/v2.1/images/e96259fe-20aa-4559-82ae-4af4ac765b5a => generated 62 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:05:31.216130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0dd4ad2d-9d72-4dd1-9589-493268fa5b1b tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:31.216767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0dd4ad2d-9d72-4dd1-9589-493268fa5b1b tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:31.242341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dd4ad2d-9d72-4dd1-9589-493268fa5b1b tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:31.242341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dd4ad2d-9d72-4dd1-9589-493268fa5b1b tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:31.243235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dd4ad2d-9d72-4dd1-9589-493268fa5b1b tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:31.243689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dd4ad2d-9d72-4dd1-9589-493268fa5b1b tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:31.568624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0dd4ad2d-9d72-4dd1-9589-493268fa5b1b tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:31.580148 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0dd4ad2d-9d72-4dd1-9589-493268fa5b1b tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1266 microversion: 2.1 time: 0.372360 Aug 04 14:05:31.581094 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1222/2445] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:31 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:31.587257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-75a857a3-0e07-42fc-85c5-d6b62818e899 req-4cd0d562-a160-4089-9255-1d76a0239e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91392508-a2d7-4ee4-a1cd-fbae92beb246", "tag": "2a13517b-dd3d-4399-aca6-9c3925f072b7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:31.616568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-75a857a3-0e07-42fc-85c5-d6b62818e899 req-4cd0d562-a160-4089-9255-1d76a0239e5b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:31.617051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-75a857a3-0e07-42fc-85c5-d6b62818e899 req-4cd0d562-a160-4089-9255-1d76a0239e5b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:31.651076 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-75a857a3-0e07-42fc-85c5-d6b62818e899 req-4cd0d562-a160-4089-9255-1d76a0239e5b service nova] Creating event network-changed:2a13517b-dd3d-4399-aca6-9c3925f072b7 for instance 91392508-a2d7-4ee4-a1cd-fbae92beb246 on n-h2-844627-10 Aug 04 14:05:31.660756 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-75a857a3-0e07-42fc-85c5-d6b62818e899 req-4cd0d562-a160-4089-9255-1d76a0239e5b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077745 Aug 04 14:05:31.667863 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1223/2446] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:31.683259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88c2a2dc-707b-4cf6-b008-7a8a7a1e57da tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:31.684378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-88c2a2dc-707b-4cf6-b008-7a8a7a1e57da tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:31.706090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88c2a2dc-707b-4cf6-b008-7a8a7a1e57da tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:31.706944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88c2a2dc-707b-4cf6-b008-7a8a7a1e57da tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:31.710684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88c2a2dc-707b-4cf6-b008-7a8a7a1e57da tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:31.711398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88c2a2dc-707b-4cf6-b008-7a8a7a1e57da tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:32.842856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-88c2a2dc-707b-4cf6-b008-7a8a7a1e57da tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:32.898533 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-88c2a2dc-707b-4cf6-b008-7a8a7a1e57da tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 1.223996 Aug 04 14:05:32.903239 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1224/2447] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:31 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:32.949262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c42449d-7742-47ab-96cf-a023af89ac04 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:32.983883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8c42449d-7742-47ab-96cf-a023af89ac04 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:32.994718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8c42449d-7742-47ab-96cf-a023af89ac04 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Searching by: {'deleted': False, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:05:33.014762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c42449d-7742-47ab-96cf-a023af89ac04 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:33.015574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c42449d-7742-47ab-96cf-a023af89ac04 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:33.017196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c42449d-7742-47ab-96cf-a023af89ac04 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:33.018028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c42449d-7742-47ab-96cf-a023af89ac04 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:33.134063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-8c42449d-7742-47ab-96cf-a023af89ac04 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:05:33.233336 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c42449d-7742-47ab-96cf-a023af89ac04 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.327123 Aug 04 14:05:33.235307 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1225/2448] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:05:32 2022] GET /compute/v2.1/servers => generated 339 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:33.244347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:33.250182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:33.266615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:33.267093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:33.268028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:33.273516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:34.254221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:34.258218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:34.273033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:34.276168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:34.278350 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86a793ac-d844-4e4e-8c81-0c60a784fcee tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 200 len: 1362 microversion: 2.26 time: 1.041724 Aug 04 14:05:34.280390 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1226/2449] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:05:33 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 1362 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:34.292394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d7ca890-b6be-45d4-8a06-a9e511b03f27 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:34.293740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d7ca890-b6be-45d4-8a06-a9e511b03f27 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:34.307346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d7ca890-b6be-45d4-8a06-a9e511b03f27 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:34.308381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d7ca890-b6be-45d4-8a06-a9e511b03f27 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:34.310295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d7ca890-b6be-45d4-8a06-a9e511b03f27 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:34.311351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d7ca890-b6be-45d4-8a06-a9e511b03f27 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:34.410603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d7ca890-b6be-45d4-8a06-a9e511b03f27 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:05:34.516885 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.compute.api [None req-5d7ca890-b6be-45d4-8a06-a9e511b03f27 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Instance is already in deleting state, ignoring this request Aug 04 14:05:34.519154 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d7ca890-b6be-45d4-8a06-a9e511b03f27 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 204 len: 0 microversion: 2.1 time: 0.236722 Aug 04 14:05:34.521853 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1227/2450] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:34 2022] DELETE /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:34.540804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe3d1e05-652e-4cdc-8f30-872c761395e3 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:34.542342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe3d1e05-652e-4cdc-8f30-872c761395e3 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:34.557415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe3d1e05-652e-4cdc-8f30-872c761395e3 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:34.558758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe3d1e05-652e-4cdc-8f30-872c761395e3 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:34.560559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe3d1e05-652e-4cdc-8f30-872c761395e3 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:34.563026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe3d1e05-652e-4cdc-8f30-872c761395e3 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:35.295652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe3d1e05-652e-4cdc-8f30-872c761395e3 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:35.312507 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe3d1e05-652e-4cdc-8f30-872c761395e3 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1324 microversion: 2.1 time: 0.788924 Aug 04 14:05:35.313696 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1228/2451] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:34 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1324 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:35.325705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-79fb2eac-57d3-4097-b48e-a8e4f131cea6 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:35.327372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-79fb2eac-57d3-4097-b48e-a8e4f131cea6 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:35.342565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79fb2eac-57d3-4097-b48e-a8e4f131cea6 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:35.343836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79fb2eac-57d3-4097-b48e-a8e4f131cea6 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:35.346313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79fb2eac-57d3-4097-b48e-a8e4f131cea6 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:35.347700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79fb2eac-57d3-4097-b48e-a8e4f131cea6 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:35.695441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-79fb2eac-57d3-4097-b48e-a8e4f131cea6 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:35.735236 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-79fb2eac-57d3-4097-b48e-a8e4f131cea6 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1272 microversion: 2.1 time: 0.417098 Aug 04 14:05:35.742576 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1229/2452] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:35 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1272 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:35.768403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:35.779613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:35.782132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Searching by: {'deleted': False, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:05:35.819659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:35.819659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:35.820106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:35.821663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:35.883654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:05:35.999501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:36.011588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:36.012591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:37.126793 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-64741815-9767-4aa3-b7eb-590f03574ace tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 1.381788 Aug 04 14:05:37.128946 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1230/2453] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:05:35 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:37.139456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6cafff4d-078a-4510-a18b-ab40037b91d7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:37.142191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6cafff4d-078a-4510-a18b-ab40037b91d7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:37.162494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cafff4d-078a-4510-a18b-ab40037b91d7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:37.164230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cafff4d-078a-4510-a18b-ab40037b91d7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:37.166300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cafff4d-078a-4510-a18b-ab40037b91d7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:37.167661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cafff4d-078a-4510-a18b-ab40037b91d7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:37.204199 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6cb7dcaf-2338-4a50-9ca7-faf0e88e971b tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.706194 Aug 04 14:05:37.206371 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1224/2454] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 14:05:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:37.215138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f2f10429-55a0-420b-9860-da894385b958 req-0ca6d667-8cab-40f2-8f78-98f6e0e34713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49465ca9-683b-4a99-9a82-7aa2bcba2578", "name": "network-vif-deleted", "tag": "1e791548-8e9f-44c0-9da1-75166c21da9f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:37.285121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f2f10429-55a0-420b-9860-da894385b958 req-0ca6d667-8cab-40f2-8f78-98f6e0e34713 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:37.285636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f2f10429-55a0-420b-9860-da894385b958 req-0ca6d667-8cab-40f2-8f78-98f6e0e34713 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:37.303343 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f2f10429-55a0-420b-9860-da894385b958 req-0ca6d667-8cab-40f2-8f78-98f6e0e34713 service nova] Creating event network-vif-deleted:1e791548-8e9f-44c0-9da1-75166c21da9f for instance 49465ca9-683b-4a99-9a82-7aa2bcba2578 on n-h1-844627-10 Aug 04 14:05:37.313013 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f2f10429-55a0-420b-9860-da894385b958 req-0ca6d667-8cab-40f2-8f78-98f6e0e34713 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104157 Aug 04 14:05:37.314974 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1225/2455] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:37.339495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:37.341547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 49465ca9-683b-4a99-9a82-7aa2bcba2578] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:37.359147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:37.360523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:37.378718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:37.381316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:37.385993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:37.422956 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Instance 49465ca9-683b-4a99-9a82-7aa2bcba2578 could not be found. Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 HTTP/1.1 Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 49465ca9-683b-4a99-9a82-7aa2bcba2578 could not be found. Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '49465ca9-683b-4a99-9a82-7aa2bcba2578'} Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49465ca9-683b-4a99-9a82-7aa2bcba2578 could not be found. Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49465ca9-683b-4a99-9a82-7aa2bcba2578 could not be found. Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:37.427627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:37.434503 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:37.434503 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:37.434503 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:37.434503 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:37.434503 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49465ca9-683b-4a99-9a82-7aa2bcba2578 could not be found. Aug 04 14:05:37.434503 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:37.438304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Instance 49465ca9-683b-4a99-9a82-7aa2bcba2578 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:37.440509 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f5414986-2606-491b-9299-237b70d32183 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578" status: 404 len: 111 microversion: 2.1 time: 0.116040 Aug 04 14:05:37.443891 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1226/2456] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:37 2022] GET /compute/v2.1/servers/49465ca9-683b-4a99-9a82-7aa2bcba2578 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:37.455687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:37.457709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:37.461477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:37.473589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:37.475357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:37.477362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:37.478535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:37.772405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6cafff4d-078a-4510-a18b-ab40037b91d7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:37.794151 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6cafff4d-078a-4510-a18b-ab40037b91d7 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 0.663274 Aug 04 14:05:37.795474 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1231/2457] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:37 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:37.808066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4728a6a-744d-4773-9be5-8bf05af542b4 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:37.809951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d4728a6a-744d-4773-9be5-8bf05af542b4 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:37.827747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4728a6a-744d-4773-9be5-8bf05af542b4 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:37.828512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4728a6a-744d-4773-9be5-8bf05af542b4 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:37.830224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4728a6a-744d-4773-9be5-8bf05af542b4 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:37.831029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4728a6a-744d-4773-9be5-8bf05af542b4 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:38.208542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:38.224938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:38.228178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:38.230459 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-35f47e98-c915-491f-a7e6-106b6bcf694d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 200 len: 1362 microversion: 2.26 time: 0.782451 Aug 04 14:05:38.232073 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1227/2458] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:05:37 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:38.245589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b03c5de4-e5d5-4885-abc6-be64cac8ae20 req-e60497c8-fcc1-4108-a4c9-e9c726cf8e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7cce837-e96f-4d54-9b5f-009f1cf28a37", "tag": "e839d5c2-63ae-407f-adfb-ac36d9ef2748"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:38.266276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b03c5de4-e5d5-4885-abc6-be64cac8ae20 req-e60497c8-fcc1-4108-a4c9-e9c726cf8e24 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:38.267653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b03c5de4-e5d5-4885-abc6-be64cac8ae20 req-e60497c8-fcc1-4108-a4c9-e9c726cf8e24 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:38.303952 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b03c5de4-e5d5-4885-abc6-be64cac8ae20 req-e60497c8-fcc1-4108-a4c9-e9c726cf8e24 service nova] Creating event network-changed:e839d5c2-63ae-407f-adfb-ac36d9ef2748 for instance d7cce837-e96f-4d54-9b5f-009f1cf28a37 on n-h2-844627-10 Aug 04 14:05:38.319333 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b03c5de4-e5d5-4885-abc6-be64cac8ae20 req-e60497c8-fcc1-4108-a4c9-e9c726cf8e24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084462 Aug 04 14:05:38.322468 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1228/2459] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:38.357443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70393b62-641f-4c17-83fb-451bf5cd257e tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:38.361638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70393b62-641f-4c17-83fb-451bf5cd257e tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:38.375093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70393b62-641f-4c17-83fb-451bf5cd257e tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:38.376294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70393b62-641f-4c17-83fb-451bf5cd257e tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:38.378004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70393b62-641f-4c17-83fb-451bf5cd257e tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:38.379062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70393b62-641f-4c17-83fb-451bf5cd257e tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:38.454690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4728a6a-744d-4773-9be5-8bf05af542b4 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:38.490527 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4728a6a-744d-4773-9be5-8bf05af542b4 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1324 microversion: 2.1 time: 0.681524 Aug 04 14:05:38.494749 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1232/2460] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:37 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1324 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:38.512006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-44236011-80a5-4f90-98e7-610f5244c6bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:38.548084 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-44236011-80a5-4f90-98e7-610f5244c6bf tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052013 Aug 04 14:05:38.549699 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1233/2461] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:05:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:38.571232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-efe0c7ea-8cb2-49ea-8af7-410cfacccb7b tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Calling method '.version_select at 0x7f46f3cf48b0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:39.447163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-70393b62-641f-4c17-83fb-451bf5cd257e tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:39.463311 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70393b62-641f-4c17-83fb-451bf5cd257e tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1314 microversion: 2.1 time: 1.138253 Aug 04 14:05:39.477332 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1229/2462] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:38 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1314 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:39.483050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-363fc316-abfa-4f72-aa96-40563b1cfff8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f4700a7c820>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:39.512415 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-363fc316-abfa-4f72-aa96-40563b1cfff8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Image not found. Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-363fc316-abfa-4f72-aa96-40563b1cfff8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd HTTP/1.1 Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '016e81f7-58b2-4902-941d-0b32396548dd'} Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 016e81f7-58b2-4902-941d-0b32396548dd to delete Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 016e81f7-58b2-4902-941d-0b32396548dd could not be found. Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:39.514757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:05:39.518542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:39.522425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-363fc316-abfa-4f72-aa96-40563b1cfff8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:39.524109 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-363fc316-abfa-4f72-aa96-40563b1cfff8 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd" status: 404 len: 62 microversion: 2.1 time: 0.045326 Aug 04 14:05:39.528399 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1230/2463] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:39 2022] DELETE /compute/v2.1/images/016e81f7-58b2-4902-941d-0b32396548dd => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:05:39.534429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6b59c76c-d366-49eb-82df-d618d3055ed0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:39.535489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6b59c76c-d366-49eb-82df-d618d3055ed0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:39.544988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b59c76c-d366-49eb-82df-d618d3055ed0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:39.545744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b59c76c-d366-49eb-82df-d618d3055ed0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:39.546962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b59c76c-d366-49eb-82df-d618d3055ed0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:39.547651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b59c76c-d366-49eb-82df-d618d3055ed0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:40.381198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6b59c76c-d366-49eb-82df-d618d3055ed0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:40.394761 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6b59c76c-d366-49eb-82df-d618d3055ed0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1719 microversion: 2.1 time: 0.864588 Aug 04 14:05:40.396019 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1231/2464] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:39 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1719 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:40.417669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9b8ab72e-6f58-42fd-8372-792218d1d9ed tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:40.418971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9b8ab72e-6f58-42fd-8372-792218d1d9ed tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:40.426961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b8ab72e-6f58-42fd-8372-792218d1d9ed tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:40.427412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b8ab72e-6f58-42fd-8372-792218d1d9ed tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:40.434182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b8ab72e-6f58-42fd-8372-792218d1d9ed tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:40.434750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b8ab72e-6f58-42fd-8372-792218d1d9ed tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:40.475624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9b8ab72e-6f58-42fd-8372-792218d1d9ed tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:05:40.774635 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9b8ab72e-6f58-42fd-8372-792218d1d9ed tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 204 len: 0 microversion: 2.1 time: 0.372772 Aug 04 14:05:40.777169 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1232/2465] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:40 2022] DELETE /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:40.801194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:40.803753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:40.843764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:40.844601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:40.848090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:40.849552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:41.811902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:41.832520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:41.844231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:41.846841 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1bcae7cb-ea31-4cc0-80c0-9d6abfd98f72 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 200 len: 1362 microversion: 2.26 time: 1.066959 Aug 04 14:05:41.848088 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1233/2466] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:05:40 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 1362 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:41.862612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eff43177-54db-40e0-bb77-95b0c126177a tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:41.863867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eff43177-54db-40e0-bb77-95b0c126177a tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:41.877405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eff43177-54db-40e0-bb77-95b0c126177a tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:41.878835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eff43177-54db-40e0-bb77-95b0c126177a tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:41.879935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eff43177-54db-40e0-bb77-95b0c126177a tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:41.881704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eff43177-54db-40e0-bb77-95b0c126177a tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:42.651982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eff43177-54db-40e0-bb77-95b0c126177a tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:42.682287 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eff43177-54db-40e0-bb77-95b0c126177a tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1324 microversion: 2.1 time: 0.832317 Aug 04 14:05:42.685125 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1234/2467] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:41 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1324 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:42.712545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:42.713752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:42.728798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:42.729289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:42.730089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:42.730541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:42.752384 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 HTTP/1.1 Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4f7a6c65-5f80-48bb-a324-23c01af35738'} Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:42.754615 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:42.758774 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:42.761704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:42.762909 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9de9bbb3-0653-4be6-b5e7-1a036f1d753c tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 404 len: 111 microversion: 2.1 time: 0.076373 Aug 04 14:05:42.769035 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1235/2468] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:42 2022] DELETE /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:42.777713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-29d115d3-e2e6-4686-b39d-d6b7fe17431a req-9ad515c7-67f9-4533-9c43-8b543848f147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91392508-a2d7-4ee4-a1cd-fbae92beb246", "name": "network-vif-plugged", "status": "completed", "tag": "2a13517b-dd3d-4399-aca6-9c3925f072b7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:42.796611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-29d115d3-e2e6-4686-b39d-d6b7fe17431a req-9ad515c7-67f9-4533-9c43-8b543848f147 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:42.797482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-29d115d3-e2e6-4686-b39d-d6b7fe17431a req-9ad515c7-67f9-4533-9c43-8b543848f147 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:42.823228 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-29d115d3-e2e6-4686-b39d-d6b7fe17431a req-9ad515c7-67f9-4533-9c43-8b543848f147 service nova] Creating event network-vif-plugged:2a13517b-dd3d-4399-aca6-9c3925f072b7 for instance 91392508-a2d7-4ee4-a1cd-fbae92beb246 on n-h2-844627-10 Aug 04 14:05:42.834756 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-29d115d3-e2e6-4686-b39d-d6b7fe17431a req-9ad515c7-67f9-4533-9c43-8b543848f147 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063703 Aug 04 14:05:42.836031 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1236/2469] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:42.856402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3616ef23-7f8f-4b3c-a1aa-2275f062b809 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:42.865399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3616ef23-7f8f-4b3c-a1aa-2275f062b809 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:42.884963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3616ef23-7f8f-4b3c-a1aa-2275f062b809 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:42.895128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3616ef23-7f8f-4b3c-a1aa-2275f062b809 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:42.898124 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-efe0c7ea-8cb2-49ea-8af7-410cfacccb7b tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/3f2404f5-c235-4ea7-991d-6d33ab87ebd0" status: 202 len: 0 microversion: 2.1 time: 4.346009 Aug 04 14:05:42.900040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1234/2470] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:05:38 2022] DELETE /compute/v2.1/os-floating-ips/3f2404f5-c235-4ea7-991d-6d33ab87ebd0 => generated 0 bytes in 4350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:42.909165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5cfd842b-cfde-42bb-8537-fd0cc6494d1a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:42.909538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3616ef23-7f8f-4b3c-a1aa-2275f062b809 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:42.910825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3616ef23-7f8f-4b3c-a1aa-2275f062b809 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:42.914789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5cfd842b-cfde-42bb-8537-fd0cc6494d1a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:42.931274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:42.935780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cfd842b-cfde-42bb-8537-fd0cc6494d1a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:42.936413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cfd842b-cfde-42bb-8537-fd0cc6494d1a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:42.937445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cfd842b-cfde-42bb-8537-fd0cc6494d1a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:42.939598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cfd842b-cfde-42bb-8537-fd0cc6494d1a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:43.602244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5cfd842b-cfde-42bb-8537-fd0cc6494d1a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:43.606095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3616ef23-7f8f-4b3c-a1aa-2275f062b809 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:43.620539 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3616ef23-7f8f-4b3c-a1aa-2275f062b809 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1314 microversion: 2.1 time: 0.781728 Aug 04 14:05:43.621880 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1237/2471] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:42 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:43.627825 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5cfd842b-cfde-42bb-8537-fd0cc6494d1a tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1712 microversion: 2.1 time: 0.717323 Aug 04 14:05:43.642224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-21bb2ed3-5493-46d6-b08f-c603ec86e2e7 req-4a90031e-9195-4215-b09b-af726e4da2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a0c9f0-5988-434b-abc2-879962cea3c6", "tag": "505c5faa-7d9a-450f-aaf6-c2129258b0e2"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:43.653040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1235/2472] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:42 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1712 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:43.670853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-83244f67-3814-4d7b-a5c6-6121a091f437 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:43.671369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-21bb2ed3-5493-46d6-b08f-c603ec86e2e7 req-4a90031e-9195-4215-b09b-af726e4da2cf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:43.672089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-21bb2ed3-5493-46d6-b08f-c603ec86e2e7 req-4a90031e-9195-4215-b09b-af726e4da2cf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:43.675576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-83244f67-3814-4d7b-a5c6-6121a091f437 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:43.697626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83244f67-3814-4d7b-a5c6-6121a091f437 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:43.698353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83244f67-3814-4d7b-a5c6-6121a091f437 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:43.699741 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-21bb2ed3-5493-46d6-b08f-c603ec86e2e7 req-4a90031e-9195-4215-b09b-af726e4da2cf service nova] Creating event network-changed:505c5faa-7d9a-450f-aaf6-c2129258b0e2 for instance 10a0c9f0-5988-434b-abc2-879962cea3c6 on n-h1-844627-10 Aug 04 14:05:43.700671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83244f67-3814-4d7b-a5c6-6121a091f437 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:43.701965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83244f67-3814-4d7b-a5c6-6121a091f437 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:43.709459 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-21bb2ed3-5493-46d6-b08f-c603ec86e2e7 req-4a90031e-9195-4215-b09b-af726e4da2cf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078376 Aug 04 14:05:43.710355 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1238/2473] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:43.717912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:43.719018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: 4f7a6c65-5f80-48bb-a324-23c01af35738] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:43.730683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:43.731162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:43.732958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:43.733430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:43.752401 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 HTTP/1.1 Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4f7a6c65-5f80-48bb-a324-23c01af35738'} Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:43.754150 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:43.758985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:43.758985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:43.758985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:43.758985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:43.758985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. Aug 04 14:05:43.758985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:43.761864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Instance 4f7a6c65-5f80-48bb-a324-23c01af35738 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:43.763465 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61771ccc-84d6-4c5d-aa9c-5bad9846ea25 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738" status: 404 len: 111 microversion: 2.1 time: 0.050804 Aug 04 14:05:43.768988 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1239/2474] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:43 2022] GET /compute/v2.1/servers/4f7a6c65-5f80-48bb-a324-23c01af35738 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:43.828508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:43.830231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:43.838167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:43.838783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:43.839704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:43.840279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:44.701057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-83244f67-3814-4d7b-a5c6-6121a091f437 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:44.732676 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-83244f67-3814-4d7b-a5c6-6121a091f437 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1709 microversion: 2.1 time: 1.071094 Aug 04 14:05:44.735402 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1236/2475] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:43 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1709 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:44.750240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4c5b2cc-9f68-4f99-ad25-355a0600d289 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Calling method '.version_select at 0x7f46f3cc4dc0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:44.828748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:44.838343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-b4c5b2cc-9f68-4f99-ad25-355a0600d289 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 could not be found", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:05:44.840546 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-b4c5b2cc-9f68-4f99-ad25-355a0600d289 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] HTTP exception thrown: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 Aug 04 14:05:44.847332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:44.849974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4c5b2cc-9f68-4f99-ad25-355a0600d289 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Request method failure captured: Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-floating-ips/3f2404f5-c235-4ea7-991d-6d33ab87ebd0 HTTP/1.1 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69IXW-8gCxGZcqOvfnQGXnOmGOXRoagSs-BnYBFjOg4lbGDzqexpBO7ZJBqdvW6aaSCKWTcWsGYZdQYUlM7JNxvKFXZ0avMPuFHnVSQH_91tmUEhuG4EH0FWXxqtuuT_BWMkd-gxV6lGSdZa0dkIJwN5wiF4Zwqf_3m8D1ZebDld9YM Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 20304ba814e645ca81950ce380878812 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-FloatingIPsTestJSON-80250292 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/20304ba814e645ca81950ce380878812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_20304ba814e645ca81950ce380878812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/20304ba814e645ca81950ce380878812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/20304ba814e645ca81950ce380878812"}]}] Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-FloatingIPsTestJSON-80250292 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 20304ba814e645ca81950ce380878812 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-FloatingIPsTestJSON-80250292 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-FloatingIPsTestJSON-80250292-project Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c26907efd1124e16abe5ea0c722b49db Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-FloatingIPsTestJSON-80250292-project Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: exception: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '3f2404f5-c235-4ea7-991d-6d33ab87ebd0'} Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 could not be found Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-65892e4d-9ee1-4282-bb27-087cd2240a34'] Aug 04 14:05:44.850385 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0. Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 Aug 04 14:05:44.861099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.871044 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-71409211-cf12-45c0-9f1b-2564ff41a206 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 200 len: 1362 microversion: 2.26 time: 1.060208 Aug 04 14:05:44.871044 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1240/2476] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:05:43 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 1362 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:44.871469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4c5b2cc-9f68-4f99-ad25-355a0600d289 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Returning 404 to user: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:44.872762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a8f687bb-66b9-40c8-b838-223096df84c2 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:44.873494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a8f687bb-66b9-40c8-b838-223096df84c2 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:44.879996 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b4c5b2cc-9f68-4f99-ad25-355a0600d289 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] 10.222.0.66 "GET /compute/v2.1/os-floating-ips/3f2404f5-c235-4ea7-991d-6d33ab87ebd0" status: 404 len: 111 microversion: 2.1 time: 0.125426 Aug 04 14:05:44.882114 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1237/2477] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 14:05:44 2022] GET /compute/v2.1/os-floating-ips/3f2404f5-c235-4ea7-991d-6d33ab87ebd0 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:44.891102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8f687bb-66b9-40c8-b838-223096df84c2 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:44.891568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8f687bb-66b9-40c8-b838-223096df84c2 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:44.892426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8f687bb-66b9-40c8-b838-223096df84c2 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:44.892914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8f687bb-66b9-40c8-b838-223096df84c2 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:44.901401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b059e3a8-91d5-4f29-a4bd-a92d0db9bb0f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f47002465e0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:44.978611 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-b059e3a8-91d5-4f29-a4bd-a92d0db9bb0f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Image not found. Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b059e3a8-91d5-4f29-a4bd-a92d0db9bb0f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 HTTP/1.1 Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'a7bbbfed-9760-4fc7-b809-82fddec27107'} Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a7bbbfed-9760-4fc7-b809-82fddec27107 to delete Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7bbbfed-9760-4fc7-b809-82fddec27107 could not be found. Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.982186 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b059e3a8-91d5-4f29-a4bd-a92d0db9bb0f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:44.989108 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b059e3a8-91d5-4f29-a4bd-a92d0db9bb0f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107" status: 404 len: 62 microversion: 2.1 time: 0.100584 Aug 04 14:05:44.998254 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1238/2478] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:44 2022] DELETE /compute/v2.1/images/a7bbbfed-9760-4fc7-b809-82fddec27107 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:05:45.007432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-deda2ec3-adb7-41a0-bff7-6cf8e1d32e7c tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:45.009042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-deda2ec3-adb7-41a0-bff7-6cf8e1d32e7c tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:45.021966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deda2ec3-adb7-41a0-bff7-6cf8e1d32e7c tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.023200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deda2ec3-adb7-41a0-bff7-6cf8e1d32e7c tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.025410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deda2ec3-adb7-41a0-bff7-6cf8e1d32e7c tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.026494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-deda2ec3-adb7-41a0-bff7-6cf8e1d32e7c tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.351392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a8f687bb-66b9-40c8-b838-223096df84c2 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:45.361941 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a8f687bb-66b9-40c8-b838-223096df84c2 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1521 microversion: 2.1 time: 0.501331 Aug 04 14:05:45.363241 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1241/2479] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:44 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:45.369491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6c377b57-5c9c-4ac2-8d33-b421de3cb7e7 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:45.370490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6c377b57-5c9c-4ac2-8d33-b421de3cb7e7 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:45.379003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c377b57-5c9c-4ac2-8d33-b421de3cb7e7 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.379975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c377b57-5c9c-4ac2-8d33-b421de3cb7e7 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.382048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c377b57-5c9c-4ac2-8d33-b421de3cb7e7 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.383309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c377b57-5c9c-4ac2-8d33-b421de3cb7e7 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.450876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-deda2ec3-adb7-41a0-bff7-6cf8e1d32e7c tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:45.475685 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-deda2ec3-adb7-41a0-bff7-6cf8e1d32e7c tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1314 microversion: 2.1 time: 0.475727 Aug 04 14:05:45.478040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1239/2480] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:44 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:45.501665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5aa2836d-af11-4d01-9265-db2a8bd88a02 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '.version_select at 0x7f47002069d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:45.520085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aa2836d-af11-4d01-9265-db2a8bd88a02 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.522032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5aa2836d-af11-4d01-9265-db2a8bd88a02 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.545057 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5aa2836d-af11-4d01-9265-db2a8bd88a02 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 1182 microversion: 2.1 time: 0.064015 Aug 04 14:05:45.546189 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1240/2481] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 14:05:45 2022] GET /compute/v2.1/os-migrations => generated 1182 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:45.558715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e1b20d40-181d-4b66-b9a1-c256fb09bd05 req-bdaa1234-85d9-41d5-909b-ee15b7d9a8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cce837-e96f-4d54-9b5f-009f1cf28a37", "name": "network-vif-plugged", "status": "completed", "tag": "e839d5c2-63ae-407f-adfb-ac36d9ef2748"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:45.565715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6c377b57-5c9c-4ac2-8d33-b421de3cb7e7 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9932e8de6124b578bf548756f749ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf6a4f1744e46e3b3947663133a78c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:45.569606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:45.581082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e1b20d40-181d-4b66-b9a1-c256fb09bd05 req-bdaa1234-85d9-41d5-909b-ee15b7d9a8ef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.582527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e1b20d40-181d-4b66-b9a1-c256fb09bd05 req-bdaa1234-85d9-41d5-909b-ee15b7d9a8ef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.583692 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6c377b57-5c9c-4ac2-8d33-b421de3cb7e7 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 200 len: 1646 microversion: 2.1 time: 0.218850 Aug 04 14:05:45.586545 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1242/2482] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:45 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 1646 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:45.596025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b2f7f654-07f6-4a57-b052-90174b7dca12 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Calling method '.version_select at 0x7f47005388b0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:45.619575 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e1b20d40-181d-4b66-b9a1-c256fb09bd05 req-bdaa1234-85d9-41d5-909b-ee15b7d9a8ef service nova] Creating event network-vif-plugged:e839d5c2-63ae-407f-adfb-ac36d9ef2748 for instance d7cce837-e96f-4d54-9b5f-009f1cf28a37 on n-h2-844627-10 Aug 04 14:05:45.629801 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e1b20d40-181d-4b66-b9a1-c256fb09bd05 req-bdaa1234-85d9-41d5-909b-ee15b7d9a8ef service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081269 Aug 04 14:05:45.631282 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1241/2483] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:45.643820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:45.645797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:45.659706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.669761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.676592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.678178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.702311 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 HTTP/1.1 Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'bff40e66-7ec3-44cd-b16b-c45f94bd0b77'} Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:45.704105 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e754633b-68dd-4b49-b0aa-873d84cb6e4f tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 404 len: 111 microversion: 2.1 time: 0.072390 Aug 04 14:05:45.712150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1242/2484] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:45 2022] DELETE /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:45.847650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:45.887564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-b2f7f654-07f6-4a57-b052-90174b7dca12 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 could not be found", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:05:45.888295 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-b2f7f654-07f6-4a57-b052-90174b7dca12 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] HTTP exception thrown: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b2f7f654-07f6-4a57-b052-90174b7dca12 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Request method failure captured: Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-floating-ips/3f2404f5-c235-4ea7-991d-6d33ab87ebd0 HTTP/1.1 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69IXW-8gCxGZcqOvfnQGXnOmGOXRoagSs-BnYBFjOg4lbGDzqexpBO7ZJBqdvW6aaSCKWTcWsGYZdQYUlM7JNxvKFXZ0avMPuFHnVSQH_91tmUEhuG4EH0FWXxqtuuT_BWMkd-gxV6lGSdZa0dkIJwN5wiF4Zwqf_3m8D1ZebDld9YM Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 20304ba814e645ca81950ce380878812 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-FloatingIPsTestJSON-80250292 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/20304ba814e645ca81950ce380878812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_20304ba814e645ca81950ce380878812"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/20304ba814e645ca81950ce380878812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/20304ba814e645ca81950ce380878812"}]}] Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-FloatingIPsTestJSON-80250292 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 20304ba814e645ca81950ce380878812 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-FloatingIPsTestJSON-80250292 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-FloatingIPsTestJSON-80250292-project Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c26907efd1124e16abe5ea0c722b49db Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-FloatingIPsTestJSON-80250292-project Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: exception: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3f2404f5-c235-4ea7-991d-6d33ab87ebd0'} Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 could not be found Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a624f990-2eda-434a-a5db-2ea2273663c0'] Aug 04 14:05:45.889952 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0. Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b2f7f654-07f6-4a57-b052-90174b7dca12 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] Returning 404 to user: Floating IP not found for ID 3f2404f5-c235-4ea7-991d-6d33ab87ebd0 {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b2f7f654-07f6-4a57-b052-90174b7dca12 tempest-FloatingIPsTestJSON-80250292 tempest-FloatingIPsTestJSON-80250292-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/3f2404f5-c235-4ea7-991d-6d33ab87ebd0" status: 404 len: 111 microversion: 2.1 time: 0.305017 Aug 04 14:05:45.903411 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1243/2485] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:05:45 2022] DELETE /compute/v2.1/os-floating-ips/3f2404f5-c235-4ea7-991d-6d33ab87ebd0 => generated 111 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:45.918840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:45.918840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:45.925414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.925881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.926861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:45.927955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:45.985789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-919577163", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "2344a004-88b5-43d1-a0c7-ab45883f4f84"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:46.005187 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] HTTP exception thrown: Instance is not a member of specified network Aug 04 14:05:46.015530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=14 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Request method failure captured: Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246/ips/invalid HTTP/1.1 Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69IbVYNsVtTaC_0eH5tozQIZ3cLrpb1yS8IKVnzLuWfUPebv6qrj6Buw_8eI9JgN3QW8i59lQWPQdUK01AS-bE3v8ef-a0pF7I2sGIJHfdlFkayi6uAkDBDQLwLlnQoFmxPHqUCKFH8yoM7bYevNLb95CrVjE_THBW6qFE2bAehsQ38 Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: bb2fa679cfa341498c0665efdaf70c3d Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1672801364 Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bb2fa679cfa341498c0665efdaf70c3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bb2fa679cfa341498c0665efdaf70c3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bb2fa679cfa341498c0665efdaf70c3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bb2fa679cfa341498c0665efdaf70c3d"}]}] Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1672801364 Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: bb2fa679cfa341498c0665efdaf70c3d Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1672801364 Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerAddressesNegativeTestJSON-1672801364-project Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 705c1752c9e642aeba041eb7ea7f6b02 Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1672801364-project Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance is not a member of specified network Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': '91392508-a2d7-4ee4-a1cd-fbae92beb246', 'id': 'invalid'} Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 04 14:05:46.020422 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:46.027940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Returning 404 to user: Instance is not a member of specified network {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:46.027940 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a6874584-ea2b-41c4-97a4-5ef40e537736 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.128654 Aug 04 14:05:46.033694 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1244/2486] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:05:45 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246/ips/invalid => generated 91 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:05:46.039877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0e5e05f-bbb1-4858-b009-c4f43558c052 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:46.040767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c0e5e05f-bbb1-4858-b009-c4f43558c052 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:46.048586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0e5e05f-bbb1-4858-b009-c4f43558c052 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:46.049376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0e5e05f-bbb1-4858-b009-c4f43558c052 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:46.050394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0e5e05f-bbb1-4858-b009-c4f43558c052 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:46.051012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0e5e05f-bbb1-4858-b009-c4f43558c052 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:46.120543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] validate_networks() for [('2344a004-88b5-43d1-a0c7-ab45883f4f84', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:05:46.794864 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0e5e05f-bbb1-4858-b009-c4f43558c052 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1862 microversion: 2.1 time: 0.759506 Aug 04 14:05:46.815198 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1245/2487] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:46 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1862 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:46.815198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:46.815198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: bff40e66-7ec3-44cd-b16b-c45f94bd0b77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:46.815198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:46.815703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:46.816112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:46.816565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:46.849911 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 HTTP/1.1 Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'bff40e66-7ec3-44cd-b16b-c45f94bd0b77'} Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:46.851514 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:46.860616 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:46.860616 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:46.860616 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:46.860616 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:46.860616 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. Aug 04 14:05:46.860616 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:46.860616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Instance bff40e66-7ec3-44cd-b16b-c45f94bd0b77 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:46.860616 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-037f85fa-d88a-400c-bda3-71ffd3479699 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77" status: 404 len: 111 microversion: 2.1 time: 0.049434 Aug 04 14:05:46.860616 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1246/2488] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:46 2022] GET /compute/v2.1/servers/bff40e66-7ec3-44cd-b16b-c45f94bd0b77 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:46.874442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:46.875371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:46.886008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:46.886671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:46.887756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:46.889041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:47.538387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:47.552700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:47.557354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:47.562521 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d6d91339-ffd6-4924-80f4-b401372f751e tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 200 len: 1362 microversion: 2.26 time: 0.692416 Aug 04 14:05:47.574774 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1247/2489] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:05:46 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 1362 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:47.580144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1bb9689-32f7-4f3f-8618-f770c4a2e826 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:47.581840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e1bb9689-32f7-4f3f-8618-f770c4a2e826 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Failed to fetch instance by id 999 {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 14:05:47.584604 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e1bb9689-32f7-4f3f-8618-f770c4a2e826 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] HTTP exception thrown: Instance 999 could not be found. Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1bb9689-32f7-4f3f-8618-f770c4a2e826 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Request method failure captured: Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69IbVYNsVtTaC_0eH5tozQIZ3cLrpb1yS8IKVnzLuWfUPebv6qrj6Buw_8eI9JgN3QW8i59lQWPQdUK01AS-bE3v8ef-a0pF7I2sGIJHfdlFkayi6uAkDBDQLwLlnQoFmxPHqUCKFH8yoM7bYevNLb95CrVjE_THBW6qFE2bAehsQ38 Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: bb2fa679cfa341498c0665efdaf70c3d Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1672801364 Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bb2fa679cfa341498c0665efdaf70c3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bb2fa679cfa341498c0665efdaf70c3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bb2fa679cfa341498c0665efdaf70c3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bb2fa679cfa341498c0665efdaf70c3d"}]}] Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1672801364 Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: bb2fa679cfa341498c0665efdaf70c3d Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1672801364 Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerAddressesNegativeTestJSON-1672801364-project Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 705c1752c9e642aeba041eb7ea7f6b02 Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1672801364-project Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 999 could not be found. Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': '999'} Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 04 14:05:47.598216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:47.607192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1bb9689-32f7-4f3f-8618-f770c4a2e826 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Returning 404 to user: Instance 999 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:47.607192 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e1bb9689-32f7-4f3f-8618-f770c4a2e826 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.026110 Aug 04 14:05:47.607192 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1248/2490] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 14:05:47 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:05:47.613167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-25a3517e-4d6a-455e-b5fb-c2478cfac614 req-13356402-4530-413e-9083-d5baf16986ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ce31a57-07b2-4d87-9822-58690ae581d6", "name": "network-vif-deleted", "tag": "2b5dd98f-40d9-4142-b50c-f6c8fb356c9e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:47.649439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-25a3517e-4d6a-455e-b5fb-c2478cfac614 req-13356402-4530-413e-9083-d5baf16986ed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:47.650474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-25a3517e-4d6a-455e-b5fb-c2478cfac614 req-13356402-4530-413e-9083-d5baf16986ed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:47.676119 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-25a3517e-4d6a-455e-b5fb-c2478cfac614 req-13356402-4530-413e-9083-d5baf16986ed service nova] Creating event network-vif-deleted:2b5dd98f-40d9-4142-b50c-f6c8fb356c9e for instance 5ce31a57-07b2-4d87-9822-58690ae581d6 on n-h2-844627-10 Aug 04 14:05:47.683048 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-25a3517e-4d6a-455e-b5fb-c2478cfac614 req-13356402-4530-413e-9083-d5baf16986ed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074395 Aug 04 14:05:47.684786 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1249/2491] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:47.696642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d00e8cdd-8f59-4320-abf5-ce8ee3d9b416 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:47.704473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d00e8cdd-8f59-4320-abf5-ce8ee3d9b416 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:47.736131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d00e8cdd-8f59-4320-abf5-ce8ee3d9b416 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:47.736997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d00e8cdd-8f59-4320-abf5-ce8ee3d9b416 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:47.738136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d00e8cdd-8f59-4320-abf5-ce8ee3d9b416 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:47.738793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d00e8cdd-8f59-4320-abf5-ce8ee3d9b416 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:48.152213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:05:48.153042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:05:48.153798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:05:48.154494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:05:48.155767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:05:48.173640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:48.174697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:48.176351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:48.177471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:48.230068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:05:48.251781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for user df576732ca5c442694d507fd4dc58279 and project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:05:48.277789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d00e8cdd-8f59-4320-abf5-ce8ee3d9b416 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:48.281072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:05:48.286607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:05:48.296913 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d00e8cdd-8f59-4320-abf5-ce8ee3d9b416 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1314 microversion: 2.1 time: 0.609378 Aug 04 14:05:48.298520 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1250/2492] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:47 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:48.329659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:48.330331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] [instance: 5ce31a57-07b2-4d87-9822-58690ae581d6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:48.347602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:48.349315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:48.351313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:48.352784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:48.388812 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] HTTP exception thrown: Instance 5ce31a57-07b2-4d87-9822-58690ae581d6 could not be found. Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Request method failure captured: Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 HTTP/1.1 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69HiG9Y4s2L6VPlSl6-wDte7Av5HQd7eM-OOgU9qWnEwCnzWvRXnnFTRzXhitjH0QiJVSBTg7-CNNJ2UQz0nMBZ8IDkXrSPkedvKbdEJpWhOVKAjozFPzyafxdvynkhDFObWQ6c5PKOrKP0dU-jHOkTUeMSxS3h0ClwjsO6t9FPbeIA Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dbf6a4f1744e46e3b3947663133a78c1 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestManualDisk-966786608 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dbf6a4f1744e46e3b3947663133a78c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dbf6a4f1744e46e3b3947663133a78c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dbf6a4f1744e46e3b3947663133a78c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dbf6a4f1744e46e3b3947663133a78c1"}]}] Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestManualDisk-966786608 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dbf6a4f1744e46e3b3947663133a78c1 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestManualDisk-966786608 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestManualDisk-966786608-project Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c9932e8de6124b578bf548756f749ef1 Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestManualDisk-966786608-project Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 5ce31a57-07b2-4d87-9822-58690ae581d6 could not be found. Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '5ce31a57-07b2-4d87-9822-58690ae581d6'} Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ce31a57-07b2-4d87-9822-58690ae581d6 could not be found. Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ce31a57-07b2-4d87-9822-58690ae581d6 could not be found. Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:48.394830 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.405603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:48.405603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:48.405603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:48.405603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:48.405603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:48.405603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ce31a57-07b2-4d87-9822-58690ae581d6 could not be found. Aug 04 14:05:48.405603 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.405603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Returning 404 to user: Instance 5ce31a57-07b2-4d87-9822-58690ae581d6 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:48.405603 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d510969-6b34-4134-b0a6-ed392b15d1de tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6" status: 404 len: 111 microversion: 2.1 time: 0.088587 Aug 04 14:05:48.413881 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c6acc26-bbe1-4dac-a5de-ee704476984b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.693761 Aug 04 14:05:48.414316 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1251/2493] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:48 2022] GET /compute/v2.1/servers/5ce31a57-07b2-4d87-9822-58690ae581d6 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:48.414577 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1243/2494] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:05:48.420505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4647b63-fb00-4614-9edb-2a8dbff57b67 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:48.421188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f4647b63-fb00-4614-9edb-2a8dbff57b67 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:48.430372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4647b63-fb00-4614-9edb-2a8dbff57b67 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:48.430937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4647b63-fb00-4614-9edb-2a8dbff57b67 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:48.431871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4647b63-fb00-4614-9edb-2a8dbff57b67 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:48.433113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-67cc7ca5-ea3f-4f8b-a210-1edcccf62a92 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '.version_select at 0x7f4700206b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:48.433545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4647b63-fb00-4614-9edb-2a8dbff57b67 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:48.501535 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-67cc7ca5-ea3f-4f8b-a210-1edcccf62a92 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Image not found. Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-67cc7ca5-ea3f-4f8b-a210-1edcccf62a92 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 HTTP/1.1 Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '397b0202-29e7-4c73-bd67-a577152aabe8'} Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 397b0202-29e7-4c73-bd67-a577152aabe8 to delete Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 397b0202-29e7-4c73-bd67-a577152aabe8 could not be found. Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.508608 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:05:48.523883 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:48.531459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-67cc7ca5-ea3f-4f8b-a210-1edcccf62a92 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:48.533759 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-67cc7ca5-ea3f-4f8b-a210-1edcccf62a92 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8" status: 404 len: 62 microversion: 2.1 time: 0.115114 Aug 04 14:05:48.534370 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1244/2495] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:48 2022] DELETE /compute/v2.1/images/397b0202-29e7-4c73-bd67-a577152aabe8 => generated 62 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:05:48.545120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b320057-8cc3-421f-943d-96d16dfd352b tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:48.546479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b320057-8cc3-421f-943d-96d16dfd352b tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:48.559795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b320057-8cc3-421f-943d-96d16dfd352b tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:48.561170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b320057-8cc3-421f-943d-96d16dfd352b tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:48.563115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b320057-8cc3-421f-943d-96d16dfd352b tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:48.565618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b320057-8cc3-421f-943d-96d16dfd352b tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:48.603042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b320057-8cc3-421f-943d-96d16dfd352b tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:05:48.722116 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b320057-8cc3-421f-943d-96d16dfd352b tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "DELETE /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 204 len: 0 microversion: 2.1 time: 0.184408 Aug 04 14:05:48.723293 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1245/2496] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:48 2022] DELETE /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:48.730335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e8edd5c-0eb1-44cd-8917-0f0b41663b57 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] Calling method '.version_select at 0x7f46f3b78b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:48.762620 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e8edd5c-0eb1-44cd-8917-0f0b41663b57 tempest-ServersTestManualDisk-966786608 tempest-ServersTestManualDisk-966786608-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676829392" status: 202 len: 0 microversion: 2.1 time: 0.036643 Aug 04 14:05:48.764224 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1246/2497] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:05:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676829392 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:48.775701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b08680a-a835-4894-9a61-4fd130f2ac4f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:48.777828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1b08680a-a835-4894-9a61-4fd130f2ac4f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:49.147582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1b08680a-a835-4894-9a61-4fd130f2ac4f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:49.163255 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1b08680a-a835-4894-9a61-4fd130f2ac4f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1192 microversion: 2.1 time: 0.397362 Aug 04 14:05:49.178151 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1247/2498] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:48 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1192 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:49.184757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:49.185901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:49.195951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:49.197552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:49.198655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:49.199282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:49.223554 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 HTTP/1.1 Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'a7ebe867-4b9d-485d-8966-8f8ba3004e79'} Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:49.232287 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:49.236493 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:49.246738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:49.248929 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e88ed3a3-ba51-40b1-945e-75412f1055d3 tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 404 len: 111 microversion: 2.1 time: 0.068863 Aug 04 14:05:49.250274 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1248/2499] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:49 2022] DELETE /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:49.272549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:49.279190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:49.291941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:49.293872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:49.295513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:49.296466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:49.368154 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4647b63-fb00-4614-9edb-2a8dbff57b67 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1862 microversion: 2.1 time: 0.951433 Aug 04 14:05:49.370227 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1252/2500] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:48 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1862 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:49.376726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bec3e428-d23a-4eed-8c88-e429f48f5de9 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:49.377703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bec3e428-d23a-4eed-8c88-e429f48f5de9 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:49.389011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bec3e428-d23a-4eed-8c88-e429f48f5de9 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:49.389974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bec3e428-d23a-4eed-8c88-e429f48f5de9 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:49.391018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bec3e428-d23a-4eed-8c88-e429f48f5de9 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:49.391647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bec3e428-d23a-4eed-8c88-e429f48f5de9 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.055387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:50.077970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:50.086134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:50.088097 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-097d8254-42dd-4dbf-a88b-bd3c64ed00aa tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 200 len: 1545 microversion: 2.26 time: 0.829079 Aug 04 14:05:50.089112 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1249/2501] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:05:49 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 1545 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:50.107871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bec3e428-d23a-4eed-8c88-e429f48f5de9 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:50.115779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:50.116670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] [instance: a7ebe867-4b9d-485d-8966-8f8ba3004e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:50.124662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.125401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.126416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.127086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.130022 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bec3e428-d23a-4eed-8c88-e429f48f5de9 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1527 microversion: 2.1 time: 0.758061 Aug 04 14:05:50.131193 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1253/2502] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:49 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1527 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:50.142074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-39afc1c1-dc6f-4b8b-b35c-f683780d57f8 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:50.143340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-39afc1c1-dc6f-4b8b-b35c-f683780d57f8 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:50.150375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:50.158025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:50.166807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39afc1c1-dc6f-4b8b-b35c-f683780d57f8 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.168179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39afc1c1-dc6f-4b8b-b35c-f683780d57f8 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.178480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39afc1c1-dc6f-4b8b-b35c-f683780d57f8 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.178925 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] HTTP exception thrown: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:50.179406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39afc1c1-dc6f-4b8b-b35c-f683780d57f8 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Request method failure captured: Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 HTTP/1.1 Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Df1P7jXwuRroFkGBBzVfzg6WTqV3eQzp07hhzkACa1qeeOS1X2lL-B4fKHjRaTgv1VYg973Q_xddtsIHkqpy4EGPj_h3Mc7MuxG8biCyNi4Kq1jAtDP1PGGg3XgmGkdG6rJMU8lxbkbR5P00RrGzOumxbyzyKK4DX5UtMTyALRs_E Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2c78c75d748a4fe29f1bcdbe40d280a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2c78c75d748a4fe29f1bcdbe40d280a9"}]}] Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesTestJSON-717502378 Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2c78c75d748a4fe29f1bcdbe40d280a9 Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesTestJSON-717502378 Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 69f66d07b9ed48d0b9e2763d9659df3f Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesTestJSON-717502378-project Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'a7ebe867-4b9d-485d-8966-8f8ba3004e79'} Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:50.181450 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:50.186210 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:50.186210 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:50.186210 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:50.186210 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:50.186210 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. Aug 04 14:05:50.186210 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:05:50.188684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] Returning 404 to user: Instance a7ebe867-4b9d-485d-8966-8f8ba3004e79 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:50.191128 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-35799c94-5630-4577-9b30-f5ad8301329a tempest-ImagesTestJSON-717502378 tempest-ImagesTestJSON-717502378-project] 10.222.0.66 "GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79" status: 404 len: 111 microversion: 2.1 time: 0.087050 Aug 04 14:05:50.193337 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1250/2503] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:50 2022] GET /compute/v2.1/servers/a7ebe867-4b9d-485d-8966-8f8ba3004e79 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:50.202163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2c8cf769-6740-4000-8ecb-e474b49434a4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:50.202954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2c8cf769-6740-4000-8ecb-e474b49434a4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:50.212768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c8cf769-6740-4000-8ecb-e474b49434a4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.213628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c8cf769-6740-4000-8ecb-e474b49434a4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.214679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c8cf769-6740-4000-8ecb-e474b49434a4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.215316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c8cf769-6740-4000-8ecb-e474b49434a4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.429513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-2c8cf769-6740-4000-8ecb-e474b49434a4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lazy-loading 'services' on Instance uuid 739d0629-de24-4a72-83a0-2f443e0af803 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:50.603882 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2c8cf769-6740-4000-8ecb-e474b49434a4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "DELETE /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments/9f330167-1b84-4f27-a665-192515a0f018" status: 202 len: 0 microversion: 2.1 time: 0.405435 Aug 04 14:05:50.605430 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1251/2504] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:05:50 2022] DELETE /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments/9f330167-1b84-4f27-a665-192515a0f018 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:05:50.618450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f46f3c46c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:50.649743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.650580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.653257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:50.666288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.666605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.668236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.669101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.748976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.750717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.797295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:50.798441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:50.886423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:51.043312 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-22de129f-229b-4798-b5a0-e1b4e48028cc tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1159084087" status: 201 len: 0 microversion: 2.26 time: 0.434396 Aug 04 14:05:51.051517 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1252/2505] 10.222.0.66 () {62 vars in 1380 bytes} [Thu Aug 4 14:05:50 2022] PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1159084087 => generated 0 bytes in 439 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 14:05:51.062173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c060112-116a-4c3b-bce6-3231c3951483 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:51.064123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0c060112-116a-4c3b-bce6-3231c3951483 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:51.081370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c060112-116a-4c3b-bce6-3231c3951483 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.082173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c060112-116a-4c3b-bce6-3231c3951483 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.084721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c060112-116a-4c3b-bce6-3231c3951483 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.085525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c060112-116a-4c3b-bce6-3231c3951483 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.110046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-39afc1c1-dc6f-4b8b-b35c-f683780d57f8 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:51.133647 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-39afc1c1-dc6f-4b8b-b35c-f683780d57f8 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1314 microversion: 2.1 time: 0.998370 Aug 04 14:05:51.168444 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1254/2506] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:50 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1314 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:51.193788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-07406a38-4448-4c90-a023-76110aaed2db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:51.200713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-07406a38-4448-4c90-a023-76110aaed2db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:51.238100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07406a38-4448-4c90-a023-76110aaed2db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.239165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07406a38-4448-4c90-a023-76110aaed2db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.241357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07406a38-4448-4c90-a023-76110aaed2db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.242425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07406a38-4448-4c90-a023-76110aaed2db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.320269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0c060112-116a-4c3b-bce6-3231c3951483 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:51.347459 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c060112-116a-4c3b-bce6-3231c3951483 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1262 microversion: 2.1 time: 0.300603 Aug 04 14:05:51.359652 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-07406a38-4448-4c90-a023-76110aaed2db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188702 Aug 04 14:05:51.360688 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1255/2507] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:05:51 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:51.371758 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1253/2508] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:51 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1262 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:51.384766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e665c704-9519-4644-b9e4-a638f03b328d tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:51.385714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6dd92246-37e9-4dc1-ac50-604464520c36 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f4700154dc0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:51.398567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e665c704-9519-4644-b9e4-a638f03b328d tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:51.401870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd92246-37e9-4dc1-ac50-604464520c36 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.409612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd92246-37e9-4dc1-ac50-604464520c36 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.415745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e665c704-9519-4644-b9e4-a638f03b328d tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.424076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e665c704-9519-4644-b9e4-a638f03b328d tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.425432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e665c704-9519-4644-b9e4-a638f03b328d tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.426088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e665c704-9519-4644-b9e4-a638f03b328d tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.462500 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6dd92246-37e9-4dc1-ac50-604464520c36 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1159084087" status: 204 len: 0 microversion: 2.26 time: 0.089147 Aug 04 14:05:51.463603 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1254/2509] 10.222.0.66 () {60 vars in 1361 bytes} [Thu Aug 4 14:05:51 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1159084087 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:51.473974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f47000ffee0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:51.493838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.494383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.495000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:51.509652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.510293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.511734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.512314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.575804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.576454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.613929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:51.646564 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f31acda9-04cf-4a9c-98d4-fd18a33669ea tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 204 len: 0 microversion: 2.26 time: 0.174013 Aug 04 14:05:51.655705 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1255/2510] 10.222.0.66 () {60 vars in 1295 bytes} [Thu Aug 4 14:05:51 2022] DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:51.665385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3baaae4c-fdab-4e81-9cc7-e494181eb1be tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f47002f13a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:51.675642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3baaae4c-fdab-4e81-9cc7-e494181eb1be tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.676059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3baaae4c-fdab-4e81-9cc7-e494181eb1be tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.713764 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3baaae4c-fdab-4e81-9cc7-e494181eb1be tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 200 len: 12 microversion: 2.26 time: 0.055803 Aug 04 14:05:51.714429 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1256/2511] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 14:05:51 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 12 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:51.743403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f47002e1430>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:51.769554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.770029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.770582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:51.781769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.782554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.785963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.790098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.903627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.904154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:51.937575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:51.938022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.019697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:52.081163 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b2b6f99f-dfce-48ec-bbfe-46a639032176 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1062899457" status: 201 len: 0 microversion: 2.26 time: 0.353450 Aug 04 14:05:52.087968 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1257/2512] 10.222.0.66 () {62 vars in 1380 bytes} [Thu Aug 4 14:05:51 2022] PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1062899457 => generated 0 bytes in 356 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 14:05:52.103315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c5a5ad2-2e30-4593-8e1a-05dccadcbf47 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f4700246b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:52.126844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c5a5ad2-2e30-4593-8e1a-05dccadcbf47 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.127608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c5a5ad2-2e30-4593-8e1a-05dccadcbf47 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.146990 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c5a5ad2-2e30-4593-8e1a-05dccadcbf47 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 200 len: 36 microversion: 2.26 time: 0.051341 Aug 04 14:05:52.148566 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1258/2513] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 14:05:52 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 36 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:52.169223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f4700246c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:52.178691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.179143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.179640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:52.189052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.189311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.190160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.190664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.220787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.221531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.266516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:52.309310 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5eaf7776-8d69-49a6-b22a-d3056d55dfd6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1062899457" status: 204 len: 0 microversion: 2.26 time: 0.144222 Aug 04 14:05:52.313284 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1259/2514] 10.222.0.66 () {60 vars in 1364 bytes} [Thu Aug 4 14:05:52 2022] DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1062899457 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:52.330423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1b20d04-64ec-4671-858a-297ecc4acd91 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:52.331992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1b20d04-64ec-4671-858a-297ecc4acd91 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:52.348743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e665c704-9519-4644-b9e4-a638f03b328d tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:52.363341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1b20d04-64ec-4671-858a-297ecc4acd91 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.363587 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e665c704-9519-4644-b9e4-a638f03b328d tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1527 microversion: 2.1 time: 0.988353 Aug 04 14:05:52.363695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1b20d04-64ec-4671-858a-297ecc4acd91 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.365464 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1256/2515] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:51 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1527 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:52.375307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7df51587-20c9-40eb-9e67-b9724a3df108 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f470031af70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:52.384476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1b20d04-64ec-4671-858a-297ecc4acd91 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.385498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1b20d04-64ec-4671-858a-297ecc4acd91 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.391837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7df51587-20c9-40eb-9e67-b9724a3df108 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.392296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7df51587-20c9-40eb-9e67-b9724a3df108 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.458743 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7df51587-20c9-40eb-9e67-b9724a3df108 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 200 len: 12 microversion: 2.26 time: 0.091551 Aug 04 14:05:52.465213 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1257/2516] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 14:05:52 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 12 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:52.526520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-04958072-605a-4008-bb6c-3335422a8baa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:52.534259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-04958072-605a-4008-bb6c-3335422a8baa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:52.598850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04958072-605a-4008-bb6c-3335422a8baa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.602149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04958072-605a-4008-bb6c-3335422a8baa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.604132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04958072-605a-4008-bb6c-3335422a8baa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.610979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04958072-605a-4008-bb6c-3335422a8baa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.794311 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-04958072-605a-4008-bb6c-3335422a8baa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.316027 Aug 04 14:05:52.799364 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1258/2517] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:05:52 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments => generated 197 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:52.822562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f63e1990-b9d4-4e88-a42e-10f069f75d1f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:52.823849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f63e1990-b9d4-4e88-a42e-10f069f75d1f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:52.866845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f63e1990-b9d4-4e88-a42e-10f069f75d1f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.867416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f63e1990-b9d4-4e88-a42e-10f069f75d1f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:52.868394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f63e1990-b9d4-4e88-a42e-10f069f75d1f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:52.868941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f63e1990-b9d4-4e88-a42e-10f069f75d1f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.283879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f63e1990-b9d4-4e88-a42e-10f069f75d1f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:53.301801 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f63e1990-b9d4-4e88-a42e-10f069f75d1f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1250 microversion: 2.1 time: 0.500015 Aug 04 14:05:53.302858 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1259/2518] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:52 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1250 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:53.315700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f470567a280>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:53.337116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.337892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.338613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:53.346168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.346940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.347909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.348535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.378403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.381475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.397345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:53.412609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c1b20d04-64ec-4671-858a-297ecc4acd91 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:53.422328 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2bd2ae2b-a180-43d4-8088-ad133d7b88fb tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 204 len: 0 microversion: 2.26 time: 0.118083 Aug 04 14:05:53.423980 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1260/2519] 10.222.0.66 () {60 vars in 1295 bytes} [Thu Aug 4 14:05:53 2022] DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:53.431426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-99c3a961-8034-44b5-8c08-1a37e4218f51 req-a00a068c-bd1f-4cc3-952f-fc5f3f2ae030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a0c9f0-5988-434b-abc2-879962cea3c6", "name": "network-vif-plugged", "status": "completed", "tag": "505c5faa-7d9a-450f-aaf6-c2129258b0e2"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:53.431697 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1b20d04-64ec-4671-858a-297ecc4acd91 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1314 microversion: 2.1 time: 1.111738 Aug 04 14:05:53.432397 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1260/2520] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:52 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1314 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:53.441240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b02ae29-de5b-45f5-8b7d-470bea51176f tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:53.441955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b02ae29-de5b-45f5-8b7d-470bea51176f tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:53.446062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-99c3a961-8034-44b5-8c08-1a37e4218f51 req-a00a068c-bd1f-4cc3-952f-fc5f3f2ae030 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.446927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-99c3a961-8034-44b5-8c08-1a37e4218f51 req-a00a068c-bd1f-4cc3-952f-fc5f3f2ae030 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.466479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b02ae29-de5b-45f5-8b7d-470bea51176f tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.467017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b02ae29-de5b-45f5-8b7d-470bea51176f tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.468096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b02ae29-de5b-45f5-8b7d-470bea51176f tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.468596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b02ae29-de5b-45f5-8b7d-470bea51176f tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.475482 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-99c3a961-8034-44b5-8c08-1a37e4218f51 req-a00a068c-bd1f-4cc3-952f-fc5f3f2ae030 service nova] Creating event network-vif-plugged:505c5faa-7d9a-450f-aaf6-c2129258b0e2 for instance 10a0c9f0-5988-434b-abc2-879962cea3c6 on n-h1-844627-10 Aug 04 14:05:53.487497 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-99c3a961-8034-44b5-8c08-1a37e4218f51 req-a00a068c-bd1f-4cc3-952f-fc5f3f2ae030 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061213 Aug 04 14:05:53.489487 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1261/2521] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:53.500231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f47002d4550>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:53.522429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.523567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.525007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:53.541347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.542498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.546440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.557115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.661275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.668201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.702437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.708682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.786685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:53.819226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:53.867025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b02ae29-de5b-45f5-8b7d-470bea51176f tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '705c1752c9e642aeba041eb7ea7f6b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2fa679cfa341498c0665efdaf70c3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:53.872360 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-982926d1-8f11-47ed-843a-5f3415d2f04b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1260875856" status: 201 len: 0 microversion: 2.26 time: 0.376178 Aug 04 14:05:53.875129 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1262/2522] 10.222.0.66 () {62 vars in 1380 bytes} [Thu Aug 4 14:05:53 2022] PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-1260875856 => generated 0 bytes in 384 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 14:05:53.883576 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b02ae29-de5b-45f5-8b7d-470bea51176f tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 200 len: 1485 microversion: 2.1 time: 0.449537 Aug 04 14:05:53.884505 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1261/2523] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:53 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 1485 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:53.888153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-23fdaefe-83d3-4da2-9211-8488530e8be3 req-f2692214-5a01-4980-b40b-ab03da008cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91392508-a2d7-4ee4-a1cd-fbae92beb246", "name": "network-vif-deleted", "tag": "2a13517b-dd3d-4399-aca6-9c3925f072b7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:53.898102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-969f4b14-ec65-4cf6-8137-7acf5141e8db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:53.902049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-969f4b14-ec65-4cf6-8137-7acf5141e8db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:53.923454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-23fdaefe-83d3-4da2-9211-8488530e8be3 req-f2692214-5a01-4980-b40b-ab03da008cdb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.923741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-969f4b14-ec65-4cf6-8137-7acf5141e8db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.924017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-969f4b14-ec65-4cf6-8137-7acf5141e8db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.924844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-969f4b14-ec65-4cf6-8137-7acf5141e8db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:53.925947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-969f4b14-ec65-4cf6-8137-7acf5141e8db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.929078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-23fdaefe-83d3-4da2-9211-8488530e8be3 req-f2692214-5a01-4980-b40b-ab03da008cdb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:53.994863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-23fdaefe-83d3-4da2-9211-8488530e8be3 req-f2692214-5a01-4980-b40b-ab03da008cdb service nova] Creating event network-vif-deleted:2a13517b-dd3d-4399-aca6-9c3925f072b7 for instance 91392508-a2d7-4ee4-a1cd-fbae92beb246 on n-h2-844627-10 Aug 04 14:05:54.006080 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-23fdaefe-83d3-4da2-9211-8488530e8be3 req-f2692214-5a01-4980-b40b-ab03da008cdb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126461 Aug 04 14:05:54.006369 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-969f4b14-ec65-4cf6-8137-7acf5141e8db tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119969 Aug 04 14:05:54.008555 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1262/2524] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:05:53 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:54.009325 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1263/2525] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:54.028394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f46f3c46700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:54.054818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.055679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.072096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:54.118934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.120014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.122775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.123570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.197214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:54.226839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.233358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.269472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.276598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.348165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3688cf98-15bd-47bc-b39c-cb8afbb3bb8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:54.349329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3688cf98-15bd-47bc-b39c-cb8afbb3bb8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:54.366020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3688cf98-15bd-47bc-b39c-cb8afbb3bb8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.372656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3688cf98-15bd-47bc-b39c-cb8afbb3bb8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.374087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3688cf98-15bd-47bc-b39c-cb8afbb3bb8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.379353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3688cf98-15bd-47bc-b39c-cb8afbb3bb8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.410000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:54.453489 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-55b9d93b-787c-4573-951d-0ffb438f270c tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-216730416" status: 201 len: 0 microversion: 2.26 time: 0.443208 Aug 04 14:05:54.468364 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1263/2526] 10.222.0.66 () {62 vars in 1377 bytes} [Thu Aug 4 14:05:54 2022] PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-216730416 => generated 0 bytes in 459 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 14:05:54.478931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b2b2eef-4382-49a9-add0-499314b36d53 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:54.480562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b2b2eef-4382-49a9-add0-499314b36d53 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:54.493291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b2b2eef-4382-49a9-add0-499314b36d53 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.494608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b2b2eef-4382-49a9-add0-499314b36d53 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.496377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b2b2eef-4382-49a9-add0-499314b36d53 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.497511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b2b2eef-4382-49a9-add0-499314b36d53 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.639496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3688cf98-15bd-47bc-b39c-cb8afbb3bb8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:54.670371 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3688cf98-15bd-47bc-b39c-cb8afbb3bb8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1250 microversion: 2.1 time: 0.333832 Aug 04 14:05:54.683819 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1264/2527] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:54 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1250 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:54.687080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f47002295e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:54.714712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.715516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.716389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:54.739910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.740511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.746466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.747296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.835051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.835546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.873489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:54.906290 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b84c76a9-b581-4c8e-b509-9456190ade4b tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 204 len: 0 microversion: 2.26 time: 0.227347 Aug 04 14:05:54.907853 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1265/2528] 10.222.0.66 () {60 vars in 1295 bytes} [Thu Aug 4 14:05:54 2022] DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:54.917623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5960ae95-fc6c-43b1-b99a-be01ca2d65e6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f47002d4430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:54.936357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5960ae95-fc6c-43b1-b99a-be01ca2d65e6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:54.937744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5960ae95-fc6c-43b1-b99a-be01ca2d65e6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:54.967139 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5960ae95-fc6c-43b1-b99a-be01ca2d65e6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 200 len: 12 microversion: 2.26 time: 0.053221 Aug 04 14:05:54.969766 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1266/2529] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 14:05:54 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:05:54.981310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:54.982446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] [instance: 91392508-a2d7-4ee4-a1cd-fbae92beb246] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:55.002071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.003350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.004222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.004682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.067429 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] HTTP exception thrown: Instance 91392508-a2d7-4ee4-a1cd-fbae92beb246 could not be found. Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Request method failure captured: Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 HTTP/1.1 Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69IbVYNsVtTaC_0eH5tozQIZ3cLrpb1yS8IKVnzLuWfUPebv6qrj6Buw_8eI9JgN3QW8i59lQWPQdUK01AS-bE3v8ef-a0pF7I2sGIJHfdlFkayi6uAkDBDQLwLlnQoFmxPHqUCKFH8yoM7bYevNLb95CrVjE_THBW6qFE2bAehsQ38 Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: bb2fa679cfa341498c0665efdaf70c3d Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1672801364 Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bb2fa679cfa341498c0665efdaf70c3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bb2fa679cfa341498c0665efdaf70c3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bb2fa679cfa341498c0665efdaf70c3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bb2fa679cfa341498c0665efdaf70c3d"}]}] Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1672801364 Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: bb2fa679cfa341498c0665efdaf70c3d Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1672801364 Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerAddressesNegativeTestJSON-1672801364-project Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 705c1752c9e642aeba041eb7ea7f6b02 Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1672801364-project Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 91392508-a2d7-4ee4-a1cd-fbae92beb246 could not be found. Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '91392508-a2d7-4ee4-a1cd-fbae92beb246'} Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91392508-a2d7-4ee4-a1cd-fbae92beb246 could not be found. Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91392508-a2d7-4ee4-a1cd-fbae92beb246 could not be found. Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:55.074903 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:05:55.089116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:55.089116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:05:55.089116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:05:55.089116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:05:55.089116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:05:55.089116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:05:55.089116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91392508-a2d7-4ee4-a1cd-fbae92beb246 could not be found. Aug 04 14:05:55.089116 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:05:55.102322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] Returning 404 to user: Instance 91392508-a2d7-4ee4-a1cd-fbae92beb246 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:05:55.131616 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e7201786-6fcd-46b4-9d73-7c29f77b36f7 tempest-ServerAddressesNegativeTestJSON-1672801364 tempest-ServerAddressesNegativeTestJSON-1672801364-project] 10.222.0.66 "GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246" status: 404 len: 111 microversion: 2.1 time: 0.157188 Aug 04 14:05:55.135514 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1267/2530] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:54 2022] GET /compute/v2.1/servers/91392508-a2d7-4ee4-a1cd-fbae92beb246 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:05:55.152547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f470093f4c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:55.173561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.174691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.175780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:55.189184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b2b2eef-4382-49a9-add0-499314b36d53 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:55.197011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.198547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.200119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.200789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.213686 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b2b2eef-4382-49a9-add0-499314b36d53 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1314 microversion: 2.1 time: 0.743025 Aug 04 14:05:55.229409 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1264/2531] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:54 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:55.250943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-12185211-0b1e-4cfa-a0ad-e9038f794327 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:55.255642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-12185211-0b1e-4cfa-a0ad-e9038f794327 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:55.280329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.281470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.287644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12185211-0b1e-4cfa-a0ad-e9038f794327 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.288992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12185211-0b1e-4cfa-a0ad-e9038f794327 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.290707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12185211-0b1e-4cfa-a0ad-e9038f794327 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.291801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12185211-0b1e-4cfa-a0ad-e9038f794327 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.336311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:55.400095 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-515fef34-46e8-4692-9258-474e4650cfc2 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 204 len: 0 microversion: 2.26 time: 0.259476 Aug 04 14:05:55.420500 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1268/2532] 10.222.0.66 () {60 vars in 1295 bytes} [Thu Aug 4 14:05:55 2022] DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:55.429997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f4705686e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:55.444073 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-12185211-0b1e-4cfa-a0ad-e9038f794327 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212031 Aug 04 14:05:55.459870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.460522 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1265/2533] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:05:55 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:55.462307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.463413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:55.485341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.486507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.488292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.489795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.604825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.605690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.649470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.650682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.698462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e6ca1e41-49b8-43f3-b526-7d9ff2655cbd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:55.701944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e6ca1e41-49b8-43f3-b526-7d9ff2655cbd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:55.756114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6ca1e41-49b8-43f3-b526-7d9ff2655cbd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.756976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6ca1e41-49b8-43f3-b526-7d9ff2655cbd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.758464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6ca1e41-49b8-43f3-b526-7d9ff2655cbd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.759768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6ca1e41-49b8-43f3-b526-7d9ff2655cbd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.766726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:55.829260 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af363430-efb1-45db-8f20-ed36d45b1f66 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-848585901" status: 201 len: 0 microversion: 2.26 time: 0.406907 Aug 04 14:05:55.835453 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1269/2534] 10.222.0.66 () {62 vars in 1377 bytes} [Thu Aug 4 14:05:55 2022] PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-848585901 => generated 0 bytes in 414 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 14:05:55.846845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f47002294c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:55.869939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.870447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.870948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:55.897131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.898004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.899518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.900315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.966701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.967721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:55.980517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:55.981522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:56.033736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:56.090945 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a5d80cd0-d686-42d2-911f-2b9ec4860fb0 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-182902460" status: 201 len: 0 microversion: 2.26 time: 0.253833 Aug 04 14:05:56.101360 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1270/2535] 10.222.0.66 () {62 vars in 1377 bytes} [Thu Aug 4 14:05:55 2022] PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags/tempest-tag-182902460 => generated 0 bytes in 265 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 14:05:56.111572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Action: 'update_all', calling method: .version_select at 0x7f4700c67820>, body: {"tags": ["tempest-tag-181814354", "tempest-tag-1964336191"]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:56.132378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:56.133728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:56.134875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:56.151202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:56.152481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:56.156852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:56.158499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:56.197589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:56.198117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:56.246929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:56.281658 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-78b4f992-71e1-4b62-8b27-b1ffb590d198 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 200 len: 61 microversion: 2.26 time: 0.177772 Aug 04 14:05:56.297604 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1271/2536] 10.222.0.66 () {62 vars in 1312 bytes} [Thu Aug 4 14:05:56 2022] PUT /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 61 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:56.309648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-043347ba-4b29-4382-824d-0011a20b8f51 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:56.311436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-043347ba-4b29-4382-824d-0011a20b8f51 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:56.323593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-043347ba-4b29-4382-824d-0011a20b8f51 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:56.324008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-043347ba-4b29-4382-824d-0011a20b8f51 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:56.324789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-043347ba-4b29-4382-824d-0011a20b8f51 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:56.325309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-043347ba-4b29-4382-824d-0011a20b8f51 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.084571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-043347ba-4b29-4382-824d-0011a20b8f51 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:57.104270 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-043347ba-4b29-4382-824d-0011a20b8f51 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1464 microversion: 2.1 time: 0.804585 Aug 04 14:05:57.104994 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1272/2537] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:56 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1464 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:57.129703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-356dc879-870b-4195-9d6d-1797b39288c6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f47001cfaf0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:57.139700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-356dc879-870b-4195-9d6d-1797b39288c6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.140891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-356dc879-870b-4195-9d6d-1797b39288c6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.160548 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-356dc879-870b-4195-9d6d-1797b39288c6 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 200 len: 61 microversion: 2.26 time: 0.035154 Aug 04 14:05:57.172467 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1273/2538] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 14:05:57 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 61 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:57.186498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d06076f6-eb27-45e9-84b7-4662603f032d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:57.189047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d06076f6-eb27-45e9-84b7-4662603f032d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:57.206536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d06076f6-eb27-45e9-84b7-4662603f032d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.207017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d06076f6-eb27-45e9-84b7-4662603f032d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.207805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d06076f6-eb27-45e9-84b7-4662603f032d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.208301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d06076f6-eb27-45e9-84b7-4662603f032d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.238659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e6ca1e41-49b8-43f3-b526-7d9ff2655cbd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:57.272680 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e6ca1e41-49b8-43f3-b526-7d9ff2655cbd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 1.583032 Aug 04 14:05:57.275114 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1266/2539] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:55 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:57.314464 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d06076f6-eb27-45e9-84b7-4662603f032d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139423 Aug 04 14:05:57.322124 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1274/2540] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:05:57 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:57.341337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '.version_select at 0x7f470093f040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:57.361423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.361896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.362421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:57.381661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.382217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.383229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.383702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.442172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.442374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.465626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:57.477912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lazy-loading 'flavor' on Instance uuid d7cce837-e96f-4d54-9b5f-009f1cf28a37 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:05:57.517716 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-639b75b4-b51a-4094-bb63-d99b33c1733d tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags" status: 204 len: 0 microversion: 2.26 time: 0.198793 Aug 04 14:05:57.528548 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1275/2541] 10.222.0.66 () {60 vars in 1295 bytes} [Thu Aug 4 14:05:57 2022] DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37/tags => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:57.546468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ea78d7c8-db41-44fa-b465-4739201efe59 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:57.551381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ea78d7c8-db41-44fa-b465-4739201efe59 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:57.584694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea78d7c8-db41-44fa-b465-4739201efe59 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.605125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea78d7c8-db41-44fa-b465-4739201efe59 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.607016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea78d7c8-db41-44fa-b465-4739201efe59 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.612907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea78d7c8-db41-44fa-b465-4739201efe59 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.715100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ea78d7c8-db41-44fa-b465-4739201efe59 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:05:57.799736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6766562b-11eb-4d6e-a9ad-e1140be54159 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Calling method '.version_select at 0x7f4700239160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:57.846842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6766562b-11eb-4d6e-a9ad-e1140be54159 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.847709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6766562b-11eb-4d6e-a9ad-e1140be54159 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.870404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6766562b-11eb-4d6e-a9ad-e1140be54159 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.871296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6766562b-11eb-4d6e-a9ad-e1140be54159 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.912778 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ea78d7c8-db41-44fa-b465-4739201efe59 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 204 len: 0 microversion: 2.26 time: 0.381926 Aug 04 14:05:57.916478 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1276/2542] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:05:57 2022] DELETE /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:05:57.923575 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6766562b-11eb-4d6e-a9ad-e1140be54159 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage/13e5d227e702414c96a9032e1936a646?start=2022-08-03T14%3A05%3A57.119427&end=2022-08-05T14%3A05%3A57.119427" status: 200 len: 695 microversion: 2.1 time: 0.645412 Aug 04 14:05:57.924583 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1267/2543] 10.222.0.66 () {58 vars in 1412 bytes} [Thu Aug 4 14:05:57 2022] GET /compute/v2.1/os-simple-tenant-usage/13e5d227e702414c96a9032e1936a646?start=2022-08-03T14%3A05%3A57.119427&end=2022-08-05T14%3A05%3A57.119427 => generated 695 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:57.942402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:57.946451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:57.949536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cc6c454-cc44-4bc6-be34-b5e57e32acbf tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '.version_select at 0x7f47002e1c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:57.961373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.962199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.963242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.963903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:57.983112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cc6c454-cc44-4bc6-be34-b5e57e32acbf tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:57.983904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cc6c454-cc44-4bc6-be34-b5e57e32acbf tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:58.035998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cc6c454-cc44-4bc6-be34-b5e57e32acbf tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:58.036820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cc6c454-cc44-4bc6-be34-b5e57e32acbf tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:58.077910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8cc6c454-cc44-4bc6-be34-b5e57e32acbf tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage/13e5d227e702414c96a9032e1936a646?start=2022-08-03T14%3A05%3A57.119427&end=2022-08-05T14%3A05%3A57.119427" status: 200 len: 695 microversion: 2.1 time: 0.140630 Aug 04 14:05:58.088756 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1268/2544] 10.222.0.66 () {58 vars in 1412 bytes} [Thu Aug 4 14:05:57 2022] GET /compute/v2.1/os-simple-tenant-usage/13e5d227e702414c96a9032e1936a646?start=2022-08-03T14%3A05%3A57.119427&end=2022-08-05T14%3A05%3A57.119427 => generated 695 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:58.097899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8222ac83-d8a2-4de3-ab0c-9194cb8108c1 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Calling method '.version_select at 0x7f47001ee040>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:58.139921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8222ac83-d8a2-4de3-ab0c-9194cb8108c1 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:58.141711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8222ac83-d8a2-4de3-ab0c-9194cb8108c1 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:58.207186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8222ac83-d8a2-4de3-ab0c-9194cb8108c1 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:58.209950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8222ac83-d8a2-4de3-ab0c-9194cb8108c1 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:58.640816 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8222ac83-d8a2-4de3-ab0c-9194cb8108c1 tempest-TenantUsagesTestJSON-605802735 tempest-TenantUsagesTestJSON-605802735-project-admin] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T14%3A05%3A57.119427&end=2022-08-05T14%3A05%3A57.119427&detailed=1" status: 200 len: 31998 microversion: 2.1 time: 0.549774 Aug 04 14:05:58.658443 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1269/2545] 10.222.0.66 () {58 vars in 1335 bytes} [Thu Aug 4 14:05:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T14%3A05%3A57.119427&end=2022-08-05T14%3A05%3A57.119427&detailed=1 => generated 31998 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:05:58.666090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f81388d2-af39-440e-b55c-03efaf1ab4c7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:58.667085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f81388d2-af39-440e-b55c-03efaf1ab4c7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:58.688235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81388d2-af39-440e-b55c-03efaf1ab4c7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:58.689345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81388d2-af39-440e-b55c-03efaf1ab4c7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:58.690376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81388d2-af39-440e-b55c-03efaf1ab4c7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:58.690992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81388d2-af39-440e-b55c-03efaf1ab4c7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:59.153364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:05:59.178496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:59.194648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:59.196899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:59.200802 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c185b39-4170-4dd0-a8c7-a695d8587c3a tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 200 len: 1551 microversion: 2.26 time: 1.280828 Aug 04 14:05:59.221929 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1277/2546] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:05:57 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 1551 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:05:59.232589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a7bcd7c-6dba-4ef9-ae1b-783a53a2f101 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:59.235418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1a7bcd7c-6dba-4ef9-ae1b-783a53a2f101 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:59.250975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a7bcd7c-6dba-4ef9-ae1b-783a53a2f101 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:59.251818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a7bcd7c-6dba-4ef9-ae1b-783a53a2f101 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:59.253181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a7bcd7c-6dba-4ef9-ae1b-783a53a2f101 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:59.254066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a7bcd7c-6dba-4ef9-ae1b-783a53a2f101 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:59.332147 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a7bcd7c-6dba-4ef9-ae1b-783a53a2f101 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107968 Aug 04 14:05:59.333874 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1278/2547] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:05:59 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:05:59.346307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c5308034-e7af-4b3f-a9cf-bb57f1670ded tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:59.347859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c5308034-e7af-4b3f-a9cf-bb57f1670ded tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:59.362284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5308034-e7af-4b3f-a9cf-bb57f1670ded tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:59.363569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5308034-e7af-4b3f-a9cf-bb57f1670ded tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:59.365577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5308034-e7af-4b3f-a9cf-bb57f1670ded tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:59.366908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5308034-e7af-4b3f-a9cf-bb57f1670ded tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:59.440320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c5308034-e7af-4b3f-a9cf-bb57f1670ded tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:05:59.461973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f81388d2-af39-440e-b55c-03efaf1ab4c7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:05:59.492553 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f81388d2-af39-440e-b55c-03efaf1ab4c7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 0.832138 Aug 04 14:05:59.513597 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1270/2548] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:58 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:05:59.683276 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c5308034-e7af-4b3f-a9cf-bb57f1670ded tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "DELETE /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 204 len: 0 microversion: 2.1 time: 0.342696 Aug 04 14:05:59.685070 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1279/2549] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:05:59 2022] DELETE /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:05:59.697074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-73a5578f-90a8-49dd-9c19-b56f1c5110a3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:05:59.698188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-73a5578f-90a8-49dd-9c19-b56f1c5110a3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:05:59.712057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73a5578f-90a8-49dd-9c19-b56f1c5110a3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:59.713328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73a5578f-90a8-49dd-9c19-b56f1c5110a3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:59.715260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73a5578f-90a8-49dd-9c19-b56f1c5110a3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:59.716482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73a5578f-90a8-49dd-9c19-b56f1c5110a3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:59.906342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-bb7b3af8-769b-4068-8a9e-44e40da04c88 req-4540d894-73bf-4db1-8273-d4edafa76cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2", "tag": "0ac8d5ba-726d-4476-b820-4498e934d17f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:05:59.939068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bb7b3af8-769b-4068-8a9e-44e40da04c88 req-4540d894-73bf-4db1-8273-d4edafa76cd1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:05:59.939832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bb7b3af8-769b-4068-8a9e-44e40da04c88 req-4540d894-73bf-4db1-8273-d4edafa76cd1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:05:59.999057 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bb7b3af8-769b-4068-8a9e-44e40da04c88 req-4540d894-73bf-4db1-8273-d4edafa76cd1 service nova] Creating event network-changed:0ac8d5ba-726d-4476-b820-4498e934d17f for instance f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 on n-h1-844627-10 Aug 04 14:06:00.009082 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-bb7b3af8-769b-4068-8a9e-44e40da04c88 req-4540d894-73bf-4db1-8273-d4edafa76cd1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123285 Aug 04 14:06:00.010410 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1280/2550] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:06:00.229538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:00.230606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:00.249508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:00.250056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:00.250927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:00.251386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:00.995177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:01.042121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:01.044511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '833a4a12a9f94068a92d73bdc54fabbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3aa866572c3417e9bca492afeac35d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:01.047928 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd56a40b-f9bf-4141-9ea6-5dd84f8d39a9 tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 200 len: 1509 microversion: 2.26 time: 0.825994 Aug 04 14:06:01.073836 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1281/2551] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:00 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 1509 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:01.086558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6435a4c3-28b9-4f2b-a669-98b7168c92be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:01.099145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6435a4c3-28b9-4f2b-a669-98b7168c92be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:01.116243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6435a4c3-28b9-4f2b-a669-98b7168c92be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:01.137008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6435a4c3-28b9-4f2b-a669-98b7168c92be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:01.141007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6435a4c3-28b9-4f2b-a669-98b7168c92be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:01.150725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6435a4c3-28b9-4f2b-a669-98b7168c92be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:01.288180 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6435a4c3-28b9-4f2b-a669-98b7168c92be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.217487 Aug 04 14:06:01.291488 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1282/2552] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:06:01 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803/os-volume_attachments => generated 25 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:01.309367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b84862bd-293f-49cb-b2e8-34015424491d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:01.310187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b84862bd-293f-49cb-b2e8-34015424491d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:01.329159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84862bd-293f-49cb-b2e8-34015424491d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:01.329941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84862bd-293f-49cb-b2e8-34015424491d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:01.331852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-73a5578f-90a8-49dd-9c19-b56f1c5110a3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:01.334485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84862bd-293f-49cb-b2e8-34015424491d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:01.346040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b84862bd-293f-49cb-b2e8-34015424491d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:01.359704 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-73a5578f-90a8-49dd-9c19-b56f1c5110a3 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1470 microversion: 2.1 time: 1.659289 Aug 04 14:06:01.382555 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1271/2553] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:05:59 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1470 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:02.088347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:02.090096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] [instance: d7cce837-e96f-4d54-9b5f-009f1cf28a37] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:02.093182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:02.120964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:02.121815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:02.126966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:02.127603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:02.147529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] HTTP exception thrown: Instance d7cce837-e96f-4d54-9b5f-009f1cf28a37 could not be found. Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Request method failure captured: Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 HTTP/1.1 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69IjV6GypLrBPXZaW5QS_ucl8G6CIWx4bhbPqbABwA58WQ9M8iY8-v9sNouQicWLxh1Z726zHoJF9mL_tJxqqxvlScFiBiqT2x1dmMWLnS96ypjsm1ot6FWGYd-yWALRHktLYWEmZuwxTBV80Uqq11NIadbgAfPSSEF4AKRQA0rASGI Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.26 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c3aa866572c3417e9bca492afeac35d3 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerTagsTestJSON-1336705648 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c3aa866572c3417e9bca492afeac35d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c3aa866572c3417e9bca492afeac35d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c3aa866572c3417e9bca492afeac35d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c3aa866572c3417e9bca492afeac35d3"}]}] Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerTagsTestJSON-1336705648 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c3aa866572c3417e9bca492afeac35d3 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerTagsTestJSON-1336705648 Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerTagsTestJSON-1336705648-project Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 833a4a12a9f94068a92d73bdc54fabbf Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerTagsTestJSON-1336705648-project Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance d7cce837-e96f-4d54-9b5f-009f1cf28a37 could not be found. Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'd7cce837-e96f-4d54-9b5f-009f1cf28a37'} Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7cce837-e96f-4d54-9b5f-009f1cf28a37 could not be found. Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7cce837-e96f-4d54-9b5f-009f1cf28a37 could not be found. Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:06:02.153415 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:02.158448 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:02.158448 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:02.158448 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:02.158448 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:06:02.158448 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:06:02.158448 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7cce837-e96f-4d54-9b5f-009f1cf28a37 could not be found. Aug 04 14:06:02.158448 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:02.160146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] Returning 404 to user: Instance d7cce837-e96f-4d54-9b5f-009f1cf28a37 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:06:02.161212 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2738ebd-da23-4f3d-b7dd-c5de1565adaf tempest-ServerTagsTestJSON-1336705648 tempest-ServerTagsTestJSON-1336705648-project] 10.222.0.66 "GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37" status: 404 len: 111 microversion: 2.26 time: 0.077460 Aug 04 14:06:02.162740 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1272/2554] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:02 2022] GET /compute/v2.1/servers/d7cce837-e96f-4d54-9b5f-009f1cf28a37 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 14:06:02.236562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-68b9b715-271b-4cc3-be68-38a56a0f6cb9 req-52cc0f80-5668-4913-8f85-f4d4780e5d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7cce837-e96f-4d54-9b5f-009f1cf28a37", "name": "network-vif-deleted", "tag": "e839d5c2-63ae-407f-adfb-ac36d9ef2748"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:02.269597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-68b9b715-271b-4cc3-be68-38a56a0f6cb9 req-52cc0f80-5668-4913-8f85-f4d4780e5d36 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:02.271546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-68b9b715-271b-4cc3-be68-38a56a0f6cb9 req-52cc0f80-5668-4913-8f85-f4d4780e5d36 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:02.305953 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-68b9b715-271b-4cc3-be68-38a56a0f6cb9 req-52cc0f80-5668-4913-8f85-f4d4780e5d36 service nova] Creating event network-vif-deleted:e839d5c2-63ae-407f-adfb-ac36d9ef2748 for instance d7cce837-e96f-4d54-9b5f-009f1cf28a37 on n-h2-844627-10 Aug 04 14:06:02.312415 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-68b9b715-271b-4cc3-be68-38a56a0f6cb9 req-52cc0f80-5668-4913-8f85-f4d4780e5d36 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081312 Aug 04 14:06:02.314209 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1273/2555] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:06:02.344182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b84862bd-293f-49cb-b2e8-34015424491d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:02.368958 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b84862bd-293f-49cb-b2e8-34015424491d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 1.075246 Aug 04 14:06:02.406488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a6c55da-ff3c-4d5c-9178-44580cf842d5 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:02.408147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a6c55da-ff3c-4d5c-9178-44580cf842d5 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:02.415105 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1283/2556] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:01 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:02.435426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a6c55da-ff3c-4d5c-9178-44580cf842d5 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:02.436249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a6c55da-ff3c-4d5c-9178-44580cf842d5 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:02.438107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a6c55da-ff3c-4d5c-9178-44580cf842d5 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:02.440347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a6c55da-ff3c-4d5c-9178-44580cf842d5 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:03.414657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8bd960f6-d803-4d57-a4bb-1ae1d5b376ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:03.415805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8bd960f6-d803-4d57-a4bb-1ae1d5b376ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:03.423030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a6c55da-ff3c-4d5c-9178-44580cf842d5 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:03.442388 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a6c55da-ff3c-4d5c-9178-44580cf842d5 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1470 microversion: 2.1 time: 1.057273 Aug 04 14:06:03.443563 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1274/2557] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:02 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1470 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:03.510805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bd960f6-d803-4d57-a4bb-1ae1d5b376ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:03.512093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bd960f6-d803-4d57-a4bb-1ae1d5b376ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:03.528528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bd960f6-d803-4d57-a4bb-1ae1d5b376ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:03.529432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bd960f6-d803-4d57-a4bb-1ae1d5b376ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:04.501979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f50ea889-b4f6-4129-a7e8-ba1becafd3da tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:04.502729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f50ea889-b4f6-4129-a7e8-ba1becafd3da tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:04.518890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f50ea889-b4f6-4129-a7e8-ba1becafd3da tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:04.520019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f50ea889-b4f6-4129-a7e8-ba1becafd3da tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:04.524463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f50ea889-b4f6-4129-a7e8-ba1becafd3da tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:04.526944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f50ea889-b4f6-4129-a7e8-ba1becafd3da tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:04.693542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8bd960f6-d803-4d57-a4bb-1ae1d5b376ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:04.715993 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8bd960f6-d803-4d57-a4bb-1ae1d5b376ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 1.305845 Aug 04 14:06:04.723343 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1284/2558] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:03 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:06:05.255724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f50ea889-b4f6-4129-a7e8-ba1becafd3da tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:05.269984 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f50ea889-b4f6-4129-a7e8-ba1becafd3da tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1470 microversion: 2.1 time: 0.773341 Aug 04 14:06:05.271530 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1275/2559] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:04 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1470 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:06:05.375526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c26fbda0-e16a-49cc-b4ea-22affb61f5eb req-34c8622e-1bcc-4469-b595-696295abed27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a0c9f0-5988-434b-abc2-879962cea3c6", "name": "network-vif-deleted", "tag": "505c5faa-7d9a-450f-aaf6-c2129258b0e2"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:05.401413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c26fbda0-e16a-49cc-b4ea-22affb61f5eb req-34c8622e-1bcc-4469-b595-696295abed27 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:05.402234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c26fbda0-e16a-49cc-b4ea-22affb61f5eb req-34c8622e-1bcc-4469-b595-696295abed27 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:05.474933 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c26fbda0-e16a-49cc-b4ea-22affb61f5eb req-34c8622e-1bcc-4469-b595-696295abed27 service nova] Creating event network-vif-deleted:505c5faa-7d9a-450f-aaf6-c2129258b0e2 for instance 10a0c9f0-5988-434b-abc2-879962cea3c6 on n-h1-844627-10 Aug 04 14:06:05.516271 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c26fbda0-e16a-49cc-b4ea-22affb61f5eb req-34c8622e-1bcc-4469-b595-696295abed27 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146438 Aug 04 14:06:05.524456 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1285/2560] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 14:06:05.760980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf7cb595-178a-414a-9204-679ed2d8a2d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:05.761917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf7cb595-178a-414a-9204-679ed2d8a2d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:05.778704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf7cb595-178a-414a-9204-679ed2d8a2d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:05.780185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf7cb595-178a-414a-9204-679ed2d8a2d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:05.782727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf7cb595-178a-414a-9204-679ed2d8a2d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:05.790921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf7cb595-178a-414a-9204-679ed2d8a2d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:06.309808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3f9d87d8-8735-4b1d-abbc-c9d2261f8236 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:06.310536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3f9d87d8-8735-4b1d-abbc-c9d2261f8236 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:06.336340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f9d87d8-8735-4b1d-abbc-c9d2261f8236 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:06.336807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f9d87d8-8735-4b1d-abbc-c9d2261f8236 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:06.337689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f9d87d8-8735-4b1d-abbc-c9d2261f8236 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:06.338131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f9d87d8-8735-4b1d-abbc-c9d2261f8236 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:06.370577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bf7cb595-178a-414a-9204-679ed2d8a2d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:06.398640 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf7cb595-178a-414a-9204-679ed2d8a2d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 0.641153 Aug 04 14:06:06.407428 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1276/2561] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:05 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:06.501583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3f9d87d8-8735-4b1d-abbc-c9d2261f8236 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:06.516927 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3f9d87d8-8735-4b1d-abbc-c9d2261f8236 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1428 microversion: 2.1 time: 0.211546 Aug 04 14:06:06.518435 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1286/2562] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:06 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1428 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:06:07.430694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-99cd195b-44cd-41b6-aaa7-bf8c2587f618 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:07.431156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-99cd195b-44cd-41b6-aaa7-bf8c2587f618 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:07.457334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99cd195b-44cd-41b6-aaa7-bf8c2587f618 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:07.459667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99cd195b-44cd-41b6-aaa7-bf8c2587f618 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:07.465079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99cd195b-44cd-41b6-aaa7-bf8c2587f618 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:07.465568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99cd195b-44cd-41b6-aaa7-bf8c2587f618 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:07.559207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:07.559818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:07.581153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:07.585026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:07.585026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:07.585026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:07.714680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:07.718413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:07.723001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lazy-loading 'fault' on Instance uuid 10a0c9f0-5988-434b-abc2-879962cea3c6 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:06:08.040441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f148d43e0f75405a81dd0c502ee3fc19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e5d227e702414c96a9032e1936a646', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:08.075762 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be8fc0aa-1cdd-47b1-bf11-726053fa4272 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 200 len: 1304 microversion: 2.1 time: 0.520599 Aug 04 14:06:08.081077 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1287/2563] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:07 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 1304 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:08.204756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:08.249400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-99cd195b-44cd-41b6-aaa7-bf8c2587f618 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:08.275933 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-99cd195b-44cd-41b6-aaa7-bf8c2587f618 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 0.851299 Aug 04 14:06:08.278390 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1277/2564] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:07 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:09.105533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:09.107241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] [instance: 10a0c9f0-5988-434b-abc2-879962cea3c6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:09.154369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:09.160368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:09.161817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:09.170467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:09.232948 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] HTTP exception thrown: Instance 10a0c9f0-5988-434b-abc2-879962cea3c6 could not be found. Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Request method failure captured: Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 HTTP/1.1 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69IiVcp99IrQeQ-xoXcr3AxEqY7budgLTe9vBI9urznjsz8c0va3K6RMYaI313ibycVxA256bq6Lxw_GOtZ_EFDlub7_ItOos4mmhnd-nvT7QHkwhwyX01biVCPwEoATtVfcUUsAAS3QgKLmgXs96VFucDV-yUTx4t89RSCMDxQqQ08 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 13e5d227e702414c96a9032e1936a646 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TenantUsagesTestJSON-551615065 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/13e5d227e702414c96a9032e1936a646"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_13e5d227e702414c96a9032e1936a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/13e5d227e702414c96a9032e1936a646"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/13e5d227e702414c96a9032e1936a646"}]}] Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TenantUsagesTestJSON-551615065 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 13e5d227e702414c96a9032e1936a646 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TenantUsagesTestJSON-551615065 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TenantUsagesTestJSON-551615065-project Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f148d43e0f75405a81dd0c502ee3fc19 Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TenantUsagesTestJSON-551615065-project Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 10a0c9f0-5988-434b-abc2-879962cea3c6 could not be found. Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '10a0c9f0-5988-434b-abc2-879962cea3c6'} Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a0c9f0-5988-434b-abc2-879962cea3c6 could not be found. Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a0c9f0-5988-434b-abc2-879962cea3c6 could not be found. Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:06:09.238754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:09.246787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:09.246787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:09.246787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:09.246787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:06:09.246787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:06:09.246787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a0c9f0-5988-434b-abc2-879962cea3c6 could not be found. Aug 04 14:06:09.246787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:09.253280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] Returning 404 to user: Instance 10a0c9f0-5988-434b-abc2-879962cea3c6 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:06:09.256951 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-42a065bb-d269-479b-86b8-57b104b4e227 tempest-TenantUsagesTestJSON-551615065 tempest-TenantUsagesTestJSON-551615065-project] 10.222.0.66 "GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6" status: 404 len: 111 microversion: 2.1 time: 0.159019 Aug 04 14:06:09.300488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3728e616-b466-4687-abf5-f6572a641539 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:09.302255 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1288/2565] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:09 2022] GET /compute/v2.1/servers/10a0c9f0-5988-434b-abc2-879962cea3c6 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:06:09.307225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3728e616-b466-4687-abf5-f6572a641539 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:09.341274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3728e616-b466-4687-abf5-f6572a641539 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:09.343368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3728e616-b466-4687-abf5-f6572a641539 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:09.345376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3728e616-b466-4687-abf5-f6572a641539 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:09.349885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3728e616-b466-4687-abf5-f6572a641539 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:10.170293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3728e616-b466-4687-abf5-f6572a641539 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:10.185928 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3728e616-b466-4687-abf5-f6572a641539 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 0.887819 Aug 04 14:06:10.187552 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1278/2566] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:09 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:10.511435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-818786336", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:10.561683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:10.646547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:06:11.216382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6ada6efd-2f08-412c-b26d-44ac34141762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:11.217854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6ada6efd-2f08-412c-b26d-44ac34141762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:11.237753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ada6efd-2f08-412c-b26d-44ac34141762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:11.238531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ada6efd-2f08-412c-b26d-44ac34141762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:11.240553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ada6efd-2f08-412c-b26d-44ac34141762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:11.241261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ada6efd-2f08-412c-b26d-44ac34141762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:11.827056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6ada6efd-2f08-412c-b26d-44ac34141762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:11.844848 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6ada6efd-2f08-412c-b26d-44ac34141762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 0.640428 Aug 04 14:06:11.850127 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1279/2567] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:11 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:12.212387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:12.213151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:12.213542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:12.213789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:12.214253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:12.255367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:12.258671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:12.268635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:12.270045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:12.379323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Getting quotas for project e82094948d794cdda8a53cbe6c013808. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:12.413594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Getting quotas for user 92de0c3f92744fac8c3a0f5e69b15bb2 and project e82094948d794cdda8a53cbe6c013808. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:12.488704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:06:12.503095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:06:12.703124 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d389c189-6fec-4315-a43a-6c2578721ce4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.316815 Aug 04 14:06:12.710417 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1289/2568] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:06:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:06:12.721768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3c9a6e2-78d6-4c41-970c-78dca8751e5c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:12.722906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3c9a6e2-78d6-4c41-970c-78dca8751e5c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:12.869444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c9397c67-509c-4b01-b622-357fe1ea8a6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:12.870076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c9397c67-509c-4b01-b622-357fe1ea8a6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:12.885627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9397c67-509c-4b01-b622-357fe1ea8a6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:12.886085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9397c67-509c-4b01-b622-357fe1ea8a6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:12.886973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9397c67-509c-4b01-b622-357fe1ea8a6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:12.887500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9397c67-509c-4b01-b622-357fe1ea8a6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:13.005965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f3c9a6e2-78d6-4c41-970c-78dca8751e5c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:13.015610 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3c9a6e2-78d6-4c41-970c-78dca8751e5c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1216 microversion: 2.1 time: 0.297746 Aug 04 14:06:13.016224 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1280/2569] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:12 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1216 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:13.098794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-cef7a1aa-f288-4874-b5dc-14a5238f7ed0 req-0421796a-c91f-4ec8-ab2b-1a365166ca47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2", "name": "network-vif-plugged", "status": "completed", "tag": "0ac8d5ba-726d-4476-b820-4498e934d17f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:13.114031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cef7a1aa-f288-4874-b5dc-14a5238f7ed0 req-0421796a-c91f-4ec8-ab2b-1a365166ca47 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:13.115175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cef7a1aa-f288-4874-b5dc-14a5238f7ed0 req-0421796a-c91f-4ec8-ab2b-1a365166ca47 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:13.159377 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-cef7a1aa-f288-4874-b5dc-14a5238f7ed0 req-0421796a-c91f-4ec8-ab2b-1a365166ca47 service nova] Creating event network-vif-plugged:0ac8d5ba-726d-4476-b820-4498e934d17f for instance f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 on n-h1-844627-10 Aug 04 14:06:13.180805 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-cef7a1aa-f288-4874-b5dc-14a5238f7ed0 req-0421796a-c91f-4ec8-ab2b-1a365166ca47 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094842 Aug 04 14:06:13.182040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1281/2570] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 14:06:13.845848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c9397c67-509c-4b01-b622-357fe1ea8a6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:13.875075 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c9397c67-509c-4b01-b622-357fe1ea8a6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 1.004861 Aug 04 14:06:13.878775 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1290/2571] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:12 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:14.044396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7a7fb504-ab6b-4123-a4ab-42cc8469de10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:14.045360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a7fb504-ab6b-4123-a4ab-42cc8469de10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:14.574760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7a7fb504-ab6b-4123-a4ab-42cc8469de10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:14.589266 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7a7fb504-ab6b-4123-a4ab-42cc8469de10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1216 microversion: 2.1 time: 0.544338 Aug 04 14:06:14.603792 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1282/2572] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:14 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1216 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:14.902839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e895d1e5-23ce-48b1-9375-079215320c27 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:14.903704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e895d1e5-23ce-48b1-9375-079215320c27 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:14.925493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e895d1e5-23ce-48b1-9375-079215320c27 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:14.925990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e895d1e5-23ce-48b1-9375-079215320c27 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:14.926917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e895d1e5-23ce-48b1-9375-079215320c27 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:14.927368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e895d1e5-23ce-48b1-9375-079215320c27 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:14.930625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:DELETE=1,nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:15.611857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba9a79dd-e380-4ab2-ac45-feb095f466cc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:15.612487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba9a79dd-e380-4ab2-ac45-feb095f466cc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:15.633141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba9a79dd-e380-4ab2-ac45-feb095f466cc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:15.633614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba9a79dd-e380-4ab2-ac45-feb095f466cc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:15.634463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba9a79dd-e380-4ab2-ac45-feb095f466cc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:15.641818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba9a79dd-e380-4ab2-ac45-feb095f466cc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:16.360736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba9a79dd-e380-4ab2-ac45-feb095f466cc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:16.367915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:16.377291 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba9a79dd-e380-4ab2-ac45-feb095f466cc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1268 microversion: 2.1 time: 0.764846 Aug 04 14:06:16.387827 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1283/2573] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:15 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1268 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:06:16.891288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e895d1e5-23ce-48b1-9375-079215320c27 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:16.925314 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e895d1e5-23ce-48b1-9375-079215320c27 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1292 microversion: 2.1 time: 2.028377 Aug 04 14:06:16.929514 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1291/2574] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:14 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1292 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:17.408130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ce76ade0-c499-4565-8109-9958b9d46a44 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:17.428798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ce76ade0-c499-4565-8109-9958b9d46a44 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:17.477144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce76ade0-c499-4565-8109-9958b9d46a44 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:17.479234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce76ade0-c499-4565-8109-9958b9d46a44 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:17.491089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce76ade0-c499-4565-8109-9958b9d46a44 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:17.510491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce76ade0-c499-4565-8109-9958b9d46a44 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:17.962371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c2cd57b-5a0b-4d28-af1f-4b29f7b7e80c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:17.963970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c2cd57b-5a0b-4d28-af1f-4b29f7b7e80c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:17.972530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c2cd57b-5a0b-4d28-af1f-4b29f7b7e80c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:17.979388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c2cd57b-5a0b-4d28-af1f-4b29f7b7e80c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:17.980522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c2cd57b-5a0b-4d28-af1f-4b29f7b7e80c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:17.981228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c2cd57b-5a0b-4d28-af1f-4b29f7b7e80c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:18.072057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ce76ade0-c499-4565-8109-9958b9d46a44 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:18.084555 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ce76ade0-c499-4565-8109-9958b9d46a44 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1274 microversion: 2.1 time: 0.686379 Aug 04 14:06:18.088152 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1284/2575] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:17 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1274 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:18.898650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2c2cd57b-5a0b-4d28-af1f-4b29f7b7e80c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:18.931474 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c2cd57b-5a0b-4d28-af1f-4b29f7b7e80c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1472 microversion: 2.1 time: 0.979621 Aug 04 14:06:18.938102 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1292/2576] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:17 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1472 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:19.108755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-915dd9b5-f091-4be9-b3ab-587c6ae15c1c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:19.109764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-915dd9b5-f091-4be9-b3ab-587c6ae15c1c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:19.130541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-915dd9b5-f091-4be9-b3ab-587c6ae15c1c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:19.131235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-915dd9b5-f091-4be9-b3ab-587c6ae15c1c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:19.132032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-915dd9b5-f091-4be9-b3ab-587c6ae15c1c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:19.132963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-915dd9b5-f091-4be9-b3ab-587c6ae15c1c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:19.463958 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f6a38b9-e326-42f8-9d3b-26b52c25dc1c tempest-TenantUsagesNegativeTestJSON-1984724095 tempest-TenantUsagesNegativeTestJSON-1984724095-project-admin] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-03T14%3A06%3A19.062653&end=2022-08-05T14%3A06%3A19.062653" status: 404 len: 112 microversion: - time: 0.396978 Aug 04 14:06:19.464839 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1285/2577] 10.222.0.66 () {58 vars in 1316 bytes} [Thu Aug 4 14:06:19 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-03T14%3A06%3A19.062653&end=2022-08-05T14%3A06%3A19.062653 => generated 112 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 14:06:19.470865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-121262530", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:19.661606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] validate_networks() for [('2344a004-88b5-43d1-a0c7-ab45883f4f84', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:06:19.932770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-915dd9b5-f091-4be9-b3ab-587c6ae15c1c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:19.959430 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-915dd9b5-f091-4be9-b3ab-587c6ae15c1c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1274 microversion: 2.1 time: 0.854751 Aug 04 14:06:19.960713 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1293/2578] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:19 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1274 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:06:19.968127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c2b85f2-ad98-4bcc-85da-0918453b7a74 tempest-TenantUsagesNegativeTestJSON-1984724095 tempest-TenantUsagesNegativeTestJSON-1984724095-project-admin] Calling method '.version_select at 0x7f46f3fb4c10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:19.977220 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2c2b85f2-ad98-4bcc-85da-0918453b7a74 tempest-TenantUsagesNegativeTestJSON-1984724095 tempest-TenantUsagesNegativeTestJSON-1984724095-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c2b85f2-ad98-4bcc-85da-0918453b7a74 tempest-TenantUsagesNegativeTestJSON-1984724095 tempest-TenantUsagesNegativeTestJSON-1984724095-project-admin] Request method failure captured: Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-simple-tenant-usage/1f9562d8c91246689e8a67c381bbe6cf?start=2022-08-05T14%3A06%3A19.062653&end=2022-08-03T14%3A06%3A19.062653 HTTP/1.1 Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Ja0LBM7iDlu3y5NT9qwTd1aRh_RtFBi6tsYsyBdcjotV98yxJ4LOHRyzNje6nA0K8CHI3ScuqH9Duo4ghMSAE05aPBB0c9PJsJDS2kLSCXuypgr6C5deWgK2eURos09iEBlWoM4tN5OIMLUMhhGOl_Wp3lZb7GvXyzRhsXfFQnPfM Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: bbd43737d7924fbeaf0a34eb8108385c Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1984724095 Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bbd43737d7924fbeaf0a34eb8108385c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bbd43737d7924fbeaf0a34eb8108385c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bbd43737d7924fbeaf0a34eb8108385c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bbd43737d7924fbeaf0a34eb8108385c"}]}] Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1984724095 Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: bbd43737d7924fbeaf0a34eb8108385c Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1984724095 Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TenantUsagesNegativeTestJSON-1984724095-project-admin Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 62a295f414684020ab5c52dcf8941b88 Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1984724095-project-admin Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid start time. The start time cannot occur after the end time. Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '1f9562d8c91246689e8a67c381bbe6cf'} Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 04 14:06:19.986530 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:19.992466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c2b85f2-ad98-4bcc-85da-0918453b7a74 tempest-TenantUsagesNegativeTestJSON-1984724095 tempest-TenantUsagesNegativeTestJSON-1984724095-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:06:19.994488 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c2b85f2-ad98-4bcc-85da-0918453b7a74 tempest-TenantUsagesNegativeTestJSON-1984724095 tempest-TenantUsagesNegativeTestJSON-1984724095-project-admin] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage/1f9562d8c91246689e8a67c381bbe6cf?start=2022-08-05T14%3A06%3A19.062653&end=2022-08-03T14%3A06%3A19.062653" status: 400 len: 111 microversion: 2.1 time: 0.031949 Aug 04 14:06:19.996026 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1294/2579] 10.222.0.66 () {58 vars in 1412 bytes} [Thu Aug 4 14:06:19 2022] GET /compute/v2.1/os-simple-tenant-usage/1f9562d8c91246689e8a67c381bbe6cf?start=2022-08-05T14%3A06%3A19.062653&end=2022-08-03T14%3A06%3A19.062653 => generated 111 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:06:20.353063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-906e3952-4f30-4d0d-8fb7-6bee6d52a3ef tempest-TenantUsagesNegativeTestJSON-575723359 tempest-TenantUsagesNegativeTestJSON-575723359-project] Calling method '.version_select at 0x7f4700133dc0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:20.399853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-906e3952-4f30-4d0d-8fb7-6bee6d52a3ef tempest-TenantUsagesNegativeTestJSON-575723359 tempest-TenantUsagesNegativeTestJSON-575723359-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '3f6dcae68b1f421cbd6b52388c3e59aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f9562d8c91246689e8a67c381bbe6cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-906e3952-4f30-4d0d-8fb7-6bee6d52a3ef tempest-TenantUsagesNegativeTestJSON-575723359 tempest-TenantUsagesNegativeTestJSON-575723359-project] Request method failure captured: Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T14%3A06%3A19.062653&end=2022-08-05T14%3A06%3A19.062653&detailed=1 HTTP/1.1 Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JZqReqPP2viav-XdLIBYkCPBAyh7wF_5jKVvQAED0Nd5qezvcPBi-JS9j1MOwad6lbTW-acoHNEff0Hd60v8H3jxRO8hmQfv9Pna6MrdFga7WfdcxfbTaiQ3pB1492EciMpzb2oJary3BOzijCIOK0bslFbaIKBnpWuJDAuRHkRLk Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1f9562d8c91246689e8a67c381bbe6cf Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-575723359 Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f9562d8c91246689e8a67c381bbe6cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1f9562d8c91246689e8a67c381bbe6cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1f9562d8c91246689e8a67c381bbe6cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1f9562d8c91246689e8a67c381bbe6cf"}]}] Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-575723359 Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1f9562d8c91246689e8a67c381bbe6cf Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-575723359 Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TenantUsagesNegativeTestJSON-575723359-project Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 3f6dcae68b1f421cbd6b52388c3e59aa Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-575723359-project Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: action_args: {} Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 14:06:20.418156 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-906e3952-4f30-4d0d-8fb7-6bee6d52a3ef tempest-TenantUsagesNegativeTestJSON-575723359 tempest-TenantUsagesNegativeTestJSON-575723359-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:06:20.422597 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-906e3952-4f30-4d0d-8fb7-6bee6d52a3ef tempest-TenantUsagesNegativeTestJSON-575723359 tempest-TenantUsagesNegativeTestJSON-575723359-project] 10.222.0.66 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T14%3A06%3A19.062653&end=2022-08-05T14%3A06%3A19.062653&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.413151 Aug 04 14:06:20.433055 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1295/2580] 10.222.0.66 () {58 vars in 1335 bytes} [Thu Aug 4 14:06:20 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T14%3A06%3A19.062653&end=2022-08-05T14%3A06%3A19.062653&detailed=1 => generated 123 bytes in 419 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:06:21.003667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f99d31c-83d0-4f77-b497-d71d571cb01f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:21.006250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f99d31c-83d0-4f77-b497-d71d571cb01f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:21.039312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f99d31c-83d0-4f77-b497-d71d571cb01f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:21.042747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f99d31c-83d0-4f77-b497-d71d571cb01f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:21.045985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f99d31c-83d0-4f77-b497-d71d571cb01f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:21.047756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f99d31c-83d0-4f77-b497-d71d571cb01f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:22.320577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:22.447346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f99d31c-83d0-4f77-b497-d71d571cb01f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:22.457583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:22.477211 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f99d31c-83d0-4f77-b497-d71d571cb01f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1274 microversion: 2.1 time: 1.497961 Aug 04 14:06:22.493389 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1296/2581] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:20 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1274 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:23.505818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-614f5686-9196-4cc1-8427-0e2be8e7d676 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:23.517579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-614f5686-9196-4cc1-8427-0e2be8e7d676 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:23.539108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-614f5686-9196-4cc1-8427-0e2be8e7d676 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:23.556230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-614f5686-9196-4cc1-8427-0e2be8e7d676 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:23.558803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-614f5686-9196-4cc1-8427-0e2be8e7d676 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:23.561107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-614f5686-9196-4cc1-8427-0e2be8e7d676 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:23.632095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:23.633540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:23.634336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:23.635010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:23.635767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:23.656803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:23.657242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:23.659928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:23.660686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:23.755470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:23.768840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for user df576732ca5c442694d507fd4dc58279 and project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:23.803449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:06:23.806065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:06:23.970839 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb0543e7-1075-42df-acf5-30a775a88a6d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.503360 Aug 04 14:06:23.975292 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1286/2582] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:06:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:06:24.015024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d0950cec-35c9-4d74-8832-5a3f9ddc8687 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:24.023789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d0950cec-35c9-4d74-8832-5a3f9ddc8687 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:24.104671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d0950cec-35c9-4d74-8832-5a3f9ddc8687 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:06:24.888263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-614f5686-9196-4cc1-8427-0e2be8e7d676 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:24.927418 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-614f5686-9196-4cc1-8427-0e2be8e7d676 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1316 microversion: 2.1 time: 1.429402 Aug 04 14:06:24.932734 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1297/2583] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:23 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1316 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:25.958538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c7311b93-7f07-43db-9782-d80184763b10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:25.959242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c7311b93-7f07-43db-9782-d80184763b10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:25.988194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7311b93-7f07-43db-9782-d80184763b10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:25.990662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7311b93-7f07-43db-9782-d80184763b10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:25.991890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7311b93-7f07-43db-9782-d80184763b10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:25.995936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7311b93-7f07-43db-9782-d80184763b10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:26.109904 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.compute.api [None req-d0950cec-35c9-4d74-8832-5a3f9ddc8687 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7] Instance Mapping does not exist while attempting local delete cleanup. Aug 04 14:06:26.112849 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d0950cec-35c9-4d74-8832-5a3f9ddc8687 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7" status: 204 len: 0 microversion: 2.1 time: 2.120334 Aug 04 14:06:26.115469 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1287/2584] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:06:23 2022] DELETE /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 => generated 0 bytes in 2125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:06:26.131805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9a495479-3540-4d0d-ad5e-0701d2bfc583 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:26.132515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9a495479-3540-4d0d-ad5e-0701d2bfc583 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:26.152392 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-9a495479-3540-4d0d-ad5e-0701d2bfc583 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9a495479-3540-4d0d-ad5e-0701d2bfc583 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 HTTP/1.1 Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7'} Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:06:26.154472 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:06:26.159242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:06:26.159242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:06:26.159242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:06:26.159242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:06:26.159242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:06:26.166524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9a495479-3540-4d0d-ad5e-0701d2bfc583 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:06:26.171866 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9a495479-3540-4d0d-ad5e-0701d2bfc583 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7" status: 404 len: 111 microversion: 2.1 time: 0.047912 Aug 04 14:06:26.175149 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1288/2585] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:26 2022] GET /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:06:26.425111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1658164945", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "2344a004-88b5-43d1-a0c7-ab45883f4f84"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:26.559058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] validate_networks() for [('2344a004-88b5-43d1-a0c7-ab45883f4f84', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:06:26.800992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c7311b93-7f07-43db-9782-d80184763b10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:26.821793 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c7311b93-7f07-43db-9782-d80184763b10 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1316 microversion: 2.1 time: 0.867236 Aug 04 14:06:26.822405 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1298/2586] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:25 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1316 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:06:27.855414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-88905155-ae38-49c5-8fed-f1531c20341c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:27.856521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-88905155-ae38-49c5-8fed-f1531c20341c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:27.876459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88905155-ae38-49c5-8fed-f1531c20341c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:27.876953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88905155-ae38-49c5-8fed-f1531c20341c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:27.877807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88905155-ae38-49c5-8fed-f1531c20341c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:27.878277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88905155-ae38-49c5-8fed-f1531c20341c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:29.566634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-88905155-ae38-49c5-8fed-f1531c20341c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:29.582447 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-88905155-ae38-49c5-8fed-f1531c20341c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1316 microversion: 2.1 time: 1.730940 Aug 04 14:06:29.583774 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1299/2587] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:27 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1316 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:29.696108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8ec4ee38-f066-49bf-ba39-0f8e3bd7c7bf req-949ae261-771a-4b80-9fcb-517d7c8f88eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8a40a39-cbe8-47bc-8869-a88e59989f63", "tag": "19e85bce-c14d-4d20-89ef-01de05cf0ac7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:29.729513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8ec4ee38-f066-49bf-ba39-0f8e3bd7c7bf req-949ae261-771a-4b80-9fcb-517d7c8f88eb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:29.733269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8ec4ee38-f066-49bf-ba39-0f8e3bd7c7bf req-949ae261-771a-4b80-9fcb-517d7c8f88eb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:29.764291 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8ec4ee38-f066-49bf-ba39-0f8e3bd7c7bf req-949ae261-771a-4b80-9fcb-517d7c8f88eb service nova] Creating event network-changed:19e85bce-c14d-4d20-89ef-01de05cf0ac7 for instance c8a40a39-cbe8-47bc-8869-a88e59989f63 on n-h2-844627-10 Aug 04 14:06:29.773807 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8ec4ee38-f066-49bf-ba39-0f8e3bd7c7bf req-949ae261-771a-4b80-9fcb-517d7c8f88eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083323 Aug 04 14:06:29.781770 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1300/2588] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:06:30.627489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7cb8fd4a-f4cf-4e7e-883c-ba7d97d0e30c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:30.628346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7cb8fd4a-f4cf-4e7e-883c-ba7d97d0e30c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:30.659270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7cb8fd4a-f4cf-4e7e-883c-ba7d97d0e30c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:30.659849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7cb8fd4a-f4cf-4e7e-883c-ba7d97d0e30c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:30.667491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7cb8fd4a-f4cf-4e7e-883c-ba7d97d0e30c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:30.668172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7cb8fd4a-f4cf-4e7e-883c-ba7d97d0e30c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:30.832193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:30.833212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:30.834168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:30.836616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:30.837375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:30.930419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:30.931272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:30.932949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:30.934137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:31.073438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:31.126471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for user df576732ca5c442694d507fd4dc58279 and project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:31.218844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:06:31.224498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:06:31.500433 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2d58a046-fadc-4b55-b9f4-6b2207aa8d7f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.081656 Aug 04 14:06:31.518206 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1289/2589] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 5101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:06:32.036216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1119345675", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": "none"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:32.273763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:32.274759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:32.275703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:32.277817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:32.280597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:32.333935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:32.334456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:32.342266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:32.346780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:32.382095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:32.450524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Getting quotas for project 20a4f1a85b1c4fdea317d091edcd4a80. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:32.463037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Getting quotas for user 70bafa980d344cffa4a93f390e789a6f and project 20a4f1a85b1c4fdea317d091edcd4a80. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:32.526835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:06:32.530569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:06:32.674280 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e12e9810-3cc3-4c07-8442-3cba2f4c260c tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.151788 Aug 04 14:06:32.679369 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1290/2590] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:06:32.706565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f421b95a-7040-4584-92ab-fdfd5d37dcab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:32.715627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f421b95a-7040-4584-92ab-fdfd5d37dcab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:33.263755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f421b95a-7040-4584-92ab-fdfd5d37dcab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:33.293086 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f421b95a-7040-4584-92ab-fdfd5d37dcab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1221 microversion: 2.1 time: 0.609799 Aug 04 14:06:33.294487 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1291/2591] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:32 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1221 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:33.318945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6cf70a0e-688c-41ee-8122-fb3ab6df1e27 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:33.322163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6cf70a0e-688c-41ee-8122-fb3ab6df1e27 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:33.699715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6cf70a0e-688c-41ee-8122-fb3ab6df1e27 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:33.741569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7cb8fd4a-f4cf-4e7e-883c-ba7d97d0e30c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:33.758773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6cf70a0e-688c-41ee-8122-fb3ab6df1e27 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:33.768115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6cf70a0e-688c-41ee-8122-fb3ab6df1e27 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:33.772389 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7cb8fd4a-f4cf-4e7e-883c-ba7d97d0e30c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1316 microversion: 2.1 time: 3.146952 Aug 04 14:06:33.773121 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1301/2592] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:30 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1316 bytes in 3152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:06:33.782123 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6cf70a0e-688c-41ee-8122-fb3ab6df1e27 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1278 microversion: 2.57 time: 0.480026 Aug 04 14:06:33.798418 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1292/2593] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:33 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1278 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:34.320546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-38dc4f11-d790-4bc2-95cf-cf2e052fc425 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:34.327103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-905998397", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:34.330253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-38dc4f11-d790-4bc2-95cf-cf2e052fc425 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:34.356351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38dc4f11-d790-4bc2-95cf-cf2e052fc425 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:34.360057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38dc4f11-d790-4bc2-95cf-cf2e052fc425 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:34.362543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38dc4f11-d790-4bc2-95cf-cf2e052fc425 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:34.365034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38dc4f11-d790-4bc2-95cf-cf2e052fc425 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:34.506960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] validate_networks() for [('4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:06:34.571458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-38dc4f11-d790-4bc2-95cf-cf2e052fc425 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:34.602419 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-38dc4f11-d790-4bc2-95cf-cf2e052fc425 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1291 microversion: 2.1 time: 0.286266 Aug 04 14:06:34.624101 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1293/2594] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:34 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1291 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:34.648714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-56ccc39c-88bf-4510-9877-a976193fb4ea tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Calling method '.version_select at 0x7f47002f13a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:34.874527 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-56ccc39c-88bf-4510-9877-a976193fb4ea tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542" status: 200 len: 636 microversion: 2.1 time: 0.256545 Aug 04 14:06:34.878908 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1294/2595] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:06:34 2022] GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542 => generated 636 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:34.977288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e76d9906-5906-4051-85aa-046bf76f013c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:34.981216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e76d9906-5906-4051-85aa-046bf76f013c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:35.062493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e76d9906-5906-4051-85aa-046bf76f013c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:35.063912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e76d9906-5906-4051-85aa-046bf76f013c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:35.070730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e76d9906-5906-4051-85aa-046bf76f013c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:35.082113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e76d9906-5906-4051-85aa-046bf76f013c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:36.006478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e76d9906-5906-4051-85aa-046bf76f013c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:36.030365 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e76d9906-5906-4051-85aa-046bf76f013c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1316 microversion: 2.1 time: 1.122815 Aug 04 14:06:36.031886 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1295/2596] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:34 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1316 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:36.042692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:36.048380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:36.073100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:36.073565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:36.078155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:36.078801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:36.431329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:36.437090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:36.437605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:36.437974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:36.438609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:36.439201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:36.460632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:36.472369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:36.474455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:36.475141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:36.477645 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2a2a00d9-eb86-4729-8ba0-969530341f15 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1338 microversion: 2.57 time: 0.444720 Aug 04 14:06:36.477972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:36.478682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:36.480900 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1296/2597] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:36 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1338 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:36.489723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18d6ecc5-9368-4dbc-86f8-20e514ae01ce tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Action: 'update_all', calling method: .version_select at 0x7f4700132ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:36.550405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:36.557572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for user d6f701d08c0741df9ad1375bd0712a59 and project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:36.592058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:06:36.594911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:06:36.641354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-18d6ecc5-9368-4dbc-86f8-20e514ae01ce tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:36.657972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-18d6ecc5-9368-4dbc-86f8-20e514ae01ce tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for user 4337e8aa5c4a4957bc9d7e85e6152edb and project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:36.747466 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-060e0e99-1056-47a9-aac6-244ce13f59a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.967179 Aug 04 14:06:36.758026 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1302/2598] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:06:36.995291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-179457986", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "a3266911-971f-4f12-b434-47bfe490ce9f"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:37.155378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] validate_networks() for [('a3266911-971f-4f12-b434-47bfe490ce9f', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:06:37.428103 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18d6ecc5-9368-4dbc-86f8-20e514ae01ce tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 61 microversion: 2.1 time: 0.945609 Aug 04 14:06:37.428710 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1297/2599] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:06:36 2022] PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 61 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:37.435217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ee88b848-25f1-47cb-ba49-10c9c5ee525a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:37.438113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ee88b848-25f1-47cb-ba49-10c9c5ee525a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:37.457697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee88b848-25f1-47cb-ba49-10c9c5ee525a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:37.458579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee88b848-25f1-47cb-ba49-10c9c5ee525a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:37.459585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee88b848-25f1-47cb-ba49-10c9c5ee525a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:37.462966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee88b848-25f1-47cb-ba49-10c9c5ee525a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:37.855315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ee88b848-25f1-47cb-ba49-10c9c5ee525a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:37.943994 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ee88b848-25f1-47cb-ba49-10c9c5ee525a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1279 microversion: 2.1 time: 0.505433 Aug 04 14:06:37.952728 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1298/2600] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:37 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1279 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:38.002568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-055d445e-77ab-4d93-8822-86b3d0c65851 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:38.007814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-055d445e-77ab-4d93-8822-86b3d0c65851 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:38.224779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-055d445e-77ab-4d93-8822-86b3d0c65851 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:38.253540 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-055d445e-77ab-4d93-8822-86b3d0c65851 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1214 microversion: 2.1 time: 0.297201 Aug 04 14:06:38.268976 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1299/2601] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:37 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1214 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:38.288287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-76f68a99-283a-4083-98e2-533f2394e1e3 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:38.289888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-76f68a99-283a-4083-98e2-533f2394e1e3 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:38.325152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76f68a99-283a-4083-98e2-533f2394e1e3 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:38.326683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76f68a99-283a-4083-98e2-533f2394e1e3 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:38.328258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76f68a99-283a-4083-98e2-533f2394e1e3 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:38.328988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76f68a99-283a-4083-98e2-533f2394e1e3 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:38.842300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-76f68a99-283a-4083-98e2-533f2394e1e3 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:38.858418 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-76f68a99-283a-4083-98e2-533f2394e1e3 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1316 microversion: 2.1 time: 0.595870 Aug 04 14:06:38.859038 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1300/2602] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:38 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:38.914616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e570f94a-3bd4-419e-b8f3-6c2cb1d97072 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Calling method '.version_select at 0x7f470005daf0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:39.042997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:39.044142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:39.044836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:39.045496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:39.046134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:39.068573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:39.069815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:39.072285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:39.073621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:39.134286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Getting quotas for project 18f8c6320ff146eea8e42f1ccffb4d68. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:39.151601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Getting quotas for user b60da41ae2454edb8c9c11a323a1157e and project 18f8c6320ff146eea8e42f1ccffb4d68. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:39.208042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:06:39.221255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:06:39.349131 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8575a45a-053f-4738-9697-585d2c3b19bd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.588522 Aug 04 14:06:39.350381 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1303/2603] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:06:39.362428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:39.363860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:39.378701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:39.379570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:39.381110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:39.381764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:39.661581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:39.678920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:39.680594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:39.689033 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c8473653-2350-4a39-b131-e1637ba72dc0 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1336 microversion: 2.57 time: 0.334166 Aug 04 14:06:39.689740 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1304/2604] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:39 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1336 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:39.704983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9b016884-1303-44c2-be03-3b067e7dfa8b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:39.705922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9b016884-1303-44c2-be03-3b067e7dfa8b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:39.722862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b016884-1303-44c2-be03-3b067e7dfa8b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:39.724371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b016884-1303-44c2-be03-3b067e7dfa8b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:39.727757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b016884-1303-44c2-be03-3b067e7dfa8b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:39.729236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b016884-1303-44c2-be03-3b067e7dfa8b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:39.776060 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e570f94a-3bd4-419e-b8f3-6c2cb1d97072 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "DELETE /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.915849 Aug 04 14:06:39.777519 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1301/2605] 10.222.0.66 () {58 vars in 1296 bytes} [Thu Aug 4 14:06:38 2022] DELETE /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata/os_version => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:06:39.783039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-563ab6d6-2f14-46c1-a156-195f92d8ed48 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:39.783680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-563ab6d6-2f14-46c1-a156-195f92d8ed48 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:39.810341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-563ab6d6-2f14-46c1-a156-195f92d8ed48 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:39.810815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-563ab6d6-2f14-46c1-a156-195f92d8ed48 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:39.811664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-563ab6d6-2f14-46c1-a156-195f92d8ed48 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:39.812234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-563ab6d6-2f14-46c1-a156-195f92d8ed48 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:39.965796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-563ab6d6-2f14-46c1-a156-195f92d8ed48 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:39.977723 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-563ab6d6-2f14-46c1-a156-195f92d8ed48 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1266 microversion: 2.1 time: 0.199063 Aug 04 14:06:39.985303 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1302/2606] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:39 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:39.991519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa038190-8f8f-4f10-8b03-0e7e9f0e5c65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:39.995733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fa038190-8f8f-4f10-8b03-0e7e9f0e5c65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:40.077580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9b016884-1303-44c2-be03-3b067e7dfa8b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:40.134405 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9b016884-1303-44c2-be03-3b067e7dfa8b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1321 microversion: 2.1 time: 0.440687 Aug 04 14:06:40.135597 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1305/2607] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:39 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:40.175978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-92c16e42-98c0-4e07-a739-87d174d1b633 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Calling method '.version_select at 0x7f4700230820>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:40.297675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fa038190-8f8f-4f10-8b03-0e7e9f0e5c65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:40.300058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=35 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:40.319037 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-92c16e42-98c0-4e07-a739-87d174d1b633 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 37 microversion: 2.1 time: 0.181606 Aug 04 14:06:40.319758 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1306/2608] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 14:06:40 2022] GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 37 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:40.322565 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fa038190-8f8f-4f10-8b03-0e7e9f0e5c65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1215 microversion: 2.1 time: 0.335591 Aug 04 14:06:40.325418 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1303/2609] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:39 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1215 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:40.343985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-390000d7-82a3-4e10-a043-f04ffb5774cd tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Action: 'update_all', calling method: .version_select at 0x7f470007ea60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:40.345204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e6cd3876-a0f8-401b-9e9f-a1a63c89810d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:40.345951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e6cd3876-a0f8-401b-9e9f-a1a63c89810d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:40.363517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6cd3876-a0f8-401b-9e9f-a1a63c89810d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:40.364068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6cd3876-a0f8-401b-9e9f-a1a63c89810d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:40.368672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6cd3876-a0f8-401b-9e9f-a1a63c89810d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:40.370656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6cd3876-a0f8-401b-9e9f-a1a63c89810d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:40.528147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-390000d7-82a3-4e10-a043-f04ffb5774cd tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:40.551210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-390000d7-82a3-4e10-a043-f04ffb5774cd tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for user 4337e8aa5c4a4957bc9d7e85e6152edb and project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:41.234313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e6cd3876-a0f8-401b-9e9f-a1a63c89810d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:41.250459 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e6cd3876-a0f8-401b-9e9f-a1a63c89810d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1316 microversion: 2.1 time: 0.927330 Aug 04 14:06:41.254263 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1307/2610] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:40 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1316 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:41.283016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:41.287852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:41.307460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=9 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:41.314812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:41.316352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:41.323475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:41.333630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:41.389874 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-390000d7-82a3-4e10-a043-f04ffb5774cd tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 61 microversion: 2.1 time: 1.049017 Aug 04 14:06:41.393043 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1304/2611] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:06:40 2022] PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 61 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 14:06:41.409003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ce61605-5d0e-41b0-b448-550b7589d3e0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:41.412455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4ce61605-5d0e-41b0-b448-550b7589d3e0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:41.471427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ce61605-5d0e-41b0-b448-550b7589d3e0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:41.472298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ce61605-5d0e-41b0-b448-550b7589d3e0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:41.473323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ce61605-5d0e-41b0-b448-550b7589d3e0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:41.473785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ce61605-5d0e-41b0-b448-550b7589d3e0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:41.591631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:41.608593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:41.611255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:41.613031 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-329e45d3-c8ee-4c82-8784-7eae8e71ed21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1357 microversion: 2.57 time: 0.340499 Aug 04 14:06:41.622889 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1308/2612] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:41 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1357 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:41.641722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca7825dd-3414-4b41-9e44-4be8ea0b0417 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:41.643210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ca7825dd-3414-4b41-9e44-4be8ea0b0417 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:41.666581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca7825dd-3414-4b41-9e44-4be8ea0b0417 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:41.666960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca7825dd-3414-4b41-9e44-4be8ea0b0417 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:41.668199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca7825dd-3414-4b41-9e44-4be8ea0b0417 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:41.668969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca7825dd-3414-4b41-9e44-4be8ea0b0417 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:41.903923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4ce61605-5d0e-41b0-b448-550b7589d3e0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:41.956854 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4ce61605-5d0e-41b0-b448-550b7589d3e0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1274 microversion: 2.1 time: 0.555850 Aug 04 14:06:41.978126 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1305/2613] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:41 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1274 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:41.999590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-953dd301-1fab-4b68-80e0-e4c72f934f65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:42.001863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-953dd301-1fab-4b68-80e0-e4c72f934f65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:42.039614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-953dd301-1fab-4b68-80e0-e4c72f934f65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:42.040174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-953dd301-1fab-4b68-80e0-e4c72f934f65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:42.041248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-953dd301-1fab-4b68-80e0-e4c72f934f65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:42.042977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-953dd301-1fab-4b68-80e0-e4c72f934f65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:42.379860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:42.496456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-953dd301-1fab-4b68-80e0-e4c72f934f65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:42.511097 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-953dd301-1fab-4b68-80e0-e4c72f934f65 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1211 microversion: 2.1 time: 0.529791 Aug 04 14:06:42.511802 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1306/2614] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:41 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1211 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:42.526814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b39bd6c-40f0-4ea0-96ca-e11b148dd010 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Calling method '.version_select at 0x7f47001c0820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:42.619187 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b39bd6c-40f0-4ea0-96ca-e11b148dd010 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.105873 Aug 04 14:06:42.620924 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1307/2615] 10.222.0.66 () {58 vars in 1290 bytes} [Thu Aug 4 14:06:42 2022] GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata/os_distro => generated 33 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:42.626915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:42.631415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:42.642541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:42.643003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:42.643822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:42.644527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:42.812707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:42.813590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:42.814560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:42.815366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:42.816102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:42.873892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ca7825dd-3414-4b41-9e44-4be8ea0b0417 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:42.894133 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca7825dd-3414-4b41-9e44-4be8ea0b0417 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1321 microversion: 2.1 time: 1.269485 Aug 04 14:06:42.897649 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1309/2616] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:41 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1321 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:42.982003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:43.011557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:43.012049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:43.012903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:43.013473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:43.103031 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-996d6e24-94f4-4336-bd17-4dbd7ff194ac tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "POST /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740/action" status: 202 len: 1138 microversion: 2.57 time: 0.481148 Aug 04 14:06:43.104906 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1308/2617] 10.222.0.66 () {62 vars in 1320 bytes} [Thu Aug 4 14:06:42 2022] POST /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740/action => generated 1138 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 14:06:43.170296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-349127501", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:43.179758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-45cabbef-9a13-4713-9404-baeb47ab99f5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:43.199956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-45cabbef-9a13-4713-9404-baeb47ab99f5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:43.279270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cabbef-9a13-4713-9404-baeb47ab99f5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:43.280068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cabbef-9a13-4713-9404-baeb47ab99f5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:43.303245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cabbef-9a13-4713-9404-baeb47ab99f5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:43.304118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-45cabbef-9a13-4713-9404-baeb47ab99f5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:43.518513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] validate_networks() for [('747cead7-f4fd-45c1-adfe-4f2d9869528a', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:06:44.783859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-45cabbef-9a13-4713-9404-baeb47ab99f5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:44.820035 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-45cabbef-9a13-4713-9404-baeb47ab99f5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1316 microversion: 2.1 time: 1.680037 Aug 04 14:06:44.822318 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1309/2618] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:43 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1316 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:44.835184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-139b1a2c-9c81-4592-a52b-9845cb80f25b req-0fdc5b0d-d900-4ec4-8c3d-cc7e4a108a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e14548-2895-42eb-b864-6d943135680d", "tag": "ba96428b-3ea5-459b-b489-1e7935fc39e1"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:44.868122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-139b1a2c-9c81-4592-a52b-9845cb80f25b req-0fdc5b0d-d900-4ec4-8c3d-cc7e4a108a61 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:44.870295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-139b1a2c-9c81-4592-a52b-9845cb80f25b req-0fdc5b0d-d900-4ec4-8c3d-cc7e4a108a61 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:44.900839 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-139b1a2c-9c81-4592-a52b-9845cb80f25b req-0fdc5b0d-d900-4ec4-8c3d-cc7e4a108a61 service nova] Creating event network-changed:ba96428b-3ea5-459b-b489-1e7935fc39e1 for instance c9e14548-2895-42eb-b864-6d943135680d on n-h2-844627-10 Aug 04 14:06:44.907827 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-139b1a2c-9c81-4592-a52b-9845cb80f25b req-0fdc5b0d-d900-4ec4-8c3d-cc7e4a108a61 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082427 Aug 04 14:06:44.914380 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1310/2619] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:44.923218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7ea2c31-8fc9-4795-9f10-5baca1da45ea tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Action: 'update_all', calling method: .version_select at 0x7f470005d820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:45.213988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f7ea2c31-8fc9-4795-9f10-5baca1da45ea tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:45.247432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f7ea2c31-8fc9-4795-9f10-5baca1da45ea tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for user 4337e8aa5c4a4957bc9d7e85e6152edb and project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:45.647352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:45.658249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:45.660086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:45.662118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:45.665048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:45.721048 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7ea2c31-8fc9-4795-9f10-5baca1da45ea tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 61 microversion: 2.1 time: 0.804187 Aug 04 14:06:45.721679 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1311/2620] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:06:44 2022] PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 61 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:45.722292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:45.723992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:45.726183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:45.727970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:45.732322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4e9f89b1-0383-455b-bdd9-d09d9667c31e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:45.733839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4e9f89b1-0383-455b-bdd9-d09d9667c31e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:45.749264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=84 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:45.758290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e9f89b1-0383-455b-bdd9-d09d9667c31e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:45.759642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e9f89b1-0383-455b-bdd9-d09d9667c31e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:45.762787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e9f89b1-0383-455b-bdd9-d09d9667c31e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:45.763964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e9f89b1-0383-455b-bdd9-d09d9667c31e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:45.818185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Getting quotas for project c9ff6de2efd240b79217e2e5efe4f8ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:45.843539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Getting quotas for user 653fb03c7a4b4a61a57ecd4cdd610e86 and project c9ff6de2efd240b79217e2e5efe4f8ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:45.899771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:06:45.911578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:06:46.034087 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3daf74e5-d6b3-4458-aa27-b2beaba4de27 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.129309 Aug 04 14:06:46.035164 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1310/2621] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:06:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 3131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:06:46.040422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:46.041224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:46.067608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:46.068632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:46.071756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:46.072510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:46.448690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:46.511917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:46.523410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:46.531864 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08666aad-98e8-41b3-a584-aa2730bf6cdd tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.494634 Aug 04 14:06:46.533905 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1311/2622] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:46 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:46.585854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76ed21c2-f6f1-431f-a563-51139a67e664 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:46.613214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76ed21c2-f6f1-431f-a563-51139a67e664 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:46.637917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ed21c2-f6f1-431f-a563-51139a67e664 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:46.646598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ed21c2-f6f1-431f-a563-51139a67e664 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:46.677835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ed21c2-f6f1-431f-a563-51139a67e664 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:46.678866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ed21c2-f6f1-431f-a563-51139a67e664 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:46.730947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4e9f89b1-0383-455b-bdd9-d09d9667c31e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:46.745795 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4e9f89b1-0383-455b-bdd9-d09d9667c31e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1314 microversion: 2.1 time: 1.017386 Aug 04 14:06:46.746387 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1312/2623] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:45 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1314 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:46.757469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-63adbf70-dcc2-47f8-9ccc-55926911cb7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:46.758095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-63adbf70-dcc2-47f8-9ccc-55926911cb7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:46.781543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63adbf70-dcc2-47f8-9ccc-55926911cb7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:46.788971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63adbf70-dcc2-47f8-9ccc-55926911cb7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:46.790422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63adbf70-dcc2-47f8-9ccc-55926911cb7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:46.791049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63adbf70-dcc2-47f8-9ccc-55926911cb7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:46.873670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76ed21c2-f6f1-431f-a563-51139a67e664 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:46.910421 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76ed21c2-f6f1-431f-a563-51139a67e664 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1273 microversion: 2.1 time: 0.370935 Aug 04 14:06:46.914222 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1312/2624] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:46 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1273 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:46.935981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3b5edc45-ea44-4d12-ad8b-7d6fa468faa8 req-6be71246-84cb-4df4-bd53-5e1444e6cb2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a40a39-cbe8-47bc-8869-a88e59989f63", "name": "network-vif-plugged", "status": "completed", "tag": "19e85bce-c14d-4d20-89ef-01de05cf0ac7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:46.956076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3b5edc45-ea44-4d12-ad8b-7d6fa468faa8 req-6be71246-84cb-4df4-bd53-5e1444e6cb2a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:46.956929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3b5edc45-ea44-4d12-ad8b-7d6fa468faa8 req-6be71246-84cb-4df4-bd53-5e1444e6cb2a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:46.985545 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3b5edc45-ea44-4d12-ad8b-7d6fa468faa8 req-6be71246-84cb-4df4-bd53-5e1444e6cb2a service nova] Creating event network-vif-plugged:19e85bce-c14d-4d20-89ef-01de05cf0ac7 for instance c8a40a39-cbe8-47bc-8869-a88e59989f63 on n-h2-844627-10 Aug 04 14:06:47.001428 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3b5edc45-ea44-4d12-ad8b-7d6fa468faa8 req-6be71246-84cb-4df4-bd53-5e1444e6cb2a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082725 Aug 04 14:06:47.002496 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1313/2625] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:47.009705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b60148f8-c712-4098-a326-55eed5b63ba4 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Calling method '.version_select at 0x7f47002d4430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:47.066435 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b60148f8-c712-4098-a326-55eed5b63ba4 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 61 microversion: 2.1 time: 0.062602 Aug 04 14:06:47.067613 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1314/2626] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 14:06:47 2022] GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 61 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:47.077804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e616139-f150-41b2-a445-3ae2df50c877 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:47.078655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8e616139-f150-41b2-a445-3ae2df50c877 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:47.094417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e616139-f150-41b2-a445-3ae2df50c877 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:47.095010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e616139-f150-41b2-a445-3ae2df50c877 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:47.095943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e616139-f150-41b2-a445-3ae2df50c877 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:47.096502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e616139-f150-41b2-a445-3ae2df50c877 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:47.951894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-63adbf70-dcc2-47f8-9ccc-55926911cb7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:47.955256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:47.966945 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-63adbf70-dcc2-47f8-9ccc-55926911cb7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1321 microversion: 2.1 time: 1.219425 Aug 04 14:06:47.972749 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1313/2627] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:46 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1321 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:47.979074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-177831716", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a6fe3b0e-589f-4137-b3da-0f7664c12e01"}], "block_device_mapping_v2": [{"uuid": "027b63a8-1edb-4694-b6d0-3d18c4bbed96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:48.001902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8e616139-f150-41b2-a445-3ae2df50c877 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:48.022758 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e616139-f150-41b2-a445-3ae2df50c877 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1316 microversion: 2.1 time: 0.953691 Aug 04 14:06:48.030227 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1315/2628] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:47 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1316 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:48.054735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70607b4f-692f-47c4-9cd8-3eb57a59581e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:48.056383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70607b4f-692f-47c4-9cd8-3eb57a59581e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:48.073355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70607b4f-692f-47c4-9cd8-3eb57a59581e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:48.075505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70607b4f-692f-47c4-9cd8-3eb57a59581e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:48.078874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70607b4f-692f-47c4-9cd8-3eb57a59581e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:48.080681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70607b4f-692f-47c4-9cd8-3eb57a59581e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:48.169570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] validate_networks() for [('a6fe3b0e-589f-4137-b3da-0f7664c12e01', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:06:48.238454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-70607b4f-692f-47c4-9cd8-3eb57a59581e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:48.259846 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70607b4f-692f-47c4-9cd8-3eb57a59581e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1217 microversion: 2.1 time: 0.227011 Aug 04 14:06:48.260900 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1316/2629] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:48 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:48.271051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-31ccecb2-acd9-47ee-8c84-4de533ffdd2f tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Action: 'update_all', calling method: .version_select at 0x7f47004d14c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:48.382542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-31ccecb2-acd9-47ee-8c84-4de533ffdd2f tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:48.396686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-31ccecb2-acd9-47ee-8c84-4de533ffdd2f tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for user 4337e8aa5c4a4957bc9d7e85e6152edb and project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:48.709205 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-31ccecb2-acd9-47ee-8c84-4de533ffdd2f tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 61 microversion: 2.1 time: 0.445947 Aug 04 14:06:48.711639 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1317/2630] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:06:48 2022] PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 61 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:48.720431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:48.721457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:48.737726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:48.750985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:48.753999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:48.755546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:49.076284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:49.087450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:49.093324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:49.103261 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8168f972-682f-43b6-b526-f8c7493981df tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.390294 Aug 04 14:06:49.104494 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1318/2631] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:48 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:49.124721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f2a8871-8565-4d31-b78b-73feec5eb352 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:49.127154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f2a8871-8565-4d31-b78b-73feec5eb352 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:49.148264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f2a8871-8565-4d31-b78b-73feec5eb352 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:49.149046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f2a8871-8565-4d31-b78b-73feec5eb352 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:49.149907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f2a8871-8565-4d31-b78b-73feec5eb352 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:49.151207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f2a8871-8565-4d31-b78b-73feec5eb352 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:49.828086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f2a8871-8565-4d31-b78b-73feec5eb352 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:49.842463 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f2a8871-8565-4d31-b78b-73feec5eb352 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1314 microversion: 2.1 time: 0.736549 Aug 04 14:06:49.852918 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1319/2632] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:49 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:49.852918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df039f65-c451-4b0a-9360-bc5d674ad5dc tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:49.852918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-df039f65-c451-4b0a-9360-bc5d674ad5dc tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:49.856807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df039f65-c451-4b0a-9360-bc5d674ad5dc tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:49.857707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df039f65-c451-4b0a-9360-bc5d674ad5dc tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:49.859039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df039f65-c451-4b0a-9360-bc5d674ad5dc tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:49.860028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df039f65-c451-4b0a-9360-bc5d674ad5dc tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:49.874352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:49.875075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:49.875939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:49.876690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:49.880712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:49.916714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:49.917606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:49.918458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:49.919175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:49.952678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:49.966361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Getting quotas for user dd1aacb549b74c21a13b9f3ca2df840c and project 1d0f04146c914cf1940cea4b2229ebd5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:50.040620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:06:50.043630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='027b63a8-1edb-4694-b6d0-3d18c4bbed96',volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:06:50.253341 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5b178c12-8505-48e9-9537-6022d618e606 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.270973 Aug 04 14:06:50.260786 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1314/2633] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:06:50.269781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1522004029", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:50.417714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-df039f65-c451-4b0a-9360-bc5d674ad5dc tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:50.433323 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-df039f65-c451-4b0a-9360-bc5d674ad5dc tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1315 microversion: 2.1 time: 0.588695 Aug 04 14:06:50.437542 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1320/2634] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:49 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:50.447616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] validate_networks() for [('747cead7-f4fd-45c1-adfe-4f2d9869528a', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:06:50.460844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5836090c-684d-4a5d-9789-ae528ecdcc5c tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Action: 'update_all', calling method: .version_select at 0x7f4705474040>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:50.595682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5836090c-684d-4a5d-9789-ae528ecdcc5c tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:50.607168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5836090c-684d-4a5d-9789-ae528ecdcc5c tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for user 4337e8aa5c4a4957bc9d7e85e6152edb and project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:51.491403 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5836090c-684d-4a5d-9789-ae528ecdcc5c tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 64 microversion: 2.1 time: 1.052308 Aug 04 14:06:51.498057 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1321/2635] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:06:50 2022] PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 64 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:51.503503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-30c8ec0e-11a7-4d84-9347-b12e4cae0d4a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:51.505623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-30c8ec0e-11a7-4d84-9347-b12e4cae0d4a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:51.512996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30c8ec0e-11a7-4d84-9347-b12e4cae0d4a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:51.513828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30c8ec0e-11a7-4d84-9347-b12e4cae0d4a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:51.514819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30c8ec0e-11a7-4d84-9347-b12e4cae0d4a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:51.515509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30c8ec0e-11a7-4d84-9347-b12e4cae0d4a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:51.902020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-30c8ec0e-11a7-4d84-9347-b12e4cae0d4a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:51.918494 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-30c8ec0e-11a7-4d84-9347-b12e4cae0d4a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1321 microversion: 2.1 time: 0.418786 Aug 04 14:06:51.919346 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1322/2636] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:51 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:51.937706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa409aa9-5575-4dd2-80be-6bffc6fd0bb9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:51.941458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa409aa9-5575-4dd2-80be-6bffc6fd0bb9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:51.996515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa409aa9-5575-4dd2-80be-6bffc6fd0bb9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:51.997062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa409aa9-5575-4dd2-80be-6bffc6fd0bb9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:51.998365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa409aa9-5575-4dd2-80be-6bffc6fd0bb9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:51.999287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa409aa9-5575-4dd2-80be-6bffc6fd0bb9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.096162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:06:52.097615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:06:52.098599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:06:52.099023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:06:52.099637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:06:52.102097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:52.115406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.116190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.117164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.117612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.155321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Getting quotas for project c9ff6de2efd240b79217e2e5efe4f8ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:52.170310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Getting quotas for user 653fb03c7a4b4a61a57ecd4cdd610e86 and project c9ff6de2efd240b79217e2e5efe4f8ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:52.197382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:06:52.201887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:06:52.264483 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6be34173-fed9-4c81-abc2-0f768ec382d5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.002355 Aug 04 14:06:52.265317 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1315/2637] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:06:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:06:52.271213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-335b63a2-8c4c-4909-85e7-e5194c877917 req-e73e9559-453c-4115-988c-ccbe26e1cded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dedb436-cd86-49c7-9a23-933ab3829812", "tag": "1a49ef80-c7b3-44c3-9e9b-4da1681e2afc"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:52.299915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-335b63a2-8c4c-4909-85e7-e5194c877917 req-e73e9559-453c-4115-988c-ccbe26e1cded service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.300914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-335b63a2-8c4c-4909-85e7-e5194c877917 req-e73e9559-453c-4115-988c-ccbe26e1cded service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.313527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa409aa9-5575-4dd2-80be-6bffc6fd0bb9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:52.331258 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa409aa9-5575-4dd2-80be-6bffc6fd0bb9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1466 microversion: 2.1 time: 0.408108 Aug 04 14:06:52.333321 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1323/2638] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:51 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1466 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:52.349911 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-335b63a2-8c4c-4909-85e7-e5194c877917 req-e73e9559-453c-4115-988c-ccbe26e1cded service nova] Creating event network-changed:1a49ef80-c7b3-44c3-9e9b-4da1681e2afc for instance 9dedb436-cd86-49c7-9a23-933ab3829812 on n-h1-844627-10 Aug 04 14:06:52.351156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:52.351795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:52.360516 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-335b63a2-8c4c-4909-85e7-e5194c877917 req-e73e9559-453c-4115-988c-ccbe26e1cded service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093740 Aug 04 14:06:52.363407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.363928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.364755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.365226 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1316/2639] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:52.369512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.385979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-13dc8673-28fa-424d-8c4c-56ff96cd4933 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:52.393011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-13dc8673-28fa-424d-8c4c-56ff96cd4933 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:52.412439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13dc8673-28fa-424d-8c4c-56ff96cd4933 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.413024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13dc8673-28fa-424d-8c4c-56ff96cd4933 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.413826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13dc8673-28fa-424d-8c4c-56ff96cd4933 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.414464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13dc8673-28fa-424d-8c4c-56ff96cd4933 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.646923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:52.679083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:52.683108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-13dc8673-28fa-424d-8c4c-56ff96cd4933 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:52.686560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:52.689973 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d72da894-48f4-4603-953d-f17446e26485 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.354983 Aug 04 14:06:52.690774 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1324/2640] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:52 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:52.698707 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-13dc8673-28fa-424d-8c4c-56ff96cd4933 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1158 microversion: 2.1 time: 0.330384 Aug 04 14:06:52.699553 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1317/2641] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:52 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1158 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:52.701873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae0689b0-f990-43b2-95ef-c13cace8b095 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:52.702514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ae0689b0-f990-43b2-95ef-c13cace8b095 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:52.719202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-663f5536-dac0-4a81-8c4e-3700caa6f0c0 req-76e1ad95-05f7-4cd7-a705-d52b62250cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e14548-2895-42eb-b864-6d943135680d", "name": "network-vif-plugged", "status": "completed", "tag": "ba96428b-3ea5-459b-b489-1e7935fc39e1"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:52.733499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae0689b0-f990-43b2-95ef-c13cace8b095 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.733967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae0689b0-f990-43b2-95ef-c13cace8b095 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.734756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae0689b0-f990-43b2-95ef-c13cace8b095 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.735198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae0689b0-f990-43b2-95ef-c13cace8b095 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.740680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-663f5536-dac0-4a81-8c4e-3700caa6f0c0 req-76e1ad95-05f7-4cd7-a705-d52b62250cba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.748792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-663f5536-dac0-4a81-8c4e-3700caa6f0c0 req-76e1ad95-05f7-4cd7-a705-d52b62250cba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.765050 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-663f5536-dac0-4a81-8c4e-3700caa6f0c0 req-76e1ad95-05f7-4cd7-a705-d52b62250cba service nova] Creating event network-vif-plugged:ba96428b-3ea5-459b-b489-1e7935fc39e1 for instance c9e14548-2895-42eb-b864-6d943135680d on n-h2-844627-10 Aug 04 14:06:52.780465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-663f5536-dac0-4a81-8c4e-3700caa6f0c0 req-76e1ad95-05f7-4cd7-a705-d52b62250cba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078640 Aug 04 14:06:52.781118 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1318/2642] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:52.787607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5b8be844-c2b3-4cd6-8495-9a29067ab6e3 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:52.788215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b8be844-c2b3-4cd6-8495-9a29067ab6e3 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:52.825147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b8be844-c2b3-4cd6-8495-9a29067ab6e3 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.825615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b8be844-c2b3-4cd6-8495-9a29067ab6e3 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:52.827620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b8be844-c2b3-4cd6-8495-9a29067ab6e3 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:52.828317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b8be844-c2b3-4cd6-8495-9a29067ab6e3 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:53.532096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae0689b0-f990-43b2-95ef-c13cace8b095 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:53.541161 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae0689b0-f990-43b2-95ef-c13cace8b095 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1314 microversion: 2.1 time: 0.848993 Aug 04 14:06:53.542124 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1325/2643] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:52 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:53.547483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b2e7e9c-90b2-4ac9-938f-911341c43905 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Calling method '.version_select at 0x7f470011aa60>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:53.577370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5b8be844-c2b3-4cd6-8495-9a29067ab6e3 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:53.597529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5b8be844-c2b3-4cd6-8495-9a29067ab6e3 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1315 microversion: 2.1 time: 0.813347 Aug 04 14:06:53.612752 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8b2e7e9c-90b2-4ac9-938f-911341c43905 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 64 microversion: 2.1 time: 0.068553 Aug 04 14:06:53.614924 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1326/2645] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 14:06:53 2022] GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 64 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:53.615617 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1319/2645] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:52 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:53.624670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ed8937f7-3c20-4ee0-aff9-4fe963db1b2e req-9bbafeca-5de0-43ff-ba77-a19a7bca45e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da969e0f-87c4-4c9d-bef7-b74fb0837616", "tag": "103e4629-b7e2-457f-94ee-b0630fd8b783"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:53.631603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b986301b-4520-4364-b123-17f5aa134a81 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:53.633759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b986301b-4520-4364-b123-17f5aa134a81 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:53.642656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ed8937f7-3c20-4ee0-aff9-4fe963db1b2e req-9bbafeca-5de0-43ff-ba77-a19a7bca45e2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:53.643818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ed8937f7-3c20-4ee0-aff9-4fe963db1b2e req-9bbafeca-5de0-43ff-ba77-a19a7bca45e2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:53.650338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b986301b-4520-4364-b123-17f5aa134a81 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:53.651463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b986301b-4520-4364-b123-17f5aa134a81 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:53.652906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b986301b-4520-4364-b123-17f5aa134a81 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:53.655010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b986301b-4520-4364-b123-17f5aa134a81 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:53.669383 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ed8937f7-3c20-4ee0-aff9-4fe963db1b2e req-9bbafeca-5de0-43ff-ba77-a19a7bca45e2 service nova] Creating event network-changed:103e4629-b7e2-457f-94ee-b0630fd8b783 for instance da969e0f-87c4-4c9d-bef7-b74fb0837616 on n-h2-844627-10 Aug 04 14:06:53.678316 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ed8937f7-3c20-4ee0-aff9-4fe963db1b2e req-9bbafeca-5de0-43ff-ba77-a19a7bca45e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060324 Aug 04 14:06:53.680665 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1327/2646] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:53.690994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b8e4888a-9f8d-46c3-859e-d8f6c0e24623 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-264147501", "metadata": {"image_type": "test"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:53.693741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b8e4888a-9f8d-46c3-859e-d8f6c0e24623 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:53.709025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8e4888a-9f8d-46c3-859e-d8f6c0e24623 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:53.710164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8e4888a-9f8d-46c3-859e-d8f6c0e24623 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:53.713567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8e4888a-9f8d-46c3-859e-d8f6c0e24623 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:53.716061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8e4888a-9f8d-46c3-859e-d8f6c0e24623 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:53.766820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b8e4888a-9f8d-46c3-859e-d8f6c0e24623 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Getting quotas for project e82094948d794cdda8a53cbe6c013808. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:53.773537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b8e4888a-9f8d-46c3-859e-d8f6c0e24623 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Getting quotas for user 92de0c3f92744fac8c3a0f5e69b15bb2 and project e82094948d794cdda8a53cbe6c013808. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:53.808001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b986301b-4520-4364-b123-17f5aa134a81 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:53.820486 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b986301b-4520-4364-b123-17f5aa134a81 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1226 microversion: 2.1 time: 0.203620 Aug 04 14:06:53.823053 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1320/2647] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:53 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1226 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:53.830034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0f291418-dd22-4be2-9ea2-5217ce397ad9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:53.832698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0f291418-dd22-4be2-9ea2-5217ce397ad9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:53.848531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f291418-dd22-4be2-9ea2-5217ce397ad9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:53.849498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f291418-dd22-4be2-9ea2-5217ce397ad9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:53.853215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f291418-dd22-4be2-9ea2-5217ce397ad9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:53.854053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f291418-dd22-4be2-9ea2-5217ce397ad9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:54.058197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b8e4888a-9f8d-46c3-859e-d8f6c0e24623 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "POST /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63/action" status: 202 len: 0 microversion: 2.1 time: 0.376057 Aug 04 14:06:54.068280 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1328/2648] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:06:53 2022] POST /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:06:54.068280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-97630056-7752-4c73-a6b2-c0b29872e918 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Action: 'update_all', calling method: .version_select at 0x7f46f39f64c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:54.214545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-97630056-7752-4c73-a6b2-c0b29872e918 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:54.233322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-97630056-7752-4c73-a6b2-c0b29872e918 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for user 4337e8aa5c4a4957bc9d7e85e6152edb and project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:54.237725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0f291418-dd22-4be2-9ea2-5217ce397ad9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:54.268557 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0f291418-dd22-4be2-9ea2-5217ce397ad9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1321 microversion: 2.1 time: 0.443142 Aug 04 14:06:54.273030 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1321/2649] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:53 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:54.294056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1865828-c137-43aa-9e1a-c37e98269f10 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:54.299196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a1865828-c137-43aa-9e1a-c37e98269f10 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:54.323540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1865828-c137-43aa-9e1a-c37e98269f10 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:54.324371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1865828-c137-43aa-9e1a-c37e98269f10 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:54.325906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1865828-c137-43aa-9e1a-c37e98269f10 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:54.326723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1865828-c137-43aa-9e1a-c37e98269f10 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:54.528214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1865828-c137-43aa-9e1a-c37e98269f10 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:54.538085 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1865828-c137-43aa-9e1a-c37e98269f10 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1168 microversion: 2.1 time: 0.261529 Aug 04 14:06:54.553689 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1322/2650] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:54 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1168 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:54.560188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:54.561115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:54.568915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:54.569672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:54.570695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:54.571341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:54.746155 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-97630056-7752-4c73-a6b2-c0b29872e918 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 61 microversion: 2.1 time: 0.685560 Aug 04 14:06:54.751483 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1329/2651] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:06:54 2022] PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 61 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:54.760377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e286f3d-7334-4d13-92d2-91d1830a26d6 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f4700123e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:54.835087 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e286f3d-7334-4d13-92d2-91d1830a26d6 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.086322 Aug 04 14:06:54.836217 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1330/2652] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:06:54 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:54.842361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-9e6e5e13-0134-4f99-bdd9-d524edbd51ce req-47b1676a-06c0-479b-a1ab-d82cf4b4fb8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f46d95-33c2-4b11-9a77-ae7309334bae", "tag": "3f5ff6e8-1b46-421a-943e-da1edad90bba"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:54.858434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9e6e5e13-0134-4f99-bdd9-d524edbd51ce req-47b1676a-06c0-479b-a1ab-d82cf4b4fb8b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:54.859046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9e6e5e13-0134-4f99-bdd9-d524edbd51ce req-47b1676a-06c0-479b-a1ab-d82cf4b4fb8b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:54.884566 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-9e6e5e13-0134-4f99-bdd9-d524edbd51ce req-47b1676a-06c0-479b-a1ab-d82cf4b4fb8b service nova] Creating event network-changed:3f5ff6e8-1b46-421a-943e-da1edad90bba for instance 13f46d95-33c2-4b11-9a77-ae7309334bae on n-h1-844627-10 Aug 04 14:06:54.888129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:54.904273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:54.913307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:54.916781 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ec07ecc5-439b-4951-9980-87ed0d454942 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.361655 Aug 04 14:06:54.917133 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-9e6e5e13-0134-4f99-bdd9-d524edbd51ce req-47b1676a-06c0-479b-a1ab-d82cf4b4fb8b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077848 Aug 04 14:06:54.921173 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1331/2653] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:54.921939 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1323/2654] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:54 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:54.933694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a858be98-0042-4a93-9ff5-855867c35480 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:54.935131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a858be98-0042-4a93-9ff5-855867c35480 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:54.944823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e1b8078-74e9-47e8-9457-6b1398f59b7b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:54.946744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e1b8078-74e9-47e8-9457-6b1398f59b7b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:54.958088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e1b8078-74e9-47e8-9457-6b1398f59b7b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:54.958959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e1b8078-74e9-47e8-9457-6b1398f59b7b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:54.960297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e1b8078-74e9-47e8-9457-6b1398f59b7b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:54.961255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e1b8078-74e9-47e8-9457-6b1398f59b7b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:54.967324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a858be98-0042-4a93-9ff5-855867c35480 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:54.968134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a858be98-0042-4a93-9ff5-855867c35480 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:54.969454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a858be98-0042-4a93-9ff5-855867c35480 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:54.970166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a858be98-0042-4a93-9ff5-855867c35480 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:55.653303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3e1b8078-74e9-47e8-9457-6b1398f59b7b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:55.682557 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e1b8078-74e9-47e8-9457-6b1398f59b7b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1314 microversion: 2.1 time: 0.756985 Aug 04 14:06:55.685399 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1332/2655] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:54 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:55.695576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef85354a-ff16-4727-a060-b061435234c2 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Action: 'update', calling method: .version_select at 0x7f4700123550>, body: {"meta": {"os_version": "alt"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:55.757181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:55.789561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-ef85354a-ff16-4727-a060-b061435234c2 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:55.791836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a858be98-0042-4a93-9ff5-855867c35480 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:55.803005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-ef85354a-ff16-4727-a060-b061435234c2 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for user 4337e8aa5c4a4957bc9d7e85e6152edb and project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:55.804934 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a858be98-0042-4a93-9ff5-855867c35480 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1315 microversion: 2.1 time: 0.876553 Aug 04 14:06:55.806479 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1324/2656] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:54 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:55.835307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8d0aac9f-029e-43f4-940b-afec99c093e7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:55.836200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8d0aac9f-029e-43f4-940b-afec99c093e7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:55.853766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d0aac9f-029e-43f4-940b-afec99c093e7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:55.854502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d0aac9f-029e-43f4-940b-afec99c093e7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:55.855468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d0aac9f-029e-43f4-940b-afec99c093e7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:55.856078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d0aac9f-029e-43f4-940b-afec99c093e7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:56.000213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d0aac9f-029e-43f4-940b-afec99c093e7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:56.013548 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8d0aac9f-029e-43f4-940b-afec99c093e7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1292 microversion: 2.1 time: 0.182504 Aug 04 14:06:56.024899 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1325/2657] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:55 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1292 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:56.024899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1126a89a-a4ba-4806-b960-31f442df089c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:56.024899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1126a89a-a4ba-4806-b960-31f442df089c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:56.036201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1126a89a-a4ba-4806-b960-31f442df089c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:56.036201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1126a89a-a4ba-4806-b960-31f442df089c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:56.036201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1126a89a-a4ba-4806-b960-31f442df089c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:56.036201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1126a89a-a4ba-4806-b960-31f442df089c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:56.340945 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ef85354a-ff16-4727-a060-b061435234c2 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.653591 Aug 04 14:06:56.347753 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1333/2658] 10.222.0.66 () {60 vars in 1313 bytes} [Thu Aug 4 14:06:55 2022] PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata/os_version => generated 31 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:56.354039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9fd8c3e3-1b14-4184-87d0-00a8ed7e6a50 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:56.355519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9fd8c3e3-1b14-4184-87d0-00a8ed7e6a50 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:56.362659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fd8c3e3-1b14-4184-87d0-00a8ed7e6a50 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:56.363470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fd8c3e3-1b14-4184-87d0-00a8ed7e6a50 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:56.364440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fd8c3e3-1b14-4184-87d0-00a8ed7e6a50 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:56.365056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fd8c3e3-1b14-4184-87d0-00a8ed7e6a50 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:56.384684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:57.306281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1126a89a-a4ba-4806-b960-31f442df089c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:57.335270 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1126a89a-a4ba-4806-b960-31f442df089c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1502 microversion: 2.1 time: 1.318768 Aug 04 14:06:57.335658 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1326/2659] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:56 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1502 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:57.355504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c3e3fa8f-7815-4206-b6b6-4224fd2c8089 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f4702bed430>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:57.445404 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c3e3fa8f-7815-4206-b6b6-4224fd2c8089 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.107122 Aug 04 14:06:57.454347 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1327/2660] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:06:57 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:57.462293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:57.463206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:57.478158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:57.478930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:57.481180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:57.482452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:57.532223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9fd8c3e3-1b14-4184-87d0-00a8ed7e6a50 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:57.554364 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9fd8c3e3-1b14-4184-87d0-00a8ed7e6a50 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1210 microversion: 2.1 time: 1.204144 Aug 04 14:06:57.555761 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1334/2661] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:56 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1210 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:57.565363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-98f059a7-ce68-4a9a-846b-126588913c51 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Calling method '.version_select at 0x7f4700230700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:57.697482 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-98f059a7-ce68-4a9a-846b-126588913c51 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 58 microversion: 2.1 time: 0.138614 Aug 04 14:06:57.704084 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1335/2662] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 14:06:57 2022] GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 58 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:06:57.720806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1a4c749-4565-4e49-87da-1301b76de9dd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:57.722013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f1a4c749-4565-4e49-87da-1301b76de9dd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:57.747039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1a4c749-4565-4e49-87da-1301b76de9dd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:57.747842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1a4c749-4565-4e49-87da-1301b76de9dd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:57.749478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1a4c749-4565-4e49-87da-1301b76de9dd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:57.750125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1a4c749-4565-4e49-87da-1301b76de9dd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:57.947898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:57.985919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:57.988020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:57.990740 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-50ebdaef-0326-49d2-80db-36dabf8e600d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.534865 Aug 04 14:06:57.996358 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1328/2663] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:57 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:06:58.006492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d35cb7a-9b07-4332-be10-0700318ddf00 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:58.011650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d35cb7a-9b07-4332-be10-0700318ddf00 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:58.036739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d35cb7a-9b07-4332-be10-0700318ddf00 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:58.037718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d35cb7a-9b07-4332-be10-0700318ddf00 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:58.038822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d35cb7a-9b07-4332-be10-0700318ddf00 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:58.039469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d35cb7a-9b07-4332-be10-0700318ddf00 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:58.456927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f1a4c749-4565-4e49-87da-1301b76de9dd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:58.492179 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f1a4c749-4565-4e49-87da-1301b76de9dd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1314 microversion: 2.1 time: 0.786140 Aug 04 14:06:58.506161 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1336/2664] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:57 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:58.543371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e306c66-ee68-412a-9641-5fbad7bfd06c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:58.544606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2e306c66-ee68-412a-9641-5fbad7bfd06c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:58.580528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e306c66-ee68-412a-9641-5fbad7bfd06c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:58.582649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d35cb7a-9b07-4332-be10-0700318ddf00 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:58.586266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e306c66-ee68-412a-9641-5fbad7bfd06c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:58.590535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e306c66-ee68-412a-9641-5fbad7bfd06c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:58.592440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e306c66-ee68-412a-9641-5fbad7bfd06c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:58.598577 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d35cb7a-9b07-4332-be10-0700318ddf00 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1315 microversion: 2.1 time: 0.598980 Aug 04 14:06:58.601721 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1329/2665] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:57 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:58.612935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f42646df-3fad-4eb7-9837-3b6a06dd750e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:58.615770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f42646df-3fad-4eb7-9837-3b6a06dd750e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:58.633227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f42646df-3fad-4eb7-9837-3b6a06dd750e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:58.634075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f42646df-3fad-4eb7-9837-3b6a06dd750e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:58.639762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f42646df-3fad-4eb7-9837-3b6a06dd750e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:58.640321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f42646df-3fad-4eb7-9837-3b6a06dd750e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:59.313834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f42646df-3fad-4eb7-9837-3b6a06dd750e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:59.326728 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f42646df-3fad-4eb7-9837-3b6a06dd750e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1502 microversion: 2.1 time: 0.724338 Aug 04 14:06:59.330357 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1330/2666] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:58 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1502 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:59.342395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b1c0a96-8279-4bcc-9430-1413ece4903e tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Action: 'update_all', calling method: .version_select at 0x7f47002f1310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:59.355417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2e306c66-ee68-412a-9641-5fbad7bfd06c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:59.373129 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2e306c66-ee68-412a-9641-5fbad7bfd06c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1322 microversion: 2.1 time: 0.856876 Aug 04 14:06:59.374003 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1337/2667] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:58 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1322 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:59.393902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b737de6c-4830-49ce-8008-d5abc0e8b703 req-806744cd-8dcd-464a-9fb2-ffd18a7efe2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac42befe-28d2-4af7-b56e-2cc6ea8034b6", "tag": "0cfa44ed-b0f3-4dcf-ae2a-f6e895e9db5d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:06:59.417631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b737de6c-4830-49ce-8008-d5abc0e8b703 req-806744cd-8dcd-464a-9fb2-ffd18a7efe2f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:59.420127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b737de6c-4830-49ce-8008-d5abc0e8b703 req-806744cd-8dcd-464a-9fb2-ffd18a7efe2f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:59.442383 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b737de6c-4830-49ce-8008-d5abc0e8b703 req-806744cd-8dcd-464a-9fb2-ffd18a7efe2f service nova] Creating event network-changed:0cfa44ed-b0f3-4dcf-ae2a-f6e895e9db5d for instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 on n-h2-844627-10 Aug 04 14:06:59.452962 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b737de6c-4830-49ce-8008-d5abc0e8b703 req-806744cd-8dcd-464a-9fb2-ffd18a7efe2f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061812 Aug 04 14:06:59.453792 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1338/2668] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:06:59.463363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-21861c6d-5c8f-4435-b591-15aab66f5d01 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f470019d550>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:59.483062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-1b1c0a96-8279-4bcc-9430-1413ece4903e tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:06:59.513586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-1b1c0a96-8279-4bcc-9430-1413ece4903e tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for user 4337e8aa5c4a4957bc9d7e85e6152edb and project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:06:59.551969 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-21861c6d-5c8f-4435-b591-15aab66f5d01 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.095340 Aug 04 14:06:59.556046 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1339/2669] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:06:59 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:59.566553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5b22040f-8b2d-43c0-9fe4-2dc87e7cdb1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:59.568505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b22040f-8b2d-43c0-9fe4-2dc87e7cdb1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:59.577957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:06:59.581101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b22040f-8b2d-43c0-9fe4-2dc87e7cdb1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:59.582847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b22040f-8b2d-43c0-9fe4-2dc87e7cdb1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:59.583939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b22040f-8b2d-43c0-9fe4-2dc87e7cdb1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:59.585155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b22040f-8b2d-43c0-9fe4-2dc87e7cdb1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:06:59.915491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5b22040f-8b2d-43c0-9fe4-2dc87e7cdb1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:06:59.930578 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5b22040f-8b2d-43c0-9fe4-2dc87e7cdb1f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1210 microversion: 2.1 time: 0.372470 Aug 04 14:06:59.939436 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1340/2670] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:06:59 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1210 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:06:59.950122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:06:59.964853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:06:59.993420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:06:59.999343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.003053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:00.005795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.119090 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1b1c0a96-8279-4bcc-9430-1413ece4903e tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 61 microversion: 2.1 time: 0.786890 Aug 04 14:07:00.120336 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1331/2671] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:06:59 2022] PUT /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 61 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:07:00.127738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-4a6dff96-d77f-405a-b049-03eda409fc95 req-854209ff-efce-4e2d-94c1-8868472501fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90627287-7390-448b-bc44-878c72306f4e", "tag": "c115a33c-f9fb-4d11-b284-d04b79cb1a39"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:00.139817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4a6dff96-d77f-405a-b049-03eda409fc95 req-854209ff-efce-4e2d-94c1-8868472501fa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:00.141405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4a6dff96-d77f-405a-b049-03eda409fc95 req-854209ff-efce-4e2d-94c1-8868472501fa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.156059 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-4a6dff96-d77f-405a-b049-03eda409fc95 req-854209ff-efce-4e2d-94c1-8868472501fa service nova] Creating event network-changed:c115a33c-f9fb-4d11-b284-d04b79cb1a39 for instance 90627287-7390-448b-bc44-878c72306f4e on n-h2-844627-10 Aug 04 14:07:00.166738 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-4a6dff96-d77f-405a-b049-03eda409fc95 req-854209ff-efce-4e2d-94c1-8868472501fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044703 Aug 04 14:07:00.168070 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1332/2672] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:00.177625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e28cac1d-08a5-41b5-88e9-e73e71685cde tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:00.178379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e28cac1d-08a5-41b5-88e9-e73e71685cde tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:00.186858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e28cac1d-08a5-41b5-88e9-e73e71685cde tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:00.187713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e28cac1d-08a5-41b5-88e9-e73e71685cde tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.188975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e28cac1d-08a5-41b5-88e9-e73e71685cde tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:00.189663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e28cac1d-08a5-41b5-88e9-e73e71685cde tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.236692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e28cac1d-08a5-41b5-88e9-e73e71685cde tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:07:00.367835 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e28cac1d-08a5-41b5-88e9-e73e71685cde tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 204 len: 0 microversion: 2.1 time: 0.194247 Aug 04 14:07:00.373158 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1333/2673] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:07:00 2022] DELETE /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:07:00.373992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:00.382695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c8c03d5e-be33-42d4-a7f7-11f5b5083de2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:00.384107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c8c03d5e-be33-42d4-a7f7-11f5b5083de2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:00.395426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8c03d5e-be33-42d4-a7f7-11f5b5083de2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:00.396484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8c03d5e-be33-42d4-a7f7-11f5b5083de2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.397810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8c03d5e-be33-42d4-a7f7-11f5b5083de2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:00.398644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8c03d5e-be33-42d4-a7f7-11f5b5083de2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.406962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:00.421484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:00.430796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:00.447535 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae699c46-cb71-4e10-bcb6-7335d1c9fc21 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.505455 Aug 04 14:07:00.448903 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1341/2674] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:06:59 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:00.467222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-83213f69-fd0c-4815-9164-188f22d40ada req-8df3cb1c-8e97-4974-a895-fb78a6ea1e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da969e0f-87c4-4c9d-bef7-b74fb0837616", "name": "network-vif-plugged", "status": "completed", "tag": "103e4629-b7e2-457f-94ee-b0630fd8b783"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:00.482550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-83213f69-fd0c-4815-9164-188f22d40ada req-8df3cb1c-8e97-4974-a895-fb78a6ea1e0e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:00.486248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-83213f69-fd0c-4815-9164-188f22d40ada req-8df3cb1c-8e97-4974-a895-fb78a6ea1e0e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.539386 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-83213f69-fd0c-4815-9164-188f22d40ada req-8df3cb1c-8e97-4974-a895-fb78a6ea1e0e service nova] Creating event network-vif-plugged:103e4629-b7e2-457f-94ee-b0630fd8b783 for instance da969e0f-87c4-4c9d-bef7-b74fb0837616 on n-h2-844627-10 Aug 04 14:07:00.552385 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-83213f69-fd0c-4815-9164-188f22d40ada req-8df3cb1c-8e97-4974-a895-fb78a6ea1e0e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101199 Aug 04 14:07:00.556825 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1342/2675] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:00.579345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e5f7e24b-046c-40a5-a89e-da98ca21bf28 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:00.585287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e5f7e24b-046c-40a5-a89e-da98ca21bf28 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:00.601472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5f7e24b-046c-40a5-a89e-da98ca21bf28 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:00.602574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5f7e24b-046c-40a5-a89e-da98ca21bf28 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.603660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5f7e24b-046c-40a5-a89e-da98ca21bf28 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:00.604426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5f7e24b-046c-40a5-a89e-da98ca21bf28 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:00.911164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c8c03d5e-be33-42d4-a7f7-11f5b5083de2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:00.922689 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c8c03d5e-be33-42d4-a7f7-11f5b5083de2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1314 microversion: 2.1 time: 0.546213 Aug 04 14:07:00.931313 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1334/2676] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:00 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:00.943307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c526be4-08af-42f1-82b7-a03dc9ccb86a tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Action: 'create', calling method: .version_select at 0x7f470027a3a0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:01.056263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e5f7e24b-046c-40a5-a89e-da98ca21bf28 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:01.087867 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e5f7e24b-046c-40a5-a89e-da98ca21bf28 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1315 microversion: 2.1 time: 0.529178 Aug 04 14:07:01.094731 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1343/2677] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:00 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:01.112719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ee449a16-305c-4819-b5b4-c68ac42f1388 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:01.115587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9c526be4-08af-42f1-82b7-a03dc9ccb86a tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:01.121140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ee449a16-305c-4819-b5b4-c68ac42f1388 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:01.141467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee449a16-305c-4819-b5b4-c68ac42f1388 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:01.142697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee449a16-305c-4819-b5b4-c68ac42f1388 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:01.143639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9c526be4-08af-42f1-82b7-a03dc9ccb86a tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Getting quotas for user 4337e8aa5c4a4957bc9d7e85e6152edb and project b6eec96fe3a84c4999f8f1713bd80338. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:01.144388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee449a16-305c-4819-b5b4-c68ac42f1388 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:01.145728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee449a16-305c-4819-b5b4-c68ac42f1388 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:01.856460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ee449a16-305c-4819-b5b4-c68ac42f1388 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:01.871205 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ee449a16-305c-4819-b5b4-c68ac42f1388 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1508 microversion: 2.1 time: 0.774553 Aug 04 14:07:01.871828 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1344/2678] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:01 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1508 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:01.882460 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c526be4-08af-42f1-82b7-a03dc9ccb86a tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "POST /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 85 microversion: 2.1 time: 0.949665 Aug 04 14:07:01.883795 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1335/2679] 10.222.0.66 () {60 vars in 1281 bytes} [Thu Aug 4 14:07:00 2022] POST /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 85 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:07:01.889233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd788e41-90ac-4a12-af06-6337eafbdf22 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3bf6ca0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:01.892563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-88f1e9ae-380f-451a-ae79-85366bf7c6e9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:01.909779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-88f1e9ae-380f-451a-ae79-85366bf7c6e9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:01.926651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88f1e9ae-380f-451a-ae79-85366bf7c6e9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:01.930062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88f1e9ae-380f-451a-ae79-85366bf7c6e9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:01.931144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88f1e9ae-380f-451a-ae79-85366bf7c6e9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:01.931758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88f1e9ae-380f-451a-ae79-85366bf7c6e9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:02.009396 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd788e41-90ac-4a12-af06-6337eafbdf22 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.120539 Aug 04 14:07:02.010791 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1336/2680] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:01 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:02.025455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bf92293-d1cb-4d91-a5d3-3afe018c5b47 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:02.026577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4bf92293-d1cb-4d91-a5d3-3afe018c5b47 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:02.043158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bf92293-d1cb-4d91-a5d3-3afe018c5b47 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:02.043991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bf92293-d1cb-4d91-a5d3-3afe018c5b47 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:02.045066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bf92293-d1cb-4d91-a5d3-3afe018c5b47 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:02.046832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bf92293-d1cb-4d91-a5d3-3afe018c5b47 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:02.144384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:03.065048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4bf92293-d1cb-4d91-a5d3-3afe018c5b47 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:03.081959 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4bf92293-d1cb-4d91-a5d3-3afe018c5b47 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1210 microversion: 2.1 time: 1.067236 Aug 04 14:07:03.084893 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1337/2681] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:02 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1210 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:03.090188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:03.096100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:03.114226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:03.116419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:03.118142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:03.121087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:03.260749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-88f1e9ae-380f-451a-ae79-85366bf7c6e9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:03.275574 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-88f1e9ae-380f-451a-ae79-85366bf7c6e9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1322 microversion: 2.1 time: 1.398669 Aug 04 14:07:03.276800 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1345/2682] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:01 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1322 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:03.282145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9afd2584-f488-419c-9dfd-f6b5738eb242 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] Calling method '.version_select at 0x7f470051f820>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:03.329840 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9afd2584-f488-419c-9dfd-f6b5738eb242 tempest-ImagesMetadataTestJSON-1996149387 tempest-ImagesMetadataTestJSON-1996149387-project] 10.222.0.66 "GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata" status: 200 len: 85 microversion: 2.1 time: 0.051232 Aug 04 14:07:03.331106 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1346/2683] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 14:07:03 2022] GET /compute/v2.1/images/e674cc90-4a66-4db0-9af5-6364f1aed542/metadata => generated 85 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:07:03.344793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1bc80388-7e09-4d82-a419-c2a522ea4ff6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:03.357347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1bc80388-7e09-4d82-a419-c2a522ea4ff6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:03.376251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bc80388-7e09-4d82-a419-c2a522ea4ff6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:03.377447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bc80388-7e09-4d82-a419-c2a522ea4ff6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:03.381433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bc80388-7e09-4d82-a419-c2a522ea4ff6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:03.383066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bc80388-7e09-4d82-a419-c2a522ea4ff6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:03.465624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:03.479377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:03.486134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:03.491616 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b5a6874e-e6c2-4b9f-b169-3b358617a145 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.403643 Aug 04 14:07:03.495438 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1338/2684] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:03 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:03.536612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a37cd409-77e6-4d20-b158-3952d1f123d2 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:03.540331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a37cd409-77e6-4d20-b158-3952d1f123d2 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:03.569015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a37cd409-77e6-4d20-b158-3952d1f123d2 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:03.570284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a37cd409-77e6-4d20-b158-3952d1f123d2 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:03.573215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a37cd409-77e6-4d20-b158-3952d1f123d2 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:03.574543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a37cd409-77e6-4d20-b158-3952d1f123d2 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:04.206308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a37cd409-77e6-4d20-b158-3952d1f123d2 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:04.218263 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a37cd409-77e6-4d20-b158-3952d1f123d2 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1315 microversion: 2.1 time: 0.720491 Aug 04 14:07:04.221774 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1339/2685] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:03 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:04.241012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-75fb4f25-f7b1-4aae-9a08-ac448ed0f95e req-d2fc5b76-8d99-4ef5-aaea-03e6421bc20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a40a39-cbe8-47bc-8869-a88e59989f63", "name": "network-vif-plugged", "status": "completed", "tag": "19e85bce-c14d-4d20-89ef-01de05cf0ac7"}, {"server_uuid": "9dedb436-cd86-49c7-9a23-933ab3829812", "name": "network-vif-plugged", "status": "completed", "tag": "1a49ef80-c7b3-44c3-9e9b-4da1681e2afc"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:04.264777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-75fb4f25-f7b1-4aae-9a08-ac448ed0f95e req-d2fc5b76-8d99-4ef5-aaea-03e6421bc20c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:04.270936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-75fb4f25-f7b1-4aae-9a08-ac448ed0f95e req-d2fc5b76-8d99-4ef5-aaea-03e6421bc20c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:04.300711 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-75fb4f25-f7b1-4aae-9a08-ac448ed0f95e req-d2fc5b76-8d99-4ef5-aaea-03e6421bc20c service nova] Creating event network-vif-plugged:19e85bce-c14d-4d20-89ef-01de05cf0ac7 for instance c8a40a39-cbe8-47bc-8869-a88e59989f63 on n-h2-844627-10 Aug 04 14:07:04.302179 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-75fb4f25-f7b1-4aae-9a08-ac448ed0f95e req-d2fc5b76-8d99-4ef5-aaea-03e6421bc20c service nova] Creating event network-vif-plugged:1a49ef80-c7b3-44c3-9e9b-4da1681e2afc for instance 9dedb436-cd86-49c7-9a23-933ab3829812 on n-h1-844627-10 Aug 04 14:07:04.324231 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-75fb4f25-f7b1-4aae-9a08-ac448ed0f95e req-d2fc5b76-8d99-4ef5-aaea-03e6421bc20c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099371 Aug 04 14:07:04.325537 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1340/2686] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:04.342677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5485428-c316-4bb8-a547-ca43f7889370 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:04.344759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5485428-c316-4bb8-a547-ca43f7889370 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:04.376517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5485428-c316-4bb8-a547-ca43f7889370 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:04.383796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1bc80388-7e09-4d82-a419-c2a522ea4ff6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:04.387598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5485428-c316-4bb8-a547-ca43f7889370 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:04.391223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5485428-c316-4bb8-a547-ca43f7889370 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:04.396325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5485428-c316-4bb8-a547-ca43f7889370 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:04.400825 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1bc80388-7e09-4d82-a419-c2a522ea4ff6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1314 microversion: 2.1 time: 1.068276 Aug 04 14:07:04.407265 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1347/2687] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:03 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1314 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:04.428288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8456652f-03fa-41d4-9be8-d0f4a0fb8ade tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3769f70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:04.528578 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8456652f-03fa-41d4-9be8-d0f4a0fb8ade tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.119905 Aug 04 14:07:04.533771 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1348/2688] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:04 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:04.569790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-85321fc1-623a-4b7e-a20f-c8f4d77d3469 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:04.572279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-85321fc1-623a-4b7e-a20f-c8f4d77d3469 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:04.592355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85321fc1-623a-4b7e-a20f-c8f4d77d3469 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:04.594570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85321fc1-623a-4b7e-a20f-c8f4d77d3469 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:04.598245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85321fc1-623a-4b7e-a20f-c8f4d77d3469 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:04.601097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85321fc1-623a-4b7e-a20f-c8f4d77d3469 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:05.403889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5485428-c316-4bb8-a547-ca43f7889370 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:05.425513 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5485428-c316-4bb8-a547-ca43f7889370 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1508 microversion: 2.1 time: 1.098023 Aug 04 14:07:05.426553 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1341/2689] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:04 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1508 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:05.462291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7fea390-33e6-4667-8e06-744841ebd92c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:05.463145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7fea390-33e6-4667-8e06-744841ebd92c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:05.485518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fea390-33e6-4667-8e06-744841ebd92c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:05.486134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fea390-33e6-4667-8e06-744841ebd92c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:05.487083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fea390-33e6-4667-8e06-744841ebd92c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:05.487640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fea390-33e6-4667-8e06-744841ebd92c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:05.524849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-85321fc1-623a-4b7e-a20f-c8f4d77d3469 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:05.582876 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-85321fc1-623a-4b7e-a20f-c8f4d77d3469 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1198 microversion: 2.1 time: 1.037300 Aug 04 14:07:05.585257 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1349/2690] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:04 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1198 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:05.596200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:05.598076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:05.617382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:05.618340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:05.619791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:05.621833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:05.837106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=34 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:05.972597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:06.002190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:06.003868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:06.006087 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12bf0c6e-d862-484f-beeb-aa4a18b7e0d9 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.419039 Aug 04 14:07:06.020903 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1350/2691] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:05 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:06.020903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e55dddd-1740-4cf8-b046-448562f808ae tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:06.020903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e55dddd-1740-4cf8-b046-448562f808ae tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:06.024964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e55dddd-1740-4cf8-b046-448562f808ae tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:06.027041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e55dddd-1740-4cf8-b046-448562f808ae tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:06.027041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e55dddd-1740-4cf8-b046-448562f808ae tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:06.027041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e55dddd-1740-4cf8-b046-448562f808ae tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:06.150710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f7fea390-33e6-4667-8e06-744841ebd92c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:06.162809 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7fea390-33e6-4667-8e06-744841ebd92c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1322 microversion: 2.1 time: 0.723178 Aug 04 14:07:06.169372 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1342/2692] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:05 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1322 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:06.188699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2161622e-6a7b-4ce8-835c-64018bbb3801 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:06.192509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2161622e-6a7b-4ce8-835c-64018bbb3801 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:06.220330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2161622e-6a7b-4ce8-835c-64018bbb3801 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:06.227779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2161622e-6a7b-4ce8-835c-64018bbb3801 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:06.229736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2161622e-6a7b-4ce8-835c-64018bbb3801 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:06.232126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2161622e-6a7b-4ce8-835c-64018bbb3801 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:06.773076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5e55dddd-1740-4cf8-b046-448562f808ae tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:06.792754 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e55dddd-1740-4cf8-b046-448562f808ae tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1315 microversion: 2.1 time: 0.776640 Aug 04 14:07:06.796362 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1351/2693] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:06 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:06.809077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a276fd6a-84c3-4b1f-9f39-6aa448644412 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3771940>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:06.955941 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a276fd6a-84c3-4b1f-9f39-6aa448644412 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.158165 Aug 04 14:07:06.956846 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1352/2694] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:06 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:06.973195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2161622e-6a7b-4ce8-835c-64018bbb3801 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:06.983224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-95ca4f19-45d4-4402-a4a9-03854780da79 req-dfc2ee9c-1246-44ab-ac62-2011d3b25c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f46d95-33c2-4b11-9a77-ae7309334bae", "name": "network-vif-plugged", "status": "completed", "tag": "3f5ff6e8-1b46-421a-943e-da1edad90bba"}, {"server_uuid": "ac42befe-28d2-4af7-b56e-2cc6ea8034b6", "name": "network-vif-plugged", "status": "completed", "tag": "0cfa44ed-b0f3-4dcf-ae2a-f6e895e9db5d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:06.987676 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2161622e-6a7b-4ce8-835c-64018bbb3801 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1314 microversion: 2.1 time: 0.816389 Aug 04 14:07:06.993046 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1343/2695] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:06 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:07.004954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-95ca4f19-45d4-4402-a4a9-03854780da79 req-dfc2ee9c-1246-44ab-ac62-2011d3b25c0a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.010173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:07.011130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:07.017559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-95ca4f19-45d4-4402-a4a9-03854780da79 req-dfc2ee9c-1246-44ab-ac62-2011d3b25c0a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.020611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.025694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.026406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.026857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.056917 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-95ca4f19-45d4-4402-a4a9-03854780da79 req-dfc2ee9c-1246-44ab-ac62-2011d3b25c0a service nova] Creating event network-vif-plugged:3f5ff6e8-1b46-421a-943e-da1edad90bba for instance 13f46d95-33c2-4b11-9a77-ae7309334bae on n-h1-844627-10 Aug 04 14:07:07.057507 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-95ca4f19-45d4-4402-a4a9-03854780da79 req-dfc2ee9c-1246-44ab-ac62-2011d3b25c0a service nova] Creating event network-vif-plugged:0cfa44ed-b0f3-4dcf-ae2a-f6e895e9db5d for instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 on n-h2-844627-10 Aug 04 14:07:07.077189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-95ca4f19-45d4-4402-a4a9-03854780da79 req-dfc2ee9c-1246-44ab-ac62-2011d3b25c0a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.118306 Aug 04 14:07:07.081863 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1353/2696] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:07.092275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-23073e63-268c-4e79-af47-fb5b22154575 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:07.093271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-23073e63-268c-4e79-af47-fb5b22154575 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:07.116685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23073e63-268c-4e79-af47-fb5b22154575 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.117187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23073e63-268c-4e79-af47-fb5b22154575 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.117998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23073e63-268c-4e79-af47-fb5b22154575 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.118843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23073e63-268c-4e79-af47-fb5b22154575 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.123137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.124049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.124049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lazy-loading 'fault' on Instance uuid c9e14548-2895-42eb-b864-6d943135680d {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:07:07.302420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:07.316965 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-510e2bdf-ceba-4f73-a6aa-a69f48dc59d3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 200 len: 1311 microversion: 2.1 time: 0.321332 Aug 04 14:07:07.318589 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1344/2697] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:06 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 1311 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:07.351985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f493ad59-79d8-4c05-bdeb-7a7328e8750c req-ce44fb8d-2ba8-4fe0-bfd8-0a09a2aa1338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e14548-2895-42eb-b864-6d943135680d", "name": "network-vif-deleted", "tag": "ba96428b-3ea5-459b-b489-1e7935fc39e1"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:07.383459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f493ad59-79d8-4c05-bdeb-7a7328e8750c req-ce44fb8d-2ba8-4fe0-bfd8-0a09a2aa1338 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.384832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f493ad59-79d8-4c05-bdeb-7a7328e8750c req-ce44fb8d-2ba8-4fe0-bfd8-0a09a2aa1338 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.418295 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f493ad59-79d8-4c05-bdeb-7a7328e8750c req-ce44fb8d-2ba8-4fe0-bfd8-0a09a2aa1338 service nova] Creating event network-vif-deleted:ba96428b-3ea5-459b-b489-1e7935fc39e1 for instance c9e14548-2895-42eb-b864-6d943135680d on n-h2-844627-10 Aug 04 14:07:07.431777 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f493ad59-79d8-4c05-bdeb-7a7328e8750c req-ce44fb8d-2ba8-4fe0-bfd8-0a09a2aa1338 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109607 Aug 04 14:07:07.433195 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1345/2698] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:07.462427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:07.463340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:07.494284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.494661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.495479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.495921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.915374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:07.929177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:07.933397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:07.934688 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff127d5d-c3c9-41ca-8052-d5061fe5c174 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.500081 Aug 04 14:07:07.936570 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1346/2699] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:07 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:07.945216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2859da8-7871-4a02-b367-a0a4009bd77f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:07.946768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d2859da8-7871-4a02-b367-a0a4009bd77f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:07.958607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2859da8-7871-4a02-b367-a0a4009bd77f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.960505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2859da8-7871-4a02-b367-a0a4009bd77f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:07.962240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2859da8-7871-4a02-b367-a0a4009bd77f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:07.963049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2859da8-7871-4a02-b367-a0a4009bd77f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:08.168072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-23073e63-268c-4e79-af47-fb5b22154575 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:08.181355 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-23073e63-268c-4e79-af47-fb5b22154575 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1198 microversion: 2.1 time: 1.097502 Aug 04 14:07:08.181956 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1354/2700] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:07 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1198 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:08.328334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d2859da8-7871-4a02-b367-a0a4009bd77f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:08.350638 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2859da8-7871-4a02-b367-a0a4009bd77f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1322 microversion: 2.1 time: 0.410723 Aug 04 14:07:08.352823 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1347/2701] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:07 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:08.362390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6a806ef5-d22f-4e3e-b4cd-298aff6824af tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:08.366142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6a806ef5-d22f-4e3e-b4cd-298aff6824af tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:08.379938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a806ef5-d22f-4e3e-b4cd-298aff6824af tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:08.385116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a806ef5-d22f-4e3e-b4cd-298aff6824af tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:08.387298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a806ef5-d22f-4e3e-b4cd-298aff6824af tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:08.387897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a806ef5-d22f-4e3e-b4cd-298aff6824af tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:08.514107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90b1d4a2-0167-46a8-81ff-a3d9d763304b tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Calling method '.version_select at 0x7f4700229ee0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:08.562050 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-90b1d4a2-0167-46a8-81ff-a3d9d763304b tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] HTTP exception thrown: Image not found. Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90b1d4a2-0167-46a8-81ff-a3d9d763304b tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Request method failure captured: Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/images/06f14bd6-8ff7-4684-af5e-0ab50855cfe8/metadata/os_distro HTTP/1.1 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69KLK6dk1XJLr1K1n5nookngtuUvtDyqAZeV9Io9jt2wrPBq7OOeGgu5VBFTvx1jARcX5tUs-mqd4-u27W6dShIUOpFLzzvMY3jUMXEE-9uIZOPnvqSQO7XlVa3llvodINeVXsD6McvigiYgLR7M8H9tUcxaiA0LU2v4CVFjNwKWkk8 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}] Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8f89d257bdea4407814ab76620ba9f60 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'image_id': '06f14bd6-8ff7-4684-af5e-0ab50855cfe8', 'id': 'os_distro'} Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 06f14bd6-8ff7-4684-af5e-0ab50855cfe8 Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 14:07:08.568793 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06f14bd6-8ff7-4684-af5e-0ab50855cfe8 could not be found. Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90b1d4a2-0167-46a8-81ff-a3d9d763304b tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90b1d4a2-0167-46a8-81ff-a3d9d763304b tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] 10.222.0.66 "DELETE /compute/v2.1/images/06f14bd6-8ff7-4684-af5e-0ab50855cfe8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.370857 Aug 04 14:07:08.582812 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1355/2702] 10.222.0.66 () {58 vars in 1293 bytes} [Thu Aug 4 14:07:08 2022] DELETE /compute/v2.1/images/06f14bd6-8ff7-4684-af5e-0ab50855cfe8/metadata/os_distro => generated 62 bytes in 374 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:07:08.595713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-27de6aba-0dc7-4641-9e32-e6f252fb8468 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f37780d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:08.677994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6a806ef5-d22f-4e3e-b4cd-298aff6824af tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:08.693111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6a806ef5-d22f-4e3e-b4cd-298aff6824af tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1315 microversion: 2.1 time: 0.337793 Aug 04 14:07:08.695160 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1348/2703] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:08 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:08.696825 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-27de6aba-0dc7-4641-9e32-e6f252fb8468 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.120137 Aug 04 14:07:08.711071 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1356/2704] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:08 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:08.714027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:08.715776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:08.720295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c04d7da4-6308-4a26-a1ec-6c25e9384e99 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:08.721511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c04d7da4-6308-4a26-a1ec-6c25e9384e99 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:08.725181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:08.726008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:08.727976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:08.729595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:08.733299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c04d7da4-6308-4a26-a1ec-6c25e9384e99 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:08.733776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c04d7da4-6308-4a26-a1ec-6c25e9384e99 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:08.735370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c04d7da4-6308-4a26-a1ec-6c25e9384e99 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:08.736172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c04d7da4-6308-4a26-a1ec-6c25e9384e99 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:08.761411 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d HTTP/1.1 Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'c9e14548-2895-42eb-b864-6d943135680d'} Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:08.765509 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.774410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.774410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:08.774410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:08.774410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:08.774410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:08.774410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:07:08.774410 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.777801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:08.779738 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4b2daeb-8fde-4cb7-880f-f4285ac18243 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 404 len: 111 microversion: 2.1 time: 0.079088 Aug 04 14:07:08.792632 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1357/2705] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:08 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:08.792632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f301a9e2-ef0e-4601-8a49-2553d875e6ce tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Calling method '.version_select at 0x7f46f3a0d1f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:08.826313 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f301a9e2-ef0e-4601-8a49-2553d875e6ce tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] HTTP exception thrown: Image not found. Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f301a9e2-ef0e-4601-8a49-2553d875e6ce tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Request method failure captured: Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/images/74a354fa-3e13-4b7f-bb88-62159a61cf0c/metadata/os_version HTTP/1.1 Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69KLK6dk1XJLr1K1n5nookngtuUvtDyqAZeV9Io9jt2wrPBq7OOeGgu5VBFTvx1jARcX5tUs-mqd4-u27W6dShIUOpFLzzvMY3jUMXEE-9uIZOPnvqSQO7XlVa3llvodINeVXsD6McvigiYgLR7M8H9tUcxaiA0LU2v4CVFjNwKWkk8 Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}] Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8f89d257bdea4407814ab76620ba9f60 Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'image_id': '74a354fa-3e13-4b7f-bb88-62159a61cf0c', 'id': 'os_version'} Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 74a354fa-3e13-4b7f-bb88-62159a61cf0c Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 14:07:08.831091 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 74a354fa-3e13-4b7f-bb88-62159a61cf0c could not be found. Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f301a9e2-ef0e-4601-8a49-2553d875e6ce tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f301a9e2-ef0e-4601-8a49-2553d875e6ce tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] 10.222.0.66 "GET /compute/v2.1/images/74a354fa-3e13-4b7f-bb88-62159a61cf0c/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.051586 Aug 04 14:07:08.843319 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1358/2706] 10.222.0.66 () {58 vars in 1293 bytes} [Thu Aug 4 14:07:08 2022] GET /compute/v2.1/images/74a354fa-3e13-4b7f-bb88-62159a61cf0c/metadata/os_version => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:07:08.854930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4eecb269-c368-413a-89c8-f0b70ae67a7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'create', calling method: .version_select at 0x7f46f3a0d430>, body: {"keypair": {"name": "tempest-key-991750562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7/qsPfQHci5OfgzSnQOaKI7aN5bSZpEj5xMT3B1AUS+671izYq1D8JLnGRq+79UzY5HUR9Lfg45RqX0dEQAUr0WFwmBH43S+b+qpzuhmPcFRA/Kd8nHc9U7aU1JwbPHQ=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:08.882503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4eecb269-c368-413a-89c8-f0b70ae67a7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for project 254dc59176414ac48f6827f95ffc907f. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:08.892991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4eecb269-c368-413a-89c8-f0b70ae67a7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for user df576732ca5c442694d507fd4dc58279 and project 254dc59176414ac48f6827f95ffc907f. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:08.944841 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4eecb269-c368-413a-89c8-f0b70ae67a7e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.106716 Aug 04 14:07:08.945948 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1359/2707] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:07:08 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:08.951717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a18ea56d-d710-4405-b675-e545577295c5 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Calling method '.version_select at 0x7f46f37715e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:09.004623 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a18ea56d-d710-4405-b675-e545577295c5 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] HTTP exception thrown: Image not found. Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a18ea56d-d710-4405-b675-e545577295c5 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Request method failure captured: Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/images/dbeb6f14-26b2-48f9-87db-a68eac98eda1/metadata HTTP/1.1 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69KLK6dk1XJLr1K1n5nookngtuUvtDyqAZeV9Io9jt2wrPBq7OOeGgu5VBFTvx1jARcX5tUs-mqd4-u27W6dShIUOpFLzzvMY3jUMXEE-9uIZOPnvqSQO7XlVa3llvodINeVXsD6McvigiYgLR7M8H9tUcxaiA0LU2v4CVFjNwKWkk8 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}] Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 8f89d257bdea4407814ab76620ba9f60 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'image_id': 'dbeb6f14-26b2-48f9-87db-a68eac98eda1'} Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dbeb6f14-26b2-48f9-87db-a68eac98eda1 Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 14:07:09.007335 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dbeb6f14-26b2-48f9-87db-a68eac98eda1 could not be found. Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a18ea56d-d710-4405-b675-e545577295c5 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a18ea56d-d710-4405-b675-e545577295c5 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] 10.222.0.66 "GET /compute/v2.1/images/dbeb6f14-26b2-48f9-87db-a68eac98eda1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.063528 Aug 04 14:07:09.019305 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1360/2708] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 14:07:08 2022] GET /compute/v2.1/images/dbeb6f14-26b2-48f9-87db-a68eac98eda1/metadata => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:07:09.034290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fab132d1-6d9e-40bf-93da-82fdc3b73ffb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '.version_select at 0x7f46f3743310>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:09.038701 n-d-844627-10 devstack@n-api.service[130961]: WARNING oslo_db.sqlalchemy.utils [None req-fab132d1-6d9e-40bf-93da-82fdc3b73ffb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 14:07:09.045903 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fab132d1-6d9e-40bf-93da-82fdc3b73ffb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.033541 Aug 04 14:07:09.060905 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1361/2709] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:07:09 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:09.060905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:09.060905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:09.063055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:09.063823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:09.065093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:09.065794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:09.118568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c04d7da4-6308-4a26-a1ec-6c25e9384e99 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:09.142909 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c04d7da4-6308-4a26-a1ec-6c25e9384e99 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1500 microversion: 2.1 time: 0.445030 Aug 04 14:07:09.143680 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1349/2710] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:08 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1500 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:09.165956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-643e7ec5-e801-45b1-83c4-5dcc6ce44838 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Action: 'update_all', calling method: .version_select at 0x7f470027a160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:09.224835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:09.228644 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-643e7ec5-e801-45b1-83c4-5dcc6ce44838 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] HTTP exception thrown: Image not found. Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-643e7ec5-e801-45b1-83c4-5dcc6ce44838 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Request method failure captured: Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/images/05def8d6-5f6d-40c9-b90a-d2f90b342bc2/metadata HTTP/1.1 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 57 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69KLK6dk1XJLr1K1n5nookngtuUvtDyqAZeV9Io9jt2wrPBq7OOeGgu5VBFTvx1jARcX5tUs-mqd4-u27W6dShIUOpFLzzvMY3jUMXEE-9uIZOPnvqSQO7XlVa3llvodINeVXsD6McvigiYgLR7M8H9tUcxaiA0LU2v4CVFjNwKWkk8 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}] Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8f89d257bdea4407814ab76620ba9f60 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'image_id': '05def8d6-5f6d-40c9-b90a-d2f90b342bc2', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 05def8d6-5f6d-40c9-b90a-d2f90b342bc2 Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 14:07:09.231286 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 05def8d6-5f6d-40c9-b90a-d2f90b342bc2 could not be found. Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-643e7ec5-e801-45b1-83c4-5dcc6ce44838 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-643e7ec5-e801-45b1-83c4-5dcc6ce44838 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] 10.222.0.66 "PUT /compute/v2.1/images/05def8d6-5f6d-40c9-b90a-d2f90b342bc2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.078359 Aug 04 14:07:09.235671 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1350/2711] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:07:09 2022] PUT /compute/v2.1/images/05def8d6-5f6d-40c9-b90a-d2f90b342bc2/metadata => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:07:09.246877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-beea8c00-f2cc-4dc5-af77-fe2a60109435 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:09.247396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-beea8c00-f2cc-4dc5-af77-fe2a60109435 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:09.254040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:09.257139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:09.258607 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e4428ce4-c065-4696-aaf8-7e10ca293161 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1366 microversion: 2.57 time: 0.210295 Aug 04 14:07:09.261327 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1362/2712] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:09 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:09.266231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca270eea-a3f7-430d-b383-805dd7a43015 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:09.266869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ca270eea-a3f7-430d-b383-805dd7a43015 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:09.274501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beea8c00-f2cc-4dc5-af77-fe2a60109435 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:09.274966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beea8c00-f2cc-4dc5-af77-fe2a60109435 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:09.276087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beea8c00-f2cc-4dc5-af77-fe2a60109435 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:09.276805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-beea8c00-f2cc-4dc5-af77-fe2a60109435 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:09.298825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca270eea-a3f7-430d-b383-805dd7a43015 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:09.299903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca270eea-a3f7-430d-b383-805dd7a43015 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:09.300680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca270eea-a3f7-430d-b383-805dd7a43015 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:09.301705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca270eea-a3f7-430d-b383-805dd7a43015 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:09.334880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-beea8c00-f2cc-4dc5-af77-fe2a60109435 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:07:09.430742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:09.450835 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-beea8c00-f2cc-4dc5-af77-fe2a60109435 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 204 len: 0 microversion: 2.1 time: 0.207629 Aug 04 14:07:09.452147 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1351/2713] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:07:09 2022] DELETE /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:07:09.461807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea634083-b3e1-4457-8e9c-0b6b6755beec tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Action: 'update', calling method: .version_select at 0x7f470027a4c0>, body: {"meta": {"os_distro": "alt"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:09.564193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ca270eea-a3f7-430d-b383-805dd7a43015 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:09.570723 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ea634083-b3e1-4457-8e9c-0b6b6755beec tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] HTTP exception thrown: Image not found. Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea634083-b3e1-4457-8e9c-0b6b6755beec tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Request method failure captured: Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/images/728963ea-31be-49ea-a038-779d33131428/metadata/os_distro HTTP/1.1 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 30 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69KLK6dk1XJLr1K1n5nookngtuUvtDyqAZeV9Io9jt2wrPBq7OOeGgu5VBFTvx1jARcX5tUs-mqd4-u27W6dShIUOpFLzzvMY3jUMXEE-9uIZOPnvqSQO7XlVa3llvodINeVXsD6McvigiYgLR7M8H9tUcxaiA0LU2v4CVFjNwKWkk8 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}] Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8f89d257bdea4407814ab76620ba9f60 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: {"meta": {"os_distro": "alt"}} Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'image_id': '728963ea-31be-49ea-a038-779d33131428', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 728963ea-31be-49ea-a038-779d33131428 Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 14:07:09.573300 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 728963ea-31be-49ea-a038-779d33131428 could not be found. Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:07:09.578020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:09.586338 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca270eea-a3f7-430d-b383-805dd7a43015 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1198 microversion: 2.1 time: 0.322341 Aug 04 14:07:09.586572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea634083-b3e1-4457-8e9c-0b6b6755beec tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:09.586572 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ea634083-b3e1-4457-8e9c-0b6b6755beec tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] 10.222.0.66 "PUT /compute/v2.1/images/728963ea-31be-49ea-a038-779d33131428/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.132032 Aug 04 14:07:09.586823 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1363/2714] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:09 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1198 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:09.594600 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1352/2715] 10.222.0.66 () {60 vars in 1310 bytes} [Thu Aug 4 14:07:09 2022] PUT /compute/v2.1/images/728963ea-31be-49ea-a038-779d33131428/metadata/os_distro => generated 62 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:07:09.600086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-412db5d8-a42c-40f1-8413-de4fef9da904 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:09.606738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-412db5d8-a42c-40f1-8413-de4fef9da904 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:09.615170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-865219392", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "key_name": "tempest-key-991750562", "networks": [{"uuid": "2344a004-88b5-43d1-a0c7-ab45883f4f84"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:09.630050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-412db5d8-a42c-40f1-8413-de4fef9da904 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:09.630725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-412db5d8-a42c-40f1-8413-de4fef9da904 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:09.632545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-412db5d8-a42c-40f1-8413-de4fef9da904 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:09.633724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-412db5d8-a42c-40f1-8413-de4fef9da904 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:09.716657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] validate_networks() for [('2344a004-88b5-43d1-a0c7-ab45883f4f84', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:07:10.021479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-412db5d8-a42c-40f1-8413-de4fef9da904 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:10.037848 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-412db5d8-a42c-40f1-8413-de4fef9da904 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1515 microversion: 2.1 time: 0.441673 Aug 04 14:07:10.039172 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1353/2716] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:09 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1515 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:10.046311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-faf3bb12-caea-4154-aa36-93ad93e6b5e8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:10.047315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-faf3bb12-caea-4154-aa36-93ad93e6b5e8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:10.055364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faf3bb12-caea-4154-aa36-93ad93e6b5e8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:10.056202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faf3bb12-caea-4154-aa36-93ad93e6b5e8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:10.057278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faf3bb12-caea-4154-aa36-93ad93e6b5e8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:10.057951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faf3bb12-caea-4154-aa36-93ad93e6b5e8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:10.061453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:10.334927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-faf3bb12-caea-4154-aa36-93ad93e6b5e8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:10.345955 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-faf3bb12-caea-4154-aa36-93ad93e6b5e8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1506 microversion: 2.1 time: 0.305425 Aug 04 14:07:10.357845 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1354/2717] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:10 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:10.373532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ffacca9b-6f5b-40c6-91f7-54d8ceea83f8 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Action: 'create', calling method: .version_select at 0x7f46f3ba2160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:10.419578 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ffacca9b-6f5b-40c6-91f7-54d8ceea83f8 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] HTTP exception thrown: Image not found. Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ffacca9b-6f5b-40c6-91f7-54d8ceea83f8 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Request method failure captured: Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/images/e81a38ed-b96c-4c59-9b83-bab3922d9ed5/metadata HTTP/1.1 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 57 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69KLK6dk1XJLr1K1n5nookngtuUvtDyqAZeV9Io9jt2wrPBq7OOeGgu5VBFTvx1jARcX5tUs-mqd4-u27W6dShIUOpFLzzvMY3jUMXEE-9uIZOPnvqSQO7XlVa3llvodINeVXsD6McvigiYgLR7M8H9tUcxaiA0LU2v4CVFjNwKWkk8 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/525735d03ee544c2b96da7cf8871d4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/525735d03ee544c2b96da7cf8871d4bd"}]}] Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 525735d03ee544c2b96da7cf8871d4bd Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 8f89d257bdea4407814ab76620ba9f60 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1757064962-project Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'image_id': 'e81a38ed-b96c-4c59-9b83-bab3922d9ed5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e81a38ed-b96c-4c59-9b83-bab3922d9ed5 Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 14:07:10.428671 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e81a38ed-b96c-4c59-9b83-bab3922d9ed5 could not be found. Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ffacca9b-6f5b-40c6-91f7-54d8ceea83f8 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:10.433761 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ffacca9b-6f5b-40c6-91f7-54d8ceea83f8 tempest-ImagesMetadataNegativeTestJSON-1757064962 tempest-ImagesMetadataNegativeTestJSON-1757064962-project] 10.222.0.66 "POST /compute/v2.1/images/e81a38ed-b96c-4c59-9b83-bab3922d9ed5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.072223 Aug 04 14:07:10.446648 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1355/2718] 10.222.0.66 () {60 vars in 1281 bytes} [Thu Aug 4 14:07:10 2022] POST /compute/v2.1/images/e81a38ed-b96c-4c59-9b83-bab3922d9ed5/metadata => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:07:10.450007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2f054a0c-dbb3-4b44-b1da-9c659f98989e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f470027ae50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:10.577633 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2f054a0c-dbb3-4b44-b1da-9c659f98989e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.129402 Aug 04 14:07:10.581324 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1356/2719] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:10 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:10.595471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c628ecd7-c995-4b0c-b43d-e721be811ce1 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:10.614538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c628ecd7-c995-4b0c-b43d-e721be811ce1 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:10.627872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c628ecd7-c995-4b0c-b43d-e721be811ce1 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:10.629802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c628ecd7-c995-4b0c-b43d-e721be811ce1 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:10.631660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c628ecd7-c995-4b0c-b43d-e721be811ce1 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:10.632807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c628ecd7-c995-4b0c-b43d-e721be811ce1 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:11.201694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=29 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:11.536693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c628ecd7-c995-4b0c-b43d-e721be811ce1 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:11.559754 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c628ecd7-c995-4b0c-b43d-e721be811ce1 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1315 microversion: 2.1 time: 0.975868 Aug 04 14:07:11.560914 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1357/2720] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:10 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1315 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:11.588938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-00b18ffc-f47c-4cb4-90bb-51114be82196 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:11.592448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-00b18ffc-f47c-4cb4-90bb-51114be82196 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:11.611797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00b18ffc-f47c-4cb4-90bb-51114be82196 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:11.612565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00b18ffc-f47c-4cb4-90bb-51114be82196 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:11.614496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00b18ffc-f47c-4cb4-90bb-51114be82196 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:11.615081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00b18ffc-f47c-4cb4-90bb-51114be82196 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:11.689165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-00b18ffc-f47c-4cb4-90bb-51114be82196 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lazy-loading 'flavor' on Instance uuid ac42befe-28d2-4af7-b56e-2cc6ea8034b6 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:07:11.689639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:07:11.691475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:07:11.692774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:07:11.693921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:07:11.695033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:07:11.716041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:11.717100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:11.718969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:11.719756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:11.805741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:11.829729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for user df576732ca5c442694d507fd4dc58279 and project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:11.893634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:07:11.899284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:07:11.922895 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-00b18ffc-f47c-4cb4-90bb-51114be82196 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6/action" status: 200 len: 32 microversion: 2.1 time: 0.359887 Aug 04 14:07:11.930021 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1358/2721] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:07:11 2022] POST /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:07:11.954240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:11.960573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:11.989186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:11.990503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:11.992410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:11.993523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:12.012193 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e086707-d8f5-45c3-be54-fcb4f72f952b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419762 Aug 04 14:07:12.013239 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1364/2722] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:07:12.018699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-812fcbdd-2baf-42bb-8cad-8b335527824c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:12.021224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-812fcbdd-2baf-42bb-8cad-8b335527824c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:12.030172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-812fcbdd-2baf-42bb-8cad-8b335527824c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:12.031055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-812fcbdd-2baf-42bb-8cad-8b335527824c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:12.032444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-812fcbdd-2baf-42bb-8cad-8b335527824c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:12.033184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-812fcbdd-2baf-42bb-8cad-8b335527824c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:12.056589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:12.230723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:12.247051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:12.251256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:12.256992 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a1eb07e-31f6-45d5-beda-a3e72a87b89b tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1372 microversion: 2.57 time: 0.323868 Aug 04 14:07:12.273599 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1359/2723] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:11 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1372 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:12.280956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6dbafe93-eaad-402f-86a1-b83b43f6942c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:12.282320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6dbafe93-eaad-402f-86a1-b83b43f6942c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:12.293785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dbafe93-eaad-402f-86a1-b83b43f6942c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:12.294539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dbafe93-eaad-402f-86a1-b83b43f6942c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:12.299141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dbafe93-eaad-402f-86a1-b83b43f6942c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:12.299610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dbafe93-eaad-402f-86a1-b83b43f6942c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:12.611232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-812fcbdd-2baf-42bb-8cad-8b335527824c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:12.643131 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-812fcbdd-2baf-42bb-8cad-8b335527824c tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1198 microversion: 2.1 time: 0.628692 Aug 04 14:07:12.651399 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1365/2724] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:12 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1198 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:12.663791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2692e5db-a963-4c97-94c7-addddc0307ff tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3769160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:12.828173 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2692e5db-a963-4c97-94c7-addddc0307ff tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.175196 Aug 04 14:07:12.830009 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1366/2725] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:12 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:12.845170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f5647a33-d424-4a19-8d2a-afc4fbef50a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:12.846232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f5647a33-d424-4a19-8d2a-afc4fbef50a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:12.857180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5647a33-d424-4a19-8d2a-afc4fbef50a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:12.864690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5647a33-d424-4a19-8d2a-afc4fbef50a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:12.867871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5647a33-d424-4a19-8d2a-afc4fbef50a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:12.871206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5647a33-d424-4a19-8d2a-afc4fbef50a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:13.469028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f5647a33-d424-4a19-8d2a-afc4fbef50a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:13.504316 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f5647a33-d424-4a19-8d2a-afc4fbef50a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.671564 Aug 04 14:07:13.529102 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1367/2726] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:12 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:13.544112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b43a5723-72ec-498a-ac7f-7e97b93783f5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:13.546764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b43a5723-72ec-498a-ac7f-7e97b93783f5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:13.561284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43a5723-72ec-498a-ac7f-7e97b93783f5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:13.567141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43a5723-72ec-498a-ac7f-7e97b93783f5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:13.568443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43a5723-72ec-498a-ac7f-7e97b93783f5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:13.569119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43a5723-72ec-498a-ac7f-7e97b93783f5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:13.600461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6dbafe93-eaad-402f-86a1-b83b43f6942c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:13.618910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6dbafe93-eaad-402f-86a1-b83b43f6942c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1506 microversion: 2.1 time: 1.342224 Aug 04 14:07:13.620168 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1360/2727] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:12 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1506 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:13.627031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6bc6096b-2c0e-4f9b-9967-4e7a84e22f0f tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:13.638081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6bc6096b-2c0e-4f9b-9967-4e7a84e22f0f tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:13.650162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bc6096b-2c0e-4f9b-9967-4e7a84e22f0f tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:13.650940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bc6096b-2c0e-4f9b-9967-4e7a84e22f0f tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:13.651954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bc6096b-2c0e-4f9b-9967-4e7a84e22f0f tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:13.652590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bc6096b-2c0e-4f9b-9967-4e7a84e22f0f tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:13.727631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b43a5723-72ec-498a-ac7f-7e97b93783f5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:13.759066 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b43a5723-72ec-498a-ac7f-7e97b93783f5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1279 microversion: 2.1 time: 0.227880 Aug 04 14:07:13.760302 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1368/2728] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:13 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:13.770809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:13.772955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:13.799535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:13.802057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:13.806504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:13.807418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:14.181453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:14.204699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:14.208758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:14.211475 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-41f4ab04-4766-4bb4-833a-d8e43ec0a732 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1372 microversion: 2.57 time: 0.449253 Aug 04 14:07:14.212698 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1369/2729] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:13 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1372 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:14.232716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51e97a48-1f5d-4e96-9bfa-90d16a2b09a9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:14.233692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-51e97a48-1f5d-4e96-9bfa-90d16a2b09a9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:14.244976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51e97a48-1f5d-4e96-9bfa-90d16a2b09a9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:14.245745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51e97a48-1f5d-4e96-9bfa-90d16a2b09a9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:14.246806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51e97a48-1f5d-4e96-9bfa-90d16a2b09a9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:14.247438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51e97a48-1f5d-4e96-9bfa-90d16a2b09a9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:14.692031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6bc6096b-2c0e-4f9b-9967-4e7a84e22f0f tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:14.709969 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6bc6096b-2c0e-4f9b-9967-4e7a84e22f0f tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1503 microversion: 2.1 time: 1.085191 Aug 04 14:07:14.733325 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1361/2730] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:13 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1503 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:14.747894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c758d218-3f71-4bfd-b199-6822b780b9dd tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f47002793a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:14.912793 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c758d218-3f71-4bfd-b199-6822b780b9dd tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.174515 Aug 04 14:07:14.913456 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1362/2731] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:14 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:14.978480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-51e97a48-1f5d-4e96-9bfa-90d16a2b09a9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:15.001480 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-51e97a48-1f5d-4e96-9bfa-90d16a2b09a9 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1198 microversion: 2.1 time: 0.786643 Aug 04 14:07:15.014443 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1370/2732] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:14 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1198 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:15.022630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1bcd1379-8bb4-4e1d-a811-d09051081ccb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:15.023612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1bcd1379-8bb4-4e1d-a811-d09051081ccb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:15.048491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bcd1379-8bb4-4e1d-a811-d09051081ccb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:15.055791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bcd1379-8bb4-4e1d-a811-d09051081ccb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:15.056777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bcd1379-8bb4-4e1d-a811-d09051081ccb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:15.057266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1bcd1379-8bb4-4e1d-a811-d09051081ccb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:15.278512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-954b4464-dae3-4800-b47c-4817dc2e38b6 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Action: 'create', calling method: .version_select at 0x7f46f3c43ee0>, body: {"keypair": {"name": "tempest-keypair-366659856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1B918ihC8pn/jQAjcgFaP8EutGk2QqrJg8ecvZGrNfrgh40tXy7wvFWj2sABsNPLrUKg62BR4jfKVk5JKtaY0oEf0XHe0WeHp5ioY7bvKeWMaZ4P+lPiRYO+5ivuhFjg=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:15.349566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-954b4464-dae3-4800-b47c-4817dc2e38b6 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:15.382918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-954b4464-dae3-4800-b47c-4817dc2e38b6 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for user fcd7772fe7c74273a2717c241734c271 and project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:15.495986 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-954b4464-dae3-4800-b47c-4817dc2e38b6 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.580787 Aug 04 14:07:15.506614 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1363/2733] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:07:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:15.517449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eb354195-275e-47ef-9c18-be13dc2d6505 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:15.518088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eb354195-275e-47ef-9c18-be13dc2d6505 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:15.538791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb354195-275e-47ef-9c18-be13dc2d6505 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:15.547554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb354195-275e-47ef-9c18-be13dc2d6505 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:15.548456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb354195-275e-47ef-9c18-be13dc2d6505 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:15.549013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb354195-275e-47ef-9c18-be13dc2d6505 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:15.859296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eb354195-275e-47ef-9c18-be13dc2d6505 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:15.873295 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eb354195-275e-47ef-9c18-be13dc2d6505 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1464 microversion: 2.1 time: 0.363716 Aug 04 14:07:15.889374 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1364/2734] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:15 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1464 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:15.896387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f482fd90-e70e-410a-869a-2e1215fab1fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:15.897331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f482fd90-e70e-410a-869a-2e1215fab1fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:15.905084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f482fd90-e70e-410a-869a-2e1215fab1fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:15.905724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f482fd90-e70e-410a-869a-2e1215fab1fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:15.907355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f482fd90-e70e-410a-869a-2e1215fab1fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:15.908079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f482fd90-e70e-410a-869a-2e1215fab1fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:15.933964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1bcd1379-8bb4-4e1d-a811-d09051081ccb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:15.942496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f482fd90-e70e-410a-869a-2e1215fab1fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:07:15.946317 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1bcd1379-8bb4-4e1d-a811-d09051081ccb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.930055 Aug 04 14:07:15.947968 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1371/2735] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:15 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:15.955838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4666028-e2d8-4b04-ab31-d21067e0547c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:15.957450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f4666028-e2d8-4b04-ab31-d21067e0547c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:15.967169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4666028-e2d8-4b04-ab31-d21067e0547c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:15.968265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4666028-e2d8-4b04-ab31-d21067e0547c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:15.969406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4666028-e2d8-4b04-ab31-d21067e0547c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:15.970041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4666028-e2d8-4b04-ab31-d21067e0547c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:16.077699 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f482fd90-e70e-410a-869a-2e1215fab1fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "DELETE /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 204 len: 0 microversion: 2.1 time: 0.185586 Aug 04 14:07:16.078991 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1365/2736] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:07:15 2022] DELETE /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:07:16.087761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5f9c999c-671a-466f-bac0-17dbdd119adf req-d4a6c7b5-8e1e-490a-b990-e6d625119927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90627287-7390-448b-bc44-878c72306f4e", "name": "network-vif-plugged", "status": "completed", "tag": "c115a33c-f9fb-4d11-b284-d04b79cb1a39"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:16.100953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5f9c999c-671a-466f-bac0-17dbdd119adf req-d4a6c7b5-8e1e-490a-b990-e6d625119927 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:16.101764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5f9c999c-671a-466f-bac0-17dbdd119adf req-d4a6c7b5-8e1e-490a-b990-e6d625119927 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:16.109716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f4666028-e2d8-4b04-ab31-d21067e0547c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:16.117584 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5f9c999c-671a-466f-bac0-17dbdd119adf req-d4a6c7b5-8e1e-490a-b990-e6d625119927 service nova] Creating event network-vif-plugged:c115a33c-f9fb-4d11-b284-d04b79cb1a39 for instance 90627287-7390-448b-bc44-878c72306f4e on n-h2-844627-10 Aug 04 14:07:16.123826 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5f9c999c-671a-466f-bac0-17dbdd119adf req-d4a6c7b5-8e1e-490a-b990-e6d625119927 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042102 Aug 04 14:07:16.124908 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1366/2737] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:16.132470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:16.133605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:16.137882 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4666028-e2d8-4b04-ab31-d21067e0547c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1285 microversion: 2.1 time: 0.188583 Aug 04 14:07:16.142099 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1372/2738] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:15 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:16.147963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:16.151987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:16.153266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:16.155658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-82c9e08a-c4c0-4392-a56e-e3397744b108 req-8c71296c-6f0a-4d7a-9bca-8b6a7b4079da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dedb436-cd86-49c7-9a23-933ab3829812", "name": "network-vif-deleted", "tag": "1a49ef80-c7b3-44c3-9e9b-4da1681e2afc"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:16.156627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:16.188776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-82c9e08a-c4c0-4392-a56e-e3397744b108 req-8c71296c-6f0a-4d7a-9bca-8b6a7b4079da service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:16.189425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-82c9e08a-c4c0-4392-a56e-e3397744b108 req-8c71296c-6f0a-4d7a-9bca-8b6a7b4079da service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:16.209369 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-82c9e08a-c4c0-4392-a56e-e3397744b108 req-8c71296c-6f0a-4d7a-9bca-8b6a7b4079da service nova] Creating event network-vif-deleted:1a49ef80-c7b3-44c3-9e9b-4da1681e2afc for instance 9dedb436-cd86-49c7-9a23-933ab3829812 on n-h1-844627-10 Aug 04 14:07:16.231559 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-82c9e08a-c4c0-4392-a56e-e3397744b108 req-8c71296c-6f0a-4d7a-9bca-8b6a7b4079da service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084556 Aug 04 14:07:16.232344 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1373/2739] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:16.240507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0d04e2e6-99f4-4351-bca7-b8a8965cce49 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Calling method '.version_select at 0x7f4700133e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:16.251911 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0d04e2e6-99f4-4351-bca7-b8a8965cce49 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs/tempest-keypair-366659856" status: 200 len: 497 microversion: 2.1 time: 0.017269 Aug 04 14:07:16.253133 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1374/2740] 10.222.0.66 () {58 vars in 1215 bytes} [Thu Aug 4 14:07:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-366659856 => generated 497 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:16.262172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7709a9ec-389c-4ccb-b233-4f5ce675297c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f37715e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:16.316523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:16.327228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:16.335336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:16.337460 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-317b012a-9834-4ad3-8a13-dfd8093d5c58 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1372 microversion: 2.57 time: 0.211010 Aug 04 14:07:16.338582 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1367/2741] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:16 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:16.344181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62d45657-1d53-4910-a2cd-6b6eeb742021 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:16.344993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-62d45657-1d53-4910-a2cd-6b6eeb742021 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:16.353181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62d45657-1d53-4910-a2cd-6b6eeb742021 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:16.353761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62d45657-1d53-4910-a2cd-6b6eeb742021 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:16.354697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62d45657-1d53-4910-a2cd-6b6eeb742021 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:16.360179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62d45657-1d53-4910-a2cd-6b6eeb742021 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:16.377060 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7709a9ec-389c-4ccb-b233-4f5ce675297c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1423 microversion: 2.1 time: 0.122524 Aug 04 14:07:16.380945 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1375/2742] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:16 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1423 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:16.391945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e894067-a6a3-4862-a192-8e1c5a4acdac tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:16.393159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2e894067-a6a3-4862-a192-8e1c5a4acdac tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:16.401101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e894067-a6a3-4862-a192-8e1c5a4acdac tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:16.401933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e894067-a6a3-4862-a192-8e1c5a4acdac tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:16.402986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e894067-a6a3-4862-a192-8e1c5a4acdac tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:16.403655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e894067-a6a3-4862-a192-8e1c5a4acdac tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:16.928456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-62d45657-1d53-4910-a2cd-6b6eeb742021 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:16.962233 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62d45657-1d53-4910-a2cd-6b6eeb742021 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1198 microversion: 2.1 time: 0.622241 Aug 04 14:07:16.969209 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1368/2743] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:16 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1198 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:16.991923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-923033f3-fd22-4ef6-a3b7-7df8c54c6a3b tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Calling method '.version_select at 0x7f46f3ba2700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:17.025049 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-923033f3-fd22-4ef6-a3b7-7df8c54c6a3b tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366659856" status: 202 len: 0 microversion: 2.1 time: 0.052950 Aug 04 14:07:17.026188 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1369/2744] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 14:07:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366659856 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:17.033451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:17.034739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:17.045013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:17.045899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:17.047035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:17.047840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:17.063280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2e894067-a6a3-4862-a192-8e1c5a4acdac tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:17.074457 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2e894067-a6a3-4862-a192-8e1c5a4acdac tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1509 microversion: 2.1 time: 0.689682 Aug 04 14:07:17.075991 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1376/2745] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:16 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1509 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:17.096035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-93367034-3285-45ac-87db-c391f260ed2e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:17.101056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-93367034-3285-45ac-87db-c391f260ed2e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:17.103073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:17.103842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:17.104535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lazy-loading 'fault' on Instance uuid 9dedb436-cd86-49c7-9a23-933ab3829812 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:07:17.121994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93367034-3285-45ac-87db-c391f260ed2e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:17.123844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93367034-3285-45ac-87db-c391f260ed2e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:17.125478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93367034-3285-45ac-87db-c391f260ed2e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:17.126286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93367034-3285-45ac-87db-c391f260ed2e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:17.226683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:17.235520 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7a10c96d-eb57-4dad-bbe7-95530bd99f2b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 200 len: 1304 microversion: 2.1 time: 0.208007 Aug 04 14:07:17.253131 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1370/2746] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:17 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 1304 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:17.261081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-acc1dd48-e9c2-4ca1-9578-7586c65c8f31 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Action: 'create', calling method: .version_select at 0x7f4700279670>, body: {"keypair": {"name": "tempest-keypair-1606100959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXI8YAWDw2JTSK/ieyRCfK4vhJ4STt8t3T8XuhW0Et1jnKWaZCzQzrP+hX5jZJX+KM04XeaBCZnis0/nLFBAn+VMdnVkTKEx/diPAnWa3vrI1DWna/u+/yyBGpHpgHMdg=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:17.277120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-acc1dd48-e9c2-4ca1-9578-7586c65c8f31 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:17.284742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-acc1dd48-e9c2-4ca1-9578-7586c65c8f31 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for user fcd7772fe7c74273a2717c241734c271 and project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:17.326940 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-acc1dd48-e9c2-4ca1-9578-7586c65c8f31 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072464 Aug 04 14:07:17.327852 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1371/2747] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:07:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:17.334915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b2024e6d-e710-4369-80fe-9a506053ad60 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:17.335288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b2024e6d-e710-4369-80fe-9a506053ad60 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:17.348906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2024e6d-e710-4369-80fe-9a506053ad60 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:17.349765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2024e6d-e710-4369-80fe-9a506053ad60 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:17.351280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2024e6d-e710-4369-80fe-9a506053ad60 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:17.352101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2024e6d-e710-4369-80fe-9a506053ad60 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:17.813465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-93367034-3285-45ac-87db-c391f260ed2e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:17.822733 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-93367034-3285-45ac-87db-c391f260ed2e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.743895 Aug 04 14:07:17.823393 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1377/2748] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:17 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:17.828211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c3ef9a9-9932-47e1-9e24-e8ff08d2b143 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Calling method '.version_select at 0x7f46f36fff70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:17.910549 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c3ef9a9-9932-47e1-9e24-e8ff08d2b143 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606100959" status: 202 len: 0 microversion: 2.1 time: 0.085156 Aug 04 14:07:17.911625 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1378/2749] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:07:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606100959 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:17.925206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:17.926395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:17.943554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b2024e6d-e710-4369-80fe-9a506053ad60 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:17.950983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:17.952183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:17.953750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:17.954773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:17.966072 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b2024e6d-e710-4369-80fe-9a506053ad60 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1327 microversion: 2.1 time: 0.636883 Aug 04 14:07:17.969923 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1372/2750] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:17 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1327 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:17.980660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-90af84d2-f39e-40a3-8c0b-900fdf25a5b1 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f38cc4c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:18.041159 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-90af84d2-f39e-40a3-8c0b-900fdf25a5b1 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1432 microversion: 2.1 time: 0.071144 Aug 04 14:07:18.042136 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1373/2751] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:17 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1432 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:18.047845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0d29a4c2-9be8-4588-85ac-8f9c03e9f716 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Action: 'create', calling method: .version_select at 0x7f46f3ba2c10>, body: {"keypair": {"name": "tempest-keypair-1215169707", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:18.065715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-0d29a4c2-9be8-4588-85ac-8f9c03e9f716 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:18.075303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-0d29a4c2-9be8-4588-85ac-8f9c03e9f716 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for user fcd7772fe7c74273a2717c241734c271 and project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:18.105887 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0d29a4c2-9be8-4588-85ac-8f9c03e9f716 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.062790 Aug 04 14:07:18.106838 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1374/2752] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:07:18 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:18.118044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ed35dad6-acae-4f71-a188-cf110af644ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:18.119064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ed35dad6-acae-4f71-a188-cf110af644ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:18.124135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:18.130928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed35dad6-acae-4f71-a188-cf110af644ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.131723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed35dad6-acae-4f71-a188-cf110af644ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:18.133126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed35dad6-acae-4f71-a188-cf110af644ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.134199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed35dad6-acae-4f71-a188-cf110af644ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:18.157626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:18.161358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:18.163351 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d8c4827-14e1-41ff-83bf-e6d1525a384d tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1357 microversion: 2.57 time: 0.249921 Aug 04 14:07:18.165110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:18.166818 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1379/2753] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:17 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:18.173727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d45ecb3e-9c41-4f98-9c9f-60e2b523dbf9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f36ff430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:18.248709 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d45ecb3e-9c41-4f98-9c9f-60e2b523dbf9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 200 len: 1432 microversion: 2.1 time: 0.079755 Aug 04 14:07:18.249804 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1380/2754] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:18 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 1432 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:18.258964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-543c01df-93c0-4747-b2ef-371904ccb942 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:18.260526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-543c01df-93c0-4747-b2ef-371904ccb942 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:18.275772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-543c01df-93c0-4747-b2ef-371904ccb942 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.276471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-543c01df-93c0-4747-b2ef-371904ccb942 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:18.277783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-543c01df-93c0-4747-b2ef-371904ccb942 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.278700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-543c01df-93c0-4747-b2ef-371904ccb942 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:18.641128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ed35dad6-acae-4f71-a188-cf110af644ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:18.653771 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ed35dad6-acae-4f71-a188-cf110af644ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1198 microversion: 2.1 time: 0.540694 Aug 04 14:07:18.654658 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1375/2755] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:18 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1198 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:18.663678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-46ba1c41-b60e-48c7-ac59-481903ea37ae tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Calling method '.version_select at 0x7f47001de280>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:18.710258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-543c01df-93c0-4747-b2ef-371904ccb942 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:18.710623 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-46ba1c41-b60e-48c7-ac59-481903ea37ae tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215169707" status: 202 len: 0 microversion: 2.1 time: 0.054097 Aug 04 14:07:18.720174 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1376/2756] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:07:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215169707 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:18.726984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f8f723af-cd5f-4863-b331-d456ddb6d31a tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:18.727270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f8f723af-cd5f-4863-b331-d456ddb6d31a tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:18.730750 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-543c01df-93c0-4747-b2ef-371904ccb942 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1509 microversion: 2.1 time: 0.479717 Aug 04 14:07:18.731360 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1381/2757] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:18 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1509 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:18.736623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:18.749570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:18.757194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.757646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:18.758621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8f723af-cd5f-4863-b331-d456ddb6d31a tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.758861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.759472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:18.759784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8f723af-cd5f-4863-b331-d456ddb6d31a tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:18.761372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8f723af-cd5f-4863-b331-d456ddb6d31a tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.762274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8f723af-cd5f-4863-b331-d456ddb6d31a tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:18.792070 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 HTTP/1.1 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9dedb436-cd86-49c7-9a23-933ab3829812'} Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:18.796213 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:18.801414 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:18.801414 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:18.801414 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:18.801414 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:18.801414 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:18.801414 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:07:18.801414 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:18.801414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:18.801414 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2cbd6c85-25e9-4d9c-8bbe-6ac4cdfab836 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 404 len: 111 microversion: 2.1 time: 0.066075 Aug 04 14:07:18.813825 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1382/2758] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:18 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:18.827324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa54e432-beea-4460-9fb1-11ccc598926e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:18.829008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa54e432-beea-4460-9fb1-11ccc598926e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:18.839201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f8f723af-cd5f-4863-b331-d456ddb6d31a tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:07:18.845940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa54e432-beea-4460-9fb1-11ccc598926e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.847231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa54e432-beea-4460-9fb1-11ccc598926e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:18.849919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa54e432-beea-4460-9fb1-11ccc598926e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:18.851050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa54e432-beea-4460-9fb1-11ccc598926e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:19.062068 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f8f723af-cd5f-4863-b331-d456ddb6d31a tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 204 len: 0 microversion: 2.57 time: 0.347390 Aug 04 14:07:19.063105 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1377/2759] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:07:18 2022] DELETE /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:07:19.076413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9332f31f-634f-4ad1-965b-12f0332bc1f9 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Action: 'create', calling method: .version_select at 0x7f46f3cd1d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-959774168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+Er4uGmqM9+D8WRNIf9nIP160n8O2HsX5GVSMA1Ob1mCtuaa7nCarNdLAZ0gu0WE0zrwLPgsibqRkV4h4I361OKE1GKWQdfldtu4AfoMhDrBNQPYoee7EvikOTU9b/ew=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:19.106057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9332f31f-634f-4ad1-965b-12f0332bc1f9 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:19.110037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:19.117457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9332f31f-634f-4ad1-965b-12f0332bc1f9 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for user fcd7772fe7c74273a2717c241734c271 and project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:19.170998 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9332f31f-634f-4ad1-965b-12f0332bc1f9 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.105572 Aug 04 14:07:19.172512 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1378/2760] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:07:19 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:19.183233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9987f488-ab6d-4cab-b499-3d47984d00ee tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:19.184973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9987f488-ab6d-4cab-b499-3d47984d00ee tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:19.192971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9987f488-ab6d-4cab-b499-3d47984d00ee tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:19.193506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9987f488-ab6d-4cab-b499-3d47984d00ee tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:19.194380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9987f488-ab6d-4cab-b499-3d47984d00ee tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:19.194881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9987f488-ab6d-4cab-b499-3d47984d00ee tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:19.814601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa54e432-beea-4460-9fb1-11ccc598926e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:19.824918 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa54e432-beea-4460-9fb1-11ccc598926e tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1466 microversion: 2.1 time: 1.009076 Aug 04 14:07:19.825722 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1383/2761] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:18 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1466 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:19.831009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d116603-66dd-4b7c-a861-69907c9ff246 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:19.832587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8d116603-66dd-4b7c-a861-69907c9ff246 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:19.840731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d116603-66dd-4b7c-a861-69907c9ff246 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:19.841490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d116603-66dd-4b7c-a861-69907c9ff246 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:19.842786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d116603-66dd-4b7c-a861-69907c9ff246 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:19.843936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d116603-66dd-4b7c-a861-69907c9ff246 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:20.054743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9987f488-ab6d-4cab-b499-3d47984d00ee tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.070881 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9987f488-ab6d-4cab-b499-3d47984d00ee tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.896457 Aug 04 14:07:20.071889 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1379/2762] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:19 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:20.094232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-1bccc6b1-55e7-4ca5-b4c4-92ff8395a5d9 req-e592b082-8eeb-4cc2-a272-830928e05fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241427eb-b636-4440-851c-389485fb5de8", "tag": "250bd247-f808-4df8-9b56-1f15e9c20ae9"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:20.114042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1bccc6b1-55e7-4ca5-b4c4-92ff8395a5d9 req-e592b082-8eeb-4cc2-a272-830928e05fa2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:20.114869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1bccc6b1-55e7-4ca5-b4c4-92ff8395a5d9 req-e592b082-8eeb-4cc2-a272-830928e05fa2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:20.138040 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-1bccc6b1-55e7-4ca5-b4c4-92ff8395a5d9 req-e592b082-8eeb-4cc2-a272-830928e05fa2 service nova] Creating event network-changed:250bd247-f808-4df8-9b56-1f15e9c20ae9 for instance 241427eb-b636-4440-851c-389485fb5de8 on n-h2-844627-10 Aug 04 14:07:20.148311 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-1bccc6b1-55e7-4ca5-b4c4-92ff8395a5d9 req-e592b082-8eeb-4cc2-a272-830928e05fa2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073769 Aug 04 14:07:20.149259 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1380/2763] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:20.159479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:20.161756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:20.173511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:20.174309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:20.175833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:20.176637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:20.341742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.348079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d116603-66dd-4b7c-a861-69907c9ff246 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.360415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.364575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.366940 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c46ab436-a483-4ecc-9f01-bceab1c62130 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1363 microversion: 2.57 time: 0.215611 Aug 04 14:07:20.368453 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1381/2764] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:20 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:20.370986 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d116603-66dd-4b7c-a861-69907c9ff246 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1327 microversion: 2.1 time: 0.543947 Aug 04 14:07:20.372646 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1384/2765] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:19 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1327 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:20.377574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1817226988", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:20.392217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-202a693f-0462-424c-afd7-4331b0ade902 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Action: 'create', calling method: .version_select at 0x7f46f39f69d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-893479933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7mf9VYt3r+kIl1zF7tUK/p3LNI5T4VeYfw1izotauJx01ZHBrOzZt42Qd6Tyjy67wA5Kyr+gwUatrg+ysXeYoa6tTkXiqi4Y5A9LjpnJGslOHj7XTm6OwRSshlsQYKdw=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:20.412974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:20.425449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-202a693f-0462-424c-afd7-4331b0ade902 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:20.439814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-202a693f-0462-424c-afd7-4331b0ade902 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for user fcd7772fe7c74273a2717c241734c271 and project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:20.469779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] validate_networks() for [('4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:07:20.485731 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-202a693f-0462-424c-afd7-4331b0ade902 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.111408 Aug 04 14:07:20.486714 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1385/2766] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:07:20 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:20.492488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1ab7e77e-c287-416e-90bf-751a7f124cfc tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:20.493262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1ab7e77e-c287-416e-90bf-751a7f124cfc tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:20.500046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ab7e77e-c287-416e-90bf-751a7f124cfc tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:20.500651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ab7e77e-c287-416e-90bf-751a7f124cfc tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:20.501654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ab7e77e-c287-416e-90bf-751a7f124cfc tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:20.502202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ab7e77e-c287-416e-90bf-751a7f124cfc tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:20.718264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1ab7e77e-c287-416e-90bf-751a7f124cfc tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.727284 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1ab7e77e-c287-416e-90bf-751a7f124cfc tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1382 microversion: 2.1 time: 0.239599 Aug 04 14:07:20.727992 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1386/2767] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:20 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1382 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:20.732794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4a29a9c4-a23d-46db-b2b9-2cb7b5e40fc6 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:20.733452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4a29a9c4-a23d-46db-b2b9-2cb7b5e40fc6 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:20.740487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a29a9c4-a23d-46db-b2b9-2cb7b5e40fc6 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:20.740971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a29a9c4-a23d-46db-b2b9-2cb7b5e40fc6 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:20.741756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a29a9c4-a23d-46db-b2b9-2cb7b5e40fc6 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:20.742193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a29a9c4-a23d-46db-b2b9-2cb7b5e40fc6 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:20.828026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4a29a9c4-a23d-46db-b2b9-2cb7b5e40fc6 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b60da41ae2454edb8c9c11a323a1157e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f8c6320ff146eea8e42f1ccffb4d68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:20.838019 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4a29a9c4-a23d-46db-b2b9-2cb7b5e40fc6 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 200 len: 1467 microversion: 2.1 time: 0.108915 Aug 04 14:07:20.838823 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1387/2768] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:20 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 1467 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:20.848353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fe244fee-3000-47de-956c-3b85b717b0a1 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f470011a1f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:20.915561 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fe244fee-3000-47de-956c-3b85b717b0a1 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/bd2a109f-56ba-4543-91dd-d0a2429000b9" status: 200 len: 784 microversion: 2.1 time: 0.074893 Aug 04 14:07:20.916654 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1388/2769] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:20 2022] GET /compute/v2.1/images/bd2a109f-56ba-4543-91dd-d0a2429000b9 => generated 784 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:20.925649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e5ae1c01-c4f3-4fee-a0c3-787f08a86833 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Action: 'create', calling method: .version_select at 0x7f46f39f61f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1982249942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIviHf5jC1RhoGyGa9GbqCqh8naN6fVio/BnroHaoJyDojXs9LpWDJukVmDtl2N2u6jGDgKSS3EFo2it94Ss6vxM8FYMVYPeUH4WC3yOFgxBVf2xIr7ywxSDsyAamssAsw=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:20.950875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e5ae1c01-c4f3-4fee-a0c3-787f08a86833 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:20.959573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e5ae1c01-c4f3-4fee-a0c3-787f08a86833 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Getting quotas for user fcd7772fe7c74273a2717c241734c271 and project a88e435f2f4a4f43a6063eaa67baf407. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:20.988613 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e5ae1c01-c4f3-4fee-a0c3-787f08a86833 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.070259 Aug 04 14:07:20.989354 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1389/2770] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:07:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:21.071674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:07:21.072455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:07:21.074162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:07:21.075824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:07:21.076857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:07:21.095125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:21.095921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:21.097405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:21.098644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:21.133859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:21.149277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for user d6f701d08c0741df9ad1375bd0712a59 and project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:21.174685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:07:21.178233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:07:21.193227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-960df962-4017-46a2-9e93-d54d092e1bbe tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:21.193927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-960df962-4017-46a2-9e93-d54d092e1bbe tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:21.201638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-960df962-4017-46a2-9e93-d54d092e1bbe tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:21.202192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-960df962-4017-46a2-9e93-d54d092e1bbe tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:21.204043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-960df962-4017-46a2-9e93-d54d092e1bbe tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:21.204924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-960df962-4017-46a2-9e93-d54d092e1bbe tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:21.236029 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-426cc770-80f9-4cd5-b95f-904512a7b12b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865901 Aug 04 14:07:21.241172 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1382/2771] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:07:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:07:21.250561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2168b9fe-7fee-4388-9a50-e41ef4f4bc5d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:21.270828 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2168b9fe-7fee-4388-9a50-e41ef4f4bc5d tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026917 Aug 04 14:07:21.273978 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1383/2772] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:07:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:21.279117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-888ba23f-2ada-4d64-a93d-5004e7bba9ea tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Calling method '.version_select at 0x7f470027a940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:21.283949 n-d-844627-10 devstack@n-api.service[130960]: WARNING oslo_db.sqlalchemy.utils [None req-888ba23f-2ada-4d64-a93d-5004e7bba9ea tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 14:07:21.296471 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-888ba23f-2ada-4d64-a93d-5004e7bba9ea tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.020829 Aug 04 14:07:21.298200 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1384/2773] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:07:21 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:21.306566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d46db3c0-63e9-460a-a072-5878f4a72c97 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:21.307625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d46db3c0-63e9-460a-a072-5878f4a72c97 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:21.318330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d46db3c0-63e9-460a-a072-5878f4a72c97 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:21.319111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d46db3c0-63e9-460a-a072-5878f4a72c97 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:21.320463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d46db3c0-63e9-460a-a072-5878f4a72c97 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:21.321241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d46db3c0-63e9-460a-a072-5878f4a72c97 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:21.542932 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-960df962-4017-46a2-9e93-d54d092e1bbe tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1535 microversion: 2.1 time: 0.551978 Aug 04 14:07:21.543802 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1390/2774] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:20 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1535 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:21.550455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d3ce01d-0415-47bc-89e6-334f9df6196b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:21.551541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9d3ce01d-0415-47bc-89e6-334f9df6196b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:21.609486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d46db3c0-63e9-460a-a072-5878f4a72c97 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:21.620926 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d46db3c0-63e9-460a-a072-5878f4a72c97 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.321313 Aug 04 14:07:21.621551 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1385/2775] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:21 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:21.626580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e44a17f6-34ce-4207-bf42-9a4cca2aa83f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3ab00d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:21.678808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9d3ce01d-0415-47bc-89e6-334f9df6196b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:21.697798 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d3ce01d-0415-47bc-89e6-334f9df6196b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1215 microversion: 2.1 time: 0.151716 Aug 04 14:07:21.698946 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1391/2776] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:21 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:21.713161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e3b31bdc-1798-48f6-ad72-3fce4365fcf6 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Calling method '.version_select at 0x7f47004d14c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:21.782599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:21.811130 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e3b31bdc-1798-48f6-ad72-3fce4365fcf6 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1982249942" status: 202 len: 0 microversion: 2.1 time: 0.109575 Aug 04 14:07:21.812678 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1392/2777] 10.222.0.66 () {58 vars in 1278 bytes} [Thu Aug 4 14:07:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1982249942 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:21.830459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:21.832822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:21.848159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:21.849445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:21.851466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:21.852527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:21.919243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:22.181548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:22.211559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:22.214866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70bafa980d344cffa4a93f390e789a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a4f1a85b1c4fdea317d091edcd4a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:22.216808 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a328a3bf-d451-4669-9591-4f9cfbb32c60 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 200 len: 1363 microversion: 2.57 time: 0.401271 Aug 04 14:07:22.217694 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1393/2778] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:21 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:07:22.226302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3ab231de-76a4-4f59-85dc-aae101609db7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:22.227222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3ab231de-76a4-4f59-85dc-aae101609db7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:22.254710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ab231de-76a4-4f59-85dc-aae101609db7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:22.256161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ab231de-76a4-4f59-85dc-aae101609db7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:22.257937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ab231de-76a4-4f59-85dc-aae101609db7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:22.259106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ab231de-76a4-4f59-85dc-aae101609db7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:22.766273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3ab231de-76a4-4f59-85dc-aae101609db7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:22.777884 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3ab231de-76a4-4f59-85dc-aae101609db7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1327 microversion: 2.1 time: 0.558637 Aug 04 14:07:22.796902 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1394/2779] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:22 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1327 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:22.806572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-efe63005-bd98-47e6-b260-9b4175f60189 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:22.811464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-efe63005-bd98-47e6-b260-9b4175f60189 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:22.840540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efe63005-bd98-47e6-b260-9b4175f60189 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:22.841315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efe63005-bd98-47e6-b260-9b4175f60189 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:22.842746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efe63005-bd98-47e6-b260-9b4175f60189 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:22.843510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efe63005-bd98-47e6-b260-9b4175f60189 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.012024 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e44a17f6-34ce-4207-bf42-9a4cca2aa83f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "DELETE /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 204 len: 0 microversion: 2.1 time: 1.388747 Aug 04 14:07:23.013159 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1386/2780] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:21 2022] DELETE /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 0 bytes in 1391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:07:23.023831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c9eb6584-4f11-4f86-930a-8a535af29373 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Calling method '.version_select at 0x7f46f38ccca0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.055453 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c9eb6584-4f11-4f86-930a-8a535af29373 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-893479933" status: 202 len: 0 microversion: 2.1 time: 0.040386 Aug 04 14:07:23.056056 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1387/2781] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:07:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-893479933 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:23.067373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.069112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:23.079796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.080414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.081468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.082063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.107290 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] HTTP exception thrown: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Request method failure captured: Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae HTTP/1.1 Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JqSzWDjmp5-Z_KJXbfyXf6Wl1yikz2bQO2GhykSHYqBIcy-Ng-koxa09B7RpYqjkafVcWsAeZRMlF5Ex3o5H_PYIihAUqOT9I9E46y0uA9ed4ua3F8Rc4ZWbIqFy0xWbktPuMbr9r1RYAeh6w1TWvDVVsUnLrzOrHv6h94lU0EDnk Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}] Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b60da41ae2454edb8c9c11a323a1157e Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '13f46d95-33c2-4b11-9a77-ae7309334bae'} Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:23.110661 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Returning 404 to user: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c773b28d-7744-448a-8c50-b667c2dca763 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 404 len: 111 microversion: 2.1 time: 0.055967 Aug 04 14:07:23.116187 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1388/2782] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:23 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:23.126658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-26845e15-b511-4aef-b248-6a2d41ef8fe0 req-13d1f923-5fb2-44b7-8e4d-d34f519a7496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f46d95-33c2-4b11-9a77-ae7309334bae", "name": "network-vif-deleted", "tag": "3f5ff6e8-1b46-421a-943e-da1edad90bba"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:23.144786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-26845e15-b511-4aef-b248-6a2d41ef8fe0 req-13d1f923-5fb2-44b7-8e4d-d34f519a7496 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.145636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-26845e15-b511-4aef-b248-6a2d41ef8fe0 req-13d1f923-5fb2-44b7-8e4d-d34f519a7496 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.172343 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-26845e15-b511-4aef-b248-6a2d41ef8fe0 req-13d1f923-5fb2-44b7-8e4d-d34f519a7496 service nova] Creating event network-vif-deleted:3f5ff6e8-1b46-421a-943e-da1edad90bba for instance 13f46d95-33c2-4b11-9a77-ae7309334bae on n-h1-844627-10 Aug 04 14:07:23.180497 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-26845e15-b511-4aef-b248-6a2d41ef8fe0 req-13d1f923-5fb2-44b7-8e4d-d34f519a7496 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064361 Aug 04 14:07:23.181336 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1389/2783] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:23.188522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ee0122ed-c653-471f-91eb-fa0542bcc6c8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.189449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ee0122ed-c653-471f-91eb-fa0542bcc6c8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:23.197641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee0122ed-c653-471f-91eb-fa0542bcc6c8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.198288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee0122ed-c653-471f-91eb-fa0542bcc6c8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.199203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee0122ed-c653-471f-91eb-fa0542bcc6c8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.199976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee0122ed-c653-471f-91eb-fa0542bcc6c8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.363855 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-efe63005-bd98-47e6-b260-9b4175f60189 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1535 microversion: 2.1 time: 0.565118 Aug 04 14:07:23.378359 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1395/2784] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:22 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1535 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:23.391067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19c0813e-e3d1-409a-8105-3d9725d4b7b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.392652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19c0813e-e3d1-409a-8105-3d9725d4b7b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:23.402004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19c0813e-e3d1-409a-8105-3d9725d4b7b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.402893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19c0813e-e3d1-409a-8105-3d9725d4b7b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.403929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19c0813e-e3d1-409a-8105-3d9725d4b7b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.404649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19c0813e-e3d1-409a-8105-3d9725d4b7b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.586702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-19c0813e-e3d1-409a-8105-3d9725d4b7b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:23.596962 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19c0813e-e3d1-409a-8105-3d9725d4b7b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1275 microversion: 2.1 time: 0.214610 Aug 04 14:07:23.597936 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1396/2785] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:23 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1275 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:23.608083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-80a70c04-3ee3-46c8-af12-e42b19e7a5a5 req-57c8386c-2a2a-4851-af1b-e969668ba6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a40a39-cbe8-47bc-8869-a88e59989f63", "name": "network-vif-unplugged", "status": "completed", "tag": "19e85bce-c14d-4d20-89ef-01de05cf0ac7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:23.627171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-80a70c04-3ee3-46c8-af12-e42b19e7a5a5 req-57c8386c-2a2a-4851-af1b-e969668ba6fa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.627723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-80a70c04-3ee3-46c8-af12-e42b19e7a5a5 req-57c8386c-2a2a-4851-af1b-e969668ba6fa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.641312 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-80a70c04-3ee3-46c8-af12-e42b19e7a5a5 req-57c8386c-2a2a-4851-af1b-e969668ba6fa service nova] Creating event network-vif-unplugged:19e85bce-c14d-4d20-89ef-01de05cf0ac7 for instance c8a40a39-cbe8-47bc-8869-a88e59989f63 on n-h2-844627-10 Aug 04 14:07:23.647740 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-80a70c04-3ee3-46c8-af12-e42b19e7a5a5 req-57c8386c-2a2a-4851-af1b-e969668ba6fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047799 Aug 04 14:07:23.648365 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1397/2786] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:23.648666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ee0122ed-c653-471f-91eb-fa0542bcc6c8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:23.654047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e74d479-5d14-40f0-8b1b-54701b6c5791 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3771af0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.664440 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ee0122ed-c653-471f-91eb-fa0542bcc6c8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.480827 Aug 04 14:07:23.665373 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1390/2787] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:23 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:23.674913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c7a83063-e09b-4ed7-ab05-7c8b1aa7c366 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] Calling method '.version_select at 0x7f4700264c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.695987 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2e74d479-5d14-40f0-8b1b-54701b6c5791 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] HTTP exception thrown: Image not found. Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e74d479-5d14-40f0-8b1b-54701b6c5791 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Request method failure captured: Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 HTTP/1.1 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JRk_FDYe2fPDb8EGwsAYL9aHQ_19UvgpbKfdfiWocfIBWivCHU9ycosKaCNPTJDT0xqNskw84zs33tb3Xza4x44mOCuYE_DerjnMCL_ep_ELSv7GAkRS5jer_6hfpKsSNaYadLpD90lL3YII6zHotp_SQj4-HKm7wq-nf8ZHSZx9E Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: e82094948d794cdda8a53cbe6c013808 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesOneServerTestJSON-1781342666 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e82094948d794cdda8a53cbe6c013808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e82094948d794cdda8a53cbe6c013808"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e82094948d794cdda8a53cbe6c013808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e82094948d794cdda8a53cbe6c013808"}]}] Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesOneServerTestJSON-1781342666 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: e82094948d794cdda8a53cbe6c013808 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1781342666 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesOneServerTestJSON-1781342666-project Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 92de0c3f92744fac8c3a0f5e69b15bb2 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesOneServerTestJSON-1781342666-project Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '22da8291-2516-41b6-9626-2f76804fc128'} Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 22da8291-2516-41b6-9626-2f76804fc128 Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 14:07:23.702751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22da8291-2516-41b6-9626-2f76804fc128 could not be found. Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e74d479-5d14-40f0-8b1b-54701b6c5791 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2e74d479-5d14-40f0-8b1b-54701b6c5791 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 404 len: 62 microversion: 2.1 time: 0.055575 Aug 04 14:07:23.707415 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1398/2788] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:23 2022] GET /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:07:23.721202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1353617944", "metadata": {"image_type": "test"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:23.723767 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c7a83063-e09b-4ed7-ab05-7c8b1aa7c366 tempest-KeyPairsV2TestJSON-1472979566 tempest-KeyPairsV2TestJSON-1472979566-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-959774168" status: 202 len: 0 microversion: 2.1 time: 0.055480 Aug 04 14:07:23.724890 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1391/2789] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:07:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-959774168 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:23.727497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:23.737635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.738876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] [instance: ed66d944-2bca-4c0a-a9cc-8647c9152740] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:23.745113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.747482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.748415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.748669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.749442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.749867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.751075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.751674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.773616 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] HTTP exception thrown: Instance ed66d944-2bca-4c0a-a9cc-8647c9152740 could not be found. Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Request method failure captured: Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 HTTP/1.1 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Jm9Rp3UKgbnKuUnSe7Pt_aHsiBsT3Do32yfJBvs2EOGG6VGPM9IbjM8EjHQLqYAV0FZQI8NbljoWPuW2tRcUYSyGpUvqXIO8cJULStDhe2_t7qiKHSMBDSE6uYwLHIzCjvA3yEOuMR04HjCQz3KLIg_Ldw_2r9EtBc5dI9gCUCbxI Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.57 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 20a4f1a85b1c4fdea317d091edcd4a80 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerShowV257Test-1978667081 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/20a4f1a85b1c4fdea317d091edcd4a80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_20a4f1a85b1c4fdea317d091edcd4a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/20a4f1a85b1c4fdea317d091edcd4a80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/20a4f1a85b1c4fdea317d091edcd4a80"}]}] Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerShowV257Test-1978667081 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 20a4f1a85b1c4fdea317d091edcd4a80 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerShowV257Test-1978667081 Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerShowV257Test-1978667081-project Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 70bafa980d344cffa4a93f390e789a6f Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerShowV257Test-1978667081-project Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance ed66d944-2bca-4c0a-a9cc-8647c9152740 could not be found. Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'ed66d944-2bca-4c0a-a9cc-8647c9152740'} Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed66d944-2bca-4c0a-a9cc-8647c9152740 could not be found. Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed66d944-2bca-4c0a-a9cc-8647c9152740 could not be found. Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:23.776273 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.786318 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.786318 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:23.786318 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:23.786318 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:23.786318 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:23.786318 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed66d944-2bca-4c0a-a9cc-8647c9152740 could not be found. Aug 04 14:07:23.786318 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.786318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] Returning 404 to user: Instance ed66d944-2bca-4c0a-a9cc-8647c9152740 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:23.786318 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df117a4b-8660-41fa-931a-c146822e8aa8 tempest-ServerShowV257Test-1978667081 tempest-ServerShowV257Test-1978667081-project] 10.222.0.66 "GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740" status: 404 len: 111 microversion: 2.57 time: 0.050907 Aug 04 14:07:23.789672 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1392/2790] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:07:23 2022] GET /compute/v2.1/servers/ed66d944-2bca-4c0a-a9cc-8647c9152740 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:07:23.798524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe5a2a9e-8a83-47d0-8e5e-d411b1ee9348 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.806721 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:07:23.806721 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:07:23.807877 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] HTTP exception thrown: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.810807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe5a2a9e-8a83-47d0-8e5e-d411b1ee9348 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Request method failure captured: Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae/action HTTP/1.1 Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 112 Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JqSzWDjmp5-Z_KJXbfyXf6Wl1yikz2bQO2GhykSHYqBIcy-Ng-koxa09B7RpYqjkafVcWsAeZRMlF5Ex3o5H_PYIihAUqOT9I9E46y0uA9ed4ua3F8Rc4ZWbIqFy0xWbktPuMbr9r1RYAeh6w1TWvDVVsUnLrzOrHv6h94lU0EDnk Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}] Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b60da41ae2454edb8c9c11a323a1157e Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1353617944", "metadata": {"image_type": "test"}}} Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '13f46d95-33c2-4b11-9a77-ae7309334bae', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1353617944', 'metadata': {'image_type': 'test'}}}} Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 14:07:23.812225 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Returning 404 to user: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:23.820677 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19cd0a61-13bd-4a7e-8a5d-dd8aa85465f7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "POST /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae/action" status: 404 len: 111 microversion: 2.1 time: 0.104341 Aug 04 14:07:23.822849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe5a2a9e-8a83-47d0-8e5e-d411b1ee9348 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.822849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe5a2a9e-8a83-47d0-8e5e-d411b1ee9348 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.822849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe5a2a9e-8a83-47d0-8e5e-d411b1ee9348 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.823299 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1399/2791] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Aug 4 14:07:23 2022] POST /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae/action => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:23.831183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c8e13cb7-d8c3-4664-988e-5cc20db9d502 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1524134991"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:23.833708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c8e13cb7-d8c3-4664-988e-5cc20db9d502 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:23.842337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8e13cb7-d8c3-4664-988e-5cc20db9d502 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.843302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8e13cb7-d8c3-4664-988e-5cc20db9d502 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.843697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8e13cb7-d8c3-4664-988e-5cc20db9d502 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.843955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8e13cb7-d8c3-4664-988e-5cc20db9d502 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.912946 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe5a2a9e-8a83-47d0-8e5e-d411b1ee9348 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.123565 Aug 04 14:07:23.918348 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1393/2792] 10.222.0.66 () {58 vars in 1176 bytes} [Thu Aug 4 14:07:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:23.925225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-32c9fd49-c7dd-498d-9287-7e6998374d5d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:23.928166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-32c9fd49-c7dd-498d-9287-7e6998374d5d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:23.935790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32c9fd49-c7dd-498d-9287-7e6998374d5d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.936233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32c9fd49-c7dd-498d-9287-7e6998374d5d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:23.937320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32c9fd49-c7dd-498d-9287-7e6998374d5d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:23.937972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32c9fd49-c7dd-498d-9287-7e6998374d5d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:24.202366 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c8e13cb7-d8c3-4664-988e-5cc20db9d502 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "POST /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63/action" status: 202 len: 0 microversion: 2.1 time: 0.374456 Aug 04 14:07:24.204082 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1400/2793] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:07:23 2022] POST /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:07:24.218087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3457f537-b536-4ab6-abf6-6d9ccdbe9db7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1972298615", "metadata": {"image_type": "test"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:24.222959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3457f537-b536-4ab6-abf6-6d9ccdbe9db7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Failed to fetch instance by id tempest-invalid-1589587116 {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 14:07:24.224181 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3457f537-b536-4ab6-abf6-6d9ccdbe9db7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] HTTP exception thrown: Instance tempest-invalid-1589587116 could not be found. Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3457f537-b536-4ab6-abf6-6d9ccdbe9db7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Request method failure captured: Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/tempest-invalid-1589587116/action HTTP/1.1 Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 112 Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JqSzWDjmp5-Z_KJXbfyXf6Wl1yikz2bQO2GhykSHYqBIcy-Ng-koxa09B7RpYqjkafVcWsAeZRMlF5Ex3o5H_PYIihAUqOT9I9E46y0uA9ed4ua3F8Rc4ZWbIqFy0xWbktPuMbr9r1RYAeh6w1TWvDVVsUnLrzOrHv6h94lU0EDnk Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}] Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b60da41ae2454edb8c9c11a323a1157e Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1972298615", "metadata": {"image_type": "test"}}} Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance tempest-invalid-1589587116 could not be found. Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'tempest-invalid-1589587116', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1972298615', 'metadata': {'image_type': 'test'}}}} Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1589587116 could not be found. Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:24.227728 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1589587116 could not be found. Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1589587116 could not be found. Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:24.235311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3457f537-b536-4ab6-abf6-6d9ccdbe9db7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Returning 404 to user: Instance tempest-invalid-1589587116 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:24.238667 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3457f537-b536-4ab6-abf6-6d9ccdbe9db7 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "POST /compute/v2.1/servers/tempest-invalid-1589587116/action" status: 404 len: 101 microversion: 2.1 time: 0.025552 Aug 04 14:07:24.247727 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1401/2794] 10.222.0.66 () {60 vars in 1249 bytes} [Thu Aug 4 14:07:24 2022] POST /compute/v2.1/servers/tempest-invalid-1589587116/action => generated 101 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:24.270601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61b2f45b-cf95-426e-a918-219d2d5d1109 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844627-10", "block_migration": false, "disk_over_commit": false}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:24.286674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61b2f45b-cf95-426e-a918-219d2d5d1109 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:24.310129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61b2f45b-cf95-426e-a918-219d2d5d1109 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:24.310798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61b2f45b-cf95-426e-a918-219d2d5d1109 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:24.311655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61b2f45b-cf95-426e-a918-219d2d5d1109 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:24.312104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61b2f45b-cf95-426e-a918-219d2d5d1109 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:24.592706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-61b2f45b-cf95-426e-a918-219d2d5d1109 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lazy-loading 'flavor' on Instance uuid 90627287-7390-448b-bc44-878c72306f4e {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:07:24.610056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61b2f45b-cf95-426e-a918-219d2d5d1109 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 90627287-7390-448b-bc44-878c72306f4e] Going to try to live migrate instance to n-h1-844627-10 {{(pid=130961) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 14:07:24.903890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-32c9fd49-c7dd-498d-9287-7e6998374d5d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:24.916419 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-32c9fd49-c7dd-498d-9287-7e6998374d5d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1327 microversion: 2.1 time: 0.996382 Aug 04 14:07:24.929230 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1394/2795] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:23 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1327 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:24.933353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f0d7b921-4d74-4cda-a2d1-458c5197895c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3c8d700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:25.007151 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f0d7b921-4d74-4cda-a2d1-458c5197895c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.087812 Aug 04 14:07:25.017019 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1395/2796] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:24 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:25.017019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f43d03a7-bf80-4d35-a172-6b9e047b4196 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1622389541"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:25.017019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f43d03a7-bf80-4d35-a172-6b9e047b4196 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 14:07:25.017821 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-f43d03a7-bf80-4d35-a172-6b9e047b4196 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f43d03a7-bf80-4d35-a172-6b9e047b4196 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Request method failure captured: Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 57 Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JqSzWDjmp5-Z_KJXbfyXf6Wl1yikz2bQO2GhykSHYqBIcy-Ng-koxa09B7RpYqjkafVcWsAeZRMlF5Ex3o5H_PYIihAUqOT9I9E46y0uA9ed4ua3F8Rc4ZWbIqFy0xWbktPuMbr9r1RYAeh6w1TWvDVVsUnLrzOrHv6h94lU0EDnk Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}] Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b60da41ae2454edb8c9c11a323a1157e Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: {"createImage": {"name": "tempest-test-snap-1622389541"}} Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1622389541'}}} Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.020677 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.026721 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:25.026721 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.026721 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:25.026721 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:25.026721 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:25.026721 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:25.026721 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:25.026721 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.026721 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.028970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f43d03a7-bf80-4d35-a172-6b9e047b4196 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:25.030312 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f43d03a7-bf80-4d35-a172-6b9e047b4196 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.020894 Aug 04 14:07:25.032469 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1396/2797] 10.222.0.66 () {60 vars in 1275 bytes} [Thu Aug 4 14:07:25 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:25.042351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88be7947-ce60-46dc-b1df-c1f920b14486 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:25.043901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-88be7947-ce60-46dc-b1df-c1f920b14486 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:25.053747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88be7947-ce60-46dc-b1df-c1f920b14486 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:25.054616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88be7947-ce60-46dc-b1df-c1f920b14486 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:25.055662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88be7947-ce60-46dc-b1df-c1f920b14486 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:25.059848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88be7947-ce60-46dc-b1df-c1f920b14486 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:25.311076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-88be7947-ce60-46dc-b1df-c1f920b14486 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:25.327450 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-88be7947-ce60-46dc-b1df-c1f920b14486 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1273 microversion: 2.1 time: 0.293500 Aug 04 14:07:25.328423 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1397/2798] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:25 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:25.345127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-31bb032d-128a-4c8f-8f94-355baee589fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:25.346027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-31bb032d-128a-4c8f-8f94-355baee589fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:25.355954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31bb032d-128a-4c8f-8f94-355baee589fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:25.358209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31bb032d-128a-4c8f-8f94-355baee589fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:25.361651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31bb032d-128a-4c8f-8f94-355baee589fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:25.367740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31bb032d-128a-4c8f-8f94-355baee589fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:25.846530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-31bb032d-128a-4c8f-8f94-355baee589fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:25.882882 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-31bb032d-128a-4c8f-8f94-355baee589fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.550770 Aug 04 14:07:25.886426 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1398/2799] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:25 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:25.905675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02f2047b-fd44-404e-9e7e-8753f450bbd5 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-500395684"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:25.918479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-02f2047b-fd44-404e-9e7e-8753f450bbd5 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 14:07:25.919376 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-02f2047b-fd44-404e-9e7e-8753f450bbd5 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02f2047b-fd44-404e-9e7e-8753f450bbd5 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Request method failure captured: Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 56 Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JqSzWDjmp5-Z_KJXbfyXf6Wl1yikz2bQO2GhykSHYqBIcy-Ng-koxa09B7RpYqjkafVcWsAeZRMlF5Ex3o5H_PYIihAUqOT9I9E46y0uA9ed4ua3F8Rc4ZWbIqFy0xWbktPuMbr9r1RYAeh6w1TWvDVVsUnLrzOrHv6h94lU0EDnk Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}] Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b60da41ae2454edb8c9c11a323a1157e Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: {"createImage": {"name": "tempest-test-snap-500395684"}} Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-500395684'}}} Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.922631 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02f2047b-fd44-404e-9e7e-8753f450bbd5 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:25.936310 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-02f2047b-fd44-404e-9e7e-8753f450bbd5 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.043880 Aug 04 14:07:25.939457 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1399/2800] 10.222.0.66 () {60 vars in 1281 bytes} [Thu Aug 4 14:07:25 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:25.957328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:25.963738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:25.996396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:25.997538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:25.999606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:26.000343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:26.056118 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] HTTP exception thrown: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Request method failure captured: Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae HTTP/1.1 Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JqSzWDjmp5-Z_KJXbfyXf6Wl1yikz2bQO2GhykSHYqBIcy-Ng-koxa09B7RpYqjkafVcWsAeZRMlF5Ex3o5H_PYIihAUqOT9I9E46y0uA9ed4ua3F8Rc4ZWbIqFy0xWbktPuMbr9r1RYAeh6w1TWvDVVsUnLrzOrHv6h94lU0EDnk Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}] Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b60da41ae2454edb8c9c11a323a1157e Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '13f46d95-33c2-4b11-9a77-ae7309334bae'} Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:26.059174 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Returning 404 to user: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-faad1433-c243-46d4-a990-3cc9cf47e5fd tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "DELETE /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 404 len: 111 microversion: 2.1 time: 0.112565 Aug 04 14:07:26.064251 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1400/2801] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:07:25 2022] DELETE /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:07:26.081576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd9f501c-9c2d-4d27-ae3d-ea1e514a5711 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:26.082830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cd9f501c-9c2d-4d27-ae3d-ea1e514a5711 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:26.093082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd9f501c-9c2d-4d27-ae3d-ea1e514a5711 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:26.094624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd9f501c-9c2d-4d27-ae3d-ea1e514a5711 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:26.095659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd9f501c-9c2d-4d27-ae3d-ea1e514a5711 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:26.097254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd9f501c-9c2d-4d27-ae3d-ea1e514a5711 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:26.494699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cd9f501c-9c2d-4d27-ae3d-ea1e514a5711 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:26.521343 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cd9f501c-9c2d-4d27-ae3d-ea1e514a5711 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1327 microversion: 2.1 time: 0.456904 Aug 04 14:07:26.522487 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1401/2802] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:26 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1327 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:26.544218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-14fe3a88-577d-4d8f-bf51-95dce7e83233 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f4705587ca0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:26.657590 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-14fe3a88-577d-4d8f-bf51-95dce7e83233 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.131326 Aug 04 14:07:26.685064 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1402/2803] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:26 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:26.698096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:26.699338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] [instance: 13f46d95-33c2-4b11-9a77-ae7309334bae] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:26.718961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:26.720474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:26.721614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:26.722168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:26.742700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] HTTP exception thrown: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Request method failure captured: Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae HTTP/1.1 Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JqSzWDjmp5-Z_KJXbfyXf6Wl1yikz2bQO2GhykSHYqBIcy-Ng-koxa09B7RpYqjkafVcWsAeZRMlF5Ex3o5H_PYIihAUqOT9I9E46y0uA9ed4ua3F8Rc4ZWbIqFy0xWbktPuMbr9r1RYAeh6w1TWvDVVsUnLrzOrHv6h94lU0EDnk Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18f8c6320ff146eea8e42f1ccffb4d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18f8c6320ff146eea8e42f1ccffb4d68"}]}] Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 18f8c6320ff146eea8e42f1ccffb4d68 Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2114985440 Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b60da41ae2454edb8c9c11a323a1157e Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesNegativeTestJSON-2114985440-project Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '13f46d95-33c2-4b11-9a77-ae7309334bae'} Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:26.744952 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.749974 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:26.749974 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:26.749974 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:26.749974 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:26.749974 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:26.749974 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. Aug 04 14:07:26.749974 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:26.749974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] Returning 404 to user: Instance 13f46d95-33c2-4b11-9a77-ae7309334bae could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:26.751824 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-94137b33-d3f6-4aaa-b452-39f7089dd319 tempest-ImagesNegativeTestJSON-2114985440 tempest-ImagesNegativeTestJSON-2114985440-project] 10.222.0.66 "GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae" status: 404 len: 111 microversion: 2.1 time: 0.068576 Aug 04 14:07:26.752836 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1403/2804] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:26 2022] GET /compute/v2.1/servers/13f46d95-33c2-4b11-9a77-ae7309334bae => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:26.767536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-187d4b42-9f8f-4dbc-a230-c46ced56b806 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:26.768949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-187d4b42-9f8f-4dbc-a230-c46ced56b806 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:26.790523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-187d4b42-9f8f-4dbc-a230-c46ced56b806 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:26.794600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-187d4b42-9f8f-4dbc-a230-c46ced56b806 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:26.798301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-187d4b42-9f8f-4dbc-a230-c46ced56b806 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:26.800098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-187d4b42-9f8f-4dbc-a230-c46ced56b806 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:27.273291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-187d4b42-9f8f-4dbc-a230-c46ced56b806 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:27.286770 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-187d4b42-9f8f-4dbc-a230-c46ced56b806 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1315 microversion: 2.1 time: 0.532280 Aug 04 14:07:27.289591 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1404/2805] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:26 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:27.295161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4a462395-b591-4c27-9d43-39832c863eb8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:27.300282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4a462395-b591-4c27-9d43-39832c863eb8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:27.342391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a462395-b591-4c27-9d43-39832c863eb8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:27.347059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a462395-b591-4c27-9d43-39832c863eb8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:27.350367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a462395-b591-4c27-9d43-39832c863eb8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:27.355437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a462395-b591-4c27-9d43-39832c863eb8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:27.799573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4a462395-b591-4c27-9d43-39832c863eb8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:27.834499 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4a462395-b591-4c27-9d43-39832c863eb8 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.542951 Aug 04 14:07:27.835506 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1405/2806] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:27 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:27.844820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c271e42c-54d6-49a7-895b-0fc79e663cfd req-5e272797-40c3-4238-9f80-34e0712686ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241427eb-b636-4440-851c-389485fb5de8", "name": "network-vif-plugged", "status": "completed", "tag": "250bd247-f808-4df8-9b56-1f15e9c20ae9"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:27.888829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c271e42c-54d6-49a7-895b-0fc79e663cfd req-5e272797-40c3-4238-9f80-34e0712686ba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:27.890898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c271e42c-54d6-49a7-895b-0fc79e663cfd req-5e272797-40c3-4238-9f80-34e0712686ba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:27.940102 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c271e42c-54d6-49a7-895b-0fc79e663cfd req-5e272797-40c3-4238-9f80-34e0712686ba service nova] Creating event network-vif-plugged:250bd247-f808-4df8-9b56-1f15e9c20ae9 for instance 241427eb-b636-4440-851c-389485fb5de8 on n-h2-844627-10 Aug 04 14:07:27.955798 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c271e42c-54d6-49a7-895b-0fc79e663cfd req-5e272797-40c3-4238-9f80-34e0712686ba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117644 Aug 04 14:07:27.958025 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1406/2807] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:27.969846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4c9c8614-de0c-46fe-b0dc-f2bfefc6bd55 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:27.972081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4c9c8614-de0c-46fe-b0dc-f2bfefc6bd55 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:27.985978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c9c8614-de0c-46fe-b0dc-f2bfefc6bd55 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:27.987246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c9c8614-de0c-46fe-b0dc-f2bfefc6bd55 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:27.992173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c9c8614-de0c-46fe-b0dc-f2bfefc6bd55 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:27.993530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c9c8614-de0c-46fe-b0dc-f2bfefc6bd55 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:28.030209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:28.243641 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61b2f45b-cf95-426e-a918-219d2d5d1109 tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e/action" status: 202 len: 0 microversion: 2.1 time: 3.992090 Aug 04 14:07:28.244830 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1402/2808] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:07:24 2022] POST /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e/action => generated 0 bytes in 4004 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:28.258560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-59635466-feb7-438a-8ef2-56060dd75959 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f37710d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:28.480741 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-59635466-feb7-438a-8ef2-56060dd75959 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.233497 Aug 04 14:07:28.484272 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1403/2809] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:28 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:28.496352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f4c6950d-1c26-447a-97cc-2dc909e2fa94 req-d6658f04-e4dc-447a-90d8-423def4f3ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc944906-6a27-4575-acca-c7d686fd5c17", "tag": "cc30f7e9-cac7-4c12-9e77-7c7f5994df71"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:28.523645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f4c6950d-1c26-447a-97cc-2dc909e2fa94 req-d6658f04-e4dc-447a-90d8-423def4f3ad0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:28.524840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f4c6950d-1c26-447a-97cc-2dc909e2fa94 req-d6658f04-e4dc-447a-90d8-423def4f3ad0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:28.557295 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f4c6950d-1c26-447a-97cc-2dc909e2fa94 req-d6658f04-e4dc-447a-90d8-423def4f3ad0 service nova] Creating event network-changed:cc30f7e9-cac7-4c12-9e77-7c7f5994df71 for instance dc944906-6a27-4575-acca-c7d686fd5c17 on n-h1-844627-10 Aug 04 14:07:28.569240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f4c6950d-1c26-447a-97cc-2dc909e2fa94 req-d6658f04-e4dc-447a-90d8-423def4f3ad0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081923 Aug 04 14:07:28.571305 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1404/2810] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:28.589809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6486758a-f1f5-42f5-abe4-8da3f6de3e57 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:28.591872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6486758a-f1f5-42f5-abe4-8da3f6de3e57 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:28.606864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6486758a-f1f5-42f5-abe4-8da3f6de3e57 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:28.607660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6486758a-f1f5-42f5-abe4-8da3f6de3e57 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:28.609303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6486758a-f1f5-42f5-abe4-8da3f6de3e57 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:28.610480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6486758a-f1f5-42f5-abe4-8da3f6de3e57 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:29.200348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4c9c8614-de0c-46fe-b0dc-f2bfefc6bd55 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:29.247017 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4c9c8614-de0c-46fe-b0dc-f2bfefc6bd55 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1327 microversion: 2.1 time: 1.281901 Aug 04 14:07:29.251722 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1407/2811] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:27 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1327 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:29.278997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c0c4925-2872-4111-a294-ad2bc205b309 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:29.281999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c0c4925-2872-4111-a294-ad2bc205b309 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:29.330790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c0c4925-2872-4111-a294-ad2bc205b309 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:29.335206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c0c4925-2872-4111-a294-ad2bc205b309 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:29.344000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c0c4925-2872-4111-a294-ad2bc205b309 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:29.345931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c0c4925-2872-4111-a294-ad2bc205b309 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:29.387951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6486758a-f1f5-42f5-abe4-8da3f6de3e57 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:29.405822 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6486758a-f1f5-42f5-abe4-8da3f6de3e57 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.831926 Aug 04 14:07:29.411558 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1405/2812] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:28 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:29.418188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4217aa8a-6148-4491-ba87-a51d0f828d6d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:29.427529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4217aa8a-6148-4491-ba87-a51d0f828d6d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:29.462206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4217aa8a-6148-4491-ba87-a51d0f828d6d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:29.472357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4217aa8a-6148-4491-ba87-a51d0f828d6d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:29.475313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4217aa8a-6148-4491-ba87-a51d0f828d6d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:29.484626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4217aa8a-6148-4491-ba87-a51d0f828d6d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:29.998015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7c0c4925-2872-4111-a294-ad2bc205b309 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:30.027199 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c0c4925-2872-4111-a294-ad2bc205b309 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1315 microversion: 2.1 time: 0.773513 Aug 04 14:07:30.032583 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1408/2813] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:29 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:30.048689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c846cc9-73db-4603-94a7-d1eae2dbf2e9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f39d2e50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:30.137431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4217aa8a-6148-4491-ba87-a51d0f828d6d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:30.185203 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4217aa8a-6148-4491-ba87-a51d0f828d6d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.768161 Aug 04 14:07:30.185875 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c846cc9-73db-4603-94a7-d1eae2dbf2e9 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.151172 Aug 04 14:07:30.186470 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1409/2814] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:30 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:30.187451 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1406/2815] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:29 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:30.291420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13a3edcc-99c9-4d3e-b83e-4a96cd5a519c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:30.294072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13a3edcc-99c9-4d3e-b83e-4a96cd5a519c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:30.315107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13a3edcc-99c9-4d3e-b83e-4a96cd5a519c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:30.316266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13a3edcc-99c9-4d3e-b83e-4a96cd5a519c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:30.318422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13a3edcc-99c9-4d3e-b83e-4a96cd5a519c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:30.319334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13a3edcc-99c9-4d3e-b83e-4a96cd5a519c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:30.451362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3e5d7523-7d31-494c-9c79-07fff90fa108 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:30.453908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3e5d7523-7d31-494c-9c79-07fff90fa108 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:30.468645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e5d7523-7d31-494c-9c79-07fff90fa108 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:30.469961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e5d7523-7d31-494c-9c79-07fff90fa108 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:30.472796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e5d7523-7d31-494c-9c79-07fff90fa108 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:30.474013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e5d7523-7d31-494c-9c79-07fff90fa108 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:30.617072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-13a3edcc-99c9-4d3e-b83e-4a96cd5a519c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:30.634817 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13a3edcc-99c9-4d3e-b83e-4a96cd5a519c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1327 microversion: 2.1 time: 0.353812 Aug 04 14:07:30.646800 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1407/2816] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:30 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1327 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:30.900575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3e5d7523-7d31-494c-9c79-07fff90fa108 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:30.916162 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3e5d7523-7d31-494c-9c79-07fff90fa108 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.476125 Aug 04 14:07:30.930070 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1410/2817] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:30 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:31.069981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-139081ba-348e-41af-b6f5-de2d1c966609 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:31.071154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-139081ba-348e-41af-b6f5-de2d1c966609 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:31.086672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-139081ba-348e-41af-b6f5-de2d1c966609 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:31.093376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-139081ba-348e-41af-b6f5-de2d1c966609 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:31.103158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-139081ba-348e-41af-b6f5-de2d1c966609 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:31.104092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-139081ba-348e-41af-b6f5-de2d1c966609 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:31.206043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=22 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:31.229616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d851a244-7d3e-4c45-9dba-c95ef5b1b457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:31.230633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d851a244-7d3e-4c45-9dba-c95ef5b1b457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:31.275835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d851a244-7d3e-4c45-9dba-c95ef5b1b457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:31.277087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d851a244-7d3e-4c45-9dba-c95ef5b1b457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:31.283927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d851a244-7d3e-4c45-9dba-c95ef5b1b457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:31.284821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d851a244-7d3e-4c45-9dba-c95ef5b1b457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:31.694979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=20 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:31.858566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-139081ba-348e-41af-b6f5-de2d1c966609 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:31.883952 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-139081ba-348e-41af-b6f5-de2d1c966609 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1315 microversion: 2.1 time: 0.812040 Aug 04 14:07:31.906841 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1408/2818] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:31 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1315 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:31.932367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f05eb5b-d57e-43e7-b16a-8953a01e1c88 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f36ff310>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:32.080207 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f05eb5b-d57e-43e7-b16a-8953a01e1c88 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.169087 Aug 04 14:07:32.100043 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1409/2819] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:31 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:32.148928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-33d7feb3-b1fc-4816-bc5a-10a1a2e8b4aa req-b8d7698f-4ce1-4471-8eb1-1909323a4e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a40a39-cbe8-47bc-8869-a88e59989f63", "name": "network-vif-plugged", "status": "completed", "tag": "19e85bce-c14d-4d20-89ef-01de05cf0ac7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:32.205215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-33d7feb3-b1fc-4816-bc5a-10a1a2e8b4aa req-b8d7698f-4ce1-4471-8eb1-1909323a4e8a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:32.228496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-33d7feb3-b1fc-4816-bc5a-10a1a2e8b4aa req-b8d7698f-4ce1-4471-8eb1-1909323a4e8a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:32.267190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d851a244-7d3e-4c45-9dba-c95ef5b1b457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:32.286398 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d851a244-7d3e-4c45-9dba-c95ef5b1b457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 1.080829 Aug 04 14:07:32.287711 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1411/2820] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:31 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:32.288713 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-33d7feb3-b1fc-4816-bc5a-10a1a2e8b4aa req-b8d7698f-4ce1-4471-8eb1-1909323a4e8a service nova] Creating event network-vif-plugged:19e85bce-c14d-4d20-89ef-01de05cf0ac7 for instance c8a40a39-cbe8-47bc-8869-a88e59989f63 on n-h2-844627-10 Aug 04 14:07:32.295868 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-33d7feb3-b1fc-4816-bc5a-10a1a2e8b4aa req-b8d7698f-4ce1-4471-8eb1-1909323a4e8a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191037 Aug 04 14:07:32.298146 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1410/2821] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:32.299657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a69c9edd-8e20-4b95-9634-77ba93cf24fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:32.306618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a69c9edd-8e20-4b95-9634-77ba93cf24fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:32.321798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a69c9edd-8e20-4b95-9634-77ba93cf24fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:32.323274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e66cc12-ed0f-4505-83b5-507d504040b0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:32.324107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e66cc12-ed0f-4505-83b5-507d504040b0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:32.325067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a69c9edd-8e20-4b95-9634-77ba93cf24fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:32.333005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a69c9edd-8e20-4b95-9634-77ba93cf24fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:32.334160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a69c9edd-8e20-4b95-9634-77ba93cf24fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:32.343484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e66cc12-ed0f-4505-83b5-507d504040b0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:32.344549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e66cc12-ed0f-4505-83b5-507d504040b0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:32.353421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e66cc12-ed0f-4505-83b5-507d504040b0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:32.354386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e66cc12-ed0f-4505-83b5-507d504040b0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:33.135191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e66cc12-ed0f-4505-83b5-507d504040b0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:33.151444 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e66cc12-ed0f-4505-83b5-507d504040b0 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.851366 Aug 04 14:07:33.156768 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1411/2822] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:32 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:33.175288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f471b437-b3f5-4f51-8d97-e6beb2ee80d6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:33.179522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f471b437-b3f5-4f51-8d97-e6beb2ee80d6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:33.213324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f471b437-b3f5-4f51-8d97-e6beb2ee80d6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:33.215385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f471b437-b3f5-4f51-8d97-e6beb2ee80d6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:33.219445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f471b437-b3f5-4f51-8d97-e6beb2ee80d6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:33.220248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f471b437-b3f5-4f51-8d97-e6beb2ee80d6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:33.396360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a69c9edd-8e20-4b95-9634-77ba93cf24fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:33.463765 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a69c9edd-8e20-4b95-9634-77ba93cf24fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1507 microversion: 2.1 time: 1.172006 Aug 04 14:07:33.482767 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1412/2823] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:32 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1507 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:33.526789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b0b36524-d413-47e3-bf12-d2ca9d47e582 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f4705590550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:33.633371 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b0b36524-d413-47e3-bf12-d2ca9d47e582 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.120750 Aug 04 14:07:33.634188 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1413/2824] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:33 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:33.649201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-54a6ec18-ac5a-4baa-ae5a-f5f9e485785e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:33.657617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-54a6ec18-ac5a-4baa-ae5a-f5f9e485785e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:33.676316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-54a6ec18-ac5a-4baa-ae5a-f5f9e485785e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:33.677013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-54a6ec18-ac5a-4baa-ae5a-f5f9e485785e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:33.677942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-54a6ec18-ac5a-4baa-ae5a-f5f9e485785e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:33.681959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-54a6ec18-ac5a-4baa-ae5a-f5f9e485785e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:33.855141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:33.891825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f471b437-b3f5-4f51-8d97-e6beb2ee80d6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:33.904392 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f471b437-b3f5-4f51-8d97-e6beb2ee80d6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1315 microversion: 2.1 time: 0.745691 Aug 04 14:07:33.909838 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1412/2825] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:33 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:33.929386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64aa0f78-4751-42f8-89af-866d3e273dad tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:33.930457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-64aa0f78-4751-42f8-89af-866d3e273dad tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:33.946108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64aa0f78-4751-42f8-89af-866d3e273dad tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:33.951980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64aa0f78-4751-42f8-89af-866d3e273dad tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:33.954754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64aa0f78-4751-42f8-89af-866d3e273dad tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:33.955750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64aa0f78-4751-42f8-89af-866d3e273dad tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:33.994630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:35.219656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-54a6ec18-ac5a-4baa-ae5a-f5f9e485785e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:35.266597 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-54a6ec18-ac5a-4baa-ae5a-f5f9e485785e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 1.614615 Aug 04 14:07:35.291682 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1414/2826] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:33 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:35.357377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f6b1069-64af-4ff1-9653-3766eed399f5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:35.368908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-64aa0f78-4751-42f8-89af-866d3e273dad tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:35.373641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3f6b1069-64af-4ff1-9653-3766eed399f5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:35.504255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f6b1069-64af-4ff1-9653-3766eed399f5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:35.516409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f6b1069-64af-4ff1-9653-3766eed399f5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:35.517623 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-64aa0f78-4751-42f8-89af-866d3e273dad tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1507 microversion: 2.1 time: 1.591831 Aug 04 14:07:35.554419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f6b1069-64af-4ff1-9653-3766eed399f5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:35.572548 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1413/2827] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:33 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1507 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:35.583788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f6b1069-64af-4ff1-9653-3766eed399f5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.058s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:35.628363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a0bb87e9-70d9-4c1f-b7d1-fc6d9e0413d2 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f36bf670>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:35.879972 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a0bb87e9-70d9-4c1f-b7d1-fc6d9e0413d2 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.305547 Aug 04 14:07:35.892132 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1414/2828] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:35 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:35.898189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70f3f1d3-c680-4b7e-8023-e7192c6bb4ee tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:35.898915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70f3f1d3-c680-4b7e-8023-e7192c6bb4ee tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:35.943681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70f3f1d3-c680-4b7e-8023-e7192c6bb4ee tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:35.944342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70f3f1d3-c680-4b7e-8023-e7192c6bb4ee tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:35.945460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70f3f1d3-c680-4b7e-8023-e7192c6bb4ee tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:35.948305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70f3f1d3-c680-4b7e-8023-e7192c6bb4ee tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:36.421495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f6b1069-64af-4ff1-9653-3766eed399f5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:36.433930 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3f6b1069-64af-4ff1-9653-3766eed399f5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 1.136500 Aug 04 14:07:36.436714 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1415/2829] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:35 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:36.457442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f2d49c80-25d0-4112-a8b0-ed48da3b8c2c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:36.458725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2d49c80-25d0-4112-a8b0-ed48da3b8c2c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:36.490585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2d49c80-25d0-4112-a8b0-ed48da3b8c2c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:36.491288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2d49c80-25d0-4112-a8b0-ed48da3b8c2c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:36.492326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2d49c80-25d0-4112-a8b0-ed48da3b8c2c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:36.494420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2d49c80-25d0-4112-a8b0-ed48da3b8c2c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:36.509567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-70f3f1d3-c680-4b7e-8023-e7192c6bb4ee tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:36.565940 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70f3f1d3-c680-4b7e-8023-e7192c6bb4ee tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1315 microversion: 2.1 time: 0.670323 Aug 04 14:07:36.572525 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1415/2830] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:35 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:36.583341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2d49c80-25d0-4112-a8b0-ed48da3b8c2c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:07:36.592728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a217f8c-57aa-45a7-8ad7-05158ab23809 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:36.596813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9a217f8c-57aa-45a7-8ad7-05158ab23809 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:36.650276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a217f8c-57aa-45a7-8ad7-05158ab23809 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:36.654914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a217f8c-57aa-45a7-8ad7-05158ab23809 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:36.660427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a217f8c-57aa-45a7-8ad7-05158ab23809 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:36.662925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a217f8c-57aa-45a7-8ad7-05158ab23809 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:36.841290 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f2d49c80-25d0-4112-a8b0-ed48da3b8c2c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 204 len: 0 microversion: 2.1 time: 0.401674 Aug 04 14:07:36.845387 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1416/2831] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:07:36 2022] DELETE /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:07:36.858667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-119940e3-d395-4045-9ca7-ed53d47eb5fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:36.866482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-119940e3-d395-4045-9ca7-ed53d47eb5fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:36.886216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-119940e3-d395-4045-9ca7-ed53d47eb5fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:36.887095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-119940e3-d395-4045-9ca7-ed53d47eb5fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:36.888176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-119940e3-d395-4045-9ca7-ed53d47eb5fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:36.889031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-119940e3-d395-4045-9ca7-ed53d47eb5fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:37.287860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9a217f8c-57aa-45a7-8ad7-05158ab23809 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:37.304450 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a217f8c-57aa-45a7-8ad7-05158ab23809 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.728914 Aug 04 14:07:37.310548 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1416/2832] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:36 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:37.323646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-62d4eb72-1b66-444d-b49e-7e1f5d78bd5c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f373b5e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:37.445487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-119940e3-d395-4045-9ca7-ed53d47eb5fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:37.484206 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-119940e3-d395-4045-9ca7-ed53d47eb5fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1513 microversion: 2.1 time: 0.636534 Aug 04 14:07:37.488398 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-62d4eb72-1b66-444d-b49e-7e1f5d78bd5c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.175034 Aug 04 14:07:37.496542 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1417/2833] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:37 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:37.499713 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1417/2834] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:36 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1513 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:37.513468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-efa91118-797c-46e8-8876-9aeceda22295 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:37.513468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-efa91118-797c-46e8-8876-9aeceda22295 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:37.563549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efa91118-797c-46e8-8876-9aeceda22295 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:37.566477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efa91118-797c-46e8-8876-9aeceda22295 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:37.575597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efa91118-797c-46e8-8876-9aeceda22295 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:37.577756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efa91118-797c-46e8-8876-9aeceda22295 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:37.616145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6102e6cf-44af-43cc-91a6-637d59757595 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:37.621618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6102e6cf-44af-43cc-91a6-637d59757595 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:37.664092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6102e6cf-44af-43cc-91a6-637d59757595 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:37.666942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6102e6cf-44af-43cc-91a6-637d59757595 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:37.670600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6102e6cf-44af-43cc-91a6-637d59757595 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:37.674409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6102e6cf-44af-43cc-91a6-637d59757595 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:38.250975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-efa91118-797c-46e8-8876-9aeceda22295 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:38.270865 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-efa91118-797c-46e8-8876-9aeceda22295 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.763763 Aug 04 14:07:38.285890 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1418/2835] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:37 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:38.332307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d840209b-2a5d-46c1-8849-5a54d1be3220 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:38.332983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d840209b-2a5d-46c1-8849-5a54d1be3220 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:38.349070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d840209b-2a5d-46c1-8849-5a54d1be3220 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:38.349538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d840209b-2a5d-46c1-8849-5a54d1be3220 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:38.350444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d840209b-2a5d-46c1-8849-5a54d1be3220 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:38.350897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d840209b-2a5d-46c1-8849-5a54d1be3220 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:38.716046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6102e6cf-44af-43cc-91a6-637d59757595 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:38.733322 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6102e6cf-44af-43cc-91a6-637d59757595 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1315 microversion: 2.1 time: 1.138088 Aug 04 14:07:38.734300 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1418/2836] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:37 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:38.740033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e1a3c1d0-e52a-43e8-a015-1014c49903ba tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f470007ea60>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:38.858773 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e1a3c1d0-e52a-43e8-a015-1014c49903ba tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.123103 Aug 04 14:07:38.859517 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1419/2837] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:38 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:38.877673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33c4d735-4c36-4701-b7d5-aecf01aad4cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:38.878303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-33c4d735-4c36-4701-b7d5-aecf01aad4cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:38.889339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:38.908333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33c4d735-4c36-4701-b7d5-aecf01aad4cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:38.909047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33c4d735-4c36-4701-b7d5-aecf01aad4cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:38.928540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33c4d735-4c36-4701-b7d5-aecf01aad4cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:38.931397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33c4d735-4c36-4701-b7d5-aecf01aad4cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:40.413393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d840209b-2a5d-46c1-8849-5a54d1be3220 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:40.457724 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d840209b-2a5d-46c1-8849-5a54d1be3220 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 2.126959 Aug 04 14:07:40.458731 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1419/2838] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:38 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 2132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:40.470926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12f9425e-83de-4e38-ad42-06339bd4aa29 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:40.472003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12f9425e-83de-4e38-ad42-06339bd4aa29 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:40.490625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12f9425e-83de-4e38-ad42-06339bd4aa29 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:40.491325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12f9425e-83de-4e38-ad42-06339bd4aa29 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:40.492384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12f9425e-83de-4e38-ad42-06339bd4aa29 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:40.493097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12f9425e-83de-4e38-ad42-06339bd4aa29 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:40.666236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-33c4d735-4c36-4701-b7d5-aecf01aad4cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:40.720030 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-33c4d735-4c36-4701-b7d5-aecf01aad4cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1513 microversion: 2.1 time: 1.859116 Aug 04 14:07:40.720680 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1420/2839] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:38 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1513 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:40.731858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bdba8a2c-150a-4814-a40f-746a18722762 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:40.732519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bdba8a2c-150a-4814-a40f-746a18722762 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:40.756261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdba8a2c-150a-4814-a40f-746a18722762 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:40.756714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdba8a2c-150a-4814-a40f-746a18722762 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:40.757604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdba8a2c-150a-4814-a40f-746a18722762 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:40.758048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdba8a2c-150a-4814-a40f-746a18722762 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:41.125507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12f9425e-83de-4e38-ad42-06339bd4aa29 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:41.148701 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12f9425e-83de-4e38-ad42-06339bd4aa29 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.679350 Aug 04 14:07:41.150345 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1420/2840] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:40 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:41.165235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d945ce5-e550-4162-a699-142f1c45ea8f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f373bc10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:41.310213 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d945ce5-e550-4162-a699-142f1c45ea8f tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.157893 Aug 04 14:07:41.311174 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1421/2841] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:41 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:41.324824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c91257c4-ae34-4dd5-86cb-8b407ccb8bee req-9d37b507-7ffa-4f21-960b-c4a1a57372e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc944906-6a27-4575-acca-c7d686fd5c17", "name": "network-vif-plugged", "status": "completed", "tag": "cc30f7e9-cac7-4c12-9e77-7c7f5994df71"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:41.360643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c91257c4-ae34-4dd5-86cb-8b407ccb8bee req-9d37b507-7ffa-4f21-960b-c4a1a57372e9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:41.367987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c91257c4-ae34-4dd5-86cb-8b407ccb8bee req-9d37b507-7ffa-4f21-960b-c4a1a57372e9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:41.411249 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c91257c4-ae34-4dd5-86cb-8b407ccb8bee req-9d37b507-7ffa-4f21-960b-c4a1a57372e9 service nova] Creating event network-vif-plugged:cc30f7e9-cac7-4c12-9e77-7c7f5994df71 for instance dc944906-6a27-4575-acca-c7d686fd5c17 on n-h1-844627-10 Aug 04 14:07:41.441338 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c91257c4-ae34-4dd5-86cb-8b407ccb8bee req-9d37b507-7ffa-4f21-960b-c4a1a57372e9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127492 Aug 04 14:07:41.446151 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1422/2842] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:41.499204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cff64021-cd71-4341-9a98-e19cc80f4a7e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:41.502215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cff64021-cd71-4341-9a98-e19cc80f4a7e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:41.522532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cff64021-cd71-4341-9a98-e19cc80f4a7e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:41.522996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cff64021-cd71-4341-9a98-e19cc80f4a7e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:41.523814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cff64021-cd71-4341-9a98-e19cc80f4a7e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:41.524259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cff64021-cd71-4341-9a98-e19cc80f4a7e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:41.744349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bdba8a2c-150a-4814-a40f-746a18722762 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:41.763126 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bdba8a2c-150a-4814-a40f-746a18722762 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1315 microversion: 2.1 time: 1.041168 Aug 04 14:07:41.764151 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1421/2843] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:40 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1315 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:41.796123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f6bc4115-da5f-4133-9fc8-64dea0a6c163 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:41.796792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f6bc4115-da5f-4133-9fc8-64dea0a6c163 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:41.831157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6bc4115-da5f-4133-9fc8-64dea0a6c163 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:41.831683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6bc4115-da5f-4133-9fc8-64dea0a6c163 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:41.839336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6bc4115-da5f-4133-9fc8-64dea0a6c163 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:41.840226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6bc4115-da5f-4133-9fc8-64dea0a6c163 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:42.360798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f6bc4115-da5f-4133-9fc8-64dea0a6c163 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:42.389054 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f6bc4115-da5f-4133-9fc8-64dea0a6c163 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 200 len: 1471 microversion: 2.1 time: 0.623500 Aug 04 14:07:42.395457 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1422/2844] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:41 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 1471 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:42.409134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e3f290bb-dcb1-4f8e-8e20-7621c733a6ed req-c175d0c3-155d-462d-9ef1-31e343a2cdfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241427eb-b636-4440-851c-389485fb5de8", "name": "network-vif-deleted", "tag": "250bd247-f808-4df8-9b56-1f15e9c20ae9"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:42.464443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e3f290bb-dcb1-4f8e-8e20-7621c733a6ed req-c175d0c3-155d-462d-9ef1-31e343a2cdfa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:42.468468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e3f290bb-dcb1-4f8e-8e20-7621c733a6ed req-c175d0c3-155d-462d-9ef1-31e343a2cdfa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:42.534979 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e3f290bb-dcb1-4f8e-8e20-7621c733a6ed req-c175d0c3-155d-462d-9ef1-31e343a2cdfa service nova] Creating event network-vif-deleted:250bd247-f808-4df8-9b56-1f15e9c20ae9 for instance 241427eb-b636-4440-851c-389485fb5de8 on n-h2-844627-10 Aug 04 14:07:42.567253 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e3f290bb-dcb1-4f8e-8e20-7621c733a6ed req-c175d0c3-155d-462d-9ef1-31e343a2cdfa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168901 Aug 04 14:07:42.574192 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1423/2845] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:42.596537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ecbd7159-fb36-49c1-af6b-7453dbdef07a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:42.598739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ecbd7159-fb36-49c1-af6b-7453dbdef07a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:42.631152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecbd7159-fb36-49c1-af6b-7453dbdef07a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:42.631996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecbd7159-fb36-49c1-af6b-7453dbdef07a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:42.633524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecbd7159-fb36-49c1-af6b-7453dbdef07a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:42.641177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecbd7159-fb36-49c1-af6b-7453dbdef07a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:42.841221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cff64021-cd71-4341-9a98-e19cc80f4a7e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:42.871695 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cff64021-cd71-4341-9a98-e19cc80f4a7e tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 1.377104 Aug 04 14:07:42.893247 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1423/2846] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:41 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:42.920359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b6b2df0a-08df-4138-9080-35160994bf49 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3710a60>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:43.048241 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b6b2df0a-08df-4138-9080-35160994bf49 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.152603 Aug 04 14:07:43.054493 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1424/2847] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:42 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:43.074056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2d18b2e3-7c8d-4642-9878-120920e8e535 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:43.075706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2d18b2e3-7c8d-4642-9878-120920e8e535 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:43.103638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d18b2e3-7c8d-4642-9878-120920e8e535 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:43.106152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d18b2e3-7c8d-4642-9878-120920e8e535 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:43.109370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d18b2e3-7c8d-4642-9878-120920e8e535 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:43.110576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d18b2e3-7c8d-4642-9878-120920e8e535 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:43.549185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ecbd7159-fb36-49c1-af6b-7453dbdef07a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:43.571927 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ecbd7159-fb36-49c1-af6b-7453dbdef07a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.992328 Aug 04 14:07:43.581073 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1424/2848] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:42 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:43.586871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:43.600914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:43.623807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:43.625106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:43.629676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:43.637047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:43.685626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2d18b2e3-7c8d-4642-9878-120920e8e535 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:43.693742 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:07:43.695021 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2d18b2e3-7c8d-4642-9878-120920e8e535 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1315 microversion: 2.1 time: 0.638632 Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 HTTP/1.1 Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '241427eb-b636-4440-851c-389485fb5de8'} Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:43.707222 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:43.711529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:43.711529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:43.711529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:43.711529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:43.711529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:43.711529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:07:43.711529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:43.711978 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1425/2849] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:43 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:43.714124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:43.715701 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-53c93c4e-2148-4b00-bb55-40cf7fed0436 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 404 len: 111 microversion: 2.1 time: 0.133004 Aug 04 14:07:43.721098 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1425/2850] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:43 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:43.727525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b1a0d69d-6861-491e-8f36-b2199387ab51 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '.version_select at 0x7f4700a7ce50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:43.779714 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b1a0d69d-6861-491e-8f36-b2199387ab51 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-key-991750562" status: 202 len: 0 microversion: 2.1 time: 0.056812 Aug 04 14:07:43.781030 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1426/2851] 10.222.0.66 () {58 vars in 1206 bytes} [Thu Aug 4 14:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-991750562 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:43.916518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6526e88e-13c6-4aab-a438-3d93b171e7bf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:43.926625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6526e88e-13c6-4aab-a438-3d93b171e7bf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:43.993830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6526e88e-13c6-4aab-a438-3d93b171e7bf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:43.995095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6526e88e-13c6-4aab-a438-3d93b171e7bf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:44.002822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6526e88e-13c6-4aab-a438-3d93b171e7bf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:44.007221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6526e88e-13c6-4aab-a438-3d93b171e7bf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:44.069366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-371b2a22-93c9-4f40-b45b-385bfeaec06c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3778e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:44.175705 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-371b2a22-93c9-4f40-b45b-385bfeaec06c tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.110160 Aug 04 14:07:44.179494 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1427/2852] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:44 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:44.272378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1663155490", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "2344a004-88b5-43d1-a0c7-ab45883f4f84"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:44.394424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] validate_networks() for [('2344a004-88b5-43d1-a0c7-ab45883f4f84', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:07:44.945948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6526e88e-13c6-4aab-a438-3d93b171e7bf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:44.951138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:44.966404 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6526e88e-13c6-4aab-a438-3d93b171e7bf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 1.057630 Aug 04 14:07:44.972683 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1426/2853] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:43 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:07:44.996888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d9500cb-e1d4-4cc5-a2ee-6b65051e6fea tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:44.999350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d9500cb-e1d4-4cc5-a2ee-6b65051e6fea tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:45.031470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d9500cb-e1d4-4cc5-a2ee-6b65051e6fea tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:45.033147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d9500cb-e1d4-4cc5-a2ee-6b65051e6fea tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:45.038083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d9500cb-e1d4-4cc5-a2ee-6b65051e6fea tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:45.040661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d9500cb-e1d4-4cc5-a2ee-6b65051e6fea tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:45.717832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d9500cb-e1d4-4cc5-a2ee-6b65051e6fea tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:45.732424 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d9500cb-e1d4-4cc5-a2ee-6b65051e6fea tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.757427 Aug 04 14:07:45.749725 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1427/2854] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:44 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:45.754940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-69f04c01-8e6a-437a-b3c9-40dec205494a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:45.756908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-69f04c01-8e6a-437a-b3c9-40dec205494a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:45.787702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-69f04c01-8e6a-437a-b3c9-40dec205494a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:45.788626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-69f04c01-8e6a-437a-b3c9-40dec205494a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:45.789920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-69f04c01-8e6a-437a-b3c9-40dec205494a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:45.790600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-69f04c01-8e6a-437a-b3c9-40dec205494a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:46.571081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:07:46.572080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:07:46.572080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:07:46.572407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:07:46.573078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:07:46.599588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:46.602654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:46.604535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:46.608614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:46.643924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-69f04c01-8e6a-437a-b3c9-40dec205494a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:46.661150 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-69f04c01-8e6a-437a-b3c9-40dec205494a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1501 microversion: 2.1 time: 0.918169 Aug 04 14:07:46.661755 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1428/2855] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:45 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1501 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:46.681803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:07:46.685996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-84514af2-1138-424f-a0e0-d53d2a1a5bf7 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f47055239d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:46.711966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for user df576732ca5c442694d507fd4dc58279 and project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:07:46.741079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:46.835630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:07:46.859757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:07:46.864032 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-84514af2-1138-424f-a0e0-d53d2a1a5bf7 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.181923 Aug 04 14:07:46.865948 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1429/2856] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:46 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:46.898877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-258e8a30-a08b-4655-99ba-425f5b3bd041 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:46.900093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-258e8a30-a08b-4655-99ba-425f5b3bd041 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:46.927174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-258e8a30-a08b-4655-99ba-425f5b3bd041 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:46.927998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-258e8a30-a08b-4655-99ba-425f5b3bd041 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:46.930691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-258e8a30-a08b-4655-99ba-425f5b3bd041 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:46.932132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-258e8a30-a08b-4655-99ba-425f5b3bd041 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:47.200033 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a8dcaf63-834b-4d3a-b28a-bc8a88580515 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.931114 Aug 04 14:07:47.235755 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1428/2857] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:07:47.317835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-adb65ac6-8a2d-42ed-8295-1bc262b7a969 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:47.327407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-adb65ac6-8a2d-42ed-8295-1bc262b7a969 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:47.369932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adb65ac6-8a2d-42ed-8295-1bc262b7a969 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:47.371470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adb65ac6-8a2d-42ed-8295-1bc262b7a969 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:47.376286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adb65ac6-8a2d-42ed-8295-1bc262b7a969 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:47.382457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adb65ac6-8a2d-42ed-8295-1bc262b7a969 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:47.603022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-258e8a30-a08b-4655-99ba-425f5b3bd041 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:47.665503 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-258e8a30-a08b-4655-99ba-425f5b3bd041 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.783686 Aug 04 14:07:47.677080 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1430/2858] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:46 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:47.713770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0885387f-9410-4741-b00b-dc8a2d6d7382 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:47.715470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0885387f-9410-4741-b00b-dc8a2d6d7382 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:48.647779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-adb65ac6-8a2d-42ed-8295-1bc262b7a969 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:48.708848 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-adb65ac6-8a2d-42ed-8295-1bc262b7a969 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 1.470519 Aug 04 14:07:48.728109 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1429/2859] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:47 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:48.768355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-614bac28-37e8-4157-9219-8bfd2bcd3c40 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f373bf70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:48.781741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0885387f-9410-4741-b00b-dc8a2d6d7382 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:48.882797 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0885387f-9410-4741-b00b-dc8a2d6d7382 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1209 microversion: 2.1 time: 1.201699 Aug 04 14:07:48.904026 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-614bac28-37e8-4157-9219-8bfd2bcd3c40 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.174451 Aug 04 14:07:48.912793 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1431/2861] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:47 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1209 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:48.915894 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1430/2861] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:48 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:48.951469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4a186b8e-3fe3-4a3c-8988-0cf012f015a4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:48.964763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4a186b8e-3fe3-4a3c-8988-0cf012f015a4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:48.990974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a186b8e-3fe3-4a3c-8988-0cf012f015a4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:48.992151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a186b8e-3fe3-4a3c-8988-0cf012f015a4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:48.998731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a186b8e-3fe3-4a3c-8988-0cf012f015a4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:48.999573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a186b8e-3fe3-4a3c-8988-0cf012f015a4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:49.634988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64779635-a02b-419f-9c7c-88d0cc8afde2 tempest-AZV2TestJSON-1849967353 tempest-AZV2TestJSON-1849967353-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:49.637409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64779635-a02b-419f-9c7c-88d0cc8afde2 tempest-AZV2TestJSON-1849967353 tempest-AZV2TestJSON-1849967353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:49.637872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64779635-a02b-419f-9c7c-88d0cc8afde2 tempest-AZV2TestJSON-1849967353 tempest-AZV2TestJSON-1849967353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:49.638696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64779635-a02b-419f-9c7c-88d0cc8afde2 tempest-AZV2TestJSON-1849967353 tempest-AZV2TestJSON-1849967353-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:49.639169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64779635-a02b-419f-9c7c-88d0cc8afde2 tempest-AZV2TestJSON-1849967353 tempest-AZV2TestJSON-1849967353-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:49.685437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4a186b8e-3fe3-4a3c-8988-0cf012f015a4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:49.699042 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4a186b8e-3fe3-4a3c-8988-0cf012f015a4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1521 microversion: 2.1 time: 0.784271 Aug 04 14:07:49.705070 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1432/2862] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:48 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1521 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:49.757331 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-64779635-a02b-419f-9c7c-88d0cc8afde2 tempest-AZV2TestJSON-1849967353 tempest-AZV2TestJSON-1849967353-project] 10.222.0.66 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.641999 Aug 04 14:07:49.765846 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1431/2863] 10.222.0.66 () {58 vars in 1164 bytes} [Thu Aug 4 14:07:49 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 14:07:49.781721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6699cc05-37bd-4b59-a1cf-a7c1888640bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:49.782489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6699cc05-37bd-4b59-a1cf-a7c1888640bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:49.814575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6699cc05-37bd-4b59-a1cf-a7c1888640bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:49.815017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6699cc05-37bd-4b59-a1cf-a7c1888640bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:49.822998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6699cc05-37bd-4b59-a1cf-a7c1888640bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:49.825159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6699cc05-37bd-4b59-a1cf-a7c1888640bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:49.934916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0d18723f-598a-4bae-ba87-5166d4ceb781 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f373b040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:50.109120 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0d18723f-598a-4bae-ba87-5166d4ceb781 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.192447 Aug 04 14:07:50.113805 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1432/2864] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:49 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:07:50.132585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b0f278b5-4148-4c39-ab6f-3ab058eee484 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:50.135113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b0f278b5-4148-4c39-ab6f-3ab058eee484 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:50.158634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0f278b5-4148-4c39-ab6f-3ab058eee484 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:50.161110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0f278b5-4148-4c39-ab6f-3ab058eee484 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:50.165241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0f278b5-4148-4c39-ab6f-3ab058eee484 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:50.169777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0f278b5-4148-4c39-ab6f-3ab058eee484 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:50.617431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b0f278b5-4148-4c39-ab6f-3ab058eee484 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:50.629973 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b0f278b5-4148-4c39-ab6f-3ab058eee484 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1205 microversion: 2.1 time: 0.513261 Aug 04 14:07:50.637648 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1433/2865] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:50 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1205 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:50.750828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6914dd7b-baed-4591-9965-c63c98b5c443 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:50.751467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6914dd7b-baed-4591-9965-c63c98b5c443 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:50.771656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6914dd7b-baed-4591-9965-c63c98b5c443 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:50.772488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6914dd7b-baed-4591-9965-c63c98b5c443 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:50.788998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6914dd7b-baed-4591-9965-c63c98b5c443 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:50.789808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6914dd7b-baed-4591-9965-c63c98b5c443 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:50.928372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6699cc05-37bd-4b59-a1cf-a7c1888640bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:50.944892 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6699cc05-37bd-4b59-a1cf-a7c1888640bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 1.177763 Aug 04 14:07:50.957365 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1433/2866] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:49 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:51.127732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-16f429ef-71be-4b3b-8481-01bf873a8c77 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f4705598040>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:51.294725 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-16f429ef-71be-4b3b-8481-01bf873a8c77 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.171265 Aug 04 14:07:51.295681 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1434/2867] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:51 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:07:51.555606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6914dd7b-baed-4591-9965-c63c98b5c443 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:51.572710 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6914dd7b-baed-4591-9965-c63c98b5c443 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1501 microversion: 2.1 time: 0.825805 Aug 04 14:07:51.577167 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1434/2868] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:50 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1501 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:07:51.634984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1cbb12f-2291-4a7a-95e2-47dec2f81ba0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:51.636434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1cbb12f-2291-4a7a-95e2-47dec2f81ba0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:51.665560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7bc4a56a-c786-4e8b-87ea-f4aa43868d7d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:51.666285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7bc4a56a-c786-4e8b-87ea-f4aa43868d7d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:51.669251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1cbb12f-2291-4a7a-95e2-47dec2f81ba0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:51.669819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1cbb12f-2291-4a7a-95e2-47dec2f81ba0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:51.682568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1cbb12f-2291-4a7a-95e2-47dec2f81ba0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:51.683109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1cbb12f-2291-4a7a-95e2-47dec2f81ba0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:51.689625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7bc4a56a-c786-4e8b-87ea-f4aa43868d7d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:51.690093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7bc4a56a-c786-4e8b-87ea-f4aa43868d7d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:51.691535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7bc4a56a-c786-4e8b-87ea-f4aa43868d7d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:51.691927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7bc4a56a-c786-4e8b-87ea-f4aa43868d7d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:51.963583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7bc4a56a-c786-4e8b-87ea-f4aa43868d7d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:51.979847 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7bc4a56a-c786-4e8b-87ea-f4aa43868d7d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1279 microversion: 2.1 time: 0.327373 Aug 04 14:07:51.982104 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1435/2869] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:51 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1279 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:52.336103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1cbb12f-2291-4a7a-95e2-47dec2f81ba0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:52.349543 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1cbb12f-2291-4a7a-95e2-47dec2f81ba0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1514 microversion: 2.1 time: 0.725858 Aug 04 14:07:52.353072 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1435/2870] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:51 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1514 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:52.362760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-66f5c4fc-02c3-4ab6-89fa-3dd2d6dfe722 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:52.363905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-66f5c4fc-02c3-4ab6-89fa-3dd2d6dfe722 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:52.391329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66f5c4fc-02c3-4ab6-89fa-3dd2d6dfe722 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:52.393609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66f5c4fc-02c3-4ab6-89fa-3dd2d6dfe722 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:52.403465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66f5c4fc-02c3-4ab6-89fa-3dd2d6dfe722 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:52.412446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66f5c4fc-02c3-4ab6-89fa-3dd2d6dfe722 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:52.522303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1aab3db-a018-497b-9a3a-c2575f3980d8 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Calling method '.version_select at 0x7f46f36dbf70>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:52.795402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-e1aab3db-a018-497b-9a3a-c2575f3980d8 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 15983835-9bb4-4454-aff4-3eb277f8e9dc does not exist", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:07:52.796828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.security_group_api [None req-e1aab3db-a018-497b-9a3a-c2575f3980d8 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Neutron security group 15983835-9bb4-4454-aff4-3eb277f8e9dc not found {{(pid=130961) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:07:52.797823 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e1aab3db-a018-497b-9a3a-c2575f3980d8 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] HTTP exception thrown: Security group 15983835-9bb4-4454-aff4-3eb277f8e9dc does not exist Aug 04 14:07:52.797823 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-af4ddb48-b010-4b8c-b887-cbbdee35706a'] Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1aab3db-a018-497b-9a3a-c2575f3980d8 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Request method failure captured: Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-security-groups/15983835-9bb4-4454-aff4-3eb277f8e9dc HTTP/1.1 Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69K3Fd3Hbg_AsWX-Ep2ME6u_vrcwnl2H2k5zlwwBE5CplWt99AQWI0xZp6rF2hWHmsQq205v69IyepPvhNj26fW4T7OvO6377G2_SvEzxf_SNzjrQQ3jK1p5lqU2CFbI3xn0YLWwBYo_77vjYGU4UZttWw1Vnjz-2n6jl2JLJ3sNFY0 Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 0d2bad600b0f4ade9faf28b65994d1ce Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d2bad600b0f4ade9faf28b65994d1ce"}]}] Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 0d2bad600b0f4ade9faf28b65994d1ce Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsNegativeTestJSON-1447010674-project Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 29ba8db3222e40bf94a462af6364ccce Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674-project Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: exception: Security group 15983835-9bb4-4454-aff4-3eb277f8e9dc does not exist Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-af4ddb48-b010-4b8c-b887-cbbdee35706a'] Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '15983835-9bb4-4454-aff4-3eb277f8e9dc'} Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:07:52.800804 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 15983835-9bb4-4454-aff4-3eb277f8e9dc does not exist Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af4ddb48-b010-4b8c-b887-cbbdee35706a'] Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 15983835-9bb4-4454-aff4-3eb277f8e9dc does not exist Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af4ddb48-b010-4b8c-b887-cbbdee35706a'] Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 15983835-9bb4-4454-aff4-3eb277f8e9dc does not exist Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af4ddb48-b010-4b8c-b887-cbbdee35706a'] Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 15983835-9bb4-4454-aff4-3eb277f8e9dc does not exist Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af4ddb48-b010-4b8c-b887-cbbdee35706a'] Aug 04 14:07:52.805095 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:52.811691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1aab3db-a018-497b-9a3a-c2575f3980d8 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Returning 404 to user: Security group 15983835-9bb4-4454-aff4-3eb277f8e9dc does not exist Aug 04 14:07:52.811691 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-af4ddb48-b010-4b8c-b887-cbbdee35706a'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:52.813092 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e1aab3db-a018-497b-9a3a-c2575f3980d8 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/15983835-9bb4-4454-aff4-3eb277f8e9dc" status: 404 len: 194 microversion: 2.1 time: 0.829512 Aug 04 14:07:52.814340 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1436/2871] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:07:51 2022] DELETE /compute/v2.1/os-security-groups/15983835-9bb4-4454-aff4-3eb277f8e9dc => generated 194 bytes in 831 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:52.826802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ed265ced-5d41-4589-8d4b-97baa75190db tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f36bf670>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:53.203425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-66f5c4fc-02c3-4ab6-89fa-3dd2d6dfe722 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:53.230308 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-66f5c4fc-02c3-4ab6-89fa-3dd2d6dfe722 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.870169 Aug 04 14:07:53.236468 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1436/2872] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:52 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:53.263996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-58a9df95-2646-484f-8227-44a9eb3483d0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:53.287827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-58a9df95-2646-484f-8227-44a9eb3483d0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: a520f045-c4e4-4182-9fca-fc65620e0337] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:53.314819 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-58a9df95-2646-484f-8227-44a9eb3483d0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] HTTP exception thrown: Instance a520f045-c4e4-4182-9fca-fc65620e0337 could not be found. Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-58a9df95-2646-484f-8227-44a9eb3483d0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Request method failure captured: Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/a520f045-c4e4-4182-9fca-fc65620e0337/action HTTP/1.1 Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 14 Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JxokQZWt73oCTeb2uIT1T61PPtBceW-GidRWsXDOZjQVnibDMlYFve8J2CmvNSqnoJ2gUswAJOQhT5G9sx82VvrXKfhYzVPLV5Gd4BsYAE7SpJCYfj1C3r3f1XD7yVS8i5KHJX727wlQRlE5KUXS609Oac6ysS4Xt8O7zqu2gmqzI Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}] Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 653fb03c7a4b4a61a57ecd4cdd610e86 Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: {"rescue": {}} Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance a520f045-c4e4-4182-9fca-fc65620e0337 could not be found. Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'a520f045-c4e4-4182-9fca-fc65620e0337', 'body': {'rescue': {}}} Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a520f045-c4e4-4182-9fca-fc65620e0337 could not be found. Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a520f045-c4e4-4182-9fca-fc65620e0337 could not be found. Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:53.326940 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:53.349496 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:53.349496 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:53.349496 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:53.349496 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:53.349496 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a520f045-c4e4-4182-9fca-fc65620e0337 could not be found. Aug 04 14:07:53.349496 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:53.349496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-58a9df95-2646-484f-8227-44a9eb3483d0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Returning 404 to user: Instance a520f045-c4e4-4182-9fca-fc65620e0337 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:53.349496 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-58a9df95-2646-484f-8227-44a9eb3483d0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/a520f045-c4e4-4182-9fca-fc65620e0337/action" status: 404 len: 111 microversion: 2.1 time: 0.092168 Aug 04 14:07:53.349496 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1437/2873] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:07:53 2022] POST /compute/v2.1/servers/a520f045-c4e4-4182-9fca-fc65620e0337/action => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:53.352821 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-faea8ebc-b151-4fc1-ba2a-08d3bac2c923 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007561 Aug 04 14:07:53.372605 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1438/2874] 10.222.0.66 () {58 vars in 1164 bytes} [Thu Aug 4 14:07:53 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 14:07:53.395689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d1db9cf5-4834-4547-a2ba-4bec4ce3199d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:53.403126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d1db9cf5-4834-4547-a2ba-4bec4ce3199d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:53.465357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1db9cf5-4834-4547-a2ba-4bec4ce3199d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:53.470946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1db9cf5-4834-4547-a2ba-4bec4ce3199d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:53.476967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1db9cf5-4834-4547-a2ba-4bec4ce3199d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:53.486106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1db9cf5-4834-4547-a2ba-4bec4ce3199d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:53.816131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d1db9cf5-4834-4547-a2ba-4bec4ce3199d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:53.846575 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d1db9cf5-4834-4547-a2ba-4bec4ce3199d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1267 microversion: 2.1 time: 0.477444 Aug 04 14:07:53.849528 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1439/2875] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:53 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1267 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:53.871685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ec9fd8c5-8a4a-4112-82f9-110f77cadfd5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6b72de6-16cd-4917-9ef8-2f69b99f91ad"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:53.872511 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ed265ced-5d41-4589-8d4b-97baa75190db tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 1.056334 Aug 04 14:07:53.876125 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1437/2876] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:52 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:53.880172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ec9fd8c5-8a4a-4112-82f9-110f77cadfd5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:53.884393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-87947e10-9f48-400e-b85b-67456fc8710d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:53.897859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec9fd8c5-8a4a-4112-82f9-110f77cadfd5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:53.898584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-87947e10-9f48-400e-b85b-67456fc8710d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:53.899109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec9fd8c5-8a4a-4112-82f9-110f77cadfd5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:53.901464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec9fd8c5-8a4a-4112-82f9-110f77cadfd5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:53.903095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec9fd8c5-8a4a-4112-82f9-110f77cadfd5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:53.925807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87947e10-9f48-400e-b85b-67456fc8710d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:53.926162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87947e10-9f48-400e-b85b-67456fc8710d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:53.926941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87947e10-9f48-400e-b85b-67456fc8710d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:53.927386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87947e10-9f48-400e-b85b-67456fc8710d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:54.216096 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-87947e10-9f48-400e-b85b-67456fc8710d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action" status: 202 len: 0 microversion: 2.1 time: 0.337436 Aug 04 14:07:54.220105 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1438/2877] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:07:53 2022] POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:54.233572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-069f478c-055a-47b8-bf3b-fc98ae923411 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Calling method '.version_select at 0x7f46f36dbee0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:54.686257 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ec9fd8c5-8a4a-4112-82f9-110f77cadfd5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833994 Aug 04 14:07:54.704412 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1440/2878] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:07:53 2022] POST /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:54.704412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eab5be24-6436-4de2-a0f4-6c75a20c956c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:54.704412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eab5be24-6436-4de2-a0f4-6c75a20c956c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:54.731312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eab5be24-6436-4de2-a0f4-6c75a20c956c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:54.738641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eab5be24-6436-4de2-a0f4-6c75a20c956c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:54.740599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eab5be24-6436-4de2-a0f4-6c75a20c956c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:54.752815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eab5be24-6436-4de2-a0f4-6c75a20c956c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:55.691418 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-069f478c-055a-47b8-bf3b-fc98ae923411 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.469103 Aug 04 14:07:55.712796 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1439/2879] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 14:07:54 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:55.729810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e0bca32d-f5e4-4a4a-a898-7a2f501e3875 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:55.736539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e0bca32d-f5e4-4a4a-a898-7a2f501e3875 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:55.748417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eab5be24-6436-4de2-a0f4-6c75a20c956c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:55.765687 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eab5be24-6436-4de2-a0f4-6c75a20c956c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1499 microversion: 2.1 time: 1.069139 Aug 04 14:07:55.780129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0bca32d-f5e4-4a4a-a898-7a2f501e3875 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:55.781496 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1441/2880] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:54 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1499 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:55.785449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0bca32d-f5e4-4a4a-a898-7a2f501e3875 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:55.787458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0bca32d-f5e4-4a4a-a898-7a2f501e3875 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:55.795058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e1e00aef-87bd-4158-910f-2c4528f6cf64 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:55.795842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e1e00aef-87bd-4158-910f-2c4528f6cf64 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:55.796817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0bca32d-f5e4-4a4a-a898-7a2f501e3875 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:55.810715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1e00aef-87bd-4158-910f-2c4528f6cf64 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:55.822970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1e00aef-87bd-4158-910f-2c4528f6cf64 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:55.824002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1e00aef-87bd-4158-910f-2c4528f6cf64 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:55.824584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1e00aef-87bd-4158-910f-2c4528f6cf64 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:56.521677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e1e00aef-87bd-4158-910f-2c4528f6cf64 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:56.539280 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e1e00aef-87bd-4158-910f-2c4528f6cf64 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1309 microversion: 2.1 time: 0.756497 Aug 04 14:07:56.555019 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1442/2881] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:55 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1309 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:56.577144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5a084081-41ae-4a27-84e2-b8597857a98b tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f4705587940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:56.664515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e0bca32d-f5e4-4a4a-a898-7a2f501e3875 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:56.676424 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e0bca32d-f5e4-4a4a-a898-7a2f501e3875 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.960672 Aug 04 14:07:56.677236 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1440/2882] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:55 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:56.704465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12c90e88-9117-4cdf-9fe5-cddaacf45587 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Calling method '.version_select at 0x7f47004d1280>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:56.721684 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5a084081-41ae-4a27-84e2-b8597857a98b tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.165028 Aug 04 14:07:56.738474 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1443/2883] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:56 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:56.751549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:56.756524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:56.771511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:56.772465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:56.774297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:56.775064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:56.783021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:56.837223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lazy-loading 'flavor' on Instance uuid da969e0f-87c4-4c9d-bef7-b74fb0837616 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:07:56.865125 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] HTTP exception thrown: Cannot 'rescue' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state paused Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Request method failure captured: Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action HTTP/1.1 Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 14 Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JxokQZWt73oCTeb2uIT1T61PPtBceW-GidRWsXDOZjQVnibDMlYFve8J2CmvNSqnoJ2gUswAJOQhT5G9sx82VvrXKfhYzVPLV5Gd4BsYAE7SpJCYfj1C3r3f1XD7yVS8i5KHJX727wlQRlE5KUXS609Oac6ysS4Xt8O7zqu2gmqzI Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}] Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 653fb03c7a4b4a61a57ecd4cdd610e86 Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: {"rescue": {}} Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: exception: Cannot 'rescue' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state paused Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'da969e0f-87c4-4c9d-bef7-b74fb0837616', 'body': {'rescue': {}}} Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da969e0f-87c4-4c9d-bef7-b74fb0837616 in vm_state paused. Cannot rescue while the instance is in this state. Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state paused Aug 04 14:07:56.873915 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state paused Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Returning 409 to user: Cannot 'rescue' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state paused {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:56.879383 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9518034d-da3f-47b4-9410-21a24d4409ff tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action" status: 409 len: 144 microversion: 2.1 time: 0.138662 Aug 04 14:07:56.885429 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1444/2884] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:07:56 2022] POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action => generated 144 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:07:56.906296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4f0139db-b637-46fe-b779-565860d29ba1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:56.907291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4f0139db-b637-46fe-b779-565860d29ba1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:56.950946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f0139db-b637-46fe-b779-565860d29ba1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:56.952387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f0139db-b637-46fe-b779-565860d29ba1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:56.953829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f0139db-b637-46fe-b779-565860d29ba1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:56.954500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f0139db-b637-46fe-b779-565860d29ba1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:57.321810 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4f0139db-b637-46fe-b779-565860d29ba1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action" status: 202 len: 0 microversion: 2.1 time: 0.429619 Aug 04 14:07:57.329934 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1445/2885] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:07:56 2022] POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:07:57.394845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-061b5698-280c-4e30-9b33-cfb041a997ac tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:57.402831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-061b5698-280c-4e30-9b33-cfb041a997ac tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:57.459896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-061b5698-280c-4e30-9b33-cfb041a997ac tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:57.463580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-061b5698-280c-4e30-9b33-cfb041a997ac tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:57.470902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-061b5698-280c-4e30-9b33-cfb041a997ac tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:57.474418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-061b5698-280c-4e30-9b33-cfb041a997ac tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:57.530402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG neutronclient.v2_0.client [None req-12c90e88-9117-4cdf-9fe5-cddaacf45587 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=130961) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:07:57.534042 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-12c90e88-9117-4cdf-9fe5-cddaacf45587 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 04 14:07:57.534042 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-3b70941f-a27b-464e-8c65-2ccf5c7e884c'] Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12c90e88-9117-4cdf-9fe5-cddaacf45587 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Request method failure captured: Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-security-groups/f6ad752e-6619-40b3-be13-e95f8b478e92 HTTP/1.1 Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69K3Fd3Hbg_AsWX-Ep2ME6u_vrcwnl2H2k5zlwwBE5CplWt99AQWI0xZp6rF2hWHmsQq205v69IyepPvhNj26fW4T7OvO6377G2_SvEzxf_SNzjrQQ3jK1p5lqU2CFbI3xn0YLWwBYo_77vjYGU4UZttWw1Vnjz-2n6jl2JLJ3sNFY0 Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 0d2bad600b0f4ade9faf28b65994d1ce Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d2bad600b0f4ade9faf28b65994d1ce"}]}] Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 0d2bad600b0f4ade9faf28b65994d1ce Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-SecurityGroupsNegativeTestJSON-1447010674-project Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 29ba8db3222e40bf94a462af6364ccce Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674-project Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: exception: Insufficient rights for removing default security group. Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-3b70941f-a27b-464e-8c65-2ccf5c7e884c'] Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'f6ad752e-6619-40b3-be13-e95f8b478e92'} Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:07:57.538910 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b70941f-a27b-464e-8c65-2ccf5c7e884c'] Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b70941f-a27b-464e-8c65-2ccf5c7e884c'] Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b70941f-a27b-464e-8c65-2ccf5c7e884c'] Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b70941f-a27b-464e-8c65-2ccf5c7e884c'] Aug 04 14:07:57.549874 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:07:57.581813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12c90e88-9117-4cdf-9fe5-cddaacf45587 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 04 14:07:57.581813 n-d-844627-10 devstack@n-api.service[130961]: Neutron server returns request_ids: ['req-3b70941f-a27b-464e-8c65-2ccf5c7e884c'] {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:57.586371 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12c90e88-9117-4cdf-9fe5-cddaacf45587 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/f6ad752e-6619-40b3-be13-e95f8b478e92" status: 400 len: 182 microversion: 2.1 time: 0.895450 Aug 04 14:07:57.589289 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1441/2886] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:07:56 2022] DELETE /compute/v2.1/os-security-groups/f6ad752e-6619-40b3-be13-e95f8b478e92 => generated 182 bytes in 911 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:07:57.697535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-afb763e6-a996-46b2-b5c1-c180c4ab1ff1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:57.717523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-afb763e6-a996-46b2-b5c1-c180c4ab1ff1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:57.778011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afb763e6-a996-46b2-b5c1-c180c4ab1ff1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:57.786467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afb763e6-a996-46b2-b5c1-c180c4ab1ff1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:57.793858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afb763e6-a996-46b2-b5c1-c180c4ab1ff1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:57.798227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afb763e6-a996-46b2-b5c1-c180c4ab1ff1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:58.269366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-061b5698-280c-4e30-9b33-cfb041a997ac tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:58.287350 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-061b5698-280c-4e30-9b33-cfb041a997ac tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1506 microversion: 2.1 time: 0.949149 Aug 04 14:07:58.290928 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1446/2887] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:57 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1506 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:58.303819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b9eee16-3087-46b0-9268-164ed39f4f33 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Calling method '.version_select at 0x7f47001c0820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:58.405238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-afb763e6-a996-46b2-b5c1-c180c4ab1ff1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:58.420969 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-afb763e6-a996-46b2-b5c1-c180c4ab1ff1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1309 microversion: 2.1 time: 0.829602 Aug 04 14:07:58.433729 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1442/2888] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:57 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1309 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:58.443731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a718bbe-f92f-4985-801d-22497ac0134d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:58.473567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a718bbe-f92f-4985-801d-22497ac0134d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:58.486029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a718bbe-f92f-4985-801d-22497ac0134d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:58.486894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-8b9eee16-3087-46b0-9268-164ed39f4f33 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 356e6747-af63-4297-bb6d-fda7d36164b2 does not exist", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:07:58.488474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.security_group_api [None req-8b9eee16-3087-46b0-9268-164ed39f4f33 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Neutron security group 356e6747-af63-4297-bb6d-fda7d36164b2 not found {{(pid=130960) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:07:58.489885 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-8b9eee16-3087-46b0-9268-164ed39f4f33 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] HTTP exception thrown: Security group 356e6747-af63-4297-bb6d-fda7d36164b2 does not exist Aug 04 14:07:58.489885 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-6c92fe5a-1a65-4e54-9f34-b630a15b06fb'] Aug 04 14:07:58.490536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a718bbe-f92f-4985-801d-22497ac0134d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b9eee16-3087-46b0-9268-164ed39f4f33 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Request method failure captured: Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-security-groups/356e6747-af63-4297-bb6d-fda7d36164b2 HTTP/1.1 Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69K3Fd3Hbg_AsWX-Ep2ME6u_vrcwnl2H2k5zlwwBE5CplWt99AQWI0xZp6rF2hWHmsQq205v69IyepPvhNj26fW4T7OvO6377G2_SvEzxf_SNzjrQQ3jK1p5lqU2CFbI3xn0YLWwBYo_77vjYGU4UZttWw1Vnjz-2n6jl2JLJ3sNFY0 Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 0d2bad600b0f4ade9faf28b65994d1ce Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d2bad600b0f4ade9faf28b65994d1ce"}]}] Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 0d2bad600b0f4ade9faf28b65994d1ce Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupsNegativeTestJSON-1447010674-project Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 29ba8db3222e40bf94a462af6364ccce Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674-project Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: exception: Security group 356e6747-af63-4297-bb6d-fda7d36164b2 does not exist Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-6c92fe5a-1a65-4e54-9f34-b630a15b06fb'] Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '356e6747-af63-4297-bb6d-fda7d36164b2'} Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:07:58.493802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 356e6747-af63-4297-bb6d-fda7d36164b2 does not exist Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c92fe5a-1a65-4e54-9f34-b630a15b06fb'] Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 356e6747-af63-4297-bb6d-fda7d36164b2 does not exist Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c92fe5a-1a65-4e54-9f34-b630a15b06fb'] Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 356e6747-af63-4297-bb6d-fda7d36164b2 does not exist Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c92fe5a-1a65-4e54-9f34-b630a15b06fb'] Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 356e6747-af63-4297-bb6d-fda7d36164b2 does not exist Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c92fe5a-1a65-4e54-9f34-b630a15b06fb'] Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b9eee16-3087-46b0-9268-164ed39f4f33 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Returning 404 to user: Security group 356e6747-af63-4297-bb6d-fda7d36164b2 does not exist Aug 04 14:07:58.497835 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-6c92fe5a-1a65-4e54-9f34-b630a15b06fb'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:58.502253 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b9eee16-3087-46b0-9268-164ed39f4f33 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/356e6747-af63-4297-bb6d-fda7d36164b2" status: 404 len: 194 microversion: 2.1 time: 0.207851 Aug 04 14:07:58.504087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a718bbe-f92f-4985-801d-22497ac0134d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:58.509704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a718bbe-f92f-4985-801d-22497ac0134d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:58.511687 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1447/2889] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 14:07:58 2022] GET /compute/v2.1/os-security-groups/356e6747-af63-4297-bb6d-fda7d36164b2 => generated 194 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:58.524861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:58.529391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b986143-ad21-4b97-a757-33f027777270 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f470558daf0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:58.622920 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b986143-ad21-4b97-a757-33f027777270 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.109729 Aug 04 14:07:58.623957 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1448/2890] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:07:58 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:58.629834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a220674e-72cd-436a-80f3-327fc2ba3f67 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Action: 'update', calling method: .version_select at 0x7f46f39d2280>, body: {"security_group": {"name": "tempest-sg-1988813651", "description": "tempest-description-2098299679"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:58.735698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-a220674e-72cd-436a-80f3-327fc2ba3f67 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 23202dd1-c6a7-4f2f-9fc6-810db1488e30 does not exist", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:07:58.738603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.security_group_api [None req-a220674e-72cd-436a-80f3-327fc2ba3f67 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Neutron security group 23202dd1-c6a7-4f2f-9fc6-810db1488e30 not found {{(pid=130960) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:07:58.742837 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-a220674e-72cd-436a-80f3-327fc2ba3f67 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] HTTP exception thrown: Security group 23202dd1-c6a7-4f2f-9fc6-810db1488e30 does not exist Aug 04 14:07:58.742837 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-643d2487-cce3-410d-8553-4ba599a0fc08'] Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a220674e-72cd-436a-80f3-327fc2ba3f67 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Request method failure captured: Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/os-security-groups/23202dd1-c6a7-4f2f-9fc6-810db1488e30 HTTP/1.1 Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 102 Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69K3Fd3Hbg_AsWX-Ep2ME6u_vrcwnl2H2k5zlwwBE5CplWt99AQWI0xZp6rF2hWHmsQq205v69IyepPvhNj26fW4T7OvO6377G2_SvEzxf_SNzjrQQ3jK1p5lqU2CFbI3xn0YLWwBYo_77vjYGU4UZttWw1Vnjz-2n6jl2JLJ3sNFY0 Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 0d2bad600b0f4ade9faf28b65994d1ce Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0d2bad600b0f4ade9faf28b65994d1ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0d2bad600b0f4ade9faf28b65994d1ce"}]}] Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 0d2bad600b0f4ade9faf28b65994d1ce Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674 Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupsNegativeTestJSON-1447010674-project Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 29ba8db3222e40bf94a462af6364ccce Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1447010674-project Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: {"security_group": {"name": "tempest-sg-1988813651", "description": "tempest-description-2098299679"}} Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: exception: Security group 23202dd1-c6a7-4f2f-9fc6-810db1488e30 does not exist Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-643d2487-cce3-410d-8553-4ba599a0fc08'] Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '23202dd1-c6a7-4f2f-9fc6-810db1488e30', 'body': {'security_group': {'name': 'tempest-sg-1988813651', 'description': 'tempest-description-2098299679'}}} Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:07:58.752723 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 23202dd1-c6a7-4f2f-9fc6-810db1488e30 does not exist Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-643d2487-cce3-410d-8553-4ba599a0fc08'] Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 23202dd1-c6a7-4f2f-9fc6-810db1488e30 does not exist Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-643d2487-cce3-410d-8553-4ba599a0fc08'] Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 23202dd1-c6a7-4f2f-9fc6-810db1488e30 does not exist Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-643d2487-cce3-410d-8553-4ba599a0fc08'] Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 23202dd1-c6a7-4f2f-9fc6-810db1488e30 does not exist Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-643d2487-cce3-410d-8553-4ba599a0fc08'] Aug 04 14:07:58.764809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:07:58.784068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a220674e-72cd-436a-80f3-327fc2ba3f67 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] Returning 404 to user: Security group 23202dd1-c6a7-4f2f-9fc6-810db1488e30 does not exist Aug 04 14:07:58.784068 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-643d2487-cce3-410d-8553-4ba599a0fc08'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:07:58.793194 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a220674e-72cd-436a-80f3-327fc2ba3f67 tempest-SecurityGroupsNegativeTestJSON-1447010674 tempest-SecurityGroupsNegativeTestJSON-1447010674-project] 10.222.0.66 "PUT /compute/v2.1/os-security-groups/23202dd1-c6a7-4f2f-9fc6-810db1488e30" status: 404 len: 194 microversion: 2.1 time: 0.158976 Aug 04 14:07:58.801047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1449/2891] 10.222.0.66 () {60 vars in 1290 bytes} [Thu Aug 4 14:07:58 2022] PUT /compute/v2.1/os-security-groups/23202dd1-c6a7-4f2f-9fc6-810db1488e30 => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:07:58.808389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6656654f-0644-471f-a05c-b5a31a98ef58 req-6459dcdc-2ff4-4ec5-a5f3-88dd7a282608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "233bf06a-0888-4b0d-a891-b785811341ed", "tag": "757fc869-3355-4b3f-a414-9ff94a76a291"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:07:58.842151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:58.845626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6656654f-0644-471f-a05c-b5a31a98ef58 req-6459dcdc-2ff4-4ec5-a5f3-88dd7a282608 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:58.847783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6656654f-0644-471f-a05c-b5a31a98ef58 req-6459dcdc-2ff4-4ec5-a5f3-88dd7a282608 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:58.866170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:07:58.878613 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6656654f-0644-471f-a05c-b5a31a98ef58 req-6459dcdc-2ff4-4ec5-a5f3-88dd7a282608 service nova] Creating event network-changed:757fc869-3355-4b3f-a414-9ff94a76a291 for instance 233bf06a-0888-4b0d-a891-b785811341ed on n-h1-844627-10 Aug 04 14:07:58.893559 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6656654f-0644-471f-a05c-b5a31a98ef58 req-6459dcdc-2ff4-4ec5-a5f3-88dd7a282608 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094127 Aug 04 14:07:58.896830 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1450/2892] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:07:59.319170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd68c163-a43b-4577-bfba-1dedc174fdde tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:59.326355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bd68c163-a43b-4577-bfba-1dedc174fdde tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:59.366680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd68c163-a43b-4577-bfba-1dedc174fdde tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:59.386077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd68c163-a43b-4577-bfba-1dedc174fdde tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:59.396806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd68c163-a43b-4577-bfba-1dedc174fdde tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:59.398802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd68c163-a43b-4577-bfba-1dedc174fdde tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:59.416625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a718bbe-f92f-4985-801d-22497ac0134d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:07:59.469189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a718bbe-f92f-4985-801d-22497ac0134d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 1.030100 Aug 04 14:07:59.475901 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1443/2893] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:58 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:07:59.499762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-461c0665-df53-4403-8e9c-2900be6d036f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:07:59.506491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-461c0665-df53-4403-8e9c-2900be6d036f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:07:59.549786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-461c0665-df53-4403-8e9c-2900be6d036f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:59.551787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-461c0665-df53-4403-8e9c-2900be6d036f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:59.557941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-461c0665-df53-4403-8e9c-2900be6d036f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:07:59.571419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-461c0665-df53-4403-8e9c-2900be6d036f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:07:59.712767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:00.353176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-461c0665-df53-4403-8e9c-2900be6d036f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:00.362057 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-461c0665-df53-4403-8e9c-2900be6d036f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1309 microversion: 2.1 time: 0.882853 Aug 04 14:08:00.366737 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1444/2894] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:59 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1309 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:00.376815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33e75458-719b-4b33-800f-daaf21fc3814 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3a19e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:00.470629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd68c163-a43b-4577-bfba-1dedc174fdde tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:00.537192 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd68c163-a43b-4577-bfba-1dedc174fdde tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1514 microversion: 2.1 time: 1.213929 Aug 04 14:08:00.549422 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1451/2895] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:07:59 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1514 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:00.597441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c43576b9-566a-474e-9930-6657a0b918c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:00.601651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c43576b9-566a-474e-9930-6657a0b918c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:00.606880 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-33e75458-719b-4b33-800f-daaf21fc3814 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.238735 Aug 04 14:08:00.609196 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1445/2896] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:08:00 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:00.617830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c43576b9-566a-474e-9930-6657a0b918c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:00.617830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c43576b9-566a-474e-9930-6657a0b918c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:00.617830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c43576b9-566a-474e-9930-6657a0b918c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:00.617830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c43576b9-566a-474e-9930-6657a0b918c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:01.393017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be720d03-afc5-4536-bcdb-2426b7663352 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:01.393724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be720d03-afc5-4536-bcdb-2426b7663352 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:01.431843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be720d03-afc5-4536-bcdb-2426b7663352 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:01.438830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be720d03-afc5-4536-bcdb-2426b7663352 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:01.445241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be720d03-afc5-4536-bcdb-2426b7663352 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:01.445709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be720d03-afc5-4536-bcdb-2426b7663352 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:02.260436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c43576b9-566a-474e-9930-6657a0b918c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:02.291986 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c43576b9-566a-474e-9930-6657a0b918c1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 1.733058 Aug 04 14:08:02.295776 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1452/2897] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:00 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:02.329589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a9a11f3-6a2a-406e-8a61-31cdcc7277ec tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f4700279430>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:02.340291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-be720d03-afc5-4536-bcdb-2426b7663352 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:02.446241 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be720d03-afc5-4536-bcdb-2426b7663352 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1309 microversion: 2.1 time: 1.059345 Aug 04 14:08:02.455885 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1446/2898] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:01 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1309 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:02.664627 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a9a11f3-6a2a-406e-8a61-31cdcc7277ec tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1429 microversion: 2.1 time: 0.367599 Aug 04 14:08:02.685436 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1453/2899] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:08:02 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1429 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:03.339944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-23573c23-be3a-47e8-b4c6-75c43fe76dd1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:03.341852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-23573c23-be3a-47e8-b4c6-75c43fe76dd1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:03.381986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23573c23-be3a-47e8-b4c6-75c43fe76dd1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:03.386009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23573c23-be3a-47e8-b4c6-75c43fe76dd1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:03.400363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23573c23-be3a-47e8-b4c6-75c43fe76dd1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:03.403472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23573c23-be3a-47e8-b4c6-75c43fe76dd1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:03.482063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e261026f-93cb-4163-98a5-b32bf1ede1c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:03.490372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e261026f-93cb-4163-98a5-b32bf1ede1c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:03.591945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e261026f-93cb-4163-98a5-b32bf1ede1c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:03.598383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e261026f-93cb-4163-98a5-b32bf1ede1c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:03.600483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e261026f-93cb-4163-98a5-b32bf1ede1c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:03.605348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e261026f-93cb-4163-98a5-b32bf1ede1c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:05.758948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-23573c23-be3a-47e8-b4c6-75c43fe76dd1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:05.796181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e261026f-93cb-4163-98a5-b32bf1ede1c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:05.807219 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-23573c23-be3a-47e8-b4c6-75c43fe76dd1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 2.473735 Aug 04 14:08:05.812336 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1447/2900] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:03 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:05.836904 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e261026f-93cb-4163-98a5-b32bf1ede1c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1309 microversion: 2.1 time: 2.361703 Aug 04 14:08:05.837566 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1454/2901] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:03 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1309 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:05.841467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4d8202d-3489-4d04-9d33-2daaac0f47fc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3a195e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:05.860922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f210a6ce-e381-4817-8655-e623e91f5cc4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:05.865414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f210a6ce-e381-4817-8655-e623e91f5cc4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:05.882356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f210a6ce-e381-4817-8655-e623e91f5cc4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:05.882811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f210a6ce-e381-4817-8655-e623e91f5cc4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:05.883629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f210a6ce-e381-4817-8655-e623e91f5cc4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:05.888378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f210a6ce-e381-4817-8655-e623e91f5cc4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:05.943777 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4d8202d-3489-4d04-9d33-2daaac0f47fc tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1438 microversion: 2.1 time: 0.127698 Aug 04 14:08:05.950154 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1448/2902] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:08:05 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:05.977717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-96b0b054-227c-40fa-943f-5cbf82acfb41 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f36db0d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:06.027139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-f210a6ce-e381-4817-8655-e623e91f5cc4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lazy-loading 'flavor' on Instance uuid da969e0f-87c4-4c9d-bef7-b74fb0837616 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:08:06.105809 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-96b0b054-227c-40fa-943f-5cbf82acfb41 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 200 len: 1438 microversion: 2.1 time: 0.144347 Aug 04 14:08:06.112186 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1449/2903] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:08:05 2022] GET /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 1438 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:08:06.153819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-93538881-9e51-4b90-acea-1035015b7b91 req-c75332c6-2b41-442e-a33a-fa5ec598f4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90627287-7390-448b-bc44-878c72306f4e", "name": "network-vif-unplugged", "status": "completed", "tag": "c115a33c-f9fb-4d11-b284-d04b79cb1a39"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:06.243240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-93538881-9e51-4b90-acea-1035015b7b91 req-c75332c6-2b41-442e-a33a-fa5ec598f4ac service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:06.244035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-93538881-9e51-4b90-acea-1035015b7b91 req-c75332c6-2b41-442e-a33a-fa5ec598f4ac service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:06.315464 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-93538881-9e51-4b90-acea-1035015b7b91 req-c75332c6-2b41-442e-a33a-fa5ec598f4ac service nova] Creating event network-vif-unplugged:c115a33c-f9fb-4d11-b284-d04b79cb1a39 for instance 90627287-7390-448b-bc44-878c72306f4e on n-h2-844627-10 Aug 04 14:08:06.347291 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-93538881-9e51-4b90-acea-1035015b7b91 req-c75332c6-2b41-442e-a33a-fa5ec598f4ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.220962 Aug 04 14:08:06.350273 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1450/2904] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:06.389829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba79b893-ddfe-4116-8fb2-ec8760034027 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:06.392763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ba79b893-ddfe-4116-8fb2-ec8760034027 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:06.448303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba79b893-ddfe-4116-8fb2-ec8760034027 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:06.450445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba79b893-ddfe-4116-8fb2-ec8760034027 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:06.461636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba79b893-ddfe-4116-8fb2-ec8760034027 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:06.465413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba79b893-ddfe-4116-8fb2-ec8760034027 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:06.509542 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f210a6ce-e381-4817-8655-e623e91f5cc4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action" status: 200 len: 32 microversion: 2.1 time: 0.668924 Aug 04 14:08:06.520384 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1455/2905] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:08:05 2022] POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action => generated 32 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:08:06.552127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c46e19bf-f98e-49c0-8348-2ab09b0ce38d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:06.553683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c46e19bf-f98e-49c0-8348-2ab09b0ce38d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:06.580631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c46e19bf-f98e-49c0-8348-2ab09b0ce38d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:06.583106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c46e19bf-f98e-49c0-8348-2ab09b0ce38d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:06.584978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c46e19bf-f98e-49c0-8348-2ab09b0ce38d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:06.587283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c46e19bf-f98e-49c0-8348-2ab09b0ce38d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:08.307048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c46e19bf-f98e-49c0-8348-2ab09b0ce38d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:08.328433 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c46e19bf-f98e-49c0-8348-2ab09b0ce38d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.800348 Aug 04 14:08:08.344710 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1456/2906] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:06 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:08.372586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21e154de-7668-4b01-b1fb-af08ea3dd302 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:08.374456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-21e154de-7668-4b01-b1fb-af08ea3dd302 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:08.395376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21e154de-7668-4b01-b1fb-af08ea3dd302 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:08.397631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21e154de-7668-4b01-b1fb-af08ea3dd302 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:08.399917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21e154de-7668-4b01-b1fb-af08ea3dd302 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:08.401190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21e154de-7668-4b01-b1fb-af08ea3dd302 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:08.652505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ba79b893-ddfe-4116-8fb2-ec8760034027 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:08.677723 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ba79b893-ddfe-4116-8fb2-ec8760034027 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1466 microversion: 2.1 time: 2.321768 Aug 04 14:08:08.685103 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1451/2907] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:06 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1466 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:08.714026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9603c507-1b1d-4d99-ba7d-b8a7f0ff9390 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:08.715471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9603c507-1b1d-4d99-ba7d-b8a7f0ff9390 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:08.752085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9603c507-1b1d-4d99-ba7d-b8a7f0ff9390 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:08.754019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9603c507-1b1d-4d99-ba7d-b8a7f0ff9390 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:08.757093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9603c507-1b1d-4d99-ba7d-b8a7f0ff9390 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:08.759769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9603c507-1b1d-4d99-ba7d-b8a7f0ff9390 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:09.950430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9603c507-1b1d-4d99-ba7d-b8a7f0ff9390 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:10.017202 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9603c507-1b1d-4d99-ba7d-b8a7f0ff9390 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1309 microversion: 2.1 time: 1.329107 Aug 04 14:08:10.026792 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1452/2908] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:08 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1309 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:10.052394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ce23459a-8220-41be-9137-d418403b9ab4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f4700230ee0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:10.169426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-21e154de-7668-4b01-b1fb-af08ea3dd302 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:10.213985 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-21e154de-7668-4b01-b1fb-af08ea3dd302 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 1.857785 Aug 04 14:08:10.239259 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1457/2909] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:08 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:10.264978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5560a2ed-6735-4d63-be3c-7ed3ecf5d182 req-e8e6bbd8-1539-4843-ae02-8124820a944b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90627287-7390-448b-bc44-878c72306f4e", "tag": "c115a33c-f9fb-4d11-b284-d04b79cb1a39"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:10.289492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=62 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:10.314547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5560a2ed-6735-4d63-be3c-7ed3ecf5d182 req-e8e6bbd8-1539-4843-ae02-8124820a944b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:10.323437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5560a2ed-6735-4d63-be3c-7ed3ecf5d182 req-e8e6bbd8-1539-4843-ae02-8124820a944b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:10.366563 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5560a2ed-6735-4d63-be3c-7ed3ecf5d182 req-e8e6bbd8-1539-4843-ae02-8124820a944b service nova] Creating event network-changed:c115a33c-f9fb-4d11-b284-d04b79cb1a39 for instance 90627287-7390-448b-bc44-878c72306f4e on n-h2-844627-10 Aug 04 14:08:10.383953 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5560a2ed-6735-4d63-be3c-7ed3ecf5d182 req-e8e6bbd8-1539-4843-ae02-8124820a944b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141501 Aug 04 14:08:10.387070 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1458/2910] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:10.407113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe8b9375-9f11-49a1-98c5-687301945e80 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:10.410942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe8b9375-9f11-49a1-98c5-687301945e80 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:10.431672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe8b9375-9f11-49a1-98c5-687301945e80 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:10.432852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe8b9375-9f11-49a1-98c5-687301945e80 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:10.435349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe8b9375-9f11-49a1-98c5-687301945e80 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:10.437802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe8b9375-9f11-49a1-98c5-687301945e80 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:12.000169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe8b9375-9f11-49a1-98c5-687301945e80 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:12.016565 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe8b9375-9f11-49a1-98c5-687301945e80 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.627554 Aug 04 14:08:12.017279 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1459/2911] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:10 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:12.033694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-61f13fe1-8051-49ee-8b9e-0d6b2f3d2d90 req-ba2a4d67-4904-4391-9c72-e6a747922db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a40a39-cbe8-47bc-8869-a88e59989f63", "name": "network-vif-unplugged", "status": "completed", "tag": "19e85bce-c14d-4d20-89ef-01de05cf0ac7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:12.057597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-61f13fe1-8051-49ee-8b9e-0d6b2f3d2d90 req-ba2a4d67-4904-4391-9c72-e6a747922db1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:12.061255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-61f13fe1-8051-49ee-8b9e-0d6b2f3d2d90 req-ba2a4d67-4904-4391-9c72-e6a747922db1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:12.092799 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-61f13fe1-8051-49ee-8b9e-0d6b2f3d2d90 req-ba2a4d67-4904-4391-9c72-e6a747922db1 service nova] Creating event network-vif-unplugged:19e85bce-c14d-4d20-89ef-01de05cf0ac7 for instance c8a40a39-cbe8-47bc-8869-a88e59989f63 on n-h2-844627-10 Aug 04 14:08:12.102778 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-61f13fe1-8051-49ee-8b9e-0d6b2f3d2d90 req-ba2a4d67-4904-4391-9c72-e6a747922db1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083924 Aug 04 14:08:12.104536 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1460/2912] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:12.113649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d86f8ab3-cb1c-4d73-9363-04d43b2959c3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:12.125956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d86f8ab3-cb1c-4d73-9363-04d43b2959c3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:12.134162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d86f8ab3-cb1c-4d73-9363-04d43b2959c3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:12.140539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d86f8ab3-cb1c-4d73-9363-04d43b2959c3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:12.141892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d86f8ab3-cb1c-4d73-9363-04d43b2959c3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:12.142660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d86f8ab3-cb1c-4d73-9363-04d43b2959c3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:12.170122 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ce23459a-8220-41be-9137-d418403b9ab4 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "DELETE /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698" status: 204 len: 0 microversion: 2.1 time: 2.141515 Aug 04 14:08:12.170731 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1453/2913] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:10 2022] DELETE /compute/v2.1/images/cc7a3c06-b37e-420f-88e8-3794ee611698 => generated 0 bytes in 2143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:08:12.180297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da9b06df-a3f9-40d4-988f-173f5f0dc22a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:12.182017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-da9b06df-a3f9-40d4-988f-173f5f0dc22a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:12.242132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da9b06df-a3f9-40d4-988f-173f5f0dc22a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:12.242606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da9b06df-a3f9-40d4-988f-173f5f0dc22a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:12.248800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da9b06df-a3f9-40d4-988f-173f5f0dc22a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:12.252081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da9b06df-a3f9-40d4-988f-173f5f0dc22a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:13.435372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d86f8ab3-cb1c-4d73-9363-04d43b2959c3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:13.453025 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d86f8ab3-cb1c-4d73-9363-04d43b2959c3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1309 microversion: 2.1 time: 1.345553 Aug 04 14:08:13.455469 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1461/2914] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:12 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1309 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:13.466373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b87a3347-ad56-47fd-a310-bdbd5a76ddd8 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '.version_select at 0x7f46f3ab0af0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:13.474501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-da9b06df-a3f9-40d4-988f-173f5f0dc22a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:13.504050 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-da9b06df-a3f9-40d4-988f-173f5f0dc22a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 1.330537 Aug 04 14:08:13.505480 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1454/2915] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:12 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:13.515489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa37d577-3baa-4558-bcf1-6647c045eb1b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:13.517549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa37d577-3baa-4558-bcf1-6647c045eb1b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:13.524925 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-b87a3347-ad56-47fd-a310-bdbd5a76ddd8 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] HTTP exception thrown: Image not found. Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b87a3347-ad56-47fd-a310-bdbd5a76ddd8 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Request method failure captured: Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 HTTP/1.1 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JRk_FDYe2fPDb8EGwsAYL9aHQ_19UvgpbKfdfiWocfIBWivCHU9ycosKaCNPTJDT0xqNskw84zs33tb3Xza4x44mOCuYE_DerjnMCL_ep_ELSv7GAkRS5jer_6hfpKsSNaYadLpD90lL3YII6zHotp_SQj4-HKm7wq-nf8ZHSZx9E Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: e82094948d794cdda8a53cbe6c013808 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerTestJSON-1781342666 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e82094948d794cdda8a53cbe6c013808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e82094948d794cdda8a53cbe6c013808"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e82094948d794cdda8a53cbe6c013808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e82094948d794cdda8a53cbe6c013808"}]}] Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerTestJSON-1781342666 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: e82094948d794cdda8a53cbe6c013808 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1781342666 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerTestJSON-1781342666-project Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 92de0c3f92744fac8c3a0f5e69b15bb2 Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerTestJSON-1781342666-project Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '22da8291-2516-41b6-9626-2f76804fc128'} Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 22da8291-2516-41b6-9626-2f76804fc128 to delete Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22da8291-2516-41b6-9626-2f76804fc128 could not be found. Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:13.529649 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:08:13.538836 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:13.545031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b87a3347-ad56-47fd-a310-bdbd5a76ddd8 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:08:13.550016 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b87a3347-ad56-47fd-a310-bdbd5a76ddd8 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "DELETE /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128" status: 404 len: 62 microversion: 2.1 time: 0.089403 Aug 04 14:08:13.557241 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1462/2916] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:13 2022] DELETE /compute/v2.1/images/22da8291-2516-41b6-9626-2f76804fc128 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:08:13.565196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa37d577-3baa-4558-bcf1-6647c045eb1b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:13.574645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c8ec3d9d-fd01-4d7c-9058-8282ae482173 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:13.575492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c8ec3d9d-fd01-4d7c-9058-8282ae482173 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:13.576237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa37d577-3baa-4558-bcf1-6647c045eb1b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:13.577567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa37d577-3baa-4558-bcf1-6647c045eb1b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:13.579145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa37d577-3baa-4558-bcf1-6647c045eb1b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:13.589933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8ec3d9d-fd01-4d7c-9058-8282ae482173 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:13.590578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8ec3d9d-fd01-4d7c-9058-8282ae482173 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:13.593466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8ec3d9d-fd01-4d7c-9058-8282ae482173 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:13.594109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8ec3d9d-fd01-4d7c-9058-8282ae482173 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:13.684544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c8ec3d9d-fd01-4d7c-9058-8282ae482173 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:08:13.916795 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c8ec3d9d-fd01-4d7c-9058-8282ae482173 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 204 len: 0 microversion: 2.1 time: 0.357160 Aug 04 14:08:13.918294 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1463/2917] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:08:13 2022] DELETE /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:08:13.938009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-824090f0-6721-4dec-8bd0-e076c4e3eaf5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:13.940041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-824090f0-6721-4dec-8bd0-e076c4e3eaf5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:13.959634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-824090f0-6721-4dec-8bd0-e076c4e3eaf5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:13.962947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-824090f0-6721-4dec-8bd0-e076c4e3eaf5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:13.964662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-824090f0-6721-4dec-8bd0-e076c4e3eaf5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:13.967269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-824090f0-6721-4dec-8bd0-e076c4e3eaf5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:14.504845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa37d577-3baa-4558-bcf1-6647c045eb1b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:14.549783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa37d577-3baa-4558-bcf1-6647c045eb1b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.040307 Aug 04 14:08:14.554238 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1455/2918] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:13 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:14.613473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2d3fbaad-e72b-49a1-9442-e9d36797842c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:14.619414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2d3fbaad-e72b-49a1-9442-e9d36797842c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:14.650727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d3fbaad-e72b-49a1-9442-e9d36797842c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:14.653571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d3fbaad-e72b-49a1-9442-e9d36797842c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:14.658707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d3fbaad-e72b-49a1-9442-e9d36797842c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:14.664323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d3fbaad-e72b-49a1-9442-e9d36797842c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:14.870405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-824090f0-6721-4dec-8bd0-e076c4e3eaf5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:14.881237 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-824090f0-6721-4dec-8bd0-e076c4e3eaf5 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1472 microversion: 2.1 time: 0.956432 Aug 04 14:08:14.885900 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1464/2919] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:13 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1472 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:14.912742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-00b93d4d-e531-42e5-83e2-788038a95e3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:14.914076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-00b93d4d-e531-42e5-83e2-788038a95e3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:14.926213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00b93d4d-e531-42e5-83e2-788038a95e3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:14.926802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00b93d4d-e531-42e5-83e2-788038a95e3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:14.932281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00b93d4d-e531-42e5-83e2-788038a95e3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:14.932828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00b93d4d-e531-42e5-83e2-788038a95e3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:15.040497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2d3fbaad-e72b-49a1-9442-e9d36797842c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:15.066893 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2d3fbaad-e72b-49a1-9442-e9d36797842c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1309 microversion: 2.1 time: 0.490132 Aug 04 14:08:15.069702 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1456/2920] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:14 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1309 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:15.080274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-823a7540-c472-4c30-abbe-a7f8150848d8 req-168aacec-330c-4338-9067-f629ec3a0ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "233bf06a-0888-4b0d-a891-b785811341ed", "name": "network-vif-plugged", "status": "completed", "tag": "757fc869-3355-4b3f-a414-9ff94a76a291"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:15.104908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-823a7540-c472-4c30-abbe-a7f8150848d8 req-168aacec-330c-4338-9067-f629ec3a0ae2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:15.106056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-823a7540-c472-4c30-abbe-a7f8150848d8 req-168aacec-330c-4338-9067-f629ec3a0ae2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:15.137983 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-823a7540-c472-4c30-abbe-a7f8150848d8 req-168aacec-330c-4338-9067-f629ec3a0ae2 service nova] Creating event network-vif-plugged:757fc869-3355-4b3f-a414-9ff94a76a291 for instance 233bf06a-0888-4b0d-a891-b785811341ed on n-h1-844627-10 Aug 04 14:08:15.152729 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-823a7540-c472-4c30-abbe-a7f8150848d8 req-168aacec-330c-4338-9067-f629ec3a0ae2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079908 Aug 04 14:08:15.156482 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1457/2921] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:15.246965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-00b93d4d-e531-42e5-83e2-788038a95e3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:15.263939 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-00b93d4d-e531-42e5-83e2-788038a95e3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.376859 Aug 04 14:08:15.264547 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1465/2922] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:14 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:15.625358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a4baf2b1-3a68-4998-87cd-5e388110da4f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:15.629969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a4baf2b1-3a68-4998-87cd-5e388110da4f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:15.644767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4baf2b1-3a68-4998-87cd-5e388110da4f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:15.645590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4baf2b1-3a68-4998-87cd-5e388110da4f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:15.646877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4baf2b1-3a68-4998-87cd-5e388110da4f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:15.647694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4baf2b1-3a68-4998-87cd-5e388110da4f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:15.927225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e91d08a7-6199-4bcf-a15f-889808fc37ee tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:15.932580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e91d08a7-6199-4bcf-a15f-889808fc37ee tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:15.978788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e91d08a7-6199-4bcf-a15f-889808fc37ee tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:15.979713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e91d08a7-6199-4bcf-a15f-889808fc37ee tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:15.986376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e91d08a7-6199-4bcf-a15f-889808fc37ee tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:15.988256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e91d08a7-6199-4bcf-a15f-889808fc37ee tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:16.543435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a4baf2b1-3a68-4998-87cd-5e388110da4f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:16.564739 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a4baf2b1-3a68-4998-87cd-5e388110da4f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 0.962379 Aug 04 14:08:16.568700 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1458/2923] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:15 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:16.592060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7973838-361a-4833-aaca-0eb8c9988d68 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:16.601108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7973838-361a-4833-aaca-0eb8c9988d68 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:16.633629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7973838-361a-4833-aaca-0eb8c9988d68 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:16.640825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7973838-361a-4833-aaca-0eb8c9988d68 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:16.642617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7973838-361a-4833-aaca-0eb8c9988d68 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:16.646490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7973838-361a-4833-aaca-0eb8c9988d68 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:16.663303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e91d08a7-6199-4bcf-a15f-889808fc37ee tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:16.680013 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e91d08a7-6199-4bcf-a15f-889808fc37ee tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1472 microversion: 2.1 time: 0.776974 Aug 04 14:08:16.693038 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1466/2924] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:15 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1472 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:16.699730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c5045ba-d8da-4a7e-8945-0c3f14392505 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:16.700361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c5045ba-d8da-4a7e-8945-0c3f14392505 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:16.708153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c5045ba-d8da-4a7e-8945-0c3f14392505 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:16.708725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c5045ba-d8da-4a7e-8945-0c3f14392505 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:16.709847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c5045ba-d8da-4a7e-8945-0c3f14392505 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:16.710352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c5045ba-d8da-4a7e-8945-0c3f14392505 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:16.713885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:17.529234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c5045ba-d8da-4a7e-8945-0c3f14392505 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:17.570043 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c5045ba-d8da-4a7e-8945-0c3f14392505 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.875046 Aug 04 14:08:17.586467 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1467/2925] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:16 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:17.588934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7973838-361a-4833-aaca-0eb8c9988d68 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:17.622501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b63c19c-1e7c-43e7-9917-b58a86e9d6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:17.623672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b63c19c-1e7c-43e7-9917-b58a86e9d6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:17.634357 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7973838-361a-4833-aaca-0eb8c9988d68 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1309 microversion: 2.1 time: 1.062697 Aug 04 14:08:17.641399 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1459/2926] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:16 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1309 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:17.665902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b63c19c-1e7c-43e7-9917-b58a86e9d6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:17.678324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b63c19c-1e7c-43e7-9917-b58a86e9d6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:17.682820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b63c19c-1e7c-43e7-9917-b58a86e9d6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:17.685105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b63c19c-1e7c-43e7-9917-b58a86e9d6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:17.703297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e614702a-cfd4-41df-a6e1-98229c76ab03 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:17.704222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e614702a-cfd4-41df-a6e1-98229c76ab03 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:17.707434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:17.721048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e614702a-cfd4-41df-a6e1-98229c76ab03 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:17.723202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e614702a-cfd4-41df-a6e1-98229c76ab03 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:17.724126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e614702a-cfd4-41df-a6e1-98229c76ab03 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:17.728192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e614702a-cfd4-41df-a6e1-98229c76ab03 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:19.303197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e614702a-cfd4-41df-a6e1-98229c76ab03 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:19.321772 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e614702a-cfd4-41df-a6e1-98229c76ab03 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1472 microversion: 2.1 time: 1.622057 Aug 04 14:08:19.324201 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1460/2927] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:17 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1472 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:19.335183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a540de15-941e-4289-8870-c59b580f74ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:19.337150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a540de15-941e-4289-8870-c59b580f74ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:19.353323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a540de15-941e-4289-8870-c59b580f74ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:19.354718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a540de15-941e-4289-8870-c59b580f74ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:19.356774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a540de15-941e-4289-8870-c59b580f74ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:19.358074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a540de15-941e-4289-8870-c59b580f74ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:19.462433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b63c19c-1e7c-43e7-9917-b58a86e9d6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:19.498244 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b63c19c-1e7c-43e7-9917-b58a86e9d6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.899554 Aug 04 14:08:19.500167 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1468/2928] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:17 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:19.513630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a33df04d-def3-42db-98bb-83cf001be430 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:19.515846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a33df04d-def3-42db-98bb-83cf001be430 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:19.553564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a33df04d-def3-42db-98bb-83cf001be430 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:19.554622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a33df04d-def3-42db-98bb-83cf001be430 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:19.556223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a33df04d-def3-42db-98bb-83cf001be430 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:19.557287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a33df04d-def3-42db-98bb-83cf001be430 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:20.118906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a540de15-941e-4289-8870-c59b580f74ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:20.134826 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a540de15-941e-4289-8870-c59b580f74ba tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.808629 Aug 04 14:08:20.136313 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1461/2929] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:19 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:20.142514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ed0f6963-2b69-4f0d-bdd7-d42e764cca7c req-e050fb22-688f-40b2-b3d4-1f8252af5dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8a40a39-cbe8-47bc-8869-a88e59989f63", "name": "network-vif-deleted", "tag": "19e85bce-c14d-4d20-89ef-01de05cf0ac7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:20.156994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ed0f6963-2b69-4f0d-bdd7-d42e764cca7c req-e050fb22-688f-40b2-b3d4-1f8252af5dc7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:20.157692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ed0f6963-2b69-4f0d-bdd7-d42e764cca7c req-e050fb22-688f-40b2-b3d4-1f8252af5dc7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:20.182002 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ed0f6963-2b69-4f0d-bdd7-d42e764cca7c req-e050fb22-688f-40b2-b3d4-1f8252af5dc7 service nova] Creating event network-vif-deleted:19e85bce-c14d-4d20-89ef-01de05cf0ac7 for instance c8a40a39-cbe8-47bc-8869-a88e59989f63 on n-h2-844627-10 Aug 04 14:08:20.189641 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ed0f6963-2b69-4f0d-bdd7-d42e764cca7c req-e050fb22-688f-40b2-b3d4-1f8252af5dc7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051588 Aug 04 14:08:20.191018 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1462/2930] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:20.266325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0f650b5-d9cd-40f9-b3f7-d615e7ec7738 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:20.267013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0f650b5-d9cd-40f9-b3f7-d615e7ec7738 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:20.277388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0f650b5-d9cd-40f9-b3f7-d615e7ec7738 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:20.278067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0f650b5-d9cd-40f9-b3f7-d615e7ec7738 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:20.278926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0f650b5-d9cd-40f9-b3f7-d615e7ec7738 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:20.279579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0f650b5-d9cd-40f9-b3f7-d615e7ec7738 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:20.281375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a33df04d-def3-42db-98bb-83cf001be430 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:20.298265 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a33df04d-def3-42db-98bb-83cf001be430 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1490 microversion: 2.1 time: 0.795536 Aug 04 14:08:20.299255 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1469/2931] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:19 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1490 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:20.345251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0f650b5-d9cd-40f9-b3f7-d615e7ec7738 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:08:20.371144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:20.371789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:20.403995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:20.404456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:20.410991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:20.413617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:20.547958 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0f650b5-d9cd-40f9-b3f7-d615e7ec7738 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 204 len: 0 microversion: 2.1 time: 0.286744 Aug 04 14:08:20.554838 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1463/2932] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:08:20 2022] DELETE /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:08:20.561977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cc9041f6-17ab-49cc-b8b7-6bfa5694c6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:20.562713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cc9041f6-17ab-49cc-b8b7-6bfa5694c6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:20.571447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc9041f6-17ab-49cc-b8b7-6bfa5694c6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:20.572320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc9041f6-17ab-49cc-b8b7-6bfa5694c6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:20.573491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc9041f6-17ab-49cc-b8b7-6bfa5694c6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:20.574231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc9041f6-17ab-49cc-b8b7-6bfa5694c6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:20.584298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:20.594639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:20.595236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:20.595593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lazy-loading 'fault' on Instance uuid c8a40a39-cbe8-47bc-8869-a88e59989f63 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:08:20.836953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92de0c3f92744fac8c3a0f5e69b15bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82094948d794cdda8a53cbe6c013808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:20.850551 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a31a14ff-830d-4151-90ef-17aad81b2482 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 200 len: 1306 microversion: 2.1 time: 0.484600 Aug 04 14:08:20.851483 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1470/2933] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:20 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 1306 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:20.861649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1663155490", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "2344a004-88b5-43d1-a0c7-ab45883f4f84"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:20.987368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] validate_networks() for [('2344a004-88b5-43d1-a0c7-ab45883f4f84', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:08:21.203024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cc9041f6-17ab-49cc-b8b7-6bfa5694c6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:21.237784 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cc9041f6-17ab-49cc-b8b7-6bfa5694c6b7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 0.679950 Aug 04 14:08:21.249409 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1464/2934] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:20 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:21.258677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-31cca4f7-f738-4093-aa10-ee0bd5dac3e9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:21.259910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-31cca4f7-f738-4093-aa10-ee0bd5dac3e9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:21.272485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31cca4f7-f738-4093-aa10-ee0bd5dac3e9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:21.273234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31cca4f7-f738-4093-aa10-ee0bd5dac3e9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:21.274754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31cca4f7-f738-4093-aa10-ee0bd5dac3e9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:21.276214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31cca4f7-f738-4093-aa10-ee0bd5dac3e9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:21.702238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:08:21.702789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:08:21.703920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:08:21.704444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:08:21.705004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:08:21.726963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:21.728945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:21.730394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:21.732427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:21.802581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:08:21.820925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for user df576732ca5c442694d507fd4dc58279 and project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:08:21.848291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:08:21.854236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:08:21.874421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-31cca4f7-f738-4093-aa10-ee0bd5dac3e9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:21.894614 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-31cca4f7-f738-4093-aa10-ee0bd5dac3e9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1553 microversion: 2.1 time: 0.640540 Aug 04 14:08:21.897763 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1465/2935] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:21 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1553 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:21.906207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38620aa7-de73-457a-be19-b0d7028c2979 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:21.907168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-38620aa7-de73-457a-be19-b0d7028c2979 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:21.938073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38620aa7-de73-457a-be19-b0d7028c2979 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:21.938545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38620aa7-de73-457a-be19-b0d7028c2979 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:21.939351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38620aa7-de73-457a-be19-b0d7028c2979 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:21.942354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38620aa7-de73-457a-be19-b0d7028c2979 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:21.963122 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d1d8d205-f0f6-4e70-8cc9-9b4d2d8f7afc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110497 Aug 04 14:08:21.963797 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1471/2936] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:08:21.987757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:21.989244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] [instance: c8a40a39-cbe8-47bc-8869-a88e59989f63] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:22.006549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:22.008572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:22.009659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:22.011054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:22.046422 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] HTTP exception thrown: Instance c8a40a39-cbe8-47bc-8869-a88e59989f63 could not be found. Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Request method failure captured: Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 HTTP/1.1 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JRk_FDYe2fPDb8EGwsAYL9aHQ_19UvgpbKfdfiWocfIBWivCHU9ycosKaCNPTJDT0xqNskw84zs33tb3Xza4x44mOCuYE_DerjnMCL_ep_ELSv7GAkRS5jer_6hfpKsSNaYadLpD90lL3YII6zHotp_SQj4-HKm7wq-nf8ZHSZx9E Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: e82094948d794cdda8a53cbe6c013808 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerTestJSON-1781342666 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e82094948d794cdda8a53cbe6c013808"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e82094948d794cdda8a53cbe6c013808"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e82094948d794cdda8a53cbe6c013808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e82094948d794cdda8a53cbe6c013808"}]}] Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerTestJSON-1781342666 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: e82094948d794cdda8a53cbe6c013808 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1781342666 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerTestJSON-1781342666-project Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 92de0c3f92744fac8c3a0f5e69b15bb2 Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerTestJSON-1781342666-project Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance c8a40a39-cbe8-47bc-8869-a88e59989f63 could not be found. Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'c8a40a39-cbe8-47bc-8869-a88e59989f63'} Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8a40a39-cbe8-47bc-8869-a88e59989f63 could not be found. Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8a40a39-cbe8-47bc-8869-a88e59989f63 could not be found. Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:22.052913 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:22.058134 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:22.058134 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:22.058134 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:22.058134 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:08:22.058134 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:08:22.058134 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8a40a39-cbe8-47bc-8869-a88e59989f63 could not be found. Aug 04 14:08:22.058134 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:08:22.061899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] Returning 404 to user: Instance c8a40a39-cbe8-47bc-8869-a88e59989f63 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:08:22.069324 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ef71586d-8dc7-4caa-b94b-d0ca6878dc70 tempest-ImagesOneServerTestJSON-1781342666 tempest-ImagesOneServerTestJSON-1781342666-project] 10.222.0.66 "GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63" status: 404 len: 111 microversion: 2.1 time: 0.099117 Aug 04 14:08:22.070740 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1472/2937] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:21 2022] GET /compute/v2.1/servers/c8a40a39-cbe8-47bc-8869-a88e59989f63 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:22.077651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1a65e4c2-0dce-4f8b-b3ab-c485d94dabf4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:22.080346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1a65e4c2-0dce-4f8b-b3ab-c485d94dabf4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:22.228131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1a65e4c2-0dce-4f8b-b3ab-c485d94dabf4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:22.236707 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1a65e4c2-0dce-4f8b-b3ab-c485d94dabf4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1209 microversion: 2.1 time: 0.164419 Aug 04 14:08:22.237894 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1473/2938] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:22 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1209 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:22.259861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e48ae9d5-05a9-404f-96ca-2f9c9d37c283 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:22.260618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e48ae9d5-05a9-404f-96ca-2f9c9d37c283 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:22.292103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e48ae9d5-05a9-404f-96ca-2f9c9d37c283 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:22.292562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e48ae9d5-05a9-404f-96ca-2f9c9d37c283 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:22.293415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e48ae9d5-05a9-404f-96ca-2f9c9d37c283 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:22.296409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e48ae9d5-05a9-404f-96ca-2f9c9d37c283 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:22.887107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-38620aa7-de73-457a-be19-b0d7028c2979 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:22.904696 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-38620aa7-de73-457a-be19-b0d7028c2979 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 1.002022 Aug 04 14:08:22.906349 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1466/2939] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:21 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:22.945661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cadff88c-c842-438a-a259-d93b1c1873a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:22.949388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cadff88c-c842-438a-a259-d93b1c1873a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:22.968914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cadff88c-c842-438a-a259-d93b1c1873a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:22.970983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cadff88c-c842-438a-a259-d93b1c1873a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:22.974799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cadff88c-c842-438a-a259-d93b1c1873a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:22.980423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cadff88c-c842-438a-a259-d93b1c1873a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:23.269373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e48ae9d5-05a9-404f-96ca-2f9c9d37c283 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:23.294660 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e48ae9d5-05a9-404f-96ca-2f9c9d37c283 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.038742 Aug 04 14:08:23.314823 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1474/2940] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:22 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:23.324175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43caf7fb-9208-4a1f-b06f-e3a43a806c3d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:23.329089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-43caf7fb-9208-4a1f-b06f-e3a43a806c3d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:23.343088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43caf7fb-9208-4a1f-b06f-e3a43a806c3d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:23.343887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43caf7fb-9208-4a1f-b06f-e3a43a806c3d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:23.345296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43caf7fb-9208-4a1f-b06f-e3a43a806c3d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:23.345916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43caf7fb-9208-4a1f-b06f-e3a43a806c3d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:23.754316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-43caf7fb-9208-4a1f-b06f-e3a43a806c3d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:23.788618 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-43caf7fb-9208-4a1f-b06f-e3a43a806c3d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1213 microversion: 2.1 time: 0.468174 Aug 04 14:08:23.791214 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1475/2941] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:23 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1213 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:23.929542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cadff88c-c842-438a-a259-d93b1c1873a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:23.947481 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cadff88c-c842-438a-a259-d93b1c1873a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1553 microversion: 2.1 time: 1.011306 Aug 04 14:08:23.948010 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1467/2942] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:22 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1553 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:08:23.972440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dc390e08-e126-42a2-bb15-06f24a5b3687 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:23.974931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dc390e08-e126-42a2-bb15-06f24a5b3687 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:23.990978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc390e08-e126-42a2-bb15-06f24a5b3687 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:23.994058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc390e08-e126-42a2-bb15-06f24a5b3687 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:23.995078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc390e08-e126-42a2-bb15-06f24a5b3687 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:23.995545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc390e08-e126-42a2-bb15-06f24a5b3687 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:24.249613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a11f9d1a-7475-4367-8744-6f8f2a4054b9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Action: 'create', calling method: .version_select at 0x7f4705523820>, body: {"keypair": {"name": "tempest-keypair-759037525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtQNQrHeFLuvjdidXAEa4upmRkrKOwE7cVjhjeTTFd3DbM39ueCQn8SUs+XL24RB26HybZgsJMF/P4l2f0F3QjVoWav8w2xewA6yFWVFoCKqFd/Vrjq3kHJGZKpIM9d/A=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:24.328216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a11f9d1a-7475-4367-8744-6f8f2a4054b9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Getting quotas for project 4cbda0bc0f0b492c8aa15e47d6ab9678. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:08:24.368972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a11f9d1a-7475-4367-8744-6f8f2a4054b9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Getting quotas for user f7465fab904c4c41b229a7a1592eb95b and project 4cbda0bc0f0b492c8aa15e47d6ab9678. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:08:24.433644 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a11f9d1a-7475-4367-8744-6f8f2a4054b9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.640313 Aug 04 14:08:24.435754 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1476/2943] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:08:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:24.447935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-72108692-c20d-45d2-9f4e-989cf86c886c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:24.457714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-72108692-c20d-45d2-9f4e-989cf86c886c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:24.490583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72108692-c20d-45d2-9f4e-989cf86c886c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:24.497794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72108692-c20d-45d2-9f4e-989cf86c886c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:24.499430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72108692-c20d-45d2-9f4e-989cf86c886c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:24.500296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72108692-c20d-45d2-9f4e-989cf86c886c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:24.537679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dc390e08-e126-42a2-bb15-06f24a5b3687 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:24.574323 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dc390e08-e126-42a2-bb15-06f24a5b3687 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1392 microversion: 2.1 time: 0.606110 Aug 04 14:08:24.594500 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1468/2944] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:23 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1392 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:08:24.823125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a333b70c-dd93-4d28-bc0f-258bf26affeb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:24.824189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a333b70c-dd93-4d28-bc0f-258bf26affeb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:24.842807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a333b70c-dd93-4d28-bc0f-258bf26affeb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:24.843651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a333b70c-dd93-4d28-bc0f-258bf26affeb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:24.845744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a333b70c-dd93-4d28-bc0f-258bf26affeb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:24.848178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a333b70c-dd93-4d28-bc0f-258bf26affeb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:25.903017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a333b70c-dd93-4d28-bc0f-258bf26affeb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:25.915654 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a333b70c-dd93-4d28-bc0f-258bf26affeb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1267 microversion: 2.1 time: 1.106663 Aug 04 14:08:25.918509 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1469/2945] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:24 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1267 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:25.928437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bbfe333d-270f-42d7-92ad-b0028310220e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:25.929756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bbfe333d-270f-42d7-92ad-b0028310220e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:25.959725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbfe333d-270f-42d7-92ad-b0028310220e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:25.961580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbfe333d-270f-42d7-92ad-b0028310220e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:25.965742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbfe333d-270f-42d7-92ad-b0028310220e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:25.966531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbfe333d-270f-42d7-92ad-b0028310220e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:26.068433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-72108692-c20d-45d2-9f4e-989cf86c886c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:26.100356 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-72108692-c20d-45d2-9f4e-989cf86c886c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.662679 Aug 04 14:08:26.111282 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1477/2946] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:24 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:26.132080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aa73d9e3-8ba5-41bf-af77-c4a6f3dd24e3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:26.137122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aa73d9e3-8ba5-41bf-af77-c4a6f3dd24e3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:26.175474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa73d9e3-8ba5-41bf-af77-c4a6f3dd24e3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:26.179862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa73d9e3-8ba5-41bf-af77-c4a6f3dd24e3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:26.185195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa73d9e3-8ba5-41bf-af77-c4a6f3dd24e3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:26.185749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa73d9e3-8ba5-41bf-af77-c4a6f3dd24e3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:26.446591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bbfe333d-270f-42d7-92ad-b0028310220e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:26.468299 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bbfe333d-270f-42d7-92ad-b0028310220e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1346 microversion: 2.1 time: 0.547215 Aug 04 14:08:26.474039 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1470/2947] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:25 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1346 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:26.498773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-149ada18-6180-4d03-a482-da1d1fa4c80f req-9bb2d483-b365-4bc4-8af2-d04b080fd0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc944906-6a27-4575-acca-c7d686fd5c17", "name": "network-vif-deleted", "tag": "cc30f7e9-cac7-4c12-9e77-7c7f5994df71"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:26.539874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-149ada18-6180-4d03-a482-da1d1fa4c80f req-9bb2d483-b365-4bc4-8af2-d04b080fd0f7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:26.540338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-149ada18-6180-4d03-a482-da1d1fa4c80f req-9bb2d483-b365-4bc4-8af2-d04b080fd0f7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:26.602200 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-149ada18-6180-4d03-a482-da1d1fa4c80f req-9bb2d483-b365-4bc4-8af2-d04b080fd0f7 service nova] Creating event network-vif-deleted:cc30f7e9-cac7-4c12-9e77-7c7f5994df71 for instance dc944906-6a27-4575-acca-c7d686fd5c17 on n-h1-844627-10 Aug 04 14:08:26.613481 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-149ada18-6180-4d03-a482-da1d1fa4c80f req-9bb2d483-b365-4bc4-8af2-d04b080fd0f7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136312 Aug 04 14:08:26.614451 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1471/2948] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:26.948292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d956e64-19f3-41eb-9e9f-31ec81c8ff99 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:26.962071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9d956e64-19f3-41eb-9e9f-31ec81c8ff99 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:27.008012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d956e64-19f3-41eb-9e9f-31ec81c8ff99 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:27.013152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d956e64-19f3-41eb-9e9f-31ec81c8ff99 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:27.021500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d956e64-19f3-41eb-9e9f-31ec81c8ff99 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:27.029305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d956e64-19f3-41eb-9e9f-31ec81c8ff99 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:28.021774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aa73d9e3-8ba5-41bf-af77-c4a6f3dd24e3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:28.034491 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aa73d9e3-8ba5-41bf-af77-c4a6f3dd24e3 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1382 microversion: 2.1 time: 1.912682 Aug 04 14:08:28.042417 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1478/2949] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:26 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1382 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:28.073443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bccd909c-dee6-4268-b459-6880938d82d4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:28.074241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bccd909c-dee6-4268-b459-6880938d82d4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:28.104822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bccd909c-dee6-4268-b459-6880938d82d4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:28.108991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bccd909c-dee6-4268-b459-6880938d82d4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:28.113488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bccd909c-dee6-4268-b459-6880938d82d4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:28.115678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bccd909c-dee6-4268-b459-6880938d82d4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:28.742192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9d956e64-19f3-41eb-9e9f-31ec81c8ff99 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:28.751322 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d956e64-19f3-41eb-9e9f-31ec81c8ff99 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1309 microversion: 2.1 time: 1.814182 Aug 04 14:08:28.760648 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1472/2950] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:26 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1309 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:28.778480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be170c3a-bbd6-40b4-9efc-3c55b0061256 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:28.779134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be170c3a-bbd6-40b4-9efc-3c55b0061256 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:28.806493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be170c3a-bbd6-40b4-9efc-3c55b0061256 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:28.806969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be170c3a-bbd6-40b4-9efc-3c55b0061256 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:28.817243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be170c3a-bbd6-40b4-9efc-3c55b0061256 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:28.817996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be170c3a-bbd6-40b4-9efc-3c55b0061256 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:29.423755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-be170c3a-bbd6-40b4-9efc-3c55b0061256 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:29.462041 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be170c3a-bbd6-40b4-9efc-3c55b0061256 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1346 microversion: 2.1 time: 0.693164 Aug 04 14:08:29.464523 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1473/2951] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:28 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1346 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:29.503750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6be43a93-3d34-4e27-91d4-bb017730b05c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '.version_select at 0x7f470031a160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:29.517058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bccd909c-dee6-4268-b459-6880938d82d4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:29.518851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6be43a93-3d34-4e27-91d4-bb017730b05c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:29.519647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6be43a93-3d34-4e27-91d4-bb017730b05c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:29.555492 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bccd909c-dee6-4268-b459-6880938d82d4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.507316 Aug 04 14:08:29.558896 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1479/2952] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:28 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:29.578151 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6be43a93-3d34-4e27-91d4-bb017730b05c tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/os-migrations" status: 200 len: 1571 microversion: 2.1 time: 0.104881 Aug 04 14:08:29.588028 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1474/2953] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 14:08:29 2022] GET /compute/v2.1/os-migrations => generated 1571 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:29.598540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d884e240-9987-4759-a604-03000021684a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:29.599299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d884e240-9987-4759-a604-03000021684a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:29.607553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d884e240-9987-4759-a604-03000021684a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:29.613729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d884e240-9987-4759-a604-03000021684a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:29.616322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d884e240-9987-4759-a604-03000021684a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:29.618539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d884e240-9987-4759-a604-03000021684a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:29.795371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76b1c68b-49b7-4235-a2a0-4b666497aa1c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:29.796544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76b1c68b-49b7-4235-a2a0-4b666497aa1c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:29.820077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76b1c68b-49b7-4235-a2a0-4b666497aa1c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:29.820077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76b1c68b-49b7-4235-a2a0-4b666497aa1c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:29.820077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76b1c68b-49b7-4235-a2a0-4b666497aa1c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:29.820077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76b1c68b-49b7-4235-a2a0-4b666497aa1c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:30.649021 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d884e240-9987-4759-a604-03000021684a tempest-LiveMigrationTest-919032458 tempest-LiveMigrationTest-919032458-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1535 microversion: 2.1 time: 1.054272 Aug 04 14:08:30.659638 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1480/2954] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:29 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1535 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:30.669013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b29f3d81-fc03-42bf-9dc0-a10cf4d4ea1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:30.670278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b29f3d81-fc03-42bf-9dc0-a10cf4d4ea1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:30.679338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b29f3d81-fc03-42bf-9dc0-a10cf4d4ea1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:30.681387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b29f3d81-fc03-42bf-9dc0-a10cf4d4ea1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:30.682951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b29f3d81-fc03-42bf-9dc0-a10cf4d4ea1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:30.683829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b29f3d81-fc03-42bf-9dc0-a10cf4d4ea1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:30.928386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76b1c68b-49b7-4235-a2a0-4b666497aa1c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:30.949638 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76b1c68b-49b7-4235-a2a0-4b666497aa1c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1309 microversion: 2.1 time: 1.155266 Aug 04 14:08:30.952097 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1475/2955] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:29 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1309 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:08:30.960175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b29f3d81-fc03-42bf-9dc0-a10cf4d4ea1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:30.986930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b6031908-0fcc-48ae-9f54-cb491101d5f3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:30.990958 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b29f3d81-fc03-42bf-9dc0-a10cf4d4ea1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1346 microversion: 2.1 time: 0.329510 Aug 04 14:08:30.991237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b6031908-0fcc-48ae-9f54-cb491101d5f3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:30.996688 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1481/2956] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:30 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1346 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:31.006095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-57dc1869-06d5-4310-af91-4275aa5e169b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:31.006616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-57dc1869-06d5-4310-af91-4275aa5e169b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:31.023539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6031908-0fcc-48ae-9f54-cb491101d5f3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:31.027342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6031908-0fcc-48ae-9f54-cb491101d5f3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:31.028639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6031908-0fcc-48ae-9f54-cb491101d5f3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:31.029392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6031908-0fcc-48ae-9f54-cb491101d5f3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:31.030861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57dc1869-06d5-4310-af91-4275aa5e169b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:31.031332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57dc1869-06d5-4310-af91-4275aa5e169b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:31.037026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57dc1869-06d5-4310-af91-4275aa5e169b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:31.037505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57dc1869-06d5-4310-af91-4275aa5e169b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:31.175211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-57dc1869-06d5-4310-af91-4275aa5e169b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:08:31.616573 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-57dc1869-06d5-4310-af91-4275aa5e169b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "DELETE /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 204 len: 0 microversion: 2.1 time: 0.616244 Aug 04 14:08:31.619951 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1482/2957] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:08:30 2022] DELETE /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:08:31.646518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f031ff10-f69b-4c16-818a-f4cf481c62bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:31.647850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f031ff10-f69b-4c16-818a-f4cf481c62bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:31.682747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f031ff10-f69b-4c16-818a-f4cf481c62bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:31.684301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f031ff10-f69b-4c16-818a-f4cf481c62bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:31.687178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f031ff10-f69b-4c16-818a-f4cf481c62bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:31.689626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f031ff10-f69b-4c16-818a-f4cf481c62bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:31.760223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:32.652918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b6031908-0fcc-48ae-9f54-cb491101d5f3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:32.694096 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b6031908-0fcc-48ae-9f54-cb491101d5f3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.721393 Aug 04 14:08:32.702520 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1476/2958] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:30 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:32.731342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4d5de5cd-e420-49e2-8a6c-4b6fdaea1a81 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:32.732647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4d5de5cd-e420-49e2-8a6c-4b6fdaea1a81 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:32.807718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d5de5cd-e420-49e2-8a6c-4b6fdaea1a81 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:32.808548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d5de5cd-e420-49e2-8a6c-4b6fdaea1a81 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:32.810032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d5de5cd-e420-49e2-8a6c-4b6fdaea1a81 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:32.810834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d5de5cd-e420-49e2-8a6c-4b6fdaea1a81 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:33.379658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f031ff10-f69b-4c16-818a-f4cf481c62bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:33.394987 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f031ff10-f69b-4c16-818a-f4cf481c62bb tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1388 microversion: 2.1 time: 1.766768 Aug 04 14:08:33.395951 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1483/2959] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:31 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1388 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:33.409635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5bee025-2c05-4606-a110-80e6b554bb9e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:33.410269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5bee025-2c05-4606-a110-80e6b554bb9e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:33.438973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5bee025-2c05-4606-a110-80e6b554bb9e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:33.439349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5bee025-2c05-4606-a110-80e6b554bb9e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:33.440169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5bee025-2c05-4606-a110-80e6b554bb9e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:33.441232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5bee025-2c05-4606-a110-80e6b554bb9e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:33.858762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5bee025-2c05-4606-a110-80e6b554bb9e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:33.875066 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5bee025-2c05-4606-a110-80e6b554bb9e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1346 microversion: 2.1 time: 0.477952 Aug 04 14:08:33.876369 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1484/2960] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:33 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1346 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:33.907241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-4309b292-a9c9-4803-a62a-a2556d8a938d req-d8cccb11-c6a0-45f1-a12e-afb3df9c0178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d3ed57-c6bf-4559-8e99-c92745f5a000", "tag": "6f74e831-3863-45dd-b235-568483fa1355"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:33.940015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4309b292-a9c9-4803-a62a-a2556d8a938d req-d8cccb11-c6a0-45f1-a12e-afb3df9c0178 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:33.942572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4309b292-a9c9-4803-a62a-a2556d8a938d req-d8cccb11-c6a0-45f1-a12e-afb3df9c0178 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:33.970101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:33.986216 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-4309b292-a9c9-4803-a62a-a2556d8a938d req-d8cccb11-c6a0-45f1-a12e-afb3df9c0178 service nova] Creating event network-changed:6f74e831-3863-45dd-b235-568483fa1355 for instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 on n-h2-844627-10 Aug 04 14:08:33.999229 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-4309b292-a9c9-4803-a62a-a2556d8a938d req-d8cccb11-c6a0-45f1-a12e-afb3df9c0178 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121133 Aug 04 14:08:34.004166 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1485/2961] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:34.020167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6052a13b-b570-43cd-b793-e72157b97d2c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:34.024104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6052a13b-b570-43cd-b793-e72157b97d2c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:34.043828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6052a13b-b570-43cd-b793-e72157b97d2c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:34.048901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6052a13b-b570-43cd-b793-e72157b97d2c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:34.059457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6052a13b-b570-43cd-b793-e72157b97d2c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:34.060583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6052a13b-b570-43cd-b793-e72157b97d2c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:34.387405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:35.436370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4d5de5cd-e420-49e2-8a6c-4b6fdaea1a81 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:35.455141 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4d5de5cd-e420-49e2-8a6c-4b6fdaea1a81 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1309 microversion: 2.1 time: 2.750565 Aug 04 14:08:35.455932 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1477/2962] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:32 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1309 bytes in 2753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:35.502349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ee8d0870-ff9f-4b67-a0bc-6c35abb75ad5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:35.505419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ee8d0870-ff9f-4b67-a0bc-6c35abb75ad5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:35.551586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee8d0870-ff9f-4b67-a0bc-6c35abb75ad5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:35.552117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee8d0870-ff9f-4b67-a0bc-6c35abb75ad5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:35.553032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee8d0870-ff9f-4b67-a0bc-6c35abb75ad5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:35.553496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee8d0870-ff9f-4b67-a0bc-6c35abb75ad5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:35.922094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ee8d0870-ff9f-4b67-a0bc-6c35abb75ad5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:35.964607 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ee8d0870-ff9f-4b67-a0bc-6c35abb75ad5 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1183 microversion: 2.1 time: 0.473607 Aug 04 14:08:35.970829 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1478/2963] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:35 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1183 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:36.006496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-66bf14ac-5941-4d07-8653-0e7d118ed715 req-2ad8af62-20b1-4d65-83d5-c72108cf7592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90627287-7390-448b-bc44-878c72306f4e", "name": "network-vif-deleted", "tag": "c115a33c-f9fb-4d11-b284-d04b79cb1a39"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:36.052386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-66bf14ac-5941-4d07-8653-0e7d118ed715 req-2ad8af62-20b1-4d65-83d5-c72108cf7592 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:36.053255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-66bf14ac-5941-4d07-8653-0e7d118ed715 req-2ad8af62-20b1-4d65-83d5-c72108cf7592 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:36.102909 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-66bf14ac-5941-4d07-8653-0e7d118ed715 req-2ad8af62-20b1-4d65-83d5-c72108cf7592 service nova] Creating event network-vif-deleted:c115a33c-f9fb-4d11-b284-d04b79cb1a39 for instance 90627287-7390-448b-bc44-878c72306f4e on n-h1-844627-10 Aug 04 14:08:36.109096 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-66bf14ac-5941-4d07-8653-0e7d118ed715 req-2ad8af62-20b1-4d65-83d5-c72108cf7592 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131051 Aug 04 14:08:36.110657 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1479/2964] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:36.118757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d2674873-22d2-4994-b8b0-f39ca1b2ca74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:36.119777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d2674873-22d2-4994-b8b0-f39ca1b2ca74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:36.132072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2674873-22d2-4994-b8b0-f39ca1b2ca74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:36.132815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2674873-22d2-4994-b8b0-f39ca1b2ca74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:36.134053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2674873-22d2-4994-b8b0-f39ca1b2ca74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:36.134983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2674873-22d2-4994-b8b0-f39ca1b2ca74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:36.700063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6052a13b-b570-43cd-b793-e72157b97d2c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:36.724561 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6052a13b-b570-43cd-b793-e72157b97d2c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 2.718667 Aug 04 14:08:36.741786 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1486/2965] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:34 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 2737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:36.747315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-805131c2-9b56-4c49-b018-b6c18aa755aa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:36.758270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-805131c2-9b56-4c49-b018-b6c18aa755aa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:36.785689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-805131c2-9b56-4c49-b018-b6c18aa755aa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:36.786198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-805131c2-9b56-4c49-b018-b6c18aa755aa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:36.787008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-805131c2-9b56-4c49-b018-b6c18aa755aa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:36.787475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-805131c2-9b56-4c49-b018-b6c18aa755aa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:36.816589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d2674873-22d2-4994-b8b0-f39ca1b2ca74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:36.836012 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d2674873-22d2-4994-b8b0-f39ca1b2ca74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1346 microversion: 2.1 time: 0.723683 Aug 04 14:08:36.844785 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1480/2966] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:36 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1346 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:36.999102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f8da31e-2376-486e-b2f5-6b9478e6ac7f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:37.000507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f8da31e-2376-486e-b2f5-6b9478e6ac7f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:37.017653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f8da31e-2376-486e-b2f5-6b9478e6ac7f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:37.020756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f8da31e-2376-486e-b2f5-6b9478e6ac7f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:37.022073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f8da31e-2376-486e-b2f5-6b9478e6ac7f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:37.022735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f8da31e-2376-486e-b2f5-6b9478e6ac7f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:37.280321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f8da31e-2376-486e-b2f5-6b9478e6ac7f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:37.355326 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f8da31e-2376-486e-b2f5-6b9478e6ac7f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1183 microversion: 2.1 time: 0.359918 Aug 04 14:08:37.372914 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1481/2967] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:36 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:37.551970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-805131c2-9b56-4c49-b018-b6c18aa755aa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:37.563982 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-805131c2-9b56-4c49-b018-b6c18aa755aa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1309 microversion: 2.1 time: 0.819318 Aug 04 14:08:37.583138 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1487/2968] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:36 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1309 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:37.765742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-865f4180-a06c-435c-a0cd-fe76a3843ecb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:37.766475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-865f4180-a06c-435c-a0cd-fe76a3843ecb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:37.782054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-865f4180-a06c-435c-a0cd-fe76a3843ecb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:37.782834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-865f4180-a06c-435c-a0cd-fe76a3843ecb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:37.787874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-865f4180-a06c-435c-a0cd-fe76a3843ecb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:37.792525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-865f4180-a06c-435c-a0cd-fe76a3843ecb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:37.881463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:37.883043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:37.910662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:37.911616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:37.913836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:37.917694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:38.024765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:38.029816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:38.034771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:38.035812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lazy-loading 'fault' on Instance uuid dc944906-6a27-4575-acca-c7d686fd5c17 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:08:38.504795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:38.531546 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d520e61-8a95-4f7a-a137-a78473c46970 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 200 len: 1351 microversion: 2.1 time: 0.655272 Aug 04 14:08:38.569356 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1488/2969] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:37 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 1351 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:38.584464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-601e3058-3af3-458f-b0dd-acccbab0603f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:38.612830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-601e3058-3af3-458f-b0dd-acccbab0603f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:38.652701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-601e3058-3af3-458f-b0dd-acccbab0603f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:38.653105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-601e3058-3af3-458f-b0dd-acccbab0603f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:38.654535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-601e3058-3af3-458f-b0dd-acccbab0603f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:38.661689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-601e3058-3af3-458f-b0dd-acccbab0603f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:39.328812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-601e3058-3af3-458f-b0dd-acccbab0603f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:39.356386 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-601e3058-3af3-458f-b0dd-acccbab0603f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1183 microversion: 2.1 time: 0.785285 Aug 04 14:08:39.369126 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1489/2970] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:38 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1183 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:39.374749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9dc8b5b7-4f8b-4dfd-a47e-a7903982ac21 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:39.385194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9dc8b5b7-4f8b-4dfd-a47e-a7903982ac21 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:39.399985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dc8b5b7-4f8b-4dfd-a47e-a7903982ac21 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:39.402175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dc8b5b7-4f8b-4dfd-a47e-a7903982ac21 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:39.403370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dc8b5b7-4f8b-4dfd-a47e-a7903982ac21 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:39.408100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dc8b5b7-4f8b-4dfd-a47e-a7903982ac21 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:39.445020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-865f4180-a06c-435c-a0cd-fe76a3843ecb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:39.447766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:39.456456 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-865f4180-a06c-435c-a0cd-fe76a3843ecb tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.694569 Aug 04 14:08:39.456979 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1482/2971] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:37 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:39.582818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:39.584614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:39.604027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:39.604687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:39.605831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:39.612085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:39.682064 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 HTTP/1.1 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dc944906-6a27-4575-acca-c7d686fd5c17'} Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:39.716227 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-30a95ac0-e844-4ab4-bf3b-39d8e592b2a8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 404 len: 111 microversion: 2.1 time: 0.140976 Aug 04 14:08:39.723097 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1483/2972] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:39 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:08:40.349958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:40.361873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:40.387010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:40.389428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:40.390760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:40.394709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:40.425441 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17/os-volume_attachments HTTP/1.1 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': 'dc944906-6a27-4575-acca-c7d686fd5c17'} Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:08:40.442063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3d27f2c-c27b-4752-b061-3b59dd6df981 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.099034 Aug 04 14:08:40.457802 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1484/2973] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:08:40 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17/os-volume_attachments => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:40.465294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a01d96ba-0054-4a33-bc11-5d6a3af88eae tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:40.465944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a01d96ba-0054-4a33-bc11-5d6a3af88eae tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:40.505523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a01d96ba-0054-4a33-bc11-5d6a3af88eae tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:40.506034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a01d96ba-0054-4a33-bc11-5d6a3af88eae tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:40.506879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a01d96ba-0054-4a33-bc11-5d6a3af88eae tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:40.510593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a01d96ba-0054-4a33-bc11-5d6a3af88eae tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:40.864646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a01d96ba-0054-4a33-bc11-5d6a3af88eae tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:40.874314 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a01d96ba-0054-4a33-bc11-5d6a3af88eae tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1183 microversion: 2.1 time: 0.420858 Aug 04 14:08:40.900997 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1485/2974] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:40 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1183 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:40.920135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-444b6be9-7562-48a0-9c4d-bd8aa7ead61f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:40.920780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-444b6be9-7562-48a0-9c4d-bd8aa7ead61f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:40.953661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444b6be9-7562-48a0-9c4d-bd8aa7ead61f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:40.954142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444b6be9-7562-48a0-9c4d-bd8aa7ead61f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:40.954989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444b6be9-7562-48a0-9c4d-bd8aa7ead61f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:40.955441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-444b6be9-7562-48a0-9c4d-bd8aa7ead61f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:41.071286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9dc8b5b7-4f8b-4dfd-a47e-a7903982ac21 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:41.087773 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9dc8b5b7-4f8b-4dfd-a47e-a7903982ac21 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1309 microversion: 2.1 time: 1.726369 Aug 04 14:08:41.088384 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1490/2975] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:39 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1309 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:41.113373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1298942925", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:41.303970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] validate_networks() for [('4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:08:42.271810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-444b6be9-7562-48a0-9c4d-bd8aa7ead61f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:42.293539 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-444b6be9-7562-48a0-9c4d-bd8aa7ead61f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.382081 Aug 04 14:08:42.308146 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1486/2976] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:40 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:42.327506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cc3f5ce5-3704-4a24-88a0-2e493a9e8a14 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:42.329642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cc3f5ce5-3704-4a24-88a0-2e493a9e8a14 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:42.353733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc3f5ce5-3704-4a24-88a0-2e493a9e8a14 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:42.357511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc3f5ce5-3704-4a24-88a0-2e493a9e8a14 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:42.359952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc3f5ce5-3704-4a24-88a0-2e493a9e8a14 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:42.361651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc3f5ce5-3704-4a24-88a0-2e493a9e8a14 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:42.938062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cc3f5ce5-3704-4a24-88a0-2e493a9e8a14 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:42.953241 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cc3f5ce5-3704-4a24-88a0-2e493a9e8a14 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1183 microversion: 2.1 time: 0.643774 Aug 04 14:08:42.957426 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1487/2977] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:42 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1183 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:42.973446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-17506d82-8378-436d-8bb6-7f5594c5b3cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:42.979916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-17506d82-8378-436d-8bb6-7f5594c5b3cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:42.999610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17506d82-8378-436d-8bb6-7f5594c5b3cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:43.000376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17506d82-8378-436d-8bb6-7f5594c5b3cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:43.002460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17506d82-8378-436d-8bb6-7f5594c5b3cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:43.005828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17506d82-8378-436d-8bb6-7f5594c5b3cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:43.601283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:08:43.602204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:08:43.603331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:08:43.604394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:08:43.605262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:08:43.686467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:43.688179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:43.690796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:43.700500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:43.814111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:08:43.840694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for user d6f701d08c0741df9ad1375bd0712a59 and project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:08:43.879068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:08:43.884742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:08:44.002609 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-680d7669-cbf4-4f9d-b786-680cbd204f02 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.909819 Aug 04 14:08:44.015590 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1491/2978] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:08:44.049217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-806ac803-8030-4fae-8ca3-4df72da20556 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:44.049947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-806ac803-8030-4fae-8ca3-4df72da20556 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:44.104174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-806ac803-8030-4fae-8ca3-4df72da20556 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:44.105016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-806ac803-8030-4fae-8ca3-4df72da20556 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:44.107693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-806ac803-8030-4fae-8ca3-4df72da20556 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:44.115567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-806ac803-8030-4fae-8ca3-4df72da20556 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:45.775090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-17506d82-8378-436d-8bb6-7f5594c5b3cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:45.790476 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-17506d82-8378-436d-8bb6-7f5594c5b3cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1309 microversion: 2.1 time: 2.829242 Aug 04 14:08:45.793093 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1488/2979] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:42 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1309 bytes in 2834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:45.811880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-abf5bceb-cf65-41fb-9f41-3b81a52f7538 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:45.816756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-abf5bceb-cf65-41fb-9f41-3b81a52f7538 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:45.838294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abf5bceb-cf65-41fb-9f41-3b81a52f7538 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:45.839231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abf5bceb-cf65-41fb-9f41-3b81a52f7538 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:45.840646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abf5bceb-cf65-41fb-9f41-3b81a52f7538 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:45.841461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abf5bceb-cf65-41fb-9f41-3b81a52f7538 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:45.874974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-806ac803-8030-4fae-8ca3-4df72da20556 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:45.905221 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-806ac803-8030-4fae-8ca3-4df72da20556 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 1.878776 Aug 04 14:08:45.907449 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1492/2980] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:44 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:45.927633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-40eeef99-4852-434e-b549-bc13a49b9ceb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:45.934549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-40eeef99-4852-434e-b549-bc13a49b9ceb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:45.953822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40eeef99-4852-434e-b549-bc13a49b9ceb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:45.954210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40eeef99-4852-434e-b549-bc13a49b9ceb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:45.955161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40eeef99-4852-434e-b549-bc13a49b9ceb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:45.962301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40eeef99-4852-434e-b549-bc13a49b9ceb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:46.199217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-abf5bceb-cf65-41fb-9f41-3b81a52f7538 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:46.214644 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-abf5bceb-cf65-41fb-9f41-3b81a52f7538 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1183 microversion: 2.1 time: 0.418535 Aug 04 14:08:46.229845 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1489/2981] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:45 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:46.827862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-26a7a8e5-1456-4310-b6c4-3d031a74c260 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:46.829165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-26a7a8e5-1456-4310-b6c4-3d031a74c260 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:46.887570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26a7a8e5-1456-4310-b6c4-3d031a74c260 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:46.888409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26a7a8e5-1456-4310-b6c4-3d031a74c260 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:46.896427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26a7a8e5-1456-4310-b6c4-3d031a74c260 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:46.903625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26a7a8e5-1456-4310-b6c4-3d031a74c260 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:47.095591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-40eeef99-4852-434e-b549-bc13a49b9ceb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:47.136532 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-40eeef99-4852-434e-b549-bc13a49b9ceb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1267 microversion: 2.1 time: 1.225299 Aug 04 14:08:47.137567 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1493/2982] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:45 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1267 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:47.163070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9bccf7cf-8edc-43f3-925f-d100079ef72c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:47.173417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9bccf7cf-8edc-43f3-925f-d100079ef72c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:47.209741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bccf7cf-8edc-43f3-925f-d100079ef72c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:47.210344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bccf7cf-8edc-43f3-925f-d100079ef72c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:47.211876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bccf7cf-8edc-43f3-925f-d100079ef72c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:47.213807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bccf7cf-8edc-43f3-925f-d100079ef72c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:47.922284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-26a7a8e5-1456-4310-b6c4-3d031a74c260 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:47.946670 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-26a7a8e5-1456-4310-b6c4-3d031a74c260 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1309 microversion: 2.1 time: 1.137096 Aug 04 14:08:47.951723 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1490/2983] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:46 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1309 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:08:47.978102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-67f01dec-9f0e-4d1a-9d5f-3f6331ee02a4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:47.979405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-67f01dec-9f0e-4d1a-9d5f-3f6331ee02a4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:47.989092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:48.019669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67f01dec-9f0e-4d1a-9d5f-3f6331ee02a4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:48.020500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67f01dec-9f0e-4d1a-9d5f-3f6331ee02a4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:48.031071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67f01dec-9f0e-4d1a-9d5f-3f6331ee02a4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:48.032000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67f01dec-9f0e-4d1a-9d5f-3f6331ee02a4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:48.143084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-67f01dec-9f0e-4d1a-9d5f-3f6331ee02a4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:08:48.421518 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-67f01dec-9f0e-4d1a-9d5f-3f6331ee02a4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 204 len: 0 microversion: 2.1 time: 0.466359 Aug 04 14:08:48.422049 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1491/2984] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:08:47 2022] DELETE /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:08:48.444514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9bccf7cf-8edc-43f3-925f-d100079ef72c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:48.461015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4b4ece1-a19c-4922-ab15-a143dfde0f9d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:48.466084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b4b4ece1-a19c-4922-ab15-a143dfde0f9d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:48.469572 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9bccf7cf-8edc-43f3-925f-d100079ef72c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1500 microversion: 2.1 time: 1.326409 Aug 04 14:08:48.471769 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1494/2985] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:47 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1500 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:48.512772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4b4ece1-a19c-4922-ab15-a143dfde0f9d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:48.514832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4b4ece1-a19c-4922-ab15-a143dfde0f9d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:48.517984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4b4ece1-a19c-4922-ab15-a143dfde0f9d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:48.520308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4b4ece1-a19c-4922-ab15-a143dfde0f9d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:48.769269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4b4ece1-a19c-4922-ab15-a143dfde0f9d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:48.791692 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4b4ece1-a19c-4922-ab15-a143dfde0f9d tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1183 microversion: 2.1 time: 0.362403 Aug 04 14:08:48.792337 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1492/2986] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:48 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1183 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:48.815564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c558889-e09a-4eb3-94f0-429c7215cc34 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:48.816232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7c558889-e09a-4eb3-94f0-429c7215cc34 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:48.824177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1179649368", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "6821352e-0edb-41d3-8a4b-8a3f25fef7a8"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:48.858712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c558889-e09a-4eb3-94f0-429c7215cc34 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:48.859279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c558889-e09a-4eb3-94f0-429c7215cc34 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:48.860192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c558889-e09a-4eb3-94f0-429c7215cc34 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:48.860734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c558889-e09a-4eb3-94f0-429c7215cc34 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:48.967136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] validate_networks() for [('6821352e-0edb-41d3-8a4b-8a3f25fef7a8', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:08:49.064722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c558889-e09a-4eb3-94f0-429c7215cc34 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:49.093863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c558889-e09a-4eb3-94f0-429c7215cc34 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1273 microversion: 2.1 time: 0.284703 Aug 04 14:08:49.095367 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1493/2987] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:48 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1273 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:49.103546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cc4a8a1-78d3-4325-bb2a-28c5d5324572"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:49.111824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:49.131545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:49.132959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:49.135385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:49.136595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:49.216988 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] HTTP exception thrown: Cannot 'attach_volume' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state rescued Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Request method failure captured: Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/os-volume_attachments HTTP/1.1 Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 74 Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JxokQZWt73oCTeb2uIT1T61PPtBceW-GidRWsXDOZjQVnibDMlYFve8J2CmvNSqnoJ2gUswAJOQhT5G9sx82VvrXKfhYzVPLV5Gd4BsYAE7SpJCYfj1C3r3f1XD7yVS8i5KHJX727wlQRlE5KUXS609Oac6ysS4Xt8O7zqu2gmqzI Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}] Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 653fb03c7a4b4a61a57ecd4cdd610e86 Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: {"volumeAttachment": {"volumeId": "9cc4a8a1-78d3-4325-bb2a-28c5d5324572"}} Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: exception: Cannot 'attach_volume' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state rescued Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': 'da969e0f-87c4-4c9d-bef7-b74fb0837616', 'body': {'volumeAttachment': {'volumeId': '9cc4a8a1-78d3-4325-bb2a-28c5d5324572'}}} Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da969e0f-87c4-4c9d-bef7-b74fb0837616 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 14:08:49.223718 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state rescued Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state rescued Aug 04 14:08:49.228122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:49.232435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Returning 409 to user: Cannot 'attach_volume' instance da969e0f-87c4-4c9d-bef7-b74fb0837616 while it is in vm_state rescued {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:08:49.235583 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-046e0a68-2ac7-4b00-bf01-89b8fa48706b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.138084 Aug 04 14:08:49.238119 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1494/2988] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:08:49 2022] POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/os-volume_attachments => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:08:49.247137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0bebe43-a08f-409c-b2e0-24c8b5206c40 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:49.248207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c0bebe43-a08f-409c-b2e0-24c8b5206c40 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:49.273097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0bebe43-a08f-409c-b2e0-24c8b5206c40 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:49.274239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0bebe43-a08f-409c-b2e0-24c8b5206c40 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:49.276435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0bebe43-a08f-409c-b2e0-24c8b5206c40 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:49.278978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0bebe43-a08f-409c-b2e0-24c8b5206c40 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:50.041944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c0bebe43-a08f-409c-b2e0-24c8b5206c40 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:50.058423 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0bebe43-a08f-409c-b2e0-24c8b5206c40 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1309 microversion: 2.1 time: 0.817688 Aug 04 14:08:50.059096 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1495/2989] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:49 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1309 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:50.080441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-781b8eda-4a84-476f-b8a1-e1b1ea6046a9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:50.081672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-781b8eda-4a84-476f-b8a1-e1b1ea6046a9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:50.100978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-781b8eda-4a84-476f-b8a1-e1b1ea6046a9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:50.101711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-781b8eda-4a84-476f-b8a1-e1b1ea6046a9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:50.102743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-781b8eda-4a84-476f-b8a1-e1b1ea6046a9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:50.103502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-781b8eda-4a84-476f-b8a1-e1b1ea6046a9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:50.401102 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-781b8eda-4a84-476f-b8a1-e1b1ea6046a9 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action" status: 202 len: 0 microversion: 2.1 time: 0.330051 Aug 04 14:08:50.403030 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1496/2990] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:08:50 2022] POST /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:08:50.412496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5dff950a-9e7e-4869-bae3-2efd72d8ce26 req-0b5c2d30-eb38-462a-b848-17b5c6715441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d3ed57-c6bf-4559-8e99-c92745f5a000", "name": "network-vif-plugged", "status": "completed", "tag": "6f74e831-3863-45dd-b235-568483fa1355"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:08:50.428481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5dff950a-9e7e-4869-bae3-2efd72d8ce26 req-0b5c2d30-eb38-462a-b848-17b5c6715441 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:50.436738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5dff950a-9e7e-4869-bae3-2efd72d8ce26 req-0b5c2d30-eb38-462a-b848-17b5c6715441 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:50.529467 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5dff950a-9e7e-4869-bae3-2efd72d8ce26 req-0b5c2d30-eb38-462a-b848-17b5c6715441 service nova] Creating event network-vif-plugged:6f74e831-3863-45dd-b235-568483fa1355 for instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 on n-h2-844627-10 Aug 04 14:08:50.548598 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5dff950a-9e7e-4869-bae3-2efd72d8ce26 req-0b5c2d30-eb38-462a-b848-17b5c6715441 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139503 Aug 04 14:08:50.550943 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1497/2991] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:08:50.578537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:50.582136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:50.614131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:50.632429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:50.636956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:50.637723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:50.812340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:50.813109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:50.820023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lazy-loading 'fault' on Instance uuid 90627287-7390-448b-bc44-878c72306f4e {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:08:51.679488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:51.683257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:08:51.700001 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6dbdeaf1-4978-4391-9372-f232c959bb74 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 200 len: 1142 microversion: 2.1 time: 1.143717 Aug 04 14:08:51.701522 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1498/2992] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:50 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 1142 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:51.715413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a8c7ace-28d2-4a1b-96ef-5ca9f5768010 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:51.719240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a8c7ace-28d2-4a1b-96ef-5ca9f5768010 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:51.744472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a8c7ace-28d2-4a1b-96ef-5ca9f5768010 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:51.745586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a8c7ace-28d2-4a1b-96ef-5ca9f5768010 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:51.746856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a8c7ace-28d2-4a1b-96ef-5ca9f5768010 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:51.747726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a8c7ace-28d2-4a1b-96ef-5ca9f5768010 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:52.354927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:08:52.356347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:08:52.359848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:08:52.361259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:08:52.362156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:08:52.390087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:52.392131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:52.396122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:52.398177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:52.521726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Getting quotas for project 786fea7d4481410d9591a181521c1eb4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:08:52.549856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Getting quotas for user f648ba00abbe4679a43d65bc925da013 and project 786fea7d4481410d9591a181521c1eb4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:08:52.623946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:08:52.633731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:08:52.801781 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ad0e8d8d-14e8-4460-9883-2f0a22fe1cab tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.327038 Aug 04 14:08:52.812437 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1495/2993] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:08:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:08:52.832186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7a8c7ace-28d2-4a1b-96ef-5ca9f5768010 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:52.836948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2247d0e-b090-486d-abb5-844d924d9094 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:52.837597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e2247d0e-b090-486d-abb5-844d924d9094 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:52.852432 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a8c7ace-28d2-4a1b-96ef-5ca9f5768010 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1315 microversion: 2.1 time: 1.141831 Aug 04 14:08:52.853141 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1499/2994] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:51 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1315 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:52.866520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2247d0e-b090-486d-abb5-844d924d9094 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:52.874264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2247d0e-b090-486d-abb5-844d924d9094 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:52.878516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3f426dfd-8c58-4738-b00e-27f6ebfc24ea tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:52.879830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3f426dfd-8c58-4738-b00e-27f6ebfc24ea tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:52.880152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2247d0e-b090-486d-abb5-844d924d9094 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:52.881708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2247d0e-b090-486d-abb5-844d924d9094 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:52.928980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f426dfd-8c58-4738-b00e-27f6ebfc24ea tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:52.929957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f426dfd-8c58-4738-b00e-27f6ebfc24ea tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:52.931536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f426dfd-8c58-4738-b00e-27f6ebfc24ea tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:52.932156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f426dfd-8c58-4738-b00e-27f6ebfc24ea tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:53.930486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3f426dfd-8c58-4738-b00e-27f6ebfc24ea tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:53.973357 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3f426dfd-8c58-4738-b00e-27f6ebfc24ea tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1309 microversion: 2.1 time: 1.081133 Aug 04 14:08:53.985326 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1500/2995] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:52 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1309 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:53.993567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:53.999714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 90627287-7390-448b-bc44-878c72306f4e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:54.025916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:54.029151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:54.032980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:54.034970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:54.113583 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] HTTP exception thrown: Instance 90627287-7390-448b-bc44-878c72306f4e could not be found. Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Request method failure captured: Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e HTTP/1.1 Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69DJ7UvFMMQjxuNDGGzjmZREMHLlPKxIERi-6Xjw59TNuWQeh_S30PzHoTkmZG9_2h_Q4QERz2msjPjuyRjTw46n9sLubSR2JWDuNFhNwuD-kyoyomXZNiUxjmRtn9uOBHtyNJUJll3yYDcs_6rKq614le-nPQLJr6B5iT_HciDxV6A Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1d0f04146c914cf1940cea4b2229ebd5 Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-LiveMigrationTest-1263624033 Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1d0f04146c914cf1940cea4b2229ebd5"}]}] Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-LiveMigrationTest-1263624033 Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1d0f04146c914cf1940cea4b2229ebd5 Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-LiveMigrationTest-1263624033 Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-LiveMigrationTest-1263624033-project Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: dd1aacb549b74c21a13b9f3ca2df840c Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-LiveMigrationTest-1263624033-project Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 90627287-7390-448b-bc44-878c72306f4e could not be found. Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '90627287-7390-448b-bc44-878c72306f4e'} Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90627287-7390-448b-bc44-878c72306f4e could not be found. Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90627287-7390-448b-bc44-878c72306f4e could not be found. Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:08:54.135324 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:54.149245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:08:54.149245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:08:54.149245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:08:54.149245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:08:54.149245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:08:54.149245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90627287-7390-448b-bc44-878c72306f4e could not be found. Aug 04 14:08:54.149245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:08:54.154963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Returning 404 to user: Instance 90627287-7390-448b-bc44-878c72306f4e could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:08:54.162844 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a9b942c-d1ce-47c5-a13b-c52c27227e73 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e" status: 404 len: 111 microversion: 2.1 time: 0.175561 Aug 04 14:08:54.194638 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1501/2996] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:53 2022] GET /compute/v2.1/servers/90627287-7390-448b-bc44-878c72306f4e => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:08:54.244795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aeaff649-908c-493a-9c83-8ad88eca9aec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:54.246026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aeaff649-908c-493a-9c83-8ad88eca9aec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:54.416296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e2247d0e-b090-486d-abb5-844d924d9094 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:54.433364 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e2247d0e-b090-486d-abb5-844d924d9094 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1508 microversion: 2.1 time: 1.619649 Aug 04 14:08:54.441436 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1496/2997] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:52 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1508 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:54.462526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-16189d39-edb9-44cf-bbe8-7786d1d4824b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:54.464751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-16189d39-edb9-44cf-bbe8-7786d1d4824b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:54.500831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16189d39-edb9-44cf-bbe8-7786d1d4824b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:54.505801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16189d39-edb9-44cf-bbe8-7786d1d4824b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:54.511095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16189d39-edb9-44cf-bbe8-7786d1d4824b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:54.518782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16189d39-edb9-44cf-bbe8-7786d1d4824b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:54.650422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aeaff649-908c-493a-9c83-8ad88eca9aec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:54.685588 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aeaff649-908c-493a-9c83-8ad88eca9aec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1225 microversion: 2.1 time: 0.480818 Aug 04 14:08:54.686687 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1502/2998] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:54 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1225 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:55.009234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72f3f18a-62af-4d49-99f0-ab1f43e43602 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:55.010628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-72f3f18a-62af-4d49-99f0-ab1f43e43602 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:55.051376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72f3f18a-62af-4d49-99f0-ab1f43e43602 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:55.052226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72f3f18a-62af-4d49-99f0-ab1f43e43602 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:55.053802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72f3f18a-62af-4d49-99f0-ab1f43e43602 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:55.058627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72f3f18a-62af-4d49-99f0-ab1f43e43602 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:56.039537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-16189d39-edb9-44cf-bbe8-7786d1d4824b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:56.055647 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-16189d39-edb9-44cf-bbe8-7786d1d4824b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1315 microversion: 2.1 time: 1.611547 Aug 04 14:08:56.056818 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1497/2999] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:54 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1315 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:56.072110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1ce551b5-2bcd-4825-a9f0-c6624fe7eb9b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:56.072947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1ce551b5-2bcd-4825-a9f0-c6624fe7eb9b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:56.100668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ce551b5-2bcd-4825-a9f0-c6624fe7eb9b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:56.105284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ce551b5-2bcd-4825-a9f0-c6624fe7eb9b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:56.106664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ce551b5-2bcd-4825-a9f0-c6624fe7eb9b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:56.107077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ce551b5-2bcd-4825-a9f0-c6624fe7eb9b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:57.411546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-72f3f18a-62af-4d49-99f0-ab1f43e43602 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:57.429545 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-72f3f18a-62af-4d49-99f0-ab1f43e43602 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1490 microversion: 2.1 time: 2.436762 Aug 04 14:08:57.433909 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1503/3000] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:54 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1490 bytes in 2442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:57.461488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8507e342-eb07-40e5-950f-5ec8a5dfd16e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:57.470339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8507e342-eb07-40e5-950f-5ec8a5dfd16e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:57.497356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8507e342-eb07-40e5-950f-5ec8a5dfd16e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:57.516102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8507e342-eb07-40e5-950f-5ec8a5dfd16e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:57.523892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8507e342-eb07-40e5-950f-5ec8a5dfd16e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:57.530331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8507e342-eb07-40e5-950f-5ec8a5dfd16e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:57.593085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1ce551b5-2bcd-4825-a9f0-c6624fe7eb9b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:57.615853 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1ce551b5-2bcd-4825-a9f0-c6624fe7eb9b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1508 microversion: 2.1 time: 1.557373 Aug 04 14:08:57.628904 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1498/3001] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:56 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1508 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:57.644946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf8ffb40-d6ad-4ae1-ae13-1efa841ba17f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:57.644946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf8ffb40-d6ad-4ae1-ae13-1efa841ba17f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:57.673325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf8ffb40-d6ad-4ae1-ae13-1efa841ba17f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:57.673789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf8ffb40-d6ad-4ae1-ae13-1efa841ba17f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:57.674831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf8ffb40-d6ad-4ae1-ae13-1efa841ba17f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:57.675282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf8ffb40-d6ad-4ae1-ae13-1efa841ba17f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:57.754251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8507e342-eb07-40e5-950f-5ec8a5dfd16e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:57.795128 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8507e342-eb07-40e5-950f-5ec8a5dfd16e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1283 microversion: 2.1 time: 0.350999 Aug 04 14:08:57.806830 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1504/3002] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:57 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1283 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:57.815349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e4f9b5f-f3cd-4b00-aa95-a2e3572389ec tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:57.816496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2e4f9b5f-f3cd-4b00-aa95-a2e3572389ec tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:57.835584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e4f9b5f-f3cd-4b00-aa95-a2e3572389ec tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:57.845189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e4f9b5f-f3cd-4b00-aa95-a2e3572389ec tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:57.846989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e4f9b5f-f3cd-4b00-aa95-a2e3572389ec tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:57.850910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e4f9b5f-f3cd-4b00-aa95-a2e3572389ec tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:59.030526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bf8ffb40-d6ad-4ae1-ae13-1efa841ba17f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:59.069880 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf8ffb40-d6ad-4ae1-ae13-1efa841ba17f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1315 microversion: 2.1 time: 1.447385 Aug 04 14:08:59.083799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2e4f9b5f-f3cd-4b00-aa95-a2e3572389ec tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:08:59.089745 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1499/3003] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:57 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1315 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:59.109192 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2e4f9b5f-f3cd-4b00-aa95-a2e3572389ec tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1490 microversion: 2.1 time: 1.292458 Aug 04 14:08:59.112600 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1505/3004] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:57 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1490 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:08:59.119665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c67aef1b-e739-4047-83b3-2af823c28023 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:08:59.120570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c67aef1b-e739-4047-83b3-2af823c28023 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:08:59.165514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c67aef1b-e739-4047-83b3-2af823c28023 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:59.166589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c67aef1b-e739-4047-83b3-2af823c28023 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:08:59.173728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c67aef1b-e739-4047-83b3-2af823c28023 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:08:59.175172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c67aef1b-e739-4047-83b3-2af823c28023 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:00.078104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-fd4120ae-9de7-4e38-9b1e-e48170988c95 req-4bcf0279-6e91-4c2e-8751-dfb4713ad3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e302fd-fd35-4511-94b2-72c885adeeeb", "tag": "d6bd7e81-a25e-475b-95a9-f101ae61e390"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:00.103243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fd4120ae-9de7-4e38-9b1e-e48170988c95 req-4bcf0279-6e91-4c2e-8751-dfb4713ad3ba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:00.104361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fd4120ae-9de7-4e38-9b1e-e48170988c95 req-4bcf0279-6e91-4c2e-8751-dfb4713ad3ba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:00.119468 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fd4120ae-9de7-4e38-9b1e-e48170988c95 req-4bcf0279-6e91-4c2e-8751-dfb4713ad3ba service nova] Creating event network-changed:d6bd7e81-a25e-475b-95a9-f101ae61e390 for instance 45e302fd-fd35-4511-94b2-72c885adeeeb on n-h1-844627-10 Aug 04 14:09:00.128840 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-fd4120ae-9de7-4e38-9b1e-e48170988c95 req-4bcf0279-6e91-4c2e-8751-dfb4713ad3ba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.034414 Aug 04 14:09:00.130928 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1500/3005] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:00.138848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-41f9950f-7c5c-41ab-beff-2790e7cf3567 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:00.139788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-41f9950f-7c5c-41ab-beff-2790e7cf3567 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:00.160693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41f9950f-7c5c-41ab-beff-2790e7cf3567 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:00.161224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41f9950f-7c5c-41ab-beff-2790e7cf3567 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:00.162231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41f9950f-7c5c-41ab-beff-2790e7cf3567 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:00.162964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41f9950f-7c5c-41ab-beff-2790e7cf3567 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:00.531986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-41f9950f-7c5c-41ab-beff-2790e7cf3567 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:00.541982 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-41f9950f-7c5c-41ab-beff-2790e7cf3567 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1283 microversion: 2.1 time: 0.408455 Aug 04 14:09:00.565243 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1501/3006] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:00 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1283 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:00.582305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f891055-ff4a-4f38-97c7-0889384609c4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:00.583095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f891055-ff4a-4f38-97c7-0889384609c4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:00.602156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f891055-ff4a-4f38-97c7-0889384609c4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:00.602626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f891055-ff4a-4f38-97c7-0889384609c4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:00.603438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f891055-ff4a-4f38-97c7-0889384609c4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:00.603886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f891055-ff4a-4f38-97c7-0889384609c4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:00.787783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c67aef1b-e739-4047-83b3-2af823c28023 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:00.804950 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c67aef1b-e739-4047-83b3-2af823c28023 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1514 microversion: 2.1 time: 1.690556 Aug 04 14:09:00.810643 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1506/3007] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:08:59 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1514 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:00.834174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-97462563-c247-42cc-b114-a924c723b4c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:00.834817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-97462563-c247-42cc-b114-a924c723b4c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:00.901836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97462563-c247-42cc-b114-a924c723b4c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:00.902702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97462563-c247-42cc-b114-a924c723b4c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:00.904284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97462563-c247-42cc-b114-a924c723b4c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:00.905143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97462563-c247-42cc-b114-a924c723b4c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:01.953516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5f891055-ff4a-4f38-97c7-0889384609c4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:01.980695 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f891055-ff4a-4f38-97c7-0889384609c4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1490 microversion: 2.1 time: 1.413743 Aug 04 14:09:02.007058 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1502/3008] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:00 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1490 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:02.038009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-efae5afc-baf9-475a-b3ae-5407a3ae0395 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:02.044788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-efae5afc-baf9-475a-b3ae-5407a3ae0395 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:02.089585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efae5afc-baf9-475a-b3ae-5407a3ae0395 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:02.101296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efae5afc-baf9-475a-b3ae-5407a3ae0395 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:02.107650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efae5afc-baf9-475a-b3ae-5407a3ae0395 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:02.116586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efae5afc-baf9-475a-b3ae-5407a3ae0395 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:02.122809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-97462563-c247-42cc-b114-a924c723b4c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:02.144587 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-97462563-c247-42cc-b114-a924c723b4c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1315 microversion: 2.1 time: 1.332660 Aug 04 14:09:02.167555 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1507/3009] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:00 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1315 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:02.185991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2b6c583e-c380-4ca1-878a-8ed5b616346c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:02.186528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2b6c583e-c380-4ca1-878a-8ed5b616346c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:02.204010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b6c583e-c380-4ca1-878a-8ed5b616346c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:02.205504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b6c583e-c380-4ca1-878a-8ed5b616346c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:02.206493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b6c583e-c380-4ca1-878a-8ed5b616346c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:02.206947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b6c583e-c380-4ca1-878a-8ed5b616346c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:02.337148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2b6c583e-c380-4ca1-878a-8ed5b616346c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:09:02.445034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:02.534700 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2b6c583e-c380-4ca1-878a-8ed5b616346c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 204 len: 0 microversion: 2.1 time: 0.365120 Aug 04 14:09:02.535308 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1508/3010] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:09:02 2022] DELETE /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:02.564598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-21879e32-2389-4e98-841c-ef2729d08b9b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:02.573016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-21879e32-2389-4e98-841c-ef2729d08b9b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:02.593760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:02.605920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21879e32-2389-4e98-841c-ef2729d08b9b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:02.610765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21879e32-2389-4e98-841c-ef2729d08b9b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:02.620086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21879e32-2389-4e98-841c-ef2729d08b9b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:02.620700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21879e32-2389-4e98-841c-ef2729d08b9b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:02.814557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-efae5afc-baf9-475a-b3ae-5407a3ae0395 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:02.834186 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-efae5afc-baf9-475a-b3ae-5407a3ae0395 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1325 microversion: 2.1 time: 0.822479 Aug 04 14:09:02.855443 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1503/3011] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:02 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1325 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:03.011775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-21879e32-2389-4e98-841c-ef2729d08b9b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:03.028121 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-21879e32-2389-4e98-841c-ef2729d08b9b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1496 microversion: 2.1 time: 0.486960 Aug 04 14:09:03.041628 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1509/3012] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:02 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1496 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:03.182106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9a7148dc-c93a-412e-9240-ad0852101f30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:03.183500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9a7148dc-c93a-412e-9240-ad0852101f30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:03.204892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a7148dc-c93a-412e-9240-ad0852101f30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:03.206724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a7148dc-c93a-412e-9240-ad0852101f30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:03.213498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a7148dc-c93a-412e-9240-ad0852101f30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:03.219135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a7148dc-c93a-412e-9240-ad0852101f30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:03.311123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:03.821988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9a7148dc-c93a-412e-9240-ad0852101f30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:03.838514 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9a7148dc-c93a-412e-9240-ad0852101f30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1315 microversion: 2.1 time: 0.659376 Aug 04 14:09:03.840738 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1504/3013] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:03 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:03.872799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c6e87ba3-57bd-4197-b19b-b09141feaaaf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:03.873944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c6e87ba3-57bd-4197-b19b-b09141feaaaf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:03.928972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6e87ba3-57bd-4197-b19b-b09141feaaaf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:03.929945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6e87ba3-57bd-4197-b19b-b09141feaaaf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:03.931439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6e87ba3-57bd-4197-b19b-b09141feaaaf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:03.932260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6e87ba3-57bd-4197-b19b-b09141feaaaf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:04.058641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-edb8c844-1f1a-4ac8-acd8-6380975c6563 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:04.066483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-edb8c844-1f1a-4ac8-acd8-6380975c6563 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:04.123639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edb8c844-1f1a-4ac8-acd8-6380975c6563 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:04.129438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edb8c844-1f1a-4ac8-acd8-6380975c6563 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:04.146482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edb8c844-1f1a-4ac8-acd8-6380975c6563 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:04.149298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edb8c844-1f1a-4ac8-acd8-6380975c6563 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:04.683968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:05.528489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-edb8c844-1f1a-4ac8-acd8-6380975c6563 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:05.608198 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-edb8c844-1f1a-4ac8-acd8-6380975c6563 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1496 microversion: 2.1 time: 1.558574 Aug 04 14:09:05.614365 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1505/3014] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:04 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1496 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:05.655721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c34eeedd-2d64-4e87-833d-772123153793 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:05.657292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c34eeedd-2d64-4e87-833d-772123153793 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:05.696031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c34eeedd-2d64-4e87-833d-772123153793 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:05.710109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c34eeedd-2d64-4e87-833d-772123153793 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:05.724073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c34eeedd-2d64-4e87-833d-772123153793 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:05.725429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c34eeedd-2d64-4e87-833d-772123153793 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:05.881125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c6e87ba3-57bd-4197-b19b-b09141feaaaf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:05.916304 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c6e87ba3-57bd-4197-b19b-b09141feaaaf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1325 microversion: 2.1 time: 2.060455 Aug 04 14:09:05.921664 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1510/3015] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:03 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1325 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:05.954953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7dc335cf-9a16-4dad-afd4-d591d1250921 req-dd75f4bf-ef58-4ee5-9b27-9109778a1cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383d7069-d26f-4b0c-b363-455fe8e5424b", "tag": "16cad79f-fc8b-422b-b7c4-cba9a5b01afa"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:06.017339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7dc335cf-9a16-4dad-afd4-d591d1250921 req-dd75f4bf-ef58-4ee5-9b27-9109778a1cc7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:06.018224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7dc335cf-9a16-4dad-afd4-d591d1250921 req-dd75f4bf-ef58-4ee5-9b27-9109778a1cc7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:06.105765 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7dc335cf-9a16-4dad-afd4-d591d1250921 req-dd75f4bf-ef58-4ee5-9b27-9109778a1cc7 service nova] Creating event network-changed:16cad79f-fc8b-422b-b7c4-cba9a5b01afa for instance 383d7069-d26f-4b0c-b363-455fe8e5424b on n-h1-844627-10 Aug 04 14:09:06.146216 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7dc335cf-9a16-4dad-afd4-d591d1250921 req-dd75f4bf-ef58-4ee5-9b27-9109778a1cc7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221854 Aug 04 14:09:06.175299 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1511/3016] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:06.215713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5f606b5-5c63-475f-9785-ed53522051a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'create', calling method: .version_select at 0x7f47001331f0>, body: {"keypair": {"name": "tempest-keypair-840200972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF++MmJ7Etes/Szfq5iTbpH39CzJm9FOY5qhd9n4vZ8htN7F1Zi5rf1yrDBY2HRs0XVUBdI4dPvng0S7GXp3kGBgrldOGzyfvl9cRtvCpOYvEC31peuSU+LSGH8fkqrxTg=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:06.351059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c34eeedd-2d64-4e87-833d-772123153793 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:06.360783 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c34eeedd-2d64-4e87-833d-772123153793 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1315 microversion: 2.1 time: 0.732885 Aug 04 14:09:06.362540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d5f606b5-5c63-475f-9785-ed53522051a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Getting quotas for project c9ff6de2efd240b79217e2e5efe4f8ce. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:09:06.368851 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1506/3017] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:05 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:06.379627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8580376c-3a6b-4251-b7cf-6e71d0447a88 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:06.380307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8580376c-3a6b-4251-b7cf-6e71d0447a88 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:06.381446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d5f606b5-5c63-475f-9785-ed53522051a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Getting quotas for user 653fb03c7a4b4a61a57ecd4cdd610e86 and project c9ff6de2efd240b79217e2e5efe4f8ce. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:09:06.443365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8580376c-3a6b-4251-b7cf-6e71d0447a88 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:06.449897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8580376c-3a6b-4251-b7cf-6e71d0447a88 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:06.453999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8580376c-3a6b-4251-b7cf-6e71d0447a88 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:06.457650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8580376c-3a6b-4251-b7cf-6e71d0447a88 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:06.530236 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d5f606b5-5c63-475f-9785-ed53522051a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.347708 Aug 04 14:09:06.558116 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1512/3018] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:09:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:06.592463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-df77c913-c75d-4ea3-90c1-c167ffe008df req-dc7b45bc-a63f-4d06-a51e-c523d9f1fddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d3ed57-c6bf-4559-8e99-c92745f5a000", "name": "network-vif-deleted", "tag": "6f74e831-3863-45dd-b235-568483fa1355"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:06.651366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8580376c-3a6b-4251-b7cf-6e71d0447a88 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:09:06.667780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-df77c913-c75d-4ea3-90c1-c167ffe008df req-dc7b45bc-a63f-4d06-a51e-c523d9f1fddd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:06.668602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-df77c913-c75d-4ea3-90c1-c167ffe008df req-dc7b45bc-a63f-4d06-a51e-c523d9f1fddd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:06.761700 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-df77c913-c75d-4ea3-90c1-c167ffe008df req-dc7b45bc-a63f-4d06-a51e-c523d9f1fddd service nova] Creating event network-vif-deleted:6f74e831-3863-45dd-b235-568483fa1355 for instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 on n-h2-844627-10 Aug 04 14:09:06.803885 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-df77c913-c75d-4ea3-90c1-c167ffe008df req-dc7b45bc-a63f-4d06-a51e-c523d9f1fddd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243402 Aug 04 14:09:06.805027 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1513/3019] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:06.849373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:06.853341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:06.916204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:06.917262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:06.918701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:06.919561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:07.172358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:07.179474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:07.182264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lazy-loading 'fault' on Instance uuid e6d3ed57-c6bf-4559-8e99-c92745f5a000 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:09:07.208734 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8580376c-3a6b-4251-b7cf-6e71d0447a88 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "DELETE /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 204 len: 0 microversion: 2.1 time: 0.836699 Aug 04 14:09:07.214512 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1507/3020] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:09:06 2022] DELETE /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:07.243440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-87e5577d-f7c4-4c71-923a-32e12288bf16 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:07.247468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-87e5577d-f7c4-4c71-923a-32e12288bf16 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:07.289181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87e5577d-f7c4-4c71-923a-32e12288bf16 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:07.293126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87e5577d-f7c4-4c71-923a-32e12288bf16 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:07.295912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87e5577d-f7c4-4c71-923a-32e12288bf16 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:07.300638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87e5577d-f7c4-4c71-923a-32e12288bf16 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:07.357200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:07.382396 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6ba54184-b9da-474d-bdb7-9b3b3cd86827 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 200 len: 1299 microversion: 2.1 time: 0.575155 Aug 04 14:09:07.383791 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1514/3021] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:06 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 1299 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:07.423660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa2499e0-37a1-4f26-b2ad-3ecdfec22305 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:07.427341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa2499e0-37a1-4f26-b2ad-3ecdfec22305 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:07.466693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa2499e0-37a1-4f26-b2ad-3ecdfec22305 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:07.469870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa2499e0-37a1-4f26-b2ad-3ecdfec22305 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:07.476239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa2499e0-37a1-4f26-b2ad-3ecdfec22305 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:07.479643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa2499e0-37a1-4f26-b2ad-3ecdfec22305 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:08.907675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-87e5577d-f7c4-4c71-923a-32e12288bf16 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:08.925525 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-87e5577d-f7c4-4c71-923a-32e12288bf16 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1325 microversion: 2.1 time: 1.701973 Aug 04 14:09:08.926235 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1508/3022] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:07 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1325 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:08.932188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa2499e0-37a1-4f26-b2ad-3ecdfec22305 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:08.947893 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa2499e0-37a1-4f26-b2ad-3ecdfec22305 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1669 microversion: 2.1 time: 1.560588 Aug 04 14:09:08.948557 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1515/3023] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:07 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1669 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:08.952688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-65592542-0ad0-4343-8c88-c8b6ce111cf4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:08.960622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-65592542-0ad0-4343-8c88-c8b6ce111cf4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:08.965102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:08.981300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:08.986973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:09.000393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:09.001938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:09.005485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65592542-0ad0-4343-8c88-c8b6ce111cf4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:09.006384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:09.008063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:09.008432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65592542-0ad0-4343-8c88-c8b6ce111cf4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:09.014342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65592542-0ad0-4343-8c88-c8b6ce111cf4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:09.024263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65592542-0ad0-4343-8c88-c8b6ce111cf4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:09.037204 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 HTTP/1.1 Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e6d3ed57-c6bf-4559-8e99-c92745f5a000'} Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:09.040673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:09:09.045626 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:09.045626 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:09.045626 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:09.045626 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:09:09.045626 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:09:09.045626 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:09:09.045626 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:09:09.047025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:09.048478 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e1073597-0810-4db1-b73c-9319e831a0e1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 404 len: 111 microversion: 2.1 time: 0.075502 Aug 04 14:09:09.056769 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1516/3024] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:08 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:09.063095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bb88a73a-ed70-4851-986c-f77fc7c6484c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:09.063937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bb88a73a-ed70-4851-986c-f77fc7c6484c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:09.072275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb88a73a-ed70-4851-986c-f77fc7c6484c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:09.073096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb88a73a-ed70-4851-986c-f77fc7c6484c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:09.074088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb88a73a-ed70-4851-986c-f77fc7c6484c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:09.074704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb88a73a-ed70-4851-986c-f77fc7c6484c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:09.178548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bb88a73a-ed70-4851-986c-f77fc7c6484c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:09:09.239100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:09.548502 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bb88a73a-ed70-4851-986c-f77fc7c6484c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 204 len: 0 microversion: 2.1 time: 0.464512 Aug 04 14:09:09.550157 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1517/3025] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:09:09 2022] DELETE /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:09.561634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a65da90b-afba-4e6e-8b68-a91b5bb0051a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:09.562672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a65da90b-afba-4e6e-8b68-a91b5bb0051a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:09.590497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a65da90b-afba-4e6e-8b68-a91b5bb0051a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:09.591201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a65da90b-afba-4e6e-8b68-a91b5bb0051a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:09.592580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a65da90b-afba-4e6e-8b68-a91b5bb0051a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:09.593466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a65da90b-afba-4e6e-8b68-a91b5bb0051a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:10.193780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-65592542-0ad0-4343-8c88-c8b6ce111cf4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:10.205348 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-65592542-0ad0-4343-8c88-c8b6ce111cf4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1315 microversion: 2.1 time: 1.277909 Aug 04 14:09:10.212380 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1509/3026] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:08 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1315 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:10.217531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a256ff1-b99e-4b07-a569-60a8ebdd9fef tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:10.218183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3a256ff1-b99e-4b07-a569-60a8ebdd9fef tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:10.242706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a256ff1-b99e-4b07-a569-60a8ebdd9fef tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:10.243162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a256ff1-b99e-4b07-a569-60a8ebdd9fef tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:10.244243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a256ff1-b99e-4b07-a569-60a8ebdd9fef tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:10.250884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a256ff1-b99e-4b07-a569-60a8ebdd9fef tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:10.317358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a65da90b-afba-4e6e-8b68-a91b5bb0051a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:10.327419 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a65da90b-afba-4e6e-8b68-a91b5bb0051a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1496 microversion: 2.1 time: 0.771603 Aug 04 14:09:10.345014 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1518/3027] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:09 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1496 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:09:10.375207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90a04d38-b797-4422-80b1-904199e4c2be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:10.382183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-90a04d38-b797-4422-80b1-904199e4c2be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:10.412138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90a04d38-b797-4422-80b1-904199e4c2be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:10.435926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90a04d38-b797-4422-80b1-904199e4c2be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:10.447438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90a04d38-b797-4422-80b1-904199e4c2be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:10.451916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90a04d38-b797-4422-80b1-904199e4c2be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:10.614551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3a256ff1-b99e-4b07-a569-60a8ebdd9fef tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:10.634290 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a256ff1-b99e-4b07-a569-60a8ebdd9fef tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1325 microversion: 2.1 time: 0.415576 Aug 04 14:09:10.636353 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1510/3028] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:10 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1325 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:10.913381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-90a04d38-b797-4422-80b1-904199e4c2be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:10.945730 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90a04d38-b797-4422-80b1-904199e4c2be tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1669 microversion: 2.1 time: 0.599015 Aug 04 14:09:10.947760 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1519/3029] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:10 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1669 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:11.228344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aef86d46-8dec-4a5e-8f88-d0d26f464f75 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:11.229357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aef86d46-8dec-4a5e-8f88-d0d26f464f75 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:11.240924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aef86d46-8dec-4a5e-8f88-d0d26f464f75 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:11.241784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aef86d46-8dec-4a5e-8f88-d0d26f464f75 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:11.244915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aef86d46-8dec-4a5e-8f88-d0d26f464f75 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:11.245644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aef86d46-8dec-4a5e-8f88-d0d26f464f75 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:11.622502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-76413992-8f94-47b3-ad45-8616de672692 req-2db3e6e6-9418-4aa2-8c30-f024c0b13772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e302fd-fd35-4511-94b2-72c885adeeeb", "name": "network-vif-plugged", "status": "completed", "tag": "d6bd7e81-a25e-475b-95a9-f101ae61e390"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:11.675043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-76413992-8f94-47b3-ad45-8616de672692 req-2db3e6e6-9418-4aa2-8c30-f024c0b13772 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:11.675858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-76413992-8f94-47b3-ad45-8616de672692 req-2db3e6e6-9418-4aa2-8c30-f024c0b13772 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:11.731782 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-76413992-8f94-47b3-ad45-8616de672692 req-2db3e6e6-9418-4aa2-8c30-f024c0b13772 service nova] Creating event network-vif-plugged:d6bd7e81-a25e-475b-95a9-f101ae61e390 for instance 45e302fd-fd35-4511-94b2-72c885adeeeb on n-h1-844627-10 Aug 04 14:09:11.751470 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-76413992-8f94-47b3-ad45-8616de672692 req-2db3e6e6-9418-4aa2-8c30-f024c0b13772 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.575808 Aug 04 14:09:11.758792 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1511/3030] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:11.776170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f2c85ffe-64d8-45ea-84f4-ba865568eb4d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:11.781936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2c85ffe-64d8-45ea-84f4-ba865568eb4d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:11.809738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2c85ffe-64d8-45ea-84f4-ba865568eb4d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:11.814695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2c85ffe-64d8-45ea-84f4-ba865568eb4d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:11.816854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2c85ffe-64d8-45ea-84f4-ba865568eb4d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:11.822139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2c85ffe-64d8-45ea-84f4-ba865568eb4d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:12.108315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aef86d46-8dec-4a5e-8f88-d0d26f464f75 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:12.130394 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aef86d46-8dec-4a5e-8f88-d0d26f464f75 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1315 microversion: 2.1 time: 0.905917 Aug 04 14:09:12.131278 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1520/3031] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:11 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1315 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:12.138170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f2ac57fb-3347-455b-94cc-1ca75408c4ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:12.138917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f2ac57fb-3347-455b-94cc-1ca75408c4ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:12.197777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2ac57fb-3347-455b-94cc-1ca75408c4ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:12.204433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2ac57fb-3347-455b-94cc-1ca75408c4ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:12.209544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2ac57fb-3347-455b-94cc-1ca75408c4ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:12.210815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2ac57fb-3347-455b-94cc-1ca75408c4ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:12.991859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f2c85ffe-64d8-45ea-84f4-ba865568eb4d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:13.003226 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f2c85ffe-64d8-45ea-84f4-ba865568eb4d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1496 microversion: 2.1 time: 1.240225 Aug 04 14:09:13.007346 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1512/3032] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:11 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1496 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:13.020800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d856df84-e691-40be-8899-b561e3605896 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:13.022421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d856df84-e691-40be-8899-b561e3605896 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:13.036195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d856df84-e691-40be-8899-b561e3605896 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:13.037620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d856df84-e691-40be-8899-b561e3605896 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:13.039157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d856df84-e691-40be-8899-b561e3605896 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:13.040761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d856df84-e691-40be-8899-b561e3605896 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:13.294538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f2ac57fb-3347-455b-94cc-1ca75408c4ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:13.309848 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f2ac57fb-3347-455b-94cc-1ca75408c4ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1325 microversion: 2.1 time: 1.177007 Aug 04 14:09:13.314915 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1521/3033] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:12 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1325 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:13.332848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9abfbfc-6867-457f-babc-a6a3178ea0b8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:13.349138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b9abfbfc-6867-457f-babc-a6a3178ea0b8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:13.373830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9abfbfc-6867-457f-babc-a6a3178ea0b8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:13.374323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9abfbfc-6867-457f-babc-a6a3178ea0b8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:13.375848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9abfbfc-6867-457f-babc-a6a3178ea0b8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:13.376677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9abfbfc-6867-457f-babc-a6a3178ea0b8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:13.838847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d856df84-e691-40be-8899-b561e3605896 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:13.875634 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d856df84-e691-40be-8899-b561e3605896 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1669 microversion: 2.1 time: 0.864443 Aug 04 14:09:13.876991 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1513/3034] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:13 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1669 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:13.910089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2040288307", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "747cead7-f4fd-45c1-adfe-4f2d9869528a"}], "security_groups": [{"name": "tempest-securitygroup--1262939573"}], "key_name": "tempest-keypair-840200972", "user_data": "}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:14.305172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b9abfbfc-6867-457f-babc-a6a3178ea0b8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:14.342866 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b9abfbfc-6867-457f-babc-a6a3178ea0b8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1315 microversion: 2.1 time: 1.024077 Aug 04 14:09:14.352205 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1522/3035] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:13 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:14.365898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2702f9ac-4389-4e48-a4c2-6afbe87ac10c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:14.369461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2702f9ac-4389-4e48-a4c2-6afbe87ac10c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:14.382433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2702f9ac-4389-4e48-a4c2-6afbe87ac10c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:14.384487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2702f9ac-4389-4e48-a4c2-6afbe87ac10c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:14.389313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2702f9ac-4389-4e48-a4c2-6afbe87ac10c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:14.390251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2702f9ac-4389-4e48-a4c2-6afbe87ac10c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:14.688253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2702f9ac-4389-4e48-a4c2-6afbe87ac10c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:14.718438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] validate_networks() for [('747cead7-f4fd-45c1-adfe-4f2d9869528a', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:09:14.729216 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2702f9ac-4389-4e48-a4c2-6afbe87ac10c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 200 len: 1454 microversion: 2.1 time: 0.375193 Aug 04 14:09:14.730950 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1523/3036] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:14 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 1454 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:14.747316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a53f5ee7-9447-47f8-86c1-0c543f676f0b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:14.750923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a53f5ee7-9447-47f8-86c1-0c543f676f0b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:14.769583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:14.773940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a53f5ee7-9447-47f8-86c1-0c543f676f0b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:14.774667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a53f5ee7-9447-47f8-86c1-0c543f676f0b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:14.776193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a53f5ee7-9447-47f8-86c1-0c543f676f0b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:14.776976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a53f5ee7-9447-47f8-86c1-0c543f676f0b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:15.865782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a53f5ee7-9447-47f8-86c1-0c543f676f0b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:15.882132 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a53f5ee7-9447-47f8-86c1-0c543f676f0b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1325 microversion: 2.1 time: 1.149305 Aug 04 14:09:15.888297 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1524/3037] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:14 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1325 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:15.897399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a62383f8-66b2-4c9c-8e6c-46af6b33a363 req-16025165-1fb1-4f3c-b0d7-87a2d4db2564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "233bf06a-0888-4b0d-a891-b785811341ed", "name": "network-vif-deleted", "tag": "757fc869-3355-4b3f-a414-9ff94a76a291"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:15.934828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a62383f8-66b2-4c9c-8e6c-46af6b33a363 req-16025165-1fb1-4f3c-b0d7-87a2d4db2564 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:15.936580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a62383f8-66b2-4c9c-8e6c-46af6b33a363 req-16025165-1fb1-4f3c-b0d7-87a2d4db2564 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:15.977611 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a62383f8-66b2-4c9c-8e6c-46af6b33a363 req-16025165-1fb1-4f3c-b0d7-87a2d4db2564 service nova] Creating event network-vif-deleted:757fc869-3355-4b3f-a414-9ff94a76a291 for instance 233bf06a-0888-4b0d-a891-b785811341ed on n-h1-844627-10 Aug 04 14:09:15.998236 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a62383f8-66b2-4c9c-8e6c-46af6b33a363 req-16025165-1fb1-4f3c-b0d7-87a2d4db2564 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106769 Aug 04 14:09:16.004510 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1525/3038] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:16.032939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-251a81e4-d2f1-41fc-bd58-8d843fd76c9a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:16.038007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-251a81e4-d2f1-41fc-bd58-8d843fd76c9a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:16.068196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-251a81e4-d2f1-41fc-bd58-8d843fd76c9a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:16.074432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-251a81e4-d2f1-41fc-bd58-8d843fd76c9a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:16.075901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-251a81e4-d2f1-41fc-bd58-8d843fd76c9a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:16.081826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-251a81e4-d2f1-41fc-bd58-8d843fd76c9a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:16.445985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:16.613652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-251a81e4-d2f1-41fc-bd58-8d843fd76c9a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:16.652315 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-251a81e4-d2f1-41fc-bd58-8d843fd76c9a tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1601 microversion: 2.1 time: 0.639970 Aug 04 14:09:16.685112 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1526/3039] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:16 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1601 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:16.724129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab32bced-a720-4997-82e6-899a4415f732 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:16.726512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:09:16.727440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:09:16.727899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:09:16.728664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ab32bced-a720-4997-82e6-899a4415f732 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:16.729017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:09:16.729478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:09:16.745747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:16.746534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:16.747945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:16.748797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:16.756787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab32bced-a720-4997-82e6-899a4415f732 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:16.761168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab32bced-a720-4997-82e6-899a4415f732 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:16.763097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab32bced-a720-4997-82e6-899a4415f732 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:16.763895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab32bced-a720-4997-82e6-899a4415f732 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:16.774697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Getting quotas for project c9ff6de2efd240b79217e2e5efe4f8ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:09:16.781812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Getting quotas for user 653fb03c7a4b4a61a57ecd4cdd610e86 and project c9ff6de2efd240b79217e2e5efe4f8ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:09:16.804601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:09:16.808160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:09:16.876569 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c47885c3-2805-4ca8-b469-ca84245fa9a1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.993163 Aug 04 14:09:16.878049 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1514/3040] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:09:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 2997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:09:16.884186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c7dd1638-53c3-46ba-bd40-f78e504292e1 req-2ade0254-134f-4248-ab34-a57817c666c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e302fd-fd35-4511-94b2-72c885adeeeb", "name": "network-vif-deleted", "tag": "d6bd7e81-a25e-475b-95a9-f101ae61e390"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:16.905568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c7dd1638-53c3-46ba-bd40-f78e504292e1 req-2ade0254-134f-4248-ab34-a57817c666c2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:16.906846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c7dd1638-53c3-46ba-bd40-f78e504292e1 req-2ade0254-134f-4248-ab34-a57817c666c2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:16.921822 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c7dd1638-53c3-46ba-bd40-f78e504292e1 req-2ade0254-134f-4248-ab34-a57817c666c2 service nova] Creating event network-vif-deleted:d6bd7e81-a25e-475b-95a9-f101ae61e390 for instance 45e302fd-fd35-4511-94b2-72c885adeeeb on n-h1-844627-10 Aug 04 14:09:16.935333 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c7dd1638-53c3-46ba-bd40-f78e504292e1 req-2ade0254-134f-4248-ab34-a57817c666c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055368 Aug 04 14:09:16.935956 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1515/3041] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:16.943065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:16.944352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:16.954329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:16.956185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:16.957793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:16.958903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:17.063341 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:09:17.071531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ab32bced-a720-4997-82e6-899a4415f732 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed HTTP/1.1 Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '233bf06a-0888-4b0d-a891-b785811341ed'} Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:17.076662 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:17.084780 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:17.084780 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:17.084780 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:17.084780 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:09:17.084780 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:09:17.084780 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:09:17.084780 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:17.089817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:17.092681 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-06f930fc-21ec-4425-bf7b-a401b078a8fc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 404 len: 111 microversion: 2.1 time: 0.155127 Aug 04 14:09:17.094463 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1516/3042] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:16 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:17.108662 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ab32bced-a720-4997-82e6-899a4415f732 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1294 microversion: 2.1 time: 0.420777 Aug 04 14:09:17.122951 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1527/3043] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:16 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1294 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:17.141275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a53ad1cc-3867-4234-b956-a1dab2cf7d9f req-40557aaa-869f-42f3-ae21-287ca58d4621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383d7069-d26f-4b0c-b363-455fe8e5424b", "name": "network-vif-plugged", "status": "completed", "tag": "16cad79f-fc8b-422b-b7c4-cba9a5b01afa"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:17.182653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-862a251b-44aa-4fa1-826b-a77d0dec07a3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:17.186212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-862a251b-44aa-4fa1-826b-a77d0dec07a3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:17.216644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a53ad1cc-3867-4234-b956-a1dab2cf7d9f req-40557aaa-869f-42f3-ae21-287ca58d4621 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:17.219553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a53ad1cc-3867-4234-b956-a1dab2cf7d9f req-40557aaa-869f-42f3-ae21-287ca58d4621 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:17.267449 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a53ad1cc-3867-4234-b956-a1dab2cf7d9f req-40557aaa-869f-42f3-ae21-287ca58d4621 service nova] Creating event network-vif-plugged:16cad79f-fc8b-422b-b7c4-cba9a5b01afa for instance 383d7069-d26f-4b0c-b363-455fe8e5424b on n-h1-844627-10 Aug 04 14:09:17.282121 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a53ad1cc-3867-4234-b956-a1dab2cf7d9f req-40557aaa-869f-42f3-ae21-287ca58d4621 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159767 Aug 04 14:09:17.286777 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1528/3044] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:17.301538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa5f2f5c-2a5b-443c-8891-469dcebb61fb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:17.302358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa5f2f5c-2a5b-443c-8891-469dcebb61fb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:17.325102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa5f2f5c-2a5b-443c-8891-469dcebb61fb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:17.325830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa5f2f5c-2a5b-443c-8891-469dcebb61fb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:17.329219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa5f2f5c-2a5b-443c-8891-469dcebb61fb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:17.331461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa5f2f5c-2a5b-443c-8891-469dcebb61fb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:17.475187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-862a251b-44aa-4fa1-826b-a77d0dec07a3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:17.500638 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-862a251b-44aa-4fa1-826b-a77d0dec07a3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1245 microversion: 2.1 time: 0.369809 Aug 04 14:09:17.501397 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1517/3045] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:17 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1245 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:17.574738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1406378359", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "2344a004-88b5-43d1-a0c7-ab45883f4f84"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:17.759753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] validate_networks() for [('2344a004-88b5-43d1-a0c7-ab45883f4f84', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:09:17.935376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa5f2f5c-2a5b-443c-8891-469dcebb61fb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:17.991013 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa5f2f5c-2a5b-443c-8891-469dcebb61fb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1325 microversion: 2.1 time: 0.701425 Aug 04 14:09:18.028918 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1529/3046] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:17 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1325 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:18.059025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:18.067435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:18.097153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:18.102400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:18.106715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:18.109419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:18.270855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:18.273142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:18.274463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lazy-loading 'fault' on Instance uuid 739d0629-de24-4a72-83a0-2f443e0af803 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:09:18.790129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:18.860082 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5dd02394-a287-4f0c-818a-120ed4630ed4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 200 len: 1325 microversion: 2.1 time: 0.817822 Aug 04 14:09:18.867293 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1530/3047] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:18 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 1325 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:18.916994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ea3bb0cd-954f-4607-9a93-9e6d2772428c req-b8913e71-e4d9-4129-b4c6-872389acdecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739d0629-de24-4a72-83a0-2f443e0af803", "name": "network-vif-deleted", "tag": "dceb6721-526a-47cd-9222-7311c255822d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:18.948098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ea3bb0cd-954f-4607-9a93-9e6d2772428c req-b8913e71-e4d9-4129-b4c6-872389acdecd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:18.949065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ea3bb0cd-954f-4607-9a93-9e6d2772428c req-b8913e71-e4d9-4129-b4c6-872389acdecd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:18.978408 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ea3bb0cd-954f-4607-9a93-9e6d2772428c req-b8913e71-e4d9-4129-b4c6-872389acdecd service nova] Creating event network-vif-deleted:dceb6721-526a-47cd-9222-7311c255822d for instance 739d0629-de24-4a72-83a0-2f443e0af803 on n-h1-844627-10 Aug 04 14:09:18.999517 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ea3bb0cd-954f-4607-9a93-9e6d2772428c req-b8913e71-e4d9-4129-b4c6-872389acdecd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101389 Aug 04 14:09:19.001622 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1531/3048] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:19.008598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cc2f5cbb-4417-4f0c-8ac6-0523ea4c3f1c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:19.009546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cc2f5cbb-4417-4f0c-8ac6-0523ea4c3f1c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:19.018331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc2f5cbb-4417-4f0c-8ac6-0523ea4c3f1c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:19.019233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc2f5cbb-4417-4f0c-8ac6-0523ea4c3f1c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:19.020541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc2f5cbb-4417-4f0c-8ac6-0523ea4c3f1c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:19.021467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc2f5cbb-4417-4f0c-8ac6-0523ea4c3f1c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:19.324309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cc2f5cbb-4417-4f0c-8ac6-0523ea4c3f1c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:19.339893 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cc2f5cbb-4417-4f0c-8ac6-0523ea4c3f1c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 200 len: 1294 microversion: 2.1 time: 0.336493 Aug 04 14:09:19.345412 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1532/3049] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:19 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 1294 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:19.356561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d1ae891-4249-41f8-a71a-8911a1181d4d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:19.357239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6d1ae891-4249-41f8-a71a-8911a1181d4d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:19.374002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d1ae891-4249-41f8-a71a-8911a1181d4d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:19.379379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d1ae891-4249-41f8-a71a-8911a1181d4d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:19.380912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d1ae891-4249-41f8-a71a-8911a1181d4d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:19.381569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d1ae891-4249-41f8-a71a-8911a1181d4d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:19.664627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d1ae891-4249-41f8-a71a-8911a1181d4d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:19.687100 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d1ae891-4249-41f8-a71a-8911a1181d4d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1241 microversion: 2.1 time: 0.342275 Aug 04 14:09:19.692829 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1533/3050] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:19 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1241 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:19.735637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfe5cfc3-242a-440a-947c-4a182125acec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:19.737508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cfe5cfc3-242a-440a-947c-4a182125acec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:19.745598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:09:19.746370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:09:19.747328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:09:19.748144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:09:19.749188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:09:19.766417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfe5cfc3-242a-440a-947c-4a182125acec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:19.767910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfe5cfc3-242a-440a-947c-4a182125acec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:19.769998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfe5cfc3-242a-440a-947c-4a182125acec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:19.771773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfe5cfc3-242a-440a-947c-4a182125acec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:19.796093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:19.796937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:19.798480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:19.799780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:19.875562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:09:19.892407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for user df576732ca5c442694d507fd4dc58279 and project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:09:19.957072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:09:19.960431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:09:20.071325 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7e39efb2-fdec-4c94-b4af-5a9e9c5ab3bf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.504972 Aug 04 14:09:20.082557 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1518/3051] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:09:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:09:20.094545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:20.095693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 739d0629-de24-4a72-83a0-2f443e0af803] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:20.131221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:20.132374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:20.139367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:20.140118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:20.187568 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] HTTP exception thrown: Instance 739d0629-de24-4a72-83a0-2f443e0af803 could not be found. Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Request method failure captured: Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 HTTP/1.1 Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69DJ7UvFMMQjxuNDGGzjmZREMHLlPKxIERi-6Xjw59TNuWQeh_S30PzHoTkmZG9_2h_Q4QERz2msjPjuyRjTw46n9sLubSR2JWDuNFhNwuD-kyoyomXZNiUxjmRtn9uOBHtyNJUJll3yYDcs_6rKq614le-nPQLJr6B5iT_HciDxV6A Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1d0f04146c914cf1940cea4b2229ebd5 Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-LiveMigrationTest-1263624033 Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1d0f04146c914cf1940cea4b2229ebd5"}]}] Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-LiveMigrationTest-1263624033 Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1d0f04146c914cf1940cea4b2229ebd5 Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-LiveMigrationTest-1263624033 Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-LiveMigrationTest-1263624033-project Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: dd1aacb549b74c21a13b9f3ca2df840c Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-LiveMigrationTest-1263624033-project Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 739d0629-de24-4a72-83a0-2f443e0af803 could not be found. Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '739d0629-de24-4a72-83a0-2f443e0af803'} Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739d0629-de24-4a72-83a0-2f443e0af803 could not be found. Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739d0629-de24-4a72-83a0-2f443e0af803 could not be found. Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:20.193514 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.198347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:20.198347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:20.198347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:20.198347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:09:20.198347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:09:20.198347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739d0629-de24-4a72-83a0-2f443e0af803 could not be found. Aug 04 14:09:20.198347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.200710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Returning 404 to user: Instance 739d0629-de24-4a72-83a0-2f443e0af803 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:20.201865 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3fadab8-d5b0-49b3-a305-e07c1a03ad3f tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803" status: 404 len: 111 microversion: 2.1 time: 0.115744 Aug 04 14:09:20.206963 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1519/3052] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:20 2022] GET /compute/v2.1/servers/739d0629-de24-4a72-83a0-2f443e0af803 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:20.212585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e1c01341-517d-44c4-8234-ce18cf29c0dc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:20.213812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e1c01341-517d-44c4-8234-ce18cf29c0dc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:20.492568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfe5cfc3-242a-440a-947c-4a182125acec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:20.495507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:20.518276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e1c01341-517d-44c4-8234-ce18cf29c0dc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:20.523477 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cfe5cfc3-242a-440a-947c-4a182125acec tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1325 microversion: 2.1 time: 0.824335 Aug 04 14:09:20.531102 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1534/3053] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:19 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1325 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:20.532222 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e1c01341-517d-44c4-8234-ce18cf29c0dc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1209 microversion: 2.1 time: 0.323664 Aug 04 14:09:20.547654 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1520/3054] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:20 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1209 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:20.553807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:20.554325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a2c3ef7c-8031-4b2a-8165-865924ba4b9b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '.version_select at 0x7f4700e485e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:20.557777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:20.591658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:20.592413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:20.593522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:20.594143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:20.623662 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a2c3ef7c-8031-4b2a-8165-865924ba4b9b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212214566" status: 202 len: 0 microversion: 2.1 time: 0.080331 Aug 04 14:09:20.633504 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1535/3055] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:09:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212214566 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:09:20.654592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb HTTP/1.1 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '45e302fd-fd35-4511-94b2-72c885adeeeb'} Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:20.658239 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.664706 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:20.664706 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:20.664706 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:20.664706 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:09:20.664706 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:09:20.664706 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:09:20.664706 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:20.666512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:20.667629 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e868a6d3-6fd7-4d05-8d0c-41ae8ff4059e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 404 len: 111 microversion: 2.1 time: 0.118639 Aug 04 14:09:20.692557 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1521/3056] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:20 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:20.729806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2343eb8d-fe6e-4d97-ad54-9e6d7200e2c2 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:20.731037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2343eb8d-fe6e-4d97-ad54-9e6d7200e2c2 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:20.755449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2343eb8d-fe6e-4d97-ad54-9e6d7200e2c2 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:20.759741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2343eb8d-fe6e-4d97-ad54-9e6d7200e2c2 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:20.764399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2343eb8d-fe6e-4d97-ad54-9e6d7200e2c2 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:20.765293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2343eb8d-fe6e-4d97-ad54-9e6d7200e2c2 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:21.234447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-361653482", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:21.271225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2343eb8d-fe6e-4d97-ad54-9e6d7200e2c2 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:21.295532 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2343eb8d-fe6e-4d97-ad54-9e6d7200e2c2 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1305 microversion: 2.1 time: 0.564541 Aug 04 14:09:21.296228 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1536/3057] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:20 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1305 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:09:21.421596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] validate_networks() for [('4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:09:21.569805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a91058c7-9c3f-44ef-b0e7-3922792e7c1f tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:21.572105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a91058c7-9c3f-44ef-b0e7-3922792e7c1f tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:21.586228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9c3f-44ef-b0e7-3922792e7c1f tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:21.590227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9c3f-44ef-b0e7-3922792e7c1f tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:21.592069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9c3f-44ef-b0e7-3922792e7c1f tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:21.594334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a91058c7-9c3f-44ef-b0e7-3922792e7c1f tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:22.737397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a91058c7-9c3f-44ef-b0e7-3922792e7c1f tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:22.751275 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a91058c7-9c3f-44ef-b0e7-3922792e7c1f tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1521 microversion: 2.1 time: 1.189910 Aug 04 14:09:22.765666 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1537/3058] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:21 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1521 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:22.779514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d338e53-27f9-4813-91c9-1d1d30b5bfff tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:22.780529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9d338e53-27f9-4813-91c9-1d1d30b5bfff tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:22.789223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d338e53-27f9-4813-91c9-1d1d30b5bfff tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:22.789952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d338e53-27f9-4813-91c9-1d1d30b5bfff tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:22.790942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d338e53-27f9-4813-91c9-1d1d30b5bfff tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:22.791571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d338e53-27f9-4813-91c9-1d1d30b5bfff tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:22.983332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9d338e53-27f9-4813-91c9-1d1d30b5bfff tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:23.003613 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d338e53-27f9-4813-91c9-1d1d30b5bfff tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1267 microversion: 2.1 time: 0.233683 Aug 04 14:09:23.004979 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1538/3059] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:22 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:23.013001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f30f1c04-050b-4c4e-ba3d-a067cb5d7142 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:23.024103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f30f1c04-050b-4c4e-ba3d-a067cb5d7142 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:23.039784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f30f1c04-050b-4c4e-ba3d-a067cb5d7142 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:23.041034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f30f1c04-050b-4c4e-ba3d-a067cb5d7142 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:23.043407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f30f1c04-050b-4c4e-ba3d-a067cb5d7142 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:23.047751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f30f1c04-050b-4c4e-ba3d-a067cb5d7142 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:23.283145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f30f1c04-050b-4c4e-ba3d-a067cb5d7142 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:23.313067 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f30f1c04-050b-4c4e-ba3d-a067cb5d7142 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1303 microversion: 2.1 time: 0.299788 Aug 04 14:09:23.315552 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1539/3060] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:23 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1303 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:23.336155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6b646298-93f9-462e-b886-180face97fe4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:23.340474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6b646298-93f9-462e-b886-180face97fe4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:23.365637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b646298-93f9-462e-b886-180face97fe4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:23.368466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b646298-93f9-462e-b886-180face97fe4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:23.373929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b646298-93f9-462e-b886-180face97fe4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:23.376493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b646298-93f9-462e-b886-180face97fe4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:23.502604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6b646298-93f9-462e-b886-180face97fe4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:09:23.824197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6b646298-93f9-462e-b886-180face97fe4 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "DELETE /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 204 len: 0 microversion: 2.1 time: 0.506166 Aug 04 14:09:23.826454 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1540/3061] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:09:23 2022] DELETE /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:23.841721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebfa75a8-c733-4380-8af4-f1c92ac34ade tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:23.843001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ebfa75a8-c733-4380-8af4-f1c92ac34ade tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:23.890562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebfa75a8-c733-4380-8af4-f1c92ac34ade tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:23.895330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebfa75a8-c733-4380-8af4-f1c92ac34ade tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:23.901854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebfa75a8-c733-4380-8af4-f1c92ac34ade tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:23.904270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebfa75a8-c733-4380-8af4-f1c92ac34ade tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:24.012149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:09:24.013154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:09:24.014241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:09:24.015341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:09:24.016277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:09:24.048782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:24.049835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:24.052769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:24.053941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:24.166114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:09:24.182225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for user d6f701d08c0741df9ad1375bd0712a59 and project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:09:24.290047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:09:24.310820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:09:24.623456 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7a23c3c2-e6d3-466d-a0ff-7b76e1fb7f74 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.388814 Aug 04 14:09:24.631445 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1522/3062] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:09:24.687597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3cd4b69d-b06a-488e-964d-db36c00146aa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:24.693548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3cd4b69d-b06a-488e-964d-db36c00146aa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:24.736220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3cd4b69d-b06a-488e-964d-db36c00146aa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:24.743483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3cd4b69d-b06a-488e-964d-db36c00146aa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:24.755465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3cd4b69d-b06a-488e-964d-db36c00146aa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:24.760172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3cd4b69d-b06a-488e-964d-db36c00146aa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:24.908360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ebfa75a8-c733-4380-8af4-f1c92ac34ade tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:24.923646 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ebfa75a8-c733-4380-8af4-f1c92ac34ade tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1521 microversion: 2.1 time: 1.094105 Aug 04 14:09:24.925221 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1541/3063] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:23 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1521 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:24.930742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64322dc2-b4d3-4249-a7e3-bf56610f3706 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:24.931754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-64322dc2-b4d3-4249-a7e3-bf56610f3706 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:24.971342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64322dc2-b4d3-4249-a7e3-bf56610f3706 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:24.974488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64322dc2-b4d3-4249-a7e3-bf56610f3706 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:24.975602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64322dc2-b4d3-4249-a7e3-bf56610f3706 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:24.979326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64322dc2-b4d3-4249-a7e3-bf56610f3706 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:25.690702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-64322dc2-b4d3-4249-a7e3-bf56610f3706 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:25.706507 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-64322dc2-b4d3-4249-a7e3-bf56610f3706 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1267 microversion: 2.1 time: 0.778470 Aug 04 14:09:25.707221 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1542/3064] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:24 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1267 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:25.722253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba68016d-3f04-4cb9-88ca-436970b151b0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:25.723157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ba68016d-3f04-4cb9-88ca-436970b151b0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:25.741599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba68016d-3f04-4cb9-88ca-436970b151b0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:25.742234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba68016d-3f04-4cb9-88ca-436970b151b0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:25.743139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba68016d-3f04-4cb9-88ca-436970b151b0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:25.743612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba68016d-3f04-4cb9-88ca-436970b151b0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:26.468153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ba68016d-3f04-4cb9-88ca-436970b151b0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:26.518686 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ba68016d-3f04-4cb9-88ca-436970b151b0 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1303 microversion: 2.1 time: 0.809990 Aug 04 14:09:26.525419 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1543/3065] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:25 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1303 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:26.539888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f0a2838-1b37-4f1d-955d-1498fd407527 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:26.550351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f0a2838-1b37-4f1d-955d-1498fd407527 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:26.588355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f0a2838-1b37-4f1d-955d-1498fd407527 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:26.593471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f0a2838-1b37-4f1d-955d-1498fd407527 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:26.596109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f0a2838-1b37-4f1d-955d-1498fd407527 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:26.597514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f0a2838-1b37-4f1d-955d-1498fd407527 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:26.966092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3cd4b69d-b06a-488e-964d-db36c00146aa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:26.982812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f0a2838-1b37-4f1d-955d-1498fd407527 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:26.984516 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3cd4b69d-b06a-488e-964d-db36c00146aa tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1486 microversion: 2.1 time: 2.341803 Aug 04 14:09:26.987475 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1523/3066] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:24 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1486 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:27.000577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e0a0dff0-98a3-4569-8334-bd2aac6c216e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1312619174", "metadata": {"": ""}}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e0a0dff0-98a3-4569-8334-bd2aac6c216e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action HTTP/1.1 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 107 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1312619174", "metadata": {"": ""}}} Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '383d7069-d26f-4b0c-b363-455fe8e5424b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1312619174', 'metadata': {'': ''}}}} Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'': ''} Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:09:27.008906 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:09:27.013529 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:27.017740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e0a0dff0-98a3-4569-8334-bd2aac6c216e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:27.020249 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e0a0dff0-98a3-4569-8334-bd2aac6c216e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action" status: 400 len: 170 microversion: 2.1 time: 0.030489 Aug 04 14:09:27.032847 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1524/3067] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Aug 4 14:09:26 2022] POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action => generated 170 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:09:27.051760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dffa4334-c0da-4c54-8a1e-74530f4c3f26 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:27.052586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dffa4334-c0da-4c54-8a1e-74530f4c3f26 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:27.052712 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f0a2838-1b37-4f1d-955d-1498fd407527 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 200 len: 1210 microversion: 2.1 time: 0.525138 Aug 04 14:09:27.053761 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1544/3068] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:26 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 1210 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:27.074606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ad8ffd7e-5878-42d4-989c-f3ba572568db tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:27.075867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ad8ffd7e-5878-42d4-989c-f3ba572568db tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:27.079046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dffa4334-c0da-4c54-8a1e-74530f4c3f26 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:27.079943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dffa4334-c0da-4c54-8a1e-74530f4c3f26 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:27.082205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dffa4334-c0da-4c54-8a1e-74530f4c3f26 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:27.082815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dffa4334-c0da-4c54-8a1e-74530f4c3f26 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:27.094066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad8ffd7e-5878-42d4-989c-f3ba572568db tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:27.094756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad8ffd7e-5878-42d4-989c-f3ba572568db tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:27.095708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad8ffd7e-5878-42d4-989c-f3ba572568db tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:27.096305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad8ffd7e-5878-42d4-989c-f3ba572568db tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:28.445674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dffa4334-c0da-4c54-8a1e-74530f4c3f26 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:28.458872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ad8ffd7e-5878-42d4-989c-f3ba572568db tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:28.475777 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ad8ffd7e-5878-42d4-989c-f3ba572568db tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1521 microversion: 2.1 time: 1.420229 Aug 04 14:09:28.482549 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dffa4334-c0da-4c54-8a1e-74530f4c3f26 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1309 microversion: 2.1 time: 1.445235 Aug 04 14:09:28.487024 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1525/3069] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:27 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1309 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:28.502757 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1545/3070] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:27 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1521 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:28.512299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a2a59677-fc75-4158-9c2b-c121eb53cf00 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:28.517425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64fd4f16-e2f6-4f07-a2e6-fa337b8e7d8c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:28.520927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64fd4f16-e2f6-4f07-a2e6-fa337b8e7d8c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:28.523263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a2a59677-fc75-4158-9c2b-c121eb53cf00 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:28.551792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64fd4f16-e2f6-4f07-a2e6-fa337b8e7d8c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:28.552649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64fd4f16-e2f6-4f07-a2e6-fa337b8e7d8c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:28.558668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64fd4f16-e2f6-4f07-a2e6-fa337b8e7d8c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:28.559406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64fd4f16-e2f6-4f07-a2e6-fa337b8e7d8c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:28.561642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2a59677-fc75-4158-9c2b-c121eb53cf00 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:28.564588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2a59677-fc75-4158-9c2b-c121eb53cf00 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:28.567584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2a59677-fc75-4158-9c2b-c121eb53cf00 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:28.569117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a2a59677-fc75-4158-9c2b-c121eb53cf00 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:29.053920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a2a59677-fc75-4158-9c2b-c121eb53cf00 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:29.080783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a2a59677-fc75-4158-9c2b-c121eb53cf00 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 200 len: 1444 microversion: 2.1 time: 0.576588 Aug 04 14:09:29.082105 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1546/3071] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:28 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 1444 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:29.090730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9aef8396-3e7a-494e-9d5f-87bb61a35a58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:29.096762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9aef8396-3e7a-494e-9d5f-87bb61a35a58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:29.113146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9aef8396-3e7a-494e-9d5f-87bb61a35a58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:29.113923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9aef8396-3e7a-494e-9d5f-87bb61a35a58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:29.114953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9aef8396-3e7a-494e-9d5f-87bb61a35a58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:29.115594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9aef8396-3e7a-494e-9d5f-87bb61a35a58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:30.369515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-64fd4f16-e2f6-4f07-a2e6-fa337b8e7d8c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:30.396606 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-64fd4f16-e2f6-4f07-a2e6-fa337b8e7d8c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1371 microversion: 2.1 time: 1.906169 Aug 04 14:09:30.409359 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1526/3072] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:28 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1371 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:30.419295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e719ce75-1a60-44cf-8212-8f59518e909b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:30.421048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e719ce75-1a60-44cf-8212-8f59518e909b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:30.467425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e719ce75-1a60-44cf-8212-8f59518e909b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:30.468192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e719ce75-1a60-44cf-8212-8f59518e909b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:30.469556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e719ce75-1a60-44cf-8212-8f59518e909b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:30.470680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e719ce75-1a60-44cf-8212-8f59518e909b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:30.502951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:30.875432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9aef8396-3e7a-494e-9d5f-87bb61a35a58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:30.911116 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9aef8396-3e7a-494e-9d5f-87bb61a35a58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 200 len: 1314 microversion: 2.1 time: 1.824263 Aug 04 14:09:30.916121 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1547/3073] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:29 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 1314 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:30.939939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1371666650", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fc8bdacb-eec0-469f-87b7-86b7d226287c"}], "security_groups": [{"name": "tempest-securitygroup--1872965721"}], "key_name": "tempest-keypair-759037525", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "8df43b87-1243-4802-bc1a-3326443d8a8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:31.051693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e719ce75-1a60-44cf-8212-8f59518e909b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:31.066119 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e719ce75-1a60-44cf-8212-8f59518e909b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1521 microversion: 2.1 time: 0.653763 Aug 04 14:09:31.070716 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1527/3074] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:30 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1521 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:31.082725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0445b1c5-ed05-4fc4-847f-f2794c226995 req-e6a04387-6cec-4193-a1ca-60374f32db79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cd7bcc-5635-4672-a8f2-b0091f35752a", "name": "network-vif-deleted", "tag": "a399b070-0ad8-49b2-aa93-590fb1803bc8"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:31.116655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0445b1c5-ed05-4fc4-847f-f2794c226995 req-e6a04387-6cec-4193-a1ca-60374f32db79 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:31.117372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0445b1c5-ed05-4fc4-847f-f2794c226995 req-e6a04387-6cec-4193-a1ca-60374f32db79 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:31.136512 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0445b1c5-ed05-4fc4-847f-f2794c226995 req-e6a04387-6cec-4193-a1ca-60374f32db79 service nova] Creating event network-vif-deleted:a399b070-0ad8-49b2-aa93-590fb1803bc8 for instance 04cd7bcc-5635-4672-a8f2-b0091f35752a on n-h1-844627-10 Aug 04 14:09:31.148594 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0445b1c5-ed05-4fc4-847f-f2794c226995 req-e6a04387-6cec-4193-a1ca-60374f32db79 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076336 Aug 04 14:09:31.153710 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1528/3075] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:31.177044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-74be8deb-9879-48a1-9b3d-510bb3270eab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:31.180417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-74be8deb-9879-48a1-9b3d-510bb3270eab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:31.194848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74be8deb-9879-48a1-9b3d-510bb3270eab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:31.195453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74be8deb-9879-48a1-9b3d-510bb3270eab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:31.197040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74be8deb-9879-48a1-9b3d-510bb3270eab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:31.198049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74be8deb-9879-48a1-9b3d-510bb3270eab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:31.504004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] validate_networks() for [('fc8bdacb-eec0-469f-87b7-86b7d226287c', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:09:31.915058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74be8deb-9879-48a1-9b3d-510bb3270eab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:31.930567 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-74be8deb-9879-48a1-9b3d-510bb3270eab tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1309 microversion: 2.1 time: 0.775099 Aug 04 14:09:31.931669 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1529/3076] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:31 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1309 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:31.943503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:31.944667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 04cd7bcc-5635-4672-a8f2-b0091f35752a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:31.958485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:31.958485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:31.959544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:31.960927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:31.999787 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] HTTP exception thrown: Instance 04cd7bcc-5635-4672-a8f2-b0091f35752a could not be found. Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Request method failure captured: Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a HTTP/1.1 Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69DJ7UvFMMQjxuNDGGzjmZREMHLlPKxIERi-6Xjw59TNuWQeh_S30PzHoTkmZG9_2h_Q4QERz2msjPjuyRjTw46n9sLubSR2JWDuNFhNwuD-kyoyomXZNiUxjmRtn9uOBHtyNJUJll3yYDcs_6rKq614le-nPQLJr6B5iT_HciDxV6A Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1d0f04146c914cf1940cea4b2229ebd5 Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-LiveMigrationTest-1263624033 Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1d0f04146c914cf1940cea4b2229ebd5"}]}] Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-LiveMigrationTest-1263624033 Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1d0f04146c914cf1940cea4b2229ebd5 Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-LiveMigrationTest-1263624033 Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-LiveMigrationTest-1263624033-project Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: dd1aacb549b74c21a13b9f3ca2df840c Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-LiveMigrationTest-1263624033-project Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 04cd7bcc-5635-4672-a8f2-b0091f35752a could not be found. Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '04cd7bcc-5635-4672-a8f2-b0091f35752a'} Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04cd7bcc-5635-4672-a8f2-b0091f35752a could not be found. Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04cd7bcc-5635-4672-a8f2-b0091f35752a could not be found. Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:32.001785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.006278 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:32.006278 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:32.006278 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:32.006278 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:09:32.006278 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:09:32.006278 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04cd7bcc-5635-4672-a8f2-b0091f35752a could not be found. Aug 04 14:09:32.006278 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.011711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Returning 404 to user: Instance 04cd7bcc-5635-4672-a8f2-b0091f35752a could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:32.013035 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30973037-34d0-4f2a-92f7-664de7547473 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a" status: 404 len: 111 microversion: 2.1 time: 0.079868 Aug 04 14:09:32.013971 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1530/3077] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:31 2022] GET /compute/v2.1/servers/04cd7bcc-5635-4672-a8f2-b0091f35752a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:32.019996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-aafe2427-3737-4db2-bc66-fab887185a60 req-b7891086-e5e4-41df-9a11-4da106e42704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef3141f-bcba-44bc-9f99-819598f48b0d", "tag": "4501cde4-5f63-4947-9883-056e7f38a066"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:32.032831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-aafe2427-3737-4db2-bc66-fab887185a60 req-b7891086-e5e4-41df-9a11-4da106e42704 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:32.033825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-aafe2427-3737-4db2-bc66-fab887185a60 req-b7891086-e5e4-41df-9a11-4da106e42704 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:32.048804 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-aafe2427-3737-4db2-bc66-fab887185a60 req-b7891086-e5e4-41df-9a11-4da106e42704 service nova] Creating event network-changed:4501cde4-5f63-4947-9883-056e7f38a066 for instance 0ef3141f-bcba-44bc-9f99-819598f48b0d on n-h2-844627-10 Aug 04 14:09:32.063698 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-aafe2427-3737-4db2-bc66-fab887185a60 req-b7891086-e5e4-41df-9a11-4da106e42704 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047915 Aug 04 14:09:32.064408 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1531/3078] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:32.070637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-69c0c849-fa63-4695-9f44-9a5c69a4687d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-666746066", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-69c0c849-fa63-4695-9f44-9a5c69a4687d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action HTTP/1.1 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 618 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-666746066", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '383d7069-d26f-4b0c-b363-455fe8e5424b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-666746066', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:09:32.076666 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:09:32.081789 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:32.089673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-69c0c849-fa63-4695-9f44-9a5c69a4687d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:32.089673 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-69c0c849-fa63-4695-9f44-9a5c69a4687d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action" status: 400 len: 938 microversion: 2.1 time: 0.013030 Aug 04 14:09:32.089673 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1532/3079] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Aug 4 14:09:32 2022] POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action => generated 938 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:09:32.089673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c678adbb-d014-4a18-be32-8e14f44b0ce1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:32.089673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c678adbb-d014-4a18-be32-8e14f44b0ce1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:32.098243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c678adbb-d014-4a18-be32-8e14f44b0ce1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:32.098939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c678adbb-d014-4a18-be32-8e14f44b0ce1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:32.100049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c678adbb-d014-4a18-be32-8e14f44b0ce1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:32.100609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c678adbb-d014-4a18-be32-8e14f44b0ce1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:32.902975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c678adbb-d014-4a18-be32-8e14f44b0ce1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:32.967307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c678adbb-d014-4a18-be32-8e14f44b0ce1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1371 microversion: 2.1 time: 0.885162 Aug 04 14:09:32.970350 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1533/3080] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:32 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1371 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:32.983874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d3d623bd-1f6f-4a1e-b6ae-1956aab293b2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:32.994312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d3d623bd-1f6f-4a1e-b6ae-1956aab293b2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:33.032336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3d623bd-1f6f-4a1e-b6ae-1956aab293b2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:33.038666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3d623bd-1f6f-4a1e-b6ae-1956aab293b2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:33.044232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3d623bd-1f6f-4a1e-b6ae-1956aab293b2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:33.045325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3d623bd-1f6f-4a1e-b6ae-1956aab293b2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:33.443075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Getting quotas for project 4cbda0bc0f0b492c8aa15e47d6ab9678. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:09:33.454409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Getting quotas for user f7465fab904c4c41b229a7a1592eb95b and project 4cbda0bc0f0b492c8aa15e47d6ab9678. Resources: dict_keys(['metadata_items']) {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:09:33.475155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:09:33.476016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:09:33.477095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:09:33.477831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:09:33.478563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:09:33.505912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:33.506818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:33.510002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:33.516015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:33.612014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Getting quotas for project 4cbda0bc0f0b492c8aa15e47d6ab9678. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:09:33.630643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Getting quotas for user f7465fab904c4c41b229a7a1592eb95b and project 4cbda0bc0f0b492c8aa15e47d6ab9678. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:09:33.671302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d3d623bd-1f6f-4a1e-b6ae-1956aab293b2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:33.683793 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d3d623bd-1f6f-4a1e-b6ae-1956aab293b2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 200 len: 1314 microversion: 2.1 time: 0.710862 Aug 04 14:09:33.684404 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1534/3081] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:32 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:33.694843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-027bdb7c-9576-4d82-9ce1-186e0cdf003b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:33.695292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-027bdb7c-9576-4d82-9ce1-186e0cdf003b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:33.718684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-027bdb7c-9576-4d82-9ce1-186e0cdf003b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:33.719847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-027bdb7c-9576-4d82-9ce1-186e0cdf003b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:33.724800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-027bdb7c-9576-4d82-9ce1-186e0cdf003b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:33.726077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-027bdb7c-9576-4d82-9ce1-186e0cdf003b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:33.782498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:09:33.788779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8df43b87-1243-4802-bc1a-3326443d8a8a',volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:09:33.829952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-027bdb7c-9576-4d82-9ce1-186e0cdf003b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:09:34.017201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:34.053093 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-027bdb7c-9576-4d82-9ce1-186e0cdf003b tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 204 len: 0 microversion: 2.1 time: 0.363245 Aug 04 14:09:34.054135 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1535/3082] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:09:33 2022] DELETE /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:34.067923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1f2b35fd-cafd-4fe1-a23d-61961a758db1 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:34.071323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1f2b35fd-cafd-4fe1-a23d-61961a758db1 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:34.085797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f2b35fd-cafd-4fe1-a23d-61961a758db1 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:34.087190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f2b35fd-cafd-4fe1-a23d-61961a758db1 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:34.088982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f2b35fd-cafd-4fe1-a23d-61961a758db1 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:34.090083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f2b35fd-cafd-4fe1-a23d-61961a758db1 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:34.118164 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-904d45bb-22a7-416c-8737-e1ea25821d76 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.200017 Aug 04 14:09:34.119262 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1548/3083] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:09:30 2022] POST /compute/v2.1/servers => generated 407 bytes in 3202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:09:34.124599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42680ee7-be6c-4751-ac56-236b6f0c1dd9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:34.125565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-42680ee7-be6c-4751-ac56-236b6f0c1dd9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:34.134793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42680ee7-be6c-4751-ac56-236b6f0c1dd9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:34.135578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42680ee7-be6c-4751-ac56-236b6f0c1dd9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:34.137177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42680ee7-be6c-4751-ac56-236b6f0c1dd9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:34.137177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42680ee7-be6c-4751-ac56-236b6f0c1dd9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:34.153851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:34.209898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=22 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:34.945180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1f2b35fd-cafd-4fe1-a23d-61961a758db1 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:34.981576 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1f2b35fd-cafd-4fe1-a23d-61961a758db1 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1521 microversion: 2.1 time: 0.925244 Aug 04 14:09:34.993589 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1536/3084] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:34 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1521 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:35.015999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2e0a089a-b639-4424-9c48-5ac7246f4c51 req-5e9509cc-5402-406a-950b-e4401a93287f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb1614-6b27-48a6-b766-c7697e4169ac", "tag": "04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf"}, {"name": "network-changed", "server_uuid": "609f1a59-c11f-4ca1-8ba9-589f3e3845d8", "tag": "2464df80-50f8-4d91-a4a0-99bd8b33b2d7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:35.073410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2e0a089a-b639-4424-9c48-5ac7246f4c51 req-5e9509cc-5402-406a-950b-e4401a93287f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:35.077518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2e0a089a-b639-4424-9c48-5ac7246f4c51 req-5e9509cc-5402-406a-950b-e4401a93287f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:35.138158 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2e0a089a-b639-4424-9c48-5ac7246f4c51 req-5e9509cc-5402-406a-950b-e4401a93287f service nova] Creating event network-changed:04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf for instance 27bb1614-6b27-48a6-b766-c7697e4169ac on n-h2-844627-10 Aug 04 14:09:35.156036 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2e0a089a-b639-4424-9c48-5ac7246f4c51 req-5e9509cc-5402-406a-950b-e4401a93287f service nova] Creating event network-changed:2464df80-50f8-4d91-a4a0-99bd8b33b2d7 for instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 on n-h2-844627-10 Aug 04 14:09:35.183257 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2e0a089a-b639-4424-9c48-5ac7246f4c51 req-5e9509cc-5402-406a-950b-e4401a93287f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.185104 Aug 04 14:09:35.191308 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1537/3085] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:35.208821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4e207d7-e39a-4ecd-9e17-774fd72efaba tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:35.216616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d4e207d7-e39a-4ecd-9e17-774fd72efaba tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:35.242094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4e207d7-e39a-4ecd-9e17-774fd72efaba tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:35.250119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4e207d7-e39a-4ecd-9e17-774fd72efaba tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:35.252559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4e207d7-e39a-4ecd-9e17-774fd72efaba tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:35.253334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4e207d7-e39a-4ecd-9e17-774fd72efaba tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:35.973918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-42680ee7-be6c-4751-ac56-236b6f0c1dd9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:36.000100 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-42680ee7-be6c-4751-ac56-236b6f0c1dd9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1309 microversion: 2.1 time: 1.879067 Aug 04 14:09:36.009120 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1549/3086] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:34 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1309 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:36.018877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19894259-107e-4f63-8b70-27ea1dd19b35 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:36.025225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19894259-107e-4f63-8b70-27ea1dd19b35 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:36.061463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19894259-107e-4f63-8b70-27ea1dd19b35 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:36.067107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19894259-107e-4f63-8b70-27ea1dd19b35 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:36.071031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19894259-107e-4f63-8b70-27ea1dd19b35 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:36.071875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19894259-107e-4f63-8b70-27ea1dd19b35 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:36.149324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4e207d7-e39a-4ecd-9e17-774fd72efaba tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:36.164012 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4e207d7-e39a-4ecd-9e17-774fd72efaba tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1371 microversion: 2.1 time: 0.970058 Aug 04 14:09:36.167836 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1538/3087] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:35 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1371 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:36.188048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d2136c2-f237-44fa-ab92-1adc40db90b1 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:36.189153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d2136c2-f237-44fa-ab92-1adc40db90b1 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:36.200003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d2136c2-f237-44fa-ab92-1adc40db90b1 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:36.200744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d2136c2-f237-44fa-ab92-1adc40db90b1 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:36.202385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d2136c2-f237-44fa-ab92-1adc40db90b1 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:36.203125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d2136c2-f237-44fa-ab92-1adc40db90b1 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:36.577050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d2136c2-f237-44fa-ab92-1adc40db90b1 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:36.612810 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d2136c2-f237-44fa-ab92-1adc40db90b1 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1219 microversion: 2.1 time: 0.442683 Aug 04 14:09:36.615135 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1539/3088] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:36 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1219 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:36.639451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b940b2a-bbc6-4c4c-8a6f-503f0e6ece25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:36.640968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b940b2a-bbc6-4c4c-8a6f-503f0e6ece25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:36.669323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b940b2a-bbc6-4c4c-8a6f-503f0e6ece25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:36.670249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b940b2a-bbc6-4c4c-8a6f-503f0e6ece25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:36.671796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b940b2a-bbc6-4c4c-8a6f-503f0e6ece25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:36.674682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b940b2a-bbc6-4c4c-8a6f-503f0e6ece25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:37.891268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-19894259-107e-4f63-8b70-27ea1dd19b35 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd1aacb549b74c21a13b9f3ca2df840c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0f04146c914cf1940cea4b2229ebd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:37.914775 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19894259-107e-4f63-8b70-27ea1dd19b35 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 200 len: 1500 microversion: 2.1 time: 1.903180 Aug 04 14:09:37.921570 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1550/3089] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:36 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 1500 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:37.945886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e2e5341f-3a87-4bdd-8fb3-e5396c87b7a6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:37.947452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e2e5341f-3a87-4bdd-8fb3-e5396c87b7a6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:37.966930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2e5341f-3a87-4bdd-8fb3-e5396c87b7a6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:37.967681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2e5341f-3a87-4bdd-8fb3-e5396c87b7a6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:37.968786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2e5341f-3a87-4bdd-8fb3-e5396c87b7a6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:37.969418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2e5341f-3a87-4bdd-8fb3-e5396c87b7a6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:38.013320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b940b2a-bbc6-4c4c-8a6f-503f0e6ece25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:38.025417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:38.025755 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b940b2a-bbc6-4c4c-8a6f-503f0e6ece25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 200 len: 1314 microversion: 2.1 time: 1.408713 Aug 04 14:09:38.038449 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1540/3090] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:36 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 1314 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:38.043561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-fb138792-5a07-48c9-a973-be863568809e req-20369390-fa3a-499e-9764-c905d2786da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef3141f-bcba-44bc-9f99-819598f48b0d", "name": "network-vif-plugged", "status": "completed", "tag": "4501cde4-5f63-4947-9883-056e7f38a066"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:38.081735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fb138792-5a07-48c9-a973-be863568809e req-20369390-fa3a-499e-9764-c905d2786da8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:38.082194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fb138792-5a07-48c9-a973-be863568809e req-20369390-fa3a-499e-9764-c905d2786da8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:38.101226 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fb138792-5a07-48c9-a973-be863568809e req-20369390-fa3a-499e-9764-c905d2786da8 service nova] Creating event network-vif-plugged:4501cde4-5f63-4947-9883-056e7f38a066 for instance 0ef3141f-bcba-44bc-9f99-819598f48b0d on n-h2-844627-10 Aug 04 14:09:38.117906 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-fb138792-5a07-48c9-a973-be863568809e req-20369390-fa3a-499e-9764-c905d2786da8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077911 Aug 04 14:09:38.118562 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1541/3091] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:38.124635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d84d0f68-c520-47ca-b9b3-c724c64720c9 req-1b1895fc-35ee-4f35-937c-542eb48bb11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc80476-6b5a-4dd1-922d-cce84e21d111", "name": "network-vif-deleted", "tag": "5e940ed8-002c-484c-96fa-0461c38ab548"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:38.155605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d84d0f68-c520-47ca-b9b3-c724c64720c9 req-1b1895fc-35ee-4f35-937c-542eb48bb11c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:38.156311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d84d0f68-c520-47ca-b9b3-c724c64720c9 req-1b1895fc-35ee-4f35-937c-542eb48bb11c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:38.189188 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d84d0f68-c520-47ca-b9b3-c724c64720c9 req-1b1895fc-35ee-4f35-937c-542eb48bb11c service nova] Creating event network-vif-deleted:5e940ed8-002c-484c-96fa-0461c38ab548 for instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 on n-h1-844627-10 Aug 04 14:09:38.204753 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d84d0f68-c520-47ca-b9b3-c724c64720c9 req-1b1895fc-35ee-4f35-937c-542eb48bb11c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084381 Aug 04 14:09:38.205483 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1542/3092] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:38.218380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-746693a3-2bfe-48c7-bec9-dabda5e7882a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:38.219116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-746693a3-2bfe-48c7-bec9-dabda5e7882a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:38.243863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-746693a3-2bfe-48c7-bec9-dabda5e7882a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:38.244436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-746693a3-2bfe-48c7-bec9-dabda5e7882a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:38.245439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-746693a3-2bfe-48c7-bec9-dabda5e7882a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:38.245977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-746693a3-2bfe-48c7-bec9-dabda5e7882a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:38.966146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e2e5341f-3a87-4bdd-8fb3-e5396c87b7a6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:38.981502 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e2e5341f-3a87-4bdd-8fb3-e5396c87b7a6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1521 microversion: 2.1 time: 1.058350 Aug 04 14:09:38.982116 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1551/3093] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:37 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1521 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:38.998076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6be0037b-5b88-41fd-8a08-c073be82738d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:38.998916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6be0037b-5b88-41fd-8a08-c073be82738d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:39.022605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6be0037b-5b88-41fd-8a08-c073be82738d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:39.023424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6be0037b-5b88-41fd-8a08-c073be82738d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:39.030697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6be0037b-5b88-41fd-8a08-c073be82738d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:39.031333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6be0037b-5b88-41fd-8a08-c073be82738d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:39.300939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-746693a3-2bfe-48c7-bec9-dabda5e7882a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:39.327267 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-746693a3-2bfe-48c7-bec9-dabda5e7882a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1309 microversion: 2.1 time: 1.114332 Aug 04 14:09:39.336578 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1543/3094] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:38 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1309 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:39.348024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a49d0a33-d343-4809-9d09-58722e17a052 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:39.348960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a49d0a33-d343-4809-9d09-58722e17a052 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:39.379325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a49d0a33-d343-4809-9d09-58722e17a052 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:39.381840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a49d0a33-d343-4809-9d09-58722e17a052 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:39.394137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a49d0a33-d343-4809-9d09-58722e17a052 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:39.394605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a49d0a33-d343-4809-9d09-58722e17a052 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:39.589501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a49d0a33-d343-4809-9d09-58722e17a052 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:39.608849 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a49d0a33-d343-4809-9d09-58722e17a052 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1237 microversion: 2.1 time: 0.270553 Aug 04 14:09:39.625386 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1544/3095] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:39 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1237 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:39.644928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:39.671594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] [instance: 6cc80476-6b5a-4dd1-922d-cce84e21d111] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:39.695013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:39.695476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:39.696509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:39.697926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:39.723470 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] HTTP exception thrown: Instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 could not be found. Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Request method failure captured: Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 HTTP/1.1 Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69DJ7UvFMMQjxuNDGGzjmZREMHLlPKxIERi-6Xjw59TNuWQeh_S30PzHoTkmZG9_2h_Q4QERz2msjPjuyRjTw46n9sLubSR2JWDuNFhNwuD-kyoyomXZNiUxjmRtn9uOBHtyNJUJll3yYDcs_6rKq614le-nPQLJr6B5iT_HciDxV6A Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1d0f04146c914cf1940cea4b2229ebd5 Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-LiveMigrationTest-1263624033 Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1d0f04146c914cf1940cea4b2229ebd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1d0f04146c914cf1940cea4b2229ebd5"}]}] Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-LiveMigrationTest-1263624033 Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1d0f04146c914cf1940cea4b2229ebd5 Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-LiveMigrationTest-1263624033 Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-LiveMigrationTest-1263624033-project Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: dd1aacb549b74c21a13b9f3ca2df840c Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-LiveMigrationTest-1263624033-project Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 could not be found. Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '6cc80476-6b5a-4dd1-922d-cce84e21d111'} Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 could not be found. Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 could not be found. Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:39.727647 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.731880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:39.731880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:39.731880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:39.731880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:09:39.731880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:09:39.731880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 could not be found. Aug 04 14:09:39.731880 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.735332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] Returning 404 to user: Instance 6cc80476-6b5a-4dd1-922d-cce84e21d111 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:39.742873 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-23a1ce32-d976-4db8-98fc-3b53394278a1 tempest-LiveMigrationTest-1263624033 tempest-LiveMigrationTest-1263624033-project] 10.222.0.66 "GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111" status: 404 len: 111 microversion: 2.1 time: 0.115602 Aug 04 14:09:39.743816 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1545/3096] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:39 2022] GET /compute/v2.1/servers/6cc80476-6b5a-4dd1-922d-cce84e21d111 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:39.754446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf3cfe4f-9144-460d-8836-a4aa49a7d759 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf3cfe4f-9144-460d-8836-a4aa49a7d759 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action HTTP/1.1 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 285 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '383d7069-d26f-4b0c-b363-455fe8e5424b', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:39.759217 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:09:39.762776 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:39.783281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf3cfe4f-9144-460d-8836-a4aa49a7d759 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:39.788850 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf3cfe4f-9144-460d-8836-a4aa49a7d759 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action" status: 400 len: 619 microversion: 2.1 time: 0.043679 Aug 04 14:09:39.791195 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1546/3097] 10.222.0.66 () {60 vars in 1279 bytes} [Thu Aug 4 14:09:39 2022] POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action => generated 619 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:09:39.802160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e5600fc-fb41-4a76-a972-fcddc8c84404 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:39.810517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2e5600fc-fb41-4a76-a972-fcddc8c84404 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:39.835387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e5600fc-fb41-4a76-a972-fcddc8c84404 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:39.839952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e5600fc-fb41-4a76-a972-fcddc8c84404 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:39.841211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e5600fc-fb41-4a76-a972-fcddc8c84404 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:39.841885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e5600fc-fb41-4a76-a972-fcddc8c84404 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:39.885984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6be0037b-5b88-41fd-8a08-c073be82738d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:39.933834 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6be0037b-5b88-41fd-8a08-c073be82738d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1371 microversion: 2.1 time: 0.943628 Aug 04 14:09:39.948677 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1552/3098] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:38 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1371 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:39.976791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c1627ef8-f30e-4675-9305-78c1fb8e69de tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:39.983967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c1627ef8-f30e-4675-9305-78c1fb8e69de tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:40.007284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1627ef8-f30e-4675-9305-78c1fb8e69de tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:40.009729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1627ef8-f30e-4675-9305-78c1fb8e69de tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:40.012644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1627ef8-f30e-4675-9305-78c1fb8e69de tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:40.014955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1627ef8-f30e-4675-9305-78c1fb8e69de tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:40.860238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e5600fc-fb41-4a76-a972-fcddc8c84404 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:40.916271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1627ef8-f30e-4675-9305-78c1fb8e69de tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:40.920508 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e5600fc-fb41-4a76-a972-fcddc8c84404 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 200 len: 1314 microversion: 2.1 time: 1.097841 Aug 04 14:09:40.924891 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1547/3099] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:39 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 1314 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:40.958242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-945889de-ca7e-4259-b6c5-5d7d8dbfe35c req-b0a30665-92f7-4b47-8426-b71e2024b1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bb1614-6b27-48a6-b766-c7697e4169ac", "name": "network-vif-plugged", "status": "completed", "tag": "04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:40.969259 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c1627ef8-f30e-4675-9305-78c1fb8e69de tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1521 microversion: 2.1 time: 0.990810 Aug 04 14:09:40.974391 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1553/3100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:39 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1521 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:41.014351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7677ed9-120d-4541-88da-0707a2211e47 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:41.021670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7677ed9-120d-4541-88da-0707a2211e47 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:41.038686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-945889de-ca7e-4259-b6c5-5d7d8dbfe35c req-b0a30665-92f7-4b47-8426-b71e2024b1a0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.044469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-945889de-ca7e-4259-b6c5-5d7d8dbfe35c req-b0a30665-92f7-4b47-8426-b71e2024b1a0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:41.056852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7677ed9-120d-4541-88da-0707a2211e47 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.060951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7677ed9-120d-4541-88da-0707a2211e47 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:41.072258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7677ed9-120d-4541-88da-0707a2211e47 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.073759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7677ed9-120d-4541-88da-0707a2211e47 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:41.106610 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-945889de-ca7e-4259-b6c5-5d7d8dbfe35c req-b0a30665-92f7-4b47-8426-b71e2024b1a0 service nova] Creating event network-vif-plugged:04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf for instance 27bb1614-6b27-48a6-b766-c7697e4169ac on n-h2-844627-10 Aug 04 14:09:41.125426 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-945889de-ca7e-4259-b6c5-5d7d8dbfe35c req-b0a30665-92f7-4b47-8426-b71e2024b1a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196841 Aug 04 14:09:41.133520 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1548/3101] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:41.181791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb5fb2fe-08a6-4d45-9df6-336558a7d446 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:41.195272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb5fb2fe-08a6-4d45-9df6-336558a7d446 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:41.276836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5fb2fe-08a6-4d45-9df6-336558a7d446 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.278723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5fb2fe-08a6-4d45-9df6-336558a7d446 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:41.281184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5fb2fe-08a6-4d45-9df6-336558a7d446 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.282428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5fb2fe-08a6-4d45-9df6-336558a7d446 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:41.447533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bb5fb2fe-08a6-4d45-9df6-336558a7d446 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:41.450218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:41.463377 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb5fb2fe-08a6-4d45-9df6-336558a7d446 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1237 microversion: 2.1 time: 0.313481 Aug 04 14:09:41.463990 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1549/3102] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:41 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1237 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:41.482041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-28cbfdfa-c28d-49cc-a91b-79045e89a64a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:41.483120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-28cbfdfa-c28d-49cc-a91b-79045e89a64a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:41.501036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28cbfdfa-c28d-49cc-a91b-79045e89a64a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.506824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28cbfdfa-c28d-49cc-a91b-79045e89a64a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:41.507702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28cbfdfa-c28d-49cc-a91b-79045e89a64a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.508161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28cbfdfa-c28d-49cc-a91b-79045e89a64a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:41.862207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7677ed9-120d-4541-88da-0707a2211e47 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:41.867359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-28cbfdfa-c28d-49cc-a91b-79045e89a64a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:41.879814 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-28cbfdfa-c28d-49cc-a91b-79045e89a64a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1371 microversion: 2.1 time: 0.412661 Aug 04 14:09:41.880756 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1550/3103] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:41 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:41.893934 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7677ed9-120d-4541-88da-0707a2211e47 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1309 microversion: 2.1 time: 0.912874 Aug 04 14:09:41.894459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-38edf2c7-6373-4982-84ca-62230155e6ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:41.904328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-38edf2c7-6373-4982-84ca-62230155e6ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:41.905326 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1554/3104] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:40 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1309 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:41.905421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38edf2c7-6373-4982-84ca-62230155e6ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.905421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38edf2c7-6373-4982-84ca-62230155e6ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:41.906034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38edf2c7-6373-4982-84ca-62230155e6ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.906496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38edf2c7-6373-4982-84ca-62230155e6ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:41.966997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d07799b3-c73f-4d80-b0df-f2ebf1b6d5c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:41.968909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d07799b3-c73f-4d80-b0df-f2ebf1b6d5c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:41.986752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d07799b3-c73f-4d80-b0df-f2ebf1b6d5c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:41.988111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d07799b3-c73f-4d80-b0df-f2ebf1b6d5c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:42.020419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d07799b3-c73f-4d80-b0df-f2ebf1b6d5c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:42.026765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d07799b3-c73f-4d80-b0df-f2ebf1b6d5c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:42.635107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-38edf2c7-6373-4982-84ca-62230155e6ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:42.648198 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-38edf2c7-6373-4982-84ca-62230155e6ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1521 microversion: 2.1 time: 0.766089 Aug 04 14:09:42.648805 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1551/3105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:41 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1521 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:42.660974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ed3ee0c8-d6bc-4448-9cb5-cfc988f45bcf tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:42.661615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ed3ee0c8-d6bc-4448-9cb5-cfc988f45bcf tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:42.678418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed3ee0c8-d6bc-4448-9cb5-cfc988f45bcf tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:42.679011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed3ee0c8-d6bc-4448-9cb5-cfc988f45bcf tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:42.691082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed3ee0c8-d6bc-4448-9cb5-cfc988f45bcf tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:42.691897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed3ee0c8-d6bc-4448-9cb5-cfc988f45bcf tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:43.053424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d07799b3-c73f-4d80-b0df-f2ebf1b6d5c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:43.070188 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d07799b3-c73f-4d80-b0df-f2ebf1b6d5c8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 200 len: 1501 microversion: 2.1 time: 1.112478 Aug 04 14:09:43.086946 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1555/3106] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:41 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 1501 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:09:43.104841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b3448c4-4209-4784-887a-68988eaf4f08 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-951056366"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:43.110538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b3448c4-4209-4784-887a-68988eaf4f08 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:43.121193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b3448c4-4209-4784-887a-68988eaf4f08 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:43.122018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b3448c4-4209-4784-887a-68988eaf4f08 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:43.123834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b3448c4-4209-4784-887a-68988eaf4f08 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:43.124500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b3448c4-4209-4784-887a-68988eaf4f08 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:43.408407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ed3ee0c8-d6bc-4448-9cb5-cfc988f45bcf tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:43.459471 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ed3ee0c8-d6bc-4448-9cb5-cfc988f45bcf tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1305 microversion: 2.1 time: 0.803551 Aug 04 14:09:43.460584 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1552/3107] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:42 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1305 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:43.489313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02e6e3f0-de46-4e26-a50f-799dcfd712d3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:43.490069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-02e6e3f0-de46-4e26-a50f-799dcfd712d3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:43.523568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e6e3f0-de46-4e26-a50f-799dcfd712d3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:43.524023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e6e3f0-de46-4e26-a50f-799dcfd712d3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:43.528151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e6e3f0-de46-4e26-a50f-799dcfd712d3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:43.538478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02e6e3f0-de46-4e26-a50f-799dcfd712d3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:43.571470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:43.674787 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4b3448c4-4209-4784-887a-68988eaf4f08 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action" status: 202 len: 0 microversion: 2.1 time: 0.571126 Aug 04 14:09:43.683933 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1556/3108] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:09:43 2022] POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:09:43.723363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac3343f5-921a-4db2-8e3d-9aaa222792ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:43.733638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ac3343f5-921a-4db2-8e3d-9aaa222792ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:43.755364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=10 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:43.756160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:43.758666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac3343f5-921a-4db2-8e3d-9aaa222792ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:43.759388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac3343f5-921a-4db2-8e3d-9aaa222792ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:43.761036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac3343f5-921a-4db2-8e3d-9aaa222792ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:43.761736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac3343f5-921a-4db2-8e3d-9aaa222792ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:44.729946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ac3343f5-921a-4db2-8e3d-9aaa222792ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:44.739369 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac3343f5-921a-4db2-8e3d-9aaa222792ba tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1309 microversion: 2.1 time: 1.049113 Aug 04 14:09:44.781270 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1557/3109] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:43 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1309 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:44.797453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52c139a2-1ee0-4fbe-84de-6e5fccba50b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:44.798272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-52c139a2-1ee0-4fbe-84de-6e5fccba50b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:44.821277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52c139a2-1ee0-4fbe-84de-6e5fccba50b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:44.821878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52c139a2-1ee0-4fbe-84de-6e5fccba50b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:44.822738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52c139a2-1ee0-4fbe-84de-6e5fccba50b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:44.823183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52c139a2-1ee0-4fbe-84de-6e5fccba50b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:45.007274 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-52c139a2-1ee0-4fbe-84de-6e5fccba50b3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d/action" status: 202 len: 0 microversion: 2.1 time: 0.219405 Aug 04 14:09:45.013346 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1558/3110] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:09:44 2022] POST /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:09:45.023217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-4c42dd38-c78b-428f-b0a2-c439d0ff31e3 req-4155c636-3f66-4969-ad8f-9c769ee545fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609f1a59-c11f-4ca1-8ba9-589f3e3845d8", "name": "network-vif-plugged", "status": "completed", "tag": "2464df80-50f8-4d91-a4a0-99bd8b33b2d7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:45.087813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4c42dd38-c78b-428f-b0a2-c439d0ff31e3 req-4155c636-3f66-4969-ad8f-9c769ee545fb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:45.088195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4c42dd38-c78b-428f-b0a2-c439d0ff31e3 req-4155c636-3f66-4969-ad8f-9c769ee545fb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:45.111486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-02e6e3f0-de46-4e26-a50f-799dcfd712d3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:45.126162 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-02e6e3f0-de46-4e26-a50f-799dcfd712d3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1565 microversion: 2.1 time: 1.655439 Aug 04 14:09:45.142155 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1553/3111] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:43 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1565 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:45.153018 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-4c42dd38-c78b-428f-b0a2-c439d0ff31e3 req-4155c636-3f66-4969-ad8f-9c769ee545fb service nova] Creating event network-vif-plugged:2464df80-50f8-4d91-a4a0-99bd8b33b2d7 for instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 on n-h2-844627-10 Aug 04 14:09:45.155454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-761482819"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:45.159007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:45.177730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:45.178256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:45.179245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:45.179703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:45.198542 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-4c42dd38-c78b-428f-b0a2-c439d0ff31e3 req-4155c636-3f66-4969-ad8f-9c769ee545fb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179081 Aug 04 14:09:45.212752 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1559/3112] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:45.230194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-43cd49e4-78b7-416f-ab63-62d7b1133da6 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:45.232714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-43cd49e4-78b7-416f-ab63-62d7b1133da6 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:45.248076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43cd49e4-78b7-416f-ab63-62d7b1133da6 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:45.251296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43cd49e4-78b7-416f-ab63-62d7b1133da6 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:45.257424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43cd49e4-78b7-416f-ab63-62d7b1133da6 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:45.258926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43cd49e4-78b7-416f-ab63-62d7b1133da6 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:45.349561 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Cannot 'createImage' instance 383d7069-d26f-4b0c-b363-455fe8e5424b while it is in task_state image_snapshot Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action HTTP/1.1 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 84 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-761482819"}} Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: exception: Cannot 'createImage' instance 383d7069-d26f-4b0c-b363-455fe8e5424b while it is in task_state image_snapshot Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '383d7069-d26f-4b0c-b363-455fe8e5424b', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-761482819'}}} Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:09:45.355171 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 383d7069-d26f-4b0c-b363-455fe8e5424b while it is in task_state image_snapshot Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 383d7069-d26f-4b0c-b363-455fe8e5424b while it is in task_state image_snapshot Aug 04 14:09:45.360488 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:45.365081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 409 to user: Cannot 'createImage' instance 383d7069-d26f-4b0c-b363-455fe8e5424b while it is in task_state image_snapshot {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:45.369402 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a340c810-8af7-4746-bf12-1174cc152024 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action" status: 409 len: 159 microversion: 2.1 time: 0.225809 Aug 04 14:09:45.377154 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1554/3113] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:09:45 2022] POST /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b/action => generated 159 bytes in 228 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:09:45.396991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eaeace27-c071-4705-a1de-23f7331fb1c3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:45.403822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eaeace27-c071-4705-a1de-23f7331fb1c3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:45.439746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaeace27-c071-4705-a1de-23f7331fb1c3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:45.440365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaeace27-c071-4705-a1de-23f7331fb1c3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:45.450706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaeace27-c071-4705-a1de-23f7331fb1c3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:45.451629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eaeace27-c071-4705-a1de-23f7331fb1c3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:46.326131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-43cd49e4-78b7-416f-ab63-62d7b1133da6 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:46.358427 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-43cd49e4-78b7-416f-ab63-62d7b1133da6 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1305 microversion: 2.1 time: 1.142064 Aug 04 14:09:46.368697 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1560/3114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:45 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1305 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:46.388738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19284730-8442-4d0a-b49a-c662f9dd01e3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:46.390300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19284730-8442-4d0a-b49a-c662f9dd01e3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:46.416580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19284730-8442-4d0a-b49a-c662f9dd01e3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:46.422029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19284730-8442-4d0a-b49a-c662f9dd01e3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:46.423853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19284730-8442-4d0a-b49a-c662f9dd01e3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:46.430405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19284730-8442-4d0a-b49a-c662f9dd01e3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:46.587727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eaeace27-c071-4705-a1de-23f7331fb1c3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:46.621372 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eaeace27-c071-4705-a1de-23f7331fb1c3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 200 len: 1486 microversion: 2.1 time: 1.241978 Aug 04 14:09:46.629239 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1555/3115] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:45 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 1486 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:46.657041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6321e2a9-3670-452a-8476-a2ba88ab8595 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '.version_select at 0x7f4705590d30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:46.953478 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6321e2a9-3670-452a-8476-a2ba88ab8595 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/images/3785b8ca-7e8a-42d8-97b6-71735cbd8d5e" status: 204 len: 0 microversion: 2.1 time: 0.321848 Aug 04 14:09:46.958721 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1556/3116] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:46 2022] DELETE /compute/v2.1/images/3785b8ca-7e8a-42d8-97b6-71735cbd8d5e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:47.047990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6897bc74-cd47-4d78-931d-6b8928dc376e req-b95c6352-7d26-43f6-b4b4-1d2714301672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81bf9735-dc4f-4216-82db-a6e836669b81", "tag": "071f8975-48da-48be-876e-436a9c956685"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:47.121080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6897bc74-cd47-4d78-931d-6b8928dc376e req-b95c6352-7d26-43f6-b4b4-1d2714301672 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:47.121868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6897bc74-cd47-4d78-931d-6b8928dc376e req-b95c6352-7d26-43f6-b4b4-1d2714301672 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:47.216801 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6897bc74-cd47-4d78-931d-6b8928dc376e req-b95c6352-7d26-43f6-b4b4-1d2714301672 service nova] Creating event network-changed:071f8975-48da-48be-876e-436a9c956685 for instance 81bf9735-dc4f-4216-82db-a6e836669b81 on n-h1-844627-10 Aug 04 14:09:47.233732 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6897bc74-cd47-4d78-931d-6b8928dc376e req-b95c6352-7d26-43f6-b4b4-1d2714301672 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270318 Aug 04 14:09:47.237683 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1557/3117] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:47.250822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e6cb284e-e9ff-4d8d-9259-90f2ccbac8fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:47.258725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e6cb284e-e9ff-4d8d-9259-90f2ccbac8fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:47.304641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6cb284e-e9ff-4d8d-9259-90f2ccbac8fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:47.306516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6cb284e-e9ff-4d8d-9259-90f2ccbac8fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:47.309153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6cb284e-e9ff-4d8d-9259-90f2ccbac8fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:47.311513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6cb284e-e9ff-4d8d-9259-90f2ccbac8fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:47.682777 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19284730-8442-4d0a-b49a-c662f9dd01e3 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.311671 Aug 04 14:09:47.684570 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1561/3118] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:09:46 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-interface => generated 285 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:47.700856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4404d17a-007c-40aa-a6be-e91f24579f9b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:47.701783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4404d17a-007c-40aa-a6be-e91f24579f9b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:47.712939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4404d17a-007c-40aa-a6be-e91f24579f9b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:47.716224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4404d17a-007c-40aa-a6be-e91f24579f9b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:47.725265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4404d17a-007c-40aa-a6be-e91f24579f9b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:47.726167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4404d17a-007c-40aa-a6be-e91f24579f9b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:47.828340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4404d17a-007c-40aa-a6be-e91f24579f9b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:09:48.098970 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4404d17a-007c-40aa-a6be-e91f24579f9b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 204 len: 0 microversion: 2.1 time: 0.411743 Aug 04 14:09:48.101067 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1562/3119] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:09:47 2022] DELETE /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:48.129463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c2b33726-41e3-4654-8fdc-919b4994fad3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:48.140391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c2b33726-41e3-4654-8fdc-919b4994fad3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:48.193224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2b33726-41e3-4654-8fdc-919b4994fad3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:48.198102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2b33726-41e3-4654-8fdc-919b4994fad3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:48.206778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2b33726-41e3-4654-8fdc-919b4994fad3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:48.208853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2b33726-41e3-4654-8fdc-919b4994fad3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:49.274078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e6cb284e-e9ff-4d8d-9259-90f2ccbac8fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:49.301628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c2b33726-41e3-4654-8fdc-919b4994fad3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:49.313578 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c2b33726-41e3-4654-8fdc-919b4994fad3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1539 microversion: 2.1 time: 1.208625 Aug 04 14:09:49.315848 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1563/3120] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:48 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1539 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:49.317280 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e6cb284e-e9ff-4d8d-9259-90f2ccbac8fe tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1309 microversion: 2.1 time: 2.072278 Aug 04 14:09:49.322403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d908ac2-daac-4297-a392-aa5889d5fee9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:49.323519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1d908ac2-daac-4297-a392-aa5889d5fee9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:49.336586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d908ac2-daac-4297-a392-aa5889d5fee9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:49.337776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d908ac2-daac-4297-a392-aa5889d5fee9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:49.341112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d908ac2-daac-4297-a392-aa5889d5fee9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:49.341983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d908ac2-daac-4297-a392-aa5889d5fee9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:49.355364 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1558/3121] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:47 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1309 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:49.371799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d03cc9e1-8f66-4c0b-b04c-e4d95a6b3254 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:49.378823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d03cc9e1-8f66-4c0b-b04c-e4d95a6b3254 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:49.410032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d03cc9e1-8f66-4c0b-b04c-e4d95a6b3254 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:49.411927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d03cc9e1-8f66-4c0b-b04c-e4d95a6b3254 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:49.421025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d03cc9e1-8f66-4c0b-b04c-e4d95a6b3254 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:49.422301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d03cc9e1-8f66-4c0b-b04c-e4d95a6b3254 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:50.659804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1d908ac2-daac-4297-a392-aa5889d5fee9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:50.675331 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d908ac2-daac-4297-a392-aa5889d5fee9 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1293 microversion: 2.1 time: 1.356563 Aug 04 14:09:50.676155 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1564/3122] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:49 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1293 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:50.683582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3533677d-1921-4d79-94fe-42b4e0227426 req-34176281-8714-4819-9ad7-916bd04319a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383d7069-d26f-4b0c-b363-455fe8e5424b", "name": "network-vif-plugged", "status": "completed", "tag": "16cad79f-fc8b-422b-b7c4-cba9a5b01afa"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:50.702140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3533677d-1921-4d79-94fe-42b4e0227426 req-34176281-8714-4819-9ad7-916bd04319a9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:50.704026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3533677d-1921-4d79-94fe-42b4e0227426 req-34176281-8714-4819-9ad7-916bd04319a9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:50.723896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:50.729449 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3533677d-1921-4d79-94fe-42b4e0227426 req-34176281-8714-4819-9ad7-916bd04319a9 service nova] Creating event network-vif-plugged:16cad79f-fc8b-422b-b7c4-cba9a5b01afa for instance 383d7069-d26f-4b0c-b363-455fe8e5424b on n-h1-844627-10 Aug 04 14:09:50.739438 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3533677d-1921-4d79-94fe-42b4e0227426 req-34176281-8714-4819-9ad7-916bd04319a9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061101 Aug 04 14:09:50.740379 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1565/3123] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:50.754854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa9e31c5-88e2-43f5-a49a-34f0e26786d9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:50.755560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa9e31c5-88e2-43f5-a49a-34f0e26786d9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:50.774473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9e31c5-88e2-43f5-a49a-34f0e26786d9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:50.775149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9e31c5-88e2-43f5-a49a-34f0e26786d9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:50.776547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9e31c5-88e2-43f5-a49a-34f0e26786d9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:50.777230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9e31c5-88e2-43f5-a49a-34f0e26786d9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:50.982080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d03cc9e1-8f66-4c0b-b04c-e4d95a6b3254 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:50.993870 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d03cc9e1-8f66-4c0b-b04c-e4d95a6b3254 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 200 len: 1492 microversion: 2.1 time: 1.636837 Aug 04 14:09:51.005490 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1559/3124] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:49 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 1492 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:51.015558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1e361e5-74aa-437e-8420-9613dd14e0f8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:51.016277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1e361e5-74aa-437e-8420-9613dd14e0f8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:51.024830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e361e5-74aa-437e-8420-9613dd14e0f8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:51.025651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e361e5-74aa-437e-8420-9613dd14e0f8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:51.026760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e361e5-74aa-437e-8420-9613dd14e0f8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:51.027430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e361e5-74aa-437e-8420-9613dd14e0f8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:51.295383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa9e31c5-88e2-43f5-a49a-34f0e26786d9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:51.315965 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa9e31c5-88e2-43f5-a49a-34f0e26786d9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1539 microversion: 2.1 time: 0.568996 Aug 04 14:09:51.318583 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1566/3125] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:50 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1539 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:51.641369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1e361e5-74aa-437e-8420-9613dd14e0f8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:51.655720 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1e361e5-74aa-437e-8420-9613dd14e0f8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1489 microversion: 2.1 time: 0.648013 Aug 04 14:09:51.674317 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1560/3126] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:51 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1489 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:51.715179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-80d430de-a988-4e95-8893-7c7f94bf3de0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:51.732467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-80d430de-a988-4e95-8893-7c7f94bf3de0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:51.737220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf918c56-988b-4953-acfd-b3b9dfaa8717 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:51.738563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf918c56-988b-4953-acfd-b3b9dfaa8717 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:51.763175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80d430de-a988-4e95-8893-7c7f94bf3de0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:51.763966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80d430de-a988-4e95-8893-7c7f94bf3de0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:51.767918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80d430de-a988-4e95-8893-7c7f94bf3de0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:51.768817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80d430de-a988-4e95-8893-7c7f94bf3de0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:51.771111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf918c56-988b-4953-acfd-b3b9dfaa8717 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:51.778327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf918c56-988b-4953-acfd-b3b9dfaa8717 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:51.780441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf918c56-988b-4953-acfd-b3b9dfaa8717 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:51.788573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf918c56-988b-4953-acfd-b3b9dfaa8717 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:52.054736 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-80d430de-a988-4e95-8893-7c7f94bf3de0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "PUT /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1084 microversion: 2.1 time: 0.361904 Aug 04 14:09:52.056089 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1567/3127] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:09:51 2022] PUT /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1084 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:52.064125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b023ec2-ae3a-41a3-9e6e-fb84db30a2ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:52.065975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8b023ec2-ae3a-41a3-9e6e-fb84db30a2ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:52.081622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b023ec2-ae3a-41a3-9e6e-fb84db30a2ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:52.083235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b023ec2-ae3a-41a3-9e6e-fb84db30a2ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:52.085422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b023ec2-ae3a-41a3-9e6e-fb84db30a2ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:52.086241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b023ec2-ae3a-41a3-9e6e-fb84db30a2ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:52.490206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bf918c56-988b-4953-acfd-b3b9dfaa8717 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:52.522199 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf918c56-988b-4953-acfd-b3b9dfaa8717 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1293 microversion: 2.1 time: 0.806354 Aug 04 14:09:52.540562 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1561/3128] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:51 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1293 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:52.561966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8de497a2-a029-4089-95e4-825f5da593c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:52.563850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8de497a2-a029-4089-95e4-825f5da593c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:52.580298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de497a2-a029-4089-95e4-825f5da593c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:52.581539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de497a2-a029-4089-95e4-825f5da593c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:52.583327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de497a2-a029-4089-95e4-825f5da593c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:52.584515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de497a2-a029-4089-95e4-825f5da593c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:52.635532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8b023ec2-ae3a-41a3-9e6e-fb84db30a2ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:52.661701 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8b023ec2-ae3a-41a3-9e6e-fb84db30a2ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 200 len: 1492 microversion: 2.1 time: 0.603296 Aug 04 14:09:52.676992 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1568/3129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:52 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 1492 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:52.678985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3ec36a89-f607-4b93-b74e-2491e4d92ad7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:52.679772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3ec36a89-f607-4b93-b74e-2491e4d92ad7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:52.755783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ec36a89-f607-4b93-b74e-2491e4d92ad7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:52.766209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ec36a89-f607-4b93-b74e-2491e4d92ad7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:52.775319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ec36a89-f607-4b93-b74e-2491e4d92ad7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:52.776096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ec36a89-f607-4b93-b74e-2491e4d92ad7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:53.038546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8de497a2-a029-4089-95e4-825f5da593c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:53.048168 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8de497a2-a029-4089-95e4-825f5da593c5 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1510 microversion: 2.1 time: 0.505159 Aug 04 14:09:53.049992 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1562/3130] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:52 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1510 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:53.058540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5ffe40cc-801f-452b-a041-692b31c93ef1 req-9a79bc9a-bc7a-4837-a75e-453f4a3f2c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb1614-6b27-48a6-b766-c7697e4169ac", "tag": "04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:53.090911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5ffe40cc-801f-452b-a041-692b31c93ef1 req-9a79bc9a-bc7a-4837-a75e-453f4a3f2c76 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:53.091619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5ffe40cc-801f-452b-a041-692b31c93ef1 req-9a79bc9a-bc7a-4837-a75e-453f4a3f2c76 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:53.109705 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5ffe40cc-801f-452b-a041-692b31c93ef1 req-9a79bc9a-bc7a-4837-a75e-453f4a3f2c76 service nova] Creating event network-changed:04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf for instance 27bb1614-6b27-48a6-b766-c7697e4169ac on n-h2-844627-10 Aug 04 14:09:53.119948 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5ffe40cc-801f-452b-a041-692b31c93ef1 req-9a79bc9a-bc7a-4837-a75e-453f4a3f2c76 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067529 Aug 04 14:09:53.121162 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1563/3131] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:53.356534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3ec36a89-f607-4b93-b74e-2491e4d92ad7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:53.406575 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3ec36a89-f607-4b93-b74e-2491e4d92ad7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1539 microversion: 2.1 time: 0.735509 Aug 04 14:09:53.415689 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1569/3132] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:52 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1539 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:53.450041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-9694d63b-317f-45b4-964b-9d0fbcdbe836 req-54d4a633-b2b1-4948-858a-d116b1c2e9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef3141f-bcba-44bc-9f99-819598f48b0d", "name": "network-vif-deleted", "tag": "4501cde4-5f63-4947-9883-056e7f38a066"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:53.457737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa455bda-2c93-43d2-bffe-a1e606943fda tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:53.458918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa455bda-2c93-43d2-bffe-a1e606943fda tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:53.477448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9694d63b-317f-45b4-964b-9d0fbcdbe836 req-54d4a633-b2b1-4948-858a-d116b1c2e9a8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:53.478221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9694d63b-317f-45b4-964b-9d0fbcdbe836 req-54d4a633-b2b1-4948-858a-d116b1c2e9a8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:53.490585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa455bda-2c93-43d2-bffe-a1e606943fda tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:53.493451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa455bda-2c93-43d2-bffe-a1e606943fda tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:53.496987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa455bda-2c93-43d2-bffe-a1e606943fda tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:53.501938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa455bda-2c93-43d2-bffe-a1e606943fda tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:53.512791 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9694d63b-317f-45b4-964b-9d0fbcdbe836 req-54d4a633-b2b1-4948-858a-d116b1c2e9a8 service nova] Creating event network-vif-deleted:4501cde4-5f63-4947-9883-056e7f38a066 for instance 0ef3141f-bcba-44bc-9f99-819598f48b0d on n-h2-844627-10 Aug 04 14:09:53.532666 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-9694d63b-317f-45b4-964b-9d0fbcdbe836 req-54d4a633-b2b1-4948-858a-d116b1c2e9a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409381 Aug 04 14:09:53.533602 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1564/3133] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:53.563255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f2510edf-8472-4221-b17a-422f8c69ddf5 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:53.563991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2510edf-8472-4221-b17a-422f8c69ddf5 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:53.578387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2510edf-8472-4221-b17a-422f8c69ddf5 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:53.586859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2510edf-8472-4221-b17a-422f8c69ddf5 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:53.588406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2510edf-8472-4221-b17a-422f8c69ddf5 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:53.588898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2510edf-8472-4221-b17a-422f8c69ddf5 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:54.165308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f2510edf-8472-4221-b17a-422f8c69ddf5 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:54.193942 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f2510edf-8472-4221-b17a-422f8c69ddf5 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1293 microversion: 2.1 time: 0.631646 Aug 04 14:09:54.195021 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1565/3134] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:53 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1293 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:09:54.248843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.250445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:54.275730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:54.284214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:54.286273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:54.287112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:54.295520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa455bda-2c93-43d2-bffe-a1e606943fda tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:54.330762 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa455bda-2c93-43d2-bffe-a1e606943fda tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1510 microversion: 2.1 time: 0.909269 Aug 04 14:09:54.332245 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1570/3135] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:53 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1510 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:54.355090 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:09:54.356414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f35beb10-2ae8-4bc3-8def-46472bf24b46 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.357090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f35beb10-2ae8-4bc3-8def-46472bf24b46 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d HTTP/1.1 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '0ef3141f-bcba-44bc-9f99-819598f48b0d'} Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:09:54.359482 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-15c970f8-715a-4951-af5e-69614b453a1d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 404 len: 111 microversion: 2.1 time: 0.147883 Aug 04 14:09:54.387663 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1566/3136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:54 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:09:54.394483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f35beb10-2ae8-4bc3-8def-46472bf24b46 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:54.394483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f35beb10-2ae8-4bc3-8def-46472bf24b46 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:54.394483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f35beb10-2ae8-4bc3-8def-46472bf24b46 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:54.394483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f35beb10-2ae8-4bc3-8def-46472bf24b46 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:54.440364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21f187fc-5875-4faf-ba82-8d6f067e298c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.453854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-21f187fc-5875-4faf-ba82-8d6f067e298c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:54.471541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21f187fc-5875-4faf-ba82-8d6f067e298c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:54.472326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21f187fc-5875-4faf-ba82-8d6f067e298c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:54.475168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21f187fc-5875-4faf-ba82-8d6f067e298c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:54.475965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21f187fc-5875-4faf-ba82-8d6f067e298c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:54.536863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f35beb10-2ae8-4bc3-8def-46472bf24b46 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:09:54.763443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-21f187fc-5875-4faf-ba82-8d6f067e298c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:54.781507 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-21f187fc-5875-4faf-ba82-8d6f067e298c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1521 microversion: 2.1 time: 0.348345 Aug 04 14:09:54.782863 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1567/3137] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:54 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:54.790261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1551356468", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:54.883072 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f35beb10-2ae8-4bc3-8def-46472bf24b46 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 204 len: 0 microversion: 2.1 time: 0.532569 Aug 04 14:09:54.883995 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1571/3138] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:09:54 2022] DELETE /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:54.885170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] validate_networks() for [('4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:09:54.906894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af48110d-7c12-4fd2-acb5-6e66a5c2310e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:54.911067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af48110d-7c12-4fd2-acb5-6e66a5c2310e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:54.936660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af48110d-7c12-4fd2-acb5-6e66a5c2310e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:54.937529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af48110d-7c12-4fd2-acb5-6e66a5c2310e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:54.939030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af48110d-7c12-4fd2-acb5-6e66a5c2310e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:54.944172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af48110d-7c12-4fd2-acb5-6e66a5c2310e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:55.026681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af48110d-7c12-4fd2-acb5-6e66a5c2310e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:09:55.267858 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af48110d-7c12-4fd2-acb5-6e66a5c2310e tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 204 len: 0 microversion: 2.1 time: 0.379140 Aug 04 14:09:55.269470 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1572/3139] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:09:54 2022] DELETE /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:09:55.288056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bcb11a3d-54c1-4c81-90c1-042cad9ac486 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:55.290156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bcb11a3d-54c1-4c81-90c1-042cad9ac486 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:55.302896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcb11a3d-54c1-4c81-90c1-042cad9ac486 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:55.303740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcb11a3d-54c1-4c81-90c1-042cad9ac486 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:55.305437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcb11a3d-54c1-4c81-90c1-042cad9ac486 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:55.306797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcb11a3d-54c1-4c81-90c1-042cad9ac486 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:55.848400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bcb11a3d-54c1-4c81-90c1-042cad9ac486 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:55.857872 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bcb11a3d-54c1-4c81-90c1-042cad9ac486 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1516 microversion: 2.1 time: 0.580811 Aug 04 14:09:55.872968 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1573/3140] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:55 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1516 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:55.879194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ed66d138-ad8f-49dd-8bd9-9261de23a396 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:55.880105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ed66d138-ad8f-49dd-8bd9-9261de23a396 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:55.891724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed66d138-ad8f-49dd-8bd9-9261de23a396 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:55.893637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed66d138-ad8f-49dd-8bd9-9261de23a396 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:55.896451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed66d138-ad8f-49dd-8bd9-9261de23a396 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:55.901106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed66d138-ad8f-49dd-8bd9-9261de23a396 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:56.169401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:09:56.170161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:09:56.170817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:09:56.171370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:09:56.171986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:09:56.208429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ed66d138-ad8f-49dd-8bd9-9261de23a396 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:56.213353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:56.214210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:56.215117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:56.215734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:56.221933 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ed66d138-ad8f-49dd-8bd9-9261de23a396 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1293 microversion: 2.1 time: 0.346579 Aug 04 14:09:56.223170 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1574/3141] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:55 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1293 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:56.230368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c48c8664-f6d1-4f3c-90dc-e38080fa0f35 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:56.231012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c48c8664-f6d1-4f3c-90dc-e38080fa0f35 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:56.247127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c48c8664-f6d1-4f3c-90dc-e38080fa0f35 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:56.247587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c48c8664-f6d1-4f3c-90dc-e38080fa0f35 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:56.248409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c48c8664-f6d1-4f3c-90dc-e38080fa0f35 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:56.249106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c48c8664-f6d1-4f3c-90dc-e38080fa0f35 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:56.250691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:09:56.265853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for user d6f701d08c0741df9ad1375bd0712a59 and project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:09:56.297355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:09:56.304446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:09:56.371870 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-87c57871-e8a9-4aef-acde-5004a06041cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.586952 Aug 04 14:09:56.374184 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1568/3142] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:09:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:09:56.391301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-364719ec-1e09-4ddc-861a-4d2dfe420a0b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:56.392577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-364719ec-1e09-4ddc-861a-4d2dfe420a0b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:56.570895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-364719ec-1e09-4ddc-861a-4d2dfe420a0b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:56.600050 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-364719ec-1e09-4ddc-861a-4d2dfe420a0b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1215 microversion: 2.1 time: 0.217970 Aug 04 14:09:56.602108 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1569/3143] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:56 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:09:56.889298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6605387b-8123-4553-bfcf-acd8e0811012 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:56.891004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6605387b-8123-4553-bfcf-acd8e0811012 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:56.894657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c48c8664-f6d1-4f3c-90dc-e38080fa0f35 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:56.913856 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c48c8664-f6d1-4f3c-90dc-e38080fa0f35 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1527 microversion: 2.1 time: 0.688169 Aug 04 14:09:56.915872 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1575/3144] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:56 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1527 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:56.938833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6605387b-8123-4553-bfcf-acd8e0811012 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:56.942406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6605387b-8123-4553-bfcf-acd8e0811012 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:56.948612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6605387b-8123-4553-bfcf-acd8e0811012 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:56.954489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6605387b-8123-4553-bfcf-acd8e0811012 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:57.245838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-241665a8-8743-4626-9a56-4dcbc8cc15a2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:57.246830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-241665a8-8743-4626-9a56-4dcbc8cc15a2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:57.273549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-241665a8-8743-4626-9a56-4dcbc8cc15a2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:57.274298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-241665a8-8743-4626-9a56-4dcbc8cc15a2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:57.275382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-241665a8-8743-4626-9a56-4dcbc8cc15a2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:57.275925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-241665a8-8743-4626-9a56-4dcbc8cc15a2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:57.782510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6605387b-8123-4553-bfcf-acd8e0811012 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:57.795354 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6605387b-8123-4553-bfcf-acd8e0811012 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1516 microversion: 2.1 time: 0.914982 Aug 04 14:09:57.800472 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1570/3145] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:56 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1516 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:57.828905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5b328e0-5fd9-49a8-bef8-4fd97c4f39c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:57.828905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5b328e0-5fd9-49a8-bef8-4fd97c4f39c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:57.853536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5b328e0-5fd9-49a8-bef8-4fd97c4f39c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:57.858531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5b328e0-5fd9-49a8-bef8-4fd97c4f39c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:57.864290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5b328e0-5fd9-49a8-bef8-4fd97c4f39c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:57.865712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5b328e0-5fd9-49a8-bef8-4fd97c4f39c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:59.361917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-241665a8-8743-4626-9a56-4dcbc8cc15a2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:59.413999 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-241665a8-8743-4626-9a56-4dcbc8cc15a2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1293 microversion: 2.1 time: 2.172478 Aug 04 14:09:59.415016 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1576/3146] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:57 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1293 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:59.447168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-900ea4ea-5058-48f2-a68f-df535cecef4d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:59.450713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-900ea4ea-5058-48f2-a68f-df535cecef4d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:59.455828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5b328e0-5fd9-49a8-bef8-4fd97c4f39c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:09:59.461300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:09:59.500483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-900ea4ea-5058-48f2-a68f-df535cecef4d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:59.504164 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5b328e0-5fd9-49a8-bef8-4fd97c4f39c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1219 microversion: 2.1 time: 1.686537 Aug 04 14:09:59.505303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-900ea4ea-5058-48f2-a68f-df535cecef4d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:59.507440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-900ea4ea-5058-48f2-a68f-df535cecef4d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:59.509667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-900ea4ea-5058-48f2-a68f-df535cecef4d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:59.530792 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1571/3147] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:57 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1219 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:09:59.555232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3be8e206-0d67-4782-b012-9115a8ad1e4e req-c3cac726-fa8e-4f64-975c-d52fb2e0dccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383d7069-d26f-4b0c-b363-455fe8e5424b", "name": "network-vif-unplugged", "status": "completed", "tag": "16cad79f-fc8b-422b-b7c4-cba9a5b01afa"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:09:59.575391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3be8e206-0d67-4782-b012-9115a8ad1e4e req-c3cac726-fa8e-4f64-975c-d52fb2e0dccf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:59.576130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3be8e206-0d67-4782-b012-9115a8ad1e4e req-c3cac726-fa8e-4f64-975c-d52fb2e0dccf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:59.607937 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3be8e206-0d67-4782-b012-9115a8ad1e4e req-c3cac726-fa8e-4f64-975c-d52fb2e0dccf service nova] Creating event network-vif-unplugged:16cad79f-fc8b-422b-b7c4-cba9a5b01afa for instance 383d7069-d26f-4b0c-b363-455fe8e5424b on n-h1-844627-10 Aug 04 14:09:59.617514 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3be8e206-0d67-4782-b012-9115a8ad1e4e req-c3cac726-fa8e-4f64-975c-d52fb2e0dccf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084797 Aug 04 14:09:59.624316 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1572/3148] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:09:59.650879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a0ce30e0-9215-42c4-9c80-be8675204732 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:09:59.651621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a0ce30e0-9215-42c4-9c80-be8675204732 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:09:59.676315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0ce30e0-9215-42c4-9c80-be8675204732 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:59.676823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0ce30e0-9215-42c4-9c80-be8675204732 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:09:59.690149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0ce30e0-9215-42c4-9c80-be8675204732 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:09:59.690883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0ce30e0-9215-42c4-9c80-be8675204732 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:00.108115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a0ce30e0-9215-42c4-9c80-be8675204732 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:00.143911 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a0ce30e0-9215-42c4-9c80-be8675204732 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 200 len: 1474 microversion: 2.1 time: 0.511681 Aug 04 14:10:00.150803 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1573/3149] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:59 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:00.175595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-65a71858-cba6-42c0-a134-c951f20cd114 req-c3095453-ec2c-4b34-898c-3ef2c3d6310e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609f1a59-c11f-4ca1-8ba9-589f3e3845d8", "name": "network-vif-deleted", "tag": "2464df80-50f8-4d91-a4a0-99bd8b33b2d7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:00.215674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-65a71858-cba6-42c0-a134-c951f20cd114 req-c3095453-ec2c-4b34-898c-3ef2c3d6310e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:00.217189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-65a71858-cba6-42c0-a134-c951f20cd114 req-c3095453-ec2c-4b34-898c-3ef2c3d6310e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:00.260577 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-65a71858-cba6-42c0-a134-c951f20cd114 req-c3095453-ec2c-4b34-898c-3ef2c3d6310e service nova] Creating event network-vif-deleted:2464df80-50f8-4d91-a4a0-99bd8b33b2d7 for instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 on n-h2-844627-10 Aug 04 14:10:00.280235 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-65a71858-cba6-42c0-a134-c951f20cd114 req-c3095453-ec2c-4b34-898c-3ef2c3d6310e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119923 Aug 04 14:10:00.288433 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1574/3150] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:00.464917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e574b929-4626-4724-b60e-42def109f270 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:00.472623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e574b929-4626-4724-b60e-42def109f270 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:00.527945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e574b929-4626-4724-b60e-42def109f270 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:00.529904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e574b929-4626-4724-b60e-42def109f270 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:00.534199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e574b929-4626-4724-b60e-42def109f270 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:00.538118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e574b929-4626-4724-b60e-42def109f270 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:00.679770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-900ea4ea-5058-48f2-a68f-df535cecef4d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:00.704369 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-900ea4ea-5058-48f2-a68f-df535cecef4d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1527 microversion: 2.1 time: 1.285346 Aug 04 14:10:00.731565 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1577/3151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:09:59 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1527 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:00.756862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-88469f24-6c62-44af-a46d-a90fb4f1d169 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:00.758473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-88469f24-6c62-44af-a46d-a90fb4f1d169 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:00.785648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88469f24-6c62-44af-a46d-a90fb4f1d169 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:00.786652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88469f24-6c62-44af-a46d-a90fb4f1d169 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:00.800124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88469f24-6c62-44af-a46d-a90fb4f1d169 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:00.800703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88469f24-6c62-44af-a46d-a90fb4f1d169 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:00.882903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:01.444012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-88469f24-6c62-44af-a46d-a90fb4f1d169 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:01.462593 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-88469f24-6c62-44af-a46d-a90fb4f1d169 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1273 microversion: 2.1 time: 0.727971 Aug 04 14:10:01.463653 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1578/3152] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:00 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1273 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:01.476975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:01.483919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:01.493708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:01.494451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:01.495530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:01.496188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:01.518939 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 HTTP/1.1 Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '609f1a59-c11f-4ca1-8ba9-589f3e3845d8'} Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:01.521240 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e816797e-71c1-4895-a0b4-847d6374fc8c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 404 len: 111 microversion: 2.1 time: 0.058596 Aug 04 14:10:01.529899 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1579/3153] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:01 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:10:01.716659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e574b929-4626-4724-b60e-42def109f270 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:01.758767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51bcfc7e-38dd-4403-9e44-0a2af88073a3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:01.762422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-51bcfc7e-38dd-4403-9e44-0a2af88073a3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:01.788355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51bcfc7e-38dd-4403-9e44-0a2af88073a3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:01.788692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51bcfc7e-38dd-4403-9e44-0a2af88073a3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:01.788817 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e574b929-4626-4724-b60e-42def109f270 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1293 microversion: 2.1 time: 1.327967 Aug 04 14:10:01.789724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51bcfc7e-38dd-4403-9e44-0a2af88073a3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:01.797330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51bcfc7e-38dd-4403-9e44-0a2af88073a3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:01.819695 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1575/3154] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:00 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1293 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:10:01.848646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1445776213", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "2344a004-88b5-43d1-a0c7-ab45883f4f84"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:02.036082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] validate_networks() for [('2344a004-88b5-43d1-a0c7-ab45883f4f84', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:10:02.634843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-51bcfc7e-38dd-4403-9e44-0a2af88073a3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:02.648487 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-51bcfc7e-38dd-4403-9e44-0a2af88073a3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 200 len: 1527 microversion: 2.1 time: 0.903237 Aug 04 14:10:02.656390 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1580/3155] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:01 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 1527 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:02.674930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-4bc98af8-4ec0-4a72-b46b-1b00856a6fce req-40bf6534-74ec-4642-8784-ce9ee2529ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81bf9735-dc4f-4216-82db-a6e836669b81", "name": "network-vif-plugged", "status": "completed", "tag": "071f8975-48da-48be-876e-436a9c956685"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:02.715048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4bc98af8-4ec0-4a72-b46b-1b00856a6fce req-40bf6534-74ec-4642-8784-ce9ee2529ee7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:02.715560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4bc98af8-4ec0-4a72-b46b-1b00856a6fce req-40bf6534-74ec-4642-8784-ce9ee2529ee7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:02.782256 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-4bc98af8-4ec0-4a72-b46b-1b00856a6fce req-40bf6534-74ec-4642-8784-ce9ee2529ee7 service nova] Creating event network-vif-plugged:071f8975-48da-48be-876e-436a9c956685 for instance 81bf9735-dc4f-4216-82db-a6e836669b81 on n-h1-844627-10 Aug 04 14:10:02.807979 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-4bc98af8-4ec0-4a72-b46b-1b00856a6fce req-40bf6534-74ec-4642-8784-ce9ee2529ee7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145287 Aug 04 14:10:02.809297 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1581/3156] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:02.837789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49da22d9-2204-4714-8855-bc22fec1699b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:02.838656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49da22d9-2204-4714-8855-bc22fec1699b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:02.917731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49da22d9-2204-4714-8855-bc22fec1699b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:02.919696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49da22d9-2204-4714-8855-bc22fec1699b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:02.921765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49da22d9-2204-4714-8855-bc22fec1699b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:02.925390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49da22d9-2204-4714-8855-bc22fec1699b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:03.227093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-49da22d9-2204-4714-8855-bc22fec1699b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:03.274112 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49da22d9-2204-4714-8855-bc22fec1699b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1273 microversion: 2.1 time: 0.433104 Aug 04 14:10:03.285563 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1582/3157] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:02 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1273 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:03.311033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-baf34389-22ab-4ea2-92ae-c5c53483fec2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:03.314073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-baf34389-22ab-4ea2-92ae-c5c53483fec2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:03.369282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-baf34389-22ab-4ea2-92ae-c5c53483fec2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:03.372931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-baf34389-22ab-4ea2-92ae-c5c53483fec2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:03.378403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-baf34389-22ab-4ea2-92ae-c5c53483fec2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:03.381113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-baf34389-22ab-4ea2-92ae-c5c53483fec2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:04.622207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:10:04.623056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:10:04.623493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:10:04.624166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:10:04.625390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:10:04.627873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:04.667453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:04.668465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:04.675803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:04.676432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:04.755213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:10:04.785871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Getting quotas for user df576732ca5c442694d507fd4dc58279 and project 254dc59176414ac48f6827f95ffc907f. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:10:04.858130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:10:04.869539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:10:05.095337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-baf34389-22ab-4ea2-92ae-c5c53483fec2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:05.122623 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-baf34389-22ab-4ea2-92ae-c5c53483fec2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1293 microversion: 2.1 time: 1.832292 Aug 04 14:10:05.128135 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b06fae6a-689a-4e32-88e6-d8fe36ce35b7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.297672 Aug 04 14:10:05.131739 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1583/3158] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:03 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1293 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:05.154339 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1576/3159] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:10:05.167973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:05.170957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:05.181927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-9f937b27-7123-403f-af8d-0a21ec2a3e97 req-ca497e9f-ed37-454e-8405-e3e4bd101f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383d7069-d26f-4b0c-b363-455fe8e5424b", "name": "network-vif-deleted", "tag": "16cad79f-fc8b-422b-b7c4-cba9a5b01afa"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:05.193964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:05.195099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:05.196755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:05.197756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:05.247177 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:10:05.253826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9f937b27-7123-403f-af8d-0a21ec2a3e97 req-ca497e9f-ed37-454e-8405-e3e4bd101f94 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b HTTP/1.1 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '383d7069-d26f-4b0c-b363-455fe8e5424b'} Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:05.254792 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:10:05.259525 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-586be1df-8184-4ab4-af1a-72d40721fa39 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 404 len: 111 microversion: 2.1 time: 0.100288 Aug 04 14:10:05.263723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9f937b27-7123-403f-af8d-0a21ec2a3e97 req-ca497e9f-ed37-454e-8405-e3e4bd101f94 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:05.271832 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1577/3160] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:05 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:10:05.278126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c04dbdd6-7d9b-495f-9793-0c84fcb5a8e6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:05.279196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c04dbdd6-7d9b-495f-9793-0c84fcb5a8e6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:05.287999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c04dbdd6-7d9b-495f-9793-0c84fcb5a8e6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:05.288554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c04dbdd6-7d9b-495f-9793-0c84fcb5a8e6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:05.289342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c04dbdd6-7d9b-495f-9793-0c84fcb5a8e6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:05.289826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c04dbdd6-7d9b-495f-9793-0c84fcb5a8e6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:05.294422 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-9f937b27-7123-403f-af8d-0a21ec2a3e97 req-ca497e9f-ed37-454e-8405-e3e4bd101f94 service nova] Creating event network-vif-deleted:16cad79f-fc8b-422b-b7c4-cba9a5b01afa for instance 383d7069-d26f-4b0c-b363-455fe8e5424b on n-h1-844627-10 Aug 04 14:10:05.337430 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-9f937b27-7123-403f-af8d-0a21ec2a3e97 req-ca497e9f-ed37-454e-8405-e3e4bd101f94 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195349 Aug 04 14:10:05.339122 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1584/3161] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:05.363914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7976616f-f4e6-4616-865e-4348d6e0c5cb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:05.365695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7976616f-f4e6-4616-865e-4348d6e0c5cb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:05.608948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7976616f-f4e6-4616-865e-4348d6e0c5cb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:05.628052 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7976616f-f4e6-4616-865e-4348d6e0c5cb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1209 microversion: 2.1 time: 0.284299 Aug 04 14:10:05.631267 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1585/3162] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:05 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1209 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:05.647652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e2f51b77-cb9f-41b8-891b-199e7336a6cb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'create', calling method: .version_select at 0x7f4700688310>, body: {"keypair": {"name": "tempest-keypair-1980382781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3GPoAWhh4v48YPlGe6K4i5319UeXnGPbftoV/8y7UQdfArFK3hPvrb2USQHVh+h49DSk+blbM3pAhf50QIbz3M5wSiIiJ1ZQ0hjydHwFqM8Fqq/M0YnJ1j2n0B6XmaYw=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:05.682633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e2f51b77-cb9f-41b8-891b-199e7336a6cb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Getting quotas for project 786fea7d4481410d9591a181521c1eb4. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:10:05.691507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e2f51b77-cb9f-41b8-891b-199e7336a6cb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Getting quotas for user f648ba00abbe4679a43d65bc925da013 and project 786fea7d4481410d9591a181521c1eb4. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:10:05.737531 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e2f51b77-cb9f-41b8-891b-199e7336a6cb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103645 Aug 04 14:10:05.738170 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1586/3163] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:10:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:06.137287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c04dbdd6-7d9b-495f-9793-0c84fcb5a8e6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:06.165854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-abba4b90-d2e8-4bee-8800-3e3c1ed2b32a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:06.168484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-abba4b90-d2e8-4bee-8800-3e3c1ed2b32a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:06.188825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abba4b90-d2e8-4bee-8800-3e3c1ed2b32a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:06.189452 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c04dbdd6-7d9b-495f-9793-0c84fcb5a8e6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1315 microversion: 2.1 time: 0.916250 Aug 04 14:10:06.190677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abba4b90-d2e8-4bee-8800-3e3c1ed2b32a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:06.192125 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1578/3164] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:05 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1315 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:06.192616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abba4b90-d2e8-4bee-8800-3e3c1ed2b32a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:06.193676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abba4b90-d2e8-4bee-8800-3e3c1ed2b32a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:06.504361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f77814d9-7bd6-4eba-a27e-920935551e34 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Action: 'create', calling method: .version_select at 0x7f47055484c0>, body: {"keypair": {"name": "tempest-keypair-1114232288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaLhOLxPth0jiWyCBcxcXGRj6Z5Eqj8gD5gbMr7syZyxMpzcWLR+QegmrzeR+ISaODmJeHOQ5LLUN4yHhqwaypqycZ7l8zjgAcpx9XO+RQgTjmHTi0VUCvI1yprYNlFuA=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:06.559209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f77814d9-7bd6-4eba-a27e-920935551e34 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Getting quotas for project 17f67c0fa1a843dfbcd3e6331300f7eb. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:10:06.580431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f77814d9-7bd6-4eba-a27e-920935551e34 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Getting quotas for user e89f60598ac944adb41d17059b568de9 and project 17f67c0fa1a843dfbcd3e6331300f7eb. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:10:06.655141 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f77814d9-7bd6-4eba-a27e-920935551e34 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.156224 Aug 04 14:10:06.655914 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1579/3165] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 14:10:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 04 14:10:06.675341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cbfe3a13-7b2c-4b8b-83e5-85e7a2615762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:06.680594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cbfe3a13-7b2c-4b8b-83e5-85e7a2615762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:06.697837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbfe3a13-7b2c-4b8b-83e5-85e7a2615762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:06.698515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbfe3a13-7b2c-4b8b-83e5-85e7a2615762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:06.699484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbfe3a13-7b2c-4b8b-83e5-85e7a2615762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:06.701706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbfe3a13-7b2c-4b8b-83e5-85e7a2615762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:07.094212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cbfe3a13-7b2c-4b8b-83e5-85e7a2615762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:07.134516 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cbfe3a13-7b2c-4b8b-83e5-85e7a2615762 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1213 microversion: 2.1 time: 0.464353 Aug 04 14:10:07.145682 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1580/3166] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:06 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1213 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:07.237233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fce5a331-1ca3-4550-b0a0-67ab68e8edb7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:07.257380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fce5a331-1ca3-4550-b0a0-67ab68e8edb7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:07.311248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fce5a331-1ca3-4550-b0a0-67ab68e8edb7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:07.326222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fce5a331-1ca3-4550-b0a0-67ab68e8edb7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:07.333057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fce5a331-1ca3-4550-b0a0-67ab68e8edb7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:07.334730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fce5a331-1ca3-4550-b0a0-67ab68e8edb7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:07.557719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-abba4b90-d2e8-4bee-8800-3e3c1ed2b32a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:07.600989 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-abba4b90-d2e8-4bee-8800-3e3c1ed2b32a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1483 microversion: 2.1 time: 1.452147 Aug 04 14:10:07.606642 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1587/3167] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:06 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1483 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:10:07.637684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4748dbdf-61a5-4bf7-874a-999325ce7548 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:07.638230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4748dbdf-61a5-4bf7-874a-999325ce7548 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:07.652705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4748dbdf-61a5-4bf7-874a-999325ce7548 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:07.653697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4748dbdf-61a5-4bf7-874a-999325ce7548 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:07.656764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4748dbdf-61a5-4bf7-874a-999325ce7548 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:07.658654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4748dbdf-61a5-4bf7-874a-999325ce7548 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:09.043994 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4748dbdf-61a5-4bf7-874a-999325ce7548 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.411812 Aug 04 14:10:09.045353 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1588/3168] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:10:07 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81/os-interface => generated 285 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:10:09.050381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e6f23777-e445-490b-a46b-615bc958816e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:09.051297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e6f23777-e445-490b-a46b-615bc958816e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:09.092236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6f23777-e445-490b-a46b-615bc958816e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:09.107480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6f23777-e445-490b-a46b-615bc958816e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:09.109443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6f23777-e445-490b-a46b-615bc958816e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:09.115770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6f23777-e445-490b-a46b-615bc958816e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:09.304173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fce5a331-1ca3-4550-b0a0-67ab68e8edb7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:09.329114 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fce5a331-1ca3-4550-b0a0-67ab68e8edb7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1315 microversion: 2.1 time: 2.103251 Aug 04 14:10:09.331383 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1581/3169] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:07 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1315 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:09.849658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e6f23777-e445-490b-a46b-615bc958816e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:09.861301 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e6f23777-e445-490b-a46b-615bc958816e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1267 microversion: 2.1 time: 0.814572 Aug 04 14:10:09.866431 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1589/3170] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:09 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1267 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:10.374278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc52ba3d-b5d3-4292-a6d4-ea01de9b4638 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:10.375466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc52ba3d-b5d3-4292-a6d4-ea01de9b4638 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:10.395532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc52ba3d-b5d3-4292-a6d4-ea01de9b4638 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:10.397187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc52ba3d-b5d3-4292-a6d4-ea01de9b4638 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:10.399674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc52ba3d-b5d3-4292-a6d4-ea01de9b4638 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:10.401247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc52ba3d-b5d3-4292-a6d4-ea01de9b4638 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:10.905065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-649aaff7-a5b2-44b4-8f7b-a6a335a071fd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:10.909643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-649aaff7-a5b2-44b4-8f7b-a6a335a071fd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:10.935175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-649aaff7-a5b2-44b4-8f7b-a6a335a071fd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:10.937363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-649aaff7-a5b2-44b4-8f7b-a6a335a071fd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:10.941929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-649aaff7-a5b2-44b4-8f7b-a6a335a071fd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:10.943621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-649aaff7-a5b2-44b4-8f7b-a6a335a071fd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:11.319613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-649aaff7-a5b2-44b4-8f7b-a6a335a071fd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:11.344852 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-649aaff7-a5b2-44b4-8f7b-a6a335a071fd tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1267 microversion: 2.1 time: 0.457549 Aug 04 14:10:11.357134 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1590/3171] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:10 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1267 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:11.357134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-188d77fe-adf2-440f-afb8-d87c08783286 req-b67f7dfa-c8b6-4f7d-b8d8-23e9ec91bdb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5cabc6-32b3-4ac9-a320-a293f5d8c27a", "tag": "c906b592-45e5-4118-861b-b643b3afbd49"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:11.395618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-188d77fe-adf2-440f-afb8-d87c08783286 req-b67f7dfa-c8b6-4f7d-b8d8-23e9ec91bdb4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:11.396230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-188d77fe-adf2-440f-afb8-d87c08783286 req-b67f7dfa-c8b6-4f7d-b8d8-23e9ec91bdb4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:11.441738 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-188d77fe-adf2-440f-afb8-d87c08783286 req-b67f7dfa-c8b6-4f7d-b8d8-23e9ec91bdb4 service nova] Creating event network-changed:c906b592-45e5-4118-861b-b643b3afbd49 for instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a on n-h1-844627-10 Aug 04 14:10:11.459467 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-188d77fe-adf2-440f-afb8-d87c08783286 req-b67f7dfa-c8b6-4f7d-b8d8-23e9ec91bdb4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109644 Aug 04 14:10:11.460696 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1591/3172] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:11.480367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc52ba3d-b5d3-4292-a6d4-ea01de9b4638 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:11.493095 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc52ba3d-b5d3-4292-a6d4-ea01de9b4638 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1315 microversion: 2.1 time: 1.131899 Aug 04 14:10:11.494331 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1582/3173] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:10 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1315 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:10:11.546883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1252451234", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0fa6bc4c-f14d-46ba-b912-0e17a342dee8"}, {"port": "53371ea6-c477-434e-80e6-d6459f75d410", "tag": "port-1"}, {"port": "f7228146-595d-4471-81a4-ebb2865b8ff6", "tag": "port-2"}, {"uuid": "5e6ed34c-5048-4410-b1a7-7e1ab3fd750b", "tag": "net-1"}, {"uuid": "5e6ed34c-5048-4410-b1a7-7e1ab3fd750b"}, {"uuid": "bfa785cf-2a71-4131-8654-423c717da03d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "bfa785cf-2a71-4131-8654-423c717da03d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "81ffaef8-09ba-4053-9622-688dff5a0680", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "943dfdf4-52f2-487c-9985-17f6e88d6be5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f51955ec-89d1-4b6c-96e6-37c683f420ae", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1115560747"}], "key_name": "tempest-keypair-1114232288", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:11.563333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:11.880093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] validate_networks() for [('0fa6bc4c-f14d-46ba-b912-0e17a342dee8', None, None, None, None, None), (None, None, '53371ea6-c477-434e-80e6-d6459f75d410', None, None, None), (None, None, 'f7228146-595d-4471-81a4-ebb2865b8ff6', None, None, None), ('5e6ed34c-5048-4410-b1a7-7e1ab3fd750b', None, None, None, None, None), ('5e6ed34c-5048-4410-b1a7-7e1ab3fd750b', None, None, None, None, None), ('bfa785cf-2a71-4131-8654-423c717da03d', '10.2.2.100', None, None, None, None), ('bfa785cf-2a71-4131-8654-423c717da03d', '10.2.2.200', None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:10:12.387499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b7010c59-9589-4748-b305-2d5fbce7f875 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:12.395685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b7010c59-9589-4748-b305-2d5fbce7f875 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:12.420002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7010c59-9589-4748-b305-2d5fbce7f875 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:12.421159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7010c59-9589-4748-b305-2d5fbce7f875 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:12.422757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7010c59-9589-4748-b305-2d5fbce7f875 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:12.423871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7010c59-9589-4748-b305-2d5fbce7f875 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:12.788021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b7010c59-9589-4748-b305-2d5fbce7f875 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:12.811932 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b7010c59-9589-4748-b305-2d5fbce7f875 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1267 microversion: 2.1 time: 0.431962 Aug 04 14:10:12.813410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1583/3174] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:12 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1267 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:10:12.825031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6bdc2919-877d-4f83-b6a0-4913bada8695 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:12.826188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6bdc2919-877d-4f83-b6a0-4913bada8695 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:12.837688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bdc2919-877d-4f83-b6a0-4913bada8695 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:12.838829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bdc2919-877d-4f83-b6a0-4913bada8695 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:12.840579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bdc2919-877d-4f83-b6a0-4913bada8695 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:12.841595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bdc2919-877d-4f83-b6a0-4913bada8695 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:14.041892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6bdc2919-877d-4f83-b6a0-4913bada8695 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:14.056208 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6bdc2919-877d-4f83-b6a0-4913bada8695 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1315 microversion: 2.1 time: 1.240050 Aug 04 14:10:14.059663 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1584/3175] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:12 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1315 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:14.092673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-270295056", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:14.247368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] validate_networks() for [('6821352e-0edb-41d3-8a4b-8a3f25fef7a8', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:10:14.709824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:15.622710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:10:15.623688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:10:15.623688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:10:15.624007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:10:15.624290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:10:15.641169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:15.641920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:15.643121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:15.643807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:15.670636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Getting quotas for project 786fea7d4481410d9591a181521c1eb4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:10:15.684647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Getting quotas for user f648ba00abbe4679a43d65bc925da013 and project 786fea7d4481410d9591a181521c1eb4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:10:15.705965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:15.711955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:10:15.715505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:10:15.815151 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2eb1ab9f-f526-4176-a010-15e28ee5e5f7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.748472 Aug 04 14:10:15.816458 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1585/3176] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:10:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:10:15.844259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-000f1526-d064-4444-b554-66a05cfeb14c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:15.847583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-000f1526-d064-4444-b554-66a05cfeb14c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:15.883936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-000f1526-d064-4444-b554-66a05cfeb14c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:15.885928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-000f1526-d064-4444-b554-66a05cfeb14c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:15.904996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-000f1526-d064-4444-b554-66a05cfeb14c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:15.905862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-000f1526-d064-4444-b554-66a05cfeb14c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:16.561705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-000f1526-d064-4444-b554-66a05cfeb14c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:16.584654 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-000f1526-d064-4444-b554-66a05cfeb14c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1309 microversion: 2.1 time: 0.761147 Aug 04 14:10:16.598089 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1586/3177] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:15 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1309 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:17.194352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-af6d939d-df3a-4386-a020-1e02945a1160 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Calling method '.version_select at 0x7f470555f4c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:17.225216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af6d939d-df3a-4386-a020-1e02945a1160 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:17.225885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af6d939d-df3a-4386-a020-1e02945a1160 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:17.228825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af6d939d-df3a-4386-a020-1e02945a1160 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:17.229902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af6d939d-df3a-4386-a020-1e02945a1160 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:17.281707 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-af6d939d-df3a-4386-a020-1e02945a1160 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] 10.222.0.66 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.670824 Aug 04 14:10:17.284212 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1587/3178] 10.222.0.66 () {58 vars in 1122 bytes} [Thu Aug 4 14:10:16 2022] GET /compute/v2.1/limits => generated 511 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:17.296806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-63780c8a-ecbd-489c-9154-50bd3beebb7a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:17.299201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-63780c8a-ecbd-489c-9154-50bd3beebb7a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:17.320089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63780c8a-ecbd-489c-9154-50bd3beebb7a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:17.321442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63780c8a-ecbd-489c-9154-50bd3beebb7a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:17.323314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63780c8a-ecbd-489c-9154-50bd3beebb7a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:17.325012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63780c8a-ecbd-489c-9154-50bd3beebb7a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:17.933929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-63780c8a-ecbd-489c-9154-50bd3beebb7a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:17.945785 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-63780c8a-ecbd-489c-9154-50bd3beebb7a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1483 microversion: 2.1 time: 0.659150 Aug 04 14:10:17.946851 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1588/3179] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:17 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1483 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:17.977410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-8852ad22-8add-4de6-9414-60c0c5910c01 req-d30319fb-6cd8-4db9-a8ea-3f9f884c3452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81bf9735-dc4f-4216-82db-a6e836669b81", "tag": "071f8975-48da-48be-876e-436a9c956685"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:18.000116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8852ad22-8add-4de6-9414-60c0c5910c01 req-d30319fb-6cd8-4db9-a8ea-3f9f884c3452 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:18.002594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8852ad22-8add-4de6-9414-60c0c5910c01 req-d30319fb-6cd8-4db9-a8ea-3f9f884c3452 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:18.041509 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-8852ad22-8add-4de6-9414-60c0c5910c01 req-d30319fb-6cd8-4db9-a8ea-3f9f884c3452 service nova] Creating event network-changed:071f8975-48da-48be-876e-436a9c956685 for instance 81bf9735-dc4f-4216-82db-a6e836669b81 on n-h1-844627-10 Aug 04 14:10:18.056698 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-8852ad22-8add-4de6-9414-60c0c5910c01 req-d30319fb-6cd8-4db9-a8ea-3f9f884c3452 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094856 Aug 04 14:10:18.059892 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1589/3180] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:18.072295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-180c4a60-dfb7-438c-9117-800ec6038f58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:18.084022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-180c4a60-dfb7-438c-9117-800ec6038f58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:18.122027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-180c4a60-dfb7-438c-9117-800ec6038f58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:18.123130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-180c4a60-dfb7-438c-9117-800ec6038f58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:18.125133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-180c4a60-dfb7-438c-9117-800ec6038f58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:18.126311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-180c4a60-dfb7-438c-9117-800ec6038f58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:18.976100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-180c4a60-dfb7-438c-9117-800ec6038f58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:19.003105 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-180c4a60-dfb7-438c-9117-800ec6038f58 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1315 microversion: 2.1 time: 0.938514 Aug 04 14:10:19.004974 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1590/3181] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:18 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:19.031021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-196bc36b-7d3e-4233-92ed-2a807e163e12 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:19.032355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-196bc36b-7d3e-4233-92ed-2a807e163e12 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:19.039863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-196bc36b-7d3e-4233-92ed-2a807e163e12 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:19.040453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-196bc36b-7d3e-4233-92ed-2a807e163e12 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:19.041563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-196bc36b-7d3e-4233-92ed-2a807e163e12 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:19.042240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-196bc36b-7d3e-4233-92ed-2a807e163e12 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:19.192053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-196bc36b-7d3e-4233-92ed-2a807e163e12 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:19.210218 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-196bc36b-7d3e-4233-92ed-2a807e163e12 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1282 microversion: 2.1 time: 0.203108 Aug 04 14:10:19.210976 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1591/3182] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:19 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1282 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:19.216793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c2681434-6fd3-4882-81e4-eaa7e53450a1 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-67656254", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:19.302325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-c2681434-6fd3-4882-81e4-eaa7e53450a1 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:10:19.924923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c2681434-6fd3-4882-81e4-eaa7e53450a1 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Getting quotas for project b96818db73d1466192cefb6a1d8564c3. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:10:19.935830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c2681434-6fd3-4882-81e4-eaa7e53450a1 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Getting quotas for user d4e0aef93b0c4a69bd90fb7f0542217c and project b96818db73d1466192cefb6a1d8564c3. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:10:19.964573 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-c2681434-6fd3-4882-81e4-eaa7e53450a1 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c2681434-6fd3-4882-81e4-eaa7e53450a1 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Request method failure captured: Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 1750 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69NFS-xKMGjfhHeY4kstqr7S8gV3qYGukNW7IYC4JNTdBKk6XzZXOPY_PX9kyJMYl2vxe0ofAXproVbq1somNlxzgZqtUa8lVH6kIqpdaXlc6QzSUjWeJR6jD9XnUCXuvD0d2Tca0W7dlIIiY9CBlhXJnwWJFucmxhxh3fhTNcOBX-0 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: b96818db73d1466192cefb6a1d8564c3 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-947764379 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b96818db73d1466192cefb6a1d8564c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b96818db73d1466192cefb6a1d8564c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b96818db73d1466192cefb6a1d8564c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b96818db73d1466192cefb6a1d8564c3"}]}] Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-947764379 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: b96818db73d1466192cefb6a1d8564c3 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-947764379 Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-947764379-project Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d4e0aef93b0c4a69bd90fb7f0542217c Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-947764379-project Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-67656254", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:10:19.968995 n-d-844627-10 devstack@n-api.service[130960]: exception: Maximum number of metadata items exceeds 128 Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-67656254', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:10:19.972724 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c2681434-6fd3-4882-81e4-eaa7e53450a1 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c2681434-6fd3-4882-81e4-eaa7e53450a1 tempest-AbsoluteLimitsNegativeTestJSON-947764379 tempest-AbsoluteLimitsNegativeTestJSON-947764379-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.759212 Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1592/3183] 10.222.0.66 () {60 vars in 1148 bytes} [Thu Aug 4 14:10:19 2022] POST /compute/v2.1/servers => generated 87 bytes in 761 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f4b05de9-26cf-446c-8ecf-0e6e9f90cddb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:19.987282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f4b05de9-26cf-446c-8ecf-0e6e9f90cddb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:19.997022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4b05de9-26cf-446c-8ecf-0e6e9f90cddb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:19.997022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4b05de9-26cf-446c-8ecf-0e6e9f90cddb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:19.998760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4b05de9-26cf-446c-8ecf-0e6e9f90cddb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:20.000216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4b05de9-26cf-446c-8ecf-0e6e9f90cddb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:20.457448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f4b05de9-26cf-446c-8ecf-0e6e9f90cddb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:20.496179 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f4b05de9-26cf-446c-8ecf-0e6e9f90cddb tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1309 microversion: 2.1 time: 0.521053 Aug 04 14:10:20.502792 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1593/3184] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:19 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1309 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:20.515693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3a1a3cc-a173-435f-844f-f9a10388aeb7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "107b8ec3-dca5-44de-9414-8c9d1f690bf2"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:20.522832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3a1a3cc-a173-435f-844f-f9a10388aeb7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:20.539848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3a1a3cc-a173-435f-844f-f9a10388aeb7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:20.541104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3a1a3cc-a173-435f-844f-f9a10388aeb7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:20.543406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3a1a3cc-a173-435f-844f-f9a10388aeb7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:20.544763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3a1a3cc-a173-435f-844f-f9a10388aeb7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:20.866879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:10:20.867788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:10:20.867788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:10:20.868162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:10:20.880805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:10:20.909372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:20.913062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:20.914947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:20.915704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:20.966891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Getting quotas for project 17f67c0fa1a843dfbcd3e6331300f7eb. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:10:20.987341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Getting quotas for user e89f60598ac944adb41d17059b568de9 and project 17f67c0fa1a843dfbcd3e6331300f7eb. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:10:21.136416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:21.359192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:10:21.362290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='81ffaef8-09ba-4053-9622-688dff5a0680',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='943dfdf4-52f2-487c-9985-17f6e88d6be5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f51955ec-89d1-4b6c-96e6-37c683f420ae',volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:10:21.563127 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3a1a3cc-a173-435f-844f-f9a10388aeb7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.056441 Aug 04 14:10:21.584121 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1594/3185] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:10:20 2022] POST /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 194 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:21.650623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-66e445fa-82ae-4127-8a46-a80544c5e1b2 req-5f086833-f357-4f7f-8ca1-496cc939a96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5cabc6-32b3-4ac9-a320-a293f5d8c27a", "name": "network-vif-plugged", "status": "completed", "tag": "c906b592-45e5-4118-861b-b643b3afbd49"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:21.754684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-66e445fa-82ae-4127-8a46-a80544c5e1b2 req-5f086833-f357-4f7f-8ca1-496cc939a96b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:21.756108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-66e445fa-82ae-4127-8a46-a80544c5e1b2 req-5f086833-f357-4f7f-8ca1-496cc939a96b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:21.821041 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-66e445fa-82ae-4127-8a46-a80544c5e1b2 req-5f086833-f357-4f7f-8ca1-496cc939a96b service nova] Creating event network-vif-plugged:c906b592-45e5-4118-861b-b643b3afbd49 for instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a on n-h1-844627-10 Aug 04 14:10:21.839836 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-66e445fa-82ae-4127-8a46-a80544c5e1b2 req-5f086833-f357-4f7f-8ca1-496cc939a96b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239666 Aug 04 14:10:21.843682 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1595/3186] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:21.856647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0b325bba-d3b7-4204-b4e4-00abe96ec5cc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:21.858624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0b325bba-d3b7-4204-b4e4-00abe96ec5cc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:21.877646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b325bba-d3b7-4204-b4e4-00abe96ec5cc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:21.879705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b325bba-d3b7-4204-b4e4-00abe96ec5cc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:21.880682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b325bba-d3b7-4204-b4e4-00abe96ec5cc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:21.886993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b325bba-d3b7-4204-b4e4-00abe96ec5cc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:22.341233 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7f3015d0-85ee-406f-b0b1-badb116eb3b5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 10.798826 Aug 04 14:10:22.343164 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1592/3187] 10.222.0.66 () {62 vars in 1189 bytes} [Thu Aug 4 14:10:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 10802 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:10:22.365719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6cb858c6-8d33-40d2-b6a9-7234b9b08d57 req-4b7eea67-abdb-4808-9e13-3da4db285e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b00e80b-401a-4efe-b5cd-d79b6f1fe587", "tag": "db0b7e55-abab-4576-9d30-7da64a519e8c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:22.406629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6cb858c6-8d33-40d2-b6a9-7234b9b08d57 req-4b7eea67-abdb-4808-9e13-3da4db285e9c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:22.410519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6cb858c6-8d33-40d2-b6a9-7234b9b08d57 req-4b7eea67-abdb-4808-9e13-3da4db285e9c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:22.455909 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6cb858c6-8d33-40d2-b6a9-7234b9b08d57 req-4b7eea67-abdb-4808-9e13-3da4db285e9c service nova] Creating event network-changed:db0b7e55-abab-4576-9d30-7da64a519e8c for instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 on n-h2-844627-10 Aug 04 14:10:22.468508 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6cb858c6-8d33-40d2-b6a9-7234b9b08d57 req-4b7eea67-abdb-4808-9e13-3da4db285e9c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123797 Aug 04 14:10:22.469582 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1593/3188] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:22.489377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c70f31e4-e37a-468c-ba85-2ea1bc7f932c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:22.493800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c70f31e4-e37a-468c-ba85-2ea1bc7f932c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:22.504657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c70f31e4-e37a-468c-ba85-2ea1bc7f932c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:22.505676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c70f31e4-e37a-468c-ba85-2ea1bc7f932c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:22.508609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c70f31e4-e37a-468c-ba85-2ea1bc7f932c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:22.509730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c70f31e4-e37a-468c-ba85-2ea1bc7f932c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:23.506083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0b325bba-d3b7-4204-b4e4-00abe96ec5cc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:23.547959 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0b325bba-d3b7-4204-b4e4-00abe96ec5cc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1315 microversion: 2.1 time: 1.699028 Aug 04 14:10:23.555545 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1596/3189] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:21 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1315 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:23.581490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6315c4a3-2df3-412f-9cc5-bbe3555d7036 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:23.588532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6315c4a3-2df3-412f-9cc5-bbe3555d7036 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:23.622751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6315c4a3-2df3-412f-9cc5-bbe3555d7036 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:23.627876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6315c4a3-2df3-412f-9cc5-bbe3555d7036 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:23.629975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6315c4a3-2df3-412f-9cc5-bbe3555d7036 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:23.635286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6315c4a3-2df3-412f-9cc5-bbe3555d7036 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:24.349438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c70f31e4-e37a-468c-ba85-2ea1bc7f932c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:24.385012 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c70f31e4-e37a-468c-ba85-2ea1bc7f932c tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1324 microversion: 2.1 time: 1.911079 Aug 04 14:10:24.388851 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1594/3190] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:22 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1324 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:24.415375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4774fb58-89f3-48b7-be4f-95438c4a5947 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:24.416452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4774fb58-89f3-48b7-be4f-95438c4a5947 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:24.795091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6315c4a3-2df3-412f-9cc5-bbe3555d7036 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:24.823927 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6315c4a3-2df3-412f-9cc5-bbe3555d7036 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1309 microversion: 2.1 time: 1.264811 Aug 04 14:10:24.827856 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1597/3191] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:23 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1309 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:24.834556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86670397-f9d6-47f7-a826-91f2f27a4311 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:24.835746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-86670397-f9d6-47f7-a826-91f2f27a4311 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:24.865715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86670397-f9d6-47f7-a826-91f2f27a4311 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:24.867189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86670397-f9d6-47f7-a826-91f2f27a4311 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:24.869857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86670397-f9d6-47f7-a826-91f2f27a4311 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:24.877370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86670397-f9d6-47f7-a826-91f2f27a4311 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:25.406796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4774fb58-89f3-48b7-be4f-95438c4a5947 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:25.431717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4774fb58-89f3-48b7-be4f-95438c4a5947 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:25.435843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4774fb58-89f3-48b7-be4f-95438c4a5947 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:25.446446 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4774fb58-89f3-48b7-be4f-95438c4a5947 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1286 microversion: 2.32 time: 1.048273 Aug 04 14:10:25.446999 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1595/3192] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:24 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1286 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:25.459680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-706ea283-09ed-4e95-b383-46233be7c7fc tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:25.462148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-706ea283-09ed-4e95-b383-46233be7c7fc tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:25.487215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706ea283-09ed-4e95-b383-46233be7c7fc tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:25.488022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706ea283-09ed-4e95-b383-46233be7c7fc tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:25.489303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706ea283-09ed-4e95-b383-46233be7c7fc tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:25.489978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706ea283-09ed-4e95-b383-46233be7c7fc tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:25.671632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-86670397-f9d6-47f7-a826-91f2f27a4311 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:25.695250 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86670397-f9d6-47f7-a826-91f2f27a4311 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1501 microversion: 2.1 time: 0.862588 Aug 04 14:10:25.711708 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1598/3193] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:24 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1501 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:25.723786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-af0e91ff-46f2-4adb-85a3-91128671ea57 req-0fb2ad44-a272-40ee-a96b-d0a4e827df28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac958b6-3fe8-4be4-95e7-2ac0be29c97a", "tag": "ae3a02ea-3e3e-4646-9115-47c84a95edb5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:25.741148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-af0e91ff-46f2-4adb-85a3-91128671ea57 req-0fb2ad44-a272-40ee-a96b-d0a4e827df28 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:25.744317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-af0e91ff-46f2-4adb-85a3-91128671ea57 req-0fb2ad44-a272-40ee-a96b-d0a4e827df28 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:25.766854 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-af0e91ff-46f2-4adb-85a3-91128671ea57 req-0fb2ad44-a272-40ee-a96b-d0a4e827df28 service nova] Creating event network-changed:ae3a02ea-3e3e-4646-9115-47c84a95edb5 for instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a on n-h1-844627-10 Aug 04 14:10:25.776245 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-af0e91ff-46f2-4adb-85a3-91128671ea57 req-0fb2ad44-a272-40ee-a96b-d0a4e827df28 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062561 Aug 04 14:10:25.778012 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1599/3194] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:25.787941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-224bfb08-f400-4867-95c3-d34685a2f4fd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:25.788958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-224bfb08-f400-4867-95c3-d34685a2f4fd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:25.799075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-224bfb08-f400-4867-95c3-d34685a2f4fd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:25.800428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-224bfb08-f400-4867-95c3-d34685a2f4fd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:25.801525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-224bfb08-f400-4867-95c3-d34685a2f4fd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:25.802324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-224bfb08-f400-4867-95c3-d34685a2f4fd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:25.861811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-224bfb08-f400-4867-95c3-d34685a2f4fd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lazy-loading 'flavor' on Instance uuid da5cabc6-32b3-4ac9-a320-a293f5d8c27a {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:10:26.509744 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-224bfb08-f400-4867-95c3-d34685a2f4fd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a/action" status: 202 len: 0 microversion: 2.1 time: 0.729354 Aug 04 14:10:26.511708 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1600/3195] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:10:25 2022] POST /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:10:26.570217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2411824-1f63-4d54-8c60-ca8778c6859a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:26.579425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d2411824-1f63-4d54-8c60-ca8778c6859a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:26.612300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2411824-1f63-4d54-8c60-ca8778c6859a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:26.615633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2411824-1f63-4d54-8c60-ca8778c6859a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:26.620828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2411824-1f63-4d54-8c60-ca8778c6859a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:26.622159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2411824-1f63-4d54-8c60-ca8778c6859a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:26.653452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-706ea283-09ed-4e95-b383-46233be7c7fc tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:26.686301 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-706ea283-09ed-4e95-b383-46233be7c7fc tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1324 microversion: 2.1 time: 1.235150 Aug 04 14:10:26.714762 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1596/3196] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:25 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1324 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:26.740500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b2609377-30e7-45f4-b8ee-13bd6dd216e3 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:26.744243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b2609377-30e7-45f4-b8ee-13bd6dd216e3 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:27.055769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b2609377-30e7-45f4-b8ee-13bd6dd216e3 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:27.074158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b2609377-30e7-45f4-b8ee-13bd6dd216e3 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:27.078173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b2609377-30e7-45f4-b8ee-13bd6dd216e3 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:27.087642 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b2609377-30e7-45f4-b8ee-13bd6dd216e3 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1286 microversion: 2.32 time: 0.363985 Aug 04 14:10:27.088619 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1597/3197] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:26 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1286 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:27.110673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-319cfe53-a053-4a18-bbfa-d4405ff44c01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:27.111532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-319cfe53-a053-4a18-bbfa-d4405ff44c01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:27.121604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319cfe53-a053-4a18-bbfa-d4405ff44c01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:27.126975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319cfe53-a053-4a18-bbfa-d4405ff44c01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:27.128275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319cfe53-a053-4a18-bbfa-d4405ff44c01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:27.130105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319cfe53-a053-4a18-bbfa-d4405ff44c01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:27.255143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:28.412669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d2411824-1f63-4d54-8c60-ca8778c6859a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:28.427163 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2411824-1f63-4d54-8c60-ca8778c6859a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1309 microversion: 2.1 time: 1.895055 Aug 04 14:10:28.440952 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1601/3198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:26 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1309 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:28.449530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2be898ec-f133-4d0b-957e-1391f2977f65 req-47da0433-cea0-444b-a522-44344b34b923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b00e80b-401a-4efe-b5cd-d79b6f1fe587", "name": "network-vif-plugged", "status": "completed", "tag": "db0b7e55-abab-4576-9d30-7da64a519e8c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:28.472253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:28.477253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2be898ec-f133-4d0b-957e-1391f2977f65 req-47da0433-cea0-444b-a522-44344b34b923 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:28.477786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2be898ec-f133-4d0b-957e-1391f2977f65 req-47da0433-cea0-444b-a522-44344b34b923 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:28.530920 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2be898ec-f133-4d0b-957e-1391f2977f65 req-47da0433-cea0-444b-a522-44344b34b923 service nova] Creating event network-vif-plugged:db0b7e55-abab-4576-9d30-7da64a519e8c for instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 on n-h2-844627-10 Aug 04 14:10:28.545101 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2be898ec-f133-4d0b-957e-1391f2977f65 req-47da0433-cea0-444b-a522-44344b34b923 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110338 Aug 04 14:10:28.548534 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1602/3199] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:28.561768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c240549e-ace2-4727-aee5-6a9be3e83adb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:28.563699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c240549e-ace2-4727-aee5-6a9be3e83adb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:28.581945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c240549e-ace2-4727-aee5-6a9be3e83adb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:28.583449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c240549e-ace2-4727-aee5-6a9be3e83adb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:28.585450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c240549e-ace2-4727-aee5-6a9be3e83adb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:28.586762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c240549e-ace2-4727-aee5-6a9be3e83adb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:29.034452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c240549e-ace2-4727-aee5-6a9be3e83adb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:29.048149 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c240549e-ace2-4727-aee5-6a9be3e83adb tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1324 microversion: 2.1 time: 0.496865 Aug 04 14:10:29.049349 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1603/3200] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:28 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1324 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:29.083081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:29.084988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:29.102192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:29.106619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:29.108194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:29.110001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:29.360086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:29.400927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:29.407324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:29.408915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-319cfe53-a053-4a18-bbfa-d4405ff44c01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:29.411437 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e26e3d0-2e46-42cc-a017-66c55469488a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1594 microversion: 2.32 time: 0.338521 Aug 04 14:10:29.417434 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1604/3201] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:29 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1594 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:29.428308 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-319cfe53-a053-4a18-bbfa-d4405ff44c01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 2.338164 Aug 04 14:10:29.429887 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1598/3202] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:27 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:29.464092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4f583a6-3e06-490a-8afc-d9d61e8b755a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:29.468722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d4f583a6-3e06-490a-8afc-d9d61e8b755a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:29.506122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4f583a6-3e06-490a-8afc-d9d61e8b755a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:29.507716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4f583a6-3e06-490a-8afc-d9d61e8b755a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:29.510623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4f583a6-3e06-490a-8afc-d9d61e8b755a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:29.511930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4f583a6-3e06-490a-8afc-d9d61e8b755a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:29.952800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=30 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:29.984402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4f583a6-3e06-490a-8afc-d9d61e8b755a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:30.014305 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4f583a6-3e06-490a-8afc-d9d61e8b755a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1309 microversion: 2.1 time: 0.558066 Aug 04 14:10:30.020686 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1605/3203] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:29 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1309 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:30.083584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4a855a45-4ba4-4cc2-85ed-f7cb5164c379 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:30.089495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4a855a45-4ba4-4cc2-85ed-f7cb5164c379 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:30.115702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a855a45-4ba4-4cc2-85ed-f7cb5164c379 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:30.121247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a855a45-4ba4-4cc2-85ed-f7cb5164c379 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:30.123661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a855a45-4ba4-4cc2-85ed-f7cb5164c379 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:30.131408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a855a45-4ba4-4cc2-85ed-f7cb5164c379 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:30.462635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b8dd87e-f3a3-4ff5-ad03-dc10b2a97e4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:30.469189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b8dd87e-f3a3-4ff5-ad03-dc10b2a97e4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:30.522430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b8dd87e-f3a3-4ff5-ad03-dc10b2a97e4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:30.550814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b8dd87e-f3a3-4ff5-ad03-dc10b2a97e4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:30.553188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b8dd87e-f3a3-4ff5-ad03-dc10b2a97e4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:30.554030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b8dd87e-f3a3-4ff5-ad03-dc10b2a97e4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:30.868364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4a855a45-4ba4-4cc2-85ed-f7cb5164c379 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:30.978898 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4a855a45-4ba4-4cc2-85ed-f7cb5164c379 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1324 microversion: 2.1 time: 0.889412 Aug 04 14:10:30.980154 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1599/3204] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:30 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1324 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:31.070259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:31.071618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:31.090982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:31.117176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:31.121187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:31.122838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:31.123844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:31.216791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=80 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:31.734427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b8dd87e-f3a3-4ff5-ad03-dc10b2a97e4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:31.742236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:31.770093 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b8dd87e-f3a3-4ff5-ad03-dc10b2a97e4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 1.316779 Aug 04 14:10:31.772325 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1606/3205] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:30 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:31.786601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:31.790461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:31.793056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aa35dbcb-a676-4e9c-8ba8-af823399ba2a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:31.794515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aa35dbcb-a676-4e9c-8ba8-af823399ba2a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:31.796076 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb6f06f2-708a-410d-a811-df0c338c1919 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1594 microversion: 2.32 time: 0.783131 Aug 04 14:10:31.800609 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1600/3206] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:30 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1594 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:31.865159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa35dbcb-a676-4e9c-8ba8-af823399ba2a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:31.867365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa35dbcb-a676-4e9c-8ba8-af823399ba2a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:31.870666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa35dbcb-a676-4e9c-8ba8-af823399ba2a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:31.873770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa35dbcb-a676-4e9c-8ba8-af823399ba2a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:32.011541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c7a265f1-4e95-4922-9ab5-a8a11393f1e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:32.013495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c7a265f1-4e95-4922-9ab5-a8a11393f1e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:32.031931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7a265f1-4e95-4922-9ab5-a8a11393f1e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:32.035883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7a265f1-4e95-4922-9ab5-a8a11393f1e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:32.037795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7a265f1-4e95-4922-9ab5-a8a11393f1e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:32.043905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7a265f1-4e95-4922-9ab5-a8a11393f1e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:33.083382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c7a265f1-4e95-4922-9ab5-a8a11393f1e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:33.100323 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c7a265f1-4e95-4922-9ab5-a8a11393f1e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1324 microversion: 2.1 time: 1.099315 Aug 04 14:10:33.106331 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1601/3207] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:31 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1324 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:33.122232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03c67e74-6dea-4e71-8815-60f1eb15e656 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:33.122882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-03c67e74-6dea-4e71-8815-60f1eb15e656 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:33.153175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03c67e74-6dea-4e71-8815-60f1eb15e656 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:33.153175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03c67e74-6dea-4e71-8815-60f1eb15e656 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:33.153957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03c67e74-6dea-4e71-8815-60f1eb15e656 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:33.154409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03c67e74-6dea-4e71-8815-60f1eb15e656 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:33.530365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aa35dbcb-a676-4e9c-8ba8-af823399ba2a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:33.568744 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aa35dbcb-a676-4e9c-8ba8-af823399ba2a tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1490 microversion: 2.1 time: 1.794274 Aug 04 14:10:33.588520 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1607/3208] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:31 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1490 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:33.639385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:33.641097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:33.651084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:33.654849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:33.666101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:33.667084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:34.490185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-03c67e74-6dea-4e71-8815-60f1eb15e656 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:34.510185 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-03c67e74-6dea-4e71-8815-60f1eb15e656 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 1.402647 Aug 04 14:10:34.513247 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1602/3209] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:33 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:34.527656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a397a3fc-b12c-4aa7-b948-3b373b41ee57 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1820406012"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:34.537110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a397a3fc-b12c-4aa7-b948-3b373b41ee57 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:34.557559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a397a3fc-b12c-4aa7-b948-3b373b41ee57 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:34.559076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a397a3fc-b12c-4aa7-b948-3b373b41ee57 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:34.565219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a397a3fc-b12c-4aa7-b948-3b373b41ee57 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:34.568242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a397a3fc-b12c-4aa7-b948-3b373b41ee57 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:34.681324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:34.721033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:34.731346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:34.737212 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3fcc6512-e356-4fca-8ab0-031704769921 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1662 microversion: 2.32 time: 1.145229 Aug 04 14:10:34.741298 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1608/3210] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:33 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1662 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:34.775760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe91d9a2-5228-4083-8885-ed54f1e8b806 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:34.776796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe91d9a2-5228-4083-8885-ed54f1e8b806 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:34.805463 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a397a3fc-b12c-4aa7-b948-3b373b41ee57 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "PUT /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1075 microversion: 2.1 time: 0.289422 Aug 04 14:10:34.809647 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1603/3211] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:10:34 2022] PUT /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1075 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:34.844112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe91d9a2-5228-4083-8885-ed54f1e8b806 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:34.844782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9719775e-4b84-4f1d-8b46-2d95373fd287 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:34.846049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe91d9a2-5228-4083-8885-ed54f1e8b806 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:34.846279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9719775e-4b84-4f1d-8b46-2d95373fd287 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:34.851947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe91d9a2-5228-4083-8885-ed54f1e8b806 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:34.852441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe91d9a2-5228-4083-8885-ed54f1e8b806 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:34.863927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9719775e-4b84-4f1d-8b46-2d95373fd287 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:34.864691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9719775e-4b84-4f1d-8b46-2d95373fd287 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:34.865802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9719775e-4b84-4f1d-8b46-2d95373fd287 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:34.870481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9719775e-4b84-4f1d-8b46-2d95373fd287 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:35.347158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9719775e-4b84-4f1d-8b46-2d95373fd287 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:35.364616 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9719775e-4b84-4f1d-8b46-2d95373fd287 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1501 microversion: 2.1 time: 0.526979 Aug 04 14:10:35.366250 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1604/3212] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:34 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1501 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:35.384995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3002b897-fb3f-4cad-847d-db951aaa5bc0 req-37de1f91-f3a7-419a-8a47-067b3fbb302b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac958b6-3fe8-4be4-95e7-2ac0be29c97a", "name": "network-vif-plugged", "status": "completed", "tag": "ae3a02ea-3e3e-4646-9115-47c84a95edb5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:35.388005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe91d9a2-5228-4083-8885-ed54f1e8b806 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:35.397873 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe91d9a2-5228-4083-8885-ed54f1e8b806 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1324 microversion: 2.1 time: 0.652516 Aug 04 14:10:35.398528 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1609/3213] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:34 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1324 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:35.415694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-22c00ec9-981e-4b68-a15f-40725f4b73bc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:35.417711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-22c00ec9-981e-4b68-a15f-40725f4b73bc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:35.428333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3002b897-fb3f-4cad-847d-db951aaa5bc0 req-37de1f91-f3a7-419a-8a47-067b3fbb302b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:35.428973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3002b897-fb3f-4cad-847d-db951aaa5bc0 req-37de1f91-f3a7-419a-8a47-067b3fbb302b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:35.437159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22c00ec9-981e-4b68-a15f-40725f4b73bc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:35.438352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22c00ec9-981e-4b68-a15f-40725f4b73bc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:35.442396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22c00ec9-981e-4b68-a15f-40725f4b73bc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:35.444611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22c00ec9-981e-4b68-a15f-40725f4b73bc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:35.457036 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3002b897-fb3f-4cad-847d-db951aaa5bc0 req-37de1f91-f3a7-419a-8a47-067b3fbb302b service nova] Creating event network-vif-plugged:ae3a02ea-3e3e-4646-9115-47c84a95edb5 for instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a on n-h1-844627-10 Aug 04 14:10:35.469353 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3002b897-fb3f-4cad-847d-db951aaa5bc0 req-37de1f91-f3a7-419a-8a47-067b3fbb302b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101590 Aug 04 14:10:35.477467 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1605/3214] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:35.503032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:35.533210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4382764f-bec7-4eb8-aeda-053f998087d8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:35.535076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4382764f-bec7-4eb8-aeda-053f998087d8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:35.547449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4382764f-bec7-4eb8-aeda-053f998087d8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:35.549776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4382764f-bec7-4eb8-aeda-053f998087d8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:35.551018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4382764f-bec7-4eb8-aeda-053f998087d8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:35.558748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4382764f-bec7-4eb8-aeda-053f998087d8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:36.142407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-22c00ec9-981e-4b68-a15f-40725f4b73bc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:36.158364 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-22c00ec9-981e-4b68-a15f-40725f4b73bc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1501 microversion: 2.1 time: 0.751318 Aug 04 14:10:36.169305 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1610/3215] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:35 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1501 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:36.174863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:36.175540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:36.199106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:36.199629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:36.200523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:36.201047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:36.299673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4382764f-bec7-4eb8-aeda-053f998087d8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:36.315963 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4382764f-bec7-4eb8-aeda-053f998087d8 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 0.787783 Aug 04 14:10:36.316587 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1606/3216] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:35 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:10:36.347383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d64104c0-1ed6-4602-a1ef-ef194988cb4f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:36.365278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d64104c0-1ed6-4602-a1ef-ef194988cb4f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:36.365927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d64104c0-1ed6-4602-a1ef-ef194988cb4f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:36.426333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d64104c0-1ed6-4602-a1ef-ef194988cb4f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Going to try to stop instance {{(pid=130961) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 14:10:36.572231 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d64104c0-1ed6-4602-a1ef-ef194988cb4f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "POST /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587/action" status: 202 len: 0 microversion: 2.1 time: 0.240336 Aug 04 14:10:36.579010 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1607/3217] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:10:36 2022] POST /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:10:36.609344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-601beb75-b52f-49e4-8ff9-bc2f2feb68d6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:36.614176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-601beb75-b52f-49e4-8ff9-bc2f2feb68d6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:36.656819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-601beb75-b52f-49e4-8ff9-bc2f2feb68d6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:36.662535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-601beb75-b52f-49e4-8ff9-bc2f2feb68d6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:36.672224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-601beb75-b52f-49e4-8ff9-bc2f2feb68d6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:36.673295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-601beb75-b52f-49e4-8ff9-bc2f2feb68d6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:36.849116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:36.866705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:36.879535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:36.893529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-faa185aa-7682-4774-9994-3ce0e8d1fa5f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1662 microversion: 2.32 time: 0.716459 Aug 04 14:10:36.918205 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1611/3218] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:36 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1662 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:36.969681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9184245a-c8ba-4448-9b54-c7ed1870f005 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:36.970918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9184245a-c8ba-4448-9b54-c7ed1870f005 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:37.003516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9184245a-c8ba-4448-9b54-c7ed1870f005 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:37.004335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9184245a-c8ba-4448-9b54-c7ed1870f005 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:37.006908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9184245a-c8ba-4448-9b54-c7ed1870f005 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:37.007715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9184245a-c8ba-4448-9b54-c7ed1870f005 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:37.060371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=10 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:37.334188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-601beb75-b52f-49e4-8ff9-bc2f2feb68d6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:37.350719 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-601beb75-b52f-49e4-8ff9-bc2f2feb68d6 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1324 microversion: 2.1 time: 0.768210 Aug 04 14:10:37.353748 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1608/3219] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:36 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1324 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:37.359914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fa6750e-721f-4378-b6b3-9767ee89956b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:37.366037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fa6750e-721f-4378-b6b3-9767ee89956b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:37.379419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa6750e-721f-4378-b6b3-9767ee89956b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:37.386243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa6750e-721f-4378-b6b3-9767ee89956b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:37.387619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa6750e-721f-4378-b6b3-9767ee89956b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:37.388365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa6750e-721f-4378-b6b3-9767ee89956b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:38.735312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9184245a-c8ba-4448-9b54-c7ed1870f005 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:38.772543 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9184245a-c8ba-4448-9b54-c7ed1870f005 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 1.833310 Aug 04 14:10:38.775405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1612/3220] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:36 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:38.789885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:38.797122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:38.827807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:38.828564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:38.830221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:38.831124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:38.912617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fa6750e-721f-4378-b6b3-9767ee89956b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:38.927024 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fa6750e-721f-4378-b6b3-9767ee89956b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 1.571960 Aug 04 14:10:38.940624 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1609/3221] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:37 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:38.960514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-04302752-d4e6-4c4b-8db9-ad3316dfe176 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:38.961418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-04302752-d4e6-4c4b-8db9-ad3316dfe176 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:38.975965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04302752-d4e6-4c4b-8db9-ad3316dfe176 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:38.976630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04302752-d4e6-4c4b-8db9-ad3316dfe176 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:38.979780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04302752-d4e6-4c4b-8db9-ad3316dfe176 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:38.980422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04302752-d4e6-4c4b-8db9-ad3316dfe176 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:40.354135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:40.402486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:40.415455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:40.420159 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e735c379-c6f4-4895-883f-630695452774 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1756 microversion: 2.32 time: 1.643081 Aug 04 14:10:40.436625 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1613/3222] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:38 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1756 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:40.448436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-04302752-d4e6-4c4b-8db9-ad3316dfe176 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:40.451092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d80ad22-3a13-4a79-ae47-ab0a95ac5ca8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:40.451913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d80ad22-3a13-4a79-ae47-ab0a95ac5ca8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:40.462686 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-04302752-d4e6-4c4b-8db9-ad3316dfe176 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1521 microversion: 2.1 time: 1.507109 Aug 04 14:10:40.468250 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1610/3223] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:38 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1521 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:40.476331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f6f1386-9ccf-44b7-b637-56451354bcbd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:40.486124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f6f1386-9ccf-44b7-b637-56451354bcbd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:40.494969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d80ad22-3a13-4a79-ae47-ab0a95ac5ca8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:40.494969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d80ad22-3a13-4a79-ae47-ab0a95ac5ca8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:40.494969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d80ad22-3a13-4a79-ae47-ab0a95ac5ca8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:40.494969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d80ad22-3a13-4a79-ae47-ab0a95ac5ca8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:40.513471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f6f1386-9ccf-44b7-b637-56451354bcbd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:40.514363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f6f1386-9ccf-44b7-b637-56451354bcbd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:40.515462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f6f1386-9ccf-44b7-b637-56451354bcbd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:40.516716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f6f1386-9ccf-44b7-b637-56451354bcbd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:40.981786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f6f1386-9ccf-44b7-b637-56451354bcbd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:40.988132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5d80ad22-3a13-4a79-ae47-ab0a95ac5ca8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:40.997129 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d80ad22-3a13-4a79-ae47-ab0a95ac5ca8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 0.557907 Aug 04 14:10:40.998592 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1614/3224] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:40 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:41.004028 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f6f1386-9ccf-44b7-b637-56451354bcbd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 0.533597 Aug 04 14:10:41.005327 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1611/3225] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:40 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:41.024441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b7bd9f50-0944-4821-97f7-aeb736d24cc2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:41.026471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b7bd9f50-0944-4821-97f7-aeb736d24cc2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:41.048854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7bd9f50-0944-4821-97f7-aeb736d24cc2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:41.050727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7bd9f50-0944-4821-97f7-aeb736d24cc2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:41.052591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7bd9f50-0944-4821-97f7-aeb736d24cc2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:41.053957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7bd9f50-0944-4821-97f7-aeb736d24cc2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:41.596787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7bd9f50-0944-4821-97f7-aeb736d24cc2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:41.599149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ee255dae-8c62-4f5a-936e-c240443895a6 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f4700132ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-215986146", "description": "tempest-description-1852054318"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:41.610292 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b7bd9f50-0944-4821-97f7-aeb736d24cc2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1521 microversion: 2.1 time: 0.602973 Aug 04 14:10:41.612416 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1612/3226] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:41 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1521 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:41.629936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-43b986e9-5424-48ca-889b-de31a91843ef tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:41.636044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-43b986e9-5424-48ca-889b-de31a91843ef tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:41.639591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:41.654417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43b986e9-5424-48ca-889b-de31a91843ef tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:41.654887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43b986e9-5424-48ca-889b-de31a91843ef tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:41.657742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43b986e9-5424-48ca-889b-de31a91843ef tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:41.659437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43b986e9-5424-48ca-889b-de31a91843ef tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:41.734328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-43b986e9-5424-48ca-889b-de31a91843ef tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lazy-loading 'flavor' on Instance uuid 27bb1614-6b27-48a6-b766-c7697e4169ac {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:10:42.056679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:42.078624 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-43b986e9-5424-48ca-889b-de31a91843ef tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/action" status: 200 len: 32 microversion: 2.1 time: 0.464437 Aug 04 14:10:42.080552 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1613/3227] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:10:41 2022] POST /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/action => generated 32 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:10:42.089048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:42.090213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:42.101392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:42.102274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:42.104146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:42.104894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:42.993937 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ee255dae-8c62-4f5a-936e-c240443895a6 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.992927 Aug 04 14:10:43.005348 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1615/3228] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:10:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:43.012080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9a2411e6-badd-4195-a244-71d9c26f2320 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-591947541"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:43.028082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9a2411e6-badd-4195-a244-71d9c26f2320 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:43.059227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:43.059829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a2411e6-badd-4195-a244-71d9c26f2320 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:43.060195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a2411e6-badd-4195-a244-71d9c26f2320 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:43.061731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a2411e6-badd-4195-a244-71d9c26f2320 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:43.064936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a2411e6-badd-4195-a244-71d9c26f2320 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:43.078633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:43.087580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:43.089762 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-50c45f26-e9a4-400c-ac94-639eb86a1006 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1756 microversion: 2.32 time: 1.007540 Aug 04 14:10:43.094786 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1614/3229] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:42 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1756 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:43.104233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-11c035ad-f357-493f-b1b9-b19e7921ece2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:43.106056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-11c035ad-f357-493f-b1b9-b19e7921ece2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:43.123991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-11c035ad-f357-493f-b1b9-b19e7921ece2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:43.125170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-11c035ad-f357-493f-b1b9-b19e7921ece2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:43.127167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-11c035ad-f357-493f-b1b9-b19e7921ece2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:43.127989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-11c035ad-f357-493f-b1b9-b19e7921ece2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:43.783468 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9a2411e6-badd-4195-a244-71d9c26f2320 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a/action" status: 202 len: 0 microversion: 2.1 time: 0.776222 Aug 04 14:10:43.787948 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1616/3230] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:10:43 2022] POST /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a/action => generated 0 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:10:43.797574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81b486dd-bf20-4d8f-a71e-4a94736f7f15 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:43.799636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81b486dd-bf20-4d8f-a71e-4a94736f7f15 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:43.808033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81b486dd-bf20-4d8f-a71e-4a94736f7f15 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:43.809109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81b486dd-bf20-4d8f-a71e-4a94736f7f15 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:43.810896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81b486dd-bf20-4d8f-a71e-4a94736f7f15 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:43.811652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81b486dd-bf20-4d8f-a71e-4a94736f7f15 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:44.315616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-11c035ad-f357-493f-b1b9-b19e7921ece2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:44.327592 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-11c035ad-f357-493f-b1b9-b19e7921ece2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 1.231184 Aug 04 14:10:44.330893 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1615/3231] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:43 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:44.338294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55cda67a-1429-4e1c-b1a1-ac72b85fd1d1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:44.346031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55cda67a-1429-4e1c-b1a1-ac72b85fd1d1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:44.353605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55cda67a-1429-4e1c-b1a1-ac72b85fd1d1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:44.354475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55cda67a-1429-4e1c-b1a1-ac72b85fd1d1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:44.355471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55cda67a-1429-4e1c-b1a1-ac72b85fd1d1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:44.356079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55cda67a-1429-4e1c-b1a1-ac72b85fd1d1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:44.723329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-81b486dd-bf20-4d8f-a71e-4a94736f7f15 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:44.735023 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81b486dd-bf20-4d8f-a71e-4a94736f7f15 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 0.944677 Aug 04 14:10:44.736187 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1617/3232] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:43 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:44.751105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82be7a26-27e5-4a42-9515-177eab3bd20f tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f46f39d2c10>, body: {"security_group_rule": {"parent_group_id": "6f15163c-a987-4be3-86d1-250c64e21f54", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:45.041540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-55cda67a-1429-4e1c-b1a1-ac72b85fd1d1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:45.052263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55cda67a-1429-4e1c-b1a1-ac72b85fd1d1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1735 microversion: 2.1 time: 0.719720 Aug 04 14:10:45.054485 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1616/3233] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:44 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1735 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:45.101600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b68c8c78-a354-4e84-ab08-445ac7c943e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '.version_select at 0x7f46f36db280>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:45.444027 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b68c8c78-a354-4e84-ab08-445ac7c943e7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/images/c7dd289d-c2cf-4694-a038-02bce81e751d" status: 204 len: 0 microversion: 2.1 time: 0.388037 Aug 04 14:10:45.445501 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1617/3234] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:45 2022] DELETE /compute/v2.1/images/c7dd289d-c2cf-4694-a038-02bce81e751d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:10:45.452276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:45.453051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:45.464324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:45.465254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:45.466542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:45.469004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:45.883229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:45.915396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:45.919790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:45.921139 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-47819315-6c41-4016-801c-bb6db3299e6e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1803 microversion: 2.32 time: 0.474397 Aug 04 14:10:45.922740 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1618/3235] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:45 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1803 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:45.929706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d6090bc-220c-4c65-8f10-eefb225d9829 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:45.930610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d6090bc-220c-4c65-8f10-eefb225d9829 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:45.945485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d6090bc-220c-4c65-8f10-eefb225d9829 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:45.947982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d6090bc-220c-4c65-8f10-eefb225d9829 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:45.950739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d6090bc-220c-4c65-8f10-eefb225d9829 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:45.951526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d6090bc-220c-4c65-8f10-eefb225d9829 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:45.986687 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-82be7a26-27e5-4a42-9515-177eab3bd20f tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.244797 Aug 04 14:10:45.987721 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1618/3236] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:10:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:45.998750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70fc4885-39a2-4c94-abe5-092bbd9f4c47 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '.version_select at 0x7f46f3ab09d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:46.098661 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-70fc4885-39a2-4c94-abe5-092bbd9f4c47 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Image not found. Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70fc4885-39a2-4c94-abe5-092bbd9f4c47 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/images/c7dd289d-c2cf-4694-a038-02bce81e751d HTTP/1.1 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'c7dd289d-c2cf-4694-a038-02bce81e751d'} Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c7dd289d-c2cf-4694-a038-02bce81e751d Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 14:10:46.106351 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7dd289d-c2cf-4694-a038-02bce81e751d could not be found. Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70fc4885-39a2-4c94-abe5-092bbd9f4c47 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:10:46.119946 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-70fc4885-39a2-4c94-abe5-092bbd9f4c47 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/images/c7dd289d-c2cf-4694-a038-02bce81e751d" status: 404 len: 62 microversion: 2.1 time: 0.122688 Aug 04 14:10:46.138439 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1619/3237] 10.222.0.66 () {58 vars in 1233 bytes} [Thu Aug 4 14:10:45 2022] GET /compute/v2.1/images/c7dd289d-c2cf-4694-a038-02bce81e751d => generated 62 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:10:46.689532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d36a4627-1db5-4340-8982-fce8c526e1d0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:46.690443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d36a4627-1db5-4340-8982-fce8c526e1d0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:46.706055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d36a4627-1db5-4340-8982-fce8c526e1d0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:46.708593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d36a4627-1db5-4340-8982-fce8c526e1d0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:46.709525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d36a4627-1db5-4340-8982-fce8c526e1d0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:46.709985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d36a4627-1db5-4340-8982-fce8c526e1d0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:46.756543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d6090bc-220c-4c65-8f10-eefb225d9829 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:46.782655 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d6090bc-220c-4c65-8f10-eefb225d9829 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 0.857821 Aug 04 14:10:46.791836 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1619/3238] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:45 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:46.802200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b0bfe753-a7db-4b60-a43a-1286f493c8cf tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f470559a790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1894601934", "description": "tempest-description-1803804848"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:47.421243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d36a4627-1db5-4340-8982-fce8c526e1d0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:47.443932 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d36a4627-1db5-4340-8982-fce8c526e1d0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 1.317593 Aug 04 14:10:47.446781 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1620/3239] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:46 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:47.479021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b53eb3a-2a27-481e-8ba9-92b408b8059d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:47.480807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b53eb3a-2a27-481e-8ba9-92b408b8059d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:47.490071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b53eb3a-2a27-481e-8ba9-92b408b8059d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:47.491938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b53eb3a-2a27-481e-8ba9-92b408b8059d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:47.493585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b53eb3a-2a27-481e-8ba9-92b408b8059d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:47.494232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b53eb3a-2a27-481e-8ba9-92b408b8059d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:48.022211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b53eb3a-2a27-481e-8ba9-92b408b8059d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:48.043061 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b53eb3a-2a27-481e-8ba9-92b408b8059d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1735 microversion: 2.1 time: 0.572073 Aug 04 14:10:48.054097 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1621/3240] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:47 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1735 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:48.071118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fbdd9508-d591-4460-99bd-103268d78739 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:48.079582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fbdd9508-d591-4460-99bd-103268d78739 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:48.098696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbdd9508-d591-4460-99bd-103268d78739 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:48.101720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbdd9508-d591-4460-99bd-103268d78739 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:48.128317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbdd9508-d591-4460-99bd-103268d78739 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:48.130713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbdd9508-d591-4460-99bd-103268d78739 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:48.144784 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b0bfe753-a7db-4b60-a43a-1286f493c8cf tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.345695 Aug 04 14:10:48.152933 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1620/3241] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:10:46 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:48.161096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:48.169733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:48.202604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:48.205861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:48.209766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:48.210842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:48.777665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:48.818659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:48.827491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:48.833583 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-97ea9f5a-c062-484b-bbce-0a14463a4e11 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1850 microversion: 2.32 time: 0.685543 Aug 04 14:10:48.838996 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1621/3242] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:48 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1850 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:48.859120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5ea8b161-6352-4371-8d4c-f7e00a16b64d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:48.863040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5ea8b161-6352-4371-8d4c-f7e00a16b64d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:48.889965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ea8b161-6352-4371-8d4c-f7e00a16b64d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:48.893708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ea8b161-6352-4371-8d4c-f7e00a16b64d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:48.896904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ea8b161-6352-4371-8d4c-f7e00a16b64d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:48.899792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ea8b161-6352-4371-8d4c-f7e00a16b64d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:49.061871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fbdd9508-d591-4460-99bd-103268d78739 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:49.088582 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fbdd9508-d591-4460-99bd-103268d78739 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1539 microversion: 2.1 time: 1.032239 Aug 04 14:10:49.094321 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1622/3243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:48 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1539 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:49.117135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2b9ec8b2-4755-498f-bae1-53d9bf7a78c9 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f46f3ab0700>, body: {"security_group_rule": {"parent_group_id": "a30ba9e9-d78d-4786-8440-edff579f257b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:49.988384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5ea8b161-6352-4371-8d4c-f7e00a16b64d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:49.999413 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5ea8b161-6352-4371-8d4c-f7e00a16b64d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 1.158450 Aug 04 14:10:50.000047 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1622/3244] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:48 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:50.011900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cede879e-cc55-430a-bbd3-033848fe35fa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:50.016020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cede879e-cc55-430a-bbd3-033848fe35fa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:50.042797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cede879e-cc55-430a-bbd3-033848fe35fa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:50.043578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cede879e-cc55-430a-bbd3-033848fe35fa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:50.044668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cede879e-cc55-430a-bbd3-033848fe35fa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:50.047759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cede879e-cc55-430a-bbd3-033848fe35fa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:50.650157 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2b9ec8b2-4755-498f-bae1-53d9bf7a78c9 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.553502 Aug 04 14:10:50.659119 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1623/3245] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:10:49 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:50.676365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-72bbcfb7-308d-4ec5-81a0-96d21c3738d6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:50.679691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-72bbcfb7-308d-4ec5-81a0-96d21c3738d6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:50.695389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cede879e-cc55-430a-bbd3-033848fe35fa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:50.700387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72bbcfb7-308d-4ec5-81a0-96d21c3738d6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:50.701307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72bbcfb7-308d-4ec5-81a0-96d21c3738d6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:50.705928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72bbcfb7-308d-4ec5-81a0-96d21c3738d6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:50.707121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72bbcfb7-308d-4ec5-81a0-96d21c3738d6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:50.712166 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cede879e-cc55-430a-bbd3-033848fe35fa tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 0.706890 Aug 04 14:10:50.714134 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1623/3246] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:50 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:50.757730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:50.759337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:50.781558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:50.782899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:50.786301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:50.787882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:51.407868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-72bbcfb7-308d-4ec5-81a0-96d21c3738d6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:51.433791 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-72bbcfb7-308d-4ec5-81a0-96d21c3738d6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1735 microversion: 2.1 time: 0.772824 Aug 04 14:10:51.435053 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1624/3247] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:50 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1735 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:51.444091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5eece70b-92e3-4e46-8a3a-2a42251fdaea req-40cf7230-2004-4e4d-9867-778ff2c3852a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac958b6-3fe8-4be4-95e7-2ac0be29c97a", "name": "network-vif-plugged", "status": "completed", "tag": "ae3a02ea-3e3e-4646-9115-47c84a95edb5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:51.456909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:51.468952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:51.469771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5eece70b-92e3-4e46-8a3a-2a42251fdaea req-40cf7230-2004-4e4d-9867-778ff2c3852a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:51.470332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5eece70b-92e3-4e46-8a3a-2a42251fdaea req-40cf7230-2004-4e4d-9867-778ff2c3852a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:51.472392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:51.474291 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cfa0622b-0df0-4741-98bd-40d3432a4205 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1850 microversion: 2.32 time: 0.745284 Aug 04 14:10:51.475082 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1624/3248] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:50 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1850 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:51.498325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b94933ad-d817-4bf5-ae9d-628f5457904b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:51.499573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b94933ad-d817-4bf5-ae9d-628f5457904b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:51.508510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b94933ad-d817-4bf5-ae9d-628f5457904b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:51.509276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b94933ad-d817-4bf5-ae9d-628f5457904b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:51.510292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b94933ad-d817-4bf5-ae9d-628f5457904b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:51.511489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b94933ad-d817-4bf5-ae9d-628f5457904b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:51.511697 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5eece70b-92e3-4e46-8a3a-2a42251fdaea req-40cf7230-2004-4e4d-9867-778ff2c3852a service nova] Creating event network-vif-plugged:ae3a02ea-3e3e-4646-9115-47c84a95edb5 for instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a on n-h1-844627-10 Aug 04 14:10:51.526760 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5eece70b-92e3-4e46-8a3a-2a42251fdaea req-40cf7230-2004-4e4d-9867-778ff2c3852a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090225 Aug 04 14:10:51.531954 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1625/3249] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:51.544063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-47aee946-134b-461a-ba52-ea7b62d5cc79 req-7ad9876f-cc38-424c-9f86-f85bba8cf9ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "tag": "6e5b3b8c-2b8f-432f-baa0-7557a9bda99c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:51.570640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-47aee946-134b-461a-ba52-ea7b62d5cc79 req-7ad9876f-cc38-424c-9f86-f85bba8cf9ea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:51.571535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-47aee946-134b-461a-ba52-ea7b62d5cc79 req-7ad9876f-cc38-424c-9f86-f85bba8cf9ea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:51.586691 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-47aee946-134b-461a-ba52-ea7b62d5cc79 req-7ad9876f-cc38-424c-9f86-f85bba8cf9ea service nova] Creating event network-changed:6e5b3b8c-2b8f-432f-baa0-7557a9bda99c for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:10:51.593869 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-47aee946-134b-461a-ba52-ea7b62d5cc79 req-7ad9876f-cc38-424c-9f86-f85bba8cf9ea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057578 Aug 04 14:10:51.594825 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1626/3250] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:51.601702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ab1ef76-d2b1-46c8-add5-7683886f2f5d tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f46f3ba2940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1764457323", "description": "tempest-description-102695484"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:52.208624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b94933ad-d817-4bf5-ae9d-628f5457904b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:52.218719 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b94933ad-d817-4bf5-ae9d-628f5457904b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1539 microversion: 2.1 time: 0.726420 Aug 04 14:10:52.233438 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1625/3251] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:51 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1539 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:52.239778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb736d7b-4372-4836-9fe3-ed377811e10a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:52.245466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb736d7b-4372-4836-9fe3-ed377811e10a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:52.246752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb736d7b-4372-4836-9fe3-ed377811e10a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Searching by: {'deleted': False, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:10:52.254080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb736d7b-4372-4836-9fe3-ed377811e10a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:52.255092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb736d7b-4372-4836-9fe3-ed377811e10a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:52.256239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb736d7b-4372-4836-9fe3-ed377811e10a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:52.257134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb736d7b-4372-4836-9fe3-ed377811e10a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:52.290805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-fb736d7b-4372-4836-9fe3-ed377811e10a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:10:52.325461 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb736d7b-4372-4836-9fe3-ed377811e10a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.090300 Aug 04 14:10:52.326700 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1626/3252] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:10:52 2022] GET /compute/v2.1/servers => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:52.343421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-21376c2b-2ace-4bb8-b3e1-06684586f0f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:52.344517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-21376c2b-2ace-4bb8-b3e1-06684586f0f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:52.352752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21376c2b-2ace-4bb8-b3e1-06684586f0f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:52.353718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21376c2b-2ace-4bb8-b3e1-06684586f0f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:52.354816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21376c2b-2ace-4bb8-b3e1-06684586f0f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:52.355537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21376c2b-2ace-4bb8-b3e1-06684586f0f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:52.649307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ab1ef76-d2b1-46c8-add5-7683886f2f5d tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.050525 Aug 04 14:10:52.655663 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1627/3253] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:10:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:52.676613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-640c6394-443d-4382-9c60-0f4d6ff69b1e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:52.681786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-640c6394-443d-4382-9c60-0f4d6ff69b1e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:52.703405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-640c6394-443d-4382-9c60-0f4d6ff69b1e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:52.707101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-640c6394-443d-4382-9c60-0f4d6ff69b1e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:52.714333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-640c6394-443d-4382-9c60-0f4d6ff69b1e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:52.716172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-640c6394-443d-4382-9c60-0f4d6ff69b1e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:52.816092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-21376c2b-2ace-4bb8-b3e1-06684586f0f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:52.824945 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-21376c2b-2ace-4bb8-b3e1-06684586f0f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 0.496675 Aug 04 14:10:52.841771 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1627/3254] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:52 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:52.850574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:52.857197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:52.858314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Searching by: {'deleted': False, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:10:52.885988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:52.888189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:52.890338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:52.892417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:52.934209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:10:52.976067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:52.983755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:52.984729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:53.238817 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c1c9d6a5-09f2-4b3b-a6fb-0d9fa25332e2 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.395626 Aug 04 14:10:53.239769 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1628/3255] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:10:52 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:53.260656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-23ce9dc9-ecb9-4bb1-880b-dd514681c356 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:53.261623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-23ce9dc9-ecb9-4bb1-880b-dd514681c356 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:53.274375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23ce9dc9-ecb9-4bb1-880b-dd514681c356 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:53.275109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23ce9dc9-ecb9-4bb1-880b-dd514681c356 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:53.276148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23ce9dc9-ecb9-4bb1-880b-dd514681c356 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:53.283741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23ce9dc9-ecb9-4bb1-880b-dd514681c356 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:53.494293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-640c6394-443d-4382-9c60-0f4d6ff69b1e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:53.509839 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-640c6394-443d-4382-9c60-0f4d6ff69b1e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 0.847993 Aug 04 14:10:53.510447 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1628/3256] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:52 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:53.529067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:53.532680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:53.545610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:53.546357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:53.547421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:53.548614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:54.175503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-23ce9dc9-ecb9-4bb1-880b-dd514681c356 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:54.186835 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-23ce9dc9-ecb9-4bb1-880b-dd514681c356 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1735 microversion: 2.1 time: 0.945635 Aug 04 14:10:54.188523 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1629/3257] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:53 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1735 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:54.195107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e737c4d3-dc87-4487-912c-8533e767f3d7 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f4700865af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1641798536", "description": "tempest-description-1614709850"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:54.314339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:54.345900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:54.351272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:54.354864 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0623b4f0-f99e-4099-8115-f6a7b35821e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1871 microversion: 2.32 time: 0.842647 Aug 04 14:10:54.358794 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1629/3258] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:53 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1871 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:54.375007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-96516df0-a19f-43f1-8857-62781c78d5e8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:54.377875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-96516df0-a19f-43f1-8857-62781c78d5e8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:54.410901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96516df0-a19f-43f1-8857-62781c78d5e8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:54.412082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96516df0-a19f-43f1-8857-62781c78d5e8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:54.414258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96516df0-a19f-43f1-8857-62781c78d5e8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:54.415362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96516df0-a19f-43f1-8857-62781c78d5e8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:54.791321 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e737c4d3-dc87-4487-912c-8533e767f3d7 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.591607 Aug 04 14:10:54.793215 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1630/3259] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:10:54 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:54.817245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-05775620-5d1d-4255-9335-43ee28d5bb98 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:54.844388 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-05775620-5d1d-4255-9335-43ee28d5bb98 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046350 Aug 04 14:10:54.850904 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1631/3260] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:10:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:54.863225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-686fcfd6-a1fc-4bee-a7fd-319bfa01b396 req-744132b3-ffdc-4eec-8d2f-17bf5ed8b982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "tag": "53371ea6-c477-434e-80e6-d6459f75d410"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:54.898546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-686fcfd6-a1fc-4bee-a7fd-319bfa01b396 req-744132b3-ffdc-4eec-8d2f-17bf5ed8b982 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:54.901715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-686fcfd6-a1fc-4bee-a7fd-319bfa01b396 req-744132b3-ffdc-4eec-8d2f-17bf5ed8b982 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:54.935479 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-686fcfd6-a1fc-4bee-a7fd-319bfa01b396 req-744132b3-ffdc-4eec-8d2f-17bf5ed8b982 service nova] Creating event network-changed:53371ea6-c477-434e-80e6-d6459f75d410 for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:10:54.948961 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-686fcfd6-a1fc-4bee-a7fd-319bfa01b396 req-744132b3-ffdc-4eec-8d2f-17bf5ed8b982 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094099 Aug 04 14:10:54.950845 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1632/3261] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:54.963207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9877d9aa-1815-4de3-b2bc-a22d7f1100ec tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:54.966252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9877d9aa-1815-4de3-b2bc-a22d7f1100ec tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:54.981779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9877d9aa-1815-4de3-b2bc-a22d7f1100ec tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:54.982962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9877d9aa-1815-4de3-b2bc-a22d7f1100ec tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:54.986089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9877d9aa-1815-4de3-b2bc-a22d7f1100ec tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:54.988137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9877d9aa-1815-4de3-b2bc-a22d7f1100ec tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:55.020709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-96516df0-a19f-43f1-8857-62781c78d5e8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:55.033502 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-96516df0-a19f-43f1-8857-62781c78d5e8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1521 microversion: 2.1 time: 0.670543 Aug 04 14:10:55.035456 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1630/3262] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:54 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1521 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:55.041305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-92deddba-8f99-477e-894f-84b6844a2da8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:55.042370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-92deddba-8f99-477e-894f-84b6844a2da8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:55.050138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92deddba-8f99-477e-894f-84b6844a2da8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:55.051002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92deddba-8f99-477e-894f-84b6844a2da8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:55.052128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92deddba-8f99-477e-894f-84b6844a2da8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:55.052754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92deddba-8f99-477e-894f-84b6844a2da8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:55.666494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-92deddba-8f99-477e-894f-84b6844a2da8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:55.693709 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-92deddba-8f99-477e-894f-84b6844a2da8 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 0.656470 Aug 04 14:10:55.698112 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1631/3263] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:55 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:55.723599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-36e05c3a-1a4a-4f7b-845d-3c802296da07 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f46f3ba2670>, body: {"security_group_rule": {"parent_group_id": "1e98780b-fb2f-47bc-a53d-4420d938159e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "58a94027-cb4b-4fd1-86c1-ff3b65216e43"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:55.760466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9877d9aa-1815-4de3-b2bc-a22d7f1100ec tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:55.775921 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9877d9aa-1815-4de3-b2bc-a22d7f1100ec tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 0.819689 Aug 04 14:10:55.776580 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1633/3264] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:54 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:55.787222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e6e5de7-c558-4cb3-999a-f34361654ae9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:55.788287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8e6e5de7-c558-4cb3-999a-f34361654ae9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:55.799687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e6e5de7-c558-4cb3-999a-f34361654ae9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:55.800418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e6e5de7-c558-4cb3-999a-f34361654ae9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:55.801473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e6e5de7-c558-4cb3-999a-f34361654ae9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:55.802113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e6e5de7-c558-4cb3-999a-f34361654ae9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:55.851231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:55.864499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8e6e5de7-c558-4cb3-999a-f34361654ae9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:10:56.036816 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e6e5de7-c558-4cb3-999a-f34361654ae9 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 204 len: 0 microversion: 2.1 time: 0.257330 Aug 04 14:10:56.039057 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1634/3265] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:10:55 2022] DELETE /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:10:56.049546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-53c5f640-bee9-47d3-9180-78e6ab344a74 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:56.050511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-53c5f640-bee9-47d3-9180-78e6ab344a74 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:56.063268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53c5f640-bee9-47d3-9180-78e6ab344a74 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:56.064118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53c5f640-bee9-47d3-9180-78e6ab344a74 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:56.074538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53c5f640-bee9-47d3-9180-78e6ab344a74 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:56.075676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53c5f640-bee9-47d3-9180-78e6ab344a74 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:56.183416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-53c5f640-bee9-47d3-9180-78e6ab344a74 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:10:56.345174 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-53c5f640-bee9-47d3-9180-78e6ab344a74 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "DELETE /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 204 len: 0 microversion: 2.1 time: 0.303652 Aug 04 14:10:56.346342 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1635/3266] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:10:56 2022] DELETE /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:10:56.355338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-69c1d553-2d66-4e5b-a3f2-79c766cb1ff6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:56.356713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-69c1d553-2d66-4e5b-a3f2-79c766cb1ff6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:56.368524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69c1d553-2d66-4e5b-a3f2-79c766cb1ff6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:56.369630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69c1d553-2d66-4e5b-a3f2-79c766cb1ff6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:56.372251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69c1d553-2d66-4e5b-a3f2-79c766cb1ff6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:56.373149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69c1d553-2d66-4e5b-a3f2-79c766cb1ff6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:56.894690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-69c1d553-2d66-4e5b-a3f2-79c766cb1ff6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:56.903760 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-69c1d553-2d66-4e5b-a3f2-79c766cb1ff6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1735 microversion: 2.1 time: 0.555374 Aug 04 14:10:56.904763 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1636/3267] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:56 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1735 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:56.921208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:56.922272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:56.931254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:56.932024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:56.933203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:56.934269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:57.370324 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-36e05c3a-1a4a-4f7b-845d-3c802296da07 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.667928 Aug 04 14:10:57.385094 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1632/3268] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:10:55 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:57.441466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-9bfef23f-c180-4a04-aa67-1d84b5fc7d0d req-73959d5c-87f5-4e9b-a64a-1938bc251d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac958b6-3fe8-4be4-95e7-2ac0be29c97a", "name": "network-vif-unplugged", "status": "completed", "tag": "ae3a02ea-3e3e-4646-9115-47c84a95edb5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:57.453308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:57.476805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:57.478815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:57.479001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9bfef23f-c180-4a04-aa67-1d84b5fc7d0d req-73959d5c-87f5-4e9b-a64a-1938bc251d83 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:57.479682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9bfef23f-c180-4a04-aa67-1d84b5fc7d0d req-73959d5c-87f5-4e9b-a64a-1938bc251d83 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:57.482178 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1b3704b1-3758-4466-8bc7-59ce9a7a590a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1892 microversion: 2.32 time: 0.576124 Aug 04 14:10:57.485304 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1637/3269] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:56 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1892 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:10:57.502294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-508f6aa7-be77-4c72-84dd-c4d4e355ac65 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:57.502933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-508f6aa7-be77-4c72-84dd-c4d4e355ac65 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:57.509358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:10:57.512651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-508f6aa7-be77-4c72-84dd-c4d4e355ac65 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:57.513521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-508f6aa7-be77-4c72-84dd-c4d4e355ac65 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:57.513931 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9bfef23f-c180-4a04-aa67-1d84b5fc7d0d req-73959d5c-87f5-4e9b-a64a-1938bc251d83 service nova] Creating event network-vif-unplugged:ae3a02ea-3e3e-4646-9115-47c84a95edb5 for instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a on n-h1-844627-10 Aug 04 14:10:57.514735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-508f6aa7-be77-4c72-84dd-c4d4e355ac65 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:57.515363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-508f6aa7-be77-4c72-84dd-c4d4e355ac65 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:57.525869 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-9bfef23f-c180-4a04-aa67-1d84b5fc7d0d req-73959d5c-87f5-4e9b-a64a-1938bc251d83 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136424 Aug 04 14:10:57.527928 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1633/3270] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:57.540295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df3e59e0-dca2-4f34-a265-269c88556c3f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:57.542394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df3e59e0-dca2-4f34-a265-269c88556c3f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:57.556617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df3e59e0-dca2-4f34-a265-269c88556c3f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:57.557454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df3e59e0-dca2-4f34-a265-269c88556c3f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:57.558596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df3e59e0-dca2-4f34-a265-269c88556c3f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:57.559449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df3e59e0-dca2-4f34-a265-269c88556c3f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:58.392226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-508f6aa7-be77-4c72-84dd-c4d4e355ac65 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:58.405927 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-508f6aa7-be77-4c72-84dd-c4d4e355ac65 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1527 microversion: 2.1 time: 0.918835 Aug 04 14:10:58.407028 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1638/3271] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:57 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1527 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:58.431330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0f4e991-affb-4b03-95f3-cac040c42814 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:58.432979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0f4e991-affb-4b03-95f3-cac040c42814 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:58.451157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0f4e991-affb-4b03-95f3-cac040c42814 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:58.452143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0f4e991-affb-4b03-95f3-cac040c42814 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:58.453955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0f4e991-affb-4b03-95f3-cac040c42814 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:58.454906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0f4e991-affb-4b03-95f3-cac040c42814 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:58.497732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df3e59e0-dca2-4f34-a265-269c88556c3f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:58.519065 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df3e59e0-dca2-4f34-a265-269c88556c3f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1608 microversion: 2.1 time: 0.988311 Aug 04 14:10:58.521433 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1634/3272] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:57 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1608 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:58.534032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-44ea13c6-7651-453a-b73d-987a55ab3874 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:58.536532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-44ea13c6-7651-453a-b73d-987a55ab3874 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:58.551889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44ea13c6-7651-453a-b73d-987a55ab3874 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:58.553317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44ea13c6-7651-453a-b73d-987a55ab3874 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:58.555090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44ea13c6-7651-453a-b73d-987a55ab3874 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:58.556032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44ea13c6-7651-453a-b73d-987a55ab3874 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:58.978397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f0f4e991-affb-4b03-95f3-cac040c42814 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:58.988725 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0f4e991-affb-4b03-95f3-cac040c42814 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 0.579097 Aug 04 14:10:58.989057 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1639/3273] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:58 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:58.998320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-44ea13c6-7651-453a-b73d-987a55ab3874 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:59.009070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f68978e7-dd2c-4327-afd6-03bd59176d96 req-56c65dff-8785-42d7-8fe7-2e04fd74bc33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "tag": "f7228146-595d-4471-81a4-ebb2865b8ff6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:59.014185 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-44ea13c6-7651-453a-b73d-987a55ab3874 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1507 microversion: 2.1 time: 0.490599 Aug 04 14:10:59.015111 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1635/3274] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:58 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:59.023769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e89251e-6b3c-4ea1-920c-7b2c73859f18 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f470007e790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-546655345", "description": "tempest-description-292099735"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:10:59.034955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f68978e7-dd2c-4327-afd6-03bd59176d96 req-56c65dff-8785-42d7-8fe7-2e04fd74bc33 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:59.035857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f68978e7-dd2c-4327-afd6-03bd59176d96 req-56c65dff-8785-42d7-8fe7-2e04fd74bc33 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:59.049891 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f68978e7-dd2c-4327-afd6-03bd59176d96 req-56c65dff-8785-42d7-8fe7-2e04fd74bc33 service nova] Creating event network-changed:f7228146-595d-4471-81a4-ebb2865b8ff6 for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:10:59.055530 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f68978e7-dd2c-4327-afd6-03bd59176d96 req-56c65dff-8785-42d7-8fe7-2e04fd74bc33 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050204 Aug 04 14:10:59.056855 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1640/3275] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:10:59.075658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d1f3000-1e9c-4d5f-9e40-13c29810a634 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:59.077713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3d1f3000-1e9c-4d5f-9e40-13c29810a634 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:59.093035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d1f3000-1e9c-4d5f-9e40-13c29810a634 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:59.094534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d1f3000-1e9c-4d5f-9e40-13c29810a634 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:59.096807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d1f3000-1e9c-4d5f-9e40-13c29810a634 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:59.097893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d1f3000-1e9c-4d5f-9e40-13c29810a634 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:59.793975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3d1f3000-1e9c-4d5f-9e40-13c29810a634 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:10:59.821423 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3d1f3000-1e9c-4d5f-9e40-13c29810a634 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1735 microversion: 2.1 time: 0.761501 Aug 04 14:10:59.825554 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1641/3276] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:10:59 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1735 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:10:59.849460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:10:59.851156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:10:59.870981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:59.872283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:10:59.874974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:10:59.876973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:00.438185 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e89251e-6b3c-4ea1-920c-7b2c73859f18 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.421264 Aug 04 14:11:00.442477 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1636/3277] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:10:59 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:00.466610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:00.470531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:00.482318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=56 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:00.488275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:00.489184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:00.490138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:00.490906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:00.531542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:00.532155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:00.532909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lazy-loading 'fault' on Instance uuid eac958b6-3fe8-4be4-95e7-2ac0be29c97a {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:11:00.704774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:00.713969 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a0f7a80-7637-4b9a-ba49-3e2ccbc8d90d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 200 len: 1314 microversion: 2.1 time: 0.268689 Aug 04 14:11:00.715010 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1637/3278] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:00 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:00.729637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5e96081-8133-4cd6-9bb3-9cab28a01e73 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:00.729637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d5e96081-8133-4cd6-9bb3-9cab28a01e73 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:00.744802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5e96081-8133-4cd6-9bb3-9cab28a01e73 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:00.745428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5e96081-8133-4cd6-9bb3-9cab28a01e73 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:00.749931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5e96081-8133-4cd6-9bb3-9cab28a01e73 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:00.750987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5e96081-8133-4cd6-9bb3-9cab28a01e73 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:01.027332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:01.052778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:01.058780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:01.062259 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-daf1b8ac-2e00-4f6b-8316-a1c9b02f2f06 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1892 microversion: 2.32 time: 1.233575 Aug 04 14:11:01.064554 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1642/3279] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:10:59 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1892 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:01.070852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f5c8903-f0d0-4bf6-aeca-27cd668ba717 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:01.072195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9f5c8903-f0d0-4bf6-aeca-27cd668ba717 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:01.082461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f5c8903-f0d0-4bf6-aeca-27cd668ba717 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:01.083235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f5c8903-f0d0-4bf6-aeca-27cd668ba717 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:01.084656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f5c8903-f0d0-4bf6-aeca-27cd668ba717 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:01.085369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f5c8903-f0d0-4bf6-aeca-27cd668ba717 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:01.520941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d5e96081-8133-4cd6-9bb3-9cab28a01e73 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:01.538030 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5e96081-8133-4cd6-9bb3-9cab28a01e73 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1608 microversion: 2.1 time: 0.820466 Aug 04 14:11:01.539171 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1638/3280] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:00 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1608 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:01.550191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ddc5e73e-41f9-479c-8130-d5202fe1ec30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:01.551993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ddc5e73e-41f9-479c-8130-d5202fe1ec30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:01.565405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ddc5e73e-41f9-479c-8130-d5202fe1ec30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:01.566229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ddc5e73e-41f9-479c-8130-d5202fe1ec30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:01.567772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ddc5e73e-41f9-479c-8130-d5202fe1ec30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:01.568589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ddc5e73e-41f9-479c-8130-d5202fe1ec30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:02.435530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9f5c8903-f0d0-4bf6-aeca-27cd668ba717 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:02.450291 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9f5c8903-f0d0-4bf6-aeca-27cd668ba717 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 1.383938 Aug 04 14:11:02.451558 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1643/3281] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:01 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:02.460719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-bc9db08d-1ea6-4ec0-aede-2fbb41fcc7db req-eeb43419-6a04-4f92-949b-348cbb3dec83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac958b6-3fe8-4be4-95e7-2ac0be29c97a", "name": "network-vif-deleted", "tag": "ae3a02ea-3e3e-4646-9115-47c84a95edb5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:02.479268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bc9db08d-1ea6-4ec0-aede-2fbb41fcc7db req-eeb43419-6a04-4f92-949b-348cbb3dec83 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:02.480827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bc9db08d-1ea6-4ec0-aede-2fbb41fcc7db req-eeb43419-6a04-4f92-949b-348cbb3dec83 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:02.505464 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bc9db08d-1ea6-4ec0-aede-2fbb41fcc7db req-eeb43419-6a04-4f92-949b-348cbb3dec83 service nova] Creating event network-vif-deleted:ae3a02ea-3e3e-4646-9115-47c84a95edb5 for instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a on n-h1-844627-10 Aug 04 14:11:02.515960 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-bc9db08d-1ea6-4ec0-aede-2fbb41fcc7db req-eeb43419-6a04-4f92-949b-348cbb3dec83 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061238 Aug 04 14:11:02.518366 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1644/3282] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:02.528958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1740cacf-da80-4d70-9321-5495b9c64ad9 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f46f3fb40d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1031138092", "description": "tempest-description-2121213964"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:02.740574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ddc5e73e-41f9-479c-8130-d5202fe1ec30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:02.753418 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ddc5e73e-41f9-479c-8130-d5202fe1ec30 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1528 microversion: 2.1 time: 1.212252 Aug 04 14:11:02.754386 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1639/3283] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:01 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1528 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:02.768007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d0c29167-667a-4363-bb03-cfa5975dbdf1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:02.769662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d0c29167-667a-4363-bb03-cfa5975dbdf1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:02.794640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0c29167-667a-4363-bb03-cfa5975dbdf1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:02.797434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0c29167-667a-4363-bb03-cfa5975dbdf1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:02.799558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0c29167-667a-4363-bb03-cfa5975dbdf1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:02.800162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0c29167-667a-4363-bb03-cfa5975dbdf1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:02.915567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:02.974173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:03.402857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d0c29167-667a-4363-bb03-cfa5975dbdf1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:03.426204 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d0c29167-667a-4363-bb03-cfa5975dbdf1 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1735 microversion: 2.1 time: 0.669310 Aug 04 14:11:03.427657 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1640/3284] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:02 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1735 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:03.438078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-cd6bec9d-272a-40d6-9a7b-90473b39cdaf req-83369838-5e6a-4750-84a9-b7a541f7407f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "tag": "2e3e1ebb-a26e-4cfc-b649-a6a9ee19768b"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:03.457733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cd6bec9d-272a-40d6-9a7b-90473b39cdaf req-83369838-5e6a-4750-84a9-b7a541f7407f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:03.458921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cd6bec9d-272a-40d6-9a7b-90473b39cdaf req-83369838-5e6a-4750-84a9-b7a541f7407f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:03.485080 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-cd6bec9d-272a-40d6-9a7b-90473b39cdaf req-83369838-5e6a-4750-84a9-b7a541f7407f service nova] Creating event network-changed:2e3e1ebb-a26e-4cfc-b649-a6a9ee19768b for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:03.501311 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-cd6bec9d-272a-40d6-9a7b-90473b39cdaf req-83369838-5e6a-4750-84a9-b7a541f7407f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070912 Aug 04 14:11:03.502774 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1641/3285] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:03.515679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:03.518313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:03.532175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:03.533138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:03.534507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:03.535268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:03.551863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1740cacf-da80-4d70-9321-5495b9c64ad9 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.030969 Aug 04 14:11:03.558076 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1645/3286] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:11:02 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:03.562804 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a HTTP/1.1 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'eac958b6-3fe8-4be4-95e7-2ac0be29c97a'} Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:03.566352 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:03.570793 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:03.570793 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:03.570793 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:03.570793 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:03.570793 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:03.570793 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:03.570793 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:03.570793 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:03.572572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:03.572572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:03.574235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:03.576404 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6855527a-c439-447e-a729-87ea3bffe0e3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 404 len: 111 microversion: 2.1 time: 0.071890 Aug 04 14:11:03.577833 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1642/3287] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:03 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:03.586362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-103c6234-565a-43e2-aed8-d4822147a3c7 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:03.587811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-103c6234-565a-43e2-aed8-d4822147a3c7 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:03.597796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-103c6234-565a-43e2-aed8-d4822147a3c7 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:03.598677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-103c6234-565a-43e2-aed8-d4822147a3c7 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:03.599917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-103c6234-565a-43e2-aed8-d4822147a3c7 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:03.600624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-103c6234-565a-43e2-aed8-d4822147a3c7 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:03.606305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:03.607136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:03.611278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:03.612102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:04.055766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-103c6234-565a-43e2-aed8-d4822147a3c7 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:04.067910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-103c6234-565a-43e2-aed8-d4822147a3c7 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1540 microversion: 2.1 time: 0.488140 Aug 04 14:11:04.068516 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1643/3288] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:03 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1540 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:04.073977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e3c4107a-384a-4d2b-82de-17e2e4200ab2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:04.075018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e3c4107a-384a-4d2b-82de-17e2e4200ab2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:04.084635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3c4107a-384a-4d2b-82de-17e2e4200ab2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:04.085625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3c4107a-384a-4d2b-82de-17e2e4200ab2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:04.086716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3c4107a-384a-4d2b-82de-17e2e4200ab2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:04.087386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3c4107a-384a-4d2b-82de-17e2e4200ab2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:05.508118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:05.521690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:05.529499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:05.531139 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-83884349-68fb-49ec-b98d-de3d6ad91f6f tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 1.971303 Aug 04 14:11:05.542439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e3c4107a-384a-4d2b-82de-17e2e4200ab2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:05.553319 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1646/3289] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:03 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:05.561348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e79ec15-1e1c-45e0-9347-47429a23d3db tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f4705686a60>, body: {"security_group_rule": {"parent_group_id": "da084044-f685-4874-9c09-eb0b8e6710b1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "cc1edc8f-0aff-4b3e-954b-370915a75786"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:05.571897 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e3c4107a-384a-4d2b-82de-17e2e4200ab2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1511 microversion: 2.1 time: 1.501621 Aug 04 14:11:05.590540 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1644/3290] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:04 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1511 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:05.660012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-715245661", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:05.803843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] validate_networks() for [('6821352e-0edb-41d3-8a4b-8a3f25fef7a8', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:11:06.776944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:11:06.777922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:11:06.778570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:11:06.779199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:11:06.779793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:11:06.800456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:06.805299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:06.806517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:06.809143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:06.888779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Getting quotas for project 786fea7d4481410d9591a181521c1eb4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:11:06.907859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Getting quotas for user f648ba00abbe4679a43d65bc925da013 and project 786fea7d4481410d9591a181521c1eb4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:11:06.953003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:11:06.958615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:11:07.151470 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ec28487d-870b-4488-b1a0-fefa41d4a5ea tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.558822 Aug 04 14:11:07.152635 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1645/3291] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:11:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:11:07.219142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6e90f0a-43df-40e5-b686-b3eb0817a7b0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:07.226567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6e90f0a-43df-40e5-b686-b3eb0817a7b0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:07.278449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6e90f0a-43df-40e5-b686-b3eb0817a7b0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:07.279749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6e90f0a-43df-40e5-b686-b3eb0817a7b0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:07.281809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6e90f0a-43df-40e5-b686-b3eb0817a7b0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:07.285778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6e90f0a-43df-40e5-b686-b3eb0817a7b0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:08.987955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6e90f0a-43df-40e5-b686-b3eb0817a7b0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:09.042725 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6e90f0a-43df-40e5-b686-b3eb0817a7b0 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1523 microversion: 2.1 time: 1.871810 Aug 04 14:11:09.076672 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1646/3292] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:07 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1523 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:09.111537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5a551124-4cfb-41a1-ac33-b19e1298798d req-4a883463-ebf9-4ce5-8f3e-59ee50f6d9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5cabc6-32b3-4ac9-a320-a293f5d8c27a", "name": "network-vif-plugged", "status": "completed", "tag": "c906b592-45e5-4118-861b-b643b3afbd49"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:09.181628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5a551124-4cfb-41a1-ac33-b19e1298798d req-4a883463-ebf9-4ce5-8f3e-59ee50f6d9f6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:09.183118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5a551124-4cfb-41a1-ac33-b19e1298798d req-4a883463-ebf9-4ce5-8f3e-59ee50f6d9f6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:09.225863 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5a551124-4cfb-41a1-ac33-b19e1298798d req-4a883463-ebf9-4ce5-8f3e-59ee50f6d9f6 service nova] Creating event network-vif-plugged:c906b592-45e5-4118-861b-b643b3afbd49 for instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a on n-h1-844627-10 Aug 04 14:11:09.243341 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5a551124-4cfb-41a1-ac33-b19e1298798d req-4a883463-ebf9-4ce5-8f3e-59ee50f6d9f6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164260 Aug 04 14:11:09.252434 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1647/3293] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:09.292857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a2b15b5d-109e-4481-9cae-de1f45a57ef5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:09.293732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a2b15b5d-109e-4481-9cae-de1f45a57ef5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:09.325317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2b15b5d-109e-4481-9cae-de1f45a57ef5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:09.327936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2b15b5d-109e-4481-9cae-de1f45a57ef5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:09.333627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2b15b5d-109e-4481-9cae-de1f45a57ef5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:09.334909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2b15b5d-109e-4481-9cae-de1f45a57ef5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:10.210399 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e79ec15-1e1c-45e0-9347-47429a23d3db tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 4.654957 Aug 04 14:11:10.212444 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1647/3294] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:11:05 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 4658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:10.235802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fff65055-2867-4aff-8033-1b070ddf25c8 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:10.237619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fff65055-2867-4aff-8033-1b070ddf25c8 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:10.273003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fff65055-2867-4aff-8033-1b070ddf25c8 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:10.281400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fff65055-2867-4aff-8033-1b070ddf25c8 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:10.284575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fff65055-2867-4aff-8033-1b070ddf25c8 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:10.285821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fff65055-2867-4aff-8033-1b070ddf25c8 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:10.654516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a2b15b5d-109e-4481-9cae-de1f45a57ef5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:10.686908 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a2b15b5d-109e-4481-9cae-de1f45a57ef5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1715 microversion: 2.1 time: 1.426677 Aug 04 14:11:10.716910 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1648/3295] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:09 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1715 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:10.716910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5ed810d0-6590-4349-8490-cb81ee455b9f req-7a2da72f-4915-44ca-89fa-1ce51a3915df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "tag": "3a7c07f8-c444-4382-b0bd-d61cc53d01fe"}, {"server_uuid": "81bf9735-dc4f-4216-82db-a6e836669b81", "name": "network-vif-deleted", "tag": "071f8975-48da-48be-876e-436a9c956685"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:10.763626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5ed810d0-6590-4349-8490-cb81ee455b9f req-7a2da72f-4915-44ca-89fa-1ce51a3915df service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:10.766085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5ed810d0-6590-4349-8490-cb81ee455b9f req-7a2da72f-4915-44ca-89fa-1ce51a3915df service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:10.861946 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5ed810d0-6590-4349-8490-cb81ee455b9f req-7a2da72f-4915-44ca-89fa-1ce51a3915df service nova] Creating event network-changed:3a7c07f8-c444-4382-b0bd-d61cc53d01fe for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:10.862872 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5ed810d0-6590-4349-8490-cb81ee455b9f req-7a2da72f-4915-44ca-89fa-1ce51a3915df service nova] Creating event network-vif-deleted:071f8975-48da-48be-876e-436a9c956685 for instance 81bf9735-dc4f-4216-82db-a6e836669b81 on n-h1-844627-10 Aug 04 14:11:10.913585 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5ed810d0-6590-4349-8490-cb81ee455b9f req-7a2da72f-4915-44ca-89fa-1ce51a3915df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.213501 Aug 04 14:11:10.920207 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1649/3296] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:10.942483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:10.956029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:10.969444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fff65055-2867-4aff-8033-1b070ddf25c8 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:10.971487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:10.972250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:10.973679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:10.974443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:10.980458 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fff65055-2867-4aff-8033-1b070ddf25c8 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1252 microversion: 2.1 time: 0.766035 Aug 04 14:11:10.987304 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1648/3297] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:10 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1252 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:10.995382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc6f131a-8cc7-4b7c-ab02-579a1b724cbf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:11.009625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bc6f131a-8cc7-4b7c-ab02-579a1b724cbf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:11.038751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc6f131a-8cc7-4b7c-ab02-579a1b724cbf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:11.047577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc6f131a-8cc7-4b7c-ab02-579a1b724cbf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:11.049605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc6f131a-8cc7-4b7c-ab02-579a1b724cbf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:11.057049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc6f131a-8cc7-4b7c-ab02-579a1b724cbf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:11.785440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:11.823744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:11.827764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:11.843367 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c10bc7d3-c479-4fb8-949f-7f8cb2f31af1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.920773 Aug 04 14:11:11.865625 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1650/3298] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:10 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:11.887333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c606945-c395-4214-9908-d29b88820f97 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:11.889672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3c606945-c395-4214-9908-d29b88820f97 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:11.913448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c606945-c395-4214-9908-d29b88820f97 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:11.917890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c606945-c395-4214-9908-d29b88820f97 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:11.919609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c606945-c395-4214-9908-d29b88820f97 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:11.929323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c606945-c395-4214-9908-d29b88820f97 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:12.253386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c606945-c395-4214-9908-d29b88820f97 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:12.280443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bc6f131a-8cc7-4b7c-ab02-579a1b724cbf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:12.293407 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c606945-c395-4214-9908-d29b88820f97 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1282 microversion: 2.1 time: 0.425456 Aug 04 14:11:12.300765 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1651/3299] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:11 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1282 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:12.325451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f54ec44-bfaf-41c9-89cb-525a858bae21 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:12.343635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f54ec44-bfaf-41c9-89cb-525a858bae21 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:12.354392 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bc6f131a-8cc7-4b7c-ab02-579a1b724cbf tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1488 microversion: 2.1 time: 1.365479 Aug 04 14:11:12.364803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f54ec44-bfaf-41c9-89cb-525a858bae21 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:12.365549 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1649/3300] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:10 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1488 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:12.374083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f54ec44-bfaf-41c9-89cb-525a858bae21 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:12.381035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f54ec44-bfaf-41c9-89cb-525a858bae21 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:12.381684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fedf1439-30b2-4147-95fe-fed93c0e6a27 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f47055cc1f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:12.382786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f54ec44-bfaf-41c9-89cb-525a858bae21 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:13.114069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9f54ec44-bfaf-41c9-89cb-525a858bae21 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:13.172080 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f54ec44-bfaf-41c9-89cb-525a858bae21 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1523 microversion: 2.1 time: 0.834645 Aug 04 14:11:13.175055 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1652/3301] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:12 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1523 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:13.201307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:13.205119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:13.237980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:13.251227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:13.253140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:13.254165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:13.583762 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] HTTP exception thrown: Cannot 'detach_volume' instance 27bb1614-6b27-48a6-b766-c7697e4169ac while it is in vm_state rescued Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Request method failure captured: Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments/107b8ec3-dca5-44de-9414-8c9d1f690bf2 HTTP/1.1 Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JxokQZWt73oCTeb2uIT1T61PPtBceW-GidRWsXDOZjQVnibDMlYFve8J2CmvNSqnoJ2gUswAJOQhT5G9sx82VvrXKfhYzVPLV5Gd4BsYAE7SpJCYfj1C3r3f1XD7yVS8i5KHJX727wlQRlE5KUXS609Oac6ysS4Xt8O7zqu2gmqzI Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}] Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 653fb03c7a4b4a61a57ecd4cdd610e86 Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: exception: Cannot 'detach_volume' instance 27bb1614-6b27-48a6-b766-c7697e4169ac while it is in vm_state rescued Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'server_id': '27bb1614-6b27-48a6-b766-c7697e4169ac', 'id': '107b8ec3-dca5-44de-9414-8c9d1f690bf2'} Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 27bb1614-6b27-48a6-b766-c7697e4169ac in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 27bb1614-6b27-48a6-b766-c7697e4169ac while it is in vm_state rescued Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:13.602579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:13.612260 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:13.612260 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:13.612260 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:13.612260 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:13.612260 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 27bb1614-6b27-48a6-b766-c7697e4169ac while it is in vm_state rescued Aug 04 14:11:13.612260 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:13.614734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Returning 409 to user: Cannot 'detach_volume' instance 27bb1614-6b27-48a6-b766-c7697e4169ac while it is in vm_state rescued {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:13.625150 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c5db7d50-33e8-4072-b0d1-c70926a2e700 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "DELETE /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments/107b8ec3-dca5-44de-9414-8c9d1f690bf2" status: 409 len: 152 microversion: 2.1 time: 0.444053 Aug 04 14:11:13.632948 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1653/3302] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:11:13 2022] DELETE /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments/107b8ec3-dca5-44de-9414-8c9d1f690bf2 => generated 152 bytes in 457 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:11:13.643681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8ce3c91c-dc0d-4d81-954f-0b535a21c23a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:13.658908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8ce3c91c-dc0d-4d81-954f-0b535a21c23a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:13.686260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8ce3c91c-dc0d-4d81-954f-0b535a21c23a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:13.687258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8ce3c91c-dc0d-4d81-954f-0b535a21c23a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:13.689002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8ce3c91c-dc0d-4d81-954f-0b535a21c23a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:13.690170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8ce3c91c-dc0d-4d81-954f-0b535a21c23a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:13.767502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:13.926692 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fedf1439-30b2-4147-95fe-fed93c0e6a27 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/cc1edc8f-0aff-4b3e-954b-370915a75786" status: 202 len: 0 microversion: 2.1 time: 1.558859 Aug 04 14:11:13.927839 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1650/3303] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:11:12 2022] DELETE /compute/v2.1/os-security-groups/cc1edc8f-0aff-4b3e-954b-370915a75786 => generated 0 bytes in 1562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:13.939506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb1203e1-bbb3-4133-9fa0-c9e10dc845be tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1648680781"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:13.943663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb1203e1-bbb3-4133-9fa0-c9e10dc845be tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:13.946393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:13.958695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb1203e1-bbb3-4133-9fa0-c9e10dc845be tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:13.962978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8ce3c91c-dc0d-4d81-954f-0b535a21c23a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7465fab904c4c41b229a7a1592eb95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cbda0bc0f0b492c8aa15e47d6ab9678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:13.972616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb1203e1-bbb3-4133-9fa0-c9e10dc845be tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:13.974630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb1203e1-bbb3-4133-9fa0-c9e10dc845be tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:13.975664 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8ce3c91c-dc0d-4d81-954f-0b535a21c23a tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 200 len: 1252 microversion: 2.1 time: 0.339645 Aug 04 14:11:13.976551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb1203e1-bbb3-4133-9fa0-c9e10dc845be tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:13.977477 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1654/3304] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:13 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 1252 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:13.988235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:13.989323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:14.014114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:14.015645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:14.017880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:14.022020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:14.134364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:14.214673 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb1203e1-bbb3-4133-9fa0-c9e10dc845be tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "PUT /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1061 microversion: 2.1 time: 0.284839 Aug 04 14:11:14.215873 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1651/3305] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:11:13 2022] PUT /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1061 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:14.236857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3c326dc0-df11-433e-96d0-c52d538afdf5 req-47dc95c3-3dbf-4201-ac3c-aaa370bfe51c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "tag": "9ffe961b-4486-4a47-94f7-7ba03bbfd645"}, {"name": "network-changed", "server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "tag": "9156d80b-d433-4a64-a4ce-78d05a747b2b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:14.312207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3c326dc0-df11-433e-96d0-c52d538afdf5 req-47dc95c3-3dbf-4201-ac3c-aaa370bfe51c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:14.313140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3c326dc0-df11-433e-96d0-c52d538afdf5 req-47dc95c3-3dbf-4201-ac3c-aaa370bfe51c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:14.352012 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3c326dc0-df11-433e-96d0-c52d538afdf5 req-47dc95c3-3dbf-4201-ac3c-aaa370bfe51c service nova] Creating event network-changed:9ffe961b-4486-4a47-94f7-7ba03bbfd645 for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:14.352540 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3c326dc0-df11-433e-96d0-c52d538afdf5 req-47dc95c3-3dbf-4201-ac3c-aaa370bfe51c service nova] Creating event network-changed:9156d80b-d433-4a64-a4ce-78d05a747b2b for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:14.377753 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3c326dc0-df11-433e-96d0-c52d538afdf5 req-47dc95c3-3dbf-4201-ac3c-aaa370bfe51c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.160114 Aug 04 14:11:14.378625 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1652/3306] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:14.384078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-57f6362e-0d68-4a37-8a21-fc6db02e3b3d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:14.384805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-57f6362e-0d68-4a37-8a21-fc6db02e3b3d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:14.422750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57f6362e-0d68-4a37-8a21-fc6db02e3b3d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:14.423861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57f6362e-0d68-4a37-8a21-fc6db02e3b3d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:14.424745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57f6362e-0d68-4a37-8a21-fc6db02e3b3d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:14.425209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57f6362e-0d68-4a37-8a21-fc6db02e3b3d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:14.764134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-57f6362e-0d68-4a37-8a21-fc6db02e3b3d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:14.780244 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-57f6362e-0d68-4a37-8a21-fc6db02e3b3d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1282 microversion: 2.1 time: 0.400382 Aug 04 14:11:14.781985 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1653/3307] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:14 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1282 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:14.788088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eeab77eb-b66f-40e9-a6e9-e95575f911a7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:14.788653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eeab77eb-b66f-40e9-a6e9-e95575f911a7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:14.802972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeab77eb-b66f-40e9-a6e9-e95575f911a7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:14.805818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeab77eb-b66f-40e9-a6e9-e95575f911a7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:14.806809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeab77eb-b66f-40e9-a6e9-e95575f911a7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:14.807339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeab77eb-b66f-40e9-a6e9-e95575f911a7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:14.929548 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eeab77eb-b66f-40e9-a6e9-e95575f911a7 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/action" status: 202 len: 0 microversion: 2.1 time: 0.140451 Aug 04 14:11:14.932186 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1654/3308] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:11:14 2022] POST /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:14.941519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ace9906-df0a-4eb9-8dc0-95b7268364a9 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f4705609550>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:14.956605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:14.974990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:14.977195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:14.979255 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b4978311-3ac5-41f4-bef5-e91d8f987bdf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.999797 Aug 04 14:11:15.011688 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1655/3309] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:13 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:15.023991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-891eb686-4ec3-4298-a843-384b6bcc0960 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:15.026899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-891eb686-4ec3-4298-a843-384b6bcc0960 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:15.039620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-891eb686-4ec3-4298-a843-384b6bcc0960 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:15.044468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-891eb686-4ec3-4298-a843-384b6bcc0960 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:15.046363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-891eb686-4ec3-4298-a843-384b6bcc0960 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:15.048788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-891eb686-4ec3-4298-a843-384b6bcc0960 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:15.410772 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ace9906-df0a-4eb9-8dc0-95b7268364a9 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/da084044-f685-4874-9c09-eb0b8e6710b1" status: 200 len: 246 microversion: 2.1 time: 0.476542 Aug 04 14:11:15.420217 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1655/3310] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 14:11:14 2022] GET /compute/v2.1/os-security-groups/da084044-f685-4874-9c09-eb0b8e6710b1 => generated 246 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:15.428261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-081157b2-9f7d-4ec6-985d-8d8f6308284f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:15.430698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-081157b2-9f7d-4ec6-985d-8d8f6308284f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:15.458655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-081157b2-9f7d-4ec6-985d-8d8f6308284f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:15.460174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-081157b2-9f7d-4ec6-985d-8d8f6308284f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:15.463884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-081157b2-9f7d-4ec6-985d-8d8f6308284f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:15.466642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-081157b2-9f7d-4ec6-985d-8d8f6308284f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:16.191263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-891eb686-4ec3-4298-a843-384b6bcc0960 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:16.235844 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-891eb686-4ec3-4298-a843-384b6bcc0960 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1523 microversion: 2.1 time: 1.221626 Aug 04 14:11:16.241385 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1656/3311] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:15 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1523 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:16.270357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3e8fcb0b-1752-41b2-b8a3-ad016d9f6332 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:16.274457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3e8fcb0b-1752-41b2-b8a3-ad016d9f6332 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:16.302050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e8fcb0b-1752-41b2-b8a3-ad016d9f6332 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:16.307364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e8fcb0b-1752-41b2-b8a3-ad016d9f6332 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:16.310177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e8fcb0b-1752-41b2-b8a3-ad016d9f6332 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:16.311586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e8fcb0b-1752-41b2-b8a3-ad016d9f6332 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:16.847410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:16.936033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:17.422128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-081157b2-9f7d-4ec6-985d-8d8f6308284f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:17.445140 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-081157b2-9f7d-4ec6-985d-8d8f6308284f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1488 microversion: 2.1 time: 2.031174 Aug 04 14:11:17.446359 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1656/3312] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:15 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1488 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:17.457656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:17.458639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] [instance: 81bf9735-dc4f-4216-82db-a6e836669b81] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:17.489998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:17.490460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:17.509274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:17.509897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:17.553048 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] HTTP exception thrown: Instance 81bf9735-dc4f-4216-82db-a6e836669b81 could not be found. Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Request method failure captured: Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 HTTP/1.1 Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69LX8CHk4fO7pw9XvuOCuhXs0L8K8w5U548Q5A_5gIV8mCjZQ-z3YJzhnbclr_AnIOVn9dcST3XKV_hBNKuHKpzg0lOWy0QnCqhded8LjrPqp_IArbNzwyqeumEA7XydUNF6rKjeBTQTsaCzZIJKsJC4dbEY9Qc0nLvzZA2LX8aQp9E Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 4cbda0bc0f0b492c8aa15e47d6ab9678 Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestBootFromVolume-1082871425 Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cbda0bc0f0b492c8aa15e47d6ab9678"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4cbda0bc0f0b492c8aa15e47d6ab9678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4cbda0bc0f0b492c8aa15e47d6ab9678"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4cbda0bc0f0b492c8aa15e47d6ab9678"}]}] Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestBootFromVolume-1082871425 Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 4cbda0bc0f0b492c8aa15e47d6ab9678 Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1082871425 Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestBootFromVolume-1082871425-project Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f7465fab904c4c41b229a7a1592eb95b Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestBootFromVolume-1082871425-project Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 81bf9735-dc4f-4216-82db-a6e836669b81 could not be found. Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '81bf9735-dc4f-4216-82db-a6e836669b81'} Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81bf9735-dc4f-4216-82db-a6e836669b81 could not be found. Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81bf9735-dc4f-4216-82db-a6e836669b81 could not be found. Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:17.563319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:17.569285 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:17.569285 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:17.569285 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:17.569285 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:17.569285 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:17.569285 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81bf9735-dc4f-4216-82db-a6e836669b81 could not be found. Aug 04 14:11:17.569285 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:17.577815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Returning 404 to user: Instance 81bf9735-dc4f-4216-82db-a6e836669b81 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:17.579077 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dc9a15e0-e3c8-4a71-a572-367bb6041a4f tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81" status: 404 len: 111 microversion: 2.1 time: 0.131386 Aug 04 14:11:17.580895 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1657/3313] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:17 2022] GET /compute/v2.1/servers/81bf9735-dc4f-4216-82db-a6e836669b81 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:17.589355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-062e8b5a-60f9-4a36-8c1b-7031b9847506 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f470093f3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-196507440", "description": "tempest-description-1014049056"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:18.062325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3e8fcb0b-1752-41b2-b8a3-ad016d9f6332 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:18.102724 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3e8fcb0b-1752-41b2-b8a3-ad016d9f6332 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1723 microversion: 2.1 time: 1.859209 Aug 04 14:11:18.103655 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1657/3314] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:16 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1723 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:18.160969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0691fffb-259e-4b3c-8961-fa41c8b9185b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:18.169546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0691fffb-259e-4b3c-8961-fa41c8b9185b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:18.186330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0691fffb-259e-4b3c-8961-fa41c8b9185b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:18.187192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0691fffb-259e-4b3c-8961-fa41c8b9185b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:18.188238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0691fffb-259e-4b3c-8961-fa41c8b9185b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:18.193755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0691fffb-259e-4b3c-8961-fa41c8b9185b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:18.379145 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-062e8b5a-60f9-4a36-8c1b-7031b9847506 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.796407 Aug 04 14:11:18.381811 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1658/3315] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:11:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:18.401874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:18.406119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:18.432841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:18.435040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:18.437211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:18.438627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:19.017500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0691fffb-259e-4b3c-8961-fa41c8b9185b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:19.028158 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0691fffb-259e-4b3c-8961-fa41c8b9185b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1324 microversion: 2.1 time: 0.894056 Aug 04 14:11:19.050344 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1658/3316] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:18 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1324 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:19.081300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ae3a6d4-c684-40f7-a92a-80eadd3c3f09 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:19.087894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ae3a6d4-c684-40f7-a92a-80eadd3c3f09 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:19.119367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ae3a6d4-c684-40f7-a92a-80eadd3c3f09 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:19.122929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ae3a6d4-c684-40f7-a92a-80eadd3c3f09 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:19.127441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ae3a6d4-c684-40f7-a92a-80eadd3c3f09 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:19.131406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ae3a6d4-c684-40f7-a92a-80eadd3c3f09 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:19.424939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:19.458227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:19.461121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:19.462796 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-54fd6c9d-dd76-4a8a-a88a-a45a29c371a5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 1.078959 Aug 04 14:11:19.477366 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1659/3317] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:18 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:19.486408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12303474-ba43-4c38-b8ab-d90fdb84dff9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:19.487427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12303474-ba43-4c38-b8ab-d90fdb84dff9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:19.494764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12303474-ba43-4c38-b8ab-d90fdb84dff9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:19.495578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12303474-ba43-4c38-b8ab-d90fdb84dff9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:19.496574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12303474-ba43-4c38-b8ab-d90fdb84dff9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:19.497217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12303474-ba43-4c38-b8ab-d90fdb84dff9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:19.617051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ae3a6d4-c684-40f7-a92a-80eadd3c3f09 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:19.630264 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ae3a6d4-c684-40f7-a92a-80eadd3c3f09 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1523 microversion: 2.1 time: 0.577931 Aug 04 14:11:19.631159 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1659/3318] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:19 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1523 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:19.651674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-65e34545-71d2-461e-aa09-fdf0d1504760 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] Calling method '.version_select at 0x7f4700013160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:19.692135 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-65e34545-71d2-461e-aa09-fdf0d1504760 tempest-ServersTestBootFromVolume-1082871425 tempest-ServersTestBootFromVolume-1082871425-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-759037525" status: 202 len: 0 microversion: 2.1 time: 0.059832 Aug 04 14:11:19.697662 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1660/3319] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 14:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-759037525 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:19.706410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-47242dca-e161-4f30-b121-210def489e4f tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f47055900d0>, body: {"security_group_rule": {"parent_group_id": "96f0eed6-055b-4de7-8329-96ecf0c8675b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:20.191663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12303474-ba43-4c38-b8ab-d90fdb84dff9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:20.199880 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12303474-ba43-4c38-b8ab-d90fdb84dff9 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1488 microversion: 2.1 time: 0.721234 Aug 04 14:11:20.208023 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1660/3320] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:19 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1488 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:20.217377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7f9f1f9-36f9-4688-8cb7-9de67f3737fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:20.223805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e7f9f1f9-36f9-4688-8cb7-9de67f3737fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:20.241607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7f9f1f9-36f9-4688-8cb7-9de67f3737fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:20.242065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7f9f1f9-36f9-4688-8cb7-9de67f3737fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:20.242883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7f9f1f9-36f9-4688-8cb7-9de67f3737fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:20.243486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7f9f1f9-36f9-4688-8cb7-9de67f3737fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:20.870509 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-47242dca-e161-4f30-b121-210def489e4f tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.175918 Aug 04 14:11:20.873528 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1661/3321] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:11:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:20.894288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-17cbbdfa-3265-4960-8ac0-e19fe70f08b8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:20.896267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-17cbbdfa-3265-4960-8ac0-e19fe70f08b8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:20.924520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17cbbdfa-3265-4960-8ac0-e19fe70f08b8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:20.925756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17cbbdfa-3265-4960-8ac0-e19fe70f08b8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:20.927643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17cbbdfa-3265-4960-8ac0-e19fe70f08b8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:20.941722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17cbbdfa-3265-4960-8ac0-e19fe70f08b8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:21.170742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e7f9f1f9-36f9-4688-8cb7-9de67f3737fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:21.190287 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e7f9f1f9-36f9-4688-8cb7-9de67f3737fd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1723 microversion: 2.1 time: 0.979282 Aug 04 14:11:21.206649 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1661/3322] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:20 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1723 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:21.215103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4cd8977e-12b1-4f5f-8779-70b34a8fcd02 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:21.215639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4cd8977e-12b1-4f5f-8779-70b34a8fcd02 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:21.224433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4cd8977e-12b1-4f5f-8779-70b34a8fcd02 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:21.224922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4cd8977e-12b1-4f5f-8779-70b34a8fcd02 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:21.225832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4cd8977e-12b1-4f5f-8779-70b34a8fcd02 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:21.227064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4cd8977e-12b1-4f5f-8779-70b34a8fcd02 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:21.261134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4cd8977e-12b1-4f5f-8779-70b34a8fcd02 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:11:21.487926 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4cd8977e-12b1-4f5f-8779-70b34a8fcd02 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 204 len: 0 microversion: 2.1 time: 0.278366 Aug 04 14:11:21.498631 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1662/3323] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:21 2022] DELETE /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:11:21.510039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:21.511663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:21.529885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:21.536613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:21.538927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:21.540410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:21.661685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-17cbbdfa-3265-4960-8ac0-e19fe70f08b8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:21.691524 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-17cbbdfa-3265-4960-8ac0-e19fe70f08b8 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1324 microversion: 2.1 time: 0.808207 Aug 04 14:11:21.705254 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1662/3324] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:20 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1324 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:21.715004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f84ce238-3e76-4889-8cfe-e9809c33c08a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:21.721978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f84ce238-3e76-4889-8cfe-e9809c33c08a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:21.739690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f84ce238-3e76-4889-8cfe-e9809c33c08a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:21.743229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f84ce238-3e76-4889-8cfe-e9809c33c08a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:21.748711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f84ce238-3e76-4889-8cfe-e9809c33c08a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:21.750173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f84ce238-3e76-4889-8cfe-e9809c33c08a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:22.360623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:22.383226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:22.387092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:22.389933 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-240fb287-29c2-4ebf-a211-8f17e7dd03a8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.888813 Aug 04 14:11:22.393484 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1663/3325] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:21 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:22.405401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dbb288a6-3100-4993-865c-da806171ccf6 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Action: 'create', calling method: .version_select at 0x7f4705533f70>, body: {"security_group_rule": {"parent_group_id": "96f0eed6-055b-4de7-8329-96ecf0c8675b", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:22.519229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f84ce238-3e76-4889-8cfe-e9809c33c08a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:22.610986 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f84ce238-3e76-4889-8cfe-e9809c33c08a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1523 microversion: 2.1 time: 0.908464 Aug 04 14:11:22.619588 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1663/3326] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:21 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1523 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:22.634636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8971bf24-5c58-44d3-88fd-4b1d8347f443 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:22.635277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8971bf24-5c58-44d3-88fd-4b1d8347f443 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:22.642436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8971bf24-5c58-44d3-88fd-4b1d8347f443 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:22.645623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8971bf24-5c58-44d3-88fd-4b1d8347f443 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:22.648626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8971bf24-5c58-44d3-88fd-4b1d8347f443 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:22.649383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8971bf24-5c58-44d3-88fd-4b1d8347f443 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:24.303784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8971bf24-5c58-44d3-88fd-4b1d8347f443 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:24.332390 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8971bf24-5c58-44d3-88fd-4b1d8347f443 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 200 len: 1494 microversion: 2.1 time: 1.711554 Aug 04 14:11:24.337271 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1664/3327] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:22 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 1494 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:24.355054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7459782d-e4a9-4bf9-8d11-7dad6ea03b9e req-4427631e-7866-418c-b050-049c89345c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed", "tag": "3e3c049a-cf93-4b57-b949-7dd918adfa54"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:24.369588 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dbb288a6-3100-4993-865c-da806171ccf6 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.973064 Aug 04 14:11:24.371184 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1664/3328] 10.222.0.66 () {60 vars in 1195 bytes} [Thu Aug 4 14:11:22 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:24.387447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-16767fbb-e6e8-45a9-abaa-5df9343eb848 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:24.391349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-16767fbb-e6e8-45a9-abaa-5df9343eb848 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:24.406527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7459782d-e4a9-4bf9-8d11-7dad6ea03b9e req-4427631e-7866-418c-b050-049c89345c06 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:24.407399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7459782d-e4a9-4bf9-8d11-7dad6ea03b9e req-4427631e-7866-418c-b050-049c89345c06 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:24.424678 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7459782d-e4a9-4bf9-8d11-7dad6ea03b9e req-4427631e-7866-418c-b050-049c89345c06 service nova] Creating event network-changed:3e3c049a-cf93-4b57-b949-7dd918adfa54 for instance a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed on n-h1-844627-10 Aug 04 14:11:24.434811 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7459782d-e4a9-4bf9-8d11-7dad6ea03b9e req-4427631e-7866-418c-b050-049c89345c06 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091253 Aug 04 14:11:24.436113 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1665/3329] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:24.448757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16767fbb-e6e8-45a9-abaa-5df9343eb848 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:24.455802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2bba08b5-fa9f-49f8-bd48-f5edee805b29 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:24.457108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2bba08b5-fa9f-49f8-bd48-f5edee805b29 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:24.459614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16767fbb-e6e8-45a9-abaa-5df9343eb848 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:24.461936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16767fbb-e6e8-45a9-abaa-5df9343eb848 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:24.471811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16767fbb-e6e8-45a9-abaa-5df9343eb848 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:24.479874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bba08b5-fa9f-49f8-bd48-f5edee805b29 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:24.481442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bba08b5-fa9f-49f8-bd48-f5edee805b29 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:24.482851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bba08b5-fa9f-49f8-bd48-f5edee805b29 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:24.488214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bba08b5-fa9f-49f8-bd48-f5edee805b29 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:25.558384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2bba08b5-fa9f-49f8-bd48-f5edee805b29 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:25.570487 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2bba08b5-fa9f-49f8-bd48-f5edee805b29 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1324 microversion: 2.1 time: 1.128666 Aug 04 14:11:25.575198 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1666/3330] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:24 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1324 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:25.588915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:25.594213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:25.611473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:25.612356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:25.613537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:25.616042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:25.663400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-16767fbb-e6e8-45a9-abaa-5df9343eb848 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:25.685940 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-16767fbb-e6e8-45a9-abaa-5df9343eb848 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1729 microversion: 2.1 time: 1.309713 Aug 04 14:11:25.688596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1665/3331] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:24 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1729 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:25.706221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d8c4f57-4d1b-4a64-888b-6d461f16ae8a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:25.706885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7d8c4f57-4d1b-4a64-888b-6d461f16ae8a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:25.742787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d8c4f57-4d1b-4a64-888b-6d461f16ae8a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:25.744080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d8c4f57-4d1b-4a64-888b-6d461f16ae8a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:25.747238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d8c4f57-4d1b-4a64-888b-6d461f16ae8a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:25.747745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d8c4f57-4d1b-4a64-888b-6d461f16ae8a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:26.522559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7d8c4f57-4d1b-4a64-888b-6d461f16ae8a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:26.569263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7d8c4f57-4d1b-4a64-888b-6d461f16ae8a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1523 microversion: 2.1 time: 0.877659 Aug 04 14:11:26.578157 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1666/3332] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:25 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1523 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:26.611064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f72cc712-3624-4221-98e2-989c264eac56 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f46f3f51040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:26.888164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:26.903708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:26.916297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:26.918064 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b9762b0c-2625-420a-a7ad-fbdf4c5cfaa2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 1.339969 Aug 04 14:11:26.919578 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1667/3333] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:25 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:26.929839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c63fdd15-52f3-43dd-817d-5edf7e1094fb req-9c1256d1-ff17-4d69-965a-b282f11420d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b00e80b-401a-4efe-b5cd-d79b6f1fe587", "name": "network-vif-deleted", "tag": "db0b7e55-abab-4576-9d30-7da64a519e8c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:26.963622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c63fdd15-52f3-43dd-817d-5edf7e1094fb req-9c1256d1-ff17-4d69-965a-b282f11420d6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:26.964423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c63fdd15-52f3-43dd-817d-5edf7e1094fb req-9c1256d1-ff17-4d69-965a-b282f11420d6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:26.977575 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c63fdd15-52f3-43dd-817d-5edf7e1094fb req-9c1256d1-ff17-4d69-965a-b282f11420d6 service nova] Creating event network-vif-deleted:db0b7e55-abab-4576-9d30-7da64a519e8c for instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 on n-h2-844627-10 Aug 04 14:11:26.993878 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c63fdd15-52f3-43dd-817d-5edf7e1094fb req-9c1256d1-ff17-4d69-965a-b282f11420d6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072523 Aug 04 14:11:26.997031 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1668/3334] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:27.005976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:27.017994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:27.025557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:27.033337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:27.034634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:27.035319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:27.062575 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 HTTP/1.1 Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '0b00e80b-401a-4efe-b5cd-d79b6f1fe587'} Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:27.069277 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:27.074790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:27.074790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:27.074790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:27.074790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:27.074790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:27.074790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:27.074790 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:27.074790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:27.076014 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7692616c-ca83-4b46-aa4f-6c322e8fda2e tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 404 len: 111 microversion: 2.1 time: 0.076640 Aug 04 14:11:27.081614 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1669/3335] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:26 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:27.093518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5156a002-736b-48d7-b4e0-960399ae0a86 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:27.097721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5156a002-736b-48d7-b4e0-960399ae0a86 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:27.110382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5156a002-736b-48d7-b4e0-960399ae0a86 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:27.117050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5156a002-736b-48d7-b4e0-960399ae0a86 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:27.118225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5156a002-736b-48d7-b4e0-960399ae0a86 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:27.118937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5156a002-736b-48d7-b4e0-960399ae0a86 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:27.571008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f72cc712-3624-4221-98e2-989c264eac56 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "GET /compute/v2.1/os-security-groups/96f0eed6-055b-4de7-8329-96ecf0c8675b" status: 200 len: 664 microversion: 2.1 time: 0.985344 Aug 04 14:11:27.572434 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1667/3336] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 14:11:26 2022] GET /compute/v2.1/os-security-groups/96f0eed6-055b-4de7-8329-96ecf0c8675b => generated 664 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:27.591004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b86206e8-f0c1-4cbd-9cdf-c811bf1f27f3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:27.592442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b86206e8-f0c1-4cbd-9cdf-c811bf1f27f3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:27.615494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b86206e8-f0c1-4cbd-9cdf-c811bf1f27f3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:27.616616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b86206e8-f0c1-4cbd-9cdf-c811bf1f27f3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:27.621543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b86206e8-f0c1-4cbd-9cdf-c811bf1f27f3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:27.625141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b86206e8-f0c1-4cbd-9cdf-c811bf1f27f3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:28.054919 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5156a002-736b-48d7-b4e0-960399ae0a86 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.971665 Aug 04 14:11:28.056458 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1670/3337] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:11:27 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-interface => generated 285 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:28.071587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:28.072620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:28.108725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:28.109597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:28.113748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:28.119043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:28.196547 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 HTTP/1.1 Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '0b00e80b-401a-4efe-b5cd-d79b6f1fe587'} Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:28.198931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:28.203855 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:28.211217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:28.211217 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-645c0a49-8a78-48ed-b79e-b18ea421c435 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 404 len: 111 microversion: 2.1 time: 0.143146 Aug 04 14:11:28.211687 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1671/3338] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:28 2022] DELETE /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:28.216992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a27eca95-66d2-47f0-bccc-dc091c31c1e1 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f4700080160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:28.297096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b86206e8-f0c1-4cbd-9cdf-c811bf1f27f3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:28.327048 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b86206e8-f0c1-4cbd-9cdf-c811bf1f27f3 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1324 microversion: 2.1 time: 0.752570 Aug 04 14:11:28.333523 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1668/3339] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:27 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1324 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:28.351189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb22e779-bfc5-433d-8fe0-d29f3c4970e3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:28.361560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb22e779-bfc5-433d-8fe0-d29f3c4970e3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:28.393658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb22e779-bfc5-433d-8fe0-d29f3c4970e3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:28.395960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb22e779-bfc5-433d-8fe0-d29f3c4970e3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:28.398548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb22e779-bfc5-433d-8fe0-d29f3c4970e3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:28.404085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb22e779-bfc5-433d-8fe0-d29f3c4970e3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:29.101965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb22e779-bfc5-433d-8fe0-d29f3c4970e3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:29.120076 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb22e779-bfc5-433d-8fe0-d29f3c4970e3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1523 microversion: 2.1 time: 0.784269 Aug 04 14:11:29.121431 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1669/3340] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:28 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1523 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:29.127997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:29.132995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:29.154867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:29.155782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:29.156630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:29.157659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:29.199540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:31.575795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:31.623415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:31.635300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:31.645053 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1c84c06a-8c43-4bcd-962f-e5cef1bb7557 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 2.521011 Aug 04 14:11:31.646655 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1670/3341] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:29 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 2524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:31.656758 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a27eca95-66d2-47f0-bccc-dc091c31c1e1 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-group-rules/a6775899-82a4-41a3-afe9-b2a7e60ea2b1" status: 202 len: 0 microversion: 2.1 time: 3.443175 Aug 04 14:11:31.659874 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1672/3342] 10.222.0.66 () {58 vars in 1287 bytes} [Thu Aug 4 14:11:28 2022] DELETE /compute/v2.1/os-security-group-rules/a6775899-82a4-41a3-afe9-b2a7e60ea2b1 => generated 0 bytes in 3447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:31.668841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:31.674618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 0b00e80b-401a-4efe-b5cd-d79b6f1fe587] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:31.678843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9f673f4-edea-4c3f-8ca5-f5c1d9f14ca5 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:31.680618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a9f673f4-edea-4c3f-8ca5-f5c1d9f14ca5 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:31.703786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:31.708367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:31.709633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:31.712934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9f673f4-edea-4c3f-8ca5-f5c1d9f14ca5 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:31.713589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:31.714667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:31.718784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9f673f4-edea-4c3f-8ca5-f5c1d9f14ca5 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:31.721110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9f673f4-edea-4c3f-8ca5-f5c1d9f14ca5 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:31.734773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9f673f4-edea-4c3f-8ca5-f5c1d9f14ca5 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:31.792054 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 HTTP/1.1 Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '0b00e80b-401a-4efe-b5cd-d79b6f1fe587'} Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:31.806853 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:31.815534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:31.815534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:31.815534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:31.815534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:31.815534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:31.815534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. Aug 04 14:11:31.815534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:31.822518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 0b00e80b-401a-4efe-b5cd-d79b6f1fe587 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:31.825262 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b1e0d296-6339-47b0-b8d8-7177c2f987a4 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587" status: 404 len: 111 microversion: 2.1 time: 0.174038 Aug 04 14:11:31.831197 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1671/3343] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:31 2022] GET /compute/v2.1/servers/0b00e80b-401a-4efe-b5cd-d79b6f1fe587 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:31.853203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8fa47d1a-058e-4535-a153-9dab55834c4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:31.866584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8fa47d1a-058e-4535-a153-9dab55834c4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:31.888041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fa47d1a-058e-4535-a153-9dab55834c4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:31.901350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fa47d1a-058e-4535-a153-9dab55834c4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:31.903512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fa47d1a-058e-4535-a153-9dab55834c4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:31.904762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fa47d1a-058e-4535-a153-9dab55834c4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:32.367048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8fa47d1a-058e-4535-a153-9dab55834c4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:32.405401 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8fa47d1a-058e-4535-a153-9dab55834c4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1523 microversion: 2.1 time: 0.571520 Aug 04 14:11:32.428380 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1672/3344] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:31 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1523 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:32.447610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37ce8acd-c71a-45c2-8b8c-9ebaf18e51bf tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f46f3f51040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:32.646530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a9f673f4-edea-4c3f-8ca5-f5c1d9f14ca5 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:32.659775 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a9f673f4-edea-4c3f-8ca5-f5c1d9f14ca5 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1324 microversion: 2.1 time: 0.997281 Aug 04 14:11:32.662700 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1673/3345] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:31 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1324 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:32.674939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-91fd2e25-8a7d-4571-ab12-f59dca386c1d req-bac46642-fd58-48f1-b72f-55bc8103cb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb1614-6b27-48a6-b766-c7697e4169ac", "tag": "04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:32.694105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-91fd2e25-8a7d-4571-ab12-f59dca386c1d req-bac46642-fd58-48f1-b72f-55bc8103cb80 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:32.694941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-91fd2e25-8a7d-4571-ab12-f59dca386c1d req-bac46642-fd58-48f1-b72f-55bc8103cb80 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:32.718482 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-91fd2e25-8a7d-4571-ab12-f59dca386c1d req-bac46642-fd58-48f1-b72f-55bc8103cb80 service nova] Creating event network-changed:04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf for instance 27bb1614-6b27-48a6-b766-c7697e4169ac on n-h2-844627-10 Aug 04 14:11:32.761614 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-91fd2e25-8a7d-4571-ab12-f59dca386c1d req-bac46642-fd58-48f1-b72f-55bc8103cb80 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095961 Aug 04 14:11:32.772947 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1674/3346] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:32.794197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:32.795316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:32.841395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:32.842299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:32.846820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:32.847794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:32.884805 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 HTTP/1.1 Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '609f1a59-c11f-4ca1-8ba9-589f3e3845d8'} Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:32.887274 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:32.892634 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:32.896754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:32.898312 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-abfe31d2-f363-458d-aaf5-823512122153 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 404 len: 111 microversion: 2.1 time: 0.121563 Aug 04 14:11:32.899096 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1675/3347] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:32 2022] DELETE /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:32.906098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:32.908765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:32.920034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:32.920585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:32.921529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:32.922111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:33.551305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:33.568810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:33.571248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:33.572847 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d22f8b4-a1e2-4080-8c6f-62810840182b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.672446 Aug 04 14:11:33.573740 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1676/3348] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:32 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:33.627218 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37ce8acd-c71a-45c2-8b8c-9ebaf18e51bf tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/96f0eed6-055b-4de7-8329-96ecf0c8675b" status: 202 len: 0 microversion: 2.1 time: 1.195742 Aug 04 14:11:33.628829 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1673/3349] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:11:32 2022] DELETE /compute/v2.1/os-security-groups/96f0eed6-055b-4de7-8329-96ecf0c8675b => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:33.629048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:33.630288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 609f1a59-c11f-4ca1-8ba9-589f3e3845d8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:33.645166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:33.646047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:33.647633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:33.649193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:33.735524 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 HTTP/1.1 Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '609f1a59-c11f-4ca1-8ba9-589f3e3845d8'} Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:33.746687 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.752449 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:33.752449 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:33.752449 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:33.752449 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:33.752449 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:33.752449 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. Aug 04 14:11:33.752449 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.764817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 609f1a59-c11f-4ca1-8ba9-589f3e3845d8 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:33.767388 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d84167a9-095c-41ff-bed2-440a42879e5c tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8" status: 404 len: 111 microversion: 2.1 time: 0.159108 Aug 04 14:11:33.772246 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1677/3350] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:33 2022] GET /compute/v2.1/servers/609f1a59-c11f-4ca1-8ba9-589f3e3845d8 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:33.783078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-034d802c-2e41-4eeb-9192-ba116669aadb tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f47001c0b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:33.891817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG neutronclient.v2_0.client [None req-034d802c-2e41-4eeb-9192-ba116669aadb tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cc1edc8f-0aff-4b3e-954b-370915a75786 does not exist", "detail": ""}} {{(pid=130960) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 14:11:33.900315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.security_group_api [None req-034d802c-2e41-4eeb-9192-ba116669aadb tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Neutron security group cc1edc8f-0aff-4b3e-954b-370915a75786 not found {{(pid=130960) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 14:11:33.901465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-034d802c-2e41-4eeb-9192-ba116669aadb tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] HTTP exception thrown: Security group cc1edc8f-0aff-4b3e-954b-370915a75786 does not exist Aug 04 14:11:33.901465 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-e80590f5-a6a3-4f80-a0ec-f2546270a1ea'] Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-034d802c-2e41-4eeb-9192-ba116669aadb tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Request method failure captured: Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-security-groups/cc1edc8f-0aff-4b3e-954b-370915a75786 HTTP/1.1 Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69NfSifgA5YgbIFrEUAhoo5jiQOR56uO-Gp0OjxbfRhkRowCX_shtUXrw9Gr3Iy2dLqkq8Pc9zvG5AiwA4Wh81Z7sU6cFCNWbvKQzKhATLtxglEcWs6dZqi6889rzII6x33WAyZIOEsrHqFk4qTfK4b50E5moqK0VHdixA4Hv7awOXw Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ea5e6ebb24e44ab58228ba82033ed03b Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1026094437 Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ea5e6ebb24e44ab58228ba82033ed03b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ea5e6ebb24e44ab58228ba82033ed03b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ea5e6ebb24e44ab58228ba82033ed03b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ea5e6ebb24e44ab58228ba82033ed03b"}]}] Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1026094437 Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ea5e6ebb24e44ab58228ba82033ed03b Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1026094437 Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-SecurityGroupRulesTestJSON-1026094437-project Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 2aac88fbce2b4860969f04701327b731 Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1026094437-project Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: exception: Security group cc1edc8f-0aff-4b3e-954b-370915a75786 does not exist Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-e80590f5-a6a3-4f80-a0ec-f2546270a1ea'] Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'cc1edc8f-0aff-4b3e-954b-370915a75786'} Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 14:11:33.904656 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cc1edc8f-0aff-4b3e-954b-370915a75786 does not exist Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e80590f5-a6a3-4f80-a0ec-f2546270a1ea'] Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cc1edc8f-0aff-4b3e-954b-370915a75786 does not exist Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e80590f5-a6a3-4f80-a0ec-f2546270a1ea'] Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cc1edc8f-0aff-4b3e-954b-370915a75786 does not exist Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e80590f5-a6a3-4f80-a0ec-f2546270a1ea'] Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cc1edc8f-0aff-4b3e-954b-370915a75786 does not exist Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e80590f5-a6a3-4f80-a0ec-f2546270a1ea'] Aug 04 14:11:33.909461 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:33.915386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-034d802c-2e41-4eeb-9192-ba116669aadb tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Returning 404 to user: Security group cc1edc8f-0aff-4b3e-954b-370915a75786 does not exist Aug 04 14:11:33.915386 n-d-844627-10 devstack@n-api.service[130960]: Neutron server returns request_ids: ['req-e80590f5-a6a3-4f80-a0ec-f2546270a1ea'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:33.919685 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-034d802c-2e41-4eeb-9192-ba116669aadb tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/cc1edc8f-0aff-4b3e-954b-370915a75786" status: 404 len: 194 microversion: 2.1 time: 0.147073 Aug 04 14:11:33.927136 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1678/3351] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:11:33 2022] DELETE /compute/v2.1/os-security-groups/cc1edc8f-0aff-4b3e-954b-370915a75786 => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:33.951896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f2a0f8a-25e3-456b-b585-066104a0aae2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:33.953650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f2a0f8a-25e3-456b-b585-066104a0aae2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:33.990334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f2a0f8a-25e3-456b-b585-066104a0aae2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:33.996399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f2a0f8a-25e3-456b-b585-066104a0aae2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:34.002970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f2a0f8a-25e3-456b-b585-066104a0aae2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:34.003994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f2a0f8a-25e3-456b-b585-066104a0aae2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:34.391007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9fb08205-92cc-44f1-b72d-856725abdf40 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:34.392783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9fb08205-92cc-44f1-b72d-856725abdf40 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:34.419234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fb08205-92cc-44f1-b72d-856725abdf40 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:34.420194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fb08205-92cc-44f1-b72d-856725abdf40 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:34.422347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fb08205-92cc-44f1-b72d-856725abdf40 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:34.423473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fb08205-92cc-44f1-b72d-856725abdf40 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:34.741694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6f2a0f8a-25e3-456b-b585-066104a0aae2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:34.765361 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f2a0f8a-25e3-456b-b585-066104a0aae2 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1324 microversion: 2.1 time: 0.836441 Aug 04 14:11:34.780081 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1679/3352] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:33 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1324 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:34.809301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:34.810262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:34.822116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:34.823064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:34.824331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:34.825127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:34.833535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:34.850804 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 HTTP/1.1 Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'e6d3ed57-c6bf-4559-8e99-c92745f5a000'} Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:34.853058 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:34.857804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:34.859612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:34.861492 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f4cb378-b294-48bf-a596-71e63afd4c6f tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 404 len: 111 microversion: 2.1 time: 0.079481 Aug 04 14:11:34.868077 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1680/3353] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:34 2022] DELETE /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:34.868077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6507dd4-e9d8-4c47-9601-5c95957af4b1 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f46f3ba2c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:35.030724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9fb08205-92cc-44f1-b72d-856725abdf40 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:35.047539 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9fb08205-92cc-44f1-b72d-856725abdf40 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1505 microversion: 2.1 time: 1.416972 Aug 04 14:11:35.049280 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1674/3354] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:33 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1505 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:35.064031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c75650a9-d18e-4c33-ad4f-9a7c190c8158 req-4502e5b2-5b6f-4150-9b36-5e4c62e4cc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed", "name": "network-vif-plugged", "status": "completed", "tag": "3e3c049a-cf93-4b57-b949-7dd918adfa54"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:35.088959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c75650a9-d18e-4c33-ad4f-9a7c190c8158 req-4502e5b2-5b6f-4150-9b36-5e4c62e4cc98 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:35.089427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c75650a9-d18e-4c33-ad4f-9a7c190c8158 req-4502e5b2-5b6f-4150-9b36-5e4c62e4cc98 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:35.104218 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c75650a9-d18e-4c33-ad4f-9a7c190c8158 req-4502e5b2-5b6f-4150-9b36-5e4c62e4cc98 service nova] Creating event network-vif-plugged:3e3c049a-cf93-4b57-b949-7dd918adfa54 for instance a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed on n-h1-844627-10 Aug 04 14:11:35.111398 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c75650a9-d18e-4c33-ad4f-9a7c190c8158 req-4502e5b2-5b6f-4150-9b36-5e4c62e4cc98 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059523 Aug 04 14:11:35.112727 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1675/3355] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:35.118739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:35.119395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:35.127317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:35.127684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:35.129153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:35.129153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:35.752417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:35.788677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:35.803928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:35.808492 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e0b6ecb-e45c-4403-966c-ca2c50923747 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.693595 Aug 04 14:11:35.810462 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1676/3356] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:35 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:35.830531 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6507dd4-e9d8-4c47-9601-5c95957af4b1 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/da084044-f685-4874-9c09-eb0b8e6710b1" status: 202 len: 0 microversion: 2.1 time: 0.966600 Aug 04 14:11:35.837137 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1681/3357] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:11:34 2022] DELETE /compute/v2.1/os-security-groups/da084044-f685-4874-9c09-eb0b8e6710b1 => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:35.839029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-894ea5fa-4631-4080-8018-7d0e42b79bd0 req-698ab4ef-4419-436f-a922-83390fda00ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27bb1614-6b27-48a6-b766-c7697e4169ac", "tag": "04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:35.874649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:35.877039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: e6d3ed57-c6bf-4559-8e99-c92745f5a000] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:35.888750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-894ea5fa-4631-4080-8018-7d0e42b79bd0 req-698ab4ef-4419-436f-a922-83390fda00ae service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:35.892007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-894ea5fa-4631-4080-8018-7d0e42b79bd0 req-698ab4ef-4419-436f-a922-83390fda00ae service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:35.911984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:35.912735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:35.922312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:35.924551 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-894ea5fa-4631-4080-8018-7d0e42b79bd0 req-698ab4ef-4419-436f-a922-83390fda00ae service nova] Creating event network-changed:04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf for instance 27bb1614-6b27-48a6-b766-c7697e4169ac on n-h2-844627-10 Aug 04 14:11:35.925625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:35.937768 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-894ea5fa-4631-4080-8018-7d0e42b79bd0 req-698ab4ef-4419-436f-a922-83390fda00ae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123866 Aug 04 14:11:35.943774 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1677/3358] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:35.956368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d1cd39b-216a-42ab-98a7-5999f5b85a49 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:35.958175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7d1cd39b-216a-42ab-98a7-5999f5b85a49 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:35.976695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d1cd39b-216a-42ab-98a7-5999f5b85a49 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:35.978505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d1cd39b-216a-42ab-98a7-5999f5b85a49 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:35.981267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d1cd39b-216a-42ab-98a7-5999f5b85a49 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:35.982988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d1cd39b-216a-42ab-98a7-5999f5b85a49 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:36.037913 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 HTTP/1.1 Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'e6d3ed57-c6bf-4559-8e99-c92745f5a000'} Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:36.047334 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance e6d3ed57-c6bf-4559-8e99-c92745f5a000 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b76021a-3200-4118-9264-163be4af59e0 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000" status: 404 len: 111 microversion: 2.1 time: 0.211890 Aug 04 14:11:36.059548 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1682/3359] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:35 2022] GET /compute/v2.1/servers/e6d3ed57-c6bf-4559-8e99-c92745f5a000 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:36.079609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f5e3f627-a25c-40f3-ad87-63c9842e0120 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f46f3ba2d30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:37.232031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7d1cd39b-216a-42ab-98a7-5999f5b85a49 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:37.259494 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7d1cd39b-216a-42ab-98a7-5999f5b85a49 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1324 microversion: 2.1 time: 1.312705 Aug 04 14:11:37.260670 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1678/3360] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:35 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1324 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:37.295326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:37.296629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:37.308485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:37.309727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:37.311371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:37.312471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:37.339462 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed HTTP/1.1 Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '233bf06a-0888-4b0d-a891-b785811341ed'} Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:37.343479 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:37.352740 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:37.359066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:37.359066 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7fadca8b-838f-4c73-90b6-2c87cbb57fac tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 404 len: 111 microversion: 2.1 time: 0.076937 Aug 04 14:11:37.361936 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1679/3361] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:37 2022] DELETE /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:37.371415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d171da00-89d1-4b6b-80a6-4d07d2983578 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:37.373160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d171da00-89d1-4b6b-80a6-4d07d2983578 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:37.385931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d171da00-89d1-4b6b-80a6-4d07d2983578 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:37.387104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d171da00-89d1-4b6b-80a6-4d07d2983578 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:37.388784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d171da00-89d1-4b6b-80a6-4d07d2983578 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:37.390022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d171da00-89d1-4b6b-80a6-4d07d2983578 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:37.684453 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f5e3f627-a25c-40f3-ad87-63c9842e0120 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/58a94027-cb4b-4fd1-86c1-ff3b65216e43" status: 202 len: 0 microversion: 2.1 time: 1.613306 Aug 04 14:11:37.686777 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1683/3362] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:11:36 2022] DELETE /compute/v2.1/os-security-groups/58a94027-cb4b-4fd1-86c1-ff3b65216e43 => generated 0 bytes in 1630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:37.708784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:37.710389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:37.750046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:37.750871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:37.761679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:37.762495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:37.977830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d171da00-89d1-4b6b-80a6-4d07d2983578 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:37.993892 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d171da00-89d1-4b6b-80a6-4d07d2983578 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1505 microversion: 2.1 time: 0.629564 Aug 04 14:11:38.010675 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1680/3363] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:37 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:38.034336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:38.035471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 233bf06a-0888-4b0d-a891-b785811341ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:38.049522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:38.050678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:38.052481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:38.053794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:38.076805 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed HTTP/1.1 Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '233bf06a-0888-4b0d-a891-b785811341ed'} Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:38.079125 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:38.083661 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:38.083661 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:38.083661 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:38.083661 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:38.083661 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:38.083661 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. Aug 04 14:11:38.083661 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:38.087831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 233bf06a-0888-4b0d-a891-b785811341ed could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:38.089102 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d19ee3f4-0f84-4e20-972e-cf5bad1e9724 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed" status: 404 len: 111 microversion: 2.1 time: 0.076499 Aug 04 14:11:38.090099 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1681/3364] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:38 2022] GET /compute/v2.1/servers/233bf06a-0888-4b0d-a891-b785811341ed => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:38.096001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da0159ca-deb6-431b-92d4-9b8e44e5dac9 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f47056099d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:39.006136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:39.095691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:39.101129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:39.105983 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d9aefbc-a5fc-42b7-9295-e5aa131315d9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 1.416675 Aug 04 14:11:39.108815 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1684/3365] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:37 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:39.128594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:39.130438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:39.145432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:39.146842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:39.148779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:39.150129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:39.223338 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 HTTP/1.1 Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '241427eb-b636-4440-851c-389485fb5de8'} Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:39.231755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:39.284159 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:39.295920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:39.300419 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf76626e-e03c-4e4e-88ab-35721e41b213 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 404 len: 111 microversion: 2.1 time: 0.186882 Aug 04 14:11:39.314732 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1685/3366] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:39 2022] DELETE /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:39.699999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1666160630", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "494bd5a0-7d0e-43b5-9ffe-0d5acbdf91b0"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:39.900077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] validate_networks() for [('494bd5a0-7d0e-43b5-9ffe-0d5acbdf91b0', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:11:40.067778 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-da0159ca-deb6-431b-92d4-9b8e44e5dac9 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/1e98780b-fb2f-47bc-a53d-4420d938159e" status: 202 len: 0 microversion: 2.1 time: 1.976014 Aug 04 14:11:40.074838 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1682/3367] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:11:38 2022] DELETE /compute/v2.1/os-security-groups/1e98780b-fb2f-47bc-a53d-4420d938159e => generated 0 bytes in 1984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:40.084360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-82afb584-b245-42fa-9c77-fcd2c85748ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:40.085934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-82afb584-b245-42fa-9c77-fcd2c85748ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:40.104354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82afb584-b245-42fa-9c77-fcd2c85748ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:40.105088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82afb584-b245-42fa-9c77-fcd2c85748ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:40.107389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82afb584-b245-42fa-9c77-fcd2c85748ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:40.108020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82afb584-b245-42fa-9c77-fcd2c85748ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:40.734052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-82afb584-b245-42fa-9c77-fcd2c85748ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:40.746128 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-82afb584-b245-42fa-9c77-fcd2c85748ce tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1520 microversion: 2.1 time: 0.668062 Aug 04 14:11:40.747356 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1683/3368] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:40 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1520 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:40.769432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-d947d7a8-e59d-4564-8d69-5cc8f9723c34 req-6bbd0aa4-c12d-4d65-a377-e554801e1a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5cabc6-32b3-4ac9-a320-a293f5d8c27a", "name": "network-vif-unplugged", "status": "completed", "tag": "c906b592-45e5-4118-861b-b643b3afbd49"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:40.783015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d947d7a8-e59d-4564-8d69-5cc8f9723c34 req-6bbd0aa4-c12d-4d65-a377-e554801e1a09 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:40.783885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d947d7a8-e59d-4564-8d69-5cc8f9723c34 req-6bbd0aa4-c12d-4d65-a377-e554801e1a09 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:40.805957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.compute.server_external_events [req-d947d7a8-e59d-4564-8d69-5cc8f9723c34 req-6bbd0aa4-c12d-4d65-a377-e554801e1a09 service nova] Unable to find a host for instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a. Dropping event network-vif-unplugged {{(pid=130961) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 14:11:40.808441 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-d947d7a8-e59d-4564-8d69-5cc8f9723c34 req-6bbd0aa4-c12d-4d65-a377-e554801e1a09 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059623 Aug 04 14:11:40.809298 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1684/3369] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 14:11:40.821438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac9eb11e-cd12-43e6-a643-84b39222e0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:40.822391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ac9eb11e-cd12-43e6-a643-84b39222e0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:40.831784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac9eb11e-cd12-43e6-a643-84b39222e0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:40.832467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac9eb11e-cd12-43e6-a643-84b39222e0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:40.833620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac9eb11e-cd12-43e6-a643-84b39222e0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:40.834246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac9eb11e-cd12-43e6-a643-84b39222e0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:41.293717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ac9eb11e-cd12-43e6-a643-84b39222e0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:41.311513 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac9eb11e-cd12-43e6-a643-84b39222e0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 200 len: 1448 microversion: 2.1 time: 0.491035 Aug 04 14:11:41.313001 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1685/3370] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:40 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 1448 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:41.336648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:41.337919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 241427eb-b636-4440-851c-389485fb5de8] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:41.350507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:41.351476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:41.352977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:41.353415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:41.371009 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 HTTP/1.1 Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '241427eb-b636-4440-851c-389485fb5de8'} Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:41.373392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:41.379314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:41.379314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:41.379314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:41.379314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:41.379314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:41.379314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. Aug 04 14:11:41.379314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:41.385322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 241427eb-b636-4440-851c-389485fb5de8 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:41.386279 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49fa3751-095e-4bc0-b9e2-ed425a61af1d tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8" status: 404 len: 111 microversion: 2.1 time: 0.071574 Aug 04 14:11:41.386873 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1686/3371] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:41 2022] GET /compute/v2.1/servers/241427eb-b636-4440-851c-389485fb5de8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:41.398452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca4aa6e9-3da8-4dbc-8671-017b8045cec4 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f46f3fb4af0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:41.402940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:11:41.403741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:11:41.404632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:11:41.405449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:11:41.406221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:11:41.444554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:41.445426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:41.467112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:41.469503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:41.544069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Getting quotas for project 76127a5e57b24da1b7fa8ff2bb2c3ffa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:11:41.563769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Getting quotas for user ae9d69e771a7411699a41da8ff17f6df and project 76127a5e57b24da1b7fa8ff2bb2c3ffa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:11:41.623092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:11:41.626861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:11:41.804431 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7815ef90-d882-4747-8d2d-90a7aa92b564 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.486411 Aug 04 14:11:41.810798 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1686/3372] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:11:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:11:41.874600 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca4aa6e9-3da8-4dbc-8671-017b8045cec4 tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/a30ba9e9-d78d-4786-8440-edff579f257b" status: 202 len: 0 microversion: 2.1 time: 0.484025 Aug 04 14:11:41.877407 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1687/3373] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:11:41 2022] DELETE /compute/v2.1/os-security-groups/a30ba9e9-d78d-4786-8440-edff579f257b => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:41.888521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:41.904692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a0111aa-4997-4402-b8f1-bb05ca74d4c7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:41.905879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:41.916168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9a0111aa-4997-4402-b8f1-bb05ca74d4c7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:41.952918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a0111aa-4997-4402-b8f1-bb05ca74d4c7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:41.963374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a0111aa-4997-4402-b8f1-bb05ca74d4c7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:41.964168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:41.968440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a0111aa-4997-4402-b8f1-bb05ca74d4c7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:41.968751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:41.974691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a0111aa-4997-4402-b8f1-bb05ca74d4c7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:41.977484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:41.978799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:42.148157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9a0111aa-4997-4402-b8f1-bb05ca74d4c7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:11:42.424942 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a0111aa-4997-4402-b8f1-bb05ca74d4c7 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 204 len: 0 microversion: 2.1 time: 0.543194 Aug 04 14:11:42.426476 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1688/3374] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:41 2022] DELETE /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:11:42.433450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:42.434473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:42.466102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:42.470161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:42.472038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:42.476783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:42.589595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:11:42.630273 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.api [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Working on deleting snapshot 8bc1d3b7-58a8-4d67-a229-b68f474d1702 from shelved instance... Aug 04 14:11:42.681569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:42.710684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:42.712495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:42.714373 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9fd267ba-67d5-4a88-8449-37686130059c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.882624 Aug 04 14:11:42.726015 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1687/3375] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:41 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:42.732187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:42.732891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:42.764241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:42.764716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:42.765580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:42.769545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:42.816666 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d HTTP/1.1 Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'c9e14548-2895-42eb-b864-6d943135680d'} Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:42.823127 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:42.835333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:42.839061 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7563f520-a22e-44ce-b240-0d6818cc8b10 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 404 len: 111 microversion: 2.1 time: 0.110906 Aug 04 14:11:42.840774 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1688/3376] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:42 2022] DELETE /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:42.852227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f67b29b5-7824-481b-8941-fde685966b9f tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] Calling method '.version_select at 0x7f4700246670>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:43.414319 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f67b29b5-7824-481b-8941-fde685966b9f tempest-SecurityGroupRulesTestJSON-1026094437 tempest-SecurityGroupRulesTestJSON-1026094437-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/6f15163c-a987-4be3-86d1-250c64e21f54" status: 202 len: 0 microversion: 2.1 time: 0.569688 Aug 04 14:11:43.416114 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1689/3377] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:11:42 2022] DELETE /compute/v2.1/os-security-groups/6f15163c-a987-4be3-86d1-250c64e21f54 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:43.436976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-100482230", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "494bd5a0-7d0e-43b5-9ffe-0d5acbdf91b0"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:43.608933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] validate_networks() for [('494bd5a0-7d0e-43b5-9ffe-0d5acbdf91b0', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:11:44.176542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:44.196775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Doing local delete in cell bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) {{(pid=130961) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 04 14:11:44.197193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:44.209846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:44.211339 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.api [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 04 14:11:44.217082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] deallocate_for_instance() {{(pid=130961) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 04 14:11:45.532000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:11:45.532904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:11:45.532904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:11:45.533446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:11:45.533868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:11:45.555369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:45.556473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:45.557736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:45.559795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:45.597079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Getting quotas for project 76127a5e57b24da1b7fa8ff2bb2c3ffa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:11:45.609241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Getting quotas for user ae9d69e771a7411699a41da8ff17f6df and project 76127a5e57b24da1b7fa8ff2bb2c3ffa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:11:45.656021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:11:45.661451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:11:45.761733 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cfe2de00-3f67-42ce-b437-6e120759a3ab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.342155 Aug 04 14:11:45.762858 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1690/3378] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:11:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:11:45.769481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2551c2f1-35fe-4450-8cdf-b00aa3cd384d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:45.798793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2551c2f1-35fe-4450-8cdf-b00aa3cd384d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:45.809452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2551c2f1-35fe-4450-8cdf-b00aa3cd384d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:45.814926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2551c2f1-35fe-4450-8cdf-b00aa3cd384d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:45.816520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2551c2f1-35fe-4450-8cdf-b00aa3cd384d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:45.819841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2551c2f1-35fe-4450-8cdf-b00aa3cd384d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:46.411902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2551c2f1-35fe-4450-8cdf-b00aa3cd384d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:46.428709 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2551c2f1-35fe-4450-8cdf-b00aa3cd384d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1526 microversion: 2.1 time: 0.662856 Aug 04 14:11:46.430182 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1691/3379] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:45 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1526 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:46.473096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:46.474960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: c9e14548-2895-42eb-b864-6d943135680d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:46.526432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:46.527187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:46.528124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:46.535450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:46.570367 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d HTTP/1.1 Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'c9e14548-2895-42eb-b864-6d943135680d'} Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:46.572000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance c9e14548-2895-42eb-b864-6d943135680d could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ed1a3cff-3aed-4eee-a263-a4ec6ab509cc tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d" status: 404 len: 111 microversion: 2.1 time: 0.127656 Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1692/3380] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:46 2022] GET /compute/v2.1/servers/c9e14548-2895-42eb-b864-6d943135680d => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:46.583802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:46.590416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:46.602109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:46.602569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:46.603366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:46.603812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:46.657691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Updating instance_info_cache with network_info: [] {{(pid=130961) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 14:11:47.193537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:47.201496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:47.217586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:47.223153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:47.226822 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-43526848-7f59-4777-bd31-3a29c4ccb5ed tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.647943 Aug 04 14:11:47.229648 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1693/3381] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:46 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:47.237346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-983504594", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "451", "networks": [{"uuid": "494bd5a0-7d0e-43b5-9ffe-0d5acbdf91b0"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:47.348504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] validate_networks() for [('494bd5a0-7d0e-43b5-9ffe-0d5acbdf91b0', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:11:47.527130 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-14591743-21b3-47b8-ba90-bd25de4468d2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 204 len: 0 microversion: 2.1 time: 5.098699 Aug 04 14:11:47.527990 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1689/3382] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:42 2022] DELETE /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 0 bytes in 5101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:11:47.541630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03b4a994-3e4b-4642-9411-661a630d0c5b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:47.542508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-03b4a994-3e4b-4642-9411-661a630d0c5b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:47.559420 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-03b4a994-3e4b-4642-9411-661a630d0c5b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03b4a994-3e4b-4642-9411-661a630d0c5b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 HTTP/1.1 Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7'} Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:47.561653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:47.566092 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:47.566092 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:47.566092 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:47.566092 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:47.566092 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:47.566092 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:47.566092 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:47.568601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03b4a994-3e4b-4642-9411-661a630d0c5b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:47.573773 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-03b4a994-3e4b-4642-9411-661a630d0c5b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7" status: 404 len: 111 microversion: 2.1 time: 0.040860 Aug 04 14:11:47.578446 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1690/3383] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:47 2022] DELETE /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:47.596367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a0fa9d8b-e734-41b1-a08c-9896609dd7e7 req-f33e1297-b44a-4852-89e9-721d5adee5cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5cabc6-32b3-4ac9-a320-a293f5d8c27a", "name": "network-vif-deleted", "tag": "c906b592-45e5-4118-861b-b643b3afbd49"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:47.615164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a0fa9d8b-e734-41b1-a08c-9896609dd7e7 req-f33e1297-b44a-4852-89e9-721d5adee5cb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:47.616058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a0fa9d8b-e734-41b1-a08c-9896609dd7e7 req-f33e1297-b44a-4852-89e9-721d5adee5cb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:47.639108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.compute.server_external_events [req-a0fa9d8b-e734-41b1-a08c-9896609dd7e7 req-f33e1297-b44a-4852-89e9-721d5adee5cb service nova] Unable to find a host for instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a. Dropping event network-vif-deleted {{(pid=130961) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 14:11:47.640757 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a0fa9d8b-e734-41b1-a08c-9896609dd7e7 req-f33e1297-b44a-4852-89e9-721d5adee5cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.060185 Aug 04 14:11:47.653278 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1691/3384] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 14:11:47.658765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:47.660315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:47.669479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:47.670358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:47.671442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:47.672124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:47.802583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:47.806971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:47.807862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lazy-loading 'fault' on Instance uuid a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:11:48.044537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f648ba00abbe4679a43d65bc925da013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fea7d4481410d9591a181521c1eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:48.057068 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c426557d-1a18-4f73-9cfa-8dbfad09ba11 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 200 len: 1314 microversion: 2.1 time: 0.401091 Aug 04 14:11:48.058466 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1692/3385] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:47 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:48.066133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:48.067274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:48.081237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:48.082748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:48.084251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:48.084998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:48.151850 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a HTTP/1.1 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'da5cabc6-32b3-4ac9-a320-a293f5d8c27a'} Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:48.153753 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.164989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:48.164989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:48.164989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:48.164989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:48.164989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:48.164989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:11:48.164989 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.169611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:48.170763 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-898f483e-fce2-4a08-b7d0-c8b2b95eb192 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 404 len: 111 microversion: 2.1 time: 0.110973 Aug 04 14:11:48.172256 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1693/3386] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:48 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:48.178172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-278ed61e-2351-47a2-a296-157914661bb3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:48.179244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-278ed61e-2351-47a2-a296-157914661bb3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:48.195015 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-278ed61e-2351-47a2-a296-157914661bb3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-278ed61e-2351-47a2-a296-157914661bb3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 HTTP/1.1 Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7'} Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:48.201679 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:48.207278 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:48.207278 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:48.207278 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:48.207278 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. Aug 04 14:11:48.207278 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:48.213089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-278ed61e-2351-47a2-a296-157914661bb3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance 8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:48.214395 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-278ed61e-2351-47a2-a296-157914661bb3 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7" status: 404 len: 111 microversion: 2.1 time: 0.040787 Aug 04 14:11:48.222780 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1694/3387] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:48 2022] GET /compute/v2.1/servers/8a0eb412-88b6-44d7-82f0-6eaa24d9c6f7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:48.242644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f430428d-8010-463a-93b1-51ddffa411f2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:48.243587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f430428d-8010-463a-93b1-51ddffa411f2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:48.271471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f430428d-8010-463a-93b1-51ddffa411f2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:48.272394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f430428d-8010-463a-93b1-51ddffa411f2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:48.279287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f430428d-8010-463a-93b1-51ddffa411f2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:48.280198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f430428d-8010-463a-93b1-51ddffa411f2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:48.356188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f430428d-8010-463a-93b1-51ddffa411f2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:11:48.593556 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f430428d-8010-463a-93b1-51ddffa411f2 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 204 len: 0 microversion: 2.1 time: 0.365767 Aug 04 14:11:48.596314 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1695/3388] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:48 2022] DELETE /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:11:48.604667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:48.608299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:48.622999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:48.624066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:48.626671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:48.627612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:49.094532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:11:49.108710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:11:49.110524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:11:49.111235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:11:49.112594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:11:49.129363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:49.130306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:49.131413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:49.132144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:49.174540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Getting quotas for project 76127a5e57b24da1b7fa8ff2bb2c3ffa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:11:49.180432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:49.187347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Getting quotas for user ae9d69e771a7411699a41da8ff17f6df and project 76127a5e57b24da1b7fa8ff2bb2c3ffa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:11:49.196387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:49.198219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:49.199718 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a51ed0c4-8652-45b9-b5e5-0412ef07baee tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.601517 Aug 04 14:11:49.214547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:11:49.217960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:11:49.220823 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1696/3389] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:48 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:49.225965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-149456425", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:49.291604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] validate_networks() for [('4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:11:49.312678 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b3900a9e-7c4a-4b5a-8d55-af4a3ef400b8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.078613 Aug 04 14:11:49.315729 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1694/3390] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:11:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:11:49.330606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-103135c9-2384-47fb-b92b-cf255732f2d1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:49.331582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-103135c9-2384-47fb-b92b-cf255732f2d1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:49.341866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-103135c9-2384-47fb-b92b-cf255732f2d1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:49.342805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-103135c9-2384-47fb-b92b-cf255732f2d1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:49.346498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-103135c9-2384-47fb-b92b-cf255732f2d1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:49.348046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-103135c9-2384-47fb-b92b-cf255732f2d1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:50.684899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-103135c9-2384-47fb-b92b-cf255732f2d1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:50.695764 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-103135c9-2384-47fb-b92b-cf255732f2d1 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1478 microversion: 2.1 time: 1.376930 Aug 04 14:11:50.696427 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1695/3391] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:49 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1478 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:50.713247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:50.713247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:50.713247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:50.713247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:50.713247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:50.713247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:50.730464 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Instance a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed could not be found. Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed HTTP/1.1 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed could not be found. Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed'} Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed could not be found. Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed could not be found. Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:50.732216 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed could not be found. Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Instance a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5a212015-e02e-4d23-9cf6-7a6d3b4231bf tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed" status: 404 len: 111 microversion: 2.1 time: 0.036277 Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1696/3392] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:50 2022] GET /compute/v2.1/servers/a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6e021aa2-2391-49e4-b9f8-eeab615e2dab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:50.742804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6e021aa2-2391-49e4-b9f8-eeab615e2dab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:50.747061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e021aa2-2391-49e4-b9f8-eeab615e2dab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:50.747511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e021aa2-2391-49e4-b9f8-eeab615e2dab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:50.748297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e021aa2-2391-49e4-b9f8-eeab615e2dab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:50.748739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e021aa2-2391-49e4-b9f8-eeab615e2dab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:50.884916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6e021aa2-2391-49e4-b9f8-eeab615e2dab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:50.894279 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6e021aa2-2391-49e4-b9f8-eeab615e2dab tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1216 microversion: 2.1 time: 0.158735 Aug 04 14:11:50.894898 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1697/3393] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:50 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:50.909283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b5e00aa0-d925-42ac-987a-f94226e8e021 req-1e60900d-240c-44ae-8ff0-7ef185080d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff61720-5387-4758-b989-86e21ec56509", "tag": "5b6b21b5-0b35-4248-87ae-057b105e118c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:50.911802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b5e00aa0-d925-42ac-987a-f94226e8e021 req-1e60900d-240c-44ae-8ff0-7ef185080d0c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:50.912262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b5e00aa0-d925-42ac-987a-f94226e8e021 req-1e60900d-240c-44ae-8ff0-7ef185080d0c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:50.925455 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b5e00aa0-d925-42ac-987a-f94226e8e021 req-1e60900d-240c-44ae-8ff0-7ef185080d0c service nova] Creating event network-changed:5b6b21b5-0b35-4248-87ae-057b105e118c for instance 0ff61720-5387-4758-b989-86e21ec56509 on n-h1-844627-10 Aug 04 14:11:50.931360 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b5e00aa0-d925-42ac-987a-f94226e8e021 req-1e60900d-240c-44ae-8ff0-7ef185080d0c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035041 Aug 04 14:11:50.932188 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1698/3394] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:50.940720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-10e4626d-acff-4144-87b0-df022585b625 req-1b704e38-aaaf-4e3f-adc9-cd0c9b699827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed", "name": "network-vif-deleted", "tag": "3e3c049a-cf93-4b57-b949-7dd918adfa54"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:50.951272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-10e4626d-acff-4144-87b0-df022585b625 req-1b704e38-aaaf-4e3f-adc9-cd0c9b699827 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:50.951959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-10e4626d-acff-4144-87b0-df022585b625 req-1b704e38-aaaf-4e3f-adc9-cd0c9b699827 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:50.967161 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-10e4626d-acff-4144-87b0-df022585b625 req-1b704e38-aaaf-4e3f-adc9-cd0c9b699827 service nova] Creating event network-vif-deleted:3e3c049a-cf93-4b57-b949-7dd918adfa54 for instance a4f5aee7-fb2b-4190-b8da-c85a9a16d3ed on n-h1-844627-10 Aug 04 14:11:50.973084 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-10e4626d-acff-4144-87b0-df022585b625 req-1b704e38-aaaf-4e3f-adc9-cd0c9b699827 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038889 Aug 04 14:11:50.974530 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1699/3395] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:50.979314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:50.980398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:50.988185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:50.988655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:50.989465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:50.989903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:51.754091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:51.785357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:51.787181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:51.788426 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f9ec661f-4039-41ce-b556-a59d821249c1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.813629 Aug 04 14:11:51.789653 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1700/3396] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:50 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:51.794090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-012a13bd-1bd3-4d3e-bef0-12217ef18b4a tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '.version_select at 0x7f47002e7b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:51.826926 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-012a13bd-1bd3-4d3e-bef0-12217ef18b4a tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Image not found. Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-012a13bd-1bd3-4d3e-bef0-12217ef18b4a tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/images/c7dd289d-c2cf-4694-a038-02bce81e751d HTTP/1.1 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: exception: Image not found. Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'c7dd289d-c2cf-4694-a038-02bce81e751d'} Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c7dd289d-c2cf-4694-a038-02bce81e751d to delete Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7dd289d-c2cf-4694-a038-02bce81e751d could not be found. Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:51.829486 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:11:51.834562 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:51.837661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-012a13bd-1bd3-4d3e-bef0-12217ef18b4a tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Image not found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:51.838755 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-012a13bd-1bd3-4d3e-bef0-12217ef18b4a tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/images/c7dd289d-c2cf-4694-a038-02bce81e751d" status: 404 len: 62 microversion: 2.1 time: 0.048511 Aug 04 14:11:51.842984 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1701/3397] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:51 2022] DELETE /compute/v2.1/images/c7dd289d-c2cf-4694-a038-02bce81e751d => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:11:51.851255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-207be0d6-cf5b-4b0b-bd97-f68aeeeba402 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:51.852340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-207be0d6-cf5b-4b0b-bd97-f68aeeeba402 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:51.861938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-207be0d6-cf5b-4b0b-bd97-f68aeeeba402 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:51.863004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-207be0d6-cf5b-4b0b-bd97-f68aeeeba402 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:51.864684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-207be0d6-cf5b-4b0b-bd97-f68aeeeba402 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:51.865528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-207be0d6-cf5b-4b0b-bd97-f68aeeeba402 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.317410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:11:52.319171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:11:52.321640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:11:52.322392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:11:52.323173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:11:52.363115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.365397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.370177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.371979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.415018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-207be0d6-cf5b-4b0b-bd97-f68aeeeba402 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:52.432955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:11:52.447559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for user d6f701d08c0741df9ad1375bd0712a59 and project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:11:52.458346 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-207be0d6-cf5b-4b0b-bd97-f68aeeeba402 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1478 microversion: 2.1 time: 0.613418 Aug 04 14:11:52.468974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:11:52.472392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:11:52.475169 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1702/3398] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:51 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1478 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:52.492125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:52.492524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:52.511642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.512718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.514524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.515550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.553099 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6124bc84-348f-44c9-a229-aeccbbba2382 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.330089 Aug 04 14:11:52.559839 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.560813 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1697/3399] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a HTTP/1.1 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'eac958b6-3fe8-4be4-95e7-2ac0be29c97a'} Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:52.561338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.567276 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.569884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:52.577178 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a8ac50e-d44d-40cd-b736-dab6f2497988 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 404 len: 111 microversion: 2.1 time: 0.101608 Aug 04 14:11:52.578064 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1703/3400] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:52 2022] DELETE /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:52.588939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1b1904c5-c630-4ec3-b890-215e13932d43 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:52.589610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b1904c5-c630-4ec3-b890-215e13932d43 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:52.592961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f993f674-998e-4b14-8ee8-3e32a63134cd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:52.595091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f993f674-998e-4b14-8ee8-3e32a63134cd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:52.599017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b1904c5-c630-4ec3-b890-215e13932d43 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.600544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b1904c5-c630-4ec3-b890-215e13932d43 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.601658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b1904c5-c630-4ec3-b890-215e13932d43 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.602355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b1904c5-c630-4ec3-b890-215e13932d43 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.791253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f993f674-998e-4b14-8ee8-3e32a63134cd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:52.803767 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f993f674-998e-4b14-8ee8-3e32a63134cd tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1214 microversion: 2.1 time: 0.213180 Aug 04 14:11:52.807005 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1704/3401] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:52 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:52.815607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:52.817188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: eac958b6-3fe8-4be4-95e7-2ac0be29c97a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:52.830775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.831597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.833437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.834387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.872007 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a HTTP/1.1 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'eac958b6-3fe8-4be4-95e7-2ac0be29c97a'} Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.876071 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:52.884463 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.884463 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:52.884463 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:52.884463 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:52.884463 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:52.884463 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:52.884463 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. Aug 04 14:11:52.884463 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:52.884463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Instance eac958b6-3fe8-4be4-95e7-2ac0be29c97a could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:52.888366 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-16b3586c-64f1-4108-92c0-58c136ba7367 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a" status: 404 len: 111 microversion: 2.1 time: 0.079736 Aug 04 14:11:52.896855 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1705/3402] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:52 2022] GET /compute/v2.1/servers/eac958b6-3fe8-4be4-95e7-2ac0be29c97a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:52.904300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:52.907668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:52.912160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:52.944248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.947550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:52.950536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:52.954200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:53.057676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b1904c5-c630-4ec3-b890-215e13932d43 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:53.066917 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1b1904c5-c630-4ec3-b890-215e13932d43 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1272 microversion: 2.1 time: 0.487114 Aug 04 14:11:53.074613 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1698/3403] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:52 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1272 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:53.107220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c6ea7cd-f3b0-4e15-b8f5-c0ad442d3fd4 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '.version_select at 0x7f47055ad8b0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:53.207223 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c6ea7cd-f3b0-4e15-b8f5-c0ad442d3fd4 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980382781" status: 202 len: 0 microversion: 2.1 time: 0.110983 Aug 04 14:11:53.208840 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1699/3404] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980382781 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:11:53.502200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-622eab1c-f955-4204-a012-2f78d7ec77e7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:53.503929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-622eab1c-f955-4204-a012-2f78d7ec77e7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:53.513026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-622eab1c-f955-4204-a012-2f78d7ec77e7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:53.513812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-622eab1c-f955-4204-a012-2f78d7ec77e7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:53.514835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-622eab1c-f955-4204-a012-2f78d7ec77e7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:53.517131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-622eab1c-f955-4204-a012-2f78d7ec77e7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:53.664582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:53.687693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:53.691480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:53.693603 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0e2908d9-d4f9-4378-868e-f027c429d66e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 0.798983 Aug 04 14:11:53.695679 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1706/3405] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:52 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:53.833689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6dd9c3d-4aa9-43ab-b1bb-d0fd622d3b3d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:53.835752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6dd9c3d-4aa9-43ab-b1bb-d0fd622d3b3d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:53.849746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6dd9c3d-4aa9-43ab-b1bb-d0fd622d3b3d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:53.854286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6dd9c3d-4aa9-43ab-b1bb-d0fd622d3b3d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:53.855712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6dd9c3d-4aa9-43ab-b1bb-d0fd622d3b3d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:53.857306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6dd9c3d-4aa9-43ab-b1bb-d0fd622d3b3d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:54.727214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6dd9c3d-4aa9-43ab-b1bb-d0fd622d3b3d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:54.744670 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6dd9c3d-4aa9-43ab-b1bb-d0fd622d3b3d tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1266 microversion: 2.1 time: 0.916900 Aug 04 14:11:54.746156 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1707/3406] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:53 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1266 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:54.758914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-56833a80-819f-435d-abd5-7cb6117da182 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:54.759971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-56833a80-819f-435d-abd5-7cb6117da182 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:54.771794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56833a80-819f-435d-abd5-7cb6117da182 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:54.773392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56833a80-819f-435d-abd5-7cb6117da182 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:54.774606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56833a80-819f-435d-abd5-7cb6117da182 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:54.776600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56833a80-819f-435d-abd5-7cb6117da182 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:54.820508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-622eab1c-f955-4204-a012-2f78d7ec77e7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df576732ca5c442694d507fd4dc58279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '254dc59176414ac48f6827f95ffc907f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:54.839304 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-622eab1c-f955-4204-a012-2f78d7ec77e7 tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 200 len: 1478 microversion: 2.1 time: 1.344522 Aug 04 14:11:54.844143 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1700/3407] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:53 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 1478 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:54.867917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f3423a42-9967-4757-bed8-89d4c1ea6b61 req-bbcf1001-9b56-4766-9595-8ba835583c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-plugged", "status": "completed", "tag": "3a7c07f8-c444-4382-b0bd-d61cc53d01fe"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:54.901058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f3423a42-9967-4757-bed8-89d4c1ea6b61 req-bbcf1001-9b56-4766-9595-8ba835583c58 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:54.902932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f3423a42-9967-4757-bed8-89d4c1ea6b61 req-bbcf1001-9b56-4766-9595-8ba835583c58 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:54.936065 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f3423a42-9967-4757-bed8-89d4c1ea6b61 req-bbcf1001-9b56-4766-9595-8ba835583c58 service nova] Creating event network-vif-plugged:3a7c07f8-c444-4382-b0bd-d61cc53d01fe for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:54.952250 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f3423a42-9967-4757-bed8-89d4c1ea6b61 req-bbcf1001-9b56-4766-9595-8ba835583c58 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107104 Aug 04 14:11:54.953535 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1701/3408] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:54.974485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:54.991353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:55.047139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:55.052130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:55.061191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:55.070916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-56833a80-819f-435d-abd5-7cb6117da182 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:55.082240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:55.121649 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-56833a80-819f-435d-abd5-7cb6117da182 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1278 microversion: 2.1 time: 0.371751 Aug 04 14:11:55.124091 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1708/3409] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:54 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1278 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:55.150747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-45b813c5-b9eb-48d8-b186-1b4ccaf0645d req-77920bff-4a45-4679-b4e3-ac2cf1b134d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2", "name": "network-vif-deleted", "tag": "0ac8d5ba-726d-4476-b820-4498e934d17f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:55.199224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-45b813c5-b9eb-48d8-b186-1b4ccaf0645d req-77920bff-4a45-4679-b4e3-ac2cf1b134d8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:55.205249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-45b813c5-b9eb-48d8-b186-1b4ccaf0645d req-77920bff-4a45-4679-b4e3-ac2cf1b134d8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:55.240474 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-45b813c5-b9eb-48d8-b186-1b4ccaf0645d req-77920bff-4a45-4679-b4e3-ac2cf1b134d8 service nova] Creating event network-vif-deleted:0ac8d5ba-726d-4476-b820-4498e934d17f for instance f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 on n-h1-844627-10 Aug 04 14:11:55.248228 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-45b813c5-b9eb-48d8-b186-1b4ccaf0645d req-77920bff-4a45-4679-b4e3-ac2cf1b134d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119791 Aug 04 14:11:55.250166 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1709/3410] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:55.783476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7f0a3a84-0465-47f2-966b-070456e13e32 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:55.791239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7f0a3a84-0465-47f2-966b-070456e13e32 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:55.806290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f0a3a84-0465-47f2-966b-070456e13e32 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:55.808467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f0a3a84-0465-47f2-966b-070456e13e32 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:55.811201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f0a3a84-0465-47f2-966b-070456e13e32 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:55.813273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f0a3a84-0465-47f2-966b-070456e13e32 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:56.088355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7f0a3a84-0465-47f2-966b-070456e13e32 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:56.113848 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7f0a3a84-0465-47f2-966b-070456e13e32 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1272 microversion: 2.1 time: 0.338413 Aug 04 14:11:56.115280 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1710/3411] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:55 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1272 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:56.145982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:56.147181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] [instance: f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:56.168848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:56.169639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:56.171075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:56.171075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:56.180042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:56.221184 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] HTTP exception thrown: Instance f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 could not be found. Aug 04 14:11:56.221851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Request method failure captured: Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 HTTP/1.1 Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69I4Z7ewueAwbw7FQkb__VrCbPcvl0Uv2sbTgDsa9Syvsa8pocRA60eJfAxwZm1n161lhm2MrjGypoe7ETTxh0i--YNpd5fOE_wgnp6iLvdLxPkp9SpI2LnktOfkKQBLR9oKs4B7LHmX9gsMvVrFPyLezxFyi7mR2YaOHrgkSjZAqPE Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_254dc59176414ac48f6827f95ffc907f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/254dc59176414ac48f6827f95ffc907f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/254dc59176414ac48f6827f95ffc907f"}]}] Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersTestJSON-1358728139 Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 254dc59176414ac48f6827f95ffc907f Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersTestJSON-1358728139 Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: df576732ca5c442694d507fd4dc58279 Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersTestJSON-1358728139-project Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 could not be found. Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2'} Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 could not be found. Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 could not be found. Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:56.224966 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 could not be found. Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] Returning 404 to user: Instance f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9ea7a96e-afd8-40ef-bfec-33076c6ed54b tempest-ServersTestJSON-1358728139 tempest-ServersTestJSON-1358728139-project] 10.222.0.66 "GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2" status: 404 len: 111 microversion: 2.1 time: 0.099372 Aug 04 14:11:56.238183 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1711/3412] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:56 2022] GET /compute/v2.1/servers/f2cd121a-a777-4ed0-ac52-cf4b0ae5c7e2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:56.240400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:56.246791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dbe696a5-22d7-4866-b810-06bd298abc17 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:56.248399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dbe696a5-22d7-4866-b810-06bd298abc17 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:56.248605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:56.250155 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c573da82-cbee-47ca-b8eb-9b26164402b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 1.288801 Aug 04 14:11:56.264943 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1702/3413] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:54 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:56.275024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbe696a5-22d7-4866-b810-06bd298abc17 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:56.277753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbe696a5-22d7-4866-b810-06bd298abc17 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:56.278181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbe696a5-22d7-4866-b810-06bd298abc17 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:56.279399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbe696a5-22d7-4866-b810-06bd298abc17 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:56.540161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dbe696a5-22d7-4866-b810-06bd298abc17 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:56.550386 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dbe696a5-22d7-4866-b810-06bd298abc17 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1278 microversion: 2.1 time: 0.312410 Aug 04 14:11:56.552127 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1712/3414] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:56 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1278 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:56.989393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-13303e77-336a-4701-af38-0abcb83926dd req-9e84005d-d278-4eab-b94d-866239c8c4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-plugged", "status": "completed", "tag": "53371ea6-c477-434e-80e6-d6459f75d410"}, {"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-plugged", "status": "completed", "tag": "9ffe961b-4486-4a47-94f7-7ba03bbfd645"}, {"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-plugged", "status": "completed", "tag": "9156d80b-d433-4a64-a4ce-78d05a747b2b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:57.051927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-13303e77-336a-4701-af38-0abcb83926dd req-9e84005d-d278-4eab-b94d-866239c8c4bf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:57.052744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-13303e77-336a-4701-af38-0abcb83926dd req-9e84005d-d278-4eab-b94d-866239c8c4bf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:57.121110 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-13303e77-336a-4701-af38-0abcb83926dd req-9e84005d-d278-4eab-b94d-866239c8c4bf service nova] Creating event network-vif-plugged:53371ea6-c477-434e-80e6-d6459f75d410 for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:57.122104 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-13303e77-336a-4701-af38-0abcb83926dd req-9e84005d-d278-4eab-b94d-866239c8c4bf service nova] Creating event network-vif-plugged:9ffe961b-4486-4a47-94f7-7ba03bbfd645 for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:57.123083 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-13303e77-336a-4701-af38-0abcb83926dd req-9e84005d-d278-4eab-b94d-866239c8c4bf service nova] Creating event network-vif-plugged:9156d80b-d433-4a64-a4ce-78d05a747b2b for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:57.144117 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-13303e77-336a-4701-af38-0abcb83926dd req-9e84005d-d278-4eab-b94d-866239c8c4bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.168523 Aug 04 14:11:57.151488 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1703/3415] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:57.170883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f166a9af-87fe-41e9-b785-f3ca0d06dc5c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:57.172131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f166a9af-87fe-41e9-b785-f3ca0d06dc5c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:57.196698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f166a9af-87fe-41e9-b785-f3ca0d06dc5c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:57.197559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f166a9af-87fe-41e9-b785-f3ca0d06dc5c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:57.199061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f166a9af-87fe-41e9-b785-f3ca0d06dc5c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:57.199765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f166a9af-87fe-41e9-b785-f3ca0d06dc5c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:57.303725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:57.304851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:57.334109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:57.346138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:57.348391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:57.349478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:57.398718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f166a9af-87fe-41e9-b785-f3ca0d06dc5c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:57.413909 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f166a9af-87fe-41e9-b785-f3ca0d06dc5c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1272 microversion: 2.1 time: 0.278903 Aug 04 14:11:57.418038 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1713/3416] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:57 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:57.571811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5833b6e-d1ae-4c94-b162-05b712149edd tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:57.572904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d5833b6e-d1ae-4c94-b162-05b712149edd tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:57.580583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5833b6e-d1ae-4c94-b162-05b712149edd tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:57.581465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5833b6e-d1ae-4c94-b162-05b712149edd tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:57.582563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5833b6e-d1ae-4c94-b162-05b712149edd tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:57.583511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5833b6e-d1ae-4c94-b162-05b712149edd tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:58.268282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:58.291033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:58.295193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:58.298938 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ed99337c-d0a3-448b-a860-020ed3fd6ddf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 1.005264 Aug 04 14:11:58.303023 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1704/3417] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:57 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:11:58.320767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a4c2b702-d8e9-4000-b5ac-3e7c37586c86 req-8152e348-8ba4-474d-9c69-91c9b3114c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd31d65-ed98-4de5-937a-9217b5aaafda", "tag": "e8ebb9da-528c-47e7-8569-33321c973a49"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:58.343378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a4c2b702-d8e9-4000-b5ac-3e7c37586c86 req-8152e348-8ba4-474d-9c69-91c9b3114c77 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:58.344968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a4c2b702-d8e9-4000-b5ac-3e7c37586c86 req-8152e348-8ba4-474d-9c69-91c9b3114c77 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:58.391390 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a4c2b702-d8e9-4000-b5ac-3e7c37586c86 req-8152e348-8ba4-474d-9c69-91c9b3114c77 service nova] Creating event network-changed:e8ebb9da-528c-47e7-8569-33321c973a49 for instance 6dd31d65-ed98-4de5-937a-9217b5aaafda on n-h1-844627-10 Aug 04 14:11:58.413137 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a4c2b702-d8e9-4000-b5ac-3e7c37586c86 req-8152e348-8ba4-474d-9c69-91c9b3114c77 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104353 Aug 04 14:11:58.416443 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1705/3418] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:11:58.432222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0d81fa22-f827-4f90-8b6d-ae251dadef40 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '.version_select at 0x7f47054844c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:58.474522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d5833b6e-d1ae-4c94-b162-05b712149edd tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:58.483582 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5833b6e-d1ae-4c94-b162-05b712149edd tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1320 microversion: 2.1 time: 0.915690 Aug 04 14:11:58.488505 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1714/3419] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:57 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1320 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:11:58.493035 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-0d81fa22-f827-4f90-8b6d-ae251dadef40 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Image not found. Aug 04 14:11:58.503849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-25146219-b939-4733-a85a-27e9096a1acb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0d81fa22-f827-4f90-8b6d-ae251dadef40 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/images/3785b8ca-7e8a-42d8-97b6-71735cbd8d5e HTTP/1.1 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: exception: Image not found. Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3785b8ca-7e8a-42d8-97b6-71735cbd8d5e'} Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3785b8ca-7e8a-42d8-97b6-71735cbd8d5e to delete Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3785b8ca-7e8a-42d8-97b6-71735cbd8d5e could not be found. Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:58.504526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 14:11:58.518399 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.522893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-25146219-b939-4733-a85a-27e9096a1acb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:58.524685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0d81fa22-f827-4f90-8b6d-ae251dadef40 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Image not found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:58.524975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25146219-b939-4733-a85a-27e9096a1acb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:58.524975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25146219-b939-4733-a85a-27e9096a1acb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:58.527312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25146219-b939-4733-a85a-27e9096a1acb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:58.527312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25146219-b939-4733-a85a-27e9096a1acb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:58.528312 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0d81fa22-f827-4f90-8b6d-ae251dadef40 tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/images/3785b8ca-7e8a-42d8-97b6-71735cbd8d5e" status: 404 len: 62 microversion: 2.1 time: 0.107846 Aug 04 14:11:58.535960 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1706/3420] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:58 2022] DELETE /compute/v2.1/images/3785b8ca-7e8a-42d8-97b6-71735cbd8d5e => generated 62 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:11:58.547601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:58.549311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:58.565095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:58.566329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:58.571134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:58.572282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:58.627799 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b HTTP/1.1 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '383d7069-d26f-4b0c-b363-455fe8e5424b'} Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:58.632687 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.640465 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.649367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:58.652741 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d3804fb4-08e4-4189-b2fb-305cb5fd4d7b tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "DELETE /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 404 len: 111 microversion: 2.1 time: 0.114306 Aug 04 14:11:58.660965 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1707/3421] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:11:58 2022] DELETE /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:58.679566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:58.684213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] [instance: 383d7069-d26f-4b0c-b363-455fe8e5424b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:58.711978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:58.716524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:58.717798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:58.720153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:58.741473 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] HTTP exception thrown: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Request method failure captured: Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b HTTP/1.1 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69LvhgOhZQaWUPB6HgktJOn3ojqxfnTodQwE1E23h9tAwGkgfuTqvhlykkf2zz_FlBO8ZbTg3NuJiBQJWQ_MCBvN8Sp-5Th7bXJH2zeWDYhsmPyNxXIQJ-rNnX075x15uF98EgjnGYKs6snscGB9jBFQ1kHNKcvo-nAo_X4LZdIfy-s Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_786fea7d4481410d9591a181521c1eb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/786fea7d4481410d9591a181521c1eb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/786fea7d4481410d9591a181521c1eb4"}]}] Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 786fea7d4481410d9591a181521c1eb4 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f648ba00abbe4679a43d65bc925da013 Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1128041643-project Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '383d7069-d26f-4b0c-b363-455fe8e5424b'} Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.743619 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:11:58.748475 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.748475 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:11:58.748475 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:11:58.748475 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:11:58.748475 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:11:58.748475 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:11:58.748475 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. Aug 04 14:11:58.748475 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:11:58.750252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] Returning 404 to user: Instance 383d7069-d26f-4b0c-b363-455fe8e5424b could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:11:58.751716 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8fb59200-bc2d-4328-aaca-27800bed764d tempest-ImagesOneServerNegativeTestJSON-1128041643 tempest-ImagesOneServerNegativeTestJSON-1128041643-project] 10.222.0.66 "GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b" status: 404 len: 111 microversion: 2.1 time: 0.087016 Aug 04 14:11:58.752805 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1708/3422] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:58 2022] GET /compute/v2.1/servers/383d7069-d26f-4b0c-b363-455fe8e5424b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:11:59.149581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:11:59.186609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7a8895bd-f5ec-49ca-9cfc-2c20f3efbbdf req-d39e338b-961a-4481-a91e-c79c54c5d3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff61720-5387-4758-b989-86e21ec56509", "name": "network-vif-plugged", "status": "completed", "tag": "5b6b21b5-0b35-4248-87ae-057b105e118c"}, {"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-plugged", "status": "completed", "tag": "6e5b3b8c-2b8f-432f-baa0-7557a9bda99c"}, {"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-plugged", "status": "completed", "tag": "f7228146-595d-4471-81a4-ebb2865b8ff6"}, {"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-plugged", "status": "completed", "tag": "2e3e1ebb-a26e-4cfc-b649-a6a9ee19768b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:11:59.212383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7a8895bd-f5ec-49ca-9cfc-2c20f3efbbdf req-d39e338b-961a-4481-a91e-c79c54c5d3b8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:59.214603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7a8895bd-f5ec-49ca-9cfc-2c20f3efbbdf req-d39e338b-961a-4481-a91e-c79c54c5d3b8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:59.245488 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7a8895bd-f5ec-49ca-9cfc-2c20f3efbbdf req-d39e338b-961a-4481-a91e-c79c54c5d3b8 service nova] Creating event network-vif-plugged:5b6b21b5-0b35-4248-87ae-057b105e118c for instance 0ff61720-5387-4758-b989-86e21ec56509 on n-h1-844627-10 Aug 04 14:11:59.246653 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7a8895bd-f5ec-49ca-9cfc-2c20f3efbbdf req-d39e338b-961a-4481-a91e-c79c54c5d3b8 service nova] Creating event network-vif-plugged:6e5b3b8c-2b8f-432f-baa0-7557a9bda99c for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:59.247617 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7a8895bd-f5ec-49ca-9cfc-2c20f3efbbdf req-d39e338b-961a-4481-a91e-c79c54c5d3b8 service nova] Creating event network-vif-plugged:f7228146-595d-4471-81a4-ebb2865b8ff6 for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:59.248815 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7a8895bd-f5ec-49ca-9cfc-2c20f3efbbdf req-d39e338b-961a-4481-a91e-c79c54c5d3b8 service nova] Creating event network-vif-plugged:2e3e1ebb-a26e-4cfc-b649-a6a9ee19768b for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:11:59.272044 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7a8895bd-f5ec-49ca-9cfc-2c20f3efbbdf req-d39e338b-961a-4481-a91e-c79c54c5d3b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.089984 Aug 04 14:11:59.274301 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1709/3423] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:11:59.349327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:59.357385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:59.405177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:59.410194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:59.414400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:59.415479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:59.824608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-25146219-b939-4733-a85a-27e9096a1acb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:11:59.835554 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-25146219-b939-4733-a85a-27e9096a1acb tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1314 microversion: 2.1 time: 1.345469 Aug 04 14:11:59.839083 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1715/3424] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:58 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1314 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:11:59.848052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd02c74e-5d02-4a30-af53-e396598c4a5f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:11:59.849015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd02c74e-5d02-4a30-af53-e396598c4a5f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:11:59.862347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd02c74e-5d02-4a30-af53-e396598c4a5f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:59.863553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd02c74e-5d02-4a30-af53-e396598c4a5f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:11:59.864606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd02c74e-5d02-4a30-af53-e396598c4a5f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:11:59.865279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd02c74e-5d02-4a30-af53-e396598c4a5f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:00.510517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:00.541045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:00.546167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:00.549926 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d3b14500-56d4-4ea0-bce1-c018d7532509 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 1.221874 Aug 04 14:12:00.568155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dd02c74e-5d02-4a30-af53-e396598c4a5f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:00.579099 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1710/3425] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:11:59 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:12:00.582945 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd02c74e-5d02-4a30-af53-e396598c4a5f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1320 microversion: 2.1 time: 0.741912 Aug 04 14:12:00.584103 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1716/3426] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:11:59 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1320 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:00.596844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2b664a3f-1d5c-4162-b8f1-e64b19ba1f63 req-5b8bbb98-25fd-490b-b2b2-4893b76367b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a0757a-a398-4381-aff2-a2735a806c60", "tag": "0dc5e4eb-6887-4d09-85fe-3b97ccc74b3c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:00.618825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2b664a3f-1d5c-4162-b8f1-e64b19ba1f63 req-5b8bbb98-25fd-490b-b2b2-4893b76367b0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:00.619794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2b664a3f-1d5c-4162-b8f1-e64b19ba1f63 req-5b8bbb98-25fd-490b-b2b2-4893b76367b0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:00.644485 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2b664a3f-1d5c-4162-b8f1-e64b19ba1f63 req-5b8bbb98-25fd-490b-b2b2-4893b76367b0 service nova] Creating event network-changed:0dc5e4eb-6887-4d09-85fe-3b97ccc74b3c for instance a0a0757a-a398-4381-aff2-a2735a806c60 on n-h1-844627-10 Aug 04 14:12:00.655519 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2b664a3f-1d5c-4162-b8f1-e64b19ba1f63 req-5b8bbb98-25fd-490b-b2b2-4893b76367b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073845 Aug 04 14:12:00.664972 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1711/3427] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:00.860142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f033a1e6-2ee5-4ff5-a020-b57950bf3d82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:00.860903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f033a1e6-2ee5-4ff5-a020-b57950bf3d82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:00.873073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f033a1e6-2ee5-4ff5-a020-b57950bf3d82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:00.873632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f033a1e6-2ee5-4ff5-a020-b57950bf3d82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:00.874583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f033a1e6-2ee5-4ff5-a020-b57950bf3d82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:00.875172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f033a1e6-2ee5-4ff5-a020-b57950bf3d82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:01.320840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f033a1e6-2ee5-4ff5-a020-b57950bf3d82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:01.337657 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f033a1e6-2ee5-4ff5-a020-b57950bf3d82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1314 microversion: 2.1 time: 0.481352 Aug 04 14:12:01.339526 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1717/3428] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:00 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:01.628543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-365b8c09-91e6-4f08-8509-6ab1dca1609c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:01.629436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-365b8c09-91e6-4f08-8509-6ab1dca1609c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:01.632081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:01.633644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:01.651278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-365b8c09-91e6-4f08-8509-6ab1dca1609c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:01.651942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-365b8c09-91e6-4f08-8509-6ab1dca1609c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:01.653024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-365b8c09-91e6-4f08-8509-6ab1dca1609c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:01.653759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-365b8c09-91e6-4f08-8509-6ab1dca1609c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:01.663364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:01.664977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:01.666006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:01.666645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:01.723483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:UPDATE=13,nova_cell1:SELECT=84,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:02.402914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:02.463499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:02.538831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-365b8c09-91e6-4f08-8509-6ab1dca1609c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:02.550268 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-365b8c09-91e6-4f08-8509-6ab1dca1609c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1320 microversion: 2.1 time: 0.937308 Aug 04 14:12:02.551188 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1718/3429] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:01 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1320 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:02.556570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f5658153-7bea-4f74-b99f-64f5a5ff8e5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:02.557925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f5658153-7bea-4f74-b99f-64f5a5ff8e5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:02.583030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5658153-7bea-4f74-b99f-64f5a5ff8e5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:02.583498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5658153-7bea-4f74-b99f-64f5a5ff8e5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:02.584314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5658153-7bea-4f74-b99f-64f5a5ff8e5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:02.584770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5658153-7bea-4f74-b99f-64f5a5ff8e5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:02.587213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:02.609443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:02.611639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:02.612932 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84101a2c-047b-4f9c-be91-37314f07440d tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1880 microversion: 2.32 time: 1.010762 Aug 04 14:12:02.613956 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1712/3430] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:12:01 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1880 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:12:02.724789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0e9ad94d-3bcf-4c5e-b5db-fe173634527d req-2e7dfea8-e85d-4938-bcd5-7f482f5cae7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d", "tag": "89c424c9-c10d-403c-8a21-df540522b26f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:02.746635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0e9ad94d-3bcf-4c5e-b5db-fe173634527d req-2e7dfea8-e85d-4938-bcd5-7f482f5cae7c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:02.748051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0e9ad94d-3bcf-4c5e-b5db-fe173634527d req-2e7dfea8-e85d-4938-bcd5-7f482f5cae7c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:02.770311 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0e9ad94d-3bcf-4c5e-b5db-fe173634527d req-2e7dfea8-e85d-4938-bcd5-7f482f5cae7c service nova] Creating event network-changed:89c424c9-c10d-403c-8a21-df540522b26f for instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d on n-h2-844627-10 Aug 04 14:12:02.780281 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0e9ad94d-3bcf-4c5e-b5db-fe173634527d req-2e7dfea8-e85d-4938-bcd5-7f482f5cae7c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062534 Aug 04 14:12:02.782379 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1713/3431] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:02.796320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=20 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:03.198086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f5658153-7bea-4f74-b99f-64f5a5ff8e5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:03.212441 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f5658153-7bea-4f74-b99f-64f5a5ff8e5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1314 microversion: 2.1 time: 0.659419 Aug 04 14:12:03.213410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1719/3432] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:02 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:03.593348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-62bac528-332d-41fc-8beb-829004c279e7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:03.597923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-62bac528-332d-41fc-8beb-829004c279e7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:03.617106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62bac528-332d-41fc-8beb-829004c279e7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:03.619531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62bac528-332d-41fc-8beb-829004c279e7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:03.622271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62bac528-332d-41fc-8beb-829004c279e7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:03.628296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62bac528-332d-41fc-8beb-829004c279e7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:03.657816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:03.658946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:03.681438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:03.692467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:03.694891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:03.698509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:04.848801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-62bac528-332d-41fc-8beb-829004c279e7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:04.850266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:04.865641 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-62bac528-332d-41fc-8beb-829004c279e7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1320 microversion: 2.1 time: 1.281571 Aug 04 14:12:04.865641 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1714/3433] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:03 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1320 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:04.885640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e182bcc-a8a7-40e6-82ac-ae51afc38c62 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:04.885901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e182bcc-a8a7-40e6-82ac-ae51afc38c62 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:04.906312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e182bcc-a8a7-40e6-82ac-ae51afc38c62 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:04.908104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e182bcc-a8a7-40e6-82ac-ae51afc38c62 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:04.911453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:04.912685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e182bcc-a8a7-40e6-82ac-ae51afc38c62 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:04.913618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e182bcc-a8a7-40e6-82ac-ae51afc38c62 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:04.917488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:04.920484 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8296ed97-947e-4652-ae32-0179a8158805 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2830 microversion: 2.32 time: 1.270701 Aug 04 14:12:04.921755 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1720/3434] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:12:03 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2830 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:12:04.932371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-27ed626f-b9b0-4654-aeae-f74149f907f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:04.934145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-27ed626f-b9b0-4654-aeae-f74149f907f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:04.949689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27ed626f-b9b0-4654-aeae-f74149f907f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:04.951037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27ed626f-b9b0-4654-aeae-f74149f907f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:04.952799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27ed626f-b9b0-4654-aeae-f74149f907f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:04.955357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27ed626f-b9b0-4654-aeae-f74149f907f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:05.189822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-1e182bcc-a8a7-40e6-82ac-ae51afc38c62 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lazy-loading 'services' on Instance uuid 27bb1614-6b27-48a6-b766-c7697e4169ac {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:12:05.361941 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e182bcc-a8a7-40e6-82ac-ae51afc38c62 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "DELETE /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments/107b8ec3-dca5-44de-9414-8c9d1f690bf2" status: 202 len: 0 microversion: 2.1 time: 0.493375 Aug 04 14:12:05.363437 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1715/3435] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:12:04 2022] DELETE /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments/107b8ec3-dca5-44de-9414-8c9d1f690bf2 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:12:05.416694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b2f1120d-d7b3-4fd8-acee-b454eddcb8eb tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:05.422251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b2f1120d-d7b3-4fd8-acee-b454eddcb8eb tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:05.453382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2f1120d-d7b3-4fd8-acee-b454eddcb8eb tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:05.470213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2f1120d-d7b3-4fd8-acee-b454eddcb8eb tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:05.484186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2f1120d-d7b3-4fd8-acee-b454eddcb8eb tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:05.488360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2f1120d-d7b3-4fd8-acee-b454eddcb8eb tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:05.805552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-27ed626f-b9b0-4654-aeae-f74149f907f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:05.838631 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-27ed626f-b9b0-4654-aeae-f74149f907f9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1314 microversion: 2.1 time: 0.913924 Aug 04 14:12:05.842780 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1721/3436] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:04 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:05.865152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-511685a0-8770-4d19-8628-9fc04e266825 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:05.878654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-511685a0-8770-4d19-8628-9fc04e266825 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:05.905976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-511685a0-8770-4d19-8628-9fc04e266825 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:05.910238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-511685a0-8770-4d19-8628-9fc04e266825 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:05.912750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-511685a0-8770-4d19-8628-9fc04e266825 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:05.918617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-511685a0-8770-4d19-8628-9fc04e266825 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:06.067743 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-511685a0-8770-4d19-8628-9fc04e266825 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221925 Aug 04 14:12:06.068756 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1722/3437] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:12:05 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:06.084278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19d99641-1401-441a-a19f-6a7040d86d11 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:06.085966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-19d99641-1401-441a-a19f-6a7040d86d11 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:06.124046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19d99641-1401-441a-a19f-6a7040d86d11 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:06.124813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19d99641-1401-441a-a19f-6a7040d86d11 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:06.126258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19d99641-1401-441a-a19f-6a7040d86d11 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:06.128033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19d99641-1401-441a-a19f-6a7040d86d11 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:06.515259 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b2f1120d-d7b3-4fd8-acee-b454eddcb8eb tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679/os-interface" status: 200 len: 1830 microversion: 2.32 time: 1.148470 Aug 04 14:12:06.516768 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1716/3438] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 14:12:05 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679/os-interface => generated 1830 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:12:06.884934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-04baa83b-81e2-4bc9-bd94-bc46c03487a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:06.889913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-04baa83b-81e2-4bc9-bd94-bc46c03487a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:06.915103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04baa83b-81e2-4bc9-bd94-bc46c03487a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:06.915951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04baa83b-81e2-4bc9-bd94-bc46c03487a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:06.917524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04baa83b-81e2-4bc9-bd94-bc46c03487a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:06.918304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04baa83b-81e2-4bc9-bd94-bc46c03487a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:07.960742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-19d99641-1401-441a-a19f-6a7040d86d11 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:07.977346 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-19d99641-1401-441a-a19f-6a7040d86d11 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1320 microversion: 2.1 time: 1.906980 Aug 04 14:12:07.981295 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1723/3439] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:06 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1320 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:07.994273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5bbccb72-5618-407e-819e-9962cc8b6d1a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:07.997118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5bbccb72-5618-407e-819e-9962cc8b6d1a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:08.015824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bbccb72-5618-407e-819e-9962cc8b6d1a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:08.018297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bbccb72-5618-407e-819e-9962cc8b6d1a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:08.019383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bbccb72-5618-407e-819e-9962cc8b6d1a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:08.025563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bbccb72-5618-407e-819e-9962cc8b6d1a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:08.118357 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5bbccb72-5618-407e-819e-9962cc8b6d1a tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135576 Aug 04 14:12:08.129527 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1724/3440] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:12:07 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:08.468525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-04baa83b-81e2-4bc9-bd94-bc46c03487a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:08.496359 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-04baa83b-81e2-4bc9-bd94-bc46c03487a3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1314 microversion: 2.1 time: 1.630396 Aug 04 14:12:08.497425 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1717/3441] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:06 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1314 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:08.620838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ae580dba-ec67-424d-b037-362b7d7be3d1 req-099d8c74-236c-49dc-9423-fc938d54d701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d", "name": "network-vif-plugged", "status": "completed", "tag": "89c424c9-c10d-403c-8a21-df540522b26f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:08.660755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ae580dba-ec67-424d-b037-362b7d7be3d1 req-099d8c74-236c-49dc-9423-fc938d54d701 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:08.664537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ae580dba-ec67-424d-b037-362b7d7be3d1 req-099d8c74-236c-49dc-9423-fc938d54d701 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:08.732893 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ae580dba-ec67-424d-b037-362b7d7be3d1 req-099d8c74-236c-49dc-9423-fc938d54d701 service nova] Creating event network-vif-plugged:89c424c9-c10d-403c-8a21-df540522b26f for instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d on n-h2-844627-10 Aug 04 14:12:08.760711 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ae580dba-ec67-424d-b037-362b7d7be3d1 req-099d8c74-236c-49dc-9423-fc938d54d701 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145782 Aug 04 14:12:08.764967 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1725/3442] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:12:09.019686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-553944a8-216a-4b81-abe5-b88870d36cfc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:09.020973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-553944a8-216a-4b81-abe5-b88870d36cfc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:09.043777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-553944a8-216a-4b81-abe5-b88870d36cfc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:09.044904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-553944a8-216a-4b81-abe5-b88870d36cfc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:09.048589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-553944a8-216a-4b81-abe5-b88870d36cfc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:09.049354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-553944a8-216a-4b81-abe5-b88870d36cfc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:09.137148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a47f0fd6-4945-4a12-ab3f-8a3cc84b5e14 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:09.139985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a47f0fd6-4945-4a12-ab3f-8a3cc84b5e14 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:09.177256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a47f0fd6-4945-4a12-ab3f-8a3cc84b5e14 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:09.178051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a47f0fd6-4945-4a12-ab3f-8a3cc84b5e14 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:09.180925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a47f0fd6-4945-4a12-ab3f-8a3cc84b5e14 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:09.186314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a47f0fd6-4945-4a12-ab3f-8a3cc84b5e14 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:09.287177 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a47f0fd6-4945-4a12-ab3f-8a3cc84b5e14 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154665 Aug 04 14:12:09.299146 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1726/3443] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:12:09 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:09.526568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2050aad2-0e28-4073-a8b9-d1f8a40f7106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:09.527225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2050aad2-0e28-4073-a8b9-d1f8a40f7106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:09.540192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2050aad2-0e28-4073-a8b9-d1f8a40f7106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:09.540716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2050aad2-0e28-4073-a8b9-d1f8a40f7106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:09.553033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2050aad2-0e28-4073-a8b9-d1f8a40f7106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:09.553528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2050aad2-0e28-4073-a8b9-d1f8a40f7106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:10.832580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2050aad2-0e28-4073-a8b9-d1f8a40f7106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:10.849675 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2050aad2-0e28-4073-a8b9-d1f8a40f7106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1314 microversion: 2.1 time: 1.327898 Aug 04 14:12:10.854595 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1727/3444] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:09 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1314 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:10.872051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b964a5e-3a2a-4082-9f7a-5c5963666ea4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:10.881742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b964a5e-3a2a-4082-9f7a-5c5963666ea4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:10.912212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b964a5e-3a2a-4082-9f7a-5c5963666ea4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:10.915693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b964a5e-3a2a-4082-9f7a-5c5963666ea4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:10.918386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b964a5e-3a2a-4082-9f7a-5c5963666ea4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:10.920338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b964a5e-3a2a-4082-9f7a-5c5963666ea4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:11.109944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-553944a8-216a-4b81-abe5-b88870d36cfc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:11.127991 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-553944a8-216a-4b81-abe5-b88870d36cfc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1320 microversion: 2.1 time: 2.115055 Aug 04 14:12:11.128589 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1718/3445] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:09 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1320 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:11.131239 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b964a5e-3a2a-4082-9f7a-5c5963666ea4 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.273918 Aug 04 14:12:11.139866 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1728/3446] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:12:10 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 197 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:11.893986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2896bdd7-645c-43b6-9ff4-df4c239c234e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:11.895099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2896bdd7-645c-43b6-9ff4-df4c239c234e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:11.910178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2896bdd7-645c-43b6-9ff4-df4c239c234e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:11.910934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2896bdd7-645c-43b6-9ff4-df4c239c234e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:11.915846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2896bdd7-645c-43b6-9ff4-df4c239c234e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:11.916841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2896bdd7-645c-43b6-9ff4-df4c239c234e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:12.150034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a674d57f-a6de-4187-a392-26ec6f02975d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:12.155795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a674d57f-a6de-4187-a392-26ec6f02975d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:12.186326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a674d57f-a6de-4187-a392-26ec6f02975d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:12.187518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a674d57f-a6de-4187-a392-26ec6f02975d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:12.189053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a674d57f-a6de-4187-a392-26ec6f02975d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:12.189722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a674d57f-a6de-4187-a392-26ec6f02975d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:12.199134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:12.309835 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a674d57f-a6de-4187-a392-26ec6f02975d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166553 Aug 04 14:12:12.313563 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1729/3447] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:12:12 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:12.334317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e5cbdb0a-1ffe-4e83-8477-3840623ac38f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:12.335680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e5cbdb0a-1ffe-4e83-8477-3840623ac38f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:12.350459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5cbdb0a-1ffe-4e83-8477-3840623ac38f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:12.354847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5cbdb0a-1ffe-4e83-8477-3840623ac38f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:12.357812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5cbdb0a-1ffe-4e83-8477-3840623ac38f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:12.361936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5cbdb0a-1ffe-4e83-8477-3840623ac38f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:12.690555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2896bdd7-645c-43b6-9ff4-df4c239c234e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:12.707008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2896bdd7-645c-43b6-9ff4-df4c239c234e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1500 microversion: 2.1 time: 0.815840 Aug 04 14:12:12.709288 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1719/3448] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:11 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1500 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:12.758689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1cfe7537-fa8f-4628-a1e6-a9076714e92b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:12.767021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1cfe7537-fa8f-4628-a1e6-a9076714e92b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:12.767521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1cfe7537-fa8f-4628-a1e6-a9076714e92b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:12.827344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1cfe7537-fa8f-4628-a1e6-a9076714e92b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Going to try to stop instance {{(pid=130961) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 14:12:12.929869 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1cfe7537-fa8f-4628-a1e6-a9076714e92b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d/action" status: 202 len: 0 microversion: 2.1 time: 0.175135 Aug 04 14:12:12.930770 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1720/3449] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:12:12 2022] POST /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:12:12.961750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d376c434-0def-4c59-ad89-7f47053a9ea7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:12.964501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d376c434-0def-4c59-ad89-7f47053a9ea7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:12.988239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d376c434-0def-4c59-ad89-7f47053a9ea7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:12.990198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d376c434-0def-4c59-ad89-7f47053a9ea7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:12.992421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d376c434-0def-4c59-ad89-7f47053a9ea7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:12.994165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d376c434-0def-4c59-ad89-7f47053a9ea7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:13.541366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e5cbdb0a-1ffe-4e83-8477-3840623ac38f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:13.587356 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e5cbdb0a-1ffe-4e83-8477-3840623ac38f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1320 microversion: 2.1 time: 1.271792 Aug 04 14:12:13.590466 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1730/3450] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:12 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1320 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:13.605827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-54a4ab9b-5e2d-4289-90be-bcf77c2521b1 req-65a7cd7a-d0b9-4a10-9f12-e82710b8531b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd31d65-ed98-4de5-937a-9217b5aaafda", "name": "network-vif-plugged", "status": "completed", "tag": "e8ebb9da-528c-47e7-8569-33321c973a49"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:13.644208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-54a4ab9b-5e2d-4289-90be-bcf77c2521b1 req-65a7cd7a-d0b9-4a10-9f12-e82710b8531b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:13.646248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-54a4ab9b-5e2d-4289-90be-bcf77c2521b1 req-65a7cd7a-d0b9-4a10-9f12-e82710b8531b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:13.698257 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-54a4ab9b-5e2d-4289-90be-bcf77c2521b1 req-65a7cd7a-d0b9-4a10-9f12-e82710b8531b service nova] Creating event network-vif-plugged:e8ebb9da-528c-47e7-8569-33321c973a49 for instance 6dd31d65-ed98-4de5-937a-9217b5aaafda on n-h1-844627-10 Aug 04 14:12:13.750556 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-54a4ab9b-5e2d-4289-90be-bcf77c2521b1 req-65a7cd7a-d0b9-4a10-9f12-e82710b8531b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153557 Aug 04 14:12:13.757827 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1731/3451] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:13.787909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aa9ca691-3b0a-4cef-8508-3422d5a5aff5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:13.799585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aa9ca691-3b0a-4cef-8508-3422d5a5aff5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:13.844791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa9ca691-3b0a-4cef-8508-3422d5a5aff5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:13.846262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa9ca691-3b0a-4cef-8508-3422d5a5aff5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:13.851631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa9ca691-3b0a-4cef-8508-3422d5a5aff5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:13.854179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa9ca691-3b0a-4cef-8508-3422d5a5aff5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:13.997587 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aa9ca691-3b0a-4cef-8508-3422d5a5aff5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235031 Aug 04 14:12:14.006334 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1732/3452] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:12:13 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:14.401897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d376c434-0def-4c59-ad89-7f47053a9ea7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:14.417966 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d376c434-0def-4c59-ad89-7f47053a9ea7 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 1.468786 Aug 04 14:12:14.429537 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1721/3453] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:12 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:14.627529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-80786037-dec9-4e46-8c05-8b4670585cd6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:14.632287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-80786037-dec9-4e46-8c05-8b4670585cd6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:14.668239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80786037-dec9-4e46-8c05-8b4670585cd6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:14.672767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80786037-dec9-4e46-8c05-8b4670585cd6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:14.674900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80786037-dec9-4e46-8c05-8b4670585cd6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:14.677307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80786037-dec9-4e46-8c05-8b4670585cd6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:14.955025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5382fd6a-fcd0-4cfb-b01d-d50ef41c86b6 req-b12ebfdf-f67b-4534-ba98-62e5edcfa1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "tag": "6e5b3b8c-2b8f-432f-baa0-7557a9bda99c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:14.986440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:15.016096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5382fd6a-fcd0-4cfb-b01d-d50ef41c86b6 req-b12ebfdf-f67b-4534-ba98-62e5edcfa1af service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:15.017124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5382fd6a-fcd0-4cfb-b01d-d50ef41c86b6 req-b12ebfdf-f67b-4534-ba98-62e5edcfa1af service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:15.075971 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5382fd6a-fcd0-4cfb-b01d-d50ef41c86b6 req-b12ebfdf-f67b-4534-ba98-62e5edcfa1af service nova] Creating event network-changed:6e5b3b8c-2b8f-432f-baa0-7557a9bda99c for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:12:15.111870 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5382fd6a-fcd0-4cfb-b01d-d50ef41c86b6 req-b12ebfdf-f67b-4534-ba98-62e5edcfa1af service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165626 Aug 04 14:12:15.114315 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1722/3454] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:15.148011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-348fc61c-c11b-4902-94b6-99e9a2950910 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:15.150652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-348fc61c-c11b-4902-94b6-99e9a2950910 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:15.184987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-348fc61c-c11b-4902-94b6-99e9a2950910 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:15.185637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-348fc61c-c11b-4902-94b6-99e9a2950910 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:15.186879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-348fc61c-c11b-4902-94b6-99e9a2950910 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:15.190790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-348fc61c-c11b-4902-94b6-99e9a2950910 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:15.291285 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-348fc61c-c11b-4902-94b6-99e9a2950910 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175069 Aug 04 14:12:15.292690 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1723/3455] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:12:15 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:15.448290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ea19fcd-a4ba-4e5a-b598-43dd9060fb01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:15.449369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ea19fcd-a4ba-4e5a-b598-43dd9060fb01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:15.475821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ea19fcd-a4ba-4e5a-b598-43dd9060fb01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:15.476286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ea19fcd-a4ba-4e5a-b598-43dd9060fb01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:15.485730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ea19fcd-a4ba-4e5a-b598-43dd9060fb01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:15.486306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ea19fcd-a4ba-4e5a-b598-43dd9060fb01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:15.928973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-80786037-dec9-4e46-8c05-8b4670585cd6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:15.955547 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-80786037-dec9-4e46-8c05-8b4670585cd6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1320 microversion: 2.1 time: 1.330764 Aug 04 14:12:15.955547 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1733/3456] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:14 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1320 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:15.978014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ef7287b8-bc7a-4711-8f7f-fe81adb70022 req-75699e7a-0d37-4018-acab-682e780ac149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a0757a-a398-4381-aff2-a2735a806c60", "name": "network-vif-plugged", "status": "completed", "tag": "0dc5e4eb-6887-4d09-85fe-3b97ccc74b3c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:16.008195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ef7287b8-bc7a-4711-8f7f-fe81adb70022 req-75699e7a-0d37-4018-acab-682e780ac149 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:16.010142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ef7287b8-bc7a-4711-8f7f-fe81adb70022 req-75699e7a-0d37-4018-acab-682e780ac149 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:16.050459 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ef7287b8-bc7a-4711-8f7f-fe81adb70022 req-75699e7a-0d37-4018-acab-682e780ac149 service nova] Creating event network-vif-plugged:0dc5e4eb-6887-4d09-85fe-3b97ccc74b3c for instance a0a0757a-a398-4381-aff2-a2735a806c60 on n-h1-844627-10 Aug 04 14:12:16.064160 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ef7287b8-bc7a-4711-8f7f-fe81adb70022 req-75699e7a-0d37-4018-acab-682e780ac149 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102464 Aug 04 14:12:16.082289 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1734/3457] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:16.309990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7a61196b-69f5-457f-8b2e-db5af6a6773d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:16.312678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a61196b-69f5-457f-8b2e-db5af6a6773d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:16.348278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a61196b-69f5-457f-8b2e-db5af6a6773d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:16.348809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a61196b-69f5-457f-8b2e-db5af6a6773d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:16.356704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a61196b-69f5-457f-8b2e-db5af6a6773d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:16.359853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a61196b-69f5-457f-8b2e-db5af6a6773d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:16.469017 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7a61196b-69f5-457f-8b2e-db5af6a6773d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163799 Aug 04 14:12:16.471724 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1735/3458] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:12:16 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:12:16.809551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ea19fcd-a4ba-4e5a-b598-43dd9060fb01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:16.830494 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ea19fcd-a4ba-4e5a-b598-43dd9060fb01 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 1.389544 Aug 04 14:12:16.849069 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1724/3459] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:15 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:16.979381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff053bfd-de50-4c24-825a-108911ce3257 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:16.980201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff053bfd-de50-4c24-825a-108911ce3257 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:16.994004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff053bfd-de50-4c24-825a-108911ce3257 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:16.995022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff053bfd-de50-4c24-825a-108911ce3257 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:16.996472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff053bfd-de50-4c24-825a-108911ce3257 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:16.997610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff053bfd-de50-4c24-825a-108911ce3257 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:17.499766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-914ec8b3-5dee-4e14-879e-edac73886305 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:17.508702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff053bfd-de50-4c24-825a-108911ce3257 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:17.511662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-914ec8b3-5dee-4e14-879e-edac73886305 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:17.529627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-914ec8b3-5dee-4e14-879e-edac73886305 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:17.530278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-914ec8b3-5dee-4e14-879e-edac73886305 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:17.537910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-914ec8b3-5dee-4e14-879e-edac73886305 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:17.538555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-914ec8b3-5dee-4e14-879e-edac73886305 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:17.566005 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff053bfd-de50-4c24-825a-108911ce3257 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1320 microversion: 2.1 time: 0.582941 Aug 04 14:12:17.570743 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1736/3460] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:16 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:17.637336 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-914ec8b3-5dee-4e14-879e-edac73886305 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148132 Aug 04 14:12:17.640844 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1725/3461] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:12:17 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:12:17.766999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:17.771902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:17.786201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:17.787628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:17.789844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:17.791133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:17.860264 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] HTTP exception thrown: Cannot 'reboot' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued Aug 04 14:12:17.862032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9bc6132e-c851-4689-81f6-16109bb8adbc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:17.864682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9bc6132e-c851-4689-81f6-16109bb8adbc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Request method failure captured: Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6/action HTTP/1.1 Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 28 Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JxokQZWt73oCTeb2uIT1T61PPtBceW-GidRWsXDOZjQVnibDMlYFve8J2CmvNSqnoJ2gUswAJOQhT5G9sx82VvrXKfhYzVPLV5Gd4BsYAE7SpJCYfj1C3r3f1XD7yVS8i5KHJX727wlQRlE5KUXS609Oac6ysS4Xt8O7zqu2gmqzI Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}] Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 653fb03c7a4b4a61a57ecd4cdd610e86 Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: {"reboot": {"type": "HARD"}} Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: exception: Cannot 'reboot' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'ac42befe-28d2-4af7-b56e-2cc6ea8034b6', 'body': {'reboot': {'type': 'HARD'}}} Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:12:17.869592 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:17.882046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Returning 409 to user: Cannot 'reboot' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:12:17.885476 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0725092b-47ac-4077-ba2c-589dd8aa4457 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6/action" status: 409 len: 145 microversion: 2.1 time: 0.138325 Aug 04 14:12:17.887040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1737/3462] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:12:17 2022] POST /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6/action => generated 145 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:12:17.912464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:17.922998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:17.927534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bc6132e-c851-4689-81f6-16109bb8adbc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:17.931557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bc6132e-c851-4689-81f6-16109bb8adbc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:17.935633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bc6132e-c851-4689-81f6-16109bb8adbc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:17.940389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bc6132e-c851-4689-81f6-16109bb8adbc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:17.942218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:17.944217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:17.948514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:17.950310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:18.154127 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] HTTP exception thrown: Cannot 'rebuild' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Request method failure captured: Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6/action HTTP/1.1 Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 65 Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JxokQZWt73oCTeb2uIT1T61PPtBceW-GidRWsXDOZjQVnibDMlYFve8J2CmvNSqnoJ2gUswAJOQhT5G9sx82VvrXKfhYzVPLV5Gd4BsYAE7SpJCYfj1C3r3f1XD7yVS8i5KHJX727wlQRlE5KUXS609Oac6ysS4Xt8O7zqu2gmqzI Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}] Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 653fb03c7a4b4a61a57ecd4cdd610e86 Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: exception: Cannot 'rebuild' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'ac42befe-28d2-4af7-b56e-2cc6ea8034b6', 'body': {'rebuild': {'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9'}}} Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:12:18.163451 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued Aug 04 14:12:18.172633 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:18.182826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Returning 409 to user: Cannot 'rebuild' instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 while it is in vm_state rescued {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:12:18.189663 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5343fdc-1ae9-4e99-a6d1-bcdf1d0464ea tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "POST /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6/action" status: 409 len: 146 microversion: 2.1 time: 0.284186 Aug 04 14:12:18.196430 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1738/3463] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:12:17 2022] POST /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6/action => generated 146 bytes in 297 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:12:18.208950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-995b1b23-574d-4c8f-94c1-cd1650c5b8a5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:18.220621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-995b1b23-574d-4c8f-94c1-cd1650c5b8a5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:18.240063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-995b1b23-574d-4c8f-94c1-cd1650c5b8a5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:18.244715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-995b1b23-574d-4c8f-94c1-cd1650c5b8a5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:18.246249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-995b1b23-574d-4c8f-94c1-cd1650c5b8a5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:18.249863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-995b1b23-574d-4c8f-94c1-cd1650c5b8a5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:18.348201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-995b1b23-574d-4c8f-94c1-cd1650c5b8a5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:12:18.589837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9bc6132e-c851-4689-81f6-16109bb8adbc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:18.611727 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9bc6132e-c851-4689-81f6-16109bb8adbc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.763052 Aug 04 14:12:18.612989 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1726/3464] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:17 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:18.634540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3fd3bf9-33c5-43f9-8325-0cef43a3e624 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:18.635770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b3fd3bf9-33c5-43f9-8325-0cef43a3e624 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:18.638221 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-995b1b23-574d-4c8f-94c1-cd1650c5b8a5 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "DELETE /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 204 len: 0 microversion: 2.1 time: 0.435426 Aug 04 14:12:18.643063 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1739/3465] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:12:18 2022] DELETE /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:12:18.651697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3fd3bf9-33c5-43f9-8325-0cef43a3e624 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:18.652656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3fd3bf9-33c5-43f9-8325-0cef43a3e624 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:18.662609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3fd3bf9-33c5-43f9-8325-0cef43a3e624 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:18.662817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53a39cdc-8704-4d25-8688-d4e458730a0b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:18.663268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3fd3bf9-33c5-43f9-8325-0cef43a3e624 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:18.666043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-53a39cdc-8704-4d25-8688-d4e458730a0b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:18.675717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53a39cdc-8704-4d25-8688-d4e458730a0b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:18.676597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53a39cdc-8704-4d25-8688-d4e458730a0b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:18.677702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53a39cdc-8704-4d25-8688-d4e458730a0b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:18.678867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53a39cdc-8704-4d25-8688-d4e458730a0b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:19.258425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-53a39cdc-8704-4d25-8688-d4e458730a0b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:19.279931 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-53a39cdc-8704-4d25-8688-d4e458730a0b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1689 microversion: 2.1 time: 0.634842 Aug 04 14:12:19.281278 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1740/3466] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:18 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1689 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:19.285864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b3fd3bf9-33c5-43f9-8325-0cef43a3e624 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:19.299136 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3fd3bf9-33c5-43f9-8325-0cef43a3e624 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1512 microversion: 2.1 time: 0.671951 Aug 04 14:12:19.316010 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1727/3467] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:18 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1512 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:19.322780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-db33295a-5a48-4be1-b442-3e9045302891 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:19.323426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-db33295a-5a48-4be1-b442-3e9045302891 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:19.339599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db33295a-5a48-4be1-b442-3e9045302891 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:19.340070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db33295a-5a48-4be1-b442-3e9045302891 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:19.341067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db33295a-5a48-4be1-b442-3e9045302891 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:19.341552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db33295a-5a48-4be1-b442-3e9045302891 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:19.652647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a771c4bb-6491-4799-bd06-811276f0f4cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:19.656427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a771c4bb-6491-4799-bd06-811276f0f4cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:19.691014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a771c4bb-6491-4799-bd06-811276f0f4cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:19.691915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a771c4bb-6491-4799-bd06-811276f0f4cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:19.702112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a771c4bb-6491-4799-bd06-811276f0f4cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:19.704055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a771c4bb-6491-4799-bd06-811276f0f4cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:19.726230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-db33295a-5a48-4be1-b442-3e9045302891 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:19.761505 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-db33295a-5a48-4be1-b442-3e9045302891 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1512 microversion: 2.1 time: 0.441013 Aug 04 14:12:19.787820 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1741/3468] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:19 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1512 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:19.807485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7037b8d9-48bd-4a9b-b0f7-8a9c7ab6042d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:19.809421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7037b8d9-48bd-4a9b-b0f7-8a9c7ab6042d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:19.835806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7037b8d9-48bd-4a9b-b0f7-8a9c7ab6042d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:19.837730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7037b8d9-48bd-4a9b-b0f7-8a9c7ab6042d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:19.851212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7037b8d9-48bd-4a9b-b0f7-8a9c7ab6042d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:19.852916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7037b8d9-48bd-4a9b-b0f7-8a9c7ab6042d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:20.407748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a771c4bb-6491-4799-bd06-811276f0f4cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:20.410432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:20.425399 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a771c4bb-6491-4799-bd06-811276f0f4cf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.785536 Aug 04 14:12:20.452906 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1728/3469] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:19 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:20.452906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d136be8b-78e3-4822-a6f8-ad6705719d9d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:20.452906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d136be8b-78e3-4822-a6f8-ad6705719d9d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:20.459867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d136be8b-78e3-4822-a6f8-ad6705719d9d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:20.460822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d136be8b-78e3-4822-a6f8-ad6705719d9d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:20.462068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d136be8b-78e3-4822-a6f8-ad6705719d9d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:20.462756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d136be8b-78e3-4822-a6f8-ad6705719d9d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:20.493579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7037b8d9-48bd-4a9b-b0f7-8a9c7ab6042d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:20.506091 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7037b8d9-48bd-4a9b-b0f7-8a9c7ab6042d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda" status: 200 len: 1511 microversion: 2.1 time: 0.709950 Aug 04 14:12:20.517519 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1742/3470] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:19 2022] GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda => generated 1511 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:20.563124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:20.578247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:20.579842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:20.641878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:20.643018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:20.647213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:20.647813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:20.856918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d136be8b-78e3-4822-a6f8-ad6705719d9d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:20.873190 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d136be8b-78e3-4822-a6f8-ad6705719d9d tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1689 microversion: 2.1 time: 0.432600 Aug 04 14:12:20.887682 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1729/3471] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:20 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1689 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:20.917329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:21.087188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:21.110139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:21.111396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:21.352410 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5bf213e2-c1b5-4099-a799-dcf1b3b40304 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.792830 Aug 04 14:12:21.353849 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1743/3472] 10.222.0.66 () {58 vars in 1167 bytes} [Thu Aug 4 14:12:20 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:21.383381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:21.394498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:21.399497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1666160630', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:21.415318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:21.417668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:21.419997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:21.420813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:21.477883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7fdfdad-be1b-4c54-ae40-48a628c153c6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:21.479495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d7fdfdad-be1b-4c54-ae40-48a628c153c6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:21.492650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7fdfdad-be1b-4c54-ae40-48a628c153c6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:21.495476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7fdfdad-be1b-4c54-ae40-48a628c153c6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:21.497503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7fdfdad-be1b-4c54-ae40-48a628c153c6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:21.498547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7fdfdad-be1b-4c54-ae40-48a628c153c6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:21.706732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:21.784176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d7fdfdad-be1b-4c54-ae40-48a628c153c6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:21.825628 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d7fdfdad-be1b-4c54-ae40-48a628c153c6 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.351588 Aug 04 14:12:21.841492 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1744/3473] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:21 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:21.915587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c61a542-0ce5-419a-89e7-8de7b736e884 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:21.920401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c61a542-0ce5-419a-89e7-8de7b736e884 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:21.934826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:21.948772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:21.949341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:21.952885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c61a542-0ce5-419a-89e7-8de7b736e884 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:21.955120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c61a542-0ce5-419a-89e7-8de7b736e884 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:21.959159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c61a542-0ce5-419a-89e7-8de7b736e884 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:21.960601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c61a542-0ce5-419a-89e7-8de7b736e884 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:22.044954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:22.310888 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c32f7c5-18fe-4ade-b542-139577c6939f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1666160630" status: 200 len: 1515 microversion: 2.1 time: 0.932226 Aug 04 14:12:22.311675 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1730/3474] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:12:21 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1666160630 => generated 1515 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:22.369293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:22.386245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:22.387552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:22.409943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:22.420969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:22.423664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:22.424587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:22.612057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7c61a542-0ce5-419a-89e7-8de7b736e884 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:22.628047 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c61a542-0ce5-419a-89e7-8de7b736e884 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1689 microversion: 2.1 time: 0.721933 Aug 04 14:12:22.634763 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1745/3475] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:21 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1689 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:22.837765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:22.872221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-89a0f947-2629-44c1-b949-5792ac0627ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:22.883941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-89a0f947-2629-44c1-b949-5792ac0627ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:22.910704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89a0f947-2629-44c1-b949-5792ac0627ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:22.914984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89a0f947-2629-44c1-b949-5792ac0627ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:22.919419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89a0f947-2629-44c1-b949-5792ac0627ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:22.920317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89a0f947-2629-44c1-b949-5792ac0627ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:23.043889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:23.061257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:23.062714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:23.490981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-89a0f947-2629-44c1-b949-5792ac0627ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:23.503692 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-89a0f947-2629-44c1-b949-5792ac0627ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.641431 Aug 04 14:12:23.505506 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1746/3476] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:22 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:23.570749 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8153f832-3d26-42f7-b6fe-7376e36e63f5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.204805 Aug 04 14:12:23.587052 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1731/3477] 10.222.0.66 () {58 vars in 1173 bytes} [Thu Aug 4 14:12:22 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:23.630485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:23.644464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:23.645743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.compute.servers [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Removing options 'limit' from query {{(pid=130960) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 14:12:23.647587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:23.651172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:23.660644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:23.661868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:23.663669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:23.665163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:23.698497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3b6d73ac-0418-48dc-8a14-39efe10c6e7c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:23.699690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3b6d73ac-0418-48dc-8a14-39efe10c6e7c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:23.725423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b6d73ac-0418-48dc-8a14-39efe10c6e7c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:23.737930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b6d73ac-0418-48dc-8a14-39efe10c6e7c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:23.739807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b6d73ac-0418-48dc-8a14-39efe10c6e7c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:23.740637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b6d73ac-0418-48dc-8a14-39efe10c6e7c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:23.768125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:23.781089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:23.782448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.321272 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b2c794e7-a73b-4f44-86ea-c8b143f7b5f1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.698806 Aug 04 14:12:24.322589 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1747/3478] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 14:12:23 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:24.366280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20a9d70a-da26-4fe6-8532-7ba7bc87c6b7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:24.372147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-20a9d70a-da26-4fe6-8532-7ba7bc87c6b7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:24.373236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-20a9d70a-da26-4fe6-8532-7ba7bc87c6b7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:24.380846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3b6d73ac-0418-48dc-8a14-39efe10c6e7c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:24.385893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20a9d70a-da26-4fe6-8532-7ba7bc87c6b7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.386571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20a9d70a-da26-4fe6-8532-7ba7bc87c6b7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.388073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20a9d70a-da26-4fe6-8532-7ba7bc87c6b7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.388658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20a9d70a-da26-4fe6-8532-7ba7bc87c6b7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.396364 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3b6d73ac-0418-48dc-8a14-39efe10c6e7c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1689 microversion: 2.1 time: 0.707190 Aug 04 14:12:24.399796 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1732/3479] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:23 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1689 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:24.427522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-20a9d70a-da26-4fe6-8532-7ba7bc87c6b7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:24.470126 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-20a9d70a-da26-4fe6-8532-7ba7bc87c6b7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.110675 Aug 04 14:12:24.471304 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1748/3480] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 14:12:24 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:24.489790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:24.497639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:24.498315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.compute.servers [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Removing options 'limit' from query {{(pid=130961) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 14:12:24.499755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:24.507204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.507946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.508817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.509318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.558567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:24.564486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-59f8efbc-c752-4ec1-b2dc-99f85a04b5fc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:24.567926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-59f8efbc-c752-4ec1-b2dc-99f85a04b5fc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:24.579730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59f8efbc-c752-4ec1-b2dc-99f85a04b5fc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.580569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59f8efbc-c752-4ec1-b2dc-99f85a04b5fc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.588996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59f8efbc-c752-4ec1-b2dc-99f85a04b5fc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.588996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59f8efbc-c752-4ec1-b2dc-99f85a04b5fc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.669119 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ea84a91a-eda6-431b-a739-af7dedaade95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.185685 Aug 04 14:12:24.681694 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1733/3481] 10.222.0.66 () {58 vars in 1150 bytes} [Thu Aug 4 14:12:24 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:24.692346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd875237-6f24-4b6e-a4fb-4ee3b67400bc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:24.699662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fd875237-6f24-4b6e-a4fb-4ee3b67400bc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:24.700991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd875237-6f24-4b6e-a4fb-4ee3b67400bc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:24.709030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd875237-6f24-4b6e-a4fb-4ee3b67400bc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.709486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd875237-6f24-4b6e-a4fb-4ee3b67400bc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.711079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd875237-6f24-4b6e-a4fb-4ee3b67400bc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.713058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd875237-6f24-4b6e-a4fb-4ee3b67400bc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.768313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-fd875237-6f24-4b6e-a4fb-4ee3b67400bc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:24.809166 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd875237-6f24-4b6e-a4fb-4ee3b67400bc tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.126156 Aug 04 14:12:24.810713 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1734/3482] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:12:24 2022] GET /compute/v2.1/servers => generated 1010 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:24.828716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-412aafc3-9d07-43f2-889f-2a3af8bfe7f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:24.838507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-412aafc3-9d07-43f2-889f-2a3af8bfe7f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:24.843091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-412aafc3-9d07-43f2-889f-2a3af8bfe7f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:24.877768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-412aafc3-9d07-43f2-889f-2a3af8bfe7f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.880151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-412aafc3-9d07-43f2-889f-2a3af8bfe7f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:24.881774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-412aafc3-9d07-43f2-889f-2a3af8bfe7f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:24.882475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-412aafc3-9d07-43f2-889f-2a3af8bfe7f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:25.080160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-412aafc3-9d07-43f2-889f-2a3af8bfe7f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:25.204888 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-412aafc3-9d07-43f2-889f-2a3af8bfe7f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.381572 Aug 04 14:12:25.221575 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1735/3483] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:12:24 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:12:25.233436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-278ab84f-6508-4b71-8080-2a212f06981b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:25.252756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-278ab84f-6508-4b71-8080-2a212f06981b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:25.253294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.compute.servers [None req-278ab84f-6508-4b71-8080-2a212f06981b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Removing options 'limit' from query {{(pid=130961) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 14:12:25.256333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-278ab84f-6508-4b71-8080-2a212f06981b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:25.281698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-278ab84f-6508-4b71-8080-2a212f06981b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:25.283710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-278ab84f-6508-4b71-8080-2a212f06981b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:25.289366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-278ab84f-6508-4b71-8080-2a212f06981b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:25.290100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-278ab84f-6508-4b71-8080-2a212f06981b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:25.354608 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-278ab84f-6508-4b71-8080-2a212f06981b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.131377 Aug 04 14:12:25.371317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-59f8efbc-c752-4ec1-b2dc-99f85a04b5fc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:25.374567 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1736/3484] 10.222.0.66 () {58 vars in 1140 bytes} [Thu Aug 4 14:12:25 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:25.382179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8bac570e-ffb5-427f-9733-dc609a885c83 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:25.385244 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-59f8efbc-c752-4ec1-b2dc-99f85a04b5fc tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.838591 Aug 04 14:12:25.389985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8bac570e-ffb5-427f-9733-dc609a885c83 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:25.391436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8bac570e-ffb5-427f-9733-dc609a885c83 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1666160630', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:25.391942 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1749/3485] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:24 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:25.404048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bac570e-ffb5-427f-9733-dc609a885c83 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:25.404884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bac570e-ffb5-427f-9733-dc609a885c83 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:25.409209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bac570e-ffb5-427f-9733-dc609a885c83 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:25.409977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bac570e-ffb5-427f-9733-dc609a885c83 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:25.426264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e152c067-7649-4c99-bd68-b7e3d64d0efd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:25.427169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e152c067-7649-4c99-bd68-b7e3d64d0efd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:25.440262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e152c067-7649-4c99-bd68-b7e3d64d0efd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:25.448797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e152c067-7649-4c99-bd68-b7e3d64d0efd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:25.450094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e152c067-7649-4c99-bd68-b7e3d64d0efd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:25.450902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e152c067-7649-4c99-bd68-b7e3d64d0efd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:25.639861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-8bac570e-ffb5-427f-9733-dc609a885c83 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:25.683110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e152c067-7649-4c99-bd68-b7e3d64d0efd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:25.697806 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e152c067-7649-4c99-bd68-b7e3d64d0efd tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1621 microversion: 2.1 time: 0.275717 Aug 04 14:12:25.700476 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1750/3486] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:25 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1621 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:25.745626 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8bac570e-ffb5-427f-9733-dc609a885c83 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1666160630" status: 200 len: 346 microversion: 2.1 time: 0.368784 Aug 04 14:12:25.757323 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1737/3487] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 14:12:25 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1666160630 => generated 346 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:25.761987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b3e91fb9-10ad-45e3-9e29-bd23246ed912 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:25.769564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3e91fb9-10ad-45e3-9e29-bd23246ed912 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:25.770439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3e91fb9-10ad-45e3-9e29-bd23246ed912 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:25.875438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b3e91fb9-10ad-45e3-9e29-bd23246ed912 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Going to try to stop instance {{(pid=130960) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 14:12:25.946261 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b3e91fb9-10ad-45e3-9e29-bd23246ed912 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "POST /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509/action" status: 202 len: 0 microversion: 2.1 time: 0.186931 Aug 04 14:12:25.948508 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1751/3488] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:12:25 2022] POST /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:12:25.977400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2174dd36-67e4-4601-9d6d-e250a5ac8220 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:25.978330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2174dd36-67e4-4601-9d6d-e250a5ac8220 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:26.002775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2174dd36-67e4-4601-9d6d-e250a5ac8220 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:26.003296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2174dd36-67e4-4601-9d6d-e250a5ac8220 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:26.011309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2174dd36-67e4-4601-9d6d-e250a5ac8220 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:26.011309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2174dd36-67e4-4601-9d6d-e250a5ac8220 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:26.444290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-51402540-ab98-4e54-8d85-f9e66428b0c5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:26.450120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-51402540-ab98-4e54-8d85-f9e66428b0c5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:26.488607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51402540-ab98-4e54-8d85-f9e66428b0c5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:26.490210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51402540-ab98-4e54-8d85-f9e66428b0c5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:26.492178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51402540-ab98-4e54-8d85-f9e66428b0c5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:26.493443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51402540-ab98-4e54-8d85-f9e66428b0c5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:27.211086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2174dd36-67e4-4601-9d6d-e250a5ac8220 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:27.260661 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2174dd36-67e4-4601-9d6d-e250a5ac8220 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1522 microversion: 2.1 time: 1.303234 Aug 04 14:12:27.282359 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1738/3489] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:25 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1522 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:27.348008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ac8313b-c7c1-4d2d-a472-57d174097ebf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:27.349462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0ac8313b-c7c1-4d2d-a472-57d174097ebf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:27.392606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac8313b-c7c1-4d2d-a472-57d174097ebf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:27.393465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac8313b-c7c1-4d2d-a472-57d174097ebf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:27.395067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac8313b-c7c1-4d2d-a472-57d174097ebf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:27.396533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ac8313b-c7c1-4d2d-a472-57d174097ebf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:27.419258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-51402540-ab98-4e54-8d85-f9e66428b0c5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:27.439713 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-51402540-ab98-4e54-8d85-f9e66428b0c5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 1.013318 Aug 04 14:12:27.440946 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1752/3490] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:26 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:27.450916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-049e8056-5a2c-4490-8776-8e960e16845b req-bb46ad4f-bd3e-4b30-b4fa-6829bd31ae07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27bb1614-6b27-48a6-b766-c7697e4169ac", "name": "network-vif-deleted", "tag": "04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:27.476579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-049e8056-5a2c-4490-8776-8e960e16845b req-bb46ad4f-bd3e-4b30-b4fa-6829bd31ae07 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:27.481073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-049e8056-5a2c-4490-8776-8e960e16845b req-bb46ad4f-bd3e-4b30-b4fa-6829bd31ae07 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:27.522919 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-049e8056-5a2c-4490-8776-8e960e16845b req-bb46ad4f-bd3e-4b30-b4fa-6829bd31ae07 service nova] Creating event network-vif-deleted:04acf0ae-b5c1-4e98-bbb8-9cf26fc4dabf for instance 27bb1614-6b27-48a6-b766-c7697e4169ac on n-h2-844627-10 Aug 04 14:12:27.542997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-049e8056-5a2c-4490-8776-8e960e16845b req-bb46ad4f-bd3e-4b30-b4fa-6829bd31ae07 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100405 Aug 04 14:12:27.548577 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1753/3491] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:28.130612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0ac8313b-c7c1-4d2d-a472-57d174097ebf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:28.208863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0ac8313b-c7c1-4d2d-a472-57d174097ebf tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 200 len: 1330 microversion: 2.1 time: 0.931576 Aug 04 14:12:28.226859 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1739/3492] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:27 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 1330 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:28.290964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-234e0f84-134d-4bc1-95a7-c16cfdb8ee23 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:28.291796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-234e0f84-134d-4bc1-95a7-c16cfdb8ee23 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:28.315058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-234e0f84-134d-4bc1-95a7-c16cfdb8ee23 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:28.321757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-234e0f84-134d-4bc1-95a7-c16cfdb8ee23 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:28.324681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-234e0f84-134d-4bc1-95a7-c16cfdb8ee23 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:28.326973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-234e0f84-134d-4bc1-95a7-c16cfdb8ee23 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:28.481653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-95725828-ca87-483a-9ed1-b4c6398b65ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:28.482623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-95725828-ca87-483a-9ed1-b4c6398b65ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:28.501390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-95725828-ca87-483a-9ed1-b4c6398b65ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:28.503084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-95725828-ca87-483a-9ed1-b4c6398b65ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:28.504183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-95725828-ca87-483a-9ed1-b4c6398b65ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:28.513494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-95725828-ca87-483a-9ed1-b4c6398b65ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:28.838438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-234e0f84-134d-4bc1-95a7-c16cfdb8ee23 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:28.929503 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-234e0f84-134d-4bc1-95a7-c16cfdb8ee23 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1522 microversion: 2.1 time: 0.642570 Aug 04 14:12:28.934014 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1754/3493] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:28 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:29.067888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-95725828-ca87-483a-9ed1-b4c6398b65ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:29.092554 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-95725828-ca87-483a-9ed1-b4c6398b65ae tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.614678 Aug 04 14:12:29.095137 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1740/3494] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:28 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:29.272163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:29.274862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: 27bb1614-6b27-48a6-b766-c7697e4169ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:29.325596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:29.329396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:29.333863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:29.340053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:29.428385 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] HTTP exception thrown: Instance 27bb1614-6b27-48a6-b766-c7697e4169ac could not be found. Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Request method failure captured: Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac HTTP/1.1 Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JxokQZWt73oCTeb2uIT1T61PPtBceW-GidRWsXDOZjQVnibDMlYFve8J2CmvNSqnoJ2gUswAJOQhT5G9sx82VvrXKfhYzVPLV5Gd4BsYAE7SpJCYfj1C3r3f1XD7yVS8i5KHJX727wlQRlE5KUXS609Oac6ysS4Xt8O7zqu2gmqzI Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}] Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 653fb03c7a4b4a61a57ecd4cdd610e86 Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 27bb1614-6b27-48a6-b766-c7697e4169ac could not be found. Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '27bb1614-6b27-48a6-b766-c7697e4169ac'} Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27bb1614-6b27-48a6-b766-c7697e4169ac could not be found. Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27bb1614-6b27-48a6-b766-c7697e4169ac could not be found. Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:29.433753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:29.440258 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:29.440258 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:29.440258 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:29.440258 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:29.440258 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:12:29.440258 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:12:29.440258 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27bb1614-6b27-48a6-b766-c7697e4169ac could not be found. Aug 04 14:12:29.440258 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:12:29.443847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Returning 404 to user: Instance 27bb1614-6b27-48a6-b766-c7697e4169ac could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:12:29.449297 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4ceff319-696a-45ef-89a1-5c9feaa05177 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac" status: 404 len: 111 microversion: 2.1 time: 0.202965 Aug 04 14:12:29.452343 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1755/3495] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:29 2022] GET /compute/v2.1/servers/27bb1614-6b27-48a6-b766-c7697e4169ac => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:12:29.467310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfb75007-5b07-4602-ab45-93afdb836a1f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '.version_select at 0x7f46f342c430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:29.519256 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cfb75007-5b07-4602-ab45-93afdb836a1f tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-840200972" status: 202 len: 0 microversion: 2.1 time: 0.057853 Aug 04 14:12:29.521354 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1741/3496] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 14:12:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-840200972 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:12:29.962231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-39ee752f-47e2-4c5b-99fd-b98262b176ae tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:29.963106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-39ee752f-47e2-4c5b-99fd-b98262b176ae tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:29.989559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39ee752f-47e2-4c5b-99fd-b98262b176ae tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:29.991743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39ee752f-47e2-4c5b-99fd-b98262b176ae tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:29.995392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39ee752f-47e2-4c5b-99fd-b98262b176ae tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:29.996366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39ee752f-47e2-4c5b-99fd-b98262b176ae tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:30.131820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c44256ad-64d3-4bc6-bec4-73b011c52418 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:30.137910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c44256ad-64d3-4bc6-bec4-73b011c52418 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:30.169583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c44256ad-64d3-4bc6-bec4-73b011c52418 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:30.172976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c44256ad-64d3-4bc6-bec4-73b011c52418 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:30.189803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c44256ad-64d3-4bc6-bec4-73b011c52418 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:30.191779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c44256ad-64d3-4bc6-bec4-73b011c52418 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:31.205061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-39ee752f-47e2-4c5b-99fd-b98262b176ae tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:31.233600 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-39ee752f-47e2-4c5b-99fd-b98262b176ae tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1522 microversion: 2.1 time: 1.276877 Aug 04 14:12:31.243346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c44256ad-64d3-4bc6-bec4-73b011c52418 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:31.256366 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1756/3497] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:29 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1522 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:31.271371 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c44256ad-64d3-4bc6-bec4-73b011c52418 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 1.153377 Aug 04 14:12:31.283120 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1742/3498] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:30 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:32.267747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d60824c-0c62-4325-a55a-d783a1bce84d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:32.270219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d60824c-0c62-4325-a55a-d783a1bce84d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:32.292156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d60824c-0c62-4325-a55a-d783a1bce84d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:32.295403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d60824c-0c62-4325-a55a-d783a1bce84d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:32.300355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d60824c-0c62-4325-a55a-d783a1bce84d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:32.305452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d60824c-0c62-4325-a55a-d783a1bce84d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:32.329850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f6cc3815-31b7-4b67-8c65-7664a2981822 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:32.331073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f6cc3815-31b7-4b67-8c65-7664a2981822 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:32.370262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6cc3815-31b7-4b67-8c65-7664a2981822 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:32.371302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6cc3815-31b7-4b67-8c65-7664a2981822 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:32.372819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6cc3815-31b7-4b67-8c65-7664a2981822 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:32.373824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6cc3815-31b7-4b67-8c65-7664a2981822 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:32.972308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d60824c-0c62-4325-a55a-d783a1bce84d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:32.987077 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d60824c-0c62-4325-a55a-d783a1bce84d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1522 microversion: 2.1 time: 0.727257 Aug 04 14:12:32.988301 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1757/3499] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:32 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1522 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:33.040911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:33.093766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f6cc3815-31b7-4b67-8c65-7664a2981822 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:33.107627 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f6cc3815-31b7-4b67-8c65-7664a2981822 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.786305 Aug 04 14:12:33.114587 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1743/3500] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:32 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:34.013422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ffd26d29-75ff-4b8a-9ea0-a9303cd89253 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:34.014289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ffd26d29-75ff-4b8a-9ea0-a9303cd89253 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:34.017129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:34.037697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffd26d29-75ff-4b8a-9ea0-a9303cd89253 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:34.038220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffd26d29-75ff-4b8a-9ea0-a9303cd89253 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:34.042811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffd26d29-75ff-4b8a-9ea0-a9303cd89253 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:34.046447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffd26d29-75ff-4b8a-9ea0-a9303cd89253 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:34.149472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de0625ad-c2f4-476c-a192-170406ed9a82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:34.155142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-de0625ad-c2f4-476c-a192-170406ed9a82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:34.187247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de0625ad-c2f4-476c-a192-170406ed9a82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:34.189395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de0625ad-c2f4-476c-a192-170406ed9a82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:34.190306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de0625ad-c2f4-476c-a192-170406ed9a82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:34.193022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de0625ad-c2f4-476c-a192-170406ed9a82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:34.233186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:34.407634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:34.746094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ffd26d29-75ff-4b8a-9ea0-a9303cd89253 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:34.755687 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ffd26d29-75ff-4b8a-9ea0-a9303cd89253 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1522 microversion: 2.1 time: 0.747822 Aug 04 14:12:34.776999 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1758/3501] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:34 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1522 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:34.815823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-de0625ad-c2f4-476c-a192-170406ed9a82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:34.862236 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-de0625ad-c2f4-476c-a192-170406ed9a82 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.705220 Aug 04 14:12:34.865357 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1744/3502] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:34 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:35.784383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a2e8697-c960-494b-8c31-33438dc84b4a tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:35.784979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3a2e8697-c960-494b-8c31-33438dc84b4a tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:35.797876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a2e8697-c960-494b-8c31-33438dc84b4a tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:35.801614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a2e8697-c960-494b-8c31-33438dc84b4a tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:35.805361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a2e8697-c960-494b-8c31-33438dc84b4a tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:35.806591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a2e8697-c960-494b-8c31-33438dc84b4a tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:35.903719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03660c34-49ce-47a9-9223-e0f2ffe0759b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:35.906017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-03660c34-49ce-47a9-9223-e0f2ffe0759b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:35.919977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=14 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:35.926645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03660c34-49ce-47a9-9223-e0f2ffe0759b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:35.928739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03660c34-49ce-47a9-9223-e0f2ffe0759b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:35.931616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03660c34-49ce-47a9-9223-e0f2ffe0759b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:35.935487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03660c34-49ce-47a9-9223-e0f2ffe0759b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:36.811685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3a2e8697-c960-494b-8c31-33438dc84b4a tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:36.830252 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a2e8697-c960-494b-8c31-33438dc84b4a tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1522 microversion: 2.1 time: 1.050073 Aug 04 14:12:36.830913 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1759/3503] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:35 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1522 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:36.889134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-03660c34-49ce-47a9-9223-e0f2ffe0759b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:36.902700 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-03660c34-49ce-47a9-9223-e0f2ffe0759b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 1.002795 Aug 04 14:12:36.908487 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1745/3504] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:35 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:37.884015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b50152c-79f9-451c-940d-0ba5efcbee8b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:37.884856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b50152c-79f9-451c-940d-0ba5efcbee8b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:37.909694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b50152c-79f9-451c-940d-0ba5efcbee8b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:37.912414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b50152c-79f9-451c-940d-0ba5efcbee8b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:37.915629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b50152c-79f9-451c-940d-0ba5efcbee8b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:37.917195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b50152c-79f9-451c-940d-0ba5efcbee8b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:37.948004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fecf59cf-60ef-49d4-b34d-0477bab201a2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:37.948807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fecf59cf-60ef-49d4-b34d-0477bab201a2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:37.971114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fecf59cf-60ef-49d4-b34d-0477bab201a2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:37.975655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fecf59cf-60ef-49d4-b34d-0477bab201a2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:37.976736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fecf59cf-60ef-49d4-b34d-0477bab201a2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:37.979036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fecf59cf-60ef-49d4-b34d-0477bab201a2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:38.594134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b50152c-79f9-451c-940d-0ba5efcbee8b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:38.616627 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b50152c-79f9-451c-940d-0ba5efcbee8b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1499 microversion: 2.1 time: 0.751384 Aug 04 14:12:38.619685 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1760/3505] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:37 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1499 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:38.663808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5b5a3138-b1ca-4315-8312-b437ba16a85f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:38.670870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5b5a3138-b1ca-4315-8312-b437ba16a85f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:38.679392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b5a3138-b1ca-4315-8312-b437ba16a85f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:38.696801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b5a3138-b1ca-4315-8312-b437ba16a85f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:38.697789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b5a3138-b1ca-4315-8312-b437ba16a85f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:38.701422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b5a3138-b1ca-4315-8312-b437ba16a85f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:38.704353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b5a3138-b1ca-4315-8312-b437ba16a85f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:38.771068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-5b5a3138-b1ca-4315-8312-b437ba16a85f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:38.776388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fecf59cf-60ef-49d4-b34d-0477bab201a2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:38.794527 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fecf59cf-60ef-49d4-b34d-0477bab201a2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.851010 Aug 04 14:12:38.811120 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1746/3506] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:37 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:38.826772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:38.842774 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5b5a3138-b1ca-4315-8312-b437ba16a85f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.183773 Aug 04 14:12:38.843591 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1761/3507] 10.222.0.66 () {58 vars in 1154 bytes} [Thu Aug 4 14:12:38 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:12:38.862866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5b42670f-f1cf-437e-8ba7-0d89bf24446f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:38.874254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b42670f-f1cf-437e-8ba7-0d89bf24446f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:38.875886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b42670f-f1cf-437e-8ba7-0d89bf24446f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:38.907272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b42670f-f1cf-437e-8ba7-0d89bf24446f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Going to try to start instance {{(pid=130961) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 14:12:38.990419 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5b42670f-f1cf-437e-8ba7-0d89bf24446f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "POST /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509/action" status: 202 len: 0 microversion: 2.1 time: 0.133073 Aug 04 14:12:38.992978 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1747/3508] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:12:38 2022] POST /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:12:39.003673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-764520ed-8316-4d9e-8081-e2dde893e889 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:39.004355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-764520ed-8316-4d9e-8081-e2dde893e889 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:39.021531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-764520ed-8316-4d9e-8081-e2dde893e889 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:39.022036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-764520ed-8316-4d9e-8081-e2dde893e889 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:39.022858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-764520ed-8316-4d9e-8081-e2dde893e889 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:39.023615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-764520ed-8316-4d9e-8081-e2dde893e889 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:39.818817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6028198f-1ce9-4ec0-b4ca-ac276c728a4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:39.819528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6028198f-1ce9-4ec0-b4ca-ac276c728a4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:39.839039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6028198f-1ce9-4ec0-b4ca-ac276c728a4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:39.840318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6028198f-1ce9-4ec0-b4ca-ac276c728a4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:39.842114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6028198f-1ce9-4ec0-b4ca-ac276c728a4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:39.843259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6028198f-1ce9-4ec0-b4ca-ac276c728a4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:40.055938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-764520ed-8316-4d9e-8081-e2dde893e889 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:40.093730 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-764520ed-8316-4d9e-8081-e2dde893e889 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1508 microversion: 2.1 time: 1.094058 Aug 04 14:12:40.099246 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1762/3509] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:38 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1508 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:40.365881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6028198f-1ce9-4ec0-b4ca-ac276c728a4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:40.384535 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6028198f-1ce9-4ec0-b4ca-ac276c728a4b tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 0.569752 Aug 04 14:12:40.400750 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1748/3510] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:39 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:41.144815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75354bd2-a304-4bc9-8860-a8d0d2fa8276 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:41.145834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75354bd2-a304-4bc9-8860-a8d0d2fa8276 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:41.179567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75354bd2-a304-4bc9-8860-a8d0d2fa8276 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:41.182030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75354bd2-a304-4bc9-8860-a8d0d2fa8276 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:41.185896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75354bd2-a304-4bc9-8860-a8d0d2fa8276 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:41.190967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75354bd2-a304-4bc9-8860-a8d0d2fa8276 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:41.441310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b18ae32-04f5-4ad7-9743-bafc825718ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:41.443613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8b18ae32-04f5-4ad7-9743-bafc825718ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:41.483591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b18ae32-04f5-4ad7-9743-bafc825718ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:41.484428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b18ae32-04f5-4ad7-9743-bafc825718ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:41.487362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b18ae32-04f5-4ad7-9743-bafc825718ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:41.489152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b18ae32-04f5-4ad7-9743-bafc825718ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:43.042548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8b18ae32-04f5-4ad7-9743-bafc825718ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:43.054942 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8b18ae32-04f5-4ad7-9743-bafc825718ed tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1510 microversion: 2.1 time: 1.650963 Aug 04 14:12:43.061652 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1749/3511] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:41 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1510 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:43.681346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-75354bd2-a304-4bc9-8860-a8d0d2fa8276 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:43.717354 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75354bd2-a304-4bc9-8860-a8d0d2fa8276 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1508 microversion: 2.1 time: 2.581277 Aug 04 14:12:43.722544 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1763/3512] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:41 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1508 bytes in 2591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:44.094356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a9628b3-334b-4ec6-a440-38d37091a4f4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:44.097118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9a9628b3-334b-4ec6-a440-38d37091a4f4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:44.149194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a9628b3-334b-4ec6-a440-38d37091a4f4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:44.149825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a9628b3-334b-4ec6-a440-38d37091a4f4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:44.153909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a9628b3-334b-4ec6-a440-38d37091a4f4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:44.157790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a9628b3-334b-4ec6-a440-38d37091a4f4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:44.763358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02a08050-0155-41c0-b994-47ab0f17cc62 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:44.765552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-02a08050-0155-41c0-b994-47ab0f17cc62 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:44.807405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02a08050-0155-41c0-b994-47ab0f17cc62 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:44.807861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02a08050-0155-41c0-b994-47ab0f17cc62 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:44.813705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02a08050-0155-41c0-b994-47ab0f17cc62 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:44.817203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02a08050-0155-41c0-b994-47ab0f17cc62 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:45.350989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9a9628b3-334b-4ec6-a440-38d37091a4f4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:45.360977 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a9628b3-334b-4ec6-a440-38d37091a4f4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1487 microversion: 2.1 time: 1.280300 Aug 04 14:12:45.366379 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1750/3513] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:44 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1487 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:45.384380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a37d9a04-f1e7-4d09-b614-dbd8497ca6ff tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:45.391486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a37d9a04-f1e7-4d09-b614-dbd8497ca6ff tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:45.415735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:45.426154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a37d9a04-f1e7-4d09-b614-dbd8497ca6ff tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:45.429667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a37d9a04-f1e7-4d09-b614-dbd8497ca6ff tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:45.430767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a37d9a04-f1e7-4d09-b614-dbd8497ca6ff tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:45.436520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a37d9a04-f1e7-4d09-b614-dbd8497ca6ff tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:45.556233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a37d9a04-f1e7-4d09-b614-dbd8497ca6ff tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:12:45.820238 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a37d9a04-f1e7-4d09-b614-dbd8497ca6ff tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 204 len: 0 microversion: 2.1 time: 0.439800 Aug 04 14:12:45.822255 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1751/3514] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:12:45 2022] DELETE /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:12:45.837716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e9d12bb5-0fea-411d-804d-48ea2c4817c2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:45.840602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e9d12bb5-0fea-411d-804d-48ea2c4817c2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:45.860769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9d12bb5-0fea-411d-804d-48ea2c4817c2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:45.862191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9d12bb5-0fea-411d-804d-48ea2c4817c2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:45.863279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9d12bb5-0fea-411d-804d-48ea2c4817c2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:45.865381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9d12bb5-0fea-411d-804d-48ea2c4817c2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:45.986126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-02a08050-0155-41c0-b994-47ab0f17cc62 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:46.003642 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-02a08050-0155-41c0-b994-47ab0f17cc62 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1512 microversion: 2.1 time: 1.257382 Aug 04 14:12:46.041139 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1764/3515] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:44 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1512 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:46.361390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6a7d9ce1-dd37-4f8c-a074-4ff920715c91 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'create', calling method: .version_select at 0x7f47001c7940>, body: {"keypair": {"name": "tempest-keypair-1051457093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBH0e9BM4tYwVs0GaFw5qir1iW6QVSxVchAHJmWa8HhyzNi4k/5cm4+gV4C6pB4+fuuPCsuYRqo88Gp16SDXmYb3dwxJk8ZnbjdJ4iB5BZVT+rJYJ5CMVsXOUux8Kb3x7g=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:46.395465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-6a7d9ce1-dd37-4f8c-a074-4ff920715c91 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:12:46.416614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-6a7d9ce1-dd37-4f8c-a074-4ff920715c91 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for user fab9d445099545e98979afa009678007 and project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:12:46.479064 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6a7d9ce1-dd37-4f8c-a074-4ff920715c91 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.434753 Aug 04 14:12:46.480392 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1765/3516] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:12:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:46.511087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-abad6e34-5df8-4961-8655-e32ef11a6c9f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:46.544692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-abad6e34-5df8-4961-8655-e32ef11a6c9f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:46.547261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.compute.servers [None req-abad6e34-5df8-4961-8655-e32ef11a6c9f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Removing options 'limit' from query {{(pid=130960) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 14:12:46.548526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-abad6e34-5df8-4961-8655-e32ef11a6c9f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:46.556245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abad6e34-5df8-4961-8655-e32ef11a6c9f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:46.563293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abad6e34-5df8-4961-8655-e32ef11a6c9f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:46.581577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abad6e34-5df8-4961-8655-e32ef11a6c9f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:46.581577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abad6e34-5df8-4961-8655-e32ef11a6c9f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:46.584789 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-abad6e34-5df8-4961-8655-e32ef11a6c9f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.095796 Aug 04 14:12:46.586232 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1766/3517] 10.222.0.66 () {58 vars in 1140 bytes} [Thu Aug 4 14:12:46 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:12:46.617747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c0681f7-a2f5-4aab-80d9-ec0ba91bc772 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:46.618391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c0681f7-a2f5-4aab-80d9-ec0ba91bc772 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:46.634265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c0681f7-a2f5-4aab-80d9-ec0ba91bc772 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:46.634731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c0681f7-a2f5-4aab-80d9-ec0ba91bc772 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:46.635579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c0681f7-a2f5-4aab-80d9-ec0ba91bc772 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:46.636034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c0681f7-a2f5-4aab-80d9-ec0ba91bc772 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:47.112315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e9d12bb5-0fea-411d-804d-48ea2c4817c2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:47.129388 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e9d12bb5-0fea-411d-804d-48ea2c4817c2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1493 microversion: 2.1 time: 1.296730 Aug 04 14:12:47.130564 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1752/3518] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:45 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1493 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:48.081338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49f5c833-622a-40bd-b64b-0b9dd163b4ce tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:48.082664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49f5c833-622a-40bd-b64b-0b9dd163b4ce tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:48.104063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49f5c833-622a-40bd-b64b-0b9dd163b4ce tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:48.106789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49f5c833-622a-40bd-b64b-0b9dd163b4ce tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:48.108636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49f5c833-622a-40bd-b64b-0b9dd163b4ce tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:48.110616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49f5c833-622a-40bd-b64b-0b9dd163b4ce tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:48.216861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49f5c833-622a-40bd-b64b-0b9dd163b4ce tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:12:48.272137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7c0681f7-a2f5-4aab-80d9-ec0ba91bc772 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:48.282441 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c0681f7-a2f5-4aab-80d9-ec0ba91bc772 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1512 microversion: 2.1 time: 1.674683 Aug 04 14:12:48.294073 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1767/3519] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:46 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1512 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:48.325169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9e07fc1d-5fb3-481a-b09b-00bd92045106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:48.327211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9e07fc1d-5fb3-481a-b09b-00bd92045106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:48.350930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e07fc1d-5fb3-481a-b09b-00bd92045106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:48.360823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e07fc1d-5fb3-481a-b09b-00bd92045106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:48.362207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e07fc1d-5fb3-481a-b09b-00bd92045106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:48.368257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e07fc1d-5fb3-481a-b09b-00bd92045106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:48.442030 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49f5c833-622a-40bd-b64b-0b9dd163b4ce tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 204 len: 0 microversion: 2.1 time: 0.364757 Aug 04 14:12:48.446778 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1753/3520] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:12:48 2022] DELETE /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:12:48.460469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa233b3d-e934-4b4f-abd9-768c66d55595 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:48.466706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa233b3d-e934-4b4f-abd9-768c66d55595 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:48.481961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa233b3d-e934-4b4f-abd9-768c66d55595 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:48.485141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa233b3d-e934-4b4f-abd9-768c66d55595 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:48.494346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa233b3d-e934-4b4f-abd9-768c66d55595 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:48.495182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa233b3d-e934-4b4f-abd9-768c66d55595 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:48.725681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:49.921048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9e07fc1d-5fb3-481a-b09b-00bd92045106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:49.943538 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9e07fc1d-5fb3-481a-b09b-00bd92045106 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1493 microversion: 2.1 time: 1.647991 Aug 04 14:12:49.944163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1768/3521] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:48 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1493 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:49.962677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7eac0151-70c3-4c8c-acdf-054203d05d6b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:49.963437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7eac0151-70c3-4c8c-acdf-054203d05d6b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:49.990697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eac0151-70c3-4c8c-acdf-054203d05d6b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:49.991517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eac0151-70c3-4c8c-acdf-054203d05d6b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:49.992617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eac0151-70c3-4c8c-acdf-054203d05d6b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:49.993301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7eac0151-70c3-4c8c-acdf-054203d05d6b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:50.474994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa233b3d-e934-4b4f-abd9-768c66d55595 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:50.488635 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa233b3d-e934-4b4f-abd9-768c66d55595 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda" status: 200 len: 1511 microversion: 2.1 time: 2.042477 Aug 04 14:12:50.495274 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1754/3522] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:48 2022] GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda => generated 1511 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:50.527031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-efb94ae3-c2db-4a6d-a5ef-1e873e16ea58 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:50.528166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-efb94ae3-c2db-4a6d-a5ef-1e873e16ea58 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:50.545362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efb94ae3-c2db-4a6d-a5ef-1e873e16ea58 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:50.548725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efb94ae3-c2db-4a6d-a5ef-1e873e16ea58 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:50.551534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efb94ae3-c2db-4a6d-a5ef-1e873e16ea58 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:50.554605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efb94ae3-c2db-4a6d-a5ef-1e873e16ea58 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:50.623455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7eac0151-70c3-4c8c-acdf-054203d05d6b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:50.633752 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7eac0151-70c3-4c8c-acdf-054203d05d6b tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1507 microversion: 2.1 time: 0.688357 Aug 04 14:12:50.643174 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1769/3523] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:49 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1507 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:50.965872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1274b80e-5dc2-4747-a042-d1eb637ad67a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:50.966903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1274b80e-5dc2-4747-a042-d1eb637ad67a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:50.987727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1274b80e-5dc2-4747-a042-d1eb637ad67a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:50.992064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1274b80e-5dc2-4747-a042-d1eb637ad67a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:50.994662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1274b80e-5dc2-4747-a042-d1eb637ad67a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:50.996751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1274b80e-5dc2-4747-a042-d1eb637ad67a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:51.435269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1274b80e-5dc2-4747-a042-d1eb637ad67a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:51.444235 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1274b80e-5dc2-4747-a042-d1eb637ad67a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 200 len: 1451 microversion: 2.1 time: 0.482568 Aug 04 14:12:51.467211 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1770/3524] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:50 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 1451 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:51.478526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2f787cf7-129d-4f05-b980-04904b72be59 req-924ace3c-c7f5-411a-86a0-d04f7c1eded9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d", "name": "network-vif-deleted", "tag": "89c424c9-c10d-403c-8a21-df540522b26f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:51.507839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2f787cf7-129d-4f05-b980-04904b72be59 req-924ace3c-c7f5-411a-86a0-d04f7c1eded9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:51.508688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2f787cf7-129d-4f05-b980-04904b72be59 req-924ace3c-c7f5-411a-86a0-d04f7c1eded9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:51.526064 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2f787cf7-129d-4f05-b980-04904b72be59 req-924ace3c-c7f5-411a-86a0-d04f7c1eded9 service nova] Creating event network-vif-deleted:89c424c9-c10d-403c-8a21-df540522b26f for instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d on n-h2-844627-10 Aug 04 14:12:51.533040 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2f787cf7-129d-4f05-b980-04904b72be59 req-924ace3c-c7f5-411a-86a0-d04f7c1eded9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063675 Aug 04 14:12:51.534650 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1771/3525] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:51.550837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-efb94ae3-c2db-4a6d-a5ef-1e873e16ea58 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:51.563560 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-efb94ae3-c2db-4a6d-a5ef-1e873e16ea58 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1512 microversion: 2.1 time: 1.047265 Aug 04 14:12:51.568930 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1755/3526] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:50 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1512 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:51.591240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e091f79d-c141-4356-bc7b-7adc08e801d8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:51.605992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e091f79d-c141-4356-bc7b-7adc08e801d8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:51.607658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e091f79d-c141-4356-bc7b-7adc08e801d8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:51.664974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4a0a247b-0d2d-489d-a192-f65585f0235c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:51.665956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4a0a247b-0d2d-489d-a192-f65585f0235c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:51.683245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a0a247b-0d2d-489d-a192-f65585f0235c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:51.693960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a0a247b-0d2d-489d-a192-f65585f0235c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:51.696374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a0a247b-0d2d-489d-a192-f65585f0235c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:51.700453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a0a247b-0d2d-489d-a192-f65585f0235c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:51.770877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:52.134520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4a0a247b-0d2d-489d-a192-f65585f0235c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:52.168193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e091f79d-c141-4356-bc7b-7adc08e801d8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:52.169204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e091f79d-c141-4356-bc7b-7adc08e801d8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:52.170477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e091f79d-c141-4356-bc7b-7adc08e801d8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:52.170922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e091f79d-c141-4356-bc7b-7adc08e801d8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:52.207746 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4a0a247b-0d2d-489d-a192-f65585f0235c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1465 microversion: 2.1 time: 0.546727 Aug 04 14:12:52.210351 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1756/3527] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:51 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1465 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:52.388339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-e091f79d-c141-4356-bc7b-7adc08e801d8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:52.478538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:52.479570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:52.504049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:52.504823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:52.510204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:52.510916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:52.554866 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d HTTP/1.1 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d'} Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:52.560036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-45cb9b07-86c6-4d68-a499-0ab2cd641240 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 404 len: 111 microversion: 2.1 time: 0.090590 Aug 04 14:12:52.567868 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1757/3528] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:52 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:12:52.594589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6c309d82-1b51-4d13-9525-6fb9b4086b6a req-44c266d4-0390-4ce5-a93e-a2ee0d3ad2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac42befe-28d2-4af7-b56e-2cc6ea8034b6", "name": "network-vif-deleted", "tag": "0cfa44ed-b0f3-4dcf-ae2a-f6e895e9db5d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:52.601048 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e091f79d-c141-4356-bc7b-7adc08e801d8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 1.015041 Aug 04 14:12:52.610305 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1772/3529] 10.222.0.66 () {58 vars in 1154 bytes} [Thu Aug 4 14:12:51 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:52.627829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c6c2b4a-73cb-4f73-a9aa-bf641f6b90a9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:52.629022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c6c2b4a-73cb-4f73-a9aa-bf641f6b90a9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:52.639738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6c309d82-1b51-4d13-9525-6fb9b4086b6a req-44c266d4-0390-4ce5-a93e-a2ee0d3ad2ae service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:52.645804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6c309d82-1b51-4d13-9525-6fb9b4086b6a req-44c266d4-0390-4ce5-a93e-a2ee0d3ad2ae service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:52.647838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c6c2b4a-73cb-4f73-a9aa-bf641f6b90a9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:52.651071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c6c2b4a-73cb-4f73-a9aa-bf641f6b90a9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:52.657663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c6c2b4a-73cb-4f73-a9aa-bf641f6b90a9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:52.658137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c6c2b4a-73cb-4f73-a9aa-bf641f6b90a9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:52.692927 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6c309d82-1b51-4d13-9525-6fb9b4086b6a req-44c266d4-0390-4ce5-a93e-a2ee0d3ad2ae service nova] Creating event network-vif-deleted:0cfa44ed-b0f3-4dcf-ae2a-f6e895e9db5d for instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 on n-h2-844627-10 Aug 04 14:12:52.713287 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6c309d82-1b51-4d13-9525-6fb9b4086b6a req-44c266d4-0390-4ce5-a93e-a2ee0d3ad2ae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123532 Aug 04 14:12:52.713912 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1758/3530] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:12:52.912619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-891636207", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:53.018047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] validate_networks() for [('4a173ec9-b17c-4d80-a2f5-c83b2bc5ffdb', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:12:53.325252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c6c2b4a-73cb-4f73-a9aa-bf641f6b90a9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:53.365096 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c6c2b4a-73cb-4f73-a9aa-bf641f6b90a9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1512 microversion: 2.1 time: 0.752749 Aug 04 14:12:53.366318 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1773/3531] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:52 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1512 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:53.392956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:53.401150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:53.414497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:53.416344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:53.420008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:53.420743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:53.541883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:53.542341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:53.542810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lazy-loading 'fault' on Instance uuid ac42befe-28d2-4af7-b56e-2cc6ea8034b6 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:12:53.726200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:53.743843 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-edc538e6-0b34-47b0-a375-4b407284e161 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 200 len: 1312 microversion: 2.1 time: 0.363745 Aug 04 14:12:53.747825 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1774/3532] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:53 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 1312 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:53.761713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fdd01b56-7091-4c2c-803f-4b019b093d3d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:53.762533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fdd01b56-7091-4c2c-803f-4b019b093d3d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:53.771588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:53.787247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdd01b56-7091-4c2c-803f-4b019b093d3d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:53.794174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdd01b56-7091-4c2c-803f-4b019b093d3d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:53.795902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdd01b56-7091-4c2c-803f-4b019b093d3d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:53.799332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdd01b56-7091-4c2c-803f-4b019b093d3d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.198572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fdd01b56-7091-4c2c-803f-4b019b093d3d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:54.208519 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fdd01b56-7091-4c2c-803f-4b019b093d3d tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda" status: 200 len: 1511 microversion: 2.1 time: 0.459283 Aug 04 14:12:54.213802 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1775/3533] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:53 2022] GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda => generated 1511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:54.239287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c6fd705-7671-419c-9fc9-1c436ada3091 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:54.240397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0c6fd705-7671-419c-9fc9-1c436ada3091 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:54.251992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c6fd705-7671-419c-9fc9-1c436ada3091 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:54.253223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c6fd705-7671-419c-9fc9-1c436ada3091 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.254375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c6fd705-7671-419c-9fc9-1c436ada3091 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:54.255113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c6fd705-7671-419c-9fc9-1c436ada3091 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.555047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:12:54.557447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:12:54.558159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:12:54.559118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:12:54.559806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:12:54.564756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0c6fd705-7671-419c-9fc9-1c436ada3091 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:54.575297 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c6fd705-7671-419c-9fc9-1c436ada3091 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1512 microversion: 2.1 time: 0.340488 Aug 04 14:12:54.576524 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1776/3534] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:54 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:12:54.584171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:54.584791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.585978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:54.586953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.605320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:54.615601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:12:54.617437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:54.618305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:54.629225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:54.630689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.632098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:54.632617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Getting quotas for user d6f701d08c0741df9ad1375bd0712a59 and project 1accf1d5aaf140bab7626c5a04941d84. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:12:54.633218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.674628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:12:54.679956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:54.681602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:12:54.784433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:54.798759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:54.799399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.860773 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dddfa78f-e652-4ce1-abda-c90202714110 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.948761 Aug 04 14:12:54.873934 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1759/3535] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:12:54.886481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:54.897454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: ac42befe-28d2-4af7-b56e-2cc6ea8034b6] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:54.926243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:54.937094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.938335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:54.938906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:54.968145 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] HTTP exception thrown: Instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 could not be found. Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Request method failure captured: Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 HTTP/1.1 Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JxokQZWt73oCTeb2uIT1T61PPtBceW-GidRWsXDOZjQVnibDMlYFve8J2CmvNSqnoJ2gUswAJOQhT5G9sx82VvrXKfhYzVPLV5Gd4BsYAE7SpJCYfj1C3r3f1XD7yVS8i5KHJX727wlQRlE5KUXS609Oac6ysS4Xt8O7zqu2gmqzI Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}] Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 653fb03c7a4b4a61a57ecd4cdd610e86 Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 could not be found. Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'ac42befe-28d2-4af7-b56e-2cc6ea8034b6'} Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 could not be found. Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 could not be found. Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:54.971442 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:12:54.976617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:54.976617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:12:54.976617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:12:54.976617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:12:54.976617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:12:54.976617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:12:54.976617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 could not be found. Aug 04 14:12:54.976617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:12:54.979911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Returning 404 to user: Instance ac42befe-28d2-4af7-b56e-2cc6ea8034b6 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:12:54.981840 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08904fcf-3696-4471-a071-4ad972eecdb6 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6" status: 404 len: 111 microversion: 2.1 time: 0.106614 Aug 04 14:12:54.983298 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1760/3536] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:54 2022] GET /compute/v2.1/servers/ac42befe-28d2-4af7-b56e-2cc6ea8034b6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:12:54.994647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3d2d89d-5edf-4e2d-863f-09fb5f0c8018 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:54.995288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a3d2d89d-5edf-4e2d-863f-09fb5f0c8018 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:55.122511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a3d2d89d-5edf-4e2d-863f-09fb5f0c8018 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:55.138938 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3d2d89d-5edf-4e2d-863f-09fb5f0c8018 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1214 microversion: 2.1 time: 0.154256 Aug 04 14:12:55.155562 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1761/3537] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:54 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:55.209792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b14ececf-c26e-4cf1-bd49-b99893fea703 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:55.210323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b14ececf-c26e-4cf1-bd49-b99893fea703 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:55.262190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b14ececf-c26e-4cf1-bd49-b99893fea703 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:55.269742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b14ececf-c26e-4cf1-bd49-b99893fea703 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:55.273624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b14ececf-c26e-4cf1-bd49-b99893fea703 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:55.274080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b14ececf-c26e-4cf1-bd49-b99893fea703 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:55.388667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b14ececf-c26e-4cf1-bd49-b99893fea703 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:12:55.391316 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1e26bad-18a4-4da8-8d96-754fe5b41311 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.792719 Aug 04 14:12:55.402895 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1777/3538] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:12:54 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:55.415508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:55.417521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:55.441817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:55.442875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:55.445784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:55.447007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:55.608306 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b14ececf-c26e-4cf1-bd49-b99893fea703 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "DELETE /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 204 len: 0 microversion: 2.1 time: 0.450618 Aug 04 14:12:55.609516 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1762/3539] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:12:55 2022] DELETE /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:12:55.625768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-343f7bea-df3f-4940-a688-01fb0ebf0e95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:55.643082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-343f7bea-df3f-4940-a688-01fb0ebf0e95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:55.646351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-343f7bea-df3f-4940-a688-01fb0ebf0e95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:55.946896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:55.965693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:55.973532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:55.976715 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c0ccc364-5360-49ad-bdd3-7566e5522f1a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2948 microversion: 2.32 time: 0.565755 Aug 04 14:12:55.980007 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1778/3540] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:12:55 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2948 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:12:55.991304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5a17b58-5344-4e76-bd03-31742c31162c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:55.994563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5a17b58-5344-4e76-bd03-31742c31162c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:56.008081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5a17b58-5344-4e76-bd03-31742c31162c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:56.008826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5a17b58-5344-4e76-bd03-31742c31162c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:56.016970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5a17b58-5344-4e76-bd03-31742c31162c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:56.017738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5a17b58-5344-4e76-bd03-31742c31162c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:56.068641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-343f7bea-df3f-4940-a688-01fb0ebf0e95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:56.069162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-343f7bea-df3f-4940-a688-01fb0ebf0e95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:56.071182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-343f7bea-df3f-4940-a688-01fb0ebf0e95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:56.072423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-343f7bea-df3f-4940-a688-01fb0ebf0e95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:56.455040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5a17b58-5344-4e76-bd03-31742c31162c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:56.471800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:12:56.480071 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5a17b58-5344-4e76-bd03-31742c31162c tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 0.498312 Aug 04 14:12:56.481311 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1779/3541] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:55 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:56.504917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1608218037", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d77cf6c-b556-48ab-92a8-04444fe680a2"}], "security_groups": [{"name": "tempest-securitygroup--140364169"}], "key_name": "tempest-keypair-1051457093", "user_data": "}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:12:56.805152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] validate_networks() for [('4d77cf6c-b556-48ab-92a8-04444fe680a2', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:12:57.003593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-343f7bea-df3f-4940-a688-01fb0ebf0e95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:57.207542 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-343f7bea-df3f-4940-a688-01fb0ebf0e95 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 1.591058 Aug 04 14:12:57.212063 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1763/3542] 10.222.0.66 () {58 vars in 1150 bytes} [Thu Aug 4 14:12:55 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:57.231237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-24f2e1ea-dbf0-4bf7-ad40-17125498b998 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:57.234166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-24f2e1ea-dbf0-4bf7-ad40-17125498b998 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:57.259625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24f2e1ea-dbf0-4bf7-ad40-17125498b998 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:57.260397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24f2e1ea-dbf0-4bf7-ad40-17125498b998 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:57.261474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24f2e1ea-dbf0-4bf7-ad40-17125498b998 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:57.262122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24f2e1ea-dbf0-4bf7-ad40-17125498b998 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:57.524085 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-24f2e1ea-dbf0-4bf7-ad40-17125498b998 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.309921 Aug 04 14:12:57.525564 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1764/3543] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 14:12:57 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679/os-interface => generated 1830 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:12:57.539730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c234f3af-cd17-4b2e-92a2-97517acbd09e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:57.542087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c234f3af-cd17-4b2e-92a2-97517acbd09e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:57.561762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c234f3af-cd17-4b2e-92a2-97517acbd09e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:57.563650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c234f3af-cd17-4b2e-92a2-97517acbd09e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:57.566511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c234f3af-cd17-4b2e-92a2-97517acbd09e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:57.573853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c234f3af-cd17-4b2e-92a2-97517acbd09e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:57.934657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:12:57.935446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:12:57.935853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:12:57.936383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:12:57.936929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:12:57.961755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c234f3af-cd17-4b2e-92a2-97517acbd09e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:57.994583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:57.997208 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c234f3af-cd17-4b2e-92a2-97517acbd09e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1218 microversion: 2.1 time: 0.469697 Aug 04 14:12:58.002835 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1765/3544] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:57 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1218 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:58.003260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:58.007598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:58.021383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:58.060738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b8775ffb-a877-4d69-bb9b-8d6a5dfcd465 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:58.093167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8775ffb-a877-4d69-bb9b-8d6a5dfcd465 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:58.099401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b8775ffb-a877-4d69-bb9b-8d6a5dfcd465 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:58.125039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8775ffb-a877-4d69-bb9b-8d6a5dfcd465 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:58.127933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8775ffb-a877-4d69-bb9b-8d6a5dfcd465 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:58.133623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8775ffb-a877-4d69-bb9b-8d6a5dfcd465 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:58.134513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8775ffb-a877-4d69-bb9b-8d6a5dfcd465 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:58.149021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:12:58.212570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for user fab9d445099545e98979afa009678007 and project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:12:58.261884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:12:58.265238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:12:58.391519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-b8775ffb-a877-4d69-bb9b-8d6a5dfcd465 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:58.474331 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-95a951f5-74ec-4f2f-ac12-9d01445d2226 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.975088 Aug 04 14:12:58.492788 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1780/3545] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:12:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:12:58.527235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c5fbc602-deea-4ade-9ceb-58dafbf71a17 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:58.531904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c5fbc602-deea-4ade-9ceb-58dafbf71a17 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:58.549031 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b8775ffb-a877-4d69-bb9b-8d6a5dfcd465 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.538627 Aug 04 14:12:58.556401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5fbc602-deea-4ade-9ceb-58dafbf71a17 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:58.557639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5fbc602-deea-4ade-9ceb-58dafbf71a17 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:58.557917 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1766/3546] 10.222.0.66 () {58 vars in 1212 bytes} [Thu Aug 4 14:12:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:58.565380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4b80d4d-fb26-4f1b-9474-a7ed08304a59 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:58.566210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e4b80d4d-fb26-4f1b-9474-a7ed08304a59 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:58.567610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5fbc602-deea-4ade-9ceb-58dafbf71a17 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:58.571530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5fbc602-deea-4ade-9ceb-58dafbf71a17 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:58.803315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e4b80d4d-fb26-4f1b-9474-a7ed08304a59 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:58.845797 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e4b80d4d-fb26-4f1b-9474-a7ed08304a59 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1239 microversion: 2.1 time: 0.286191 Aug 04 14:12:58.850748 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1767/3547] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:58 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1239 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:58.897487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6dcb2fc6-a56e-4cac-9f5e-a5bbc2aa6369 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:58.925532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6dcb2fc6-a56e-4cac-9f5e-a5bbc2aa6369 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:58.926801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6dcb2fc6-a56e-4cac-9f5e-a5bbc2aa6369 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:58.956113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fc6-a56e-4cac-9f5e-a5bbc2aa6369 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:58.957080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fc6-a56e-4cac-9f5e-a5bbc2aa6369 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:58.958647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fc6-a56e-4cac-9f5e-a5bbc2aa6369 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:58.969103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dcb2fc6-a56e-4cac-9f5e-a5bbc2aa6369 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:59.162342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-6dcb2fc6-a56e-4cac-9f5e-a5bbc2aa6369 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:12:59.252475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c5fbc602-deea-4ade-9ceb-58dafbf71a17 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:59.285152 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c5fbc602-deea-4ade-9ceb-58dafbf71a17 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1520 microversion: 2.1 time: 0.788351 Aug 04 14:12:59.286861 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1781/3548] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:58 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1520 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:59.308602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac65280a-800a-47e9-b4ee-1c9a166cb687 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:59.313645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac65280a-800a-47e9-b4ee-1c9a166cb687 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:12:59.348685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac65280a-800a-47e9-b4ee-1c9a166cb687 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:59.348954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac65280a-800a-47e9-b4ee-1c9a166cb687 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:59.351138 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6dcb2fc6-a56e-4cac-9f5e-a5bbc2aa6369 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.497883 Aug 04 14:12:59.352956 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1768/3549] 10.222.0.66 () {58 vars in 1196 bytes} [Thu Aug 4 14:12:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:12:59.389623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0eb32ab-58c5-456d-bda3-48c05e6b69d5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:12:59.394865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac65280a-800a-47e9-b4ee-1c9a166cb687 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:59.398732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac65280a-800a-47e9-b4ee-1c9a166cb687 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:59.420956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f0eb32ab-58c5-456d-bda3-48c05e6b69d5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:12:59.423773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0eb32ab-58c5-456d-bda3-48c05e6b69d5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'name': '1666160630', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:12:59.450598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0eb32ab-58c5-456d-bda3-48c05e6b69d5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:59.453024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0eb32ab-58c5-456d-bda3-48c05e6b69d5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:59.457444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0eb32ab-58c5-456d-bda3-48c05e6b69d5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:12:59.460729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0eb32ab-58c5-456d-bda3-48c05e6b69d5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:12:59.788625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-f0eb32ab-58c5-456d-bda3-48c05e6b69d5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:13:00.030830 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0eb32ab-58c5-456d-bda3-48c05e6b69d5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?name=1666160630" status: 200 len: 346 microversion: 2.1 time: 0.648895 Aug 04 14:13:00.053681 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1769/3550] 10.222.0.66 () {58 vars in 1156 bytes} [Thu Aug 4 14:12:59 2022] GET /compute/v2.1/servers?name=1666160630 => generated 346 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:00.078298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cc32e589-83f7-4573-a442-f1d5198c6753 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:00.079499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cc32e589-83f7-4573-a442-f1d5198c6753 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:00.108820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc32e589-83f7-4573-a442-f1d5198c6753 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:00.109549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc32e589-83f7-4573-a442-f1d5198c6753 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:00.110563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc32e589-83f7-4573-a442-f1d5198c6753 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:00.111064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc32e589-83f7-4573-a442-f1d5198c6753 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:00.365438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac65280a-800a-47e9-b4ee-1c9a166cb687 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:00.399105 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac65280a-800a-47e9-b4ee-1c9a166cb687 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1272 microversion: 2.1 time: 1.103523 Aug 04 14:13:00.401826 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1782/3551] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:12:59 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1272 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:00.435466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a4c1d0a5-7ee8-4325-a995-5790b19f98c8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:00.449466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a4c1d0a5-7ee8-4325-a995-5790b19f98c8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:00.451903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a4c1d0a5-7ee8-4325-a995-5790b19f98c8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:13:00.473048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4c1d0a5-7ee8-4325-a995-5790b19f98c8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:00.473509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4c1d0a5-7ee8-4325-a995-5790b19f98c8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:00.474345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4c1d0a5-7ee8-4325-a995-5790b19f98c8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:00.474797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4c1d0a5-7ee8-4325-a995-5790b19f98c8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:00.528981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cc32e589-83f7-4573-a442-f1d5198c6753 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:00.590763 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cc32e589-83f7-4573-a442-f1d5198c6753 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1243 microversion: 2.1 time: 0.522067 Aug 04 14:13:00.599812 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1770/3552] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:00 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1243 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:00.622396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-21114457-9d48-4e92-9ceb-22a1f4f6a5af tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:00.624013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-21114457-9d48-4e92-9ceb-22a1f4f6a5af tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:00.663021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21114457-9d48-4e92-9ceb-22a1f4f6a5af tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:00.673808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21114457-9d48-4e92-9ceb-22a1f4f6a5af tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:00.693159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21114457-9d48-4e92-9ceb-22a1f4f6a5af tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:00.694889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21114457-9d48-4e92-9ceb-22a1f4f6a5af tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:00.731505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-a4c1d0a5-7ee8-4325-a995-5790b19f98c8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:13:00.823411 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a4c1d0a5-7ee8-4325-a995-5790b19f98c8 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.420076 Aug 04 14:13:00.824668 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1783/3553] 10.222.0.66 () {58 vars in 1154 bytes} [Thu Aug 4 14:13:00 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:00.854230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70dda5c3-16ba-401e-9784-b220cf36ca2b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:00.865615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-70dda5c3-16ba-401e-9784-b220cf36ca2b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:00.867637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-70dda5c3-16ba-401e-9784-b220cf36ca2b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-166616063', 'deleted': False, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:13:00.885725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70dda5c3-16ba-401e-9784-b220cf36ca2b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:00.895839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-21114457-9d48-4e92-9ceb-22a1f4f6a5af tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '653fb03c7a4b4a61a57ecd4cdd610e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9ff6de2efd240b79217e2e5efe4f8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:00.901916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70dda5c3-16ba-401e-9784-b220cf36ca2b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:00.907420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70dda5c3-16ba-401e-9784-b220cf36ca2b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:00.912318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70dda5c3-16ba-401e-9784-b220cf36ca2b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:00.932485 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-21114457-9d48-4e92-9ceb-22a1f4f6a5af tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 200 len: 1478 microversion: 2.1 time: 0.329102 Aug 04 14:13:00.935398 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1771/3554] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:00 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 1478 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:00.954639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6f1c54a7-4075-4daf-a4dd-ca52ef6dc28c req-ef6f10f9-3a4a-4b66-94a6-a6df0ccd8ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da969e0f-87c4-4c9d-bef7-b74fb0837616", "name": "network-vif-deleted", "tag": "103e4629-b7e2-457f-94ee-b0630fd8b783"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:00.982177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6f1c54a7-4075-4daf-a4dd-ca52ef6dc28c req-ef6f10f9-3a4a-4b66-94a6-a6df0ccd8ed4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:00.982177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6f1c54a7-4075-4daf-a4dd-ca52ef6dc28c req-ef6f10f9-3a4a-4b66-94a6-a6df0ccd8ed4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:01.011569 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6f1c54a7-4075-4daf-a4dd-ca52ef6dc28c req-ef6f10f9-3a4a-4b66-94a6-a6df0ccd8ed4 service nova] Creating event network-vif-deleted:103e4629-b7e2-457f-94ee-b0630fd8b783 for instance da969e0f-87c4-4c9d-bef7-b74fb0837616 on n-h2-844627-10 Aug 04 14:13:01.023111 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6f1c54a7-4075-4daf-a4dd-ca52ef6dc28c req-ef6f10f9-3a4a-4b66-94a6-a6df0ccd8ed4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083948 Aug 04 14:13:01.027271 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1772/3555] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:01.201294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-70dda5c3-16ba-401e-9784-b220cf36ca2b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:13:01.355725 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-70dda5c3-16ba-401e-9784-b220cf36ca2b tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-166616063" status: 200 len: 346 microversion: 2.1 time: 0.519333 Aug 04 14:13:01.372130 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1784/3556] 10.222.0.66 () {58 vars in 1228 bytes} [Thu Aug 4 14:13:00 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-166616063 => generated 346 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:13:01.398005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c7ab192-a96e-4c6a-91c0-9d70299a65f4 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:01.400967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c7ab192-a96e-4c6a-91c0-9d70299a65f4 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:01.426558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c7ab192-a96e-4c6a-91c0-9d70299a65f4 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:01.427016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c7ab192-a96e-4c6a-91c0-9d70299a65f4 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:01.427953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c7ab192-a96e-4c6a-91c0-9d70299a65f4 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:01.428398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c7ab192-a96e-4c6a-91c0-9d70299a65f4 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:01.449832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2bbf5a24-6028-42e1-9905-2c13045f9e84 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:01.455682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2bbf5a24-6028-42e1-9905-2c13045f9e84 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:01.489165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c7ab192-a96e-4c6a-91c0-9d70299a65f4 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:13:01.564704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bbf5a24-6028-42e1-9905-2c13045f9e84 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:01.574588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bbf5a24-6028-42e1-9905-2c13045f9e84 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:01.577119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bbf5a24-6028-42e1-9905-2c13045f9e84 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:01.578860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2bbf5a24-6028-42e1-9905-2c13045f9e84 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:01.692469 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c7ab192-a96e-4c6a-91c0-9d70299a65f4 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 204 len: 0 microversion: 2.1 time: 0.308466 Aug 04 14:13:01.693486 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1773/3557] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:01 2022] DELETE /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:13:01.706502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-db5013ff-1522-47af-8dfe-500f39667802 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:01.708695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-db5013ff-1522-47af-8dfe-500f39667802 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:01.725243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db5013ff-1522-47af-8dfe-500f39667802 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:01.725855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db5013ff-1522-47af-8dfe-500f39667802 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:01.726656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db5013ff-1522-47af-8dfe-500f39667802 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:01.734068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db5013ff-1522-47af-8dfe-500f39667802 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:01.795118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:01.855352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2bbf5a24-6028-42e1-9905-2c13045f9e84 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:01.893703 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2bbf5a24-6028-42e1-9905-2c13045f9e84 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1272 microversion: 2.1 time: 0.453842 Aug 04 14:13:01.903165 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1785/3558] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:01 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1272 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:01.908654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f01ae0b-ee9b-4605-9d65-ef8a1e1f2c5e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:01.916908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f01ae0b-ee9b-4605-9d65-ef8a1e1f2c5e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:01.926717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f01ae0b-ee9b-4605-9d65-ef8a1e1f2c5e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:01.930134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f01ae0b-ee9b-4605-9d65-ef8a1e1f2c5e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:01.931895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f01ae0b-ee9b-4605-9d65-ef8a1e1f2c5e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:01.932573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f01ae0b-ee9b-4605-9d65-ef8a1e1f2c5e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:02.039628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-db5013ff-1522-47af-8dfe-500f39667802 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:02.058677 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-db5013ff-1522-47af-8dfe-500f39667802 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1297 microversion: 2.1 time: 0.363632 Aug 04 14:13:02.060625 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1774/3559] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:01 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1297 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:02.069581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:02.070687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] [instance: da969e0f-87c4-4c9d-bef7-b74fb0837616] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:02.091698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:02.092752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:02.095623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:02.096807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:02.127662 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] HTTP exception thrown: Instance da969e0f-87c4-4c9d-bef7-b74fb0837616 could not be found. Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Request method failure captured: Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 HTTP/1.1 Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JxokQZWt73oCTeb2uIT1T61PPtBceW-GidRWsXDOZjQVnibDMlYFve8J2CmvNSqnoJ2gUswAJOQhT5G9sx82VvrXKfhYzVPLV5Gd4BsYAE7SpJCYfj1C3r3f1XD7yVS8i5KHJX727wlQRlE5KUXS609Oac6ysS4Xt8O7zqu2gmqzI Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c9ff6de2efd240b79217e2e5efe4f8ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c9ff6de2efd240b79217e2e5efe4f8ce"}]}] Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c9ff6de2efd240b79217e2e5efe4f8ce Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-777890762 Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 653fb03c7a4b4a61a57ecd4cdd610e86 Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerRescueNegativeTestJSON-777890762-project Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance da969e0f-87c4-4c9d-bef7-b74fb0837616 could not be found. Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'da969e0f-87c4-4c9d-bef7-b74fb0837616'} Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da969e0f-87c4-4c9d-bef7-b74fb0837616 could not be found. Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da969e0f-87c4-4c9d-bef7-b74fb0837616 could not be found. Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:02.130269 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da969e0f-87c4-4c9d-bef7-b74fb0837616 could not be found. Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] Returning 404 to user: Instance da969e0f-87c4-4c9d-bef7-b74fb0837616 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:02.137117 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf205099-204a-430e-a006-3bc11d015383 tempest-ServerRescueNegativeTestJSON-777890762 tempest-ServerRescueNegativeTestJSON-777890762-project] 10.222.0.66 "GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616" status: 404 len: 111 microversion: 2.1 time: 0.070441 Aug 04 14:13:02.139237 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1775/3560] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:02 2022] GET /compute/v2.1/servers/da969e0f-87c4-4c9d-bef7-b74fb0837616 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:02.247677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9f01ae0b-ee9b-4605-9d65-ef8a1e1f2c5e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:02.258589 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f01ae0b-ee9b-4605-9d65-ef8a1e1f2c5e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1518 microversion: 2.1 time: 0.354084 Aug 04 14:13:02.259241 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1786/3561] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:01 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1518 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:02.938506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4bf6c79-962a-4c4e-b7b6-53551bd4eb43 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:02.939965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b4bf6c79-962a-4c4e-b7b6-53551bd4eb43 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:02.954518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4bf6c79-962a-4c4e-b7b6-53551bd4eb43 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:02.955848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4bf6c79-962a-4c4e-b7b6-53551bd4eb43 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:02.967433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4bf6c79-962a-4c4e-b7b6-53551bd4eb43 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:02.968446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4bf6c79-962a-4c4e-b7b6-53551bd4eb43 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:03.103531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a81dd6b3-11b5-4793-8941-8d01a4140e83 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:03.105460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a81dd6b3-11b5-4793-8941-8d01a4140e83 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:03.114709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a81dd6b3-11b5-4793-8941-8d01a4140e83 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:03.115437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a81dd6b3-11b5-4793-8941-8d01a4140e83 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:03.116398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a81dd6b3-11b5-4793-8941-8d01a4140e83 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:03.117059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a81dd6b3-11b5-4793-8941-8d01a4140e83 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:03.263017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a81dd6b3-11b5-4793-8941-8d01a4140e83 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:03.290437 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a81dd6b3-11b5-4793-8941-8d01a4140e83 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1297 microversion: 2.1 time: 0.195395 Aug 04 14:13:03.292608 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1787/3562] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:03 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1297 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:03.303589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f81e63e2-bcb7-4203-9af3-d60babc5b11c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:03.307019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f81e63e2-bcb7-4203-9af3-d60babc5b11c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:03.319265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81e63e2-bcb7-4203-9af3-d60babc5b11c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:03.320127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81e63e2-bcb7-4203-9af3-d60babc5b11c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:03.321217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81e63e2-bcb7-4203-9af3-d60babc5b11c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:03.321906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81e63e2-bcb7-4203-9af3-d60babc5b11c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:03.652280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4bf6c79-962a-4c4e-b7b6-53551bd4eb43 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:03.676329 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4bf6c79-962a-4c4e-b7b6-53551bd4eb43 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 0.743301 Aug 04 14:13:03.677447 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1776/3563] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:02 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:03.798851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f81e63e2-bcb7-4203-9af3-d60babc5b11c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:03.808958 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f81e63e2-bcb7-4203-9af3-d60babc5b11c tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1518 microversion: 2.1 time: 0.514798 Aug 04 14:13:03.815225 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1788/3564] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:03 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1518 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:04.346459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6b337a10-811f-4d22-88ff-d52e03d4df9d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:04.349105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6b337a10-811f-4d22-88ff-d52e03d4df9d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:04.385068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b337a10-811f-4d22-88ff-d52e03d4df9d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:04.385949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b337a10-811f-4d22-88ff-d52e03d4df9d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:04.397149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b337a10-811f-4d22-88ff-d52e03d4df9d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:04.401195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b337a10-811f-4d22-88ff-d52e03d4df9d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:04.661558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6b337a10-811f-4d22-88ff-d52e03d4df9d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:04.686895 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6b337a10-811f-4d22-88ff-d52e03d4df9d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1297 microversion: 2.1 time: 0.357203 Aug 04 14:13:04.689076 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1777/3565] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:04 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1297 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:04.730696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-162b1da5-1ee5-4e44-8230-19c839aef5e2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:04.734811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-162b1da5-1ee5-4e44-8230-19c839aef5e2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:04.763577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-162b1da5-1ee5-4e44-8230-19c839aef5e2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:04.765263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-162b1da5-1ee5-4e44-8230-19c839aef5e2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:04.768764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-162b1da5-1ee5-4e44-8230-19c839aef5e2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:04.771207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-162b1da5-1ee5-4e44-8230-19c839aef5e2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:04.860699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca4dd952-2811-4489-8dc3-56bdd62e53d7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:04.861434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ca4dd952-2811-4489-8dc3-56bdd62e53d7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:04.878286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca4dd952-2811-4489-8dc3-56bdd62e53d7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:04.882231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca4dd952-2811-4489-8dc3-56bdd62e53d7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:04.883581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca4dd952-2811-4489-8dc3-56bdd62e53d7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:04.885523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca4dd952-2811-4489-8dc3-56bdd62e53d7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:05.280568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-162b1da5-1ee5-4e44-8230-19c839aef5e2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:05.296039 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-162b1da5-1ee5-4e44-8230-19c839aef5e2 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 0.578951 Aug 04 14:13:05.297713 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1789/3566] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:04 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:05.433019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ca4dd952-2811-4489-8dc3-56bdd62e53d7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:05.448052 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca4dd952-2811-4489-8dc3-56bdd62e53d7 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1518 microversion: 2.1 time: 0.597402 Aug 04 14:13:05.449714 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1778/3567] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:04 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1518 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:05.722664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ffef4a64-610e-4d9f-806f-1ed0975aa136 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:05.723722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ffef4a64-610e-4d9f-806f-1ed0975aa136 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:05.751154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffef4a64-610e-4d9f-806f-1ed0975aa136 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:05.756761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffef4a64-610e-4d9f-806f-1ed0975aa136 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:05.761372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffef4a64-610e-4d9f-806f-1ed0975aa136 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:05.762447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffef4a64-610e-4d9f-806f-1ed0975aa136 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:06.115344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ffef4a64-610e-4d9f-806f-1ed0975aa136 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:06.124734 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ffef4a64-610e-4d9f-806f-1ed0975aa136 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1364 microversion: 2.1 time: 0.410909 Aug 04 14:13:06.150153 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1790/3568] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:05 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1364 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:06.335194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d8eb35d-b602-4f53-a248-e6091055af45 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:06.336353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d8eb35d-b602-4f53-a248-e6091055af45 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:06.377626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8eb35d-b602-4f53-a248-e6091055af45 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:06.379700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8eb35d-b602-4f53-a248-e6091055af45 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:06.383376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8eb35d-b602-4f53-a248-e6091055af45 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:06.388009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d8eb35d-b602-4f53-a248-e6091055af45 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:06.479535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-91911e11-e6a0-4b07-885e-10212968006f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:06.480192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-91911e11-e6a0-4b07-885e-10212968006f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:06.491734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91911e11-e6a0-4b07-885e-10212968006f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:06.497454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91911e11-e6a0-4b07-885e-10212968006f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:06.498683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91911e11-e6a0-4b07-885e-10212968006f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:06.504340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91911e11-e6a0-4b07-885e-10212968006f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:06.823024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-91911e11-e6a0-4b07-885e-10212968006f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:06.881193 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-91911e11-e6a0-4b07-885e-10212968006f tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1476 microversion: 2.1 time: 0.397263 Aug 04 14:13:06.883187 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1791/3569] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:06 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:13:07.094349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d8eb35d-b602-4f53-a248-e6091055af45 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:07.136233 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d8eb35d-b602-4f53-a248-e6091055af45 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 0.817717 Aug 04 14:13:07.138363 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1779/3570] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:06 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:07.189388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82f95004-e78a-45e4-9ba2-f50e38c63ce9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:07.191286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-82f95004-e78a-45e4-9ba2-f50e38c63ce9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:07.224592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82f95004-e78a-45e4-9ba2-f50e38c63ce9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:07.226051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82f95004-e78a-45e4-9ba2-f50e38c63ce9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:07.228559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82f95004-e78a-45e4-9ba2-f50e38c63ce9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:07.242472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82f95004-e78a-45e4-9ba2-f50e38c63ce9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:07.921213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-978c60f2-beff-417b-8686-8fd0537d28a1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:07.922553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-978c60f2-beff-417b-8686-8fd0537d28a1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:07.936060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978c60f2-beff-417b-8686-8fd0537d28a1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:07.941720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978c60f2-beff-417b-8686-8fd0537d28a1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:07.944045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978c60f2-beff-417b-8686-8fd0537d28a1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:07.949135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978c60f2-beff-417b-8686-8fd0537d28a1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:08.173720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82f95004-e78a-45e4-9ba2-f50e38c63ce9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:08.185881 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-82f95004-e78a-45e4-9ba2-f50e38c63ce9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1364 microversion: 2.1 time: 1.030707 Aug 04 14:13:08.194375 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1792/3571] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:07 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1364 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:08.225812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-442ffcac-d272-4539-bea7-d179f1a54922 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:08.228313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-442ffcac-d272-4539-bea7-d179f1a54922 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:08.248154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:08.254492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-442ffcac-d272-4539-bea7-d179f1a54922 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:08.256406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-442ffcac-d272-4539-bea7-d179f1a54922 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:08.258440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-442ffcac-d272-4539-bea7-d179f1a54922 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:08.260024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-442ffcac-d272-4539-bea7-d179f1a54922 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:08.306702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-978c60f2-beff-417b-8686-8fd0537d28a1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:08.316299 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-978c60f2-beff-417b-8686-8fd0537d28a1 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1476 microversion: 2.1 time: 0.399321 Aug 04 14:13:08.328247 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1780/3572] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:07 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1476 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:08.772766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3721624f-d001-4f77-86a2-5a437dadf0e3 req-67ce5a12-6d71-4c90-8b70-98e133d82b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a0757a-a398-4381-aff2-a2735a806c60", "name": "network-vif-deleted", "tag": "0dc5e4eb-6887-4d09-85fe-3b97ccc74b3c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:08.784425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:08.823541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=10 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:08.849380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3721624f-d001-4f77-86a2-5a437dadf0e3 req-67ce5a12-6d71-4c90-8b70-98e133d82b39 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:08.849906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3721624f-d001-4f77-86a2-5a437dadf0e3 req-67ce5a12-6d71-4c90-8b70-98e133d82b39 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:08.900384 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3721624f-d001-4f77-86a2-5a437dadf0e3 req-67ce5a12-6d71-4c90-8b70-98e133d82b39 service nova] Creating event network-vif-deleted:0dc5e4eb-6887-4d09-85fe-3b97ccc74b3c for instance a0a0757a-a398-4381-aff2-a2735a806c60 on n-h1-844627-10 Aug 04 14:13:08.935333 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3721624f-d001-4f77-86a2-5a437dadf0e3 req-67ce5a12-6d71-4c90-8b70-98e133d82b39 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173829 Aug 04 14:13:08.941983 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1781/3573] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:13:08.966710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-16d77b03-496e-4608-8e49-2172273780d4 req-5d7058e3-ccd6-440b-9ecd-d8076e7a52b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:09.005719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-16d77b03-496e-4608-8e49-2172273780d4 req-5d7058e3-ccd6-440b-9ecd-d8076e7a52b2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:09.011129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-16d77b03-496e-4608-8e49-2172273780d4 req-5d7058e3-ccd6-440b-9ecd-d8076e7a52b2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:09.052522 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-16d77b03-496e-4608-8e49-2172273780d4 req-5d7058e3-ccd6-440b-9ecd-d8076e7a52b2 service nova] Creating event network-changed:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:13:09.069167 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-16d77b03-496e-4608-8e49-2172273780d4 req-5d7058e3-ccd6-440b-9ecd-d8076e7a52b2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119251 Aug 04 14:13:09.069891 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1782/3574] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:09.222939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2239f21d-9782-4c8d-a16e-af667b67b5cf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:09.235652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2239f21d-9782-4c8d-a16e-af667b67b5cf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:09.252542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-442ffcac-d272-4539-bea7-d179f1a54922 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:09.260317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2239f21d-9782-4c8d-a16e-af667b67b5cf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:09.260811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2239f21d-9782-4c8d-a16e-af667b67b5cf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:09.267546 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-442ffcac-d272-4539-bea7-d179f1a54922 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 1.068512 Aug 04 14:13:09.269198 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1793/3575] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:08 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:09.273755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2239f21d-9782-4c8d-a16e-af667b67b5cf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:09.274248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2239f21d-9782-4c8d-a16e-af667b67b5cf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:09.359911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:09.361020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:09.374565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:09.376207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:09.383660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:09.384380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:09.504129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:09.504593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:09.505087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lazy-loading 'fault' on Instance uuid a0a0757a-a398-4381-aff2-a2735a806c60 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:13:09.600392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=10 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:09.647472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:09.749351 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c3b97373-8cad-4d7e-a693-680152b6aff3 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 200 len: 1310 microversion: 2.1 time: 0.389871 Aug 04 14:13:09.770485 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1794/3576] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:09 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 1310 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:09.926482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2239f21d-9782-4c8d-a16e-af667b67b5cf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:09.938154 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2239f21d-9782-4c8d-a16e-af667b67b5cf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1364 microversion: 2.1 time: 0.725254 Aug 04 14:13:09.941947 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1783/3577] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:09 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1364 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:10.314339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2dc45e32-59a7-4900-aa7e-323f6a72238a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:10.315860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2dc45e32-59a7-4900-aa7e-323f6a72238a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:10.346906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2dc45e32-59a7-4900-aa7e-323f6a72238a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:10.347799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2dc45e32-59a7-4900-aa7e-323f6a72238a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:10.348815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2dc45e32-59a7-4900-aa7e-323f6a72238a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:10.349285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2dc45e32-59a7-4900-aa7e-323f6a72238a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:10.687508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2dc45e32-59a7-4900-aa7e-323f6a72238a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:10.701867 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2dc45e32-59a7-4900-aa7e-323f6a72238a tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 0.395307 Aug 04 14:13:10.705635 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1795/3578] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:10 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:13:10.808258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:10.811431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: a0a0757a-a398-4381-aff2-a2735a806c60] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:10.834926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:10.835884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:10.838468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:10.840493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:10.907657 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] HTTP exception thrown: Instance a0a0757a-a398-4381-aff2-a2735a806c60 could not be found. Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Request method failure captured: Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 HTTP/1.1 Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69OZrds2hzivqo2QY3PPh078y7cexhdwPUFVKf3IcHdwIFK61SrNW8bL2o2wICIsaUr1nr06zF9pc-slnyoGEyQODcro4vQaBIWbQB121gb4XemmcMCn4nYVAD2muhdC4XCuQh-lEJEKqRR7SIfi1vBinh7ummwAOejECeS2GTIvMNU Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 76127a5e57b24da1b7fa8ff2bb2c3ffa Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ListServerFiltersTestJSON-1620466286 Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}] Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ListServerFiltersTestJSON-1620466286 Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 76127a5e57b24da1b7fa8ff2bb2c3ffa Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1620466286 Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ListServerFiltersTestJSON-1620466286-project Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: ae9d69e771a7411699a41da8ff17f6df Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ListServerFiltersTestJSON-1620466286-project Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance a0a0757a-a398-4381-aff2-a2735a806c60 could not be found. Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'a0a0757a-a398-4381-aff2-a2735a806c60'} Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a0757a-a398-4381-aff2-a2735a806c60 could not be found. Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a0757a-a398-4381-aff2-a2735a806c60 could not be found. Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:10.911611 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a0757a-a398-4381-aff2-a2735a806c60 could not be found. Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Returning 404 to user: Instance a0a0757a-a398-4381-aff2-a2735a806c60 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e51861f-3c5f-446e-a2a6-bd2ce83df8a5 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60" status: 404 len: 111 microversion: 2.1 time: 0.118611 Aug 04 14:13:10.935319 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1784/3579] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:10 2022] GET /compute/v2.1/servers/a0a0757a-a398-4381-aff2-a2735a806c60 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:10.939355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-105e581e-9f42-4670-acf1-9d3f59172282 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:10.939355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-105e581e-9f42-4670-acf1-9d3f59172282 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:10.939355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-105e581e-9f42-4670-acf1-9d3f59172282 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:10.939355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-105e581e-9f42-4670-acf1-9d3f59172282 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:10.939355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-105e581e-9f42-4670-acf1-9d3f59172282 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:10.939355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-105e581e-9f42-4670-acf1-9d3f59172282 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:10.943036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:10.977245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-98669757-0c3d-4dc0-bb85-db787e27025d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:10.982308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-98669757-0c3d-4dc0-bb85-db787e27025d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:10.995850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-105e581e-9f42-4670-acf1-9d3f59172282 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:13:11.011843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98669757-0c3d-4dc0-bb85-db787e27025d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:11.013684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98669757-0c3d-4dc0-bb85-db787e27025d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:11.018964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98669757-0c3d-4dc0-bb85-db787e27025d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:11.019918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98669757-0c3d-4dc0-bb85-db787e27025d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:11.100734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=10 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:11.214423 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-105e581e-9f42-4670-acf1-9d3f59172282 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda" status: 204 len: 0 microversion: 2.1 time: 0.291828 Aug 04 14:13:11.221018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1796/3580] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:10 2022] DELETE /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:13:11.227086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-831bedcd-c16a-478b-beef-226acf47dc30 req-d97d6bf3-24c8-43c9-90a8-92d53cb206fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e19bc0e-734c-4fb6-8b4f-874e5ba2183b", "tag": "a7f5c08e-3867-4c36-998e-e4ed994416bf"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:11.238432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-831bedcd-c16a-478b-beef-226acf47dc30 req-d97d6bf3-24c8-43c9-90a8-92d53cb206fd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:11.239057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-831bedcd-c16a-478b-beef-226acf47dc30 req-d97d6bf3-24c8-43c9-90a8-92d53cb206fd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:11.254171 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-831bedcd-c16a-478b-beef-226acf47dc30 req-d97d6bf3-24c8-43c9-90a8-92d53cb206fd service nova] Creating event network-changed:a7f5c08e-3867-4c36-998e-e4ed994416bf for instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b on n-h2-844627-10 Aug 04 14:13:11.260707 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-831bedcd-c16a-478b-beef-226acf47dc30 req-d97d6bf3-24c8-43c9-90a8-92d53cb206fd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042375 Aug 04 14:13:11.261382 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1797/3581] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:11.267098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7455df9f-4827-4276-9785-6ff6fd7c3e00 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:11.267817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7455df9f-4827-4276-9785-6ff6fd7c3e00 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:11.277386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7455df9f-4827-4276-9785-6ff6fd7c3e00 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:11.277934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7455df9f-4827-4276-9785-6ff6fd7c3e00 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:11.278987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7455df9f-4827-4276-9785-6ff6fd7c3e00 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:11.280186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7455df9f-4827-4276-9785-6ff6fd7c3e00 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:12.337771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7455df9f-4827-4276-9785-6ff6fd7c3e00 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:12.346945 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7455df9f-4827-4276-9785-6ff6fd7c3e00 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda" status: 200 len: 1517 microversion: 2.1 time: 1.084203 Aug 04 14:13:12.354701 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1798/3582] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:11 2022] GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda => generated 1517 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:12.363532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cb9937e2-c124-4eca-9bf5-af70d56e562f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:12.364459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cb9937e2-c124-4eca-9bf5-af70d56e562f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:12.375246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb9937e2-c124-4eca-9bf5-af70d56e562f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:12.375975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb9937e2-c124-4eca-9bf5-af70d56e562f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:12.377049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb9937e2-c124-4eca-9bf5-af70d56e562f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:12.377838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb9937e2-c124-4eca-9bf5-af70d56e562f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:12.441660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-98669757-0c3d-4dc0-bb85-db787e27025d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:12.456984 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-98669757-0c3d-4dc0-bb85-db787e27025d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1364 microversion: 2.1 time: 1.489285 Aug 04 14:13:12.460394 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1785/3583] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:10 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1364 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:12.757625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cb9937e2-c124-4eca-9bf5-af70d56e562f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:12.775236 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cb9937e2-c124-4eca-9bf5-af70d56e562f tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 0.419060 Aug 04 14:13:12.791735 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1799/3584] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:12 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:13.377527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-759e9b00-a1ce-4c79-bcdf-3e6ea6f30e42 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:13.378650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-759e9b00-a1ce-4c79-bcdf-3e6ea6f30e42 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:13.396195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-759e9b00-a1ce-4c79-bcdf-3e6ea6f30e42 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:13.398287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-759e9b00-a1ce-4c79-bcdf-3e6ea6f30e42 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:13.403879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-759e9b00-a1ce-4c79-bcdf-3e6ea6f30e42 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:13.404753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-759e9b00-a1ce-4c79-bcdf-3e6ea6f30e42 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:13.527879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-253064198", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "26cecf75-2c83-4f3c-9efe-ef928524fdbb"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:13.726921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] validate_networks() for [('26cecf75-2c83-4f3c-9efe-ef928524fdbb', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:13:14.455866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-759e9b00-a1ce-4c79-bcdf-3e6ea6f30e42 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:14.550982 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-759e9b00-a1ce-4c79-bcdf-3e6ea6f30e42 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda" status: 200 len: 1517 microversion: 2.1 time: 1.163761 Aug 04 14:13:14.555840 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1800/3585] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:13 2022] GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda => generated 1517 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:14.611777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-027ac1ee-c3f5-4919-9057-28e0625bd3da tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:14.619466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-027ac1ee-c3f5-4919-9057-28e0625bd3da tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:14.651603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-027ac1ee-c3f5-4919-9057-28e0625bd3da tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:14.653021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-027ac1ee-c3f5-4919-9057-28e0625bd3da tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:14.655080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-027ac1ee-c3f5-4919-9057-28e0625bd3da tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:14.656696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-027ac1ee-c3f5-4919-9057-28e0625bd3da tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:15.709026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:13:15.709614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:13:15.709928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:13:15.710457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:13:15.710884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:13:15.736828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:15.741148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:15.745504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:15.747385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:15.811926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Getting quotas for project ccabacc4068b41debabd3184f28aec4d. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:13:15.840903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Getting quotas for user 9b51276088a44f8a851b433430a7487c and project ccabacc4068b41debabd3184f28aec4d. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:13:15.861779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-027ac1ee-c3f5-4919-9057-28e0625bd3da tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:15.866492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:13:15.872105 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-027ac1ee-c3f5-4919-9057-28e0625bd3da tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1364 microversion: 2.1 time: 1.305448 Aug 04 14:13:15.879676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:13:15.893100 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1801/3586] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:14 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1364 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:15.912859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b54f709-2a25-44e9-9cd3-96e38fc7ad5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:15.913752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b54f709-2a25-44e9-9cd3-96e38fc7ad5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:15.938738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b54f709-2a25-44e9-9cd3-96e38fc7ad5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:15.939346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b54f709-2a25-44e9-9cd3-96e38fc7ad5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:15.940288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b54f709-2a25-44e9-9cd3-96e38fc7ad5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:15.941366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b54f709-2a25-44e9-9cd3-96e38fc7ad5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:16.042686 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ccd9c88-ed12-4641-894e-f5d23859854e tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.062447 Aug 04 14:13:16.044553 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1786/3587] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:13:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:13:16.058144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be703937-dec3-4eab-a679-cae8bfc0ee19 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:16.065978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be703937-dec3-4eab-a679-cae8bfc0ee19 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:16.083314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be703937-dec3-4eab-a679-cae8bfc0ee19 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:16.083752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be703937-dec3-4eab-a679-cae8bfc0ee19 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:16.085238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be703937-dec3-4eab-a679-cae8bfc0ee19 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:16.085680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be703937-dec3-4eab-a679-cae8bfc0ee19 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:16.691014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-be703937-dec3-4eab-a679-cae8bfc0ee19 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:16.704670 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be703937-dec3-4eab-a679-cae8bfc0ee19 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda" status: 200 len: 1475 microversion: 2.1 time: 0.658248 Aug 04 14:13:16.708596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1787/3588] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:16 2022] GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda => generated 1475 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:16.724785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cc84502f-ebbf-400a-b10c-745fbad353f4 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:16.725857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cc84502f-ebbf-400a-b10c-745fbad353f4 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:17.617375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cc84502f-ebbf-400a-b10c-745fbad353f4 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:17.633532 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cc84502f-ebbf-400a-b10c-745fbad353f4 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1227 microversion: 2.1 time: 0.914620 Aug 04 14:13:17.634393 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1788/3589] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:16 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1227 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:17.663625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f71827b0-2f80-4853-b08c-ee1cb539c2df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:17.664240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f71827b0-2f80-4853-b08c-ee1cb539c2df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:17.690957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f71827b0-2f80-4853-b08c-ee1cb539c2df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:17.691754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f71827b0-2f80-4853-b08c-ee1cb539c2df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:17.692782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f71827b0-2f80-4853-b08c-ee1cb539c2df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:17.699657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f71827b0-2f80-4853-b08c-ee1cb539c2df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:18.060702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b54f709-2a25-44e9-9cd3-96e38fc7ad5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:18.078206 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b54f709-2a25-44e9-9cd3-96e38fc7ad5e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 2.183415 Aug 04 14:13:18.081361 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1802/3590] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:15 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:18.098096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-943b8066-7940-48ef-a10a-e02aef862a46 req-abbba6bd-b160-4b72-9e50-5f8afa061522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd31d65-ed98-4de5-937a-9217b5aaafda", "name": "network-vif-deleted", "tag": "e8ebb9da-528c-47e7-8569-33321c973a49"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:18.122356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-943b8066-7940-48ef-a10a-e02aef862a46 req-abbba6bd-b160-4b72-9e50-5f8afa061522 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:18.122732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-943b8066-7940-48ef-a10a-e02aef862a46 req-abbba6bd-b160-4b72-9e50-5f8afa061522 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:18.148401 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-943b8066-7940-48ef-a10a-e02aef862a46 req-abbba6bd-b160-4b72-9e50-5f8afa061522 service nova] Creating event network-vif-deleted:e8ebb9da-528c-47e7-8569-33321c973a49 for instance 6dd31d65-ed98-4de5-937a-9217b5aaafda on n-h1-844627-10 Aug 04 14:13:18.181733 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-943b8066-7940-48ef-a10a-e02aef862a46 req-abbba6bd-b160-4b72-9e50-5f8afa061522 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084917 Aug 04 14:13:18.184492 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1803/3591] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:18.192771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:18.194541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:18.206661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:18.207570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:18.209189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:18.210296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:18.346839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:18.347720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:18.349420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lazy-loading 'fault' on Instance uuid 6dd31d65-ed98-4de5-937a-9217b5aaafda {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:13:18.535154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f71827b0-2f80-4853-b08c-ee1cb539c2df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:18.550818 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f71827b0-2f80-4853-b08c-ee1cb539c2df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1364 microversion: 2.1 time: 0.915401 Aug 04 14:13:18.558395 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1789/3592] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:17 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1364 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:18.631596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:18.660759 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d7c0dbb5-4cba-4817-addf-3f696ba0f826 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda" status: 200 len: 1310 microversion: 2.1 time: 0.473297 Aug 04 14:13:18.678476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-966e23b1-bef2-4849-a070-0ea4b87d6466 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:18.679632 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1804/3593] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:18 2022] GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda => generated 1310 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:18.680243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-966e23b1-bef2-4849-a070-0ea4b87d6466 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:18.697631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966e23b1-bef2-4849-a070-0ea4b87d6466 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:18.700412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966e23b1-bef2-4849-a070-0ea4b87d6466 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:18.701714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966e23b1-bef2-4849-a070-0ea4b87d6466 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:18.702190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966e23b1-bef2-4849-a070-0ea4b87d6466 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:18.965082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-966e23b1-bef2-4849-a070-0ea4b87d6466 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:18.988317 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-966e23b1-bef2-4849-a070-0ea4b87d6466 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1285 microversion: 2.1 time: 0.314949 Aug 04 14:13:18.989780 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1790/3594] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:18 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:19.106304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43771cc9-d008-4aa8-8c2f-30ad61a988a9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:19.107545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-43771cc9-d008-4aa8-8c2f-30ad61a988a9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:19.123851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43771cc9-d008-4aa8-8c2f-30ad61a988a9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:19.126994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43771cc9-d008-4aa8-8c2f-30ad61a988a9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:19.128082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43771cc9-d008-4aa8-8c2f-30ad61a988a9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:19.131239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43771cc9-d008-4aa8-8c2f-30ad61a988a9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:19.544217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-43771cc9-d008-4aa8-8c2f-30ad61a988a9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:19.574297 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-43771cc9-d008-4aa8-8c2f-30ad61a988a9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 0.472131 Aug 04 14:13:19.581248 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1805/3595] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:19 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:19.605361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b7660520-d34e-466d-adaa-c578e584f730 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:19.609350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b7660520-d34e-466d-adaa-c578e584f730 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:19.626120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a5c5fbed-038e-4403-a626-b915a9c05c92 req-a4669ebc-c9fb-4555-aa3e-e951f9caf7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "name": "network-vif-plugged", "status": "completed", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:19.640147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7660520-d34e-466d-adaa-c578e584f730 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:19.645359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7660520-d34e-466d-adaa-c578e584f730 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:19.651361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7660520-d34e-466d-adaa-c578e584f730 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:19.654834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7660520-d34e-466d-adaa-c578e584f730 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:19.674615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a5c5fbed-038e-4403-a626-b915a9c05c92 req-a4669ebc-c9fb-4555-aa3e-e951f9caf7f4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:19.675380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a5c5fbed-038e-4403-a626-b915a9c05c92 req-a4669ebc-c9fb-4555-aa3e-e951f9caf7f4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:19.725151 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a5c5fbed-038e-4403-a626-b915a9c05c92 req-a4669ebc-c9fb-4555-aa3e-e951f9caf7f4 service nova] Creating event network-vif-plugged:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:13:19.744760 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a5c5fbed-038e-4403-a626-b915a9c05c92 req-a4669ebc-c9fb-4555-aa3e-e951f9caf7f4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127201 Aug 04 14:13:19.751319 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1806/3596] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:19.771279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:19.775038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 6dd31d65-ed98-4de5-937a-9217b5aaafda] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:19.815631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:19.816828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:19.818662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:19.820397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:19.886329 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] HTTP exception thrown: Instance 6dd31d65-ed98-4de5-937a-9217b5aaafda could not be found. Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Request method failure captured: Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda HTTP/1.1 Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69OZrds2hzivqo2QY3PPh078y7cexhdwPUFVKf3IcHdwIFK61SrNW8bL2o2wICIsaUr1nr06zF9pc-slnyoGEyQODcro4vQaBIWbQB121gb4XemmcMCn4nYVAD2muhdC4XCuQh-lEJEKqRR7SIfi1vBinh7ummwAOejECeS2GTIvMNU Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 76127a5e57b24da1b7fa8ff2bb2c3ffa Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ListServerFiltersTestJSON-1620466286 Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}] Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ListServerFiltersTestJSON-1620466286 Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 76127a5e57b24da1b7fa8ff2bb2c3ffa Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1620466286 Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ListServerFiltersTestJSON-1620466286-project Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: ae9d69e771a7411699a41da8ff17f6df Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ListServerFiltersTestJSON-1620466286-project Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 6dd31d65-ed98-4de5-937a-9217b5aaafda could not be found. Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '6dd31d65-ed98-4de5-937a-9217b5aaafda'} Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd31d65-ed98-4de5-937a-9217b5aaafda could not be found. Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd31d65-ed98-4de5-937a-9217b5aaafda could not be found. Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:19.895153 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:19.905247 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:19.905247 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:19.905247 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:19.905247 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:19.905247 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:19.905247 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd31d65-ed98-4de5-937a-9217b5aaafda could not be found. Aug 04 14:13:19.905247 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:19.913971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Returning 404 to user: Instance 6dd31d65-ed98-4de5-937a-9217b5aaafda could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:19.916572 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb5cf625-b208-4fd8-9ed7-517fbc466aba tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda" status: 404 len: 111 microversion: 2.1 time: 0.162589 Aug 04 14:13:19.925596 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1807/3597] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:19 2022] GET /compute/v2.1/servers/6dd31d65-ed98-4de5-937a-9217b5aaafda => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:19.937976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-92685add-c5b5-4759-8684-7f0098fb3f8e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:19.938492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-92685add-c5b5-4759-8684-7f0098fb3f8e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:19.947815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92685add-c5b5-4759-8684-7f0098fb3f8e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:19.948282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92685add-c5b5-4759-8684-7f0098fb3f8e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:19.949744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92685add-c5b5-4759-8684-7f0098fb3f8e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:19.952229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92685add-c5b5-4759-8684-7f0098fb3f8e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:20.014303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-92685add-c5b5-4759-8684-7f0098fb3f8e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:13:20.252511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:20.260157 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-92685add-c5b5-4759-8684-7f0098fb3f8e tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 204 len: 0 microversion: 2.1 time: 0.327554 Aug 04 14:13:20.271072 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1808/3598] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:19 2022] DELETE /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:13:20.280774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac9e1b27-0598-4bac-8b75-3cb8078fef52 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:20.282870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac9e1b27-0598-4bac-8b75-3cb8078fef52 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:20.295381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac9e1b27-0598-4bac-8b75-3cb8078fef52 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:20.296890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac9e1b27-0598-4bac-8b75-3cb8078fef52 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:20.298688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac9e1b27-0598-4bac-8b75-3cb8078fef52 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:20.299712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac9e1b27-0598-4bac-8b75-3cb8078fef52 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:20.463079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac9e1b27-0598-4bac-8b75-3cb8078fef52 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:20.464247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7660520-d34e-466d-adaa-c578e584f730 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:20.474100 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b7660520-d34e-466d-adaa-c578e584f730 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1364 microversion: 2.1 time: 0.876363 Aug 04 14:13:20.476198 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1791/3599] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:19 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1364 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:20.480788 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac9e1b27-0598-4bac-8b75-3cb8078fef52 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1285 microversion: 2.1 time: 0.206962 Aug 04 14:13:20.485085 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1809/3600] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:20 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:20.500059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-35405fda-84d6-47fb-b8f7-b20a60a018d6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:20.501170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-35405fda-84d6-47fb-b8f7-b20a60a018d6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:20.509407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35405fda-84d6-47fb-b8f7-b20a60a018d6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:20.509862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35405fda-84d6-47fb-b8f7-b20a60a018d6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:20.510925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35405fda-84d6-47fb-b8f7-b20a60a018d6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:20.511381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35405fda-84d6-47fb-b8f7-b20a60a018d6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:20.628709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da6621e4-2cd0-4858-87dc-fb4f8f14c0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:20.629795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-da6621e4-2cd0-4858-87dc-fb4f8f14c0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:20.643069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da6621e4-2cd0-4858-87dc-fb4f8f14c0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:20.645514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da6621e4-2cd0-4858-87dc-fb4f8f14c0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:20.647363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da6621e4-2cd0-4858-87dc-fb4f8f14c0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:20.648561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da6621e4-2cd0-4858-87dc-fb4f8f14c0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:20.718002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-35405fda-84d6-47fb-b8f7-b20a60a018d6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:20.736624 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-35405fda-84d6-47fb-b8f7-b20a60a018d6 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1518 microversion: 2.1 time: 0.258558 Aug 04 14:13:20.745622 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1792/3601] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:20 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:20.971188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-da6621e4-2cd0-4858-87dc-fb4f8f14c0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:20.989579 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-da6621e4-2cd0-4858-87dc-fb4f8f14c0a1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 0.383321 Aug 04 14:13:20.992369 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1810/3602] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:20 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:21.506570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c6002e72-b0d8-425e-9436-50d0c6eb0ed8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:21.507680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c6002e72-b0d8-425e-9436-50d0c6eb0ed8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:21.514587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f3ef8ce-08b0-4b31-ac69-52c06aea00df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:21.516430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f3ef8ce-08b0-4b31-ac69-52c06aea00df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:21.531608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6002e72-b0d8-425e-9436-50d0c6eb0ed8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:21.532528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6002e72-b0d8-425e-9436-50d0c6eb0ed8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:21.534658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6002e72-b0d8-425e-9436-50d0c6eb0ed8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:21.538062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6002e72-b0d8-425e-9436-50d0c6eb0ed8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:21.540733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f3ef8ce-08b0-4b31-ac69-52c06aea00df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:21.541272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f3ef8ce-08b0-4b31-ac69-52c06aea00df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:21.551490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f3ef8ce-08b0-4b31-ac69-52c06aea00df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:21.552807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f3ef8ce-08b0-4b31-ac69-52c06aea00df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:22.449356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6f3ef8ce-08b0-4b31-ac69-52c06aea00df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:22.455109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:22.466113 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f3ef8ce-08b0-4b31-ac69-52c06aea00df tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1364 microversion: 2.1 time: 0.959610 Aug 04 14:13:22.472906 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1811/3603] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:21 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1364 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:22.479271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebeae5d3-379a-4cd4-ade4-89dc598faecb tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:22.486725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ebeae5d3-379a-4cd4-ade4-89dc598faecb tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:22.503909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c6002e72-b0d8-425e-9436-50d0c6eb0ed8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:22.506837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebeae5d3-379a-4cd4-ade4-89dc598faecb tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:22.507332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebeae5d3-379a-4cd4-ade4-89dc598faecb tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:22.508555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebeae5d3-379a-4cd4-ade4-89dc598faecb tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:22.509042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebeae5d3-379a-4cd4-ade4-89dc598faecb tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:22.539385 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c6002e72-b0d8-425e-9436-50d0c6eb0ed8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1327 microversion: 2.1 time: 1.039027 Aug 04 14:13:22.541965 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1793/3604] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:21 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1327 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:22.585808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2b2116eb-1176-49ef-ad5c-5105b369d6a1 req-6607a5dd-6368-440e-9a79-19b45da56a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e19bc0e-734c-4fb6-8b4f-874e5ba2183b", "name": "network-vif-plugged", "status": "completed", "tag": "a7f5c08e-3867-4c36-998e-e4ed994416bf"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:22.612747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2b2116eb-1176-49ef-ad5c-5105b369d6a1 req-6607a5dd-6368-440e-9a79-19b45da56a42 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:22.613584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2b2116eb-1176-49ef-ad5c-5105b369d6a1 req-6607a5dd-6368-440e-9a79-19b45da56a42 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:22.637458 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2b2116eb-1176-49ef-ad5c-5105b369d6a1 req-6607a5dd-6368-440e-9a79-19b45da56a42 service nova] Creating event network-vif-plugged:a7f5c08e-3867-4c36-998e-e4ed994416bf for instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b on n-h2-844627-10 Aug 04 14:13:22.644810 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2b2116eb-1176-49ef-ad5c-5105b369d6a1 req-6607a5dd-6368-440e-9a79-19b45da56a42 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098850 Aug 04 14:13:22.646223 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1794/3605] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:22.661505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8cf9c0ce-02ce-4305-b1f4-a867ea857049 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:22.667862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8cf9c0ce-02ce-4305-b1f4-a867ea857049 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:22.677641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cf9c0ce-02ce-4305-b1f4-a867ea857049 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:22.678536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cf9c0ce-02ce-4305-b1f4-a867ea857049 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:22.679668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cf9c0ce-02ce-4305-b1f4-a867ea857049 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:22.680396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cf9c0ce-02ce-4305-b1f4-a867ea857049 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:23.505582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8cf9c0ce-02ce-4305-b1f4-a867ea857049 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:23.513630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:23.528460 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8cf9c0ce-02ce-4305-b1f4-a867ea857049 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 0.880073 Aug 04 14:13:23.531391 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1795/3606] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:22 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:23.541810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-d97e027e-aac3-47c8-89bf-325cfad6f503 req-6ca52867-ba90-4a9a-b0d1-ed44b88146ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef", "tag": "7fd44b3c-91f8-4cf1-87d3-d94014e65cbb"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:23.565042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d97e027e-aac3-47c8-89bf-325cfad6f503 req-6ca52867-ba90-4a9a-b0d1-ed44b88146ac service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:23.566293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d97e027e-aac3-47c8-89bf-325cfad6f503 req-6ca52867-ba90-4a9a-b0d1-ed44b88146ac service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:23.595483 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-d97e027e-aac3-47c8-89bf-325cfad6f503 req-6ca52867-ba90-4a9a-b0d1-ed44b88146ac service nova] Creating event network-changed:7fd44b3c-91f8-4cf1-87d3-d94014e65cbb for instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef on n-h2-844627-10 Aug 04 14:13:23.603111 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-d97e027e-aac3-47c8-89bf-325cfad6f503 req-6ca52867-ba90-4a9a-b0d1-ed44b88146ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068831 Aug 04 14:13:23.604190 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1796/3607] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:23.611726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-77b723fb-2013-4e66-a8ba-ec76fddab536 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:23.613221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-77b723fb-2013-4e66-a8ba-ec76fddab536 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:23.622721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77b723fb-2013-4e66-a8ba-ec76fddab536 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:23.623628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77b723fb-2013-4e66-a8ba-ec76fddab536 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:23.624859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77b723fb-2013-4e66-a8ba-ec76fddab536 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:23.625389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77b723fb-2013-4e66-a8ba-ec76fddab536 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:23.971931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ebeae5d3-379a-4cd4-ade4-89dc598faecb tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:23.998395 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ebeae5d3-379a-4cd4-ade4-89dc598faecb tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1518 microversion: 2.1 time: 1.508452 Aug 04 14:13:23.999323 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1812/3608] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:22 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1518 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:24.005269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f5fd3514-149d-4719-a2b2-1443aa40e3f5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:24.006375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f5fd3514-149d-4719-a2b2-1443aa40e3f5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:24.014148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5fd3514-149d-4719-a2b2-1443aa40e3f5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:24.014912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5fd3514-149d-4719-a2b2-1443aa40e3f5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:24.016115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5fd3514-149d-4719-a2b2-1443aa40e3f5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:24.016901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f5fd3514-149d-4719-a2b2-1443aa40e3f5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:24.267461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-77b723fb-2013-4e66-a8ba-ec76fddab536 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:24.291062 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-77b723fb-2013-4e66-a8ba-ec76fddab536 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1550 microversion: 2.1 time: 0.684317 Aug 04 14:13:24.314233 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1797/3609] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:23 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1550 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:24.324339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f5fd3514-149d-4719-a2b2-1443aa40e3f5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:24.329332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-723ff9ee-d632-46b3-a15f-45c00bdf022a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:24.330249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-723ff9ee-d632-46b3-a15f-45c00bdf022a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:24.333079 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f5fd3514-149d-4719-a2b2-1443aa40e3f5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1327 microversion: 2.1 time: 0.331784 Aug 04 14:13:24.333923 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1813/3610] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:23 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1327 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:24.344759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-723ff9ee-d632-46b3-a15f-45c00bdf022a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:24.346225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-723ff9ee-d632-46b3-a15f-45c00bdf022a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:24.348282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-723ff9ee-d632-46b3-a15f-45c00bdf022a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:24.349232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-723ff9ee-d632-46b3-a15f-45c00bdf022a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:24.552488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2f37208-8d84-442e-aa9b-e33f7aa0bc25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:24.553145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e2f37208-8d84-442e-aa9b-e33f7aa0bc25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:24.563530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2f37208-8d84-442e-aa9b-e33f7aa0bc25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:24.563989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2f37208-8d84-442e-aa9b-e33f7aa0bc25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:24.564911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2f37208-8d84-442e-aa9b-e33f7aa0bc25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:24.565588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2f37208-8d84-442e-aa9b-e33f7aa0bc25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:24.650913 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-723ff9ee-d632-46b3-a15f-45c00bdf022a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.327933 Aug 04 14:13:24.651914 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1798/3611] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:13:24 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/os-interface => generated 284 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:24.669546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7bc58129-b2ef-4bda-9e6f-73062d179215 req-7a9aced0-6f8b-44e0-a74f-a3a1f81d105b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff61720-5387-4758-b989-86e21ec56509", "name": "network-vif-deleted", "tag": "5b6b21b5-0b35-4248-87ae-057b105e118c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:24.700475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7bc58129-b2ef-4bda-9e6f-73062d179215 req-7a9aced0-6f8b-44e0-a74f-a3a1f81d105b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:24.701289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7bc58129-b2ef-4bda-9e6f-73062d179215 req-7a9aced0-6f8b-44e0-a74f-a3a1f81d105b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:24.736998 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7bc58129-b2ef-4bda-9e6f-73062d179215 req-7a9aced0-6f8b-44e0-a74f-a3a1f81d105b service nova] Creating event network-vif-deleted:5b6b21b5-0b35-4248-87ae-057b105e118c for instance 0ff61720-5387-4758-b989-86e21ec56509 on n-h1-844627-10 Aug 04 14:13:24.750734 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7bc58129-b2ef-4bda-9e6f-73062d179215 req-7a9aced0-6f8b-44e0-a74f-a3a1f81d105b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096538 Aug 04 14:13:24.754379 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1799/3612] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:25.016844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:25.018017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:25.037035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:25.038170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:25.044983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:25.046359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:25.183628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:25.185547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:25.188791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lazy-loading 'fault' on Instance uuid 0ff61720-5387-4758-b989-86e21ec56509 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:13:25.463019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9d69e771a7411699a41da8ff17f6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76127a5e57b24da1b7fa8ff2bb2c3ffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:25.480679 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ce3ecfb-82de-477d-8faa-722f75bbc3f9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 200 len: 1311 microversion: 2.1 time: 0.475771 Aug 04 14:13:25.481640 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1800/3613] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:25 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 1311 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:25.486851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a0f92ae-efa2-450b-99cf-aca8b1404a63 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:25.508808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a0f92ae-efa2-450b-99cf-aca8b1404a63 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:25.541274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a0f92ae-efa2-450b-99cf-aca8b1404a63 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:25.545755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a0f92ae-efa2-450b-99cf-aca8b1404a63 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:25.547350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a0f92ae-efa2-450b-99cf-aca8b1404a63 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:25.553234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a0f92ae-efa2-450b-99cf-aca8b1404a63 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:25.780122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:25.849583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e2f37208-8d84-442e-aa9b-e33f7aa0bc25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:25.865675 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e2f37208-8d84-442e-aa9b-e33f7aa0bc25 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1314 microversion: 2.1 time: 1.316974 Aug 04 14:13:25.879065 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1814/3614] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:24 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1314 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:26.414255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2a0f92ae-efa2-450b-99cf-aca8b1404a63 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:26.426783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a0f92ae-efa2-450b-99cf-aca8b1404a63 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1327 microversion: 2.1 time: 0.943715 Aug 04 14:13:26.427286 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1801/3615] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:25 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1327 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:26.529932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:26.530587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] [instance: 0ff61720-5387-4758-b989-86e21ec56509] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:26.547240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:26.548018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:26.549669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:26.549669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:26.575626 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] HTTP exception thrown: Instance 0ff61720-5387-4758-b989-86e21ec56509 could not be found. Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Request method failure captured: Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 HTTP/1.1 Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69OZrds2hzivqo2QY3PPh078y7cexhdwPUFVKf3IcHdwIFK61SrNW8bL2o2wICIsaUr1nr06zF9pc-slnyoGEyQODcro4vQaBIWbQB121gb4XemmcMCn4nYVAD2muhdC4XCuQh-lEJEKqRR7SIfi1vBinh7ummwAOejECeS2GTIvMNU Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 76127a5e57b24da1b7fa8ff2bb2c3ffa Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ListServerFiltersTestJSON-1620466286 Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/76127a5e57b24da1b7fa8ff2bb2c3ffa"}]}] Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ListServerFiltersTestJSON-1620466286 Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 76127a5e57b24da1b7fa8ff2bb2c3ffa Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1620466286 Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ListServerFiltersTestJSON-1620466286-project Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: ae9d69e771a7411699a41da8ff17f6df Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ListServerFiltersTestJSON-1620466286-project Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 0ff61720-5387-4758-b989-86e21ec56509 could not be found. Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '0ff61720-5387-4758-b989-86e21ec56509'} Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff61720-5387-4758-b989-86e21ec56509 could not be found. Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff61720-5387-4758-b989-86e21ec56509 could not be found. Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:26.577371 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:26.583142 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:26.583142 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:26.583142 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:26.583142 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:26.583142 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:26.583142 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff61720-5387-4758-b989-86e21ec56509 could not be found. Aug 04 14:13:26.583142 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:26.584900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] Returning 404 to user: Instance 0ff61720-5387-4758-b989-86e21ec56509 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:26.585975 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3dbe9bf-b0a2-470a-829f-ab2fc8cfdea9 tempest-ListServerFiltersTestJSON-1620466286 tempest-ListServerFiltersTestJSON-1620466286-project] 10.222.0.66 "GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509" status: 404 len: 111 microversion: 2.1 time: 0.060365 Aug 04 14:13:26.587068 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1815/3616] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:26 2022] GET /compute/v2.1/servers/0ff61720-5387-4758-b989-86e21ec56509 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:26.886793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd3f710b-89c7-40e4-9d48-bb6805ebb4fa tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:26.887433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bd3f710b-89c7-40e4-9d48-bb6805ebb4fa tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:26.907930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd3f710b-89c7-40e4-9d48-bb6805ebb4fa tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:26.918028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd3f710b-89c7-40e4-9d48-bb6805ebb4fa tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:26.920133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd3f710b-89c7-40e4-9d48-bb6805ebb4fa tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:26.921262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd3f710b-89c7-40e4-9d48-bb6805ebb4fa tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:27.454308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ccf987b-34d6-46ff-be4d-d916d00856e8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:27.461209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2ccf987b-34d6-46ff-be4d-d916d00856e8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:27.477473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-34d6-46ff-be4d-d916d00856e8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:27.480733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-34d6-46ff-be4d-d916d00856e8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:27.483349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-34d6-46ff-be4d-d916d00856e8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:27.485273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ccf987b-34d6-46ff-be4d-d916d00856e8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:27.531121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bd3f710b-89c7-40e4-9d48-bb6805ebb4fa tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:27.546182 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd3f710b-89c7-40e4-9d48-bb6805ebb4fa tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1500 microversion: 2.1 time: 0.663475 Aug 04 14:13:27.557300 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1802/3617] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:26 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1500 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:27.581586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3c7f2d1-726f-479f-8933-e51ba5624e87 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:27.582786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c3c7f2d1-726f-479f-8933-e51ba5624e87 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:27.589912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3c7f2d1-726f-479f-8933-e51ba5624e87 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:27.590698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3c7f2d1-726f-479f-8933-e51ba5624e87 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:27.591680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3c7f2d1-726f-479f-8933-e51ba5624e87 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:27.592320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3c7f2d1-726f-479f-8933-e51ba5624e87 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:27.625944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-c3c7f2d1-726f-479f-8933-e51ba5624e87 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lazy-loading 'flavor' on Instance uuid 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:13:27.632298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:27.750618 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c3c7f2d1-726f-479f-8933-e51ba5624e87 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "POST /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b/action" status: 202 len: 0 microversion: 2.1 time: 0.172114 Aug 04 14:13:27.751646 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1803/3618] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:13:27 2022] POST /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:13:27.772910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e6d73c7-19a5-4f9a-a644-17a9800d54d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:27.778800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4e6d73c7-19a5-4f9a-a644-17a9800d54d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:27.790871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e6d73c7-19a5-4f9a-a644-17a9800d54d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:27.792082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e6d73c7-19a5-4f9a-a644-17a9800d54d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:27.793162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e6d73c7-19a5-4f9a-a644-17a9800d54d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:27.793847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e6d73c7-19a5-4f9a-a644-17a9800d54d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:29.082703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2ccf987b-34d6-46ff-be4d-d916d00856e8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:29.143061 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ccf987b-34d6-46ff-be4d-d916d00856e8 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1327 microversion: 2.1 time: 1.698058 Aug 04 14:13:29.169854 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1816/3619] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:27 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1327 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:29.259150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e6d73c7-19a5-4f9a-a644-17a9800d54d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:29.291888 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e6d73c7-19a5-4f9a-a644-17a9800d54d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1508 microversion: 2.1 time: 1.520041 Aug 04 14:13:29.293023 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1804/3620] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:27 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1508 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:29.467782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2903f304-c5b8-4b37-8c39-8760345e4d3a req-009eacf5-c314-463d-be4a-bc4cfdb5ab40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:29.497276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2903f304-c5b8-4b37-8c39-8760345e4d3a req-009eacf5-c314-463d-be4a-bc4cfdb5ab40 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:29.505159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2903f304-c5b8-4b37-8c39-8760345e4d3a req-009eacf5-c314-463d-be4a-bc4cfdb5ab40 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:29.560919 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2903f304-c5b8-4b37-8c39-8760345e4d3a req-009eacf5-c314-463d-be4a-bc4cfdb5ab40 service nova] Creating event network-changed:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:13:29.579184 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2903f304-c5b8-4b37-8c39-8760345e4d3a req-009eacf5-c314-463d-be4a-bc4cfdb5ab40 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122164 Aug 04 14:13:29.579829 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1817/3621] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:30.194968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca797630-73eb-4842-a1f9-6f1aafb3b654 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:30.199793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ca797630-73eb-4842-a1f9-6f1aafb3b654 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:30.223503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca797630-73eb-4842-a1f9-6f1aafb3b654 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:30.227486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca797630-73eb-4842-a1f9-6f1aafb3b654 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:30.229129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca797630-73eb-4842-a1f9-6f1aafb3b654 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:30.233878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca797630-73eb-4842-a1f9-6f1aafb3b654 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:30.316159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff0db6b3-19a2-49ca-9121-5b136549858c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:30.317924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff0db6b3-19a2-49ca-9121-5b136549858c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:30.340299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff0db6b3-19a2-49ca-9121-5b136549858c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:30.343606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff0db6b3-19a2-49ca-9121-5b136549858c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:30.350268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff0db6b3-19a2-49ca-9121-5b136549858c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:30.350938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff0db6b3-19a2-49ca-9121-5b136549858c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:32.119932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ca797630-73eb-4842-a1f9-6f1aafb3b654 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:32.134769 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca797630-73eb-4842-a1f9-6f1aafb3b654 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1327 microversion: 2.1 time: 1.957155 Aug 04 14:13:32.137196 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1805/3622] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:30 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1327 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:32.164768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fc5b9c8e-760e-41a6-aaad-41f53a45afa6 req-75755206-e795-4a51-be76-29f56f001a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef", "name": "network-vif-plugged", "status": "completed", "tag": "7fd44b3c-91f8-4cf1-87d3-d94014e65cbb"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:32.184587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fc5b9c8e-760e-41a6-aaad-41f53a45afa6 req-75755206-e795-4a51-be76-29f56f001a1e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:32.189276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fc5b9c8e-760e-41a6-aaad-41f53a45afa6 req-75755206-e795-4a51-be76-29f56f001a1e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:32.223464 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fc5b9c8e-760e-41a6-aaad-41f53a45afa6 req-75755206-e795-4a51-be76-29f56f001a1e service nova] Creating event network-vif-plugged:7fd44b3c-91f8-4cf1-87d3-d94014e65cbb for instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef on n-h2-844627-10 Aug 04 14:13:32.229809 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fc5b9c8e-760e-41a6-aaad-41f53a45afa6 req-75755206-e795-4a51-be76-29f56f001a1e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091077 Aug 04 14:13:32.230434 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1806/3623] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:32.384210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff0db6b3-19a2-49ca-9121-5b136549858c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:32.401207 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff0db6b3-19a2-49ca-9121-5b136549858c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1491 microversion: 2.1 time: 2.089898 Aug 04 14:13:32.402650 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1818/3624] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:30 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1491 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:13:32.425395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3949a52b-4de4-4d8f-8486-368cf957fe50 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:32.425827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3949a52b-4de4-4d8f-8486-368cf957fe50 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:32.435032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3949a52b-4de4-4d8f-8486-368cf957fe50 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:32.435809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3949a52b-4de4-4d8f-8486-368cf957fe50 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:32.436790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3949a52b-4de4-4d8f-8486-368cf957fe50 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:32.437509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3949a52b-4de4-4d8f-8486-368cf957fe50 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:32.472526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3949a52b-4de4-4d8f-8486-368cf957fe50 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:13:32.630362 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3949a52b-4de4-4d8f-8486-368cf957fe50 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 204 len: 0 microversion: 2.1 time: 0.206434 Aug 04 14:13:32.638004 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1807/3625] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:32 2022] DELETE /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:13:32.646990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7753a707-6e45-4bfc-98ff-81e3656e8a1e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:32.647735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7753a707-6e45-4bfc-98ff-81e3656e8a1e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:32.666352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7753a707-6e45-4bfc-98ff-81e3656e8a1e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:32.667033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7753a707-6e45-4bfc-98ff-81e3656e8a1e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:32.668118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7753a707-6e45-4bfc-98ff-81e3656e8a1e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:32.668657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7753a707-6e45-4bfc-98ff-81e3656e8a1e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:33.170187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb9e251f-ffa1-4f0a-9be3-856295d79e09 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:33.173387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb9e251f-ffa1-4f0a-9be3-856295d79e09 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:33.183374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb9e251f-ffa1-4f0a-9be3-856295d79e09 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:33.184523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb9e251f-ffa1-4f0a-9be3-856295d79e09 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:33.185674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb9e251f-ffa1-4f0a-9be3-856295d79e09 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:33.186348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb9e251f-ffa1-4f0a-9be3-856295d79e09 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:33.404465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7753a707-6e45-4bfc-98ff-81e3656e8a1e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:33.431677 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7753a707-6e45-4bfc-98ff-81e3656e8a1e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1497 microversion: 2.1 time: 0.792690 Aug 04 14:13:33.443705 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1819/3626] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:32 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1497 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:33.709512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cb9e251f-ffa1-4f0a-9be3-856295d79e09 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:33.733379 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb9e251f-ffa1-4f0a-9be3-856295d79e09 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1327 microversion: 2.1 time: 0.580458 Aug 04 14:13:33.734515 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1808/3627] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:33 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1327 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:13:34.475124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ec76bb7c-57b4-49de-9eba-67bf9d832a19 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:34.480815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ec76bb7c-57b4-49de-9eba-67bf9d832a19 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:34.523123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec76bb7c-57b4-49de-9eba-67bf9d832a19 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:34.524160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec76bb7c-57b4-49de-9eba-67bf9d832a19 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:34.532578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec76bb7c-57b4-49de-9eba-67bf9d832a19 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:34.533652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec76bb7c-57b4-49de-9eba-67bf9d832a19 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:34.762399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-26ffb82c-df32-4228-a5f4-da8323f9e6b5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:34.763498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-26ffb82c-df32-4228-a5f4-da8323f9e6b5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:34.788494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26ffb82c-df32-4228-a5f4-da8323f9e6b5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:34.791178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26ffb82c-df32-4228-a5f4-da8323f9e6b5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:34.794531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26ffb82c-df32-4228-a5f4-da8323f9e6b5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:34.798477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26ffb82c-df32-4228-a5f4-da8323f9e6b5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:35.853205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-26ffb82c-df32-4228-a5f4-da8323f9e6b5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:35.861395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ec76bb7c-57b4-49de-9eba-67bf9d832a19 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f701d08c0741df9ad1375bd0712a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1accf1d5aaf140bab7626c5a04941d84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:35.873190 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-26ffb82c-df32-4228-a5f4-da8323f9e6b5 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1327 microversion: 2.1 time: 1.118972 Aug 04 14:13:35.875617 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1809/3628] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:34 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1327 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:13:35.895461 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ec76bb7c-57b4-49de-9eba-67bf9d832a19 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 200 len: 1497 microversion: 2.1 time: 1.430340 Aug 04 14:13:35.899050 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1820/3629] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:34 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 1497 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:36.280833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5fca8fdf-8f4d-4516-a545-4472ab6d39c6 req-3dbe3359-c049-4c7c-a38c-be25f2e3ea38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e19bc0e-734c-4fb6-8b4f-874e5ba2183b", "name": "network-vif-deleted", "tag": "a7f5c08e-3867-4c36-998e-e4ed994416bf"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:36.318300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5fca8fdf-8f4d-4516-a545-4472ab6d39c6 req-3dbe3359-c049-4c7c-a38c-be25f2e3ea38 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:36.319572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5fca8fdf-8f4d-4516-a545-4472ab6d39c6 req-3dbe3359-c049-4c7c-a38c-be25f2e3ea38 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:36.344683 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5fca8fdf-8f4d-4516-a545-4472ab6d39c6 req-3dbe3359-c049-4c7c-a38c-be25f2e3ea38 service nova] Creating event network-vif-deleted:a7f5c08e-3867-4c36-998e-e4ed994416bf for instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b on n-h2-844627-10 Aug 04 14:13:36.361929 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5fca8fdf-8f4d-4516-a545-4472ab6d39c6 req-3dbe3359-c049-4c7c-a38c-be25f2e3ea38 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085348 Aug 04 14:13:36.369326 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1810/3630] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:13:36.909098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-40837ff1-20b2-4b6f-abb2-842551bb5967 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:36.911932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-40837ff1-20b2-4b6f-abb2-842551bb5967 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:36.923844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:36.924698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:36.938108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40837ff1-20b2-4b6f-abb2-842551bb5967 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:36.940430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40837ff1-20b2-4b6f-abb2-842551bb5967 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:36.942352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40837ff1-20b2-4b6f-abb2-842551bb5967 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:36.943460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40837ff1-20b2-4b6f-abb2-842551bb5967 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:36.944041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:36.944807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:36.945879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:36.946536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:36.985906 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b HTTP/1.1 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7e19bc0e-734c-4fb6-8b4f-874e5ba2183b'} Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:36.995053 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.001453 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.001453 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.001453 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.001453 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.001453 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.001453 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.001453 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.001453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.001453 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be7d3f0f-2d52-4557-9d72-0cc3eb5ee420 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 404 len: 111 microversion: 2.1 time: 0.078749 Aug 04 14:13:37.009345 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1811/3631] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:36 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:13:37.021829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.022353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.038789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.039301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.040403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.040968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.102616 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b HTTP/1.1 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7e19bc0e-734c-4fb6-8b4f-874e5ba2183b'} Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.107142 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.116970 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.121533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.123135 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eb2c8e02-af79-4f31-9292-75b2db7f886e tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 404 len: 111 microversion: 2.1 time: 0.106302 Aug 04 14:13:37.130099 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1812/3632] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:37 2022] DELETE /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:13:37.144192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.146216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.164519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.165688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.167763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.168983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.228577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:37.238835 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b HTTP/1.1 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7e19bc0e-734c-4fb6-8b4f-874e5ba2183b'} Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.246419 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 7e19bc0e-734c-4fb6-8b4f-874e5ba2183b could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f2819dec-09a9-4af3-a969-ccc706002121 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b" status: 404 len: 111 microversion: 2.1 time: 0.114980 Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1813/3633] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:37 2022] GET /compute/v2.1/servers/7e19bc0e-734c-4fb6-8b4f-874e5ba2183b => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:37.261966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.267641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.284988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.285400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.297433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.298038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.326804 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d HTTP/1.1 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d'} Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.328652 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1865a62b-53a0-424e-a120-2360f9c4486c tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 404 len: 111 microversion: 2.1 time: 0.073938 Aug 04 14:13:37.337137 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1814/3634] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:37 2022] DELETE /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:37.351868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.352562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.373204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.373754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.375164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.375641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.490813 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d HTTP/1.1 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d'} Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.496996 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.510717 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.510717 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.510717 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.510717 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.510717 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.510717 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. Aug 04 14:13:37.510717 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.510717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.516096 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf892672-d0b9-4504-8d17-ccca079d5db5 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d" status: 404 len: 111 microversion: 2.1 time: 0.178506 Aug 04 14:13:37.525595 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1815/3635] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:37 2022] GET /compute/v2.1/servers/5a9ac516-e6c6-4e0f-a4bf-d40b9f09f50d => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:37.539665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.540563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.561095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.562068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.564485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.566587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.594574 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a HTTP/1.1 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'da5cabc6-32b3-4ac9-a320-a293f5d8c27a'} Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.596268 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-134d143e-d519-4601-bc75-86262a535758 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 404 len: 111 microversion: 2.1 time: 0.068605 Aug 04 14:13:37.609120 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1816/3636] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:37 2022] DELETE /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:37.622457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.623084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: da5cabc6-32b3-4ac9-a320-a293f5d8c27a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.634239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.634946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.635779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.636216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.678847 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a HTTP/1.1 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'da5cabc6-32b3-4ac9-a320-a293f5d8c27a'} Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.681042 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance da5cabc6-32b3-4ac9-a320-a293f5d8c27a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa0d0e0c-96b1-4bec-9e3c-381164864adf tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a" status: 404 len: 111 microversion: 2.1 time: 0.065386 Aug 04 14:13:37.694703 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1817/3637] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:37 2022] GET /compute/v2.1/servers/da5cabc6-32b3-4ac9-a320-a293f5d8c27a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:13:37.700695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.701340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.711008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.711523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.712519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.712995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.731076 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d HTTP/1.1 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '0ef3141f-bcba-44bc-9f99-819598f48b0d'} Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.733052 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.738825 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.741339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.742448 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-214aae8f-8710-4dc0-b9f9-9feee015bde1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 404 len: 111 microversion: 2.1 time: 0.053284 Aug 04 14:13:37.746982 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1818/3638] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:37 2022] DELETE /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:37.755575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.756773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 0ef3141f-bcba-44bc-9f99-819598f48b0d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.759805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:37.770619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.772321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.773405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-40837ff1-20b2-4b6f-abb2-842551bb5967 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:37.773609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.775121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.788637 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-40837ff1-20b2-4b6f-abb2-842551bb5967 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1528 microversion: 2.1 time: 0.891649 Aug 04 14:13:37.789473 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1821/3639] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:36 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1528 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:37.805013 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d HTTP/1.1 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '0ef3141f-bcba-44bc-9f99-819598f48b0d'} Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.814393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.820445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.820445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.820445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.820445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.820445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.820445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. Aug 04 14:13:37.820445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.822346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fba09336-ce03-462f-a333-9ce07c25d867 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.823452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 0ef3141f-bcba-44bc-9f99-819598f48b0d could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.824589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fba09336-ce03-462f-a333-9ce07c25d867 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.825803 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ad8e963f-deb5-46f1-88bb-654e80b1d6d4 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d" status: 404 len: 111 microversion: 2.1 time: 0.076280 Aug 04 14:13:37.827007 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1819/3640] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:37 2022] GET /compute/v2.1/servers/0ef3141f-bcba-44bc-9f99-819598f48b0d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:37.840075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.844116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.844938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fba09336-ce03-462f-a333-9ce07c25d867 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.846259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fba09336-ce03-462f-a333-9ce07c25d867 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.848731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fba09336-ce03-462f-a333-9ce07c25d867 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.850393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fba09336-ce03-462f-a333-9ce07c25d867 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.860257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.862212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.863385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.864701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.899052 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb HTTP/1.1 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '45e302fd-fd35-4511-94b2-72c885adeeeb'} Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.903362 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:37.911314 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.914868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:37.915778 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-74ce580d-69d9-422d-b36e-825ec08a5a11 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 404 len: 111 microversion: 2.1 time: 0.081982 Aug 04 14:13:37.920608 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1820/3641] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:37 2022] DELETE /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:13:37.934494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:37.935208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 45e302fd-fd35-4511-94b2-72c885adeeeb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:37.955690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.956149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.956975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:37.957490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:37.991872 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb HTTP/1.1 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '45e302fd-fd35-4511-94b2-72c885adeeeb'} Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:37.996216 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:38.001998 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:38.001998 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:38.001998 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:38.001998 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:38.001998 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:38.001998 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. Aug 04 14:13:38.001998 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:38.006423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 45e302fd-fd35-4511-94b2-72c885adeeeb could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:38.007603 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-da2745d5-d4c5-4bd8-8e46-303a1c341733 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb" status: 404 len: 111 microversion: 2.1 time: 0.082088 Aug 04 14:13:38.015963 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1821/3642] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:37 2022] GET /compute/v2.1/servers/45e302fd-fd35-4511-94b2-72c885adeeeb => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:38.640432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fba09336-ce03-462f-a333-9ce07c25d867 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:38.675479 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fba09336-ce03-462f-a333-9ce07c25d867 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1528 microversion: 2.1 time: 0.867398 Aug 04 14:13:38.680819 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1822/3643] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:37 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1528 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:13:39.322919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:39.324278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:39.334027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:39.336627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:39.338055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:39.339358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:39.361763 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] HTTP exception thrown: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Request method failure captured: Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef HTTP/1.1 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69P4gzsiD9i2ikjy8cGxISRvCT268jiyW1i4B4SCuGGVhQAny2papbmxb_eT-0Pb4CQoHBR2tXHNoAmUwmSdNTs0gNLaumFGFcEp5rlN-0kvgK5XKxRMaOslGxzjclW4lVqXyjIhdrRN2DfG-ZHWk46t_A91vbq669CEpdAAsjWjuNo Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 0fd56ab76b034d1b878a288fa47ca286 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1859186726 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0fd56ab76b034d1b878a288fa47ca286"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0fd56ab76b034d1b878a288fa47ca286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0fd56ab76b034d1b878a288fa47ca286"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0fd56ab76b034d1b878a288fa47ca286"}]}] Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1859186726 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 0fd56ab76b034d1b878a288fa47ca286 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1859186726 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1859186726-project Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: fe58cbfd87514436abaf4d1fee47ef19 Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1859186726-project Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef'} Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:39.364417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:39.370152 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:39.373226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Returning 404 to user: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:39.374603 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d9dd5e5c-9ae6-416f-8e31-0fef51fc82a2 tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 404 len: 111 microversion: 2.1 time: 0.655954 Aug 04 14:13:39.375791 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1822/3644] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:38 2022] DELETE /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 111 bytes in 658 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:39.388474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-625fdb3d-af8c-4d07-a6fa-e0cebf09b4f1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:39.389311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-625fdb3d-af8c-4d07-a6fa-e0cebf09b4f1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:39.409308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-625fdb3d-af8c-4d07-a6fa-e0cebf09b4f1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:39.409667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-625fdb3d-af8c-4d07-a6fa-e0cebf09b4f1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:39.410413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-625fdb3d-af8c-4d07-a6fa-e0cebf09b4f1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:39.410861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-625fdb3d-af8c-4d07-a6fa-e0cebf09b4f1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:40.345475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-625fdb3d-af8c-4d07-a6fa-e0cebf09b4f1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:40.381641 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-625fdb3d-af8c-4d07-a6fa-e0cebf09b4f1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1528 microversion: 2.1 time: 0.996241 Aug 04 14:13:40.382678 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1823/3645] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:39 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1528 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:40.423776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Action: 'update', calling method: >, body: {"server": {"name": "4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef_new"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:40.431874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:40.467138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:40.468970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:40.470875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:40.475419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:40.540665 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] HTTP exception thrown: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Request method failure captured: Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: request: PUT /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef HTTP/1.1 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 64 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69P4gzsiD9i2ikjy8cGxISRvCT268jiyW1i4B4SCuGGVhQAny2papbmxb_eT-0Pb4CQoHBR2tXHNoAmUwmSdNTs0gNLaumFGFcEp5rlN-0kvgK5XKxRMaOslGxzjclW4lVqXyjIhdrRN2DfG-ZHWk46t_A91vbq669CEpdAAsjWjuNo Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 0fd56ab76b034d1b878a288fa47ca286 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1859186726 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0fd56ab76b034d1b878a288fa47ca286"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0fd56ab76b034d1b878a288fa47ca286"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0fd56ab76b034d1b878a288fa47ca286"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0fd56ab76b034d1b878a288fa47ca286"}]}] Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1859186726 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 0fd56ab76b034d1b878a288fa47ca286 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1859186726 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1859186726-project Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: fe58cbfd87514436abaf4d1fee47ef19 Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1859186726-project Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef_new"}} Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef', 'body': {'server': {'name': '4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef_new'}}} Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:13:40.544250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] Returning 404 to user: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:40.550257 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-38cc3658-f536-49c2-b8d8-634904198c8a tempest-ServersNegativeTestMultiTenantJSON-1859186726 tempest-ServersNegativeTestMultiTenantJSON-1859186726-project] 10.222.0.66 "PUT /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 404 len: 111 microversion: 2.1 time: 0.131652 Aug 04 14:13:40.565970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-72f3fd0e-c2c3-4475-befb-25f0b53e8af3 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:40.566897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-72f3fd0e-c2c3-4475-befb-25f0b53e8af3 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:40.569371 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1823/3646] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:13:40 2022] PUT /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:40.587618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72f3fd0e-c2c3-4475-befb-25f0b53e8af3 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:40.588393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72f3fd0e-c2c3-4475-befb-25f0b53e8af3 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:40.589797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72f3fd0e-c2c3-4475-befb-25f0b53e8af3 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:40.590754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72f3fd0e-c2c3-4475-befb-25f0b53e8af3 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:40.669847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-72f3fd0e-c2c3-4475-befb-25f0b53e8af3 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:13:40.927898 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-72f3fd0e-c2c3-4475-befb-25f0b53e8af3 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 204 len: 0 microversion: 2.1 time: 0.367566 Aug 04 14:13:40.928994 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1824/3647] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:40 2022] DELETE /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:13:40.946392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd8e0397-05db-4756-ac07-6914537bac74 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:40.948414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd8e0397-05db-4756-ac07-6914537bac74 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:41.011640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd8e0397-05db-4756-ac07-6914537bac74 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:41.013025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd8e0397-05db-4756-ac07-6914537bac74 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:41.017070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd8e0397-05db-4756-ac07-6914537bac74 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:41.018600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd8e0397-05db-4756-ac07-6914537bac74 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:41.509906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5164eccf-cc52-498b-83a6-c56e82a0de9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'create', calling method: .version_select at 0x7f46f31aeee0>, body: {"keypair": {"name": "tempest-keypair-1190541258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPQMDgr9pj9PX5WvUbIFjXYzhf5Vb9Dfnz/Dbo7b9le8e0t283+BC+kXyBC8EU8bweSKsrseBnc5XcDLhkrMz4ubWri8aqYtSjs6dQScOjUG/90k7INaPzChmPKayB/Ig=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:41.543779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5164eccf-cc52-498b-83a6-c56e82a0de9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Getting quotas for project dd3c60073acc4679bbf967680287239e. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:13:41.552099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5164eccf-cc52-498b-83a6-c56e82a0de9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Getting quotas for user be1de13158f1415e9fc93ab6fcf28b30 and project dd3c60073acc4679bbf967680287239e. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:13:41.586525 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5164eccf-cc52-498b-83a6-c56e82a0de9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.191751 Aug 04 14:13:41.587830 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1825/3648] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 14:13:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 04 14:13:41.798052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fd8e0397-05db-4756-ac07-6914537bac74 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:41.810102 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd8e0397-05db-4756-ac07-6914537bac74 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1534 microversion: 2.1 time: 0.874355 Aug 04 14:13:41.811665 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1824/3649] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:40 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1534 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:42.836407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-584f0882-254a-4f22-acca-0079a2d9f9d1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:42.838189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-584f0882-254a-4f22-acca-0079a2d9f9d1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:42.853596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-584f0882-254a-4f22-acca-0079a2d9f9d1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:42.854446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-584f0882-254a-4f22-acca-0079a2d9f9d1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:42.855825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-584f0882-254a-4f22-acca-0079a2d9f9d1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:42.856527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-584f0882-254a-4f22-acca-0079a2d9f9d1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:44.201711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-584f0882-254a-4f22-acca-0079a2d9f9d1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:44.217477 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-584f0882-254a-4f22-acca-0079a2d9f9d1 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1534 microversion: 2.1 time: 1.386716 Aug 04 14:13:44.229517 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1826/3650] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:42 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1534 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:44.759471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e9c9d53-2971-47c2-94ff-5b2dfcccafea tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Action: 'create', calling method: .version_select at 0x7f47007cd3a0>, body: {"keypair": {"name": "tempest-keypair-828973960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQIAasQv4V3Jz0S1ZBTVpZdIBQFa8tZfRlPegmRioG2sUsAv3OnnMnvjKILGSiiMSaX2mCwlOSCjjpfMwywtmcVvWu4hHCBpfVHvG/WG6gmxNCjfsoqI3MNHQ1R07jxKw=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:44.800107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8e9c9d53-2971-47c2-94ff-5b2dfcccafea tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Getting quotas for project c99a5688f72e43d0be0f0b8e175344b0. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:13:44.821526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8e9c9d53-2971-47c2-94ff-5b2dfcccafea tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Getting quotas for user a8f7ab6120c547b592479d79344d6850 and project c99a5688f72e43d0be0f0b8e175344b0. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:13:44.875377 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e9c9d53-2971-47c2-94ff-5b2dfcccafea tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.119392 Aug 04 14:13:44.878773 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1825/3651] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 14:13:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 14:13:45.017367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:45.017875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:45.040212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.041445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.043566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.047286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.108775 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 HTTP/1.1 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'dc944906-6a27-4575-acca-c7d686fd5c17'} Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:45.117939 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.123699 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.130462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:45.131561 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2d66ccb5-1253-4307-8ee6-ed6b441333c1 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 404 len: 111 microversion: 2.1 time: 0.119283 Aug 04 14:13:45.133833 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1827/3652] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:45 2022] DELETE /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:45.166589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:45.168502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: dc944906-6a27-4575-acca-c7d686fd5c17] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:45.188166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.189311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.190369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.191009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.211789 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 HTTP/1.1 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dc944906-6a27-4575-acca-c7d686fd5c17'} Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:45.214751 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.219630 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.219630 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:45.219630 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:45.219630 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:45.219630 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:45.219630 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. Aug 04 14:13:45.219630 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.222927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance dc944906-6a27-4575-acca-c7d686fd5c17 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:45.224189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-001a7c5e-adf5-4f8a-a138-6a7ba847f6c9 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17" status: 404 len: 111 microversion: 2.1 time: 0.084370 Aug 04 14:13:45.228331 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1826/3653] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:45 2022] GET /compute/v2.1/servers/dc944906-6a27-4575-acca-c7d686fd5c17 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:13:45.240566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:45.241529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:45.253571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4ab90d0-2fb6-439d-8f4b-d28f33537f8f tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:45.256791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.257648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.260162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.260848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b4ab90d0-2fb6-439d-8f4b-d28f33537f8f tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:45.261130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.289909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4ab90d0-2fb6-439d-8f4b-d28f33537f8f tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.290830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4ab90d0-2fb6-439d-8f4b-d28f33537f8f tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.294207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4ab90d0-2fb6-439d-8f4b-d28f33537f8f tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.295575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4ab90d0-2fb6-439d-8f4b-d28f33537f8f tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.398591 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 HTTP/1.1 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9dedb436-cd86-49c7-9a23-933ab3829812'} Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:45.417760 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.428307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:45.432327 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc370616-b003-42f3-a3fc-07e102f63212 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 404 len: 111 microversion: 2.1 time: 0.199011 Aug 04 14:13:45.438022 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1828/3654] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:13:45 2022] DELETE /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:45.462354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:45.466458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] [instance: 9dedb436-cd86-49c7-9a23-933ab3829812] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:45.537397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.545784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.550772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:45.551834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:45.657848 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] HTTP exception thrown: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Request method failure captured: Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 HTTP/1.1 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69JotWUmAjD4KlIkB7EokappAoPHZnz6N-NRBTNXtwS2uMKiofZoUTw4pbQXPeyK7ickachWogtyOMiy0ex5jBG0rNMgcylcPVJQaJbHCmOQYIgOKCPg4Q5U1RoFgxYxcwH7NHmpRUn4_oVXWYJid_fy-L9d1UZcB9mGs2_T1WF-Bz0 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1accf1d5aaf140bab7626c5a04941d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1accf1d5aaf140bab7626c5a04941d84"}]}] Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 1accf1d5aaf140bab7626c5a04941d84 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-DeleteServersTestJSON-1715695612 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d6f701d08c0741df9ad1375bd0712a59 Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-DeleteServersTestJSON-1715695612-project Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9dedb436-cd86-49c7-9a23-933ab3829812'} Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:45.666284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.671197 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:45.671197 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:45.671197 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:45.671197 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:45.671197 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:45.671197 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. Aug 04 14:13:45.671197 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:45.675776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] Returning 404 to user: Instance 9dedb436-cd86-49c7-9a23-933ab3829812 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:45.683973 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-15f8543b-83ba-435b-91fa-b1e0cb0283f3 tempest-DeleteServersTestJSON-1715695612 tempest-DeleteServersTestJSON-1715695612-project] 10.222.0.66 "GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812" status: 404 len: 111 microversion: 2.1 time: 0.234254 Aug 04 14:13:45.688424 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1829/3655] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:45 2022] GET /compute/v2.1/servers/9dedb436-cd86-49c7-9a23-933ab3829812 => generated 111 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:47.054566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4ab90d0-2fb6-439d-8f4b-d28f33537f8f tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:47.069589 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4ab90d0-2fb6-439d-8f4b-d28f33537f8f tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1534 microversion: 2.1 time: 1.829737 Aug 04 14:13:47.070991 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1827/3656] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:45 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1534 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:47.461888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6ae95ee9-50ed-470f-b581-a9456896ade0 req-5fd1127f-e6b1-4125-9175-9dddaa25a2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef", "name": "network-vif-deleted", "tag": "7fd44b3c-91f8-4cf1-87d3-d94014e65cbb"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:47.497916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6ae95ee9-50ed-470f-b581-a9456896ade0 req-5fd1127f-e6b1-4125-9175-9dddaa25a2cd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:47.498679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6ae95ee9-50ed-470f-b581-a9456896ade0 req-5fd1127f-e6b1-4125-9175-9dddaa25a2cd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:47.559259 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6ae95ee9-50ed-470f-b581-a9456896ade0 req-5fd1127f-e6b1-4125-9175-9dddaa25a2cd service nova] Creating event network-vif-deleted:7fd44b3c-91f8-4cf1-87d3-d94014e65cbb for instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef on n-h2-844627-10 Aug 04 14:13:47.575162 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6ae95ee9-50ed-470f-b581-a9456896ade0 req-5fd1127f-e6b1-4125-9175-9dddaa25a2cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120255 Aug 04 14:13:47.587578 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1830/3657] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:13:48.093076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:48.095926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:48.129600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:48.133865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:48.138562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:48.139027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:48.248346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:48.249218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:48.250063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lazy-loading 'fault' on Instance uuid 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:13:48.642357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b51276088a44f8a851b433430a7487c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccabacc4068b41debabd3184f28aec4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:48.654940 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a621779-c23d-47a0-b584-c8b658435d56 tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 200 len: 1317 microversion: 2.1 time: 0.566318 Aug 04 14:13:48.655701 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1828/3658] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:48 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:13:49.687078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:49.688010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] [instance: 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:49.741047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:49.742901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:49.747720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:49.755727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:49.824255 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] HTTP exception thrown: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Request method failure captured: Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef HTTP/1.1 Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Pbdh-eRj5oaRJ_NjFFMJyr1v7zkBmm93KeePziVPclYaxvf7pACOVdSvm1lop3288uBZB_-mW10DZZ-o_egoFu3wWSUbRqtJSGgXbnZqb08AkLCjCf1LV77Oxdx2M1Ic2-5ra9AwcbmAtp8x5oIS41Xp8T2dqrKt3swbw87ti8H2Y Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: ccabacc4068b41debabd3184f28aec4d Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-498537309 Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccabacc4068b41debabd3184f28aec4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ccabacc4068b41debabd3184f28aec4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ccabacc4068b41debabd3184f28aec4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ccabacc4068b41debabd3184f28aec4d"}]}] Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-498537309 Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: ccabacc4068b41debabd3184f28aec4d Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-498537309 Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestMultiTenantJSON-498537309-project Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 9b51276088a44f8a851b433430a7487c Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-498537309-project Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef'} Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:49.830848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] Returning 404 to user: Instance 4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:13:49.836346 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-21c82ad2-4620-4c72-b986-0e47759a3cba tempest-ServersNegativeTestMultiTenantJSON-498537309 tempest-ServersNegativeTestMultiTenantJSON-498537309-project] 10.222.0.66 "GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef" status: 404 len: 111 microversion: 2.1 time: 0.155332 Aug 04 14:13:49.837917 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1831/3659] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:49 2022] GET /compute/v2.1/servers/4391e9c6-edbb-4b81-b4fc-8fe5a0c477ef => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:13:51.541178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-266004776", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "221ce427-a2e0-4876-a7d7-372ae236e973"}], "security_groups": [{"name": "tempest-securitygroup--805297794"}], "key_name": "tempest-keypair-1190541258", "user_data": "}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:52.021195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] validate_networks() for [('221ce427-a2e0-4876-a7d7-372ae236e973', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:13:53.063568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:13:53.066420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:13:53.070216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:13:53.071186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:13:53.071933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:13:53.102436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:53.103401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:53.105332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:53.106099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:53.136849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Getting quotas for project dd3c60073acc4679bbf967680287239e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:13:53.154326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Getting quotas for user be1de13158f1415e9fc93ab6fcf28b30 and project dd3c60073acc4679bbf967680287239e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:13:53.182804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:13:53.186430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:13:53.265494 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4c2881bc-a448-46ab-8fbc-3a62736ba71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.739266 Aug 04 14:13:53.267030 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1829/3660] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:13:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:13:53.282544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82882716-0b0e-4066-ba7d-879c68ff0947 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:53.283598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-82882716-0b0e-4066-ba7d-879c68ff0947 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:53.304816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:53.307335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:53.497510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82882716-0b0e-4066-ba7d-879c68ff0947 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:53.534425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82882716-0b0e-4066-ba7d-879c68ff0947 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:53.537831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82882716-0b0e-4066-ba7d-879c68ff0947 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:53.541250 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-82882716-0b0e-4066-ba7d-879c68ff0947 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1281 microversion: 2.20 time: 0.266714 Aug 04 14:13:53.543696 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1832/3661] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:13:53 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:13:54.574625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0bde753f-f284-4779-badd-82e1fd5ea7b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:54.575480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0bde753f-f284-4779-badd-82e1fd5ea7b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:54.824998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0bde753f-f284-4779-badd-82e1fd5ea7b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:54.850225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0bde753f-f284-4779-badd-82e1fd5ea7b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:54.857098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0bde753f-f284-4779-badd-82e1fd5ea7b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:54.861980 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0bde753f-f284-4779-badd-82e1fd5ea7b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1281 microversion: 2.20 time: 0.291908 Aug 04 14:13:54.864354 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1830/3662] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:13:54 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1281 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:13:55.053956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1575463473", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "038577a6-d597-470a-a639-cb9845cadaa5"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:55.185008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] validate_networks() for [('038577a6-d597-470a-a639-cb9845cadaa5', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:13:55.913613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:55.916775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:55.948676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:55.952445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:55.960194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:55.961560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:56.221758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:56.238455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:56.242631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:56.247373 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a6d035ed-d758-4f2a-90ad-d618b40201e7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1351 microversion: 2.20 time: 0.340538 Aug 04 14:13:56.248889 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1831/3663] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:13:55 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1351 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:13:56.986004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-508134545", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8cadc3f9-fcd2-4fcc-8379-706a5f60d0a8"}, {"port": "cf3dc4f5-e181-4296-845f-3b9c2c178bba", "tag": "port-1"}, {"port": "181b4200-6b0b-4cc8-9f01-1313569bebe5", "tag": "port-2"}, {"uuid": "f8e3d29c-10bc-4910-a87d-ee9281307e56", "tag": "net-1"}, {"uuid": "f8e3d29c-10bc-4910-a87d-ee9281307e56"}, {"uuid": "7831a09f-ee32-4b8c-b730-d2beb5640527", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7831a09f-ee32-4b8c-b730-d2beb5640527", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7369290f-6018-44e3-930d-922490613a58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d3a0d080-ee76-40a3-9ed7-7e70fb92e821", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4963a019-b7c3-42b2-88a0-94541d22c45c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1758795940"}], "key_name": "tempest-keypair-828973960", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:13:58.141384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] validate_networks() for [('8cadc3f9-fcd2-4fcc-8379-706a5f60d0a8', None, None, None, None, None), (None, None, 'cf3dc4f5-e181-4296-845f-3b9c2c178bba', None, None, None), (None, None, '181b4200-6b0b-4cc8-9f01-1313569bebe5', None, None, None), ('f8e3d29c-10bc-4910-a87d-ee9281307e56', None, None, None, None, None), ('f8e3d29c-10bc-4910-a87d-ee9281307e56', None, None, None, None, None), ('7831a09f-ee32-4b8c-b730-d2beb5640527', '10.2.2.100', None, None, None, None), ('7831a09f-ee32-4b8c-b730-d2beb5640527', '10.2.2.200', None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:13:58.216475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:13:58.218196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:13:58.219248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:13:58.220256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:13:58.221279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:13:58.241886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:58.254177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:58.256082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:58.257136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:58.284500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:13:58.341409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Getting quotas for project 0904b55b94c5408ca3bc08b4653301f3. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:13:58.386526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Getting quotas for user 07dd715cfad74341a2aa0bf9ca4c0d00 and project 0904b55b94c5408ca3bc08b4653301f3. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:13:58.463323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Going to run 2 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:13:58.469454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: cb5ee693-830c-431f-aad3-8f355f421370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:13:58.615903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=cb5ee693-830c-431f-aad3-8f355f421370,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:13:58.821015 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f8cf7653-1541-47e7-b1df-34c88e2e87b3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.933667 Aug 04 14:13:58.835526 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1833/3664] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:13:58.845294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:58.847011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:58.866720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:58.871209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:58.878367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:58.879578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:59.200774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:59.227547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:59.238155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:59.241024 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2083499a-cc5c-4b4f-8945-0cfe46324c39 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1339 microversion: 2.20 time: 0.402976 Aug 04 14:13:59.243528 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1834/3665] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:13:58 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1339 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:13:59.268001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-311c0308-c592-4ef8-8a81-06b2fb56698b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:59.275858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-311c0308-c592-4ef8-8a81-06b2fb56698b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:59.276768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-311c0308-c592-4ef8-8a81-06b2fb56698b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Searching by: {'deleted': False, 'project_id': '0904b55b94c5408ca3bc08b4653301f3'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:13:59.346275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-311c0308-c592-4ef8-8a81-06b2fb56698b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:59.348025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-311c0308-c592-4ef8-8a81-06b2fb56698b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:59.352619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-311c0308-c592-4ef8-8a81-06b2fb56698b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:13:59.354602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-311c0308-c592-4ef8-8a81-06b2fb56698b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:13:59.422769 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-311c0308-c592-4ef8-8a81-06b2fb56698b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.161443 Aug 04 14:13:59.424717 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1835/3666] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:13:59 2022] GET /compute/v2.1/servers => generated 677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:13:59.455081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-67c70500-1c4a-4509-a074-aed41f3e8b01 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:13:59.456579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-67c70500-1c4a-4509-a074-aed41f3e8b01 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:13:59.681715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67c70500-1c4a-4509-a074-aed41f3e8b01 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:13:59.696379 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-67c70500-1c4a-4509-a074-aed41f3e8b01 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1220 microversion: 2.1 time: 0.252164 Aug 04 14:13:59.698018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1836/3667] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:13:59 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1220 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:00.271510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:00.272520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:00.299326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:00.299872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:00.300717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:00.301200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:01.203549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:01.267794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:01.286039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:01.288676 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-534cc909-3028-4e5b-8799-92fa40e3c9c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1339 microversion: 2.20 time: 1.021188 Aug 04 14:14:01.293541 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1837/3668] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:00 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1339 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:01.313236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-37b4459b-7580-4163-a591-7d7e3bb28f94 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:01.314367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-37b4459b-7580-4163-a591-7d7e3bb28f94 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:01.335361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37b4459b-7580-4163-a591-7d7e3bb28f94 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:01.338536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37b4459b-7580-4163-a591-7d7e3bb28f94 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:01.339950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37b4459b-7580-4163-a591-7d7e3bb28f94 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:01.342126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37b4459b-7580-4163-a591-7d7e3bb28f94 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:01.661732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-37b4459b-7580-4163-a591-7d7e3bb28f94 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:01.677700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-37b4459b-7580-4163-a591-7d7e3bb28f94 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1216 microversion: 2.1 time: 0.377914 Aug 04 14:14:01.678657 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1838/3669] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:01 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1216 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:02.341112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:02.342191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:02.362731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:02.365011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:02.365880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:02.366325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:02.962595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:02.972946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:02.974706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:02.982153 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c78b5923-8566-4f6d-9497-820890c91888 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 0.647481 Aug 04 14:14:02.987693 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1839/3670] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:02 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:02.993078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a8eac031-b9a8-49f6-a474-a02ffb310955 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:03.001486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a8eac031-b9a8-49f6-a474-a02ffb310955 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:03.031260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8eac031-b9a8-49f6-a474-a02ffb310955 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:03.031729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8eac031-b9a8-49f6-a474-a02ffb310955 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:03.032898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8eac031-b9a8-49f6-a474-a02ffb310955 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:03.033638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8eac031-b9a8-49f6-a474-a02ffb310955 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:03.121419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:03.171065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a8eac031-b9a8-49f6-a474-a02ffb310955 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:03.188199 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a8eac031-b9a8-49f6-a474-a02ffb310955 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1278 microversion: 2.1 time: 0.199010 Aug 04 14:14:03.189569 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1840/3671] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:02 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:04.035380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:04.036750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:04.050613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:04.051462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:04.052964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:04.053852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:04.691920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:04.708893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:04.712467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:04.715409 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f66c76e0-6c04-43df-a5bd-96aa292e4eea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 0.686681 Aug 04 14:14:04.717128 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1841/3672] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:04 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:04.727430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-05ae675c-8497-4022-9273-71e945b9601d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:04.729232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-05ae675c-8497-4022-9273-71e945b9601d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:04.744218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05ae675c-8497-4022-9273-71e945b9601d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:04.745525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05ae675c-8497-4022-9273-71e945b9601d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:04.747016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05ae675c-8497-4022-9273-71e945b9601d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:04.748199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05ae675c-8497-4022-9273-71e945b9601d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:04.834378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:04.902915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-05ae675c-8497-4022-9273-71e945b9601d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:04.920417 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-05ae675c-8497-4022-9273-71e945b9601d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1278 microversion: 2.1 time: 0.200815 Aug 04 14:14:04.923427 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1842/3673] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:04 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:05.746807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:05.747975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:05.773540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:05.775085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:05.779934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:05.783811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:06.234956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=50 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:07.676557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:07.707550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:07.712323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:07.738060 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-35dc198c-778c-4f69-9e0f-9885b05b12de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 1.996627 Aug 04 14:14:07.755154 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1843/3674] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:05 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:07.781503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3268c2a4-1763-423e-9685-222d04b9a9ce tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:07.783062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3268c2a4-1763-423e-9685-222d04b9a9ce tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:07.798992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3268c2a4-1763-423e-9685-222d04b9a9ce tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:07.799756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3268c2a4-1763-423e-9685-222d04b9a9ce tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:07.802544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3268c2a4-1763-423e-9685-222d04b9a9ce tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:07.803625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3268c2a4-1763-423e-9685-222d04b9a9ce tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:08.811575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3268c2a4-1763-423e-9685-222d04b9a9ce tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:08.832384 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3268c2a4-1763-423e-9685-222d04b9a9ce tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1320 microversion: 2.1 time: 1.074980 Aug 04 14:14:08.833710 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1844/3675] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:07 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1320 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:08.853404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-26c384ca-7988-41fc-8609-66c7b2e1df10 req-1a12ed34-adb1-4cbb-b7db-844196801810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5ee693-830c-431f-aad3-8f355f421370", "tag": "58679032-210d-45a7-aad2-eb8eb8102cc1"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:08.871853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-26c384ca-7988-41fc-8609-66c7b2e1df10 req-1a12ed34-adb1-4cbb-b7db-844196801810 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:08.872313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-26c384ca-7988-41fc-8609-66c7b2e1df10 req-1a12ed34-adb1-4cbb-b7db-844196801810 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:08.896278 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-26c384ca-7988-41fc-8609-66c7b2e1df10 req-1a12ed34-adb1-4cbb-b7db-844196801810 service nova] Creating event network-changed:58679032-210d-45a7-aad2-eb8eb8102cc1 for instance cb5ee693-830c-431f-aad3-8f355f421370 on n-h2-844627-10 Aug 04 14:14:08.913818 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-26c384ca-7988-41fc-8609-66c7b2e1df10 req-1a12ed34-adb1-4cbb-b7db-844196801810 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066420 Aug 04 14:14:08.915562 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1845/3676] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:09.286055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d429f04e-eae4-4b94-b50a-139f8910c6bb req-4353bdbf-d90b-4302-88e0-5ad89a313548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9c2731-512a-423b-a54e-32f7e2171623", "tag": "fcaf7619-ad8a-4c0d-91da-0cf44e564f7f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:09.312353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:14:09.313195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:14:09.313401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d429f04e-eae4-4b94-b50a-139f8910c6bb req-4353bdbf-d90b-4302-88e0-5ad89a313548 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:09.313900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:14:09.314434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:14:09.314662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d429f04e-eae4-4b94-b50a-139f8910c6bb req-4353bdbf-d90b-4302-88e0-5ad89a313548 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:09.315152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:14:09.318370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:09.334833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:09.335770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:09.336911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:09.337662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:09.341547 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d429f04e-eae4-4b94-b50a-139f8910c6bb req-4353bdbf-d90b-4302-88e0-5ad89a313548 service nova] Creating event network-changed:fcaf7619-ad8a-4c0d-91da-0cf44e564f7f for instance 8b9c2731-512a-423b-a54e-32f7e2171623 on n-h1-844627-10 Aug 04 14:14:09.355036 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d429f04e-eae4-4b94-b50a-139f8910c6bb req-4353bdbf-d90b-4302-88e0-5ad89a313548 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436766 Aug 04 14:14:09.356177 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1846/3677] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:09.368138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:09.370090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:09.379102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:09.384797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Getting quotas for project c99a5688f72e43d0be0f0b8e175344b0. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:14:09.394865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:09.396109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:09.397856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Getting quotas for user a8f7ab6120c547b592479d79344d6850 and project c99a5688f72e43d0be0f0b8e175344b0. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:14:09.398340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:09.399393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:09.687490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=10 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:09.704541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:14:09.708797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7369290f-6018-44e3-930d-922490613a58',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d3a0d080-ee76-40a3-9ed7-7e70fb92e821',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4963a019-b7c3-42b2-88a0-94541d22c45c',volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:14:10.294319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:10.311081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:10.316165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:10.319980 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9353e904-2518-49cd-aa40-cfbdc9a253ad tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 0.960199 Aug 04 14:14:10.322680 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1847/3678] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:09 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:10.348190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3700549c-b272-4e78-9415-dcf26f4fa142 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:10.350241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3700549c-b272-4e78-9415-dcf26f4fa142 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:10.370793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3700549c-b272-4e78-9415-dcf26f4fa142 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:10.376354 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-997b8d65-0a6d-4299-b4b1-375e9c5b567f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 13.396335 Aug 04 14:14:10.377012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3700549c-b272-4e78-9415-dcf26f4fa142 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:10.378496 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1832/3679] 10.222.0.66 () {62 vars in 1189 bytes} [Thu Aug 4 14:13:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 13399 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 14:14:10.392948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3700549c-b272-4e78-9415-dcf26f4fa142 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:10.398394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3700549c-b272-4e78-9415-dcf26f4fa142 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:10.404459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64243dac-79e4-498d-8dcc-192cddb3bbef tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:10.405514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-64243dac-79e4-498d-8dcc-192cddb3bbef tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:10.999198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-64243dac-79e4-498d-8dcc-192cddb3bbef tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:11.025881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-64243dac-79e4-498d-8dcc-192cddb3bbef tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:11.029769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-64243dac-79e4-498d-8dcc-192cddb3bbef tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:11.033031 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-64243dac-79e4-498d-8dcc-192cddb3bbef tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1284 microversion: 2.42 time: 0.639597 Aug 04 14:14:11.035534 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1833/3680] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:10 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1284 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:11.051824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6326322e-26fe-4e99-b08d-6b59b99e8c4a req-8bdacb27-0cb1-4999-b7d5-13505977dfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343f54f4-4ee4-482d-b786-39eb3f3cd37d", "tag": "ea5597c5-6514-4cc0-9e82-56dea8779ca3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:11.075326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6326322e-26fe-4e99-b08d-6b59b99e8c4a req-8bdacb27-0cb1-4999-b7d5-13505977dfee service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:11.076140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6326322e-26fe-4e99-b08d-6b59b99e8c4a req-8bdacb27-0cb1-4999-b7d5-13505977dfee service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:11.101081 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6326322e-26fe-4e99-b08d-6b59b99e8c4a req-8bdacb27-0cb1-4999-b7d5-13505977dfee service nova] Creating event network-changed:ea5597c5-6514-4cc0-9e82-56dea8779ca3 for instance 343f54f4-4ee4-482d-b786-39eb3f3cd37d on n-h1-844627-10 Aug 04 14:14:11.111788 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6326322e-26fe-4e99-b08d-6b59b99e8c4a req-8bdacb27-0cb1-4999-b7d5-13505977dfee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073494 Aug 04 14:14:11.112923 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1834/3681] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:11.360317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3700549c-b272-4e78-9415-dcf26f4fa142 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:11.366028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:11.368396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:11.382040 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3700549c-b272-4e78-9415-dcf26f4fa142 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1320 microversion: 2.1 time: 1.054391 Aug 04 14:14:11.384587 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1848/3682] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:10 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1320 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:11.393483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:11.395415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:11.398402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:11.400845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:12.088243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:12.090293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:12.106967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:12.108581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:12.109955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:12.111168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:12.112256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:12.119447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:12.126856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:12.132503 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-69047f48-9106-417e-9e55-e7d051f88724 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 0.773390 Aug 04 14:14:12.133665 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1835/3683] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:11 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:12.328551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:12.386278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:12.391735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:12.394759 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-85b272b6-3e0b-475b-a3e4-c89c0c372889 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1574 microversion: 2.42 time: 0.317079 Aug 04 14:14:12.414338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d38763fe-9ef0-4e63-9b57-0eac19e28452 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:12.417596 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1849/3684] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:12 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1574 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:12.422570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d38763fe-9ef0-4e63-9b57-0eac19e28452 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:12.446192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d38763fe-9ef0-4e63-9b57-0eac19e28452 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:12.448297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d38763fe-9ef0-4e63-9b57-0eac19e28452 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:12.450881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d38763fe-9ef0-4e63-9b57-0eac19e28452 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:12.452291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d38763fe-9ef0-4e63-9b57-0eac19e28452 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:12.896713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d38763fe-9ef0-4e63-9b57-0eac19e28452 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:12.930698 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d38763fe-9ef0-4e63-9b57-0eac19e28452 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1320 microversion: 2.1 time: 0.528742 Aug 04 14:14:12.944545 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1836/3685] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:12 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1320 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:14:13.191008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:13.191540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:13.250093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:13.251056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:13.252497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:13.253735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:13.465865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:13.467173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:13.493268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:13.493738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:13.494584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:13.495042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:13.634528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:13.645759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:13.654550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:13.662680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:13.667795 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f569127-c4a7-43e9-ab22-0e9e93aead8a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1592 microversion: 2.42 time: 0.205950 Aug 04 14:14:13.673701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:13.675507 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1837/3686] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:13 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1592 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:13.680659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:13.682350 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b90a38b-5d64-4ae6-873d-c19604f61aff tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 0.501980 Aug 04 14:14:13.683162 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1850/3687] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:13 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:13.956554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7227adaf-f8a8-42d7-a2a6-38fd717106e3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:13.958450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7227adaf-f8a8-42d7-a2a6-38fd717106e3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:13.976721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7227adaf-f8a8-42d7-a2a6-38fd717106e3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:13.979481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7227adaf-f8a8-42d7-a2a6-38fd717106e3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:13.982359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7227adaf-f8a8-42d7-a2a6-38fd717106e3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:13.982962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7227adaf-f8a8-42d7-a2a6-38fd717106e3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:14.712345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:14.716017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:14.745422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:14.750062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:14.751816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:14.754369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:15.257342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7227adaf-f8a8-42d7-a2a6-38fd717106e3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:15.311846 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7227adaf-f8a8-42d7-a2a6-38fd717106e3 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1320 microversion: 2.1 time: 1.360856 Aug 04 14:14:15.318518 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1838/3688] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:13 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1320 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:15.338045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:15.341599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:15.360829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:15.365407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:15.367357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:15.369312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:15.370493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:15.380382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:15.395762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:15.398325 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0441c7d3-879a-41f1-9744-9da2ec8f75a2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1592 microversion: 2.42 time: 0.700802 Aug 04 14:14:15.403581 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1851/3689] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:14 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1592 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:15.966252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:15.996465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:16.019132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:16.036539 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-386ccf73-4fe9-4367-8013-66a48cf224e3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 0.710004 Aug 04 14:14:16.055809 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1839/3690] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:15 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:16.338549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-141ee79d-6c9b-4550-8770-65f07466448c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:16.339845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-141ee79d-6c9b-4550-8770-65f07466448c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:16.355874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-141ee79d-6c9b-4550-8770-65f07466448c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:16.356594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-141ee79d-6c9b-4550-8770-65f07466448c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:16.359286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-141ee79d-6c9b-4550-8770-65f07466448c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:16.359770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-141ee79d-6c9b-4550-8770-65f07466448c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:16.452683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:16.456180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:16.503230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:16.509408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:16.544558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:16.547501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:16.938161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:16.962154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:16.964200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:16.970433 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a2a1d24-50f9-4201-b7e4-81923b5645fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1592 microversion: 2.42 time: 0.539246 Aug 04 14:14:16.971417 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1840/3691] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:16 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1592 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:17.064936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:17.065623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:17.082886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:17.084469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:17.089224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:17.091030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:17.130966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-141ee79d-6c9b-4550-8770-65f07466448c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:17.140382 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-141ee79d-6c9b-4550-8770-65f07466448c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1320 microversion: 2.1 time: 0.807753 Aug 04 14:14:17.151237 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1852/3692] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:16 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1320 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:17.627977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:17.646666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:17.649857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:17.652722 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9ee8784d-ae83-4a6a-adc1-eb92312e4913 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 0.592741 Aug 04 14:14:17.658201 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1841/3693] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:17 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:17.991173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2466bfc3-a61e-4bfa-85b0-9b3c58c543d7 req-a8cf7989-c592-4485-93e9-caa3562cf2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5ee693-830c-431f-aad3-8f355f421370", "name": "network-vif-plugged", "status": "completed", "tag": "58679032-210d-45a7-aad2-eb8eb8102cc1"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:18.017903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2466bfc3-a61e-4bfa-85b0-9b3c58c543d7 req-a8cf7989-c592-4485-93e9-caa3562cf2aa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:18.018370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2466bfc3-a61e-4bfa-85b0-9b3c58c543d7 req-a8cf7989-c592-4485-93e9-caa3562cf2aa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:18.021949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:18.022778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:18.033447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:18.037730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:18.038856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:18.039464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:18.046670 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2466bfc3-a61e-4bfa-85b0-9b3c58c543d7 req-a8cf7989-c592-4485-93e9-caa3562cf2aa service nova] Creating event network-vif-plugged:58679032-210d-45a7-aad2-eb8eb8102cc1 for instance cb5ee693-830c-431f-aad3-8f355f421370 on n-h2-844627-10 Aug 04 14:14:18.065001 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2466bfc3-a61e-4bfa-85b0-9b3c58c543d7 req-a8cf7989-c592-4485-93e9-caa3562cf2aa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409066 Aug 04 14:14:18.069652 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1853/3694] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:14:18.184015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-db1aec05-0fd0-4b7e-bd54-f20cef561275 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:18.186632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-db1aec05-0fd0-4b7e-bd54-f20cef561275 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:18.202143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db1aec05-0fd0-4b7e-bd54-f20cef561275 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:18.203549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db1aec05-0fd0-4b7e-bd54-f20cef561275 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:18.204584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db1aec05-0fd0-4b7e-bd54-f20cef561275 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:18.205323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db1aec05-0fd0-4b7e-bd54-f20cef561275 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:18.235315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:19.274344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-db1aec05-0fd0-4b7e-bd54-f20cef561275 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:19.283150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:19.292242 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-db1aec05-0fd0-4b7e-bd54-f20cef561275 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1320 microversion: 2.1 time: 1.104310 Aug 04 14:14:19.295035 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1854/3695] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:18 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1320 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:14:19.308425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:19.309039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:19.310849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:19.312500 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ca15e48-99d1-47f7-bced-e813314d1fe0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1660 microversion: 2.42 time: 1.295165 Aug 04 14:14:19.317382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:19.329641 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1842/3696] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:18 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1660 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:19.341562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:19.342032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:19.342855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:19.343831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:19.859703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:19.872337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:19.874105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:19.875412 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1f5bfcc-25b4-4d6b-bdb5-1cc9f0285c93 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 0.579116 Aug 04 14:14:19.876013 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1855/3697] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:19 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:20.112860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-db2cb993-8f70-4f79-b496-1a77e1bceb47 req-8bf4e775-18a1-4c96-94eb-ec9021a4c157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343f54f4-4ee4-482d-b786-39eb3f3cd37d", "name": "network-vif-plugged", "status": "completed", "tag": "ea5597c5-6514-4cc0-9e82-56dea8779ca3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:20.134619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:20.143020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-db2cb993-8f70-4f79-b496-1a77e1bceb47 req-8bf4e775-18a1-4c96-94eb-ec9021a4c157 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:20.144278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-db2cb993-8f70-4f79-b496-1a77e1bceb47 req-8bf4e775-18a1-4c96-94eb-ec9021a4c157 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:20.178874 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-db2cb993-8f70-4f79-b496-1a77e1bceb47 req-8bf4e775-18a1-4c96-94eb-ec9021a4c157 service nova] Creating event network-vif-plugged:ea5597c5-6514-4cc0-9e82-56dea8779ca3 for instance 343f54f4-4ee4-482d-b786-39eb3f3cd37d on n-h1-844627-10 Aug 04 14:14:20.200091 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-db2cb993-8f70-4f79-b496-1a77e1bceb47 req-8bf4e775-18a1-4c96-94eb-ec9021a4c157 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091141 Aug 04 14:14:20.223585 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1843/3698] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:20.334486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a309138f-c566-4f34-93db-c16bcc428e76 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:20.335365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a309138f-c566-4f34-93db-c16bcc428e76 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:20.351187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a309138f-c566-4f34-93db-c16bcc428e76 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:20.351641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a309138f-c566-4f34-93db-c16bcc428e76 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:20.352463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a309138f-c566-4f34-93db-c16bcc428e76 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:20.352942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a309138f-c566-4f34-93db-c16bcc428e76 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:20.373877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:20.374854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:20.387720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:20.388191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:20.389047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:20.389503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:20.863782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a309138f-c566-4f34-93db-c16bcc428e76 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:20.873700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a309138f-c566-4f34-93db-c16bcc428e76 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1320 microversion: 2.1 time: 0.543144 Aug 04 14:14:20.878354 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1856/3699] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:20 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1320 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:20.898615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:20.899506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:20.911420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:20.912171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:20.913219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:20.913930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:21.020553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:21.044824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:21.097759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:21.104015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:21.105561 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e630816-4bcd-4d61-bed4-0dc89f7e5f70 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1660 microversion: 2.42 time: 0.736430 Aug 04 14:14:21.106170 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1844/3700] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:20 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1660 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:21.922121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0e25f8f6-66bd-4a9f-bd7d-4569d7760304 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:21.923379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0e25f8f6-66bd-4a9f-bd7d-4569d7760304 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:21.940153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:21.960329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:21.962399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:21.963479 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c3b26af9-0063-4abc-b947-49a52d4ee384 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 1.068931 Aug 04 14:14:21.963650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e25f8f6-66bd-4a9f-bd7d-4569d7760304 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:21.964109 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1857/3701] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:20 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:21.964544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e25f8f6-66bd-4a9f-bd7d-4569d7760304 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:21.977262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e25f8f6-66bd-4a9f-bd7d-4569d7760304 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:21.978416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e25f8f6-66bd-4a9f-bd7d-4569d7760304 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:22.153845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:22.154661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:22.173629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:22.174106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:22.179125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:22.179604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:23.022726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0e25f8f6-66bd-4a9f-bd7d-4569d7760304 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:23.030203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:23.058484 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0e25f8f6-66bd-4a9f-bd7d-4569d7760304 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1320 microversion: 2.1 time: 1.147511 Aug 04 14:14:23.072131 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1845/3702] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:21 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1320 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:23.075833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:23.080560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:23.108662 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d1e96eb8-d3c6-4bfb-98f7-0a42d36ff620 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1707 microversion: 2.42 time: 0.958715 Aug 04 14:14:23.121928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b29dbac2-96ba-4667-ba07-668fa1b9faa7 req-d8b64eb9-eed5-405c-9cef-75f7605943b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9c2731-512a-423b-a54e-32f7e2171623", "name": "network-vif-plugged", "status": "completed", "tag": "fcaf7619-ad8a-4c0d-91da-0cf44e564f7f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:23.139172 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1858/3703] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:22 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1707 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:23.175280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:23.175927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:23.194401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:23.195072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:23.195679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:23.198039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:23.227467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b29dbac2-96ba-4667-ba07-668fa1b9faa7 req-d8b64eb9-eed5-405c-9cef-75f7605943b2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:23.228454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b29dbac2-96ba-4667-ba07-668fa1b9faa7 req-d8b64eb9-eed5-405c-9cef-75f7605943b2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:23.331781 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b29dbac2-96ba-4667-ba07-668fa1b9faa7 req-d8b64eb9-eed5-405c-9cef-75f7605943b2 service nova] Creating event network-vif-plugged:fcaf7619-ad8a-4c0d-91da-0cf44e564f7f for instance 8b9c2731-512a-423b-a54e-32f7e2171623 on n-h1-844627-10 Aug 04 14:14:23.373634 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b29dbac2-96ba-4667-ba07-668fa1b9faa7 req-d8b64eb9-eed5-405c-9cef-75f7605943b2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.290881 Aug 04 14:14:23.379044 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1846/3704] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:24.059538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:24.077496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:24.082305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:24.085438 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a75be2ed-b3d7-486a-bd72-c0334a4beda6 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 0.944919 Aug 04 14:14:24.096788 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1859/3705] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:23 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:24.126834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b25ba050-61a9-4b1c-b85d-2a713546456e tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:24.130361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b25ba050-61a9-4b1c-b85d-2a713546456e tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:24.157668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b25ba050-61a9-4b1c-b85d-2a713546456e tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:24.159447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b25ba050-61a9-4b1c-b85d-2a713546456e tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:24.162819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b25ba050-61a9-4b1c-b85d-2a713546456e tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:24.165544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b25ba050-61a9-4b1c-b85d-2a713546456e tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:24.166897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:24.167677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:24.170044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:24.188520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:24.189256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:24.189737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:24.190235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:24.681910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:24.723918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:24.728006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:24.731154 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c64590fe-14df-4eda-9262-305f6e2df0bc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1754 microversion: 2.42 time: 0.580227 Aug 04 14:14:24.752306 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1860/3706] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:24 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1754 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:24.910822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b25ba050-61a9-4b1c-b85d-2a713546456e tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:24.942447 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b25ba050-61a9-4b1c-b85d-2a713546456e tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 200 len: 1508 microversion: 2.1 time: 0.828207 Aug 04 14:14:24.946579 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1847/3707] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:24 2022] GET /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 1508 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:14:24.998674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac6dc6e9-cc38-48e1-aa2f-e0c90b8351b0 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:25.000819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac6dc6e9-cc38-48e1-aa2f-e0c90b8351b0 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: cb5ee693-830c-431f-aad3-8f355f421370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:25.012663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6dc6e9-cc38-48e1-aa2f-e0c90b8351b0 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:25.014242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6dc6e9-cc38-48e1-aa2f-e0c90b8351b0 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:25.016700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6dc6e9-cc38-48e1-aa2f-e0c90b8351b0 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:25.017986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6dc6e9-cc38-48e1-aa2f-e0c90b8351b0 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:25.142807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:25.150320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:25.176803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:25.187058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:25.189106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:25.190297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:25.634980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac6dc6e9-cc38-48e1-aa2f-e0c90b8351b0 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:25.710748 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac6dc6e9-cc38-48e1-aa2f-e0c90b8351b0 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/cb5ee693-830c-431f-aad3-8f355f421370" status: 200 len: 1507 microversion: 2.1 time: 0.727481 Aug 04 14:14:25.712499 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1861/3708] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:24 2022] GET /compute/v2.1/servers/cb5ee693-830c-431f-aad3-8f355f421370 => generated 1507 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:14:25.754241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-752a119f-159c-4329-8766-dd3af97bc692 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:25.755729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-752a119f-159c-4329-8766-dd3af97bc692 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: cb5ee693-830c-431f-aad3-8f355f421370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:25.768924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-752a119f-159c-4329-8766-dd3af97bc692 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:25.770343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-752a119f-159c-4329-8766-dd3af97bc692 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:25.772169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-752a119f-159c-4329-8766-dd3af97bc692 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:25.773421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-752a119f-159c-4329-8766-dd3af97bc692 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:25.850833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-752a119f-159c-4329-8766-dd3af97bc692 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: cb5ee693-830c-431f-aad3-8f355f421370] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:14:26.192159 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-752a119f-159c-4329-8766-dd3af97bc692 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cb5ee693-830c-431f-aad3-8f355f421370" status: 204 len: 0 microversion: 2.1 time: 0.447607 Aug 04 14:14:26.193985 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1862/3709] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:14:25 2022] DELETE /compute/v2.1/servers/cb5ee693-830c-431f-aad3-8f355f421370 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:14:26.233774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:26.248196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:26.273674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:26.276071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:26.278143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:26.288290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:27.017856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:27.021953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:27.036375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:27.039928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:27.041934 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-66dbbbd1-2dce-4646-99fe-80ab63d75824 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1801 microversion: 2.42 time: 0.845407 Aug 04 14:14:27.045373 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1863/3710] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:26 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1801 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:27.052337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:27.055869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:27.060396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bba2870d-2065-40f0-bb35-38575340cb2c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:27.061066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bba2870d-2065-40f0-bb35-38575340cb2c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:27.061518 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-77d88c15-2a89-479a-a4eb-3325dad0e72a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1406 microversion: 2.20 time: 1.925680 Aug 04 14:14:27.071581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bba2870d-2065-40f0-bb35-38575340cb2c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:27.074250 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1848/3711] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:25 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1406 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:27.075092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bba2870d-2065-40f0-bb35-38575340cb2c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:27.082374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bba2870d-2065-40f0-bb35-38575340cb2c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:27.084097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bba2870d-2065-40f0-bb35-38575340cb2c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:27.126974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bba2870d-2065-40f0-bb35-38575340cb2c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 343f54f4-4ee4-482d-b786-39eb3f3cd37d] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:14:27.297855 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bba2870d-2065-40f0-bb35-38575340cb2c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "DELETE /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d" status: 204 len: 0 microversion: 2.1 time: 0.249808 Aug 04 14:14:27.299076 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1864/3712] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:14:27 2022] DELETE /compute/v2.1/servers/343f54f4-4ee4-482d-b786-39eb3f3cd37d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:14:27.659083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-853848619", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "038577a6-d597-470a-a639-cb9845cadaa5"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:27.835899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] validate_networks() for [('038577a6-d597-470a-a639-cb9845cadaa5', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:14:28.098959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:28.101268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:28.130404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:28.131209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:28.132102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:28.132559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:28.974022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:28.991536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:28.993359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:28.998946 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4c0b32c7-c67d-4afe-895e-381911135c75 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1801 microversion: 2.42 time: 0.911575 Aug 04 14:14:29.019130 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1865/3713] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:28 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1801 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:29.024922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:29.025460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:29.040191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:29.041485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:29.043571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:29.044696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:29.604986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:29.635618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:29.652254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:29.654862 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c051c262-8220-4258-b73c-de59ea6fe636 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1597 microversion: 2.20 time: 0.634264 Aug 04 14:14:29.656820 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1866/3714] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:29 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1597 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:29.687882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33844bf8-559c-4f20-8825-887eb91f33f5 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:29.689265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-33844bf8-559c-4f20-8825-887eb91f33f5 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:29.715673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33844bf8-559c-4f20-8825-887eb91f33f5 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:29.716823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33844bf8-559c-4f20-8825-887eb91f33f5 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:29.718687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33844bf8-559c-4f20-8825-887eb91f33f5 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:29.721956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33844bf8-559c-4f20-8825-887eb91f33f5 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:29.776172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:29.986333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:14:29.988084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:14:29.988823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:14:29.989722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:14:29.990353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:14:30.021767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:30.022961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:30.023908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:30.024364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:30.069458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Getting quotas for project 0904b55b94c5408ca3bc08b4653301f3. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:14:30.087003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Getting quotas for user 07dd715cfad74341a2aa0bf9ca4c0d00 and project 0904b55b94c5408ca3bc08b4653301f3. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:14:30.087745 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-33844bf8-559c-4f20-8825-887eb91f33f5 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.407382 Aug 04 14:14:30.089145 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1867/3715] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 14:14:29 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-interface => generated 284 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:14:30.103898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:30.105501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:30.111979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Going to run 2 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:14:30.114461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:14:30.123300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:30.128036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:30.129705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:30.132497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:30.190839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: dbf59c44-a78d-447f-9fcf-af72d1a1c5a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=947e83c8-b972-4b3b-9d18-dff9147dfaa3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:14:30.311195 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c6ca4e5a-833d-456f-a999-bf6cc81198f9 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.658783 Aug 04 14:14:30.312591 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1849/3716] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:14:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 2663 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 14:14:30.693877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1160725506", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "1b4f866d-e9ad-4302-a20b-1d7a246b12d6"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:30.812677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] validate_networks() for [('1b4f866d-e9ad-4302-a20b-1d7a246b12d6', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:14:32.903056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:32.946624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:32.957758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:32.962810 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-53adee2a-463b-4d8d-a8a4-a21091f72a62 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1848 microversion: 2.42 time: 2.871826 Aug 04 14:14:32.966154 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1868/3717] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:30 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1848 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:33.004092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1311c7a6-8d51-4705-a3cf-0b6a87334f77 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:33.019699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1311c7a6-8d51-4705-a3cf-0b6a87334f77 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:33.103462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1311c7a6-8d51-4705-a3cf-0b6a87334f77 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:33.104220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1311c7a6-8d51-4705-a3cf-0b6a87334f77 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:33.129230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1311c7a6-8d51-4705-a3cf-0b6a87334f77 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:33.133113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1311c7a6-8d51-4705-a3cf-0b6a87334f77 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:34.511357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1311c7a6-8d51-4705-a3cf-0b6a87334f77 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:34.529552 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1311c7a6-8d51-4705-a3cf-0b6a87334f77 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.546253 Aug 04 14:14:34.531183 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1869/3718] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:32 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:34.557320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5daacfe7-c5d2-4a2b-a082-c6938d17263b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:34.575288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5daacfe7-c5d2-4a2b-a082-c6938d17263b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:34.576418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5daacfe7-c5d2-4a2b-a082-c6938d17263b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Searching by: {'deleted': False, 'project_id': '0904b55b94c5408ca3bc08b4653301f3'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:14:34.586520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5daacfe7-c5d2-4a2b-a082-c6938d17263b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:34.587347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5daacfe7-c5d2-4a2b-a082-c6938d17263b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:34.588848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5daacfe7-c5d2-4a2b-a082-c6938d17263b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:34.589734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5daacfe7-c5d2-4a2b-a082-c6938d17263b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:34.652668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-5daacfe7-c5d2-4a2b-a082-c6938d17263b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:14:34.740175 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5daacfe7-c5d2-4a2b-a082-c6938d17263b tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 671 microversion: 2.1 time: 0.207588 Aug 04 14:14:34.741164 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1870/3719] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 14:14:34 2022] GET /compute/v2.1/servers => generated 671 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:34.761972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-bd2e72d8-53da-4aa0-ac98-eaae90083d20 req-fb7b43af-ab94-4d1b-be10-7ad621105afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5ee693-830c-431f-aad3-8f355f421370", "name": "network-vif-deleted", "tag": "58679032-210d-45a7-aad2-eb8eb8102cc1"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:34.789343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bd2e72d8-53da-4aa0-ac98-eaae90083d20 req-fb7b43af-ab94-4d1b-be10-7ad621105afb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:34.790132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bd2e72d8-53da-4aa0-ac98-eaae90083d20 req-fb7b43af-ab94-4d1b-be10-7ad621105afb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:34.830093 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-bd2e72d8-53da-4aa0-ac98-eaae90083d20 req-fb7b43af-ab94-4d1b-be10-7ad621105afb service nova] Creating event network-vif-deleted:58679032-210d-45a7-aad2-eb8eb8102cc1 for instance cb5ee693-830c-431f-aad3-8f355f421370 on n-h2-844627-10 Aug 04 14:14:34.844070 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-bd2e72d8-53da-4aa0-ac98-eaae90083d20 req-fb7b43af-ab94-4d1b-be10-7ad621105afb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100825 Aug 04 14:14:34.845908 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1871/3720] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:34.861648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d854f785-8f42-4543-9cdf-09976149b47f req-0f45e0b1-9bef-4914-a267-7e7e14ba5f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343f54f4-4ee4-482d-b786-39eb3f3cd37d", "name": "network-vif-deleted", "tag": "ea5597c5-6514-4cc0-9e82-56dea8779ca3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:34.891870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d854f785-8f42-4543-9cdf-09976149b47f req-0f45e0b1-9bef-4914-a267-7e7e14ba5f76 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:34.895450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d854f785-8f42-4543-9cdf-09976149b47f req-0f45e0b1-9bef-4914-a267-7e7e14ba5f76 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:34.939382 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d854f785-8f42-4543-9cdf-09976149b47f req-0f45e0b1-9bef-4914-a267-7e7e14ba5f76 service nova] Creating event network-vif-deleted:ea5597c5-6514-4cc0-9e82-56dea8779ca3 for instance 343f54f4-4ee4-482d-b786-39eb3f3cd37d on n-h1-844627-10 Aug 04 14:14:34.948741 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d854f785-8f42-4543-9cdf-09976149b47f req-0f45e0b1-9bef-4914-a267-7e7e14ba5f76 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100482 Aug 04 14:14:34.949405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1872/3721] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:34.969705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:14:34.974285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:14:34.975841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:14:34.980616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:14:34.982474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:14:35.016735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:35.020048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:35.022952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:35.025663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:35.090917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Getting quotas for project 5e494ac06713453d9e598f82cdadccd2. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:14:35.107944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Getting quotas for user cdc33353bb874a57b82deab4669b998c and project 5e494ac06713453d9e598f82cdadccd2. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:14:35.139551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-752ad028-681f-44c9-b6d9-8f4a5b44dfc7 tempest-ComputeTenantNetworksTest-1423246359 tempest-ComputeTenantNetworksTest-1423246359-project] Calling method '.version_select at 0x7f46f31aef70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:35.153005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:14:35.165355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:14:35.243219 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-da523291-5d87-4f8b-a0bc-4247218ba6c7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.922403 Aug 04 14:14:35.245725 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1850/3722] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 4926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:14:35.252269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:35.253703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:35.271294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:35.272659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:35.273862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:35.274548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:36.436132 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-752ad028-681f-44c9-b6d9-8f4a5b44dfc7 tempest-ComputeTenantNetworksTest-1423246359 tempest-ComputeTenantNetworksTest-1423246359-project] 10.222.0.66 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 307 microversion: 2.1 time: 1.484921 Aug 04 14:14:36.446658 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1873/3723] 10.222.0.66 () {58 vars in 1158 bytes} [Thu Aug 4 14:14:34 2022] GET /compute/v2.1/os-tenant-networks => generated 307 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:36.493622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23a7d2d2-b1d1-4f23-ab87-3c05e590eb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:36.507720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-23a7d2d2-b1d1-4f23-ab87-3c05e590eb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:36.549907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23a7d2d2-b1d1-4f23-ab87-3c05e590eb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:36.550464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23a7d2d2-b1d1-4f23-ab87-3c05e590eb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:36.551709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23a7d2d2-b1d1-4f23-ab87-3c05e590eb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:36.552706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23a7d2d2-b1d1-4f23-ab87-3c05e590eb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:36.802320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:36.814534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=89 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:36.853748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:36.857009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:36.858375 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-17ef8f77-cc8a-420b-a027-a228ebb90b31 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1848 microversion: 2.42 time: 1.611259 Aug 04 14:14:36.862229 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1851/3724] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:35 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1848 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:36.870889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6dade922-df8b-48bb-b238-139223bfb254 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:36.872046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6dade922-df8b-48bb-b238-139223bfb254 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:36.885472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dade922-df8b-48bb-b238-139223bfb254 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:36.886610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dade922-df8b-48bb-b238-139223bfb254 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:36.888261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dade922-df8b-48bb-b238-139223bfb254 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:36.889116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dade922-df8b-48bb-b238-139223bfb254 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:37.181110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6dade922-df8b-48bb-b238-139223bfb254 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:37.212597 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6dade922-df8b-48bb-b238-139223bfb254 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1275 microversion: 2.1 time: 0.349066 Aug 04 14:14:37.224392 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1852/3725] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:36 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:37.268141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41ffcc90-4a8e-4ae5-b313-405285b1e462 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:37.270132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-41ffcc90-4a8e-4ae5-b313-405285b1e462 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:37.321448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ffcc90-4a8e-4ae5-b313-405285b1e462 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:37.325960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ffcc90-4a8e-4ae5-b313-405285b1e462 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:37.330160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ffcc90-4a8e-4ae5-b313-405285b1e462 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:37.336398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ffcc90-4a8e-4ae5-b313-405285b1e462 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:37.709441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-23a7d2d2-b1d1-4f23-ab87-3c05e590eb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:37.722737 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-23a7d2d2-b1d1-4f23-ab87-3c05e590eb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.283853 Aug 04 14:14:37.724490 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1874/3726] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:36 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:37.756648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebe89adc-e85a-46c6-bd9d-03743ef41772 tempest-ComputeTenantNetworksTest-1423246359 tempest-ComputeTenantNetworksTest-1423246359-project] Calling method '.version_select at 0x7f46f31393a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:38.679207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-41ffcc90-4a8e-4ae5-b313-405285b1e462 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:38.709702 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-41ffcc90-4a8e-4ae5-b313-405285b1e462 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1270 microversion: 2.1 time: 1.482286 Aug 04 14:14:38.721358 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1853/3727] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:37 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1270 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:38.722341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-370b465d-e058-40d5-ba35-8319f9dae309 req-caece30d-e920-4731-bced-1a65b9ac511b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "tag": "d470b701-7300-4fa0-a043-83ad11cf1a6e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:38.746425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-370b465d-e058-40d5-ba35-8319f9dae309 req-caece30d-e920-4731-bced-1a65b9ac511b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:38.747651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-370b465d-e058-40d5-ba35-8319f9dae309 req-caece30d-e920-4731-bced-1a65b9ac511b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:38.776712 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-370b465d-e058-40d5-ba35-8319f9dae309 req-caece30d-e920-4731-bced-1a65b9ac511b service nova] Creating event network-changed:d470b701-7300-4fa0-a043-83ad11cf1a6e for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:14:38.789166 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-370b465d-e058-40d5-ba35-8319f9dae309 req-caece30d-e920-4731-bced-1a65b9ac511b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074434 Aug 04 14:14:38.790198 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1854/3728] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:38.821971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b43375fb-92b2-4c4d-a28a-0c641ee69eab tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:38.822504 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ebe89adc-e85a-46c6-bd9d-03743ef41772 tempest-ComputeTenantNetworksTest-1423246359 tempest-ComputeTenantNetworksTest-1423246359-project] 10.222.0.66 "GET /compute/v2.1/os-tenant-networks/0d982de1-7d3e-4ccb-b2b6-19637e067aab" status: 200 len: 138 microversion: 2.1 time: 1.077230 Aug 04 14:14:38.823415 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1875/3729] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 14:14:37 2022] GET /compute/v2.1/os-tenant-networks/0d982de1-7d3e-4ccb-b2b6-19637e067aab => generated 138 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:38.823616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b43375fb-92b2-4c4d-a28a-0c641ee69eab tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:38.828973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:38.829987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:38.840480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43375fb-92b2-4c4d-a28a-0c641ee69eab tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:38.841580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43375fb-92b2-4c4d-a28a-0c641ee69eab tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:38.843734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43375fb-92b2-4c4d-a28a-0c641ee69eab tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:38.844811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43375fb-92b2-4c4d-a28a-0c641ee69eab tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:38.855940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:38.862650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:38.863880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:38.864575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:39.941230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b43375fb-92b2-4c4d-a28a-0c641ee69eab tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:39.969183 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b43375fb-92b2-4c4d-a28a-0c641ee69eab tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.176661 Aug 04 14:14:39.971302 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1855/3730] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:38 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:39.992259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a942d6af-e709-4221-b78e-edd79377497f tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:39.993509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a942d6af-e709-4221-b78e-edd79377497f tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:39.998831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:40.007116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a942d6af-e709-4221-b78e-edd79377497f tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:40.008544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a942d6af-e709-4221-b78e-edd79377497f tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:40.011325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a942d6af-e709-4221-b78e-edd79377497f tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:40.012521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a942d6af-e709-4221-b78e-edd79377497f tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:40.030514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:40.071345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:40.081678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:40.088463 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e6856579-63f4-47cc-a785-10d6d1cbbce6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1869 microversion: 2.42 time: 1.262252 Aug 04 14:14:40.093408 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1876/3731] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:38 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1869 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:40.106686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7ff849e6-52b9-4c6c-af81-b3e3045345cd req-9a0572a5-3bf4-463e-b58d-6dacb312329b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9c2731-512a-423b-a54e-32f7e2171623", "tag": "fcaf7619-ad8a-4c0d-91da-0cf44e564f7f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:40.144683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7ff849e6-52b9-4c6c-af81-b3e3045345cd req-9a0572a5-3bf4-463e-b58d-6dacb312329b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:40.149922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7ff849e6-52b9-4c6c-af81-b3e3045345cd req-9a0572a5-3bf4-463e-b58d-6dacb312329b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:40.197847 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7ff849e6-52b9-4c6c-af81-b3e3045345cd req-9a0572a5-3bf4-463e-b58d-6dacb312329b service nova] Creating event network-changed:fcaf7619-ad8a-4c0d-91da-0cf44e564f7f for instance 8b9c2731-512a-423b-a54e-32f7e2171623 on n-h1-844627-10 Aug 04 14:14:40.206533 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7ff849e6-52b9-4c6c-af81-b3e3045345cd req-9a0572a5-3bf4-463e-b58d-6dacb312329b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110902 Aug 04 14:14:40.208613 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1877/3732] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:40.220399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3f8a539-58b5-4be4-908f-67b701ab452e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:40.221832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3f8a539-58b5-4be4-908f-67b701ab452e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:40.233877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3f8a539-58b5-4be4-908f-67b701ab452e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:40.235520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3f8a539-58b5-4be4-908f-67b701ab452e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:40.237676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3f8a539-58b5-4be4-908f-67b701ab452e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:40.251336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3f8a539-58b5-4be4-908f-67b701ab452e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:40.974247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a942d6af-e709-4221-b78e-edd79377497f tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:40.994321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f3f8a539-58b5-4be4-908f-67b701ab452e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:40.994713 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a942d6af-e709-4221-b78e-edd79377497f tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1317 microversion: 2.1 time: 1.021663 Aug 04 14:14:40.995289 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1856/3733] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:39 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1317 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:41.007565 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3f8a539-58b5-4be4-908f-67b701ab452e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1276 microversion: 2.1 time: 0.796699 Aug 04 14:14:41.008554 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1878/3734] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:40 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1276 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:41.012000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7582cfde-52c6-4ed7-b367-de04f92d057a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1942584413"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:41.015258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-584ade00-8684-4cf0-9830-8145e0a75f05 req-9213f38a-ce01-4c30-b7ee-f042dc887b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "tag": "cf3dc4f5-e181-4296-845f-3b9c2c178bba"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:41.025509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7582cfde-52c6-4ed7-b367-de04f92d057a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:41.042891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-584ade00-8684-4cf0-9830-8145e0a75f05 req-9213f38a-ce01-4c30-b7ee-f042dc887b85 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:41.049597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-584ade00-8684-4cf0-9830-8145e0a75f05 req-9213f38a-ce01-4c30-b7ee-f042dc887b85 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:41.055167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7582cfde-52c6-4ed7-b367-de04f92d057a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:41.055989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7582cfde-52c6-4ed7-b367-de04f92d057a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:41.057138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7582cfde-52c6-4ed7-b367-de04f92d057a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:41.057679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7582cfde-52c6-4ed7-b367-de04f92d057a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:41.071928 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-584ade00-8684-4cf0-9830-8145e0a75f05 req-9213f38a-ce01-4c30-b7ee-f042dc887b85 service nova] Creating event network-changed:cf3dc4f5-e181-4296-845f-3b9c2c178bba for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:14:41.080495 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-584ade00-8684-4cf0-9830-8145e0a75f05 req-9213f38a-ce01-4c30-b7ee-f042dc887b85 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069387 Aug 04 14:14:41.081744 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1879/3735] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:41.146540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:41.158246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:41.182005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:41.185858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:41.188648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:41.189368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:41.722390 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7582cfde-52c6-4ed7-b367-de04f92d057a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.725488 Aug 04 14:14:41.737778 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1857/3736] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:14:40 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 14:14:42.033615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55432a3d-206b-4d48-ab44-c628e289d547 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:42.034801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55432a3d-206b-4d48-ab44-c628e289d547 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:42.064521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55432a3d-206b-4d48-ab44-c628e289d547 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:42.065509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55432a3d-206b-4d48-ab44-c628e289d547 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:42.066577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55432a3d-206b-4d48-ab44-c628e289d547 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:42.067462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55432a3d-206b-4d48-ab44-c628e289d547 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:42.432948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:42.459477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:42.461541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:42.463070 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-38b83deb-456f-4661-9dbf-bd3b002d3f52 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1869 microversion: 2.42 time: 1.325221 Aug 04 14:14:42.463887 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1880/3737] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:41 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1869 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:42.469471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-32ed8e4a-896f-43a6-8e20-6983aff2520f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:42.482062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-32ed8e4a-896f-43a6-8e20-6983aff2520f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:42.492918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32ed8e4a-896f-43a6-8e20-6983aff2520f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:42.498907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32ed8e4a-896f-43a6-8e20-6983aff2520f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:42.500071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32ed8e4a-896f-43a6-8e20-6983aff2520f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:42.514549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32ed8e4a-896f-43a6-8e20-6983aff2520f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:42.632650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-55432a3d-206b-4d48-ab44-c628e289d547 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:42.653280 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55432a3d-206b-4d48-ab44-c628e289d547 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1317 microversion: 2.1 time: 0.622760 Aug 04 14:14:42.654951 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1858/3738] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:42 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:43.130939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-32ed8e4a-896f-43a6-8e20-6983aff2520f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:43.150309 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-32ed8e4a-896f-43a6-8e20-6983aff2520f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1318 microversion: 2.1 time: 0.685100 Aug 04 14:14:43.150915 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1881/3739] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:42 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:43.239255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ffacc1f7-2c26-48d6-8a88-af6767c65fd7 req-0b6d030a-e0d3-437e-9a4a-746a758466e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf59c44-a78d-447f-9fcf-af72d1a1c5a7", "tag": "cf69197c-9e04-41e7-a095-dcc5ebd940f1"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:43.263301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ffacc1f7-2c26-48d6-8a88-af6767c65fd7 req-0b6d030a-e0d3-437e-9a4a-746a758466e6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:43.268481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ffacc1f7-2c26-48d6-8a88-af6767c65fd7 req-0b6d030a-e0d3-437e-9a4a-746a758466e6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:43.304404 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ffacc1f7-2c26-48d6-8a88-af6767c65fd7 req-0b6d030a-e0d3-437e-9a4a-746a758466e6 service nova] Creating event network-changed:cf69197c-9e04-41e7-a095-dcc5ebd940f1 for instance dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 on n-h1-844627-10 Aug 04 14:14:43.314089 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ffacc1f7-2c26-48d6-8a88-af6767c65fd7 req-0b6d030a-e0d3-437e-9a4a-746a758466e6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082729 Aug 04 14:14:43.318074 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1859/3740] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:43.521203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:43.526859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:43.561078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:43.562662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:43.566132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:43.567023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:43.622348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-1221d3a2-2ca9-408a-9d41-9c22d0ccbe26 req-36e3ec7c-c328-47d0-a362-e1b54519cfdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947e83c8-b972-4b3b-9d18-dff9147dfaa3", "tag": "82964c2a-4b01-4d01-8cdc-b5aeb8dc5650"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:43.647663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1221d3a2-2ca9-408a-9d41-9c22d0ccbe26 req-36e3ec7c-c328-47d0-a362-e1b54519cfdb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:43.648558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1221d3a2-2ca9-408a-9d41-9c22d0ccbe26 req-36e3ec7c-c328-47d0-a362-e1b54519cfdb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:43.672678 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-1221d3a2-2ca9-408a-9d41-9c22d0ccbe26 req-36e3ec7c-c328-47d0-a362-e1b54519cfdb service nova] Creating event network-changed:82964c2a-4b01-4d01-8cdc-b5aeb8dc5650 for instance 947e83c8-b972-4b3b-9d18-dff9147dfaa3 on n-h2-844627-10 Aug 04 14:14:43.683753 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-1221d3a2-2ca9-408a-9d41-9c22d0ccbe26 req-36e3ec7c-c328-47d0-a362-e1b54519cfdb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065724 Aug 04 14:14:43.686254 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1860/3741] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:43.694735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-925050c9-3d4a-4a55-ac59-830092571350 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:43.695967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-925050c9-3d4a-4a55-ac59-830092571350 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:43.711224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-925050c9-3d4a-4a55-ac59-830092571350 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:43.712208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-925050c9-3d4a-4a55-ac59-830092571350 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:43.713319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-925050c9-3d4a-4a55-ac59-830092571350 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:43.713963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-925050c9-3d4a-4a55-ac59-830092571350 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:44.602346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:44.881877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:44.891790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-925050c9-3d4a-4a55-ac59-830092571350 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:44.919798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:44.920178 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-925050c9-3d4a-4a55-ac59-830092571350 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1317 microversion: 2.1 time: 1.231926 Aug 04 14:14:44.921487 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1861/3742] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:43 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1317 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:44.926536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:44.930351 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-34ee3cb3-3266-416e-8467-0f24e1a67365 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1890 microversion: 2.42 time: 1.418434 Aug 04 14:14:44.949099 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1882/3743] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:43 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1890 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:44.959924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2f507e54-242b-4626-be27-9f0876dbdc0a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:44.961973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f507e54-242b-4626-be27-9f0876dbdc0a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:44.979552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f507e54-242b-4626-be27-9f0876dbdc0a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:44.980280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f507e54-242b-4626-be27-9f0876dbdc0a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:44.982061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f507e54-242b-4626-be27-9f0876dbdc0a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:44.982765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f507e54-242b-4626-be27-9f0876dbdc0a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:45.064982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:45.140994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:45.345406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d58939df-4ad8-43ee-9794-a075cebde83b req-8b451ce8-e383-4270-96f0-4bd109099bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "tag": "181b4200-6b0b-4cc8-9f01-1313569bebe5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:45.360289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d58939df-4ad8-43ee-9794-a075cebde83b req-8b451ce8-e383-4270-96f0-4bd109099bf8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:45.361298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d58939df-4ad8-43ee-9794-a075cebde83b req-8b451ce8-e383-4270-96f0-4bd109099bf8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:45.379146 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d58939df-4ad8-43ee-9794-a075cebde83b req-8b451ce8-e383-4270-96f0-4bd109099bf8 service nova] Creating event network-changed:181b4200-6b0b-4cc8-9f01-1313569bebe5 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:14:45.386051 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d58939df-4ad8-43ee-9794-a075cebde83b req-8b451ce8-e383-4270-96f0-4bd109099bf8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046890 Aug 04 14:14:45.387394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1883/3744] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:14:45.538887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2f507e54-242b-4626-be27-9f0876dbdc0a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:45.572556 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2f507e54-242b-4626-be27-9f0876dbdc0a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1318 microversion: 2.1 time: 0.629223 Aug 04 14:14:45.573771 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1862/3745] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:44 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1318 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:45.778071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e08b0a98-3b7a-410c-befb-6bbbab015934 req-3834b65a-946f-48d0-afe0-221c4e29038d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e03570-2c81-4cfa-bf53-a020e35cf3ff", "tag": "8f560447-b2ce-4ba1-8f95-c14326135739"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:45.795822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e08b0a98-3b7a-410c-befb-6bbbab015934 req-3834b65a-946f-48d0-afe0-221c4e29038d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:45.796759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e08b0a98-3b7a-410c-befb-6bbbab015934 req-3834b65a-946f-48d0-afe0-221c4e29038d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:45.834844 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e08b0a98-3b7a-410c-befb-6bbbab015934 req-3834b65a-946f-48d0-afe0-221c4e29038d service nova] Creating event network-changed:8f560447-b2ce-4ba1-8f95-c14326135739 for instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff on n-h2-844627-10 Aug 04 14:14:45.840442 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e08b0a98-3b7a-410c-befb-6bbbab015934 req-3834b65a-946f-48d0-afe0-221c4e29038d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071430 Aug 04 14:14:45.841606 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1884/3746] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:45.941913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-db5f23a4-79a7-4269-9472-751914b46f11 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:45.944095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-db5f23a4-79a7-4269-9472-751914b46f11 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:45.954508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db5f23a4-79a7-4269-9472-751914b46f11 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:45.954980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db5f23a4-79a7-4269-9472-751914b46f11 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:45.958824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db5f23a4-79a7-4269-9472-751914b46f11 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:45.958824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db5f23a4-79a7-4269-9472-751914b46f11 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:45.988102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:45.992276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:46.011453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:46.017105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:46.018892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:46.020360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:46.550082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-db5f23a4-79a7-4269-9472-751914b46f11 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:46.572002 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-db5f23a4-79a7-4269-9472-751914b46f11 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1317 microversion: 2.1 time: 0.633417 Aug 04 14:14:46.573791 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1863/3747] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:45 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:14:46.600522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-968a2a5f-1489-4130-a25d-f105e1a72f8d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:46.601308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-968a2a5f-1489-4130-a25d-f105e1a72f8d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:46.610920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-968a2a5f-1489-4130-a25d-f105e1a72f8d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:46.611398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-968a2a5f-1489-4130-a25d-f105e1a72f8d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:46.612216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-968a2a5f-1489-4130-a25d-f105e1a72f8d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:46.612669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-968a2a5f-1489-4130-a25d-f105e1a72f8d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:46.927763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:46.955001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:46.959994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:46.966586 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fcdd6172-95cf-4c04-99ad-1f3d096ca26c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.987086 Aug 04 14:14:46.968696 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1885/3748] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:45 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:47.294170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-968a2a5f-1489-4130-a25d-f105e1a72f8d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:47.307372 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-968a2a5f-1489-4130-a25d-f105e1a72f8d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1318 microversion: 2.1 time: 0.714299 Aug 04 14:14:47.310025 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1864/3749] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:46 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:14:47.417772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-cb716fec-1f17-4995-90e5-6abab9d613c0 req-bcb7e643-e85c-4424-884c-ed65028f0ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "tag": "33360f7e-a160-4b97-8979-cdcad2ec3c38"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:47.447110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cb716fec-1f17-4995-90e5-6abab9d613c0 req-bcb7e643-e85c-4424-884c-ed65028f0ac0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:47.448403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cb716fec-1f17-4995-90e5-6abab9d613c0 req-bcb7e643-e85c-4424-884c-ed65028f0ac0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:47.472439 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-cb716fec-1f17-4995-90e5-6abab9d613c0 req-bcb7e643-e85c-4424-884c-ed65028f0ac0 service nova] Creating event network-changed:33360f7e-a160-4b97-8979-cdcad2ec3c38 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:14:47.482617 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-cb716fec-1f17-4995-90e5-6abab9d613c0 req-bcb7e643-e85c-4424-884c-ed65028f0ac0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071564 Aug 04 14:14:47.484925 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1886/3750] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:47.599879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4aab11bd-964b-4f6c-83d0-40d988f05392 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:47.601185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4aab11bd-964b-4f6c-83d0-40d988f05392 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:47.614816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4aab11bd-964b-4f6c-83d0-40d988f05392 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:47.615557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4aab11bd-964b-4f6c-83d0-40d988f05392 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:47.617702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4aab11bd-964b-4f6c-83d0-40d988f05392 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:47.618872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4aab11bd-964b-4f6c-83d0-40d988f05392 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:48.025956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:48.034176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:48.058753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:48.060459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:48.063513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:48.065219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:48.248954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4aab11bd-964b-4f6c-83d0-40d988f05392 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:48.266203 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4aab11bd-964b-4f6c-83d0-40d988f05392 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1317 microversion: 2.1 time: 0.672071 Aug 04 14:14:48.267181 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1865/3751] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:47 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:48.337334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-616b65b8-32f1-4c89-b4dd-254502b6de3c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:48.341217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-616b65b8-32f1-4c89-b4dd-254502b6de3c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:48.357319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-616b65b8-32f1-4c89-b4dd-254502b6de3c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:48.360527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-616b65b8-32f1-4c89-b4dd-254502b6de3c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:48.362630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-616b65b8-32f1-4c89-b4dd-254502b6de3c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:48.363811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-616b65b8-32f1-4c89-b4dd-254502b6de3c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:49.452761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:49.463704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:49.465465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:49.467095 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a8c32b35-c259-4a56-b6fb-8aea48d97c14 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.456925 Aug 04 14:14:49.469000 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1887/3752] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:48 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:49.474217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7fbd776-6713-4981-b16d-95f85d137c9a tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:49.475268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7fbd776-6713-4981-b16d-95f85d137c9a tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:49.482082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fbd776-6713-4981-b16d-95f85d137c9a tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:49.482938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fbd776-6713-4981-b16d-95f85d137c9a tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:49.484174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fbd776-6713-4981-b16d-95f85d137c9a tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:49.484961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fbd776-6713-4981-b16d-95f85d137c9a tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:49.620743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-616b65b8-32f1-4c89-b4dd-254502b6de3c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:49.638339 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-616b65b8-32f1-4c89-b4dd-254502b6de3c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1318 microversion: 2.1 time: 1.309893 Aug 04 14:14:49.644142 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1866/3753] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:48 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1318 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:14:49.662106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-337d66e8-6952-4261-bea1-b7531bb88cfb req-dc8199ca-d377-423a-ac7d-19d9001e5bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "name": "network-vif-plugged", "status": "completed", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:49.688528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-337d66e8-6952-4261-bea1-b7531bb88cfb req-dc8199ca-d377-423a-ac7d-19d9001e5bd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:49.689383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-337d66e8-6952-4261-bea1-b7531bb88cfb req-dc8199ca-d377-423a-ac7d-19d9001e5bd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:49.728593 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-337d66e8-6952-4261-bea1-b7531bb88cfb req-dc8199ca-d377-423a-ac7d-19d9001e5bd4 service nova] Creating event network-vif-plugged:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:14:49.738922 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-337d66e8-6952-4261-bea1-b7531bb88cfb req-dc8199ca-d377-423a-ac7d-19d9001e5bd4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091626 Aug 04 14:14:49.740105 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1867/3754] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:50.270433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f7fbd776-6713-4981-b16d-95f85d137c9a tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:50.280801 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7fbd776-6713-4981-b16d-95f85d137c9a tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1317 microversion: 2.1 time: 0.809710 Aug 04 14:14:50.282077 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1888/3755] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:49 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:50.440519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-888178d8-970d-41a2-b9e0-918adf85887e req-8862411c-f942-45a8-b0da-5265fc67b79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "tag": "66b17b90-0211-4216-98ba-ebedb5d38090"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:50.464657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-888178d8-970d-41a2-b9e0-918adf85887e req-8862411c-f942-45a8-b0da-5265fc67b79a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:50.465503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-888178d8-970d-41a2-b9e0-918adf85887e req-8862411c-f942-45a8-b0da-5265fc67b79a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:50.519049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:50.520074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:50.524276 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-888178d8-970d-41a2-b9e0-918adf85887e req-8862411c-f942-45a8-b0da-5265fc67b79a service nova] Creating event network-changed:66b17b90-0211-4216-98ba-ebedb5d38090 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:14:50.537786 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-888178d8-970d-41a2-b9e0-918adf85887e req-8862411c-f942-45a8-b0da-5265fc67b79a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116646 Aug 04 14:14:50.538890 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1868/3756] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:50.550393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:50.551691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:50.553532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:50.554320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:50.684456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f14ead6e-6526-47b5-bbdd-92c1308264d0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:50.686073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f14ead6e-6526-47b5-bbdd-92c1308264d0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:50.703193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f14ead6e-6526-47b5-bbdd-92c1308264d0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:50.707645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f14ead6e-6526-47b5-bbdd-92c1308264d0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:50.708845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f14ead6e-6526-47b5-bbdd-92c1308264d0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:50.710187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f14ead6e-6526-47b5-bbdd-92c1308264d0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:50.988813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:51.027520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f14ead6e-6526-47b5-bbdd-92c1308264d0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:51.038245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:51.050286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:51.063778 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-da7e2200-aa8f-4c6f-9c88-ab648eeb3e4f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.549027 Aug 04 14:14:51.073846 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f14ead6e-6526-47b5-bbdd-92c1308264d0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1318 microversion: 2.1 time: 0.388581 Aug 04 14:14:51.075718 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1869/3757] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:50 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:14:51.085388 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1889/3758] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:50 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:51.318787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9b4529f-4c97-49d8-96c4-b16a7037f096 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:51.319700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b9b4529f-4c97-49d8-96c4-b16a7037f096 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:51.329318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9b4529f-4c97-49d8-96c4-b16a7037f096 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:51.330134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9b4529f-4c97-49d8-96c4-b16a7037f096 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:51.331753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9b4529f-4c97-49d8-96c4-b16a7037f096 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:51.332412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9b4529f-4c97-49d8-96c4-b16a7037f096 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:51.364447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:51.839564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-31a0297f-47fe-4d5a-b2f5-4c9c314286db req-7ee5f1b5-b634-462d-a657-b91ce7c2dd8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947e83c8-b972-4b3b-9d18-dff9147dfaa3", "name": "network-vif-plugged", "status": "completed", "tag": "82964c2a-4b01-4d01-8cdc-b5aeb8dc5650"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:51.865474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-31a0297f-47fe-4d5a-b2f5-4c9c314286db req-7ee5f1b5-b634-462d-a657-b91ce7c2dd8d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:51.867187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-31a0297f-47fe-4d5a-b2f5-4c9c314286db req-7ee5f1b5-b634-462d-a657-b91ce7c2dd8d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:51.897462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b9b4529f-4c97-49d8-96c4-b16a7037f096 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:51.914416 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b9b4529f-4c97-49d8-96c4-b16a7037f096 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1317 microversion: 2.1 time: 0.599421 Aug 04 14:14:51.929905 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-31a0297f-47fe-4d5a-b2f5-4c9c314286db req-7ee5f1b5-b634-462d-a657-b91ce7c2dd8d service nova] Creating event network-vif-plugged:82964c2a-4b01-4d01-8cdc-b5aeb8dc5650 for instance 947e83c8-b972-4b3b-9d18-dff9147dfaa3 on n-h2-844627-10 Aug 04 14:14:51.931094 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1870/3759] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:51 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:51.944506 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-31a0297f-47fe-4d5a-b2f5-4c9c314286db req-7ee5f1b5-b634-462d-a657-b91ce7c2dd8d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129184 Aug 04 14:14:51.945712 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1890/3760] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:14:52.136977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae396a8e-7e7d-43e1-8f5b-eb19ae28a6cf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:52.137637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ae396a8e-7e7d-43e1-8f5b-eb19ae28a6cf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:52.141510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:52.142578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:52.157573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae396a8e-7e7d-43e1-8f5b-eb19ae28a6cf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:52.158408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae396a8e-7e7d-43e1-8f5b-eb19ae28a6cf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:52.162024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae396a8e-7e7d-43e1-8f5b-eb19ae28a6cf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:52.162884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae396a8e-7e7d-43e1-8f5b-eb19ae28a6cf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:52.164091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:52.164662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:52.168557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:52.169616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:52.229588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:53.249857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae396a8e-7e7d-43e1-8f5b-eb19ae28a6cf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:53.297691 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae396a8e-7e7d-43e1-8f5b-eb19ae28a6cf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1318 microversion: 2.1 time: 1.170319 Aug 04 14:14:53.299301 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1871/3761] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:52 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1318 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:53.307973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4f34c4e-bcca-4ad1-be83-1dede697b28c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:53.322227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f4f34c4e-bcca-4ad1-be83-1dede697b28c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:53.351614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:53.363720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4f34c4e-bcca-4ad1-be83-1dede697b28c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:53.365399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4f34c4e-bcca-4ad1-be83-1dede697b28c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:53.368485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4f34c4e-bcca-4ad1-be83-1dede697b28c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:53.371117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4f34c4e-bcca-4ad1-be83-1dede697b28c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:53.413130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:53.420940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:53.426112 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-01974ac4-34ac-4a8d-826d-87ae8847a4f0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.291232 Aug 04 14:14:53.440993 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1891/3762] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:52 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:54.008957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2580617d-bcdc-4fbc-9988-072987c46dd9 req-5fd23d04-4187-4185-b4f2-6531a09dc8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf59c44-a78d-447f-9fcf-af72d1a1c5a7", "name": "network-vif-plugged", "status": "completed", "tag": "cf69197c-9e04-41e7-a095-dcc5ebd940f1"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:54.011940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f4f34c4e-bcca-4ad1-be83-1dede697b28c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:54.024850 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4f34c4e-bcca-4ad1-be83-1dede697b28c tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1317 microversion: 2.1 time: 0.724273 Aug 04 14:14:54.026962 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1872/3763] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:53 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1317 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:54.071651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2580617d-bcdc-4fbc-9988-072987c46dd9 req-5fd23d04-4187-4185-b4f2-6531a09dc8a6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:54.075396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2580617d-bcdc-4fbc-9988-072987c46dd9 req-5fd23d04-4187-4185-b4f2-6531a09dc8a6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:54.100513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0bb45530-902d-4d5f-8cf1-a8e28d8c6cf9 req-b0fe1e34-559b-45da-93b4-9b05cb73f272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "tag": "2929d1af-7745-46e1-b7dd-8c5635506a57"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:54.134700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0bb45530-902d-4d5f-8cf1-a8e28d8c6cf9 req-b0fe1e34-559b-45da-93b4-9b05cb73f272 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:54.135880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0bb45530-902d-4d5f-8cf1-a8e28d8c6cf9 req-b0fe1e34-559b-45da-93b4-9b05cb73f272 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:54.176557 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0bb45530-902d-4d5f-8cf1-a8e28d8c6cf9 req-b0fe1e34-559b-45da-93b4-9b05cb73f272 service nova] Creating event network-changed:2929d1af-7745-46e1-b7dd-8c5635506a57 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:14:54.184009 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2580617d-bcdc-4fbc-9988-072987c46dd9 req-5fd23d04-4187-4185-b4f2-6531a09dc8a6 service nova] Creating event network-vif-plugged:cf69197c-9e04-41e7-a095-dcc5ebd940f1 for instance dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 on n-h1-844627-10 Aug 04 14:14:54.193047 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0bb45530-902d-4d5f-8cf1-a8e28d8c6cf9 req-b0fe1e34-559b-45da-93b4-9b05cb73f272 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095899 Aug 04 14:14:54.205819 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2580617d-bcdc-4fbc-9988-072987c46dd9 req-5fd23d04-4187-4185-b4f2-6531a09dc8a6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209867 Aug 04 14:14:54.210285 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1873/3764] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:54.212057 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1892/3765] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:54.351904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b000363-ebfd-402f-84a9-f50764b81ef1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:54.360564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b000363-ebfd-402f-84a9-f50764b81ef1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:54.384825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b000363-ebfd-402f-84a9-f50764b81ef1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:54.391496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b000363-ebfd-402f-84a9-f50764b81ef1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:54.394971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b000363-ebfd-402f-84a9-f50764b81ef1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:54.398296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b000363-ebfd-402f-84a9-f50764b81ef1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:54.479575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:54.486041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:54.491251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:14:54.511136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:54.515824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:54.517906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:54.520162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:55.605448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4b000363-ebfd-402f-84a9-f50764b81ef1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:55.635359 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4b000363-ebfd-402f-84a9-f50764b81ef1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1318 microversion: 2.1 time: 1.297027 Aug 04 14:14:55.636978 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1874/3766] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:54 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1318 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:55.652582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b97229d1-811d-47c3-873d-cb331e2d3439 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:55.656734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b97229d1-811d-47c3-873d-cb331e2d3439 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:55.714462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b97229d1-811d-47c3-873d-cb331e2d3439 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:55.715038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b97229d1-811d-47c3-873d-cb331e2d3439 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:55.715974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b97229d1-811d-47c3-873d-cb331e2d3439 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:55.716379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b97229d1-811d-47c3-873d-cb331e2d3439 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:56.200215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:56.254944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:56.275889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:56.287085 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-19f0abfb-8c80-41ae-8fe9-958f635c7a0d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.831556 Aug 04 14:14:56.294021 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1893/3767] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:54 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:14:56.682490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-679e9fb4-1d98-43f4-a8b7-63bba79dba67 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:56.685560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-679e9fb4-1d98-43f4-a8b7-63bba79dba67 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:56.707130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-679e9fb4-1d98-43f4-a8b7-63bba79dba67 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:56.708110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-679e9fb4-1d98-43f4-a8b7-63bba79dba67 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:56.710091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-679e9fb4-1d98-43f4-a8b7-63bba79dba67 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:56.711060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-679e9fb4-1d98-43f4-a8b7-63bba79dba67 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:56.729030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b97229d1-811d-47c3-873d-cb331e2d3439 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:56.786191 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b97229d1-811d-47c3-873d-cb331e2d3439 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1504 microversion: 2.1 time: 1.146379 Aug 04 14:14:56.789961 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1875/3768] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:55 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1504 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:56.834641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7c25456-6dff-4893-9611-e2b0e9a158b6 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:56.836904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7c25456-6dff-4893-9611-e2b0e9a158b6 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: dbf59c44-a78d-447f-9fcf-af72d1a1c5a7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:56.850551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7c25456-6dff-4893-9611-e2b0e9a158b6 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:56.852673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7c25456-6dff-4893-9611-e2b0e9a158b6 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:56.855107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7c25456-6dff-4893-9611-e2b0e9a158b6 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:56.856359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7c25456-6dff-4893-9611-e2b0e9a158b6 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:57.890088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-679e9fb4-1d98-43f4-a8b7-63bba79dba67 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:57.902505 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-679e9fb4-1d98-43f4-a8b7-63bba79dba67 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1318 microversion: 2.1 time: 1.230623 Aug 04 14:14:57.915789 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1894/3769] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:56 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1318 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:57.936312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:57.936988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:57.960687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:57.961467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:57.966534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:57.968404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:58.245038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7c25456-6dff-4893-9611-e2b0e9a158b6 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:58.262099 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7c25456-6dff-4893-9611-e2b0e9a158b6 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7" status: 200 len: 1504 microversion: 2.1 time: 1.437445 Aug 04 14:14:58.278173 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1876/3770] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:56 2022] GET /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 => generated 1504 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:58.288582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-29982aca-bd5c-4f55-aeea-9a787279002f req-7ebb1621-e3d7-45ff-aef6-a054a9f70258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e03570-2c81-4cfa-bf53-a020e35cf3ff", "name": "network-vif-plugged", "status": "completed", "tag": "8f560447-b2ce-4ba1-8f95-c14326135739"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:58.314525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-29982aca-bd5c-4f55-aeea-9a787279002f req-7ebb1621-e3d7-45ff-aef6-a054a9f70258 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:58.314969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-29982aca-bd5c-4f55-aeea-9a787279002f req-7ebb1621-e3d7-45ff-aef6-a054a9f70258 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:58.340919 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-29982aca-bd5c-4f55-aeea-9a787279002f req-7ebb1621-e3d7-45ff-aef6-a054a9f70258 service nova] Creating event network-vif-plugged:8f560447-b2ce-4ba1-8f95-c14326135739 for instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff on n-h2-844627-10 Aug 04 14:14:58.355695 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-29982aca-bd5c-4f55-aeea-9a787279002f req-7ebb1621-e3d7-45ff-aef6-a054a9f70258 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076075 Aug 04 14:14:58.357021 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1877/3771] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:58.382428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22af003a-b98a-4132-81e1-74715f718d9d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:58.385860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22af003a-b98a-4132-81e1-74715f718d9d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: dbf59c44-a78d-447f-9fcf-af72d1a1c5a7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:58.402327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22af003a-b98a-4132-81e1-74715f718d9d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:58.405326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22af003a-b98a-4132-81e1-74715f718d9d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:58.411246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22af003a-b98a-4132-81e1-74715f718d9d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:58.412063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22af003a-b98a-4132-81e1-74715f718d9d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:58.604057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:58.624646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:58.629681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:58.639535 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-130a13be-3c58-4b41-82ef-ce1c05bc7b38 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.722408 Aug 04 14:14:58.640546 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1895/3772] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:57 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:14:58.645293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22af003a-b98a-4132-81e1-74715f718d9d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: dbf59c44-a78d-447f-9fcf-af72d1a1c5a7] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:14:58.856699 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22af003a-b98a-4132-81e1-74715f718d9d tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7" status: 204 len: 0 microversion: 2.1 time: 0.497559 Aug 04 14:14:58.857499 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1878/3773] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:14:58 2022] DELETE /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:14:58.868974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e3fabc90-ecba-44a8-97a7-106e05fc5550 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:58.869835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e3fabc90-ecba-44a8-97a7-106e05fc5550 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:58.883562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3fabc90-ecba-44a8-97a7-106e05fc5550 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:58.884981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3fabc90-ecba-44a8-97a7-106e05fc5550 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:58.887493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3fabc90-ecba-44a8-97a7-106e05fc5550 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:58.891525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3fabc90-ecba-44a8-97a7-106e05fc5550 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:58.966155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-614b857a-05d7-4c84-86c6-cb548a95bb0d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:58.970177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-614b857a-05d7-4c84-86c6-cb548a95bb0d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:59.007082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e3fabc90-ecba-44a8-97a7-106e05fc5550 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:14:59.008326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-614b857a-05d7-4c84-86c6-cb548a95bb0d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:59.009100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-614b857a-05d7-4c84-86c6-cb548a95bb0d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:59.012609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-614b857a-05d7-4c84-86c6-cb548a95bb0d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:59.017602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-614b857a-05d7-4c84-86c6-cb548a95bb0d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:59.278862 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e3fabc90-ecba-44a8-97a7-106e05fc5550 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "DELETE /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 204 len: 0 microversion: 2.1 time: 0.414443 Aug 04 14:14:59.285763 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1896/3774] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:14:58 2022] DELETE /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:14:59.317343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-499b9d9a-b84c-408b-96f8-997a06c8e97e req-1cbfc2f1-0c89-4ce9-a341-cd1b6fa10077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "tag": "c7dc083d-72bd-44a5-a860-49733935c554"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:14:59.346980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-499b9d9a-b84c-408b-96f8-997a06c8e97e req-1cbfc2f1-0c89-4ce9-a341-cd1b6fa10077 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:59.347930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-499b9d9a-b84c-408b-96f8-997a06c8e97e req-1cbfc2f1-0c89-4ce9-a341-cd1b6fa10077 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:59.369563 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-499b9d9a-b84c-408b-96f8-997a06c8e97e req-1cbfc2f1-0c89-4ce9-a341-cd1b6fa10077 service nova] Creating event network-changed:c7dc083d-72bd-44a5-a860-49733935c554 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:14:59.377673 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-499b9d9a-b84c-408b-96f8-997a06c8e97e req-1cbfc2f1-0c89-4ce9-a341-cd1b6fa10077 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089154 Aug 04 14:14:59.379636 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1897/3775] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:14:59.386525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5dc81b46-8b74-4aa2-98c6-24a1ea450061 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:59.389002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5dc81b46-8b74-4aa2-98c6-24a1ea450061 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: dbf59c44-a78d-447f-9fcf-af72d1a1c5a7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:59.405459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dc81b46-8b74-4aa2-98c6-24a1ea450061 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:59.406910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dc81b46-8b74-4aa2-98c6-24a1ea450061 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:59.408051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dc81b46-8b74-4aa2-98c6-24a1ea450061 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:59.408805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dc81b46-8b74-4aa2-98c6-24a1ea450061 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:59.712833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-614b857a-05d7-4c84-86c6-cb548a95bb0d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:59.729407 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-614b857a-05d7-4c84-86c6-cb548a95bb0d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1318 microversion: 2.1 time: 0.783025 Aug 04 14:14:59.737172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5dc81b46-8b74-4aa2-98c6-24a1ea450061 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:14:59.737717 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1879/3776] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:58 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:59.749334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:14:59.761783 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5dc81b46-8b74-4aa2-98c6-24a1ea450061 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7" status: 200 len: 1510 microversion: 2.1 time: 0.367129 Aug 04 14:14:59.763105 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1898/3777] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:14:59 2022] GET /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:14:59.777402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:14:59.794076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:59.794835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:14:59.796649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:14:59.797336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:00.237795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:00.256690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:00.262769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:00.266977 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-03fee553-3874-47ef-8b31-9638f2e25fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.525110 Aug 04 14:15:00.272323 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1880/3778] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:14:59 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:00.757317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e72245ea-af69-49e5-9b63-472037237a4f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:00.758720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e72245ea-af69-49e5-9b63-472037237a4f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:00.776249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e72245ea-af69-49e5-9b63-472037237a4f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:00.777159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e72245ea-af69-49e5-9b63-472037237a4f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:00.778309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e72245ea-af69-49e5-9b63-472037237a4f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:00.787696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-749caef7-5f95-467c-b6cf-3c1459508627 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:00.791273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-749caef7-5f95-467c-b6cf-3c1459508627 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: dbf59c44-a78d-447f-9fcf-af72d1a1c5a7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:00.794201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e72245ea-af69-49e5-9b63-472037237a4f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:00.830143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-749caef7-5f95-467c-b6cf-3c1459508627 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:00.833190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-749caef7-5f95-467c-b6cf-3c1459508627 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:00.837979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-749caef7-5f95-467c-b6cf-3c1459508627 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:00.841752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-749caef7-5f95-467c-b6cf-3c1459508627 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:02.475667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e72245ea-af69-49e5-9b63-472037237a4f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:02.491882 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e72245ea-af69-49e5-9b63-472037237a4f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1508 microversion: 2.1 time: 1.740294 Aug 04 14:15:02.496990 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1899/3779] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:00 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1508 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:02.507693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:02.508568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:02.523112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:02.523595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:02.528206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:02.528971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:02.768851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-749caef7-5f95-467c-b6cf-3c1459508627 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:02.818473 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-749caef7-5f95-467c-b6cf-3c1459508627 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7" status: 200 len: 1510 microversion: 2.1 time: 2.037317 Aug 04 14:15:02.820307 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1881/3780] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:00 2022] GET /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 => generated 1510 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:02.852318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-151d1281-9ebc-4c47-b90f-84209958e136 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:02.853669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-151d1281-9ebc-4c47-b90f-84209958e136 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:02.881951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-151d1281-9ebc-4c47-b90f-84209958e136 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:02.883193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-151d1281-9ebc-4c47-b90f-84209958e136 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:02.886818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-151d1281-9ebc-4c47-b90f-84209958e136 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:02.888019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-151d1281-9ebc-4c47-b90f-84209958e136 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:03.943561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:03.971638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:03.973406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:04.006281 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1d69a858-2740-485e-809f-482697bcf402 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.503601 Aug 04 14:15:04.011611 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1900/3781] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:02 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:04.337857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-151d1281-9ebc-4c47-b90f-84209958e136 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:04.402020 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-151d1281-9ebc-4c47-b90f-84209958e136 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1508 microversion: 2.1 time: 1.574378 Aug 04 14:15:04.404047 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1882/3782] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:02 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1508 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:04.625471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b8f5193d-17b9-405a-a476-435249e06fd4 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:04.626187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b8f5193d-17b9-405a-a476-435249e06fd4 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:04.639239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8f5193d-17b9-405a-a476-435249e06fd4 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:04.645728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8f5193d-17b9-405a-a476-435249e06fd4 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:04.646873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8f5193d-17b9-405a-a476-435249e06fd4 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:04.647346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8f5193d-17b9-405a-a476-435249e06fd4 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:04.714763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-dd5605ea-6c34-49f1-881e-51b05677a47f req-6ad0688d-0d32-4b93-a2db-49f3de7e61cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf59c44-a78d-447f-9fcf-af72d1a1c5a7", "name": "network-vif-deleted", "tag": "cf69197c-9e04-41e7-a095-dcc5ebd940f1"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:04.732034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b8f5193d-17b9-405a-a476-435249e06fd4 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:15:04.738342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-dd5605ea-6c34-49f1-881e-51b05677a47f req-6ad0688d-0d32-4b93-a2db-49f3de7e61cb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:04.738808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-dd5605ea-6c34-49f1-881e-51b05677a47f req-6ad0688d-0d32-4b93-a2db-49f3de7e61cb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:04.763254 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-dd5605ea-6c34-49f1-881e-51b05677a47f req-6ad0688d-0d32-4b93-a2db-49f3de7e61cb service nova] Creating event network-vif-deleted:cf69197c-9e04-41e7-a095-dcc5ebd940f1 for instance dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 on n-h1-844627-10 Aug 04 14:15:04.778468 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-dd5605ea-6c34-49f1-881e-51b05677a47f req-6ad0688d-0d32-4b93-a2db-49f3de7e61cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.371815 Aug 04 14:15:04.779566 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1883/3783] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:04.791962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:04.792717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: dbf59c44-a78d-447f-9fcf-af72d1a1c5a7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:04.809488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:04.809972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:04.810889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:04.811343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:04.861012 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] HTTP exception thrown: Instance dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 could not be found. Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Request method failure captured: Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 HTTP/1.1 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69QiBoikHDpPm-KC6zMwC6FCozMVOlyPRmVjH1AGndQJUa5Znm9agMf2bF7BnBh03dYFEUzhVUWibFdxD2q_ukN2JI6LS62A3aPt77Gxwdt5q8Uw_6r950G34xrW5JuqEfj3nTCJCb5Vu8UXGPXC28XwVVi7XUVWtGMRTn2AOPj-OA0 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 0904b55b94c5408ca3bc08b4653301f3 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-MultipleCreateTestJSON-1933894208 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0904b55b94c5408ca3bc08b4653301f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0904b55b94c5408ca3bc08b4653301f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0904b55b94c5408ca3bc08b4653301f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0904b55b94c5408ca3bc08b4653301f3"}]}] Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-MultipleCreateTestJSON-1933894208 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 0904b55b94c5408ca3bc08b4653301f3 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1933894208 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-MultipleCreateTestJSON-1933894208-project Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 07dd715cfad74341a2aa0bf9ca4c0d00 Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-MultipleCreateTestJSON-1933894208-project Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 could not be found. Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dbf59c44-a78d-447f-9fcf-af72d1a1c5a7'} Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 could not be found. Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 could not be found. Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:15:04.865376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:15:04.870852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:15:04.870852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:15:04.870852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:15:04.870852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:15:04.870852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:15:04.870852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 could not be found. Aug 04 14:15:04.870852 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:15:04.875110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Returning 404 to user: Instance dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:15:04.877149 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-382db680-37ce-4c90-bda3-7c3f0e3ac6c5 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7" status: 404 len: 111 microversion: 2.1 time: 0.095682 Aug 04 14:15:04.882031 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1884/3784] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:04 2022] GET /compute/v2.1/servers/dbf59c44-a78d-447f-9fcf-af72d1a1c5a7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:15:04.956611 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b8f5193d-17b9-405a-a476-435249e06fd4 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 204 len: 0 microversion: 2.32 time: 0.940665 Aug 04 14:15:04.960897 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1901/3785] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:15:04 2022] DELETE /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 0 bytes in 945 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:15:04.967174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:04.976686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:04.997183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:04.998104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:04.999094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:04.999853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:05.002090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6fb8eb97-b4cc-4da5-9830-badc5d86794e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: .version_select at 0x7f4700491820>, body: {"keypair": {"name": "tempest-keypair-1994326237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWFfMFXoBd15HczZDBZCvIMH1xKEOMZbvrOoCLoR2v43KQIZdd/iAi8QLt2cudSBYgHFvoK3y/Df4WrfbTsQSiORtcEENGX/LYRLCRcskl/u2FbU4TjH4XF3GA6S036cQ=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:05.062181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6fb8eb97-b4cc-4da5-9830-badc5d86794e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:05.084448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6fb8eb97-b4cc-4da5-9830-badc5d86794e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for user 0a5b06982b8b43ef98866e495427d381 and project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:05.112328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:15:05.113070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:15:05.113786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:15:05.114393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:15:05.115168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:15:05.142767 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6fb8eb97-b4cc-4da5-9830-badc5d86794e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.259041 Aug 04 14:15:05.144078 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1885/3786] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:15:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:05.153458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4c65d514-9042-49af-b956-36bb9c8fa733 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:05.154767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c65d514-9042-49af-b956-36bb9c8fa733 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:05.181178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c65d514-9042-49af-b956-36bb9c8fa733 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:05.181655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c65d514-9042-49af-b956-36bb9c8fa733 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:05.191302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c65d514-9042-49af-b956-36bb9c8fa733 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:05.199747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c65d514-9042-49af-b956-36bb9c8fa733 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:05.381024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:05.411734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:05.415138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:05.433213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:05.437867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:05.560464 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c845bde-9956-489b-b699-e4f2a9ce67cd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "POST /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff/action" status: 202 len: 1110 microversion: 2.1 time: 0.597109 Aug 04 14:15:05.591642 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1902/3787] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:15:04 2022] POST /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff/action => generated 1110 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 14:15:05.608636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:05.615880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:05.637152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:05.640391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:05.645338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:05.646708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:06.017613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4c65d514-9042-49af-b956-36bb9c8fa733 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:06.041559 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4c65d514-9042-49af-b956-36bb9c8fa733 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1468 microversion: 2.1 time: 0.893385 Aug 04 14:15:06.046489 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1886/3788] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:05 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1468 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:06.074915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:06.078715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:06.120826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:06.128128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:06.129343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:06.129697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:07.070748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:07.098989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:07.134905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:07.136445 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3f837cc8-40dd-47de-a600-a8edd749b344 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2954 microversion: 2.32 time: 1.542522 Aug 04 14:15:07.137132 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1903/3789] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:05 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2954 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:07.179611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7f36a373-10c9-42c4-887e-357eedc8268d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:07.180234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7f36a373-10c9-42c4-887e-357eedc8268d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:07.189017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f36a373-10c9-42c4-887e-357eedc8268d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:07.189574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f36a373-10c9-42c4-887e-357eedc8268d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:07.190702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f36a373-10c9-42c4-887e-357eedc8268d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:07.191472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f36a373-10c9-42c4-887e-357eedc8268d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:07.202717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:07.510568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7f36a373-10c9-42c4-887e-357eedc8268d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:07.532800 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7f36a373-10c9-42c4-887e-357eedc8268d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1515 microversion: 2.1 time: 0.394047 Aug 04 14:15:07.537343 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1904/3790] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:07 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1515 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:07.554906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:07.563261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:07.596810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:07.599626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:07.604200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:07.605643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:07.769335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:07.769704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:07.773604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lazy-loading 'fault' on Instance uuid 947e83c8-b972-4b3b-9d18-dff9147dfaa3 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:15:07.947599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dd715cfad74341a2aa0bf9ca4c0d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0904b55b94c5408ca3bc08b4653301f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:07.961674 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc1c6182-ff12-403f-bb46-4cd8bdc62722 tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 200 len: 1307 microversion: 2.1 time: 0.421918 Aug 04 14:15:07.978566 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1905/3791] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:07 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:07.986909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:08.007448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-be486ec7-be3e-4ad1-a722-521ee9b6bfcc req-bff8687c-726d-4414-98bc-03d7a68c47d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947e83c8-b972-4b3b-9d18-dff9147dfaa3", "name": "network-vif-deleted", "tag": "82964c2a-4b01-4d01-8cdc-b5aeb8dc5650"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:08.008101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:08.014067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:08.020408 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bcf80efd-61cc-415b-a3e7-0770a2dc0baf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.972179 Aug 04 14:15:08.023548 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1887/3792] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:06 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:08.047702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-be486ec7-be3e-4ad1-a722-521ee9b6bfcc req-bff8687c-726d-4414-98bc-03d7a68c47d8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:08.050752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-be486ec7-be3e-4ad1-a722-521ee9b6bfcc req-bff8687c-726d-4414-98bc-03d7a68c47d8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:08.114751 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-be486ec7-be3e-4ad1-a722-521ee9b6bfcc req-bff8687c-726d-4414-98bc-03d7a68c47d8 service nova] Creating event network-vif-deleted:82964c2a-4b01-4d01-8cdc-b5aeb8dc5650 for instance 947e83c8-b972-4b3b-9d18-dff9147dfaa3 on n-h2-844627-10 Aug 04 14:15:08.137204 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-be486ec7-be3e-4ad1-a722-521ee9b6bfcc req-bff8687c-726d-4414-98bc-03d7a68c47d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157117 Aug 04 14:15:08.138371 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1906/3793] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:08.174769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:08.177376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:08.216655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:08.217568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:08.222758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:08.229230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:08.563189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe33bbb5-39ec-4ce6-b9d1-2bcdd65e3a22 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:08.564672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe33bbb5-39ec-4ce6-b9d1-2bcdd65e3a22 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:08.576662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe33bbb5-39ec-4ce6-b9d1-2bcdd65e3a22 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:08.579226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe33bbb5-39ec-4ce6-b9d1-2bcdd65e3a22 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:08.580595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe33bbb5-39ec-4ce6-b9d1-2bcdd65e3a22 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:08.581523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe33bbb5-39ec-4ce6-b9d1-2bcdd65e3a22 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:09.693797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe33bbb5-39ec-4ce6-b9d1-2bcdd65e3a22 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:09.706041 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe33bbb5-39ec-4ce6-b9d1-2bcdd65e3a22 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1515 microversion: 2.1 time: 1.148568 Aug 04 14:15:09.706663 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1907/3794] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:08 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1515 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:09.725732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:09.728786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] [instance: 947e83c8-b972-4b3b-9d18-dff9147dfaa3] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:09.740893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:09.741688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:09.744391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:09.745142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:09.774719 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] HTTP exception thrown: Instance 947e83c8-b972-4b3b-9d18-dff9147dfaa3 could not be found. Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Request method failure captured: Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 HTTP/1.1 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69QiBoikHDpPm-KC6zMwC6FCozMVOlyPRmVjH1AGndQJUa5Znm9agMf2bF7BnBh03dYFEUzhVUWibFdxD2q_ukN2JI6LS62A3aPt77Gxwdt5q8Uw_6r950G34xrW5JuqEfj3nTCJCb5Vu8UXGPXC28XwVVi7XUVWtGMRTn2AOPj-OA0 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 0904b55b94c5408ca3bc08b4653301f3 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-MultipleCreateTestJSON-1933894208 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0904b55b94c5408ca3bc08b4653301f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0904b55b94c5408ca3bc08b4653301f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0904b55b94c5408ca3bc08b4653301f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0904b55b94c5408ca3bc08b4653301f3"}]}] Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-MultipleCreateTestJSON-1933894208 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 0904b55b94c5408ca3bc08b4653301f3 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1933894208 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-MultipleCreateTestJSON-1933894208-project Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 07dd715cfad74341a2aa0bf9ca4c0d00 Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-MultipleCreateTestJSON-1933894208-project Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 947e83c8-b972-4b3b-9d18-dff9147dfaa3 could not be found. Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '947e83c8-b972-4b3b-9d18-dff9147dfaa3'} Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947e83c8-b972-4b3b-9d18-dff9147dfaa3 could not be found. Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947e83c8-b972-4b3b-9d18-dff9147dfaa3 could not be found. Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:15:09.784835 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:15:09.789945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:15:09.789945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:15:09.789945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:15:09.789945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:15:09.789945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:15:09.789945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947e83c8-b972-4b3b-9d18-dff9147dfaa3 could not be found. Aug 04 14:15:09.789945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:15:09.789945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] Returning 404 to user: Instance 947e83c8-b972-4b3b-9d18-dff9147dfaa3 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:15:09.789945 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-172d06a6-5a19-4d70-8c20-36bd76958acf tempest-MultipleCreateTestJSON-1933894208 tempest-MultipleCreateTestJSON-1933894208-project] 10.222.0.66 "GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3" status: 404 len: 111 microversion: 2.1 time: 0.079152 Aug 04 14:15:09.794144 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1908/3795] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:09 2022] GET /compute/v2.1/servers/947e83c8-b972-4b3b-9d18-dff9147dfaa3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:15:09.806969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:09.807681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:09.826233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:09.830468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:09.831511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:09.831965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:10.424320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:10.478399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:10.482847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:10.485918 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-908b4816-99d7-4acc-9839-3eb2a43c3ead tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2954 microversion: 2.32 time: 2.323811 Aug 04 14:15:10.494843 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1888/3796] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:08 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2954 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:10.536233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1406582882", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92919b9e-87d8-4c0f-81a1-d2a3d627e9d7"}], "security_groups": [{"name": "tempest-securitygroup--882488414"}], "key_name": "tempest-keypair-1994326237", "user_data": "}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:10.582369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:11.254061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] validate_networks() for [('92919b9e-87d8-4c0f-81a1-d2a3d627e9d7', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:15:11.396539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:11.414181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:11.418156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:11.423041 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fb87ebc4-a1b9-4175-b86f-6889e47e53b0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.627547 Aug 04 14:15:11.426116 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1909/3797] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:09 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:11.441290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-646ccc9b-84fa-4b5f-8595-60511739b416 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:11.445594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-646ccc9b-84fa-4b5f-8595-60511739b416 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:11.464414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-646ccc9b-84fa-4b5f-8595-60511739b416 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:11.465288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-646ccc9b-84fa-4b5f-8595-60511739b416 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:11.467041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-646ccc9b-84fa-4b5f-8595-60511739b416 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:11.467779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-646ccc9b-84fa-4b5f-8595-60511739b416 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:12.910462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-646ccc9b-84fa-4b5f-8595-60511739b416 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:12.924015 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-646ccc9b-84fa-4b5f-8595-60511739b416 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1515 microversion: 2.1 time: 1.494866 Aug 04 14:15:12.925252 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1910/3798] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:11 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1515 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:12.953543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:12.955098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:12.968051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:12.969257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:12.972916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:12.974079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:14.268930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:14.294118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:14.297149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:14.299764 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f14166a7-ba87-4311-9d58-9c81ec341131 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2933 microversion: 2.32 time: 1.372599 Aug 04 14:15:14.310828 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1911/3799] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:12 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2933 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:14.331933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:14.336345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:14.363354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:14.364192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:14.371135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:14.371990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:14.987182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:15:14.989018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:15:14.990379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:15:14.991839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:15:14.992934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:15:15.016974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:15.018244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:15.019281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:15.019913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:15.028161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:15.047025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:15.057855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for user 0a5b06982b8b43ef98866e495427d381 and project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:15.111491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:15:15.117920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:15:15.317017 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90bb0e67-62a2-4f3a-83bd-9defb6f90534 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.798909 Aug 04 14:15:15.361398 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1889/3800] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:15:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 4845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:15:15.380497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-4541cf53-1945-4271-9dea-8f2d39a3c020 req-87b175b9-43b3-479b-bdd8-e8a2feadf895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-unplugged", "status": "completed", "tag": "3a7c07f8-c444-4382-b0bd-d61cc53d01fe"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:15.424648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4541cf53-1945-4271-9dea-8f2d39a3c020 req-87b175b9-43b3-479b-bdd8-e8a2feadf895 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:15.428357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4541cf53-1945-4271-9dea-8f2d39a3c020 req-87b175b9-43b3-479b-bdd8-e8a2feadf895 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:15.523542 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-4541cf53-1945-4271-9dea-8f2d39a3c020 req-87b175b9-43b3-479b-bdd8-e8a2feadf895 service nova] Creating event network-vif-unplugged:3a7c07f8-c444-4382-b0bd-d61cc53d01fe for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:15.573402 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-4541cf53-1945-4271-9dea-8f2d39a3c020 req-87b175b9-43b3-479b-bdd8-e8a2feadf895 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.208065 Aug 04 14:15:15.590763 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1890/3801] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:15.626228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb437975-42f5-4a3a-aeb7-88f3b80c3ee1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:15.631941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb437975-42f5-4a3a-aeb7-88f3b80c3ee1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:15.660889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb437975-42f5-4a3a-aeb7-88f3b80c3ee1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:15.668413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb437975-42f5-4a3a-aeb7-88f3b80c3ee1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:15.677536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb437975-42f5-4a3a-aeb7-88f3b80c3ee1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:15.678662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb437975-42f5-4a3a-aeb7-88f3b80c3ee1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:15.996486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:16.031871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:16.034999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:16.036663 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-90553bbb-57c8-478f-a91e-7214cb82ac43 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.727473 Aug 04 14:15:16.039257 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1912/3802] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:14 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:16.080060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:16.080707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:16.100616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:16.101428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:16.105413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:16.109409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:16.841106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cb437975-42f5-4a3a-aeb7-88f3b80c3ee1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:16.865243 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb437975-42f5-4a3a-aeb7-88f3b80c3ee1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1515 microversion: 2.1 time: 1.269986 Aug 04 14:15:16.867048 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1891/3803] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:15 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1515 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:16.888430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d41b353-2c10-4e9b-9c22-27a5a896d948 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:16.896060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7d41b353-2c10-4e9b-9c22-27a5a896d948 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:16.914810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d41b353-2c10-4e9b-9c22-27a5a896d948 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:16.917002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d41b353-2c10-4e9b-9c22-27a5a896d948 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:16.921177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d41b353-2c10-4e9b-9c22-27a5a896d948 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:16.922175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d41b353-2c10-4e9b-9c22-27a5a896d948 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:17.229386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7d41b353-2c10-4e9b-9c22-27a5a896d948 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:17.272485 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7d41b353-2c10-4e9b-9c22-27a5a896d948 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1246 microversion: 2.1 time: 0.396048 Aug 04 14:15:17.278031 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1892/3804] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:16 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1246 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:17.302928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:17.322454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:17.324226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:17.324926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:17.326553 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-471cc9ee-5b3d-4900-aca1-08038e8fc8f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2933 microversion: 2.32 time: 1.264370 Aug 04 14:15:17.327924 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1913/3805] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:16 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2933 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:17.338832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:17.362646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:17.363823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:17.365532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:17.366739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:17.598917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7319e148-8851-49fe-80c1-8020b8c19e67 req-d177b515-e647-49dc-9e66-5a8e83b32c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-unplugged", "status": "completed", "tag": "53371ea6-c477-434e-80e6-d6459f75d410"}, {"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-unplugged", "status": "completed", "tag": "9ffe961b-4486-4a47-94f7-7ba03bbfd645"}, {"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-unplugged", "status": "completed", "tag": "9156d80b-d433-4a64-a4ce-78d05a747b2b"}, {"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-unplugged", "status": "completed", "tag": "6e5b3b8c-2b8f-432f-baa0-7557a9bda99c"}, {"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-unplugged", "status": "completed", "tag": "2e3e1ebb-a26e-4cfc-b649-a6a9ee19768b"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:17.625698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7319e148-8851-49fe-80c1-8020b8c19e67 req-d177b515-e647-49dc-9e66-5a8e83b32c84 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:17.626598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7319e148-8851-49fe-80c1-8020b8c19e67 req-d177b515-e647-49dc-9e66-5a8e83b32c84 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:17.657064 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7319e148-8851-49fe-80c1-8020b8c19e67 req-d177b515-e647-49dc-9e66-5a8e83b32c84 service nova] Creating event network-vif-unplugged:53371ea6-c477-434e-80e6-d6459f75d410 for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:17.657584 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7319e148-8851-49fe-80c1-8020b8c19e67 req-d177b515-e647-49dc-9e66-5a8e83b32c84 service nova] Creating event network-vif-unplugged:9ffe961b-4486-4a47-94f7-7ba03bbfd645 for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:17.658090 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7319e148-8851-49fe-80c1-8020b8c19e67 req-d177b515-e647-49dc-9e66-5a8e83b32c84 service nova] Creating event network-vif-unplugged:9156d80b-d433-4a64-a4ce-78d05a747b2b for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:17.658587 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7319e148-8851-49fe-80c1-8020b8c19e67 req-d177b515-e647-49dc-9e66-5a8e83b32c84 service nova] Creating event network-vif-unplugged:6e5b3b8c-2b8f-432f-baa0-7557a9bda99c for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:17.664956 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7319e148-8851-49fe-80c1-8020b8c19e67 req-d177b515-e647-49dc-9e66-5a8e83b32c84 service nova] Creating event network-vif-unplugged:2e3e1ebb-a26e-4cfc-b649-a6a9ee19768b for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:17.675653 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7319e148-8851-49fe-80c1-8020b8c19e67 req-d177b515-e647-49dc-9e66-5a8e83b32c84 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.081065 Aug 04 14:15:17.679839 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1914/3806] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:15:17.890567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ad6909a-8ebd-493a-b44e-8c64bf462e65 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:17.891280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4ad6909a-8ebd-493a-b44e-8c64bf462e65 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:17.910126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ad6909a-8ebd-493a-b44e-8c64bf462e65 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:17.910585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ad6909a-8ebd-493a-b44e-8c64bf462e65 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:17.911404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ad6909a-8ebd-493a-b44e-8c64bf462e65 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:17.911852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ad6909a-8ebd-493a-b44e-8c64bf462e65 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:18.499479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:18.523145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:18.536070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:18.541067 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e2a046e-69b1-49ab-9416-996338f80502 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.258780 Aug 04 14:15:18.541975 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1893/3807] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:17 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:18.555333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2ecec7a2-06bb-4b1d-9e45-c214af2f51c1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:18.556329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2ecec7a2-06bb-4b1d-9e45-c214af2f51c1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:18.571907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ecec7a2-06bb-4b1d-9e45-c214af2f51c1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:18.572986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ecec7a2-06bb-4b1d-9e45-c214af2f51c1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:18.574093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ecec7a2-06bb-4b1d-9e45-c214af2f51c1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:18.577469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ecec7a2-06bb-4b1d-9e45-c214af2f51c1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:18.810400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2ecec7a2-06bb-4b1d-9e45-c214af2f51c1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:18.829562 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2ecec7a2-06bb-4b1d-9e45-c214af2f51c1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1300 microversion: 2.1 time: 0.285021 Aug 04 14:15:18.832989 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1894/3808] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:18 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1300 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:18.847298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:18.848287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:18.864925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:18.869847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:18.872751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:18.873633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:19.122520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4ad6909a-8ebd-493a-b44e-8c64bf462e65 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:19.138885 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4ad6909a-8ebd-493a-b44e-8c64bf462e65 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1515 microversion: 2.1 time: 1.251720 Aug 04 14:15:19.139327 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1915/3809] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:17 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1515 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:15:19.596890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:19.597850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:19.610079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:19.610539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:19.611344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:19.617471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:19.679766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:19.694483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:19.706940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:19.721223 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-72c1de40-2ab1-440a-842f-8afaaa3870cf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2912 microversion: 2.32 time: 0.874740 Aug 04 14:15:19.737329 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1895/3810] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:18 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2912 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:19.857328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13c48420-22f9-43ee-8f07-717670a90428 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:19.857976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13c48420-22f9-43ee-8f07-717670a90428 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:19.876036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13c48420-22f9-43ee-8f07-717670a90428 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:19.876399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13c48420-22f9-43ee-8f07-717670a90428 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:19.877267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13c48420-22f9-43ee-8f07-717670a90428 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:19.877725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13c48420-22f9-43ee-8f07-717670a90428 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:20.825329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-13c48420-22f9-43ee-8f07-717670a90428 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:20.921263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13c48420-22f9-43ee-8f07-717670a90428 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 1.058841 Aug 04 14:15:20.967214 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1896/3811] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:19 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:15:20.986531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c7b96e79-3f79-4d30-917f-f23a13437f55 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:20.990506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c7b96e79-3f79-4d30-917f-f23a13437f55 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:21.013065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7b96e79-3f79-4d30-917f-f23a13437f55 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:21.014418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7b96e79-3f79-4d30-917f-f23a13437f55 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:21.016392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7b96e79-3f79-4d30-917f-f23a13437f55 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:21.017603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7b96e79-3f79-4d30-917f-f23a13437f55 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:21.135667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:21.198213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:21.203714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:21.206641 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e3df10e9-f65a-4866-ab5f-95a8671fced3 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.613326 Aug 04 14:15:21.223117 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1916/3812] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:19 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:21.256131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:21.262124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:21.280782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:21.282355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:21.284219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:21.285446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:21.941815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:22.012009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:22.017044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:22.021962 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b5e720e2-62ca-4c54-aac1-126138d9a179 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2865 microversion: 2.32 time: 0.795556 Aug 04 14:15:22.024584 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1917/3813] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:21 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2865 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:22.036425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ae309792-445a-4989-8b56-e3b2b711c379 req-4c94549c-cf0f-409a-8b56-05922a927df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-deleted", "tag": "9156d80b-d433-4a64-a4ce-78d05a747b2b"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:22.065767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ae309792-445a-4989-8b56-e3b2b711c379 req-4c94549c-cf0f-409a-8b56-05922a927df8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:22.066626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ae309792-445a-4989-8b56-e3b2b711c379 req-4c94549c-cf0f-409a-8b56-05922a927df8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:22.112808 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ae309792-445a-4989-8b56-e3b2b711c379 req-4c94549c-cf0f-409a-8b56-05922a927df8 service nova] Creating event network-vif-deleted:9156d80b-d433-4a64-a4ce-78d05a747b2b for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:22.144503 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ae309792-445a-4989-8b56-e3b2b711c379 req-4c94549c-cf0f-409a-8b56-05922a927df8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097739 Aug 04 14:15:22.149366 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1918/3814] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:22.207452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b1dfc22-2669-4750-9724-38611ce6f034 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:22.209975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b1dfc22-2669-4750-9724-38611ce6f034 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:22.231116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b1dfc22-2669-4750-9724-38611ce6f034 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:22.235086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b1dfc22-2669-4750-9724-38611ce6f034 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:22.237489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b1dfc22-2669-4750-9724-38611ce6f034 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:22.238386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b1dfc22-2669-4750-9724-38611ce6f034 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:22.257772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c7b96e79-3f79-4d30-917f-f23a13437f55 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:22.323801 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c7b96e79-3f79-4d30-917f-f23a13437f55 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1515 microversion: 2.1 time: 1.351977 Aug 04 14:15:22.324849 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1897/3815] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:20 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1515 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:22.354785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:22.355979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:22.402690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:22.404580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:22.407946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:22.414044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:23.577791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b1dfc22-2669-4750-9724-38611ce6f034 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:23.588829 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b1dfc22-2669-4750-9724-38611ce6f034 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 1.434449 Aug 04 14:15:23.598228 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1919/3816] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:22 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:23.623302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:23.634498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:23.662543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:23.664965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:23.671406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:23.672783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:23.729812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:23.749056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:23.766772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:23.771828 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eeadc37d-448a-42b6-96a5-ab569f77c22f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.445013 Aug 04 14:15:23.774975 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1898/3817] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:22 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:23.786558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e5bb9c1c-db18-455d-b385-495c8dfb5d58 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:23.791140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e5bb9c1c-db18-455d-b385-495c8dfb5d58 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:23.811446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5bb9c1c-db18-455d-b385-495c8dfb5d58 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:23.812344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5bb9c1c-db18-455d-b385-495c8dfb5d58 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:23.813555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5bb9c1c-db18-455d-b385-495c8dfb5d58 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:23.815676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5bb9c1c-db18-455d-b385-495c8dfb5d58 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:24.436906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:24.472518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:24.483370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:24.487951 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-91a89b58-6d97-4ead-8320-37cc2a5ad529 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2751 microversion: 2.32 time: 0.880431 Aug 04 14:15:24.494782 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1920/3818] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:23 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2751 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:24.513521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-33e60293-b0b5-43ca-9f93-38f70f958336 req-3d3dee3c-eb28-47d1-96ff-b5b140bc02f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d", "tag": "89667c90-91f3-4574-83a4-7ed1a8cc99ff"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:24.556829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-33e60293-b0b5-43ca-9f93-38f70f958336 req-3d3dee3c-eb28-47d1-96ff-b5b140bc02f3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:24.558199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-33e60293-b0b5-43ca-9f93-38f70f958336 req-3d3dee3c-eb28-47d1-96ff-b5b140bc02f3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:24.597412 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-33e60293-b0b5-43ca-9f93-38f70f958336 req-3d3dee3c-eb28-47d1-96ff-b5b140bc02f3 service nova] Creating event network-changed:89667c90-91f3-4574-83a4-7ed1a8cc99ff for instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d on n-h1-844627-10 Aug 04 14:15:24.627603 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-33e60293-b0b5-43ca-9f93-38f70f958336 req-3d3dee3c-eb28-47d1-96ff-b5b140bc02f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129994 Aug 04 14:15:24.628803 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1921/3819] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:24.638534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d014af41-3fe8-4e81-8013-fda4fd3611a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:24.651444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d014af41-3fe8-4e81-8013-fda4fd3611a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:24.657987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:24.678270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d014af41-3fe8-4e81-8013-fda4fd3611a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:24.681642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d014af41-3fe8-4e81-8013-fda4fd3611a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:24.687038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d014af41-3fe8-4e81-8013-fda4fd3611a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:24.688219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d014af41-3fe8-4e81-8013-fda4fd3611a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:24.794447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e5bb9c1c-db18-455d-b385-495c8dfb5d58 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:24.824057 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e5bb9c1c-db18-455d-b385-495c8dfb5d58 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1515 microversion: 2.1 time: 1.044325 Aug 04 14:15:24.825220 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1899/3820] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:23 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1515 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:24.837793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:24.838946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:24.862952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:24.865001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:24.867320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:24.868576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:25.030281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:25.094534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=10 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:26.564846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d014af41-3fe8-4e81-8013-fda4fd3611a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:26.587368 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d014af41-3fe8-4e81-8013-fda4fd3611a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 1.956103 Aug 04 14:15:26.588461 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1922/3821] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:24 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:26.631320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2eb87ab6-70f6-4952-ab14-bad6ec9121b3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:26.632036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:26.642919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2eb87ab6-70f6-4952-ab14-bad6ec9121b3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:26.675852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2eb87ab6-70f6-4952-ab14-bad6ec9121b3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:26.676304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2eb87ab6-70f6-4952-ab14-bad6ec9121b3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:26.682134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2eb87ab6-70f6-4952-ab14-bad6ec9121b3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:26.686397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2eb87ab6-70f6-4952-ab14-bad6ec9121b3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:26.709710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:26.720771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:26.727573 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-53d72504-b1f6-4372-ab7c-18f017cf7b7a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.900433 Aug 04 14:15:26.729743 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1900/3822] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:24 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:26.751082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:26.754494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:26.787442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:26.788947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:26.790719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:26.791783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:27.458778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2eb87ab6-70f6-4952-ab14-bad6ec9121b3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:27.463816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:27.481163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:27.508795 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2eb87ab6-70f6-4952-ab14-bad6ec9121b3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.895011 Aug 04 14:15:27.521413 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1923/3823] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:26 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:27.535586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e0453644-cccf-4a2e-b998-d93c7f2ef86f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:27.537198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e0453644-cccf-4a2e-b998-d93c7f2ef86f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:27.542433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:27.551850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0453644-cccf-4a2e-b998-d93c7f2ef86f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:27.552160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:27.553486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0453644-cccf-4a2e-b998-d93c7f2ef86f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:27.555391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0453644-cccf-4a2e-b998-d93c7f2ef86f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:27.556594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0453644-cccf-4a2e-b998-d93c7f2ef86f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:27.562447 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-326e3b72-ac22-4d05-8468-fc1c8fc3c6e2 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2704 microversion: 2.32 time: 0.828159 Aug 04 14:15:27.567402 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1901/3824] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:26 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2704 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:27.596507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-02454a0f-e932-47ff-abc9-5b5e494fae78 req-61e0a9b2-da11-42d3-bf36-304f789deb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-deleted", "tag": "6e5b3b8c-2b8f-432f-baa0-7557a9bda99c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:27.631824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-02454a0f-e932-47ff-abc9-5b5e494fae78 req-61e0a9b2-da11-42d3-bf36-304f789deb1b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:27.632623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-02454a0f-e932-47ff-abc9-5b5e494fae78 req-61e0a9b2-da11-42d3-bf36-304f789deb1b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:27.671564 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-02454a0f-e932-47ff-abc9-5b5e494fae78 req-61e0a9b2-da11-42d3-bf36-304f789deb1b service nova] Creating event network-vif-deleted:6e5b3b8c-2b8f-432f-baa0-7557a9bda99c for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:27.683695 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-02454a0f-e932-47ff-abc9-5b5e494fae78 req-61e0a9b2-da11-42d3-bf36-304f789deb1b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110920 Aug 04 14:15:27.685771 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1902/3825] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:27.705960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5fd645cc-3ad8-4b2b-b328-82f23f1b940d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-368987866"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:27.713393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5fd645cc-3ad8-4b2b-b328-82f23f1b940d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:27.724781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fd645cc-3ad8-4b2b-b328-82f23f1b940d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:27.726496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fd645cc-3ad8-4b2b-b328-82f23f1b940d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:27.730505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fd645cc-3ad8-4b2b-b328-82f23f1b940d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:27.732543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fd645cc-3ad8-4b2b-b328-82f23f1b940d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:28.125450 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5fd645cc-3ad8-4b2b-b328-82f23f1b940d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.436698 Aug 04 14:15:28.142900 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1903/3826] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:15:27 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 14:15:28.165839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fb9f859-c337-4876-854a-ead5be527250 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:28.167609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fb9f859-c337-4876-854a-ead5be527250 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:28.178119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb9f859-c337-4876-854a-ead5be527250 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:28.178923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb9f859-c337-4876-854a-ead5be527250 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:28.179943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb9f859-c337-4876-854a-ead5be527250 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:28.180582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb9f859-c337-4876-854a-ead5be527250 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:28.425948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e0453644-cccf-4a2e-b998-d93c7f2ef86f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:28.470971 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e0453644-cccf-4a2e-b998-d93c7f2ef86f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1515 microversion: 2.1 time: 0.947678 Aug 04 14:15:28.473403 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1924/3827] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:27 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1515 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:28.485201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:28.490147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:28.507564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:28.508300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:28.510344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:28.512689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:28.739622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fb9f859-c337-4876-854a-ead5be527250 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:28.771033 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fb9f859-c337-4876-854a-ead5be527250 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 0.623022 Aug 04 14:15:28.773264 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1904/3828] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:28 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:28.789960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:28.792037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:28.819697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:28.821559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:28.823919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:28.827338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:29.223898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:29.255664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:29.259902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:29.268494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:29.270969 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-27ecac55-1386-47f0-99b5-2c56c5078648 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2371 microversion: 2.32 time: 0.494891 Aug 04 14:15:29.291323 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1905/3829] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:28 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2371 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:29.299826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:29.309441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:29.329457 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-87c4a721-d3fd-493b-8b84-7dbea90b64d7 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.840366 Aug 04 14:15:29.343719 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1925/3830] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:28 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:29.496027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f4b13bf-3fb8-4243-a9b3-55703404c036 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:29.497953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f4b13bf-3fb8-4243-a9b3-55703404c036 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:29.505857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f4b13bf-3fb8-4243-a9b3-55703404c036 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:29.507387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f4b13bf-3fb8-4243-a9b3-55703404c036 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:29.508455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f4b13bf-3fb8-4243-a9b3-55703404c036 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:29.509157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f4b13bf-3fb8-4243-a9b3-55703404c036 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:29.558413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:29.734818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-8d1c0e47-5857-450d-865c-cfcebc3a99f0 req-7a8e10b9-92f7-4bd7-8786-d45b130df642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-deleted", "tag": "9ffe961b-4486-4a47-94f7-7ba03bbfd645"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:29.780284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8d1c0e47-5857-450d-865c-cfcebc3a99f0 req-7a8e10b9-92f7-4bd7-8786-d45b130df642 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:29.781275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8d1c0e47-5857-450d-865c-cfcebc3a99f0 req-7a8e10b9-92f7-4bd7-8786-d45b130df642 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:29.815404 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-8d1c0e47-5857-450d-865c-cfcebc3a99f0 req-7a8e10b9-92f7-4bd7-8786-d45b130df642 service nova] Creating event network-vif-deleted:9ffe961b-4486-4a47-94f7-7ba03bbfd645 for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:29.842748 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-8d1c0e47-5857-450d-865c-cfcebc3a99f0 req-7a8e10b9-92f7-4bd7-8786-d45b130df642 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119288 Aug 04 14:15:29.844667 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1926/3831] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:15:29.854772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0f011c3a-a6c3-4a28-82fa-db1c3e2b054e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:29.856113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0f011c3a-a6c3-4a28-82fa-db1c3e2b054e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:29.869350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f011c3a-a6c3-4a28-82fa-db1c3e2b054e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:29.870380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f011c3a-a6c3-4a28-82fa-db1c3e2b054e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:29.872667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f011c3a-a6c3-4a28-82fa-db1c3e2b054e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:29.874341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f011c3a-a6c3-4a28-82fa-db1c3e2b054e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:29.966658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f4b13bf-3fb8-4243-a9b3-55703404c036 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:30.007116 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f4b13bf-3fb8-4243-a9b3-55703404c036 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1515 microversion: 2.1 time: 0.512858 Aug 04 14:15:30.010562 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1906/3832] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:29 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:15:30.041344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-e458f3d9-5cf3-43ec-ae4d-f784c63cdb0b req-a5c02c46-c9c5-41a7-b81e-483519ac3bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "name": "network-vif-unplugged", "status": "completed", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:30.092932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e458f3d9-5cf3-43ec-ae4d-f784c63cdb0b req-a5c02c46-c9c5-41a7-b81e-483519ac3bde service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:30.099012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e458f3d9-5cf3-43ec-ae4d-f784c63cdb0b req-a5c02c46-c9c5-41a7-b81e-483519ac3bde service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:30.154067 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-e458f3d9-5cf3-43ec-ae4d-f784c63cdb0b req-a5c02c46-c9c5-41a7-b81e-483519ac3bde service nova] Creating event network-vif-unplugged:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:15:30.169743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0f011c3a-a6c3-4a28-82fa-db1c3e2b054e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:30.176724 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-e458f3d9-5cf3-43ec-ae4d-f784c63cdb0b req-a5c02c46-c9c5-41a7-b81e-483519ac3bde service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146992 Aug 04 14:15:30.179329 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1907/3833] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:15:30.181508 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0f011c3a-a6c3-4a28-82fa-db1c3e2b054e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 0.334966 Aug 04 14:15:30.182135 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1927/3834] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:29 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:30.333591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:30.335127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:30.348247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:30.349273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:30.350951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:30.352235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:30.403021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:30.408557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:30.441545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:30.443339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:30.450283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:30.451071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:30.679017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:30.693210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:30.698113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:30.702480 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b8140f31-7322-450d-a77b-f4fe0288a683 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2324 microversion: 2.32 time: 0.373848 Aug 04 14:15:30.706043 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1908/3835] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:30 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2324 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:31.031989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e22a89b-4323-4838-ad4d-5d5e72eb2eea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:31.032970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e22a89b-4323-4838-ad4d-5d5e72eb2eea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:31.048849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e22a89b-4323-4838-ad4d-5d5e72eb2eea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:31.049311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e22a89b-4323-4838-ad4d-5d5e72eb2eea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:31.050334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e22a89b-4323-4838-ad4d-5d5e72eb2eea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:31.050984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e22a89b-4323-4838-ad4d-5d5e72eb2eea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:31.391908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:31.414269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:31.419967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:31.421717 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5039a50a-b1c4-4409-a752-bfc190589a1d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.035043 Aug 04 14:15:31.442424 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1928/3836] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:30 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:31.448666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1896f28e-aa02-4b50-9738-9270931ccdec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:31.449802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1896f28e-aa02-4b50-9738-9270931ccdec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:31.464888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1896f28e-aa02-4b50-9738-9270931ccdec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:31.466160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1896f28e-aa02-4b50-9738-9270931ccdec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:31.467441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1896f28e-aa02-4b50-9738-9270931ccdec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:31.468122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1896f28e-aa02-4b50-9738-9270931ccdec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:32.182377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5e22a89b-4323-4838-ad4d-5d5e72eb2eea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:32.193109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1896f28e-aa02-4b50-9738-9270931ccdec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:32.214421 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e22a89b-4323-4838-ad4d-5d5e72eb2eea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1521 microversion: 2.1 time: 1.186151 Aug 04 14:15:32.220061 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1896f28e-aa02-4b50-9738-9270931ccdec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 0.775604 Aug 04 14:15:32.222194 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1909/3837] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:31 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1521 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:15:32.226000 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1929/3838] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:31 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:32.240774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a3932eb9-934b-4671-824b-d20d6c61d54d req-17d48dab-e244-49b9-9400-3265b8dc5030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-deleted", "tag": "3a7c07f8-c444-4382-b0bd-d61cc53d01fe"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:32.268938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:32.270668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:32.275430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a3932eb9-934b-4671-824b-d20d6c61d54d req-17d48dab-e244-49b9-9400-3265b8dc5030 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:32.279357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a3932eb9-934b-4671-824b-d20d6c61d54d req-17d48dab-e244-49b9-9400-3265b8dc5030 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:32.295382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:32.296768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:32.312454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:32.313950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:32.323991 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a3932eb9-934b-4671-824b-d20d6c61d54d req-17d48dab-e244-49b9-9400-3265b8dc5030 service nova] Creating event network-vif-deleted:3a7c07f8-c444-4382-b0bd-d61cc53d01fe for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:32.342974 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a3932eb9-934b-4671-824b-d20d6c61d54d req-17d48dab-e244-49b9-9400-3265b8dc5030 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115447 Aug 04 14:15:32.346377 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1930/3839] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:32.455687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:32.462302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:32.472743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:32.473296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:32.476330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:32.476795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:33.040798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:33.072962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:33.087540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:33.090501 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4d7c6bc-83b3-4243-b779-426265c9d6a9 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 2167 microversion: 2.32 time: 0.865540 Aug 04 14:15:33.103855 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1910/3840] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:32 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 2167 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:33.281742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13e82398-0db8-4195-a17c-bf1e29d96c4d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:33.282964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13e82398-0db8-4195-a17c-bf1e29d96c4d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:33.300357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:33.311493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:33.314304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13e82398-0db8-4195-a17c-bf1e29d96c4d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:33.318549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13e82398-0db8-4195-a17c-bf1e29d96c4d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:33.320603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:33.321888 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e423ba20-8282-4be4-8db0-d4dd4ac34f29 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.877296 Aug 04 14:15:33.323101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13e82398-0db8-4195-a17c-bf1e29d96c4d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:33.324983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13e82398-0db8-4195-a17c-bf1e29d96c4d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:33.326899 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1931/3841] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:32 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:33.332174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-31d14552-07a4-40c6-a192-7a3fe59ef73f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:33.332817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-31d14552-07a4-40c6-a192-7a3fe59ef73f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:33.359362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31d14552-07a4-40c6-a192-7a3fe59ef73f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:33.359815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31d14552-07a4-40c6-a192-7a3fe59ef73f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:33.361073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31d14552-07a4-40c6-a192-7a3fe59ef73f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:33.361846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31d14552-07a4-40c6-a192-7a3fe59ef73f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:33.743857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-31d14552-07a4-40c6-a192-7a3fe59ef73f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:33.774664 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-31d14552-07a4-40c6-a192-7a3fe59ef73f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 0.446404 Aug 04 14:15:33.775852 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1932/3842] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:33 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:33.784279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-13e82398-0db8-4195-a17c-bf1e29d96c4d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:33.794975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7d5425f5-2420-44f4-99ca-3e7d9cd42f5c req-911144db-6e21-4540-840c-d531c3f8e2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e03570-2c81-4cfa-bf53-a020e35cf3ff", "name": "network-vif-plugged", "status": "completed", "tag": "8f560447-b2ce-4ba1-8f95-c14326135739"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:33.825216 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13e82398-0db8-4195-a17c-bf1e29d96c4d tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1521 microversion: 2.1 time: 0.566034 Aug 04 14:15:33.832092 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1911/3843] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:33 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:33.834914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7d5425f5-2420-44f4-99ca-3e7d9cd42f5c req-911144db-6e21-4540-840c-d531c3f8e2a1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:33.835667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7d5425f5-2420-44f4-99ca-3e7d9cd42f5c req-911144db-6e21-4540-840c-d531c3f8e2a1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:33.882247 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7d5425f5-2420-44f4-99ca-3e7d9cd42f5c req-911144db-6e21-4540-840c-d531c3f8e2a1 service nova] Creating event network-vif-plugged:8f560447-b2ce-4ba1-8f95-c14326135739 for instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff on n-h2-844627-10 Aug 04 14:15:33.896814 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7d5425f5-2420-44f4-99ca-3e7d9cd42f5c req-911144db-6e21-4540-840c-d531c3f8e2a1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118095 Aug 04 14:15:33.898083 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1933/3844] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:34.136009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:34.137972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:34.187596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:34.188202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:34.189665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:34.190433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:34.360080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:34.361656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:34.388488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:34.402526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:34.406630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:34.410656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:34.566937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:34.619457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:34.645121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:34.647049 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-afddb930-8e0f-434a-bcab-22e7f50585b1 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.522506 Aug 04 14:15:34.651296 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1912/3845] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:34 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:34.671241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5c2aa6f5-10bc-47d6-b7a7-ed7f0c47da46 req-2750e7fc-9351-4c83-81d3-4e7d11c045a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2571717c-8f98-4963-bc46-a79f2eed9679", "name": "network-vif-deleted", "tag": "2e3e1ebb-a26e-4cfc-b649-a6a9ee19768b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:34.719494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5c2aa6f5-10bc-47d6-b7a7-ed7f0c47da46 req-2750e7fc-9351-4c83-81d3-4e7d11c045a1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:34.719947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5c2aa6f5-10bc-47d6-b7a7-ed7f0c47da46 req-2750e7fc-9351-4c83-81d3-4e7d11c045a1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:34.786198 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5c2aa6f5-10bc-47d6-b7a7-ed7f0c47da46 req-2750e7fc-9351-4c83-81d3-4e7d11c045a1 service nova] Creating event network-vif-deleted:2e3e1ebb-a26e-4cfc-b649-a6a9ee19768b for instance 2571717c-8f98-4963-bc46-a79f2eed9679 on n-h2-844627-10 Aug 04 14:15:34.792258 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5c2aa6f5-10bc-47d6-b7a7-ed7f0c47da46 req-2750e7fc-9351-4c83-81d3-4e7d11c045a1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139225 Aug 04 14:15:34.803199 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1913/3846] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:34.818366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-92bff263-b58d-4592-8324-635dc455991c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:34.819112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-92bff263-b58d-4592-8324-635dc455991c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:34.847165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92bff263-b58d-4592-8324-635dc455991c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:34.847656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92bff263-b58d-4592-8324-635dc455991c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:34.848482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92bff263-b58d-4592-8324-635dc455991c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:34.848993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92bff263-b58d-4592-8324-635dc455991c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:35.939893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:35.997089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:36.010900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:36.013549 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e09592e2-8735-443a-988b-9ea251a9cef0 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.666739 Aug 04 14:15:36.014651 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1934/3847] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:34 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:36.056545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-92bff263-b58d-4592-8324-635dc455991c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:36.061058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ede4b81-95c3-47dd-8566-615a6c0462bf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:36.065763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ede4b81-95c3-47dd-8566-615a6c0462bf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:36.073796 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-92bff263-b58d-4592-8324-635dc455991c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 1.259696 Aug 04 14:15:36.076134 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1914/3848] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:34 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:36.083054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:36.089397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:36.100827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:36.101665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:36.102674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:36.103308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:36.114668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ede4b81-95c3-47dd-8566-615a6c0462bf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:36.115144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ede4b81-95c3-47dd-8566-615a6c0462bf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:36.116345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ede4b81-95c3-47dd-8566-615a6c0462bf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:36.117336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ede4b81-95c3-47dd-8566-615a6c0462bf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:36.257985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:36.282645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:36.284792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:36.286432 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b9328961-9d79-407d-adcf-4049156ef3f7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.208305 Aug 04 14:15:36.286894 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1915/3849] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:36 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:36.315363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6a112c7c-9aad-4130-a653-3924e24d63e3 req-98f75db2-90bd-4f3f-8e1f-14b4857c4030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d", "name": "network-vif-plugged", "status": "completed", "tag": "89667c90-91f3-4574-83a4-7ed1a8cc99ff"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:36.371948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6a112c7c-9aad-4130-a653-3924e24d63e3 req-98f75db2-90bd-4f3f-8e1f-14b4857c4030 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:36.372178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6a112c7c-9aad-4130-a653-3924e24d63e3 req-98f75db2-90bd-4f3f-8e1f-14b4857c4030 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:36.427746 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6a112c7c-9aad-4130-a653-3924e24d63e3 req-98f75db2-90bd-4f3f-8e1f-14b4857c4030 service nova] Creating event network-vif-plugged:89667c90-91f3-4574-83a4-7ed1a8cc99ff for instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d on n-h1-844627-10 Aug 04 14:15:36.448515 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6a112c7c-9aad-4130-a653-3924e24d63e3 req-98f75db2-90bd-4f3f-8e1f-14b4857c4030 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149495 Aug 04 14:15:36.449305 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1916/3850] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:36.765872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ede4b81-95c3-47dd-8566-615a6c0462bf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:36.782575 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ede4b81-95c3-47dd-8566-615a6c0462bf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1506 microversion: 2.1 time: 0.751009 Aug 04 14:15:36.783192 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1935/3851] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:36 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1506 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:36.811017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76ffb9d8-a665-432e-98af-af3c74da0364 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:36.811633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76ffb9d8-a665-432e-98af-af3c74da0364 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:36.827612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ffb9d8-a665-432e-98af-af3c74da0364 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:36.837661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ffb9d8-a665-432e-98af-af3c74da0364 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:36.838644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ffb9d8-a665-432e-98af-af3c74da0364 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:36.839152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ffb9d8-a665-432e-98af-af3c74da0364 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:37.046767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:37.048413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:37.080201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:37.081409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:37.086119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:37.088406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:37.397156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76ffb9d8-a665-432e-98af-af3c74da0364 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:37.407591 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76ffb9d8-a665-432e-98af-af3c74da0364 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 200 len: 1506 microversion: 2.1 time: 0.601609 Aug 04 14:15:37.412087 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1917/3852] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:36 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 1506 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:15:37.426148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-888ea70c-df52-4078-9cbf-94515e583904 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:37.438294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-888ea70c-df52-4078-9cbf-94515e583904 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:37.464093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-888ea70c-df52-4078-9cbf-94515e583904 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:37.466838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-888ea70c-df52-4078-9cbf-94515e583904 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:37.470834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-888ea70c-df52-4078-9cbf-94515e583904 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:37.473850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-888ea70c-df52-4078-9cbf-94515e583904 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:37.882048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:37.894566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-888ea70c-df52-4078-9cbf-94515e583904 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:37.908830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:37.912976 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-888ea70c-df52-4078-9cbf-94515e583904 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 0.499295 Aug 04 14:15:37.914434 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1918/3853] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:37 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:37.919014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:37.921166 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5142877-bbd4-40f2-8838-af9119a22edf tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.880908 Aug 04 14:15:37.928283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:37.929391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:37.940667 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1936/3854] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:37 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:37.944144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:37.944727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:37.945596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:37.946053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:37.948984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4f343691-7c20-4145-abb5-04d456da1f0c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:37.950740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4f343691-7c20-4145-abb5-04d456da1f0c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:37.962382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f343691-7c20-4145-abb5-04d456da1f0c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:37.963138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f343691-7c20-4145-abb5-04d456da1f0c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:37.964129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f343691-7c20-4145-abb5-04d456da1f0c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:37.964842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f343691-7c20-4145-abb5-04d456da1f0c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:38.000312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4f343691-7c20-4145-abb5-04d456da1f0c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:15:38.113867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:38.131697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:38.135946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:38.139269 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fb7a702-9d3c-4bae-b09e-421445287af7 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.223113 Aug 04 14:15:38.181167 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1919/3855] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:37 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:38.250050 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4f343691-7c20-4145-abb5-04d456da1f0c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 204 len: 0 microversion: 2.1 time: 0.307441 Aug 04 14:15:38.251206 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1937/3856] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:15:37 2022] DELETE /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:15:38.596660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1290056392", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "1b4f866d-e9ad-4302-a20b-1d7a246b12d6"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:38.868852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] validate_networks() for [('1b4f866d-e9ad-4302-a20b-1d7a246b12d6', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:15:38.954289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:38.959730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:38.984594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:38.992217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:38.994535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:38.997754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:40.788298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:40.874090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:40.897758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:40.921631 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-269aca0b-3617-4e74-ac18-e0622397de3d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.962487 Aug 04 14:15:40.926558 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1938/3857] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:38 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:40.955297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0cf35d1d-2163-46bd-bdbb-5e3322426350 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:40.962434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0cf35d1d-2163-46bd-bdbb-5e3322426350 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:41.000591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cf35d1d-2163-46bd-bdbb-5e3322426350 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:41.006148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cf35d1d-2163-46bd-bdbb-5e3322426350 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:41.013077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cf35d1d-2163-46bd-bdbb-5e3322426350 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:41.014238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cf35d1d-2163-46bd-bdbb-5e3322426350 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:41.739116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:15:41.739963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:15:41.740826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:15:41.741833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:15:41.742751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:15:41.749295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:41.795051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:41.796537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:41.806916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:41.810168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:41.893368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Getting quotas for project 5e494ac06713453d9e598f82cdadccd2. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:41.918052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Getting quotas for user cdc33353bb874a57b82deab4669b998c and project 5e494ac06713453d9e598f82cdadccd2. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:41.998306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:15:42.009498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:15:42.344635 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-91e394f6-2328-4a42-aa95-50fe3ea963a3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.757671 Aug 04 14:15:42.351279 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1920/3858] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:15:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:15:42.388311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:42.394392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:42.441972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:42.457979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:42.459855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:42.466465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:43.106334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0cf35d1d-2163-46bd-bdbb-5e3322426350 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:43.114687 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0cf35d1d-2163-46bd-bdbb-5e3322426350 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1367 microversion: 2.1 time: 2.186084 Aug 04 14:15:43.122799 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1939/3859] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:40 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1367 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:43.141970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2872d910-b821-4da7-a7d6-bb40eed61027 req-07ec8a7b-5f87-4870-b213-6abbfb739d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "name": "network-vif-plugged", "status": "completed", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:43.142288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:43.199905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2872d910-b821-4da7-a7d6-bb40eed61027 req-07ec8a7b-5f87-4870-b213-6abbfb739d76 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:43.201909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2872d910-b821-4da7-a7d6-bb40eed61027 req-07ec8a7b-5f87-4870-b213-6abbfb739d76 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:43.228703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:43.244856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:43.248176 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae8210c2-d7cb-4303-9d92-8c136611769c tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.892620 Aug 04 14:15:43.255424 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1921/3860] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:42 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:43.272418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8789eece-48a4-4b8b-8fdf-02a2287defd9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:43.272811 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2872d910-b821-4da7-a7d6-bb40eed61027 req-07ec8a7b-5f87-4870-b213-6abbfb739d76 service nova] Creating event network-vif-plugged:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:15:43.273928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8789eece-48a4-4b8b-8fdf-02a2287defd9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:43.303038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8789eece-48a4-4b8b-8fdf-02a2287defd9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:43.304750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8789eece-48a4-4b8b-8fdf-02a2287defd9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:43.318735 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2872d910-b821-4da7-a7d6-bb40eed61027 req-07ec8a7b-5f87-4870-b213-6abbfb739d76 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181630 Aug 04 14:15:43.319206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8789eece-48a4-4b8b-8fdf-02a2287defd9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:43.320388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8789eece-48a4-4b8b-8fdf-02a2287defd9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:43.323065 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1940/3861] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:43.328937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:43.329662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:43.369882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:43.380654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:43.381843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:43.383164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:43.455939 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8789eece-48a4-4b8b-8fdf-02a2287defd9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/ips" status: 200 len: 151 microversion: 2.20 time: 0.197323 Aug 04 14:15:43.456668 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1922/3862] 10.222.0.66 () {60 vars in 1289 bytes} [Thu Aug 4 14:15:43 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/ips => generated 151 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:15:43.481918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b9007132-c81a-4fa6-a8ba-98c34719828e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:43.484823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b9007132-c81a-4fa6-a8ba-98c34719828e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:43.532380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:44.232403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b9007132-c81a-4fa6-a8ba-98c34719828e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:44.279279 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b9007132-c81a-4fa6-a8ba-98c34719828e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1218 microversion: 2.1 time: 0.818089 Aug 04 14:15:44.286179 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1923/3863] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:43 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1218 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:44.344725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa5a754d-f485-467c-b87b-6e8ac3737109 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:44.346096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa5a754d-f485-467c-b87b-6e8ac3737109 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:44.378815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa5a754d-f485-467c-b87b-6e8ac3737109 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:44.386766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa5a754d-f485-467c-b87b-6e8ac3737109 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:44.388825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa5a754d-f485-467c-b87b-6e8ac3737109 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:44.393603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa5a754d-f485-467c-b87b-6e8ac3737109 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:44.994320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:45.041907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:45.050457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:45.059150 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-74b0a189-0221-4d9a-a498-b2f6dc290fd9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.731032 Aug 04 14:15:45.063523 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1941/3864] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:43 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:45.129794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:45.138557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:45.175408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:45.183954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:45.188790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:45.191495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:45.704791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:45.732620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:45.737186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:45.738468 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8a719682-73e4-4a28-9f65-d5afd820ab36 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.665235 Aug 04 14:15:45.744603 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1942/3865] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:45 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:45.760255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b89f4879-7f8b-48ad-851e-c8465f9df615 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:45.760903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b89f4879-7f8b-48ad-851e-c8465f9df615 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:45.795180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b89f4879-7f8b-48ad-851e-c8465f9df615 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:45.796023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b89f4879-7f8b-48ad-851e-c8465f9df615 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:45.799653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b89f4879-7f8b-48ad-851e-c8465f9df615 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:45.800300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b89f4879-7f8b-48ad-851e-c8465f9df615 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:46.326592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa5a754d-f485-467c-b87b-6e8ac3737109 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:46.339786 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa5a754d-f485-467c-b87b-6e8ac3737109 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1557 microversion: 2.1 time: 2.039311 Aug 04 14:15:46.355834 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1924/3866] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:44 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1557 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:46.375095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:46.376191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:46.393929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:46.394584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:46.397697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:46.401583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:46.474397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b89f4879-7f8b-48ad-851e-c8465f9df615 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:46.564642 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b89f4879-7f8b-48ad-851e-c8465f9df615 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1270 microversion: 2.1 time: 0.800916 Aug 04 14:15:46.591166 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1943/3867] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:45 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1270 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:46.617685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-80b6520f-fd1f-49a7-aca1-9f85f5fb5810 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:46.640258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-80b6520f-fd1f-49a7-aca1-9f85f5fb5810 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:46.730525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80b6520f-fd1f-49a7-aca1-9f85f5fb5810 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:46.731330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80b6520f-fd1f-49a7-aca1-9f85f5fb5810 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:46.732807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80b6520f-fd1f-49a7-aca1-9f85f5fb5810 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:46.752084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80b6520f-fd1f-49a7-aca1-9f85f5fb5810 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:47.485608 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-80b6520f-fd1f-49a7-aca1-9f85f5fb5810 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.892044 Aug 04 14:15:47.488044 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1944/3868] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:15:46 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-interface => generated 284 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:47.527103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-86abf678-0a26-4af2-aa7d-99e9dea2d0bf req-faf2083c-8ff5-4d74-9169-86b995aae975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e03570-2c81-4cfa-bf53-a020e35cf3ff", "name": "network-vif-deleted", "tag": "8f560447-b2ce-4ba1-8f95-c14326135739"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:47.648704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-86abf678-0a26-4af2-aa7d-99e9dea2d0bf req-faf2083c-8ff5-4d74-9169-86b995aae975 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:47.649572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-86abf678-0a26-4af2-aa7d-99e9dea2d0bf req-faf2083c-8ff5-4d74-9169-86b995aae975 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:47.745903 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-86abf678-0a26-4af2-aa7d-99e9dea2d0bf req-faf2083c-8ff5-4d74-9169-86b995aae975 service nova] Creating event network-vif-deleted:8f560447-b2ce-4ba1-8f95-c14326135739 for instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff on n-h2-844627-10 Aug 04 14:15:47.847463 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-86abf678-0a26-4af2-aa7d-99e9dea2d0bf req-faf2083c-8ff5-4d74-9169-86b995aae975 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331222 Aug 04 14:15:47.849317 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1945/3869] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:47.869891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:47.872446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:47.895363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:47.896661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:47.898546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:47.899716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:48.576128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:48.661157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:48.668094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:48.671924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:48.675106 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9e7452a2-3244-47ee-b90e-ddf726d99e47 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.823289 Aug 04 14:15:48.702828 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1946/3870] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:47 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:48.712198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:48.724919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:48.736794 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a21390c7-d5b1-4ac8-b7a1-8a1fb8c3c13e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 2.379715 Aug 04 14:15:48.742872 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1925/3871] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:46 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 2386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:48.749156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b9e95fce-274e-4715-ae61-6169af78c518 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:48.757678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b9e95fce-274e-4715-ae61-6169af78c518 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:48.779634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9e95fce-274e-4715-ae61-6169af78c518 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:48.780829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9e95fce-274e-4715-ae61-6169af78c518 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:48.786846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9e95fce-274e-4715-ae61-6169af78c518 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:48.788232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9e95fce-274e-4715-ae61-6169af78c518 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:49.359633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41d7d33a-d9b6-487c-aac8-f3ef252ad308 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Action: 'create', calling method: .version_select at 0x7f470031aee0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1029113550", "policies": ["affinity"]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:49.414899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-41d7d33a-d9b6-487c-aac8-f3ef252ad308 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:49.430754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-41d7d33a-d9b6-487c-aac8-f3ef252ad308 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:49.494624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b9e95fce-274e-4715-ae61-6169af78c518 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:49.528097 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b9e95fce-274e-4715-ae61-6169af78c518 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1276 microversion: 2.1 time: 0.818871 Aug 04 14:15:49.533688 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1947/3872] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:48 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1276 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:49.751979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:49.754498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:49.766779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:49.769676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:49.771703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:49.773977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:49.785533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-41d7d33a-d9b6-487c-aac8-f3ef252ad308 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:49.849415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-41d7d33a-d9b6-487c-aac8-f3ef252ad308 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:49.918134 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-41d7d33a-d9b6-487c-aac8-f3ef252ad308 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.065956 Aug 04 14:15:49.919409 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1926/3873] 10.222.0.66 () {60 vars in 1174 bytes} [Thu Aug 4 14:15:48 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:49.943446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:49.950356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:49.976824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:49.979044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:49.990869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:49.995137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:50.063466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:50.110567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:50.129979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:50.153837 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3e7f76d2-af95-4302-8fa8-b8b06101a9c8 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.399678 Aug 04 14:15:50.169643 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1948/3874] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:49 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:50.185501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a03553df-6c56-44d6-a16f-d19fbf2d36c5 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Action: 'create', calling method: .version_select at 0x7f46f30eeb80>, body: {"server_group": {"name": "tempest-server-group-833144831", "policies": ["affinity"]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:50.273594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a03553df-6c56-44d6-a16f-d19fbf2d36c5 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:50.299519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a03553df-6c56-44d6-a16f-d19fbf2d36c5 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:50.524261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a03553df-6c56-44d6-a16f-d19fbf2d36c5 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:50.543254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a03553df-6c56-44d6-a16f-d19fbf2d36c5 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:50.576588 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a03553df-6c56-44d6-a16f-d19fbf2d36c5 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.405335 Aug 04 14:15:50.581057 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1949/3875] 10.222.0.66 () {60 vars in 1173 bytes} [Thu Aug 4 14:15:50 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:50.589326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0e7a7cc3-7013-4165-8830-482b480dc8e1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:50.590460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0e7a7cc3-7013-4165-8830-482b480dc8e1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:50.605711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e7a7cc3-7013-4165-8830-482b480dc8e1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:50.606172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e7a7cc3-7013-4165-8830-482b480dc8e1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:50.606997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e7a7cc3-7013-4165-8830-482b480dc8e1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:50.607449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e7a7cc3-7013-4165-8830-482b480dc8e1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:51.674782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:51.707665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e7a7cc3-7013-4165-8830-482b480dc8e1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:51.729930 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0e7a7cc3-7013-4165-8830-482b480dc8e1 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1318 microversion: 2.1 time: 1.147472 Aug 04 14:15:51.731019 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1950/3876] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:50 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1318 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:51.734294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:51.741533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:51.753348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b0a40bec-0c57-4c00-a905-0a85ec7af131 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Action: 'create', calling method: .version_select at 0x7f46f3172430>, body: {"server_group": {"name": "tempest-server-group-833144831", "policies": ["affinity"]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:51.756402 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0441520-e7b9-427f-a411-6d2c0f5f2c5b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.830613 Aug 04 14:15:51.760493 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1927/3877] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:49 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:51.790909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:51.793495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:51.820340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:51.822698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:51.824745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:51.825915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:51.838731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:51.853209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b0a40bec-0c57-4c00-a905-0a85ec7af131 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:51.874811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:51.875392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b0a40bec-0c57-4c00-a905-0a85ec7af131 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:51.943996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:52.002691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b0a40bec-0c57-4c00-a905-0a85ec7af131 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:52.022504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b0a40bec-0c57-4c00-a905-0a85ec7af131 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:52.048366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:52.062016 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b0a40bec-0c57-4c00-a905-0a85ec7af131 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.328007 Aug 04 14:15:52.070279 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1951/3878] 10.222.0.66 () {60 vars in 1173 bytes} [Thu Aug 4 14:15:51 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:52.114268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:52.128106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:52.133672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c66a8f37-3b6b-47bc-885e-89ea345b2ec1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:52.134625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c66a8f37-3b6b-47bc-885e-89ea345b2ec1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:52.142145 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-db21294a-da3c-47e4-9f18-1bcc92cd2862 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.364576 Aug 04 14:15:52.143643 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1928/3879] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:51 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:52.168023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e816633c-31ae-49cf-a1f8-118d8d47b61a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:52.225135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c66a8f37-3b6b-47bc-885e-89ea345b2ec1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:52.226020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c66a8f37-3b6b-47bc-885e-89ea345b2ec1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:52.260695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c66a8f37-3b6b-47bc-885e-89ea345b2ec1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:52.266231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c66a8f37-3b6b-47bc-885e-89ea345b2ec1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:52.289129 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e816633c-31ae-49cf-a1f8-118d8d47b61a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/188b62b8-2dfd-47b3-b489-669fc1266f7b" status: 204 len: 0 microversion: 2.1 time: 0.143591 Aug 04 14:15:52.294849 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1929/3880] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:15:52 2022] DELETE /compute/v2.1/os-server-groups/188b62b8-2dfd-47b3-b489-669fc1266f7b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:15:52.310889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbb9591d-f76f-4b7c-b419-88a35d7f9ba2 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:52.353091 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbb9591d-f76f-4b7c-b419-88a35d7f9ba2 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.055418 Aug 04 14:15:52.363544 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1930/3881] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 14:15:52 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:52.387738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52bcba2b-2abc-42c0-9386-925d2260a26a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:52.484421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-c66a8f37-3b6b-47bc-885e-89ea345b2ec1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lazy-loading 'flavor' on Instance uuid 8b9c2731-512a-423b-a54e-32f7e2171623 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:15:52.569657 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-52bcba2b-2abc-42c0-9386-925d2260a26a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/15d982b4-6d49-485e-a3cf-d68544c8aede" status: 204 len: 0 microversion: 2.1 time: 0.201006 Aug 04 14:15:52.571811 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1931/3882] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:15:52 2022] DELETE /compute/v2.1/os-server-groups/15d982b4-6d49-485e-a3cf-d68544c8aede => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:15:52.600376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-577e64da-0088-4406-b68a-2a2768253644 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:52.646933 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-577e64da-0088-4406-b68a-2a2768253644 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.068094 Aug 04 14:15:52.660499 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1932/3883] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 14:15:52 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:52.688436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d93a271-cd0b-4e49-9a02-269a2aad2b0c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Action: 'create', calling method: .version_select at 0x7f4700a1e670>, body: {"server_group": {"name": "tempest-server-group-1845295909", "policies": ["affinity"]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:52.780684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-1d93a271-cd0b-4e49-9a02-269a2aad2b0c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:52.822160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-1d93a271-cd0b-4e49-9a02-269a2aad2b0c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:53.097284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-1d93a271-cd0b-4e49-9a02-269a2aad2b0c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:53.129729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-1d93a271-cd0b-4e49-9a02-269a2aad2b0c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:53.146877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:15:53.215454 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d93a271-cd0b-4e49-9a02-269a2aad2b0c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.543906 Aug 04 14:15:53.223130 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1933/3884] 10.222.0.66 () {60 vars in 1173 bytes} [Thu Aug 4 14:15:52 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:53.228661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7460f0b1-8ff1-470d-b457-cbab15dbc041 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:53.229344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7460f0b1-8ff1-470d-b457-cbab15dbc041 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:53.249016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7460f0b1-8ff1-470d-b457-cbab15dbc041 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:53.249484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7460f0b1-8ff1-470d-b457-cbab15dbc041 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:53.254127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7460f0b1-8ff1-470d-b457-cbab15dbc041 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:53.254780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7460f0b1-8ff1-470d-b457-cbab15dbc041 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:53.786694 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c66a8f37-3b6b-47bc-885e-89ea345b2ec1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/action" status: 202 len: 0 microversion: 2.20 time: 1.712801 Aug 04 14:15:53.789256 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1952/3885] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 14:15:52 2022] POST /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/action => generated 0 bytes in 1718 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:15:53.800998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:53.801742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:53.833909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:53.834374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:53.846309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:53.849158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:54.988655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7460f0b1-8ff1-470d-b457-cbab15dbc041 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.003783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7460f0b1-8ff1-470d-b457-cbab15dbc041 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1318 microversion: 2.1 time: 1.779265 Aug 04 14:15:55.007489 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1934/3886] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:53 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1318 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:55.019175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:55.020143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:55.035444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:55.042713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:55.044007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:55.044651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:55.073972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.093723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.096371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.101527 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-296d93d7-ac80-4e83-99ff-6590a1bab48c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.307656 Aug 04 14:15:55.105663 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1953/3887] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:53 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:55.116074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c4a5e91c-d80b-4e53-ba83-9e37122f7695 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:55.173159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.185904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.187963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.189696 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-457f7f55-3780-49eb-9cb2-2a014707f2c5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.180770 Aug 04 14:15:55.190897 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1935/3888] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:55 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:55.197179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8cec1c30-7c93-4ddd-a5ca-8eb744b8490d req-26768721-58d3-4e3a-b93e-50b2239fd863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ffdabf-8907-428a-91e2-89a32616e683", "tag": "3767cf18-ff64-4e0e-92ea-2beb69097e3c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:55.207872 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c4a5e91c-d80b-4e53-ba83-9e37122f7695 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/f55ccd9d-c315-4ffc-9a32-689181c4d687" status: 204 len: 0 microversion: 2.1 time: 0.097059 Aug 04 14:15:55.211776 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1954/3889] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:15:55 2022] DELETE /compute/v2.1/os-server-groups/f55ccd9d-c315-4ffc-9a32-689181c4d687 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:15:55.231099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8cec1c30-7c93-4ddd-a5ca-8eb744b8490d req-26768721-58d3-4e3a-b93e-50b2239fd863 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:55.232016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8cec1c30-7c93-4ddd-a5ca-8eb744b8490d req-26768721-58d3-4e3a-b93e-50b2239fd863 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:55.236198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:55.237611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:55.265456 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8cec1c30-7c93-4ddd-a5ca-8eb744b8490d req-26768721-58d3-4e3a-b93e-50b2239fd863 service nova] Creating event network-changed:3767cf18-ff64-4e0e-92ea-2beb69097e3c for instance f3ffdabf-8907-428a-91e2-89a32616e683 on n-h1-844627-10 Aug 04 14:15:55.268229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:55.269159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:55.272105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:55.274119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:55.274760 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8cec1c30-7c93-4ddd-a5ca-8eb744b8490d req-26768721-58d3-4e3a-b93e-50b2239fd863 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081919 Aug 04 14:15:55.276296 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1936/3890] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:55.288653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-15d12f38-ecc7-45ce-a0c2-9e302687eddd req-ab96bf0b-bec6-4b47-a4c0-1d992745aa21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d", "tag": "89667c90-91f3-4574-83a4-7ed1a8cc99ff"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:55.321943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-15d12f38-ecc7-45ce-a0c2-9e302687eddd req-ab96bf0b-bec6-4b47-a4c0-1d992745aa21 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:55.325690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-15d12f38-ecc7-45ce-a0c2-9e302687eddd req-ab96bf0b-bec6-4b47-a4c0-1d992745aa21 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:55.375216 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-15d12f38-ecc7-45ce-a0c2-9e302687eddd req-ab96bf0b-bec6-4b47-a4c0-1d992745aa21 service nova] Creating event network-changed:89667c90-91f3-4574-83a4-7ed1a8cc99ff for instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d on n-h1-844627-10 Aug 04 14:15:55.389715 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-15d12f38-ecc7-45ce-a0c2-9e302687eddd req-ab96bf0b-bec6-4b47-a4c0-1d992745aa21 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111696 Aug 04 14:15:55.397943 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1937/3891] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:55.413382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6abcd6d4-c270-434e-a1d1-bca9a01849ef tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:55.472505 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6abcd6d4-c270-434e-a1d1-bca9a01849ef tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.071862 Aug 04 14:15:55.473713 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1938/3892] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 14:15:55 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:55.502267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c8afd3f-3d41-4757-b9b4-5943627b4059 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Action: 'create', calling method: .version_select at 0x7f4700865280>, body: {"server_group": {"name": "tempest-server-group-732829071", "policies": ["anti-affinity"]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:55.608893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8c8afd3f-3d41-4757-b9b4-5943627b4059 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:55.657295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8c8afd3f-3d41-4757-b9b4-5943627b4059 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:55.936974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.938693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8c8afd3f-3d41-4757-b9b4-5943627b4059 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:15:55.954552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.966404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:55.966809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8c8afd3f-3d41-4757-b9b4-5943627b4059 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:15:55.970224 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ce809cc1-50ca-4596-a538-6b66a2645d5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.756263 Aug 04 14:15:55.973467 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1955/3893] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:55 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:55.982921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-345c4866-1816-41d7-b0dc-5898af723d81 req-1c6fe573-2c38-4845-b19e-ceec31de31a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-plugged", "status": "completed", "tag": "2929d1af-7745-46e1-b7dd-8c5635506a57"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:56.008161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-345c4866-1816-41d7-b0dc-5898af723d81 req-1c6fe573-2c38-4845-b19e-ceec31de31a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:56.008926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-345c4866-1816-41d7-b0dc-5898af723d81 req-1c6fe573-2c38-4845-b19e-ceec31de31a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:56.037754 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8c8afd3f-3d41-4757-b9b4-5943627b4059 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.553759 Aug 04 14:15:56.043013 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1939/3894] 10.222.0.66 () {60 vars in 1173 bytes} [Thu Aug 4 14:15:55 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:15:56.066752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-16b8362a-5104-4c40-b813-3337db0688bd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:56.074074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-16b8362a-5104-4c40-b813-3337db0688bd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:56.101426 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-345c4866-1816-41d7-b0dc-5898af723d81 req-1c6fe573-2c38-4845-b19e-ceec31de31a4 service nova] Creating event network-vif-plugged:2929d1af-7745-46e1-b7dd-8c5635506a57 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:15:56.116200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16b8362a-5104-4c40-b813-3337db0688bd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:56.132117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16b8362a-5104-4c40-b813-3337db0688bd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:56.134099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16b8362a-5104-4c40-b813-3337db0688bd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:56.134667 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-345c4866-1816-41d7-b0dc-5898af723d81 req-1c6fe573-2c38-4845-b19e-ceec31de31a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156074 Aug 04 14:15:56.142378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16b8362a-5104-4c40-b813-3337db0688bd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:56.143869 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1956/3895] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:56.162007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-34273991-1bb8-4b45-9cdd-b88f0b8cdacf tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:56.283357 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-34273991-1bb8-4b45-9cdd-b88f0b8cdacf tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/0dd0301a-62ed-448c-8815-500f0ea64d40" status: 204 len: 0 microversion: 2.1 time: 0.137065 Aug 04 14:15:56.284898 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1957/3896] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:15:56 2022] DELETE /compute/v2.1/os-server-groups/0dd0301a-62ed-448c-8815-500f0ea64d40 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:15:56.304068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:56.305992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:56.337206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:56.348518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:56.350089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:56.352083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:56.978359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-16b8362a-5104-4c40-b813-3337db0688bd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:57.044691 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-16b8362a-5104-4c40-b813-3337db0688bd tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1318 microversion: 2.1 time: 0.997117 Aug 04 14:15:57.053951 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1940/3897] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:56 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1318 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:57.087446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:57.098459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:57.159073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:57.160015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:57.171637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:57.172545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:57.197175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:57.221828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:57.231586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:57.241323 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-61667685-1969-4552-990a-5b3942dd2a01 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.954820 Aug 04 14:15:57.253086 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1958/3898] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:56 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:57.263709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-42d5f8a7-7d89-4244-a055-6a6c8bb0468c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:57.306548 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-42d5f8a7-7d89-4244-a055-6a6c8bb0468c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.059209 Aug 04 14:15:57.308822 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1959/3899] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 14:15:57 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:15:57.333281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:57.336398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:57.375980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:57.377414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:57.384989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:57.393966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:57.572178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:57.595733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:57.601829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:57.606267 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a4574d57-48c1-4b72-a272-40ddd6143036 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.550274 Aug 04 14:15:57.609984 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1941/3900] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:57 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:57.615656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-434340916", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "f4136da3-247b-469d-99e9-dd0e66c55de9"}]}, "os:scheduler_hints": {"group": "6fb1790f-3179-4e3c-9884-54a962f6758d"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:15:57.800417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] validate_networks() for [('f4136da3-247b-469d-99e9-dd0e66c55de9', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:15:58.528806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:58.585721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:58.598439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:58.604496 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-48ca19bc-b8f0-41c0-a5ce-eecacaa6878a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 1.292582 Aug 04 14:15:58.617300 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1960/3901] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:57 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:15:58.632169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4533702-3cdf-480d-ab08-2e16440681d6 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:58.637855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d4533702-3cdf-480d-ab08-2e16440681d6 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:58.672003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4533702-3cdf-480d-ab08-2e16440681d6 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:58.677566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4533702-3cdf-480d-ab08-2e16440681d6 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:58.684677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4533702-3cdf-480d-ab08-2e16440681d6 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:58.685830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4533702-3cdf-480d-ab08-2e16440681d6 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:59.701092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4533702-3cdf-480d-ab08-2e16440681d6 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:15:59.729999 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4533702-3cdf-480d-ab08-2e16440681d6 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1318 microversion: 2.1 time: 1.109614 Aug 04 14:15:59.750180 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1961/3902] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:15:58 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1318 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:15:59.780538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:15:59.788529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:15:59.821350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:59.822123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:15:59.825961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:15:59.829446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:01.031549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:16:01.032805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:16:01.034995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:16:01.035634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:16:01.036261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:16:01.113225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:01.114155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:01.118117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:01.122304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:01.210428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:16:01.239202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:16:01.340400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:16:01.359846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:16:01.564261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:01.572592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:01.643316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:01.656559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:01.662016 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-94a8858d-f3bb-4b32-9a30-dc00cfcae3f9 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.909829 Aug 04 14:16:01.691045 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1962/3903] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:15:59 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:01.704400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3e19dd89-5758-4400-8502-c90d70b3ac1f req-5305f918-a245-4098-964b-5bff86f0f274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-plugged", "status": "completed", "tag": "cf3dc4f5-e181-4296-845f-3b9c2c178bba"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:01.737832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3e19dd89-5758-4400-8502-c90d70b3ac1f req-5305f918-a245-4098-964b-5bff86f0f274 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:01.738692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3e19dd89-5758-4400-8502-c90d70b3ac1f req-5305f918-a245-4098-964b-5bff86f0f274 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:01.764035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:16:01.768288 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3e19dd89-5758-4400-8502-c90d70b3ac1f req-5305f918-a245-4098-964b-5bff86f0f274 service nova] Creating event network-vif-plugged:cf3dc4f5-e181-4296-845f-3b9c2c178bba for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:16:01.778848 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3e19dd89-5758-4400-8502-c90d70b3ac1f req-5305f918-a245-4098-964b-5bff86f0f274 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085077 Aug 04 14:16:01.780487 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1963/3904] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:01.812653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:01.814436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:01.818986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:16:01.837768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:01.840381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:01.845516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:01.846953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:02.055710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=16 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:02.098406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:16:02.176525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Getting quotas for user a94a5b302d6847bfba6c1e01bcbf4239 and project d23326ebe5834dbd8c181aa2f0d4dd36. Resources: {'server_group_members'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:16:02.176791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:02.201519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:02.223757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:02.230206 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cf596634-3dd0-46b0-b9b3-3d446cad77bf tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.447388 Aug 04 14:16:02.234407 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1964/3905] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:01 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:02.274312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:02.275630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:02.305024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:02.306055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:02.308148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:02.309139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:02.344483 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-29c3ea8d-a62d-497a-970d-8f04913c7d9c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.732403 Aug 04 14:16:02.361747 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1942/3906] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:16:02.377113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-708eb77a-edd3-44d6-a0b1-52829e56231a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:02.385026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-708eb77a-edd3-44d6-a0b1-52829e56231a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:02.399820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-708eb77a-edd3-44d6-a0b1-52829e56231a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:02.400279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-708eb77a-edd3-44d6-a0b1-52829e56231a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:02.404764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-708eb77a-edd3-44d6-a0b1-52829e56231a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:02.405330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-708eb77a-edd3-44d6-a0b1-52829e56231a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:03.107925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:03.157835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:03.175113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:03.196674 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5abbeb6-8961-493e-a561-3dbe0997087d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.960159 Aug 04 14:16:03.206846 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1965/3907] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:02 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:03.261990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dab4b5e8-cca0-48c4-b513-5d1df6acede9 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:03.273806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dab4b5e8-cca0-48c4-b513-5d1df6acede9 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:03.373123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-708eb77a-edd3-44d6-a0b1-52829e56231a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:03.383821 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-708eb77a-edd3-44d6-a0b1-52829e56231a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1318 microversion: 2.1 time: 1.020249 Aug 04 14:16:03.384414 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1943/3908] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:02 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1318 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:03.399625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:03.400823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:03.418276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:03.420848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:03.422054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:03.425002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:03.442816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dab4b5e8-cca0-48c4-b513-5d1df6acede9 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:03.455901 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dab4b5e8-cca0-48c4-b513-5d1df6acede9 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1212 microversion: 2.1 time: 0.214191 Aug 04 14:16:03.458116 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1966/3909] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:03 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1212 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:03.474937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:03.478290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:03.495247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:03.496325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:03.497989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:03.498928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:03.971483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:03.988686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:03.997734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:03.999342 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-32cfb756-d7ed-43d6-97e5-af9c0cea2a29 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.539082 Aug 04 14:16:04.003756 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1967/3910] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:03 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:04.016150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c9b6b45a-4a08-48b8-a27e-b05a87e9c651 req-fceb5ded-a355-4654-9344-ddb0dda3a8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-plugged", "status": "completed", "tag": "d470b701-7300-4fa0-a043-83ad11cf1a6e"}, {"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-plugged", "status": "completed", "tag": "66b17b90-0211-4216-98ba-ebedb5d38090"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:04.058463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c9b6b45a-4a08-48b8-a27e-b05a87e9c651 req-fceb5ded-a355-4654-9344-ddb0dda3a8cf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:04.063471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c9b6b45a-4a08-48b8-a27e-b05a87e9c651 req-fceb5ded-a355-4654-9344-ddb0dda3a8cf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:04.105988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:04.123241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:04.123872 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c9b6b45a-4a08-48b8-a27e-b05a87e9c651 req-fceb5ded-a355-4654-9344-ddb0dda3a8cf service nova] Creating event network-vif-plugged:d470b701-7300-4fa0-a043-83ad11cf1a6e for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:16:04.124619 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c9b6b45a-4a08-48b8-a27e-b05a87e9c651 req-fceb5ded-a355-4654-9344-ddb0dda3a8cf service nova] Creating event network-vif-plugged:66b17b90-0211-4216-98ba-ebedb5d38090 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:16:04.128475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:04.133272 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6bb89b73-543d-429e-a133-72c0f93b3ed8 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.741933 Aug 04 14:16:04.134230 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1944/3911] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:03 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:04.137106 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c9b6b45a-4a08-48b8-a27e-b05a87e9c651 req-fceb5ded-a355-4654-9344-ddb0dda3a8cf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.131608 Aug 04 14:16:04.138423 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1968/3912] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:04.254632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:04.255501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:04.266929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:04.272320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:04.273492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:04.274554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:04.421571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62efbc8b-ae69-4812-b2ba-228c424d63c4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:04.424709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-62efbc8b-ae69-4812-b2ba-228c424d63c4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:04.488554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62efbc8b-ae69-4812-b2ba-228c424d63c4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:04.489478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62efbc8b-ae69-4812-b2ba-228c424d63c4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:04.491467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62efbc8b-ae69-4812-b2ba-228c424d63c4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:04.492273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62efbc8b-ae69-4812-b2ba-228c424d63c4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:04.941473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:04.961153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:04.966088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:04.971166 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fbf47c1d-3e0c-4182-89f8-219ff902c71e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.719712 Aug 04 14:16:04.984913 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1945/3913] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:04 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:16:04.987718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c7287ed-2b3f-49c7-b9c7-b3dfa0dbcd37 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:04.988388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c7287ed-2b3f-49c7-b9c7-b3dfa0dbcd37 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:05.007654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c7287ed-2b3f-49c7-b9c7-b3dfa0dbcd37 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:05.008122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c7287ed-2b3f-49c7-b9c7-b3dfa0dbcd37 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:05.010715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c7287ed-2b3f-49c7-b9c7-b3dfa0dbcd37 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:05.011271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c7287ed-2b3f-49c7-b9c7-b3dfa0dbcd37 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:05.405405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-62efbc8b-ae69-4812-b2ba-228c424d63c4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:05.434507 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62efbc8b-ae69-4812-b2ba-228c424d63c4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1318 microversion: 2.1 time: 1.027042 Aug 04 14:16:05.436626 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1969/3914] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:04 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1318 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:05.446889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:05.449073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:05.461737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:05.463023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:05.465506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:05.466898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:05.539372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3c7287ed-2b3f-49c7-b9c7-b3dfa0dbcd37 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:05.554455 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c7287ed-2b3f-49c7-b9c7-b3dfa0dbcd37 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1272 microversion: 2.1 time: 0.578772 Aug 04 14:16:05.561389 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1946/3915] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:04 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1272 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:05.577557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:05.580098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:05.607395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:05.615080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:05.620765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:05.624718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:05.694085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:05.711472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:05.716186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:05.720583 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8288886d-f10f-4a97-8e32-185efab24680 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.280719 Aug 04 14:16:05.721492 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1970/3916] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:05 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:06.002962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:06.003810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:06.018996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:06.022659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:06.023718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:06.026424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:06.690204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:06.720688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:06.728315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:06.736256 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e0e63e0-00a2-4ea6-87f3-4eecff03ae03 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.738650 Aug 04 14:16:06.737314 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1971/3917] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:05 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:16:06.748693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-76c7fda0-7cd2-4173-a4bf-c0f5d3349aad req-cc584ca7-069d-419c-a2d6-cc8fd6445d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-plugged", "status": "completed", "tag": "181b4200-6b0b-4cc8-9f01-1313569bebe5"}, {"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-plugged", "status": "completed", "tag": "c7dc083d-72bd-44a5-a860-49733935c554"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:06.783902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-76c7fda0-7cd2-4173-a4bf-c0f5d3349aad req-cc584ca7-069d-419c-a2d6-cc8fd6445d85 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:06.785683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-76c7fda0-7cd2-4173-a4bf-c0f5d3349aad req-cc584ca7-069d-419c-a2d6-cc8fd6445d85 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:06.853781 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-76c7fda0-7cd2-4173-a4bf-c0f5d3349aad req-cc584ca7-069d-419c-a2d6-cc8fd6445d85 service nova] Creating event network-vif-plugged:181b4200-6b0b-4cc8-9f01-1313569bebe5 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:16:06.858268 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-76c7fda0-7cd2-4173-a4bf-c0f5d3349aad req-cc584ca7-069d-419c-a2d6-cc8fd6445d85 service nova] Creating event network-vif-plugged:c7dc083d-72bd-44a5-a860-49733935c554 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:16:06.890464 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-76c7fda0-7cd2-4173-a4bf-c0f5d3349aad req-cc584ca7-069d-419c-a2d6-cc8fd6445d85 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.150600 Aug 04 14:16:06.901407 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1972/3918] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:06.908049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1008a373-6702-423c-b11f-132571ce6196 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:06.910221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1008a373-6702-423c-b11f-132571ce6196 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:06.924921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1008a373-6702-423c-b11f-132571ce6196 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:06.926451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1008a373-6702-423c-b11f-132571ce6196 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:06.929070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1008a373-6702-423c-b11f-132571ce6196 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:06.929658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1008a373-6702-423c-b11f-132571ce6196 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:07.244069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:07.285138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:07.291925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:07.300003 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-99ab0487-0fef-4ccc-a84a-d91a36f35147 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 1.736880 Aug 04 14:16:07.306436 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1947/3919] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:05 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:07.321315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2468f770-b4bd-4920-9ef5-02ba87295c75 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:07.329669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2468f770-b4bd-4920-9ef5-02ba87295c75 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:07.355266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2468f770-b4bd-4920-9ef5-02ba87295c75 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:07.356458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2468f770-b4bd-4920-9ef5-02ba87295c75 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:07.358176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2468f770-b4bd-4920-9ef5-02ba87295c75 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:07.366618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2468f770-b4bd-4920-9ef5-02ba87295c75 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:07.664781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2468f770-b4bd-4920-9ef5-02ba87295c75 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:07.687438 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2468f770-b4bd-4920-9ef5-02ba87295c75 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1270 microversion: 2.1 time: 0.378091 Aug 04 14:16:07.694561 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1948/3920] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:07 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1270 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:07.714613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:07.715795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:07.730527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:07.753754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:07.754445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:07.755675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:07.756406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:07.834253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1008a373-6702-423c-b11f-132571ce6196 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:07.866595 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1008a373-6702-423c-b11f-132571ce6196 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1318 microversion: 2.1 time: 0.963312 Aug 04 14:16:07.872623 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1973/3921] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:06 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1318 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:07.887924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:07.888747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:07.903615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:07.904831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:07.906134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:07.906927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:07.995953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:08.053981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:08.065122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:08.067268 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b956f9e9-5865-4762-8330-a88c843d9b78 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.370838 Aug 04 14:16:08.084658 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1949/3922] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:07 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:08.333960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:08.335105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:08.353721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:08.354539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:08.357439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:08.358240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:08.426530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:08.442673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:08.444392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:08.446044 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-238e9fd0-5f6a-45e5-9703-a1f1eb4e6ae7 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.571394 Aug 04 14:16:08.449652 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1974/3923] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:07 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:08.714672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3bb2976c-8454-448c-95f2-bfca00bb598a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:08.715442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3bb2976c-8454-448c-95f2-bfca00bb598a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:08.745875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3bb2976c-8454-448c-95f2-bfca00bb598a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:08.746510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3bb2976c-8454-448c-95f2-bfca00bb598a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:08.747382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3bb2976c-8454-448c-95f2-bfca00bb598a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:08.747833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3bb2976c-8454-448c-95f2-bfca00bb598a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:08.965785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:08.981901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:08.983472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:08.984827 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a6674a3f-39d0-4b0e-8dbc-fb8297665dd1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.658589 Aug 04 14:16:08.990543 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1950/3924] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:08 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:08.997908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f6b0ca50-8753-4a17-9efb-ad0781efb5a0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:08.998665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f6b0ca50-8753-4a17-9efb-ad0781efb5a0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:09.019090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6b0ca50-8753-4a17-9efb-ad0781efb5a0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:09.019500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6b0ca50-8753-4a17-9efb-ad0781efb5a0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:09.020309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6b0ca50-8753-4a17-9efb-ad0781efb5a0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:09.025139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6b0ca50-8753-4a17-9efb-ad0781efb5a0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:10.202084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3bb2976c-8454-448c-95f2-bfca00bb598a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:10.222123 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3bb2976c-8454-448c-95f2-bfca00bb598a tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1312 microversion: 2.1 time: 1.511270 Aug 04 14:16:10.222770 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1975/3925] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:08 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1312 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:10.234906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a3d9cc44-dfac-4d2e-bbbd-9b676dded287 req-05c2556d-5047-493f-9fb2-e5bd9099d251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-plugged", "status": "completed", "tag": "33360f7e-a160-4b97-8979-cdcad2ec3c38"}, {"server_uuid": "f3ffdabf-8907-428a-91e2-89a32616e683", "name": "network-vif-plugged", "status": "completed", "tag": "3767cf18-ff64-4e0e-92ea-2beb69097e3c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:10.263438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a3d9cc44-dfac-4d2e-bbbd-9b676dded287 req-05c2556d-5047-493f-9fb2-e5bd9099d251 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:10.263878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a3d9cc44-dfac-4d2e-bbbd-9b676dded287 req-05c2556d-5047-493f-9fb2-e5bd9099d251 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:10.309822 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a3d9cc44-dfac-4d2e-bbbd-9b676dded287 req-05c2556d-5047-493f-9fb2-e5bd9099d251 service nova] Creating event network-vif-plugged:33360f7e-a160-4b97-8979-cdcad2ec3c38 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:16:10.310923 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a3d9cc44-dfac-4d2e-bbbd-9b676dded287 req-05c2556d-5047-493f-9fb2-e5bd9099d251 service nova] Creating event network-vif-plugged:3767cf18-ff64-4e0e-92ea-2beb69097e3c for instance f3ffdabf-8907-428a-91e2-89a32616e683 on n-h1-844627-10 Aug 04 14:16:10.330842 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a3d9cc44-dfac-4d2e-bbbd-9b676dded287 req-05c2556d-5047-493f-9fb2-e5bd9099d251 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.106583 Aug 04 14:16:10.331754 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1976/3926] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:10.358749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f6b0ca50-8753-4a17-9efb-ad0781efb5a0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:10.359277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:10.360048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:10.396939 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f6b0ca50-8753-4a17-9efb-ad0781efb5a0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1318 microversion: 2.1 time: 1.405060 Aug 04 14:16:10.402467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:10.402939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:10.403774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:10.404225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:10.414215 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1951/3927] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:08 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1318 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:10.438099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:10.438738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:10.457165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:10.457625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:10.459843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:10.460372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:10.851918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:10.892272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:10.897269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:10.910724 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6d5259e0-e928-44f1-be0f-84f2477d19f5 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.577350 Aug 04 14:16:10.915663 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1977/3928] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:10 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:10.935422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:10.943496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:10.966535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:10.967776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:10.970319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:10.971402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:11.158631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:11.383062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:11.394886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:11.404033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:11.405472 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9bde52c4-bd4c-4cff-a404-9103f6ca8746 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.986060 Aug 04 14:16:11.406619 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1952/3929] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:10 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:11.424008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1131860a-de7c-4a22-94f6-7e44968c36ae tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:11.425041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1131860a-de7c-4a22-94f6-7e44968c36ae tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:11.436666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1131860a-de7c-4a22-94f6-7e44968c36ae tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:11.455492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1131860a-de7c-4a22-94f6-7e44968c36ae tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:11.456673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1131860a-de7c-4a22-94f6-7e44968c36ae tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:11.457327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1131860a-de7c-4a22-94f6-7e44968c36ae tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:11.811189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:11.837116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:11.839678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:11.841182 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fa0152ff-5b7f-42a6-baed-30d1ebff379a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.920436 Aug 04 14:16:11.841837 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1978/3930] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:10 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:11.854428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6fab8a94-7810-485d-8398-a32650f776ba tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:11.872371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6fab8a94-7810-485d-8398-a32650f776ba tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:11.900921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fab8a94-7810-485d-8398-a32650f776ba tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:11.901396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fab8a94-7810-485d-8398-a32650f776ba tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:11.909600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1131860a-de7c-4a22-94f6-7e44968c36ae tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:11.913429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:11.918689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fab8a94-7810-485d-8398-a32650f776ba tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:11.921781 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1131860a-de7c-4a22-94f6-7e44968c36ae tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1312 microversion: 2.1 time: 0.513792 Aug 04 14:16:11.922789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fab8a94-7810-485d-8398-a32650f776ba tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:11.928638 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1953/3931] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:11 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1312 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:11.959187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:11.960172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:11.973962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:11.975781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:11.980985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:11.982086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:12.160890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:12.176959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:12.186433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:12.187753 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cfea7674-bb9a-413e-8688-48533d43952b tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.233883 Aug 04 14:16:12.188474 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1954/3932] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:11 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:12.198798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f5989fba-4b8d-4278-8157-e5a7dc487977 req-64bc73e6-8a51-4951-b5ec-d1dcfd6403ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e39de8e5-4fe9-4f27-9712-9e55f7aa8873", "tag": "75e0bb21-e231-4303-a555-87e660de6d5b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:12.230289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=46 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:12.243555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f5989fba-4b8d-4278-8157-e5a7dc487977 req-64bc73e6-8a51-4951-b5ec-d1dcfd6403ba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:12.244037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f5989fba-4b8d-4278-8157-e5a7dc487977 req-64bc73e6-8a51-4951-b5ec-d1dcfd6403ba service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:12.277838 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f5989fba-4b8d-4278-8157-e5a7dc487977 req-64bc73e6-8a51-4951-b5ec-d1dcfd6403ba service nova] Creating event network-changed:75e0bb21-e231-4303-a555-87e660de6d5b for instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 on n-h2-844627-10 Aug 04 14:16:12.297463 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f5989fba-4b8d-4278-8157-e5a7dc487977 req-64bc73e6-8a51-4951-b5ec-d1dcfd6403ba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107461 Aug 04 14:16:12.298418 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1955/3933] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:12.442662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:12.446288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:12.466259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:12.466995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:12.470420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:12.472107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:12.552543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6fab8a94-7810-485d-8398-a32650f776ba tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:12.567020 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6fab8a94-7810-485d-8398-a32650f776ba tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1318 microversion: 2.1 time: 0.724041 Aug 04 14:16:12.569648 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1979/3934] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:11 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1318 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:12.873995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:12.876316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:12.891798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:12.895226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:12.896460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:12.900317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:13.059651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.085472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.087722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.089436 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-35709984-22e5-41d1-821f-dd792f712f32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.653565 Aug 04 14:16:13.109226 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1956/3935] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:12 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:16:13.135855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fb39aed-f002-4207-9823-3db4152f3470 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:13.136603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fb39aed-f002-4207-9823-3db4152f3470 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:13.169864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb39aed-f002-4207-9823-3db4152f3470 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:13.170336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb39aed-f002-4207-9823-3db4152f3470 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:13.173223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb39aed-f002-4207-9823-3db4152f3470 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:13.173747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb39aed-f002-4207-9823-3db4152f3470 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:13.450723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:13.611661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.644570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.646963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.648985 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3554be0a-32d6-4b99-a6f8-110aa40cffeb tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1878 microversion: 2.42 time: 0.782654 Aug 04 14:16:13.650897 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1980/3936] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:12 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1878 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:13.661849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:13.662768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:13.672400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:13.673305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:13.674454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:13.675112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:13.680668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fb39aed-f002-4207-9823-3db4152f3470 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.693690 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fb39aed-f002-4207-9823-3db4152f3470 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1312 microversion: 2.1 time: 0.581084 Aug 04 14:16:13.695803 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1957/3937] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:13 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1312 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:13.702912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4c7a542-5adc-48e1-b72b-ceb85bbf0614 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:13.703545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4c7a542-5adc-48e1-b72b-ceb85bbf0614 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:13.715622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4c7a542-5adc-48e1-b72b-ceb85bbf0614 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:13.716400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4c7a542-5adc-48e1-b72b-ceb85bbf0614 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:13.717465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4c7a542-5adc-48e1-b72b-ceb85bbf0614 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:13.718275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4c7a542-5adc-48e1-b72b-ceb85bbf0614 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:13.877848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.892420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.894497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:13.895973 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f4267863-2dd9-4bb6-a6a2-64e179ffb73a tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1605 microversion: 2.32 time: 0.243868 Aug 04 14:16:13.910204 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1981/3938] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:13 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1605 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:14.005153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d4c7a542-5adc-48e1-b72b-ceb85bbf0614 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:14.015693 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4c7a542-5adc-48e1-b72b-ceb85bbf0614 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1509 microversion: 2.1 time: 0.318748 Aug 04 14:16:14.017775 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1958/3939] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:13 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:14.053866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-335246d7-7b04-435d-a52e-0fb825d19fcc tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:14.054995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-335246d7-7b04-435d-a52e-0fb825d19fcc tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:14.065206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-335246d7-7b04-435d-a52e-0fb825d19fcc tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.066193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-335246d7-7b04-435d-a52e-0fb825d19fcc tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:14.066291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-335246d7-7b04-435d-a52e-0fb825d19fcc tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.066721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-335246d7-7b04-435d-a52e-0fb825d19fcc tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:14.137717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:14.138877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:14.194282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.196503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:14.198978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.206535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:14.303779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-335246d7-7b04-435d-a52e-0fb825d19fcc tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:14.314300 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-335246d7-7b04-435d-a52e-0fb825d19fcc tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1509 microversion: 2.1 time: 0.267738 Aug 04 14:16:14.324970 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1982/3940] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:14 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:14.346377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0d2c3654-3801-448d-9d19-c851c6c094ea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:14.349906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0d2c3654-3801-448d-9d19-c851c6c094ea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:14.367926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d2c3654-3801-448d-9d19-c851c6c094ea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.370297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d2c3654-3801-448d-9d19-c851c6c094ea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:14.373640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d2c3654-3801-448d-9d19-c851c6c094ea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.374860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d2c3654-3801-448d-9d19-c851c6c094ea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:14.378625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:14.475808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:14.486521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:14.488832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:14.490531 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c73fa63f-d12c-4687-857e-f77a6de51052 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.358143 Aug 04 14:16:14.507971 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1959/3941] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:14 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:14.577532 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0d2c3654-3801-448d-9d19-c851c6c094ea tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "PUT /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1081 microversion: 2.1 time: 0.235286 Aug 04 14:16:14.587113 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1983/3942] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:16:14 2022] PUT /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1081 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:14.608654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4d2ab21e-760b-4bd2-a250-8e137403a223 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:14.609824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4d2ab21e-760b-4bd2-a250-8e137403a223 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:14.616774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d2ab21e-760b-4bd2-a250-8e137403a223 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.617278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d2ab21e-760b-4bd2-a250-8e137403a223 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:14.618109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d2ab21e-760b-4bd2-a250-8e137403a223 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.618564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d2ab21e-760b-4bd2-a250-8e137403a223 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:14.675700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:14.676338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:14.684842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.685344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:14.686233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:14.686690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:15.095708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4d2ab21e-760b-4bd2-a250-8e137403a223 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:15.112160 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4d2ab21e-760b-4bd2-a250-8e137403a223 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1507 microversion: 2.1 time: 0.509974 Aug 04 14:16:15.124574 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1960/3943] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:14 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1507 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:15.142907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-082f1627-f423-4dc9-9239-d229d96f35af tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:15.161364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-082f1627-f423-4dc9-9239-d229d96f35af tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:15.195844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-082f1627-f423-4dc9-9239-d229d96f35af tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:15.198649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-082f1627-f423-4dc9-9239-d229d96f35af tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:15.205544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-082f1627-f423-4dc9-9239-d229d96f35af tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:15.211037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-082f1627-f423-4dc9-9239-d229d96f35af tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:15.236707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:15.265800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:15.283948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:15.286962 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-31b4f1a2-0e91-478b-9939-5355c76593fe tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 2836 microversion: 2.42 time: 0.615918 Aug 04 14:16:15.299379 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1984/3944] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:14 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 2836 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:16:15.318651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:15.321131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:15.362391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:15.369913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:15.371553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:15.374894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:15.517864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:15.524628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:15.532147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lazy-loading 'fault' on Instance uuid 2571717c-8f98-4963-bc46-a79f2eed9679 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:16:15.737981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:15.790570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:15.800315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e89f60598ac944adb41d17059b568de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f67c0fa1a843dfbcd3e6331300f7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:15.807298 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aea1030c-0d74-46aa-8733-0ecd8f78fa59 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 200 len: 1372 microversion: 2.32 time: 0.505027 Aug 04 14:16:15.810205 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1985/3945] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:15 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 1372 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:15.825342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-56ded16a-9c65-450a-af0e-f3d3484f89b2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:15.826123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-56ded16a-9c65-450a-af0e-f3d3484f89b2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:15.833020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:DELETE=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:15.839465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-082f1627-f423-4dc9-9239-d229d96f35af tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:15.852695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56ded16a-9c65-450a-af0e-f3d3484f89b2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:15.854940 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-082f1627-f423-4dc9-9239-d229d96f35af tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1312 microversion: 2.1 time: 0.728339 Aug 04 14:16:15.855676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56ded16a-9c65-450a-af0e-f3d3484f89b2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:15.855964 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1961/3946] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:15 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1312 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:15.869784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-978601bb-2622-4906-9e48-d0ae64fb9fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:15.871011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-978601bb-2622-4906-9e48-d0ae64fb9fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:15.882462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978601bb-2622-4906-9e48-d0ae64fb9fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:15.883679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978601bb-2622-4906-9e48-d0ae64fb9fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:15.885480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978601bb-2622-4906-9e48-d0ae64fb9fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:15.886631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-978601bb-2622-4906-9e48-d0ae64fb9fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:15.887243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56ded16a-9c65-450a-af0e-f3d3484f89b2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:15.888076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56ded16a-9c65-450a-af0e-f3d3484f89b2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:16.098569 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-978601bb-2622-4906-9e48-d0ae64fb9fcd tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.240327 Aug 04 14:16:16.104200 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1962/3947] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 14:16:15 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238/os-interface => generated 1833 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:16.127675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:16.128326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:16.173448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:16.174757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:16.176205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:16.178811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:16.726946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-56ded16a-9c65-450a-af0e-f3d3484f89b2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:16.745627 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-56ded16a-9c65-450a-af0e-f3d3484f89b2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1507 microversion: 2.1 time: 0.933750 Aug 04 14:16:16.756957 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1986/3948] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:15 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1507 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:16.770998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:16.774043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:16.803497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:16.804791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:16.806559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:16.807667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:16.930662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:16:16.931527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:16:16.932704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:16:16.933343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:16:16.933948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:16:17.071426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:17.081922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.082985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:17.084210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.084919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:17.164233 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4897e441-07c6-4fbd-97d6-a7299633bf6b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "POST /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683/action" status: 202 len: 1113 microversion: 2.1 time: 0.397242 Aug 04 14:16:17.166209 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1987/3949] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:16:16 2022] POST /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683/action => generated 1113 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 14:16:17.179035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:17.179685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:17.194763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.195313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:17.196158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.199851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:17.228845 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] HTTP exception thrown: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Request method failure captured: Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 HTTP/1.1 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LfanTGg88eou2xbiTIqr48KQcIJCPJttG5b4MKwNhnz43BAWXBldkEizPNM5x04jW_iNHIG4YezOmMncuYSyeaxNgPCP47v8Zm_XSo34jCBkdrmWKvMLHqV6EHnaueaylz4fWKojpJsjWw_yMsYS1eLvpI-9xWFLlgQzrpFDWgSZ4 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 17f67c0fa1a843dfbcd3e6331300f7eb Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TaggedBootDevicesTest-2128902326 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/17f67c0fa1a843dfbcd3e6331300f7eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_17f67c0fa1a843dfbcd3e6331300f7eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/17f67c0fa1a843dfbcd3e6331300f7eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/17f67c0fa1a843dfbcd3e6331300f7eb"}]}] Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TaggedBootDevicesTest-2128902326 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 17f67c0fa1a843dfbcd3e6331300f7eb Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2128902326 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TaggedBootDevicesTest-2128902326-project Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: e89f60598ac944adb41d17059b568de9 Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TaggedBootDevicesTest-2128902326-project Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '2571717c-8f98-4963-bc46-a79f2eed9679'} Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:17.232584 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Returning 404 to user: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:17.241658 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c9242109-75dd-4bf6-bcaa-912db007c75e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 404 len: 111 microversion: 2.32 time: 0.069231 Aug 04 14:16:17.244828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:17.254128 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1988/3950] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:17 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:16:17.263706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:17.269396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:17.274250 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5678d33d-f336-40c2-9a8f-642117616533 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1743 microversion: 2.20 time: 1.166700 Aug 04 14:16:17.277563 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1963/3951] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:16 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1743 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:17.279744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a66de2b8-9797-4169-92f1-4c3af3cca8d0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:17.281643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a66de2b8-9797-4169-92f1-4c3af3cca8d0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:17.289054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef4a75e7-c7f3-4b97-b678-64f3d69519f8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:17.289920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ef4a75e7-c7f3-4b97-b678-64f3d69519f8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:17.309177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e7-c7f3-4b97-b678-64f3d69519f8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.310002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e7-c7f3-4b97-b678-64f3d69519f8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:17.314860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e7-c7f3-4b97-b678-64f3d69519f8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.315712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a66de2b8-9797-4169-92f1-4c3af3cca8d0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.316268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef4a75e7-c7f3-4b97-b678-64f3d69519f8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:17.316577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a66de2b8-9797-4169-92f1-4c3af3cca8d0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:17.325451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a66de2b8-9797-4169-92f1-4c3af3cca8d0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.326303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a66de2b8-9797-4169-92f1-4c3af3cca8d0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:17.754011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a66de2b8-9797-4169-92f1-4c3af3cca8d0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:17.771050 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a66de2b8-9797-4169-92f1-4c3af3cca8d0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1312 microversion: 2.1 time: 0.511907 Aug 04 14:16:17.773969 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1989/3952] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:17 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:17.779820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ef4a75e7-c7f3-4b97-b678-64f3d69519f8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:17.781546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9ad2163-e91f-44c6-88fa-0be5e8f26acb tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '.version_select at 0x7f46f38dc8b0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:17.791160 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ef4a75e7-c7f3-4b97-b678-64f3d69519f8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 0.511766 Aug 04 14:16:17.791760 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1964/3953] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:17 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:17.813866 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f9ad2163-e91f-44c6-88fa-0be5e8f26acb tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114232288" status: 204 len: 0 microversion: 2.32 time: 0.038486 Aug 04 14:16:17.817785 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1990/3954] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 14:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114232288 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:16:17.913062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a5ac55c-7255-4316-a0f7-e1ffeec556d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:17.917648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a5ac55c-7255-4316-a0f7-e1ffeec556d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:17.935590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a5ac55c-7255-4316-a0f7-e1ffeec556d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.935815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a5ac55c-7255-4316-a0f7-e1ffeec556d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:17.937212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a5ac55c-7255-4316-a0f7-e1ffeec556d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:17.938345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a5ac55c-7255-4316-a0f7-e1ffeec556d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:18.283079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2a5ac55c-7255-4316-a0f7-e1ffeec556d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:18.301974 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a5ac55c-7255-4316-a0f7-e1ffeec556d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.397879 Aug 04 14:16:18.303252 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1965/3955] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:17 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:18.308685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:18.310415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:18.325211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:18.325474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0438513b-684c-4280-bce1-e66780759f48 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1265188204"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:18.326613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:18.328315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:18.328908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0438513b-684c-4280-bce1-e66780759f48 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:18.329901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:18.340679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0438513b-684c-4280-bce1-e66780759f48 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:18.341197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0438513b-684c-4280-bce1-e66780759f48 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:18.341996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0438513b-684c-4280-bce1-e66780759f48 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:18.357647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0438513b-684c-4280-bce1-e66780759f48 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:18.688555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:18.701299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:18.703264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:18.704554 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba2d8c1e-f65c-4bb1-922e-fa9f712ced5c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1743 microversion: 2.20 time: 0.406825 Aug 04 14:16:18.705157 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1991/3956] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:18 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1743 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:16:18.765692 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0438513b-684c-4280-bce1-e66780759f48 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.444968 Aug 04 14:16:18.767687 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1966/3957] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:16:18 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 04 14:16:18.781686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f0434283-8287-4644-ab0a-dc85034a8b31 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:18.783732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0434283-8287-4644-ab0a-dc85034a8b31 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:18.796607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-841532e4-8cb5-41ae-94d7-e23ea2013753 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:18.797137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0434283-8287-4644-ab0a-dc85034a8b31 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:18.798196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-841532e4-8cb5-41ae-94d7-e23ea2013753 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:18.799128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0434283-8287-4644-ab0a-dc85034a8b31 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:18.801086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0434283-8287-4644-ab0a-dc85034a8b31 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:18.802157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0434283-8287-4644-ab0a-dc85034a8b31 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:18.825678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-841532e4-8cb5-41ae-94d7-e23ea2013753 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:18.826156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-841532e4-8cb5-41ae-94d7-e23ea2013753 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:18.827009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-841532e4-8cb5-41ae-94d7-e23ea2013753 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:18.827461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-841532e4-8cb5-41ae-94d7-e23ea2013753 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:19.075845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f0434283-8287-4644-ab0a-dc85034a8b31 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:19.084855 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f0434283-8287-4644-ab0a-dc85034a8b31 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.310963 Aug 04 14:16:19.089192 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1992/3958] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:18 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:19.117335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9bcaa278-c960-4880-8efd-96cdac134f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:19.122625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9bcaa278-c960-4880-8efd-96cdac134f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:19.139662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bcaa278-c960-4880-8efd-96cdac134f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:19.140561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bcaa278-c960-4880-8efd-96cdac134f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:19.143897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bcaa278-c960-4880-8efd-96cdac134f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:19.145496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bcaa278-c960-4880-8efd-96cdac134f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:19.297357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-841532e4-8cb5-41ae-94d7-e23ea2013753 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:19.363458 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-841532e4-8cb5-41ae-94d7-e23ea2013753 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1312 microversion: 2.1 time: 0.574236 Aug 04 14:16:19.375868 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1967/3959] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:18 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1312 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:19.389091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-139251ee-0d33-475c-9c60-fc6f8d5a69d2 req-bcc48faf-4e64-4ab4-aee6-442f309659a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9c2731-512a-423b-a54e-32f7e2171623", "name": "network-vif-plugged", "status": "completed", "tag": "fcaf7619-ad8a-4c0d-91da-0cf44e564f7f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:19.428856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-139251ee-0d33-475c-9c60-fc6f8d5a69d2 req-bcc48faf-4e64-4ab4-aee6-442f309659a3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:19.429574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-139251ee-0d33-475c-9c60-fc6f8d5a69d2 req-bcc48faf-4e64-4ab4-aee6-442f309659a3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:19.492856 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-139251ee-0d33-475c-9c60-fc6f8d5a69d2 req-bcc48faf-4e64-4ab4-aee6-442f309659a3 service nova] Creating event network-vif-plugged:fcaf7619-ad8a-4c0d-91da-0cf44e564f7f for instance 8b9c2731-512a-423b-a54e-32f7e2171623 on n-h1-844627-10 Aug 04 14:16:19.507130 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-139251ee-0d33-475c-9c60-fc6f8d5a69d2 req-bcc48faf-4e64-4ab4-aee6-442f309659a3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125819 Aug 04 14:16:19.508119 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1968/3960] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:19.514724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-78198ffc-b41d-4abd-91cd-1261334de324 req-4ab1bfa9-4d41-490d-b0d9-5b777b3b5f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "tag": "d470b701-7300-4fa0-a043-83ad11cf1a6e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:19.536518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-78198ffc-b41d-4abd-91cd-1261334de324 req-4ab1bfa9-4d41-490d-b0d9-5b777b3b5f94 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:19.537341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-78198ffc-b41d-4abd-91cd-1261334de324 req-4ab1bfa9-4d41-490d-b0d9-5b777b3b5f94 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:19.555899 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-78198ffc-b41d-4abd-91cd-1261334de324 req-4ab1bfa9-4d41-490d-b0d9-5b777b3b5f94 service nova] Creating event network-changed:d470b701-7300-4fa0-a043-83ad11cf1a6e for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:16:19.565139 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-78198ffc-b41d-4abd-91cd-1261334de324 req-4ab1bfa9-4d41-490d-b0d9-5b777b3b5f94 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054725 Aug 04 14:16:19.567656 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1969/3961] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:19.750034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:19.751036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:19.761031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:19.761794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:19.762728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:19.763085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:19.859105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9bcaa278-c960-4880-8efd-96cdac134f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:19.871626 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9bcaa278-c960-4880-8efd-96cdac134f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 0.768236 Aug 04 14:16:19.872352 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1993/3962] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:19 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:20.115733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c6299d8e-aeb5-4a49-ad00-144d0d37c0db tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:20.117180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c6299d8e-aeb5-4a49-ad00-144d0d37c0db tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:20.127111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6299d8e-aeb5-4a49-ad00-144d0d37c0db tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:20.127814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6299d8e-aeb5-4a49-ad00-144d0d37c0db tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:20.128830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6299d8e-aeb5-4a49-ad00-144d0d37c0db tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:20.129611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6299d8e-aeb5-4a49-ad00-144d0d37c0db tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:20.225084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:20.241567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:20.245657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:20.248920 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f60f86d-d8eb-423d-b84e-0cd9bd279a4f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1743 microversion: 2.20 time: 0.504305 Aug 04 14:16:20.250261 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1970/3963] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:19 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1743 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:20.416706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e07e886-d397-4456-a6b1-520c617171c4 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:20.419673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e07e886-d397-4456-a6b1-520c617171c4 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:20.434219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e07e886-d397-4456-a6b1-520c617171c4 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:20.435295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e07e886-d397-4456-a6b1-520c617171c4 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:20.437475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e07e886-d397-4456-a6b1-520c617171c4 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:20.438546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e07e886-d397-4456-a6b1-520c617171c4 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:20.478800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:21.205507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c6299d8e-aeb5-4a49-ad00-144d0d37c0db tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:21.218407 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c6299d8e-aeb5-4a49-ad00-144d0d37c0db tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 1.108113 Aug 04 14:16:21.219734 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1994/3964] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:20 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:21.237633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d7481df-dc52-40bc-86aa-e2df19479e03 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:21.239956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d7481df-dc52-40bc-86aa-e2df19479e03 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:21.255227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d7481df-dc52-40bc-86aa-e2df19479e03 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:21.256141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d7481df-dc52-40bc-86aa-e2df19479e03 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:21.257450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d7481df-dc52-40bc-86aa-e2df19479e03 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:21.258062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d7481df-dc52-40bc-86aa-e2df19479e03 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:21.528437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3e07e886-d397-4456-a6b1-520c617171c4 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:21.548848 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e07e886-d397-4456-a6b1-520c617171c4 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1312 microversion: 2.1 time: 1.142218 Aug 04 14:16:21.550131 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1971/3965] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:20 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1312 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:21.575526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:21.577684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:21.609733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:21.610544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:21.611369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:21.612084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:21.989908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d7481df-dc52-40bc-86aa-e2df19479e03 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:22.000708 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d7481df-dc52-40bc-86aa-e2df19479e03 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 0.779632 Aug 04 14:16:22.001399 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1995/3966] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:21 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:22.006425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-141333d2-f49f-462b-95ad-35e8c27a49cc req-f837c906-af8f-4761-9290-ff1872fa1505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39de8e5-4fe9-4f27-9712-9e55f7aa8873", "name": "network-vif-plugged", "status": "completed", "tag": "75e0bb21-e231-4303-a555-87e660de6d5b"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:22.042686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-141333d2-f49f-462b-95ad-35e8c27a49cc req-f837c906-af8f-4761-9290-ff1872fa1505 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:22.043211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-141333d2-f49f-462b-95ad-35e8c27a49cc req-f837c906-af8f-4761-9290-ff1872fa1505 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:22.101237 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-141333d2-f49f-462b-95ad-35e8c27a49cc req-f837c906-af8f-4761-9290-ff1872fa1505 service nova] Creating event network-vif-plugged:75e0bb21-e231-4303-a555-87e660de6d5b for instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 on n-h2-844627-10 Aug 04 14:16:22.108368 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-141333d2-f49f-462b-95ad-35e8c27a49cc req-f837c906-af8f-4761-9290-ff1872fa1505 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105649 Aug 04 14:16:22.109639 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1996/3967] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:22.146953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:22.184997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:22.188651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:22.191947 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f53b3f30-9f60-4369-80a1-329ebd22c314 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 0.638906 Aug 04 14:16:22.204110 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1972/3968] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:21 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:22.265809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-990718ae-14ba-4e1c-ad95-81096c55169f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:22.267529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-990718ae-14ba-4e1c-ad95-81096c55169f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:22.277451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-990718ae-14ba-4e1c-ad95-81096c55169f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:22.278128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-990718ae-14ba-4e1c-ad95-81096c55169f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:22.279202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-990718ae-14ba-4e1c-ad95-81096c55169f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:22.279767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-990718ae-14ba-4e1c-ad95-81096c55169f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:22.583383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7ef18a45-9b8a-49ed-95ed-f875b1f2d843 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:22.584794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7ef18a45-9b8a-49ed-95ed-f875b1f2d843 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:22.611024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ef18a45-9b8a-49ed-95ed-f875b1f2d843 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:22.611822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ef18a45-9b8a-49ed-95ed-f875b1f2d843 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:22.618012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ef18a45-9b8a-49ed-95ed-f875b1f2d843 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:22.619449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ef18a45-9b8a-49ed-95ed-f875b1f2d843 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:23.406506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-990718ae-14ba-4e1c-ad95-81096c55169f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:23.417764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7ef18a45-9b8a-49ed-95ed-f875b1f2d843 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:23.434342 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7ef18a45-9b8a-49ed-95ed-f875b1f2d843 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1312 microversion: 2.1 time: 0.865869 Aug 04 14:16:23.435406 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1973/3969] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:22 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1312 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:23.437327 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-990718ae-14ba-4e1c-ad95-81096c55169f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 1.179157 Aug 04 14:16:23.447346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4b669b1-7d51-4bf7-8a7b-de7f4f523c2b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:23.447997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e4b669b1-7d51-4bf7-8a7b-de7f4f523c2b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:23.466353 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1997/3970] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:22 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:23.491759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4b669b1-7d51-4bf7-8a7b-de7f4f523c2b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:23.492974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4b669b1-7d51-4bf7-8a7b-de7f4f523c2b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:23.495131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4b669b1-7d51-4bf7-8a7b-de7f4f523c2b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:23.496146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4b669b1-7d51-4bf7-8a7b-de7f4f523c2b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:23.504282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:23.507429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:23.534366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:23.538500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:23.545143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:23.545676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:23.995021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:24.005145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:24.006717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:24.013170 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e0ea1000-cc7c-4f45-b4c8-5ef16bbf8e44 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 0.542849 Aug 04 14:16:24.018717 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1998/3971] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:23 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:24.035245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e4b669b1-7d51-4bf7-8a7b-de7f4f523c2b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:24.046423 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e4b669b1-7d51-4bf7-8a7b-de7f4f523c2b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 0.609639 Aug 04 14:16:24.047465 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1974/3972] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:23 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:24.136232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7b323e1d-7750-47ef-86c7-42d417fa71c0 req-5b290dfa-c2e8-4d38-be40-3a1dfbf06e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "name": "network-vif-unplugged", "status": "completed", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:24.148314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7b323e1d-7750-47ef-86c7-42d417fa71c0 req-5b290dfa-c2e8-4d38-be40-3a1dfbf06e6f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:24.149501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7b323e1d-7750-47ef-86c7-42d417fa71c0 req-5b290dfa-c2e8-4d38-be40-3a1dfbf06e6f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:24.177023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:24.179999 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7b323e1d-7750-47ef-86c7-42d417fa71c0 req-5b290dfa-c2e8-4d38-be40-3a1dfbf06e6f service nova] Creating event network-vif-unplugged:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:16:24.187940 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7b323e1d-7750-47ef-86c7-42d417fa71c0 req-5b290dfa-c2e8-4d38-be40-3a1dfbf06e6f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055954 Aug 04 14:16:24.188575 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 1999/3973] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:24.492165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5efaf9b3-095c-43ce-8926-afc92b0da807 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:24.503161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-230532ec-f033-42bf-b2c7-a4afbb5f1176 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:24.507471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5efaf9b3-095c-43ce-8926-afc92b0da807 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:24.513972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-230532ec-f033-42bf-b2c7-a4afbb5f1176 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:24.568082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5efaf9b3-095c-43ce-8926-afc92b0da807 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:24.568909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5efaf9b3-095c-43ce-8926-afc92b0da807 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:24.570397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5efaf9b3-095c-43ce-8926-afc92b0da807 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:24.571170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5efaf9b3-095c-43ce-8926-afc92b0da807 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:24.579659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-230532ec-f033-42bf-b2c7-a4afbb5f1176 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:24.580381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-230532ec-f033-42bf-b2c7-a4afbb5f1176 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:24.591497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-230532ec-f033-42bf-b2c7-a4afbb5f1176 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:24.592315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-230532ec-f033-42bf-b2c7-a4afbb5f1176 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:25.090688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-230532ec-f033-42bf-b2c7-a4afbb5f1176 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:25.109914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5efaf9b3-095c-43ce-8926-afc92b0da807 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:25.124234 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-230532ec-f033-42bf-b2c7-a4afbb5f1176 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1687 microversion: 2.1 time: 0.640214 Aug 04 14:16:25.126101 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2000/3974] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:24 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1687 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:25.143048 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5efaf9b3-095c-43ce-8926-afc92b0da807 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1497 microversion: 2.1 time: 0.663749 Aug 04 14:16:25.153580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:25.154468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:25.155716 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1975/3975] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:24 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1497 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:25.173038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75414d60-8fd1-418c-9ce7-2ac941fde3ae tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:25.174013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-75414d60-8fd1-418c-9ce7-2ac941fde3ae tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:25.174157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:25.174909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:25.176357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:25.177212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:25.182495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75414d60-8fd1-418c-9ce7-2ac941fde3ae tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:25.183664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75414d60-8fd1-418c-9ce7-2ac941fde3ae tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:25.185293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75414d60-8fd1-418c-9ce7-2ac941fde3ae tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:25.186090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75414d60-8fd1-418c-9ce7-2ac941fde3ae tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:25.584719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:25.608145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:25.610050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:25.612052 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9de4c528-48f7-4e08-8cb8-daf2a4ba14d3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 0.482960 Aug 04 14:16:25.613048 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2001/3976] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:25 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:25.624227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cad8d490-4f67-4413-b4b7-313ab01aa76c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:25.659227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.compute.server_groups [None req-cad8d490-4f67-4413-b4b7-313ab01aa76c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Querying cell bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) for 1 instances {{(pid=130960) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 14:16:25.665670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cad8d490-4f67-4413-b4b7-313ab01aa76c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:25.667191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cad8d490-4f67-4413-b4b7-313ab01aa76c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:25.693106 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cad8d490-4f67-4413-b4b7-313ab01aa76c tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/6fb1790f-3179-4e3c-9884-54a962f6758d" status: 200 len: 222 microversion: 2.1 time: 0.078506 Aug 04 14:16:25.694338 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2002/3977] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:16:25 2022] GET /compute/v2.1/os-server-groups/6fb1790f-3179-4e3c-9884-54a962f6758d => generated 222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:25.707346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-122d17e6-2342-42c1-acd0-5663c0ccd22b tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:25.708656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-122d17e6-2342-42c1-acd0-5663c0ccd22b tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:25.714271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75414d60-8fd1-418c-9ce7-2ac941fde3ae tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:25.730968 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75414d60-8fd1-418c-9ce7-2ac941fde3ae tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 0.573798 Aug 04 14:16:25.747091 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1976/3978] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:25 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:25.757839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-122d17e6-2342-42c1-acd0-5663c0ccd22b tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:25.758567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-122d17e6-2342-42c1-acd0-5663c0ccd22b tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:25.760100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-122d17e6-2342-42c1-acd0-5663c0ccd22b tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:25.760711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-122d17e6-2342-42c1-acd0-5663c0ccd22b tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:25.793453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-122d17e6-2342-42c1-acd0-5663c0ccd22b tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:16:25.972469 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-122d17e6-2342-42c1-acd0-5663c0ccd22b tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 204 len: 0 microversion: 2.1 time: 0.267658 Aug 04 14:16:25.979326 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2003/3979] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:16:25 2022] DELETE /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:16:25.989392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-26e8837a-a9fb-4430-8654-d62ee55cc49f tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:25.990023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-26e8837a-a9fb-4430-8654-d62ee55cc49f tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:26.011247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26e8837a-a9fb-4430-8654-d62ee55cc49f tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:26.013074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26e8837a-a9fb-4430-8654-d62ee55cc49f tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:26.015225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26e8837a-a9fb-4430-8654-d62ee55cc49f tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:26.022970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26e8837a-a9fb-4430-8654-d62ee55cc49f tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:26.182463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75e48cae-3b2b-4201-a73a-24f0f81c9844 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:26.189249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75e48cae-3b2b-4201-a73a-24f0f81c9844 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:26.229544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75e48cae-3b2b-4201-a73a-24f0f81c9844 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:26.233026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75e48cae-3b2b-4201-a73a-24f0f81c9844 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:26.239162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75e48cae-3b2b-4201-a73a-24f0f81c9844 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:26.243023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75e48cae-3b2b-4201-a73a-24f0f81c9844 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:26.343971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-26e8837a-a9fb-4430-8654-d62ee55cc49f tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:26.352637 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-26e8837a-a9fb-4430-8654-d62ee55cc49f tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1503 microversion: 2.1 time: 0.367117 Aug 04 14:16:26.354933 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1977/3980] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:25 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1503 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:26.647787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:26.653301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:26.683810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:26.686108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-75e48cae-3b2b-4201-a73a-24f0f81c9844 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:26.691028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:26.698130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:26.700645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:26.729592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75e48cae-3b2b-4201-a73a-24f0f81c9844 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1687 microversion: 2.1 time: 0.577667 Aug 04 14:16:26.737466 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2004/3981] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:26 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1687 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:26.779702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-410f0c5f-ff96-42b4-b369-76ee15cba04b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:26.797133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-410f0c5f-ff96-42b4-b369-76ee15cba04b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:26.845865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-410f0c5f-ff96-42b4-b369-76ee15cba04b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:26.850892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-410f0c5f-ff96-42b4-b369-76ee15cba04b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:26.853030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-410f0c5f-ff96-42b4-b369-76ee15cba04b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:26.854275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-410f0c5f-ff96-42b4-b369-76ee15cba04b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:27.409399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:27.461428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:27.469404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:27.474678 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6cff5adf-1c0d-4297-9e11-d47677fca429 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 0.834050 Aug 04 14:16:27.478495 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1978/3982] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:26 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:27.488615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9e02bcc5-c418-4f99-b379-cd9523b73737 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:27.493074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9e02bcc5-c418-4f99-b379-cd9523b73737 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:27.517364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-410f0c5f-ff96-42b4-b369-76ee15cba04b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:27.527340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e02bcc5-c418-4f99-b379-cd9523b73737 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:27.531816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e02bcc5-c418-4f99-b379-cd9523b73737 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:27.533752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e02bcc5-c418-4f99-b379-cd9523b73737 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:27.536160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e02bcc5-c418-4f99-b379-cd9523b73737 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:27.573685 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-410f0c5f-ff96-42b4-b369-76ee15cba04b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 0.812996 Aug 04 14:16:27.578664 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2005/3983] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:26 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:27.784228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6be4ea8e-bc71-4844-a281-bed05d5f30f7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:27.786628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6be4ea8e-bc71-4844-a281-bed05d5f30f7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:27.834884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6be4ea8e-bc71-4844-a281-bed05d5f30f7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:27.845779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6be4ea8e-bc71-4844-a281-bed05d5f30f7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:27.848168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6be4ea8e-bc71-4844-a281-bed05d5f30f7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:27.849586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6be4ea8e-bc71-4844-a281-bed05d5f30f7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:28.783900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9e02bcc5-c418-4f99-b379-cd9523b73737 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:28.804523 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9e02bcc5-c418-4f99-b379-cd9523b73737 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1503 microversion: 2.1 time: 1.321142 Aug 04 14:16:28.811034 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1979/3984] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:27 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1503 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:28.837829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-25487c13-9807-457d-84cb-0aafb8c62368 req-73ff4d24-9e1e-4903-8013-321a977f2cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "name": "network-vif-plugged", "status": "completed", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:28.861223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6be4ea8e-bc71-4844-a281-bed05d5f30f7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:28.873495 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6be4ea8e-bc71-4844-a281-bed05d5f30f7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1687 microversion: 2.1 time: 1.092432 Aug 04 14:16:28.877310 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2006/3985] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:27 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1687 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:28.881459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-25487c13-9807-457d-84cb-0aafb8c62368 req-73ff4d24-9e1e-4903-8013-321a977f2cd5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:28.881974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-25487c13-9807-457d-84cb-0aafb8c62368 req-73ff4d24-9e1e-4903-8013-321a977f2cd5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:28.884268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:28.893881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:28.912435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:28.913423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:28.917568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:28.921400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:28.940637 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-25487c13-9807-457d-84cb-0aafb8c62368 req-73ff4d24-9e1e-4903-8013-321a977f2cd5 service nova] Creating event network-vif-plugged:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:16:28.980314 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-25487c13-9807-457d-84cb-0aafb8c62368 req-73ff4d24-9e1e-4903-8013-321a977f2cd5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155098 Aug 04 14:16:28.991157 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1980/3986] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:28.998149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08b83ac8-8894-4a16-a3cb-9559645a9623 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:29.023049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-08b83ac8-8894-4a16-a3cb-9559645a9623 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:29.068671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08b83ac8-8894-4a16-a3cb-9559645a9623 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:29.072823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08b83ac8-8894-4a16-a3cb-9559645a9623 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:29.079135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08b83ac8-8894-4a16-a3cb-9559645a9623 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:29.085946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08b83ac8-8894-4a16-a3cb-9559645a9623 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:29.745316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:29.778072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:29.790657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:29.799839 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-09a28c60-f03e-4c25-8a0d-ea805c0f4c5a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 0.921207 Aug 04 14:16:29.826185 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2007/3987] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:28 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:29.850259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:29.855959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:29.884246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:29.885946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:29.888762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:29.898791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:29.935052 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] HTTP exception thrown: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Request method failure captured: Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 HTTP/1.1 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LfanTGg88eou2xbiTIqr48KQcIJCPJttG5b4MKwNhnz43BAWXBldkEizPNM5x04jW_iNHIG4YezOmMncuYSyeaxNgPCP47v8Zm_XSo34jCBkdrmWKvMLHqV6EHnaueaylz4fWKojpJsjWw_yMsYS1eLvpI-9xWFLlgQzrpFDWgSZ4 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 17f67c0fa1a843dfbcd3e6331300f7eb Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TaggedBootDevicesTest-2128902326 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/17f67c0fa1a843dfbcd3e6331300f7eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_17f67c0fa1a843dfbcd3e6331300f7eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/17f67c0fa1a843dfbcd3e6331300f7eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/17f67c0fa1a843dfbcd3e6331300f7eb"}]}] Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TaggedBootDevicesTest-2128902326 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 17f67c0fa1a843dfbcd3e6331300f7eb Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2128902326 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TaggedBootDevicesTest-2128902326-project Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: e89f60598ac944adb41d17059b568de9 Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TaggedBootDevicesTest-2128902326-project Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '2571717c-8f98-4963-bc46-a79f2eed9679'} Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:16:29.937039 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:29.940323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Returning 404 to user: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:29.949684 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-498f71d1-f53a-4be2-a52d-6f4d36a9d11e tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 404 len: 111 microversion: 2.32 time: 0.110412 Aug 04 14:16:29.959918 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2008/3988] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:16:29 2022] DELETE /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:16:29.970335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-efb9c51d-f604-42df-9cb8-d05b68325300 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:29.970969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-efb9c51d-f604-42df-9cb8-d05b68325300 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:29.997076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08b83ac8-8894-4a16-a3cb-9559645a9623 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:29.998400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efb9c51d-f604-42df-9cb8-d05b68325300 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:29.998863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efb9c51d-f604-42df-9cb8-d05b68325300 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:30.010297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efb9c51d-f604-42df-9cb8-d05b68325300 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:30.010891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efb9c51d-f604-42df-9cb8-d05b68325300 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:30.013733 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08b83ac8-8894-4a16-a3cb-9559645a9623 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 1.020545 Aug 04 14:16:30.028332 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1981/3989] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:28 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:30.040946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-56fcc465-9102-44fa-903e-540aa55a48be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:30.047895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-56fcc465-9102-44fa-903e-540aa55a48be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:30.068357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56fcc465-9102-44fa-903e-540aa55a48be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:30.074523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56fcc465-9102-44fa-903e-540aa55a48be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:30.080591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56fcc465-9102-44fa-903e-540aa55a48be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:30.081780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56fcc465-9102-44fa-903e-540aa55a48be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:30.821334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-efb9c51d-f604-42df-9cb8-d05b68325300 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a94a5b302d6847bfba6c1e01bcbf4239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23326ebe5834dbd8c181aa2f0d4dd36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:30.836210 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-efb9c51d-f604-42df-9cb8-d05b68325300 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 200 len: 1503 microversion: 2.1 time: 0.874807 Aug 04 14:16:30.850053 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2009/3990] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:29 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 1503 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:30.882845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:30.884302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] [instance: 2571717c-8f98-4963-bc46-a79f2eed9679] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:30.893467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-56fcc465-9102-44fa-903e-540aa55a48be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:30.900294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:30.904891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:30.907573 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-56fcc465-9102-44fa-903e-540aa55a48be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 0.877400 Aug 04 14:16:30.913773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:30.922192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:30.942053 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1982/3991] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:30 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:30.954138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-005303d8-848d-462a-aa74-a340fc03b272 req-19ff067d-4729-4a9c-9816-3625842301fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39de8e5-4fe9-4f27-9712-9e55f7aa8873", "name": "network-vif-deleted", "tag": "75e0bb21-e231-4303-a555-87e660de6d5b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:30.986116 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] HTTP exception thrown: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Request method failure captured: Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 HTTP/1.1 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69LfanTGg88eou2xbiTIqr48KQcIJCPJttG5b4MKwNhnz43BAWXBldkEizPNM5x04jW_iNHIG4YezOmMncuYSyeaxNgPCP47v8Zm_XSo34jCBkdrmWKvMLHqV6EHnaueaylz4fWKojpJsjWw_yMsYS1eLvpI-9xWFLlgQzrpFDWgSZ4 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 17f67c0fa1a843dfbcd3e6331300f7eb Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TaggedBootDevicesTest-2128902326 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/17f67c0fa1a843dfbcd3e6331300f7eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_17f67c0fa1a843dfbcd3e6331300f7eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/17f67c0fa1a843dfbcd3e6331300f7eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/17f67c0fa1a843dfbcd3e6331300f7eb"}]}] Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TaggedBootDevicesTest-2128902326 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 17f67c0fa1a843dfbcd3e6331300f7eb Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2128902326 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TaggedBootDevicesTest-2128902326-project Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: e89f60598ac944adb41d17059b568de9 Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TaggedBootDevicesTest-2128902326-project Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '2571717c-8f98-4963-bc46-a79f2eed9679'} Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:30.990421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:31.001379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:31.001379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:31.001379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:31.001379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:31.001379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:31.001379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:31.001379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. Aug 04 14:16:31.001379 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:31.007816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-005303d8-848d-462a-aa74-a340fc03b272 req-19ff067d-4729-4a9c-9816-3625842301fb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:31.007816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-005303d8-848d-462a-aa74-a340fc03b272 req-19ff067d-4729-4a9c-9816-3625842301fb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:31.009361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] Returning 404 to user: Instance 2571717c-8f98-4963-bc46-a79f2eed9679 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:31.009744 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0202aa26-6b31-40d7-9ef4-766ede1f1a83 tempest-TaggedBootDevicesTest-2128902326 tempest-TaggedBootDevicesTest-2128902326-project] 10.222.0.66 "GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679" status: 404 len: 111 microversion: 2.32 time: 0.155016 Aug 04 14:16:31.016403 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2010/3992] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:30 2022] GET /compute/v2.1/servers/2571717c-8f98-4963-bc46-a79f2eed9679 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:16:31.034515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:31.037158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:31.049698 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-005303d8-848d-462a-aa74-a340fc03b272 req-19ff067d-4729-4a9c-9816-3625842301fb service nova] Creating event network-vif-deleted:75e0bb21-e231-4303-a555-87e660de6d5b for instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 on n-h2-844627-10 Aug 04 14:16:31.050185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:31.051244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:31.053047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:31.054283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:31.069645 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-005303d8-848d-462a-aa74-a340fc03b272 req-19ff067d-4729-4a9c-9816-3625842301fb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125640 Aug 04 14:16:31.070968 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1983/3993] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:31.079349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d42135d-a4e2-4e99-b9cc-b552001f9bdf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:31.080427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9d42135d-a4e2-4e99-b9cc-b552001f9bdf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:31.104519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d42135d-a4e2-4e99-b9cc-b552001f9bdf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:31.105385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d42135d-a4e2-4e99-b9cc-b552001f9bdf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:31.106801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d42135d-a4e2-4e99-b9cc-b552001f9bdf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:31.107420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d42135d-a4e2-4e99-b9cc-b552001f9bdf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:31.664147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9d42135d-a4e2-4e99-b9cc-b552001f9bdf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:31.678325 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d42135d-a4e2-4e99-b9cc-b552001f9bdf tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 0.604796 Aug 04 14:16:31.693352 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1984/3994] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:31 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:31.700647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:31.727181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:31.736224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:31.752641 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3fee0ba-05f1-4ef1-b837-e6de86b0edf0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 0.727292 Aug 04 14:16:31.788704 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2011/3995] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:31 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:31.884439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:31.885281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:31.900631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:31.901176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:31.902008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:31.902640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:31.933543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4474f67-7bb5-4198-b359-963af98e3ee6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:31.934881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e4474f67-7bb5-4198-b359-963af98e3ee6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:31.959057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4474f67-7bb5-4198-b359-963af98e3ee6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:31.959764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4474f67-7bb5-4198-b359-963af98e3ee6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:31.962214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4474f67-7bb5-4198-b359-963af98e3ee6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:31.965302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4474f67-7bb5-4198-b359-963af98e3ee6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.012017 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] HTTP exception thrown: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Request method failure captured: Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 HTTP/1.1 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69SUQAjp6G5VsDNZwVIAf1y-tWQQJeZvelChIRoMu1O0VTgU-lAzjqI1gfnEMFAY3D-9fpQC2yRrV9k3j8yNDTtXzRL41Dby1SCIJaLOr8Fx2Ce-D0-TxL2ne-C1PkfA9I3p7TNQKXDndFvgcKrrQlhFzo4NOValTx3B8d4YtzIty94 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}] Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: a94a5b302d6847bfba6c1e01bcbf4239 Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e39de8e5-4fe9-4f27-9712-9e55f7aa8873'} Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.017063 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.024629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.024629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.024629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.024629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:32.024629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:32.024629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.024629 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.036507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Returning 404 to user: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:32.039052 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e16f5986-7045-4622-bc1e-09146ac331b0 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 404 len: 111 microversion: 2.1 time: 0.159206 Aug 04 14:16:32.057262 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1985/3996] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:31 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:16:32.094281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d316e34-fed7-45ef-9ef7-7134330cbbcf tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.194934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.compute.server_groups [None req-6d316e34-fed7-45ef-9ef7-7134330cbbcf tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Querying cell bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) for 1 instances {{(pid=130961) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 14:16:32.198085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d316e34-fed7-45ef-9ef7-7134330cbbcf tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.198764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d316e34-fed7-45ef-9ef7-7134330cbbcf tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.250419 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d316e34-fed7-45ef-9ef7-7134330cbbcf tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.189335 Aug 04 14:16:32.257523 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1986/3997] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 14:16:32 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:32.278616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e033e26-2ab0-46c8-a598-13ff1f357898 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.313490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.compute.server_groups [None req-1e033e26-2ab0-46c8-a598-13ff1f357898 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Querying cell bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) for 1 instances {{(pid=130961) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 14:16:32.318089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e033e26-2ab0-46c8-a598-13ff1f357898 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.322739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e033e26-2ab0-46c8-a598-13ff1f357898 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.354860 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e033e26-2ab0-46c8-a598-13ff1f357898 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/6fb1790f-3179-4e3c-9884-54a962f6758d" status: 200 len: 184 microversion: 2.1 time: 0.084416 Aug 04 14:16:32.356093 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1987/3998] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:16:32 2022] GET /compute/v2.1/os-server-groups/6fb1790f-3179-4e3c-9884-54a962f6758d => generated 184 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:32.370719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.371616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:32.402615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.412703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.419597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.421660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.465263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] HTTP exception thrown: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Request method failure captured: Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 HTTP/1.1 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69SUQAjp6G5VsDNZwVIAf1y-tWQQJeZvelChIRoMu1O0VTgU-lAzjqI1gfnEMFAY3D-9fpQC2yRrV9k3j8yNDTtXzRL41Dby1SCIJaLOr8Fx2Ce-D0-TxL2ne-C1PkfA9I3p7TNQKXDndFvgcKrrQlhFzo4NOValTx3B8d4YtzIty94 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}] Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: a94a5b302d6847bfba6c1e01bcbf4239 Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e39de8e5-4fe9-4f27-9712-9e55f7aa8873'} Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:16:32.469000 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.472742 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.475624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Returning 404 to user: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:32.478255 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13df9de8-ef57-4892-9c1c-6f014bec6815 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 404 len: 111 microversion: 2.1 time: 0.113373 Aug 04 14:16:32.485974 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1988/3999] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:16:32 2022] DELETE /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:16:32.497709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.498656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] [instance: e39de8e5-4fe9-4f27-9712-9e55f7aa8873] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:32.517080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.517716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.519828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.521468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.568276 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] HTTP exception thrown: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Request method failure captured: Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 HTTP/1.1 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69SUQAjp6G5VsDNZwVIAf1y-tWQQJeZvelChIRoMu1O0VTgU-lAzjqI1gfnEMFAY3D-9fpQC2yRrV9k3j8yNDTtXzRL41Dby1SCIJaLOr8Fx2Ce-D0-TxL2ne-C1PkfA9I3p7TNQKXDndFvgcKrrQlhFzo4NOValTx3B8d4YtzIty94 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}] Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: a94a5b302d6847bfba6c1e01bcbf4239 Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e39de8e5-4fe9-4f27-9712-9e55f7aa8873'} Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.573906 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.578196 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.578196 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.578196 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.578196 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:32.578196 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:32.578196 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. Aug 04 14:16:32.578196 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.579111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e4474f67-7bb5-4198-b359-963af98e3ee6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:32.580486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Returning 404 to user: Instance e39de8e5-4fe9-4f27-9712-9e55f7aa8873 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:32.584773 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e4a670d1-f6b1-45e3-9654-cdf9fb119712 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873" status: 404 len: 111 microversion: 2.1 time: 0.092166 Aug 04 14:16:32.586098 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1989/4000] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:32 2022] GET /compute/v2.1/servers/e39de8e5-4fe9-4f27-9712-9e55f7aa8873 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:16:32.604133 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e4474f67-7bb5-4198-b359-963af98e3ee6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 0.673475 Aug 04 14:16:32.608255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-611a0600-ab93-49c8-af88-35392d7a9132 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.624222 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2012/4001] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:31 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:32.625421 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-611a0600-ab93-49c8-af88-35392d7a9132 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] HTTP exception thrown: Instance group 0dd0301a-62ed-448c-8815-500f0ea64d40 could not be found. Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-611a0600-ab93-49c8-af88-35392d7a9132 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Request method failure captured: Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-server-groups/0dd0301a-62ed-448c-8815-500f0ea64d40 HTTP/1.1 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69SUQAjp6G5VsDNZwVIAf1y-tWQQJeZvelChIRoMu1O0VTgU-lAzjqI1gfnEMFAY3D-9fpQC2yRrV9k3j8yNDTtXzRL41Dby1SCIJaLOr8Fx2Ce-D0-TxL2ne-C1PkfA9I3p7TNQKXDndFvgcKrrQlhFzo4NOValTx3B8d4YtzIty94 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}] Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: a94a5b302d6847bfba6c1e01bcbf4239 Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance group 0dd0301a-62ed-448c-8815-500f0ea64d40 could not be found. Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '0dd0301a-62ed-448c-8815-500f0ea64d40'} Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0dd0301a-62ed-448c-8815-500f0ea64d40 could not be found. Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0dd0301a-62ed-448c-8815-500f0ea64d40 could not be found. Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.637547 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.641060 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.641060 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.641060 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:32.641060 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:32.641060 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0dd0301a-62ed-448c-8815-500f0ea64d40 could not be found. Aug 04 14:16:32.641060 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.643009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-611a0600-ab93-49c8-af88-35392d7a9132 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Returning 404 to user: Instance group 0dd0301a-62ed-448c-8815-500f0ea64d40 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:32.644120 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-611a0600-ab93-49c8-af88-35392d7a9132 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/0dd0301a-62ed-448c-8815-500f0ea64d40" status: 404 len: 117 microversion: 2.1 time: 0.052037 Aug 04 14:16:32.645927 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1990/4002] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:16:32 2022] DELETE /compute/v2.1/os-server-groups/0dd0301a-62ed-448c-8815-500f0ea64d40 => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:16:32.653420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43ec0496-8de1-4d90-8e11-d938e5bbb173 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.672784 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-43ec0496-8de1-4d90-8e11-d938e5bbb173 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] HTTP exception thrown: Instance group f55ccd9d-c315-4ffc-9a32-689181c4d687 could not be found. Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43ec0496-8de1-4d90-8e11-d938e5bbb173 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Request method failure captured: Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-server-groups/f55ccd9d-c315-4ffc-9a32-689181c4d687 HTTP/1.1 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69SUQAjp6G5VsDNZwVIAf1y-tWQQJeZvelChIRoMu1O0VTgU-lAzjqI1gfnEMFAY3D-9fpQC2yRrV9k3j8yNDTtXzRL41Dby1SCIJaLOr8Fx2Ce-D0-TxL2ne-C1PkfA9I3p7TNQKXDndFvgcKrrQlhFzo4NOValTx3B8d4YtzIty94 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}] Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a94a5b302d6847bfba6c1e01bcbf4239 Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance group f55ccd9d-c315-4ffc-9a32-689181c4d687 could not be found. Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'f55ccd9d-c315-4ffc-9a32-689181c4d687'} Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f55ccd9d-c315-4ffc-9a32-689181c4d687 could not be found. Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f55ccd9d-c315-4ffc-9a32-689181c4d687 could not be found. Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.682950 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.686348 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.686348 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.686348 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:32.686348 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:32.686348 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f55ccd9d-c315-4ffc-9a32-689181c4d687 could not be found. Aug 04 14:16:32.686348 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.686348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43ec0496-8de1-4d90-8e11-d938e5bbb173 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Returning 404 to user: Instance group f55ccd9d-c315-4ffc-9a32-689181c4d687 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:32.686348 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-43ec0496-8de1-4d90-8e11-d938e5bbb173 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/f55ccd9d-c315-4ffc-9a32-689181c4d687" status: 404 len: 117 microversion: 2.1 time: 0.036997 Aug 04 14:16:32.692263 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2013/4003] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:16:32 2022] DELETE /compute/v2.1/os-server-groups/f55ccd9d-c315-4ffc-9a32-689181c4d687 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:16:32.705097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3f5ff69f-c937-4300-a220-4edb231a6fb4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.707508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3f5ff69f-c937-4300-a220-4edb231a6fb4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:32.716743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f8deb14-1d7a-4d16-b9ea-e1cbb66c1134 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.725295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f5ff69f-c937-4300-a220-4edb231a6fb4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.728819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f5ff69f-c937-4300-a220-4edb231a6fb4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.731709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f5ff69f-c937-4300-a220-4edb231a6fb4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.732556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3f5ff69f-c937-4300-a220-4edb231a6fb4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.736689 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-9f8deb14-1d7a-4d16-b9ea-e1cbb66c1134 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] HTTP exception thrown: Instance group 15d982b4-6d49-485e-a3cf-d68544c8aede could not be found. Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f8deb14-1d7a-4d16-b9ea-e1cbb66c1134 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Request method failure captured: Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-server-groups/15d982b4-6d49-485e-a3cf-d68544c8aede HTTP/1.1 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69SUQAjp6G5VsDNZwVIAf1y-tWQQJeZvelChIRoMu1O0VTgU-lAzjqI1gfnEMFAY3D-9fpQC2yRrV9k3j8yNDTtXzRL41Dby1SCIJaLOr8Fx2Ce-D0-TxL2ne-C1PkfA9I3p7TNQKXDndFvgcKrrQlhFzo4NOValTx3B8d4YtzIty94 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}] Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a94a5b302d6847bfba6c1e01bcbf4239 Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance group 15d982b4-6d49-485e-a3cf-d68544c8aede could not be found. Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '15d982b4-6d49-485e-a3cf-d68544c8aede'} Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 15d982b4-6d49-485e-a3cf-d68544c8aede could not be found. Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 15d982b4-6d49-485e-a3cf-d68544c8aede could not be found. Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.741345 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.746020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.746020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.746020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:32.746020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:32.746020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 15d982b4-6d49-485e-a3cf-d68544c8aede could not be found. Aug 04 14:16:32.746020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.756980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f8deb14-1d7a-4d16-b9ea-e1cbb66c1134 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Returning 404 to user: Instance group 15d982b4-6d49-485e-a3cf-d68544c8aede could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:32.762368 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f8deb14-1d7a-4d16-b9ea-e1cbb66c1134 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/15d982b4-6d49-485e-a3cf-d68544c8aede" status: 404 len: 117 microversion: 2.1 time: 0.054573 Aug 04 14:16:32.765164 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2014/4004] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:16:32 2022] DELETE /compute/v2.1/os-server-groups/15d982b4-6d49-485e-a3cf-d68544c8aede => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:16:32.774313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7a638c2-2ae5-4faa-b36e-6ae9aeba6794 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.792944 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-d7a638c2-2ae5-4faa-b36e-6ae9aeba6794 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] HTTP exception thrown: Instance group 188b62b8-2dfd-47b3-b489-669fc1266f7b could not be found. Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7a638c2-2ae5-4faa-b36e-6ae9aeba6794 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Request method failure captured: Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-server-groups/188b62b8-2dfd-47b3-b489-669fc1266f7b HTTP/1.1 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69SUQAjp6G5VsDNZwVIAf1y-tWQQJeZvelChIRoMu1O0VTgU-lAzjqI1gfnEMFAY3D-9fpQC2yRrV9k3j8yNDTtXzRL41Dby1SCIJaLOr8Fx2Ce-D0-TxL2ne-C1PkfA9I3p7TNQKXDndFvgcKrrQlhFzo4NOValTx3B8d4YtzIty94 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d23326ebe5834dbd8c181aa2f0d4dd36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d23326ebe5834dbd8c181aa2f0d4dd36"}]}] Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: d23326ebe5834dbd8c181aa2f0d4dd36 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerGroupTestJSON-986751430 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a94a5b302d6847bfba6c1e01bcbf4239 Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerGroupTestJSON-986751430-project Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance group 188b62b8-2dfd-47b3-b489-669fc1266f7b could not be found. Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '188b62b8-2dfd-47b3-b489-669fc1266f7b'} Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 188b62b8-2dfd-47b3-b489-669fc1266f7b could not be found. Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 188b62b8-2dfd-47b3-b489-669fc1266f7b could not be found. Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.794849 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:16:32.798094 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:16:32.798094 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:16:32.798094 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:16:32.798094 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:16:32.798094 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 188b62b8-2dfd-47b3-b489-669fc1266f7b could not be found. Aug 04 14:16:32.798094 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:16:32.807093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7a638c2-2ae5-4faa-b36e-6ae9aeba6794 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Returning 404 to user: Instance group 188b62b8-2dfd-47b3-b489-669fc1266f7b could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:16:32.808233 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d7a638c2-2ae5-4faa-b36e-6ae9aeba6794 tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/188b62b8-2dfd-47b3-b489-669fc1266f7b" status: 404 len: 117 microversion: 2.1 time: 0.038021 Aug 04 14:16:32.810303 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2015/4005] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:16:32 2022] DELETE /compute/v2.1/os-server-groups/188b62b8-2dfd-47b3-b489-669fc1266f7b => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:16:32.820843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:32.822618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:32.837300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.838076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:32.839181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:32.839851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:33.327519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3f5ff69f-c937-4300-a220-4edb231a6fb4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:33.339657 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3f5ff69f-c937-4300-a220-4edb231a6fb4 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 0.640176 Aug 04 14:16:33.340506 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1991/4006] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:32 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:33.361698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6ca79ffc-fb71-430c-bf77-fbb515b6b45e tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:33.383328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:33.399982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:33.410992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:33.424456 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3c2c2f6-0060-4b4b-9c45-672da970945f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 0.605593 Aug 04 14:16:33.427485 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2016/4007] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:32 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:33.453198 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6ca79ffc-fb71-430c-bf77-fbb515b6b45e tempest-ServerGroupTestJSON-986751430 tempest-ServerGroupTestJSON-986751430-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/6fb1790f-3179-4e3c-9884-54a962f6758d" status: 204 len: 0 microversion: 2.1 time: 0.106863 Aug 04 14:16:33.454518 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1992/4008] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:16:33 2022] DELETE /compute/v2.1/os-server-groups/6fb1790f-3179-4e3c-9884-54a962f6758d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:16:33.644103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-276ef2d6-80ed-4af1-82bd-a807cc845bc8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:33.645159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-276ef2d6-80ed-4af1-82bd-a807cc845bc8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:33.661883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-276ef2d6-80ed-4af1-82bd-a807cc845bc8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:33.662723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-276ef2d6-80ed-4af1-82bd-a807cc845bc8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:33.663819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-276ef2d6-80ed-4af1-82bd-a807cc845bc8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:33.664529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-276ef2d6-80ed-4af1-82bd-a807cc845bc8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:34.379188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e215748d-5e42-4705-8807-54d1ff7777d2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:34.379996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e215748d-5e42-4705-8807-54d1ff7777d2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:34.405941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e215748d-5e42-4705-8807-54d1ff7777d2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:34.406713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e215748d-5e42-4705-8807-54d1ff7777d2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:34.407940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e215748d-5e42-4705-8807-54d1ff7777d2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:34.409800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e215748d-5e42-4705-8807-54d1ff7777d2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:35.015302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-276ef2d6-80ed-4af1-82bd-a807cc845bc8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:35.036292 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-276ef2d6-80ed-4af1-82bd-a807cc845bc8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 1.392932 Aug 04 14:16:35.044569 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2017/4009] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:33 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:35.051073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:35.064256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:35.087804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:35.095396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:35.101481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:35.102494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:35.844673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e215748d-5e42-4705-8807-54d1ff7777d2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:35.859890 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e215748d-5e42-4705-8807-54d1ff7777d2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 1.485234 Aug 04 14:16:35.874837 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1993/4010] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:34 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:35.987521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:36.011003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:36.023100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:36.026962 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c47f3c1-18c3-41d7-9eea-f32fde24ef3e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 0.980565 Aug 04 14:16:36.031897 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2018/4011] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:35 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:36.067605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51ca55a5-d7fc-41c1-a497-8eb758bff4de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:36.068738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-51ca55a5-d7fc-41c1-a497-8eb758bff4de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:36.072744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:36.088443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51ca55a5-d7fc-41c1-a497-8eb758bff4de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:36.089215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51ca55a5-d7fc-41c1-a497-8eb758bff4de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:36.090222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51ca55a5-d7fc-41c1-a497-8eb758bff4de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:36.090834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51ca55a5-d7fc-41c1-a497-8eb758bff4de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:36.708297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-51ca55a5-d7fc-41c1-a497-8eb758bff4de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:36.730902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:36.745485 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-51ca55a5-d7fc-41c1-a497-8eb758bff4de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 0.675591 Aug 04 14:16:36.762292 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1994/4012] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:36 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:36.915034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5227cee9-9b16-4b5b-9e4b-eca3f6fe76c0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:36.916042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5227cee9-9b16-4b5b-9e4b-eca3f6fe76c0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:36.938921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5227cee9-9b16-4b5b-9e4b-eca3f6fe76c0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:36.939578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5227cee9-9b16-4b5b-9e4b-eca3f6fe76c0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:36.940994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5227cee9-9b16-4b5b-9e4b-eca3f6fe76c0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:36.941591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5227cee9-9b16-4b5b-9e4b-eca3f6fe76c0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:37.031338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:37.063889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:37.065088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:37.109482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:37.110371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:37.121335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:37.122271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:38.467584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5227cee9-9b16-4b5b-9e4b-eca3f6fe76c0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:38.490857 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5227cee9-9b16-4b5b-9e4b-eca3f6fe76c0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 1.573409 Aug 04 14:16:38.492026 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2019/4013] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:36 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:38.504767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-391b49a1-62d2-4ed5-868c-2af9a0d670c5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:38.505781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-391b49a1-62d2-4ed5-868c-2af9a0d670c5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:38.522253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-391b49a1-62d2-4ed5-868c-2af9a0d670c5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:38.526426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-391b49a1-62d2-4ed5-868c-2af9a0d670c5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:38.527546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-391b49a1-62d2-4ed5-868c-2af9a0d670c5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:38.528157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-391b49a1-62d2-4ed5-868c-2af9a0d670c5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:38.927512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:38.948612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:38.960523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:38.966712 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fb207ea-1bb2-4014-9811-87afc7bedfdc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 1.911121 Aug 04 14:16:38.969826 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1995/4014] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:37 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:16:39.521452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e5f23cb-6521-4e87-bbae-e750386c09ee tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:39.522085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e5f23cb-6521-4e87-bbae-e750386c09ee tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:39.551206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e5f23cb-6521-4e87-bbae-e750386c09ee tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:39.562631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e5f23cb-6521-4e87-bbae-e750386c09ee tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:39.566154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e5f23cb-6521-4e87-bbae-e750386c09ee tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:39.566952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e5f23cb-6521-4e87-bbae-e750386c09ee tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:40.396852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-391b49a1-62d2-4ed5-868c-2af9a0d670c5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:40.431639 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-391b49a1-62d2-4ed5-868c-2af9a0d670c5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 1.937033 Aug 04 14:16:40.432715 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2020/4015] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:38 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:40.462036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:40.464152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:40.504099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:40.505301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:40.507054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:40.509987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:41.447578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7e5f23cb-6521-4e87-bbae-e750386c09ee tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:41.471663 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e5f23cb-6521-4e87-bbae-e750386c09ee tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 1.941993 Aug 04 14:16:41.472925 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1996/4016] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:39 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:41.486222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb2cd003-3333-4a3d-a64f-55a212db8839 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:41.495565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb2cd003-3333-4a3d-a64f-55a212db8839 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:41.512287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb2cd003-3333-4a3d-a64f-55a212db8839 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:41.521893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb2cd003-3333-4a3d-a64f-55a212db8839 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:41.527798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb2cd003-3333-4a3d-a64f-55a212db8839 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:41.528629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb2cd003-3333-4a3d-a64f-55a212db8839 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:42.983740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:43.028622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:43.060334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:43.076386 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8513eb8a-8039-4e76-9e0f-0669bc934c9e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 2.619282 Aug 04 14:16:43.091587 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2021/4017] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:40 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 2649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:43.134491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77c400fc-ac27-4f65-925b-09b523989f51 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:43.143870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-77c400fc-ac27-4f65-925b-09b523989f51 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:43.212333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77c400fc-ac27-4f65-925b-09b523989f51 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:43.220200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77c400fc-ac27-4f65-925b-09b523989f51 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:43.253170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77c400fc-ac27-4f65-925b-09b523989f51 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:43.254572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77c400fc-ac27-4f65-925b-09b523989f51 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:44.541696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb2cd003-3333-4a3d-a64f-55a212db8839 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:44.568066 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb2cd003-3333-4a3d-a64f-55a212db8839 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 3.093789 Aug 04 14:16:44.568650 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1997/4018] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:41 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 3095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:44.579358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:44.580058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:44.600617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:44.609324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:44.610304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:44.610767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:45.491686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-77c400fc-ac27-4f65-925b-09b523989f51 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:45.514956 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-77c400fc-ac27-4f65-925b-09b523989f51 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 2.421507 Aug 04 14:16:45.518998 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2022/4019] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:43 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 2427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:45.593213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-91349294-585e-4039-b28d-4675b1e5afe3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:45.594386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-91349294-585e-4039-b28d-4675b1e5afe3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:45.609724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91349294-585e-4039-b28d-4675b1e5afe3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:45.613628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91349294-585e-4039-b28d-4675b1e5afe3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:45.615613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91349294-585e-4039-b28d-4675b1e5afe3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:45.616537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-91349294-585e-4039-b28d-4675b1e5afe3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:46.396400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-91349294-585e-4039-b28d-4675b1e5afe3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:46.416793 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-91349294-585e-4039-b28d-4675b1e5afe3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 0.827102 Aug 04 14:16:46.422359 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2023/4020] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:45 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:46.476278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:46.493046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:46.500361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:46.502230 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fe57d74-ca97-4b15-9235-68dcde91162d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 1.932545 Aug 04 14:16:46.510659 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1998/4021] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:44 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:46.569202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e75d1f11-fb45-471f-8e8f-fcf32c66ba23 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:46.569837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e75d1f11-fb45-471f-8e8f-fcf32c66ba23 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:46.582526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:46.584299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e75d1f11-fb45-471f-8e8f-fcf32c66ba23 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:46.599018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e75d1f11-fb45-471f-8e8f-fcf32c66ba23 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:46.600304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e75d1f11-fb45-471f-8e8f-fcf32c66ba23 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:46.600748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e75d1f11-fb45-471f-8e8f-fcf32c66ba23 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:47.454460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84ac70a0-3fa7-4ad8-a0f4-a6db86fabdd2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:47.455613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84ac70a0-3fa7-4ad8-a0f4-a6db86fabdd2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:47.474537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84ac70a0-3fa7-4ad8-a0f4-a6db86fabdd2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:47.475486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84ac70a0-3fa7-4ad8-a0f4-a6db86fabdd2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:47.480232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84ac70a0-3fa7-4ad8-a0f4-a6db86fabdd2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:47.481729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84ac70a0-3fa7-4ad8-a0f4-a6db86fabdd2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:47.550025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e75d1f11-fb45-471f-8e8f-fcf32c66ba23 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:47.587638 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e75d1f11-fb45-471f-8e8f-fcf32c66ba23 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 1.021015 Aug 04 14:16:47.590286 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2024/4022] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:46 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:47.612717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:47.616916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:47.653916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:47.682800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:47.691211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:47.693040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:48.581195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84ac70a0-3fa7-4ad8-a0f4-a6db86fabdd2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:48.642033 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84ac70a0-3fa7-4ad8-a0f4-a6db86fabdd2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 1.193297 Aug 04 14:16:48.647667 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 1999/4023] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:47 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:48.703364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-badc1a14-5f9a-40d6-84b5-59521b909082 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:48.709294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-badc1a14-5f9a-40d6-84b5-59521b909082 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:48.743828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-badc1a14-5f9a-40d6-84b5-59521b909082 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:48.754320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-badc1a14-5f9a-40d6-84b5-59521b909082 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:48.756411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-badc1a14-5f9a-40d6-84b5-59521b909082 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:48.764652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-badc1a14-5f9a-40d6-84b5-59521b909082 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:48.953929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:48.982380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:48.993149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:48.999951 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-40c8e8ed-faa2-4053-96d9-14c53339c5d0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1738 microversion: 2.20 time: 1.401551 Aug 04 14:16:49.003061 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2025/4024] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:47 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1738 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:49.683924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1ccafff7-01d1-4838-896c-36b282e34e26 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:49.686191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1ccafff7-01d1-4838-896c-36b282e34e26 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:49.708106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ccafff7-01d1-4838-896c-36b282e34e26 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:49.710137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ccafff7-01d1-4838-896c-36b282e34e26 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:49.712528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ccafff7-01d1-4838-896c-36b282e34e26 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:49.713410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ccafff7-01d1-4838-896c-36b282e34e26 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:50.912280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-badc1a14-5f9a-40d6-84b5-59521b909082 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:50.947404 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-badc1a14-5f9a-40d6-84b5-59521b909082 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1518 microversion: 2.1 time: 2.296866 Aug 04 14:16:50.948825 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2000/4025] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:48 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1518 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:51.006576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:51.010570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:51.060299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1ccafff7-01d1-4838-896c-36b282e34e26 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:51.090986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:51.098893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:51.102485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:51.106760 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1ccafff7-01d1-4838-896c-36b282e34e26 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 1.426253 Aug 04 14:16:51.108685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:51.159456 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2026/4026] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:49 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:51.632799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:51.669897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:51.674168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:51.676922 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0daf2d3b-17b4-4fa4-b1b8-55ee518b9c32 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1720 microversion: 2.20 time: 0.723026 Aug 04 14:16:51.685969 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2001/4027] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:50 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1720 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:51.982999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5e7ca380-116f-465c-92f3-ad0d83087ffa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:51.989043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5e7ca380-116f-465c-92f3-ad0d83087ffa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:52.031077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e7ca380-116f-465c-92f3-ad0d83087ffa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:52.034572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e7ca380-116f-465c-92f3-ad0d83087ffa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:52.046987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e7ca380-116f-465c-92f3-ad0d83087ffa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:52.051587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e7ca380-116f-465c-92f3-ad0d83087ffa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:52.179182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b38c307a-849c-40e9-8d76-52c4d3a25c90 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:52.199082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b38c307a-849c-40e9-8d76-52c4d3a25c90 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:52.249687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b38c307a-849c-40e9-8d76-52c4d3a25c90 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:52.250587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b38c307a-849c-40e9-8d76-52c4d3a25c90 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:52.259865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b38c307a-849c-40e9-8d76-52c4d3a25c90 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:52.263350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b38c307a-849c-40e9-8d76-52c4d3a25c90 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:52.779604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b38c307a-849c-40e9-8d76-52c4d3a25c90 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:52.804111 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b38c307a-849c-40e9-8d76-52c4d3a25c90 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 0.643399 Aug 04 14:16:52.807007 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2002/4028] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:52 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:52.841974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:52.846509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:52.863401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:52.864495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5e7ca380-116f-465c-92f3-ad0d83087ffa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:52.881520 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5e7ca380-116f-465c-92f3-ad0d83087ffa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1524 microversion: 2.1 time: 0.913637 Aug 04 14:16:52.883789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:52.885666 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2027/4029] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:51 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1524 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:52.934198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:52.936410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:53.843781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df2edbb6-245b-41db-9eca-611dff9866d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:53.845592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df2edbb6-245b-41db-9eca-611dff9866d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:53.880610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df2edbb6-245b-41db-9eca-611dff9866d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:53.882216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df2edbb6-245b-41db-9eca-611dff9866d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:53.883837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df2edbb6-245b-41db-9eca-611dff9866d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:53.884618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df2edbb6-245b-41db-9eca-611dff9866d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:53.933861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:53.949939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:53.952032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:53.960233 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-319b318c-fbfd-44f5-bec3-50e19ccc7b45 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1720 microversion: 2.20 time: 1.141834 Aug 04 14:16:53.962086 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2003/4030] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:52 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1720 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:53.973462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01c3b7fd-a9c8-4c8c-a2c4-edc95049cae9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:53.977612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-01c3b7fd-a9c8-4c8c-a2c4-edc95049cae9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:53.994157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01c3b7fd-a9c8-4c8c-a2c4-edc95049cae9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:53.996001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01c3b7fd-a9c8-4c8c-a2c4-edc95049cae9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:53.998050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01c3b7fd-a9c8-4c8c-a2c4-edc95049cae9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:54.003816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01c3b7fd-a9c8-4c8c-a2c4-edc95049cae9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:54.658569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df2edbb6-245b-41db-9eca-611dff9866d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:54.696994 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df2edbb6-245b-41db-9eca-611dff9866d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 0.871942 Aug 04 14:16:54.715294 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2028/4031] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:53 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:55.008125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-01c3b7fd-a9c8-4c8c-a2c4-edc95049cae9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:55.017862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:55.019724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:55.022669 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-01c3b7fd-a9c8-4c8c-a2c4-edc95049cae9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1524 microversion: 2.1 time: 1.056588 Aug 04 14:16:55.025898 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2004/4032] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:53 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1524 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:55.059456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:55.059920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:55.060795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:55.065347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:55.690525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:55.712860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:55.716860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:55.719540 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75468fa7-a387-4b06-b34f-0de537c4394e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1720 microversion: 2.20 time: 0.707195 Aug 04 14:16:55.721410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2029/4033] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:55 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1720 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:55.760359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4bb7ad23-1e8a-4df7-84ee-af46ec72c32d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:55.766367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4bb7ad23-1e8a-4df7-84ee-af46ec72c32d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:55.817197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4bb7ad23-1e8a-4df7-84ee-af46ec72c32d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:55.818048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4bb7ad23-1e8a-4df7-84ee-af46ec72c32d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:55.819696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4bb7ad23-1e8a-4df7-84ee-af46ec72c32d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:55.820542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4bb7ad23-1e8a-4df7-84ee-af46ec72c32d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:56.008536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b81ed5db-33bc-4e97-a7ba-5d108bbbdee8 req-bd2d81d4-6bbf-49ab-a1ae-8cbb6da9735d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ffdabf-8907-428a-91e2-89a32616e683", "name": "network-vif-plugged", "status": "completed", "tag": "3767cf18-ff64-4e0e-92ea-2beb69097e3c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:56.034024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b81ed5db-33bc-4e97-a7ba-5d108bbbdee8 req-bd2d81d4-6bbf-49ab-a1ae-8cbb6da9735d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:56.035956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b81ed5db-33bc-4e97-a7ba-5d108bbbdee8 req-bd2d81d4-6bbf-49ab-a1ae-8cbb6da9735d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:56.093178 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b81ed5db-33bc-4e97-a7ba-5d108bbbdee8 req-bd2d81d4-6bbf-49ab-a1ae-8cbb6da9735d service nova] Creating event network-vif-plugged:3767cf18-ff64-4e0e-92ea-2beb69097e3c for instance f3ffdabf-8907-428a-91e2-89a32616e683 on n-h1-844627-10 Aug 04 14:16:56.117923 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b81ed5db-33bc-4e97-a7ba-5d108bbbdee8 req-bd2d81d4-6bbf-49ab-a1ae-8cbb6da9735d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109182 Aug 04 14:16:56.119218 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2030/4034] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:56.129974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb88e41f-f132-40e2-abbf-ded79b5c4033 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:56.131845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb88e41f-f132-40e2-abbf-ded79b5c4033 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:56.176856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb88e41f-f132-40e2-abbf-ded79b5c4033 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:56.178946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb88e41f-f132-40e2-abbf-ded79b5c4033 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:56.186753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb88e41f-f132-40e2-abbf-ded79b5c4033 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:56.187643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb88e41f-f132-40e2-abbf-ded79b5c4033 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:56.246856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4bb7ad23-1e8a-4df7-84ee-af46ec72c32d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:56.256268 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4bb7ad23-1e8a-4df7-84ee-af46ec72c32d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 0.503763 Aug 04 14:16:56.272258 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2005/4035] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:55 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:56.578027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bb88e41f-f132-40e2-abbf-ded79b5c4033 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:56.591766 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb88e41f-f132-40e2-abbf-ded79b5c4033 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1524 microversion: 2.1 time: 0.470921 Aug 04 14:16:56.592959 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2031/4036] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:56 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1524 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:56.745481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:56.746457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:56.771314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:56.779550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:56.782343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:56.784061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:57.003173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:57.013473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:57.015766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:57.017429 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf2bb8a5-e4c7-4889-98df-5afe5e13c799 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1720 microversion: 2.20 time: 0.276605 Aug 04 14:16:57.018283 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2006/4037] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:56 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1720 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:16:57.279591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9edef44e-ecd3-40d1-9675-d5e7f674a6d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:57.281222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9edef44e-ecd3-40d1-9675-d5e7f674a6d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:57.329495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9edef44e-ecd3-40d1-9675-d5e7f674a6d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:57.333195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9edef44e-ecd3-40d1-9675-d5e7f674a6d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:57.336707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9edef44e-ecd3-40d1-9675-d5e7f674a6d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:57.341963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9edef44e-ecd3-40d1-9675-d5e7f674a6d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:57.620162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7afe4b2-fdec-4498-bcab-3db20d353faa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:57.625185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7afe4b2-fdec-4498-bcab-3db20d353faa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:57.639340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7afe4b2-fdec-4498-bcab-3db20d353faa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:57.640596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7afe4b2-fdec-4498-bcab-3db20d353faa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:57.642478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7afe4b2-fdec-4498-bcab-3db20d353faa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:57.643545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7afe4b2-fdec-4498-bcab-3db20d353faa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:57.823112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9edef44e-ecd3-40d1-9675-d5e7f674a6d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:57.850625 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9edef44e-ecd3-40d1-9675-d5e7f674a6d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1682 microversion: 2.1 time: 0.557410 Aug 04 14:16:57.854424 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2032/4038] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:57 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1682 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:58.074203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:58.075198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:58.084284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:58.085173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:58.087352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:58.088164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:58.527678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7afe4b2-fdec-4498-bcab-3db20d353faa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:58.553558 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7afe4b2-fdec-4498-bcab-3db20d353faa tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1524 microversion: 2.1 time: 0.937938 Aug 04 14:16:58.563402 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2007/4039] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:57 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1524 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:16:58.593887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7691c8c5-00ac-4c61-a074-00f6fa643e4c req-02980b5b-7fbf-4285-879e-7ce93a56e554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9c2731-512a-423b-a54e-32f7e2171623", "name": "network-vif-unplugged", "status": "completed", "tag": "fcaf7619-ad8a-4c0d-91da-0cf44e564f7f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:58.637675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7691c8c5-00ac-4c61-a074-00f6fa643e4c req-02980b5b-7fbf-4285-879e-7ce93a56e554 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:58.643669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7691c8c5-00ac-4c61-a074-00f6fa643e4c req-02980b5b-7fbf-4285-879e-7ce93a56e554 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:58.744197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7691c8c5-00ac-4c61-a074-00f6fa643e4c req-02980b5b-7fbf-4285-879e-7ce93a56e554 service nova] Creating event network-vif-unplugged:fcaf7619-ad8a-4c0d-91da-0cf44e564f7f for instance 8b9c2731-512a-423b-a54e-32f7e2171623 on n-h1-844627-10 Aug 04 14:16:58.773035 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7691c8c5-00ac-4c61-a074-00f6fa643e4c req-02980b5b-7fbf-4285-879e-7ce93a56e554 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.205691 Aug 04 14:16:58.777759 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2008/4040] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:16:58.845580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:58.861034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:58.878598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:58.883366 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5ef4b75-1979-48ad-87bf-9364e9e957c9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1723 microversion: 2.20 time: 0.817516 Aug 04 14:16:58.887968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a230c123-738e-4b9d-bfd6-982ca468c430 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:58.889340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a230c123-738e-4b9d-bfd6-982ca468c430 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:58.890155 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2033/4041] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:16:58 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1723 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:16:58.903105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a230c123-738e-4b9d-bfd6-982ca468c430 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:58.903570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a230c123-738e-4b9d-bfd6-982ca468c430 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:58.907509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a230c123-738e-4b9d-bfd6-982ca468c430 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:58.907999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a230c123-738e-4b9d-bfd6-982ca468c430 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:58.922890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3e60a999-2460-4853-81c7-e16355391173 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c6068c0-b951-47b8-b6a2-49cee444c59f"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:16:58.935247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3e60a999-2460-4853-81c7-e16355391173 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:58.956936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e60a999-2460-4853-81c7-e16355391173 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:58.958834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e60a999-2460-4853-81c7-e16355391173 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:58.961429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e60a999-2460-4853-81c7-e16355391173 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:58.963788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e60a999-2460-4853-81c7-e16355391173 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:59.193037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a230c123-738e-4b9d-bfd6-982ca468c430 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:16:59.228452 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a230c123-738e-4b9d-bfd6-982ca468c430 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.344735 Aug 04 14:16:59.231734 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2009/4042] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:58 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:16:59.587080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:16:59.590893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2ae156ee-1e1e-4e21-bbf0-e1d9a43ad742 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:16:59.592340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2ae156ee-1e1e-4e21-bbf0-e1d9a43ad742 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:16:59.624798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ae156ee-1e1e-4e21-bbf0-e1d9a43ad742 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:59.625512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ae156ee-1e1e-4e21-bbf0-e1d9a43ad742 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:59.629990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ae156ee-1e1e-4e21-bbf0-e1d9a43ad742 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:16:59.630624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2ae156ee-1e1e-4e21-bbf0-e1d9a43ad742 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:16:59.854671 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3e60a999-2460-4853-81c7-e16355391173 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.941398 Aug 04 14:16:59.855757 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2034/4043] 10.222.0.66 () {62 vars in 1364 bytes} [Thu Aug 4 14:16:58 2022] POST /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 188 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:17:00.103127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2ae156ee-1e1e-4e21-bbf0-e1d9a43ad742 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:00.138802 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2ae156ee-1e1e-4e21-bbf0-e1d9a43ad742 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1524 microversion: 2.1 time: 0.558064 Aug 04 14:17:00.142357 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2010/4044] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:16:59 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1524 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:17:00.176229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac2dc5b0-5473-4bd3-8f16-0ba528a61d9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:00.177360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac2dc5b0-5473-4bd3-8f16-0ba528a61d9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:00.191229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac2dc5b0-5473-4bd3-8f16-0ba528a61d9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:00.191716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac2dc5b0-5473-4bd3-8f16-0ba528a61d9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:00.201826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac2dc5b0-5473-4bd3-8f16-0ba528a61d9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:00.202315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac2dc5b0-5473-4bd3-8f16-0ba528a61d9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:00.531502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac2dc5b0-5473-4bd3-8f16-0ba528a61d9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130960) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 14:17:00.728886 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac2dc5b0-5473-4bd3-8f16-0ba528a61d9a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/action" status: 202 len: 0 microversion: 2.20 time: 0.592870 Aug 04 14:17:00.731336 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2035/4045] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 14:17:00 2022] POST /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:17:00.741120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:00.742907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:00.752042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:00.753257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:00.754375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:00.755078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:00.937943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:00.951830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:00.955010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:00.961869 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a5e2b161-25eb-48c8-b07a-c65612be7113 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1749 microversion: 2.20 time: 0.225636 Aug 04 14:17:00.962956 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2011/4046] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:00 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1749 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:01.204912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aec5f2cd-4e08-4470-a1a7-4d49c6fddef2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:01.206155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aec5f2cd-4e08-4470-a1a7-4d49c6fddef2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:01.247548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aec5f2cd-4e08-4470-a1a7-4d49c6fddef2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:01.248288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aec5f2cd-4e08-4470-a1a7-4d49c6fddef2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:01.250847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aec5f2cd-4e08-4470-a1a7-4d49c6fddef2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:01.251785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aec5f2cd-4e08-4470-a1a7-4d49c6fddef2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:01.702242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12e64011-05b9-487a-a12d-fcee701d4b58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:01.703826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12e64011-05b9-487a-a12d-fcee701d4b58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:01.723517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12e64011-05b9-487a-a12d-fcee701d4b58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:01.724017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12e64011-05b9-487a-a12d-fcee701d4b58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:01.724904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12e64011-05b9-487a-a12d-fcee701d4b58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:01.725348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12e64011-05b9-487a-a12d-fcee701d4b58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:01.735879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:01.754351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aec5f2cd-4e08-4470-a1a7-4d49c6fddef2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:01.784631 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aec5f2cd-4e08-4470-a1a7-4d49c6fddef2 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1509 microversion: 2.1 time: 0.595118 Aug 04 14:17:01.789314 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2036/4047] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:01 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1509 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:01.824303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ef70f491-2091-4a04-a731-0bae6aa6bb5f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:01.827911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ef70f491-2091-4a04-a731-0bae6aa6bb5f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:01.861100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef70f491-2091-4a04-a731-0bae6aa6bb5f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:01.862082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef70f491-2091-4a04-a731-0bae6aa6bb5f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:01.867677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef70f491-2091-4a04-a731-0bae6aa6bb5f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:01.869736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef70f491-2091-4a04-a731-0bae6aa6bb5f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:02.214716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12e64011-05b9-487a-a12d-fcee701d4b58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:02.250405 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12e64011-05b9-487a-a12d-fcee701d4b58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.550179 Aug 04 14:17:02.254165 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2012/4048] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:01 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:17:02.280973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:02.287164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:02.317947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:02.321168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:02.326363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:02.332675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:03.115615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ef70f491-2091-4a04-a731-0bae6aa6bb5f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:03.140158 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ef70f491-2091-4a04-a731-0bae6aa6bb5f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 200 len: 1509 microversion: 2.1 time: 1.327924 Aug 04 14:17:03.163965 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2037/4049] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:01 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 1509 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:03.175583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7eb4a4d6-7a5e-4dbd-9de4-ff72c19b916e req-d1abfd1e-5c06-4a59-b00b-3456c65f691a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "name": "network-vif-unplugged", "status": "completed", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:03.222955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7eb4a4d6-7a5e-4dbd-9de4-ff72c19b916e req-d1abfd1e-5c06-4a59-b00b-3456c65f691a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:03.223585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7eb4a4d6-7a5e-4dbd-9de4-ff72c19b916e req-d1abfd1e-5c06-4a59-b00b-3456c65f691a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:03.243861 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7eb4a4d6-7a5e-4dbd-9de4-ff72c19b916e req-d1abfd1e-5c06-4a59-b00b-3456c65f691a service nova] Creating event network-vif-unplugged:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:17:03.262905 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7eb4a4d6-7a5e-4dbd-9de4-ff72c19b916e req-d1abfd1e-5c06-4a59-b00b-3456c65f691a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096639 Aug 04 14:17:03.264513 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2038/4050] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:03.281606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3ced3d5-c0d5-422b-bcf0-5e6b5d397367 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:03.282442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3ced3d5-c0d5-422b-bcf0-5e6b5d397367 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:03.296130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3ced3d5-c0d5-422b-bcf0-5e6b5d397367 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:03.296935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3ced3d5-c0d5-422b-bcf0-5e6b5d397367 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:03.298438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3ced3d5-c0d5-422b-bcf0-5e6b5d397367 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:03.300127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3ced3d5-c0d5-422b-bcf0-5e6b5d397367 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:03.348232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3ced3d5-c0d5-422b-bcf0-5e6b5d397367 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:17:03.558304 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3ced3d5-c0d5-422b-bcf0-5e6b5d397367 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 204 len: 0 microversion: 2.1 time: 0.291667 Aug 04 14:17:03.559203 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2039/4051] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:17:03 2022] DELETE /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:17:03.579292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:03.580575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:03.598752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:03.599576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:03.600544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:03.603323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:03.773119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:03.853027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:03.864539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:03.880777 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fe44919-dac5-4718-907a-aeecaec1115e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1749 microversion: 2.20 time: 1.621203 Aug 04 14:17:03.886191 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2013/4052] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:02 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1749 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:03.921232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1702610050", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "1b4f866d-e9ad-4302-a20b-1d7a246b12d6"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:04.134457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] validate_networks() for [('1b4f866d-e9ad-4302-a20b-1d7a246b12d6', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:17:04.555631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:04.570884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:04.572623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:04.582447 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4aed8948-b82c-40ca-a764-4014a09bf08d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 2955 microversion: 2.42 time: 1.015033 Aug 04 14:17:04.584047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2040/4053] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:03 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 2955 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:04.644130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e3e9175e-f39e-44f3-ab2e-255bc0f12a33 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:04.646084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e3e9175e-f39e-44f3-ab2e-255bc0f12a33 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:04.685024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3e9175e-f39e-44f3-ab2e-255bc0f12a33 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:04.690607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3e9175e-f39e-44f3-ab2e-255bc0f12a33 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:04.692663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3e9175e-f39e-44f3-ab2e-255bc0f12a33 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:04.693831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3e9175e-f39e-44f3-ab2e-255bc0f12a33 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:05.320805 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e3e9175e-f39e-44f3-ab2e-255bc0f12a33 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.700300 Aug 04 14:17:05.322397 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2041/4054] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 14:17:04 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238/os-interface => generated 1833 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:05.355404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:05.356610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:05.467319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:05.470090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:05.485315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:05.491474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:07.872826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:17:07.873942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:17:07.875308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:17:07.876489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:17:07.877703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:17:07.889445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:07.902758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=41 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:07.937244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:07.943590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:07.944795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:07.948347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:07.953129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:07.954414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:07.962283 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a53d01f5-ab20-47a5-aa59-630005700b4a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1751 microversion: 2.20 time: 2.632136 Aug 04 14:17:07.968533 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2042/4055] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:05 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1751 bytes in 2645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:08.003625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf5a097f-9b1e-483c-8e91-8027800e36b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:08.005719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf5a097f-9b1e-483c-8e91-8027800e36b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:08.042438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Getting quotas for project 5e494ac06713453d9e598f82cdadccd2. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:17:08.043411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf5a097f-9b1e-483c-8e91-8027800e36b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:08.044251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf5a097f-9b1e-483c-8e91-8027800e36b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:08.045804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf5a097f-9b1e-483c-8e91-8027800e36b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:08.046610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf5a097f-9b1e-483c-8e91-8027800e36b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:08.058966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Getting quotas for user cdc33353bb874a57b82deab4669b998c and project 5e494ac06713453d9e598f82cdadccd2. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:17:08.112480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:17:08.121313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:17:08.306362 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9ea04bfd-fe28-4380-96f6-6c224cc7e6f0 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.390943 Aug 04 14:17:08.309581 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2014/4056] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:17:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:17:08.324678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d3c5ea2-7782-41c7-b5b3-bd6b88e987c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:08.333932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7d3c5ea2-7782-41c7-b5b3-bd6b88e987c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:08.363654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d3c5ea2-7782-41c7-b5b3-bd6b88e987c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:08.365607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d3c5ea2-7782-41c7-b5b3-bd6b88e987c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:08.372237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d3c5ea2-7782-41c7-b5b3-bd6b88e987c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:08.373388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d3c5ea2-7782-41c7-b5b3-bd6b88e987c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:08.489627 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7d3c5ea2-7782-41c7-b5b3-bd6b88e987c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/ips" status: 200 len: 150 microversion: 2.1 time: 0.176844 Aug 04 14:17:08.510227 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2015/4057] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:17:08 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/ips => generated 150 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:08.526445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-01266643-6f6a-4258-9cc6-1f8ef2db94cb req-cc458ed5-6679-4176-88b9-d53a8a7d84eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ffdabf-8907-428a-91e2-89a32616e683", "name": "network-vif-deleted", "tag": "3767cf18-ff64-4e0e-92ea-2beb69097e3c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:08.556840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-01266643-6f6a-4258-9cc6-1f8ef2db94cb req-cc458ed5-6679-4176-88b9-d53a8a7d84eb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:08.566438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-01266643-6f6a-4258-9cc6-1f8ef2db94cb req-cc458ed5-6679-4176-88b9-d53a8a7d84eb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:08.623382 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-01266643-6f6a-4258-9cc6-1f8ef2db94cb req-cc458ed5-6679-4176-88b9-d53a8a7d84eb service nova] Creating event network-vif-deleted:3767cf18-ff64-4e0e-92ea-2beb69097e3c for instance f3ffdabf-8907-428a-91e2-89a32616e683 on n-h1-844627-10 Aug 04 14:17:08.645628 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-01266643-6f6a-4258-9cc6-1f8ef2db94cb req-cc458ed5-6679-4176-88b9-d53a8a7d84eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133090 Aug 04 14:17:08.647675 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2016/4058] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:08.684344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75f0cc7a-2e5e-4aac-a40d-05e9b0a3cb36 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:08.689546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-75f0cc7a-2e5e-4aac-a40d-05e9b0a3cb36 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:09.127171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75f0cc7a-2e5e-4aac-a40d-05e9b0a3cb36 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:09.137446 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75f0cc7a-2e5e-4aac-a40d-05e9b0a3cb36 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1218 microversion: 2.1 time: 0.482619 Aug 04 14:17:09.146890 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2017/4059] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:08 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1218 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:09.158602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:09.170357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:09.199466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:09.201173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:09.203776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:09.205863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:09.282075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bf5a097f-9b1e-483c-8e91-8027800e36b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:09.297379 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf5a097f-9b1e-483c-8e91-8027800e36b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.327298 Aug 04 14:17:09.311832 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2043/4060] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:07 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:09.366018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-46b9faf7-572c-4920-bb2e-c9ce5e4cfdd5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:09.369937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-46b9faf7-572c-4920-bb2e-c9ce5e4cfdd5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:09.391331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-46b9faf7-572c-4920-bb2e-c9ce5e4cfdd5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:09.395719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-46b9faf7-572c-4920-bb2e-c9ce5e4cfdd5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:09.401917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-46b9faf7-572c-4920-bb2e-c9ce5e4cfdd5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:09.402712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-46b9faf7-572c-4920-bb2e-c9ce5e4cfdd5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:10.258126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:10.295454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:10.303936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:10.307893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-46b9faf7-572c-4920-bb2e-c9ce5e4cfdd5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:10.311671 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a74e070a-728e-4e58-be80-c5fac2b360e8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1751 microversion: 2.20 time: 1.162745 Aug 04 14:17:10.312290 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2018/4061] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:09 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1751 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:10.333111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-46b9faf7-572c-4920-bb2e-c9ce5e4cfdd5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.973611 Aug 04 14:17:10.333111 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2044/4062] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:09 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:10.334031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8cbeae43-6105-4d84-a900-b4c0aa21285e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:10.334031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8cbeae43-6105-4d84-a900-b4c0aa21285e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:10.349172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0143130d-31a0-4fec-9fab-75857535a496 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:10.349897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0143130d-31a0-4fec-9fab-75857535a496 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:10.351887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cbeae43-6105-4d84-a900-b4c0aa21285e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:10.352473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cbeae43-6105-4d84-a900-b4c0aa21285e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:10.353349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cbeae43-6105-4d84-a900-b4c0aa21285e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:10.357985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cbeae43-6105-4d84-a900-b4c0aa21285e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:10.371330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0143130d-31a0-4fec-9fab-75857535a496 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:10.376282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0143130d-31a0-4fec-9fab-75857535a496 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:10.377639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0143130d-31a0-4fec-9fab-75857535a496 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:10.380115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0143130d-31a0-4fec-9fab-75857535a496 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:10.573876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8cbeae43-6105-4d84-a900-b4c0aa21285e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:10.589910 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8cbeae43-6105-4d84-a900-b4c0aa21285e tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1214 microversion: 2.1 time: 0.272876 Aug 04 14:17:10.597136 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2019/4063] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:10 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:11.058043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0143130d-31a0-4fec-9fab-75857535a496 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:11.088575 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0143130d-31a0-4fec-9fab-75857535a496 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.742471 Aug 04 14:17:11.092329 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2045/4064] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:10 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:17:11.117394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f21474d5-b2f1-4f2b-97b9-9217c29b8bca tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:11.133830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f21474d5-b2f1-4f2b-97b9-9217c29b8bca tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:11.181101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f21474d5-b2f1-4f2b-97b9-9217c29b8bca tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:11.190055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f21474d5-b2f1-4f2b-97b9-9217c29b8bca tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:11.191683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f21474d5-b2f1-4f2b-97b9-9217c29b8bca tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:11.196839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f21474d5-b2f1-4f2b-97b9-9217c29b8bca tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:11.346540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:11.348478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:11.377706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:11.380545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:11.387214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:11.389035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:11.419916 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f21474d5-b2f1-4f2b-97b9-9217c29b8bca tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.311210 Aug 04 14:17:11.429049 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2020/4065] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:17:11 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:17:11.441104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7512280-a5b9-4a6e-8077-7a50c8f3a7d4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:11.442112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e7512280-a5b9-4a6e-8077-7a50c8f3a7d4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:11.454937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7512280-a5b9-4a6e-8077-7a50c8f3a7d4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:11.460136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7512280-a5b9-4a6e-8077-7a50c8f3a7d4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:11.461333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7512280-a5b9-4a6e-8077-7a50c8f3a7d4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:11.467299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7512280-a5b9-4a6e-8077-7a50c8f3a7d4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:13.245392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:13.262397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e7512280-a5b9-4a6e-8077-7a50c8f3a7d4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:13.264495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:13.271328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:13.273663 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-291d704e-815b-463c-8bc9-7016e825db68 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1751 microversion: 2.20 time: 1.934143 Aug 04 14:17:13.276828 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2046/4066] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:11 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1751 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:13.294582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd51076c-3aff-4f64-bb61-0a0ee132598c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:13.295506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd51076c-3aff-4f64-bb61-0a0ee132598c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:13.305949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd51076c-3aff-4f64-bb61-0a0ee132598c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:13.309354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd51076c-3aff-4f64-bb61-0a0ee132598c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:13.310559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd51076c-3aff-4f64-bb61-0a0ee132598c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:13.314977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd51076c-3aff-4f64-bb61-0a0ee132598c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:13.342011 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e7512280-a5b9-4a6e-8077-7a50c8f3a7d4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1671 microversion: 2.1 time: 1.911154 Aug 04 14:17:13.343121 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2021/4067] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:11 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1671 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:13.375821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2acb5664-3d0e-4e2f-8147-cb9bd05810a8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cceca16-91a6-45b6-9704-7adbb178c810"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:13.391402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2acb5664-3d0e-4e2f-8147-cb9bd05810a8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:13.427588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2acb5664-3d0e-4e2f-8147-cb9bd05810a8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:13.428060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2acb5664-3d0e-4e2f-8147-cb9bd05810a8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:13.429487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2acb5664-3d0e-4e2f-8147-cb9bd05810a8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:13.429941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2acb5664-3d0e-4e2f-8147-cb9bd05810a8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:13.574002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dd51076c-3aff-4f64-bb61-0a0ee132598c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:13.592629 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd51076c-3aff-4f64-bb61-0a0ee132598c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1276 microversion: 2.1 time: 0.310410 Aug 04 14:17:13.597044 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2047/4068] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:13 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1276 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:14.336171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:14.337782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:14.347339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:14.363449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:14.368042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:14.368946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:15.067148 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2acb5664-3d0e-4e2f-8147-cb9bd05810a8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.722109 Aug 04 14:17:15.075402 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2022/4069] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:17:13 2022] POST /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 194 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:15.092094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01b6dfca-0a63-4f53-aca6-79d1c57c4100 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:15.097717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-01b6dfca-0a63-4f53-aca6-79d1c57c4100 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:15.116313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01b6dfca-0a63-4f53-aca6-79d1c57c4100 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:15.123357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01b6dfca-0a63-4f53-aca6-79d1c57c4100 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:15.130584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01b6dfca-0a63-4f53-aca6-79d1c57c4100 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:15.132831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01b6dfca-0a63-4f53-aca6-79d1c57c4100 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:16.514612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-01b6dfca-0a63-4f53-aca6-79d1c57c4100 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:16.545760 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-01b6dfca-0a63-4f53-aca6-79d1c57c4100 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1671 microversion: 2.1 time: 1.460183 Aug 04 14:17:16.547890 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2023/4070] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:15 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1671 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:16.567290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af15a6b7-15c8-43b4-a52e-5544cf59d60b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:16.572704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af15a6b7-15c8-43b4-a52e-5544cf59d60b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:16.612402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af15a6b7-15c8-43b4-a52e-5544cf59d60b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:16.613651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af15a6b7-15c8-43b4-a52e-5544cf59d60b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:16.618958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af15a6b7-15c8-43b4-a52e-5544cf59d60b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:16.624467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af15a6b7-15c8-43b4-a52e-5544cf59d60b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:16.674567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:16.691403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:16.695817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:16.697629 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-27ec73f9-bbd9-46d4-ad34-a5a90742eb89 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1751 microversion: 2.20 time: 2.371483 Aug 04 14:17:16.706278 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2048/4071] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:14 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1751 bytes in 2381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:17:17.369792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-af15a6b7-15c8-43b4-a52e-5544cf59d60b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:17.390977 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af15a6b7-15c8-43b4-a52e-5544cf59d60b tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1276 microversion: 2.1 time: 0.836941 Aug 04 14:17:17.408247 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2024/4072] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:16 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1276 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:17.595440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f4176718-29cd-4bd0-bc2b-294b8672ce11 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:17.602510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f4176718-29cd-4bd0-bc2b-294b8672ce11 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:17.605216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:17.620130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4176718-29cd-4bd0-bc2b-294b8672ce11 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:17.621129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4176718-29cd-4bd0-bc2b-294b8672ce11 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:17.624292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4176718-29cd-4bd0-bc2b-294b8672ce11 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:17.625629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4176718-29cd-4bd0-bc2b-294b8672ce11 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:17.689309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:17.754079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:17.759731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:17.776456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:17.777039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:17.777906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:17.778379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:17.993144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:18.681379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f4176718-29cd-4bd0-bc2b-294b8672ce11 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:18.721775 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f4176718-29cd-4bd0-bc2b-294b8672ce11 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1671 microversion: 2.1 time: 1.133444 Aug 04 14:17:18.724295 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2049/4073] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:17 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1671 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:18.734092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c468817-097a-4224-9cac-ba2c645d945c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:18.735730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3c468817-097a-4224-9cac-ba2c645d945c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:18.749215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c468817-097a-4224-9cac-ba2c645d945c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:18.750392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c468817-097a-4224-9cac-ba2c645d945c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:18.752233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c468817-097a-4224-9cac-ba2c645d945c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:18.753562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c468817-097a-4224-9cac-ba2c645d945c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:18.847240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:18.875811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:18.889683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:18.902604 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dd0b4750-20f9-46ff-9000-cdae2b34e387 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 1.154379 Aug 04 14:17:18.904281 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2025/4074] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:17 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:19.640248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c468817-097a-4224-9cac-ba2c645d945c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:19.658473 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c468817-097a-4224-9cac-ba2c645d945c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1318 microversion: 2.1 time: 0.932207 Aug 04 14:17:19.659163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2050/4075] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:18 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1318 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:19.771023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ce179cfa-50d6-4c1b-ae06-3d3812b2f2f4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:19.772111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ce179cfa-50d6-4c1b-ae06-3d3812b2f2f4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:19.776029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:19.793635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce179cfa-50d6-4c1b-ae06-3d3812b2f2f4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:19.794474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce179cfa-50d6-4c1b-ae06-3d3812b2f2f4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:19.796198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce179cfa-50d6-4c1b-ae06-3d3812b2f2f4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:19.797319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce179cfa-50d6-4c1b-ae06-3d3812b2f2f4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:19.957431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:19.958999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:19.976899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:19.979775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:19.984069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:19.985323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:20.418545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ce179cfa-50d6-4c1b-ae06-3d3812b2f2f4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:20.435548 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ce179cfa-50d6-4c1b-ae06-3d3812b2f2f4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.670291 Aug 04 14:17:20.436453 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2026/4076] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:19 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:20.471126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a65de85-67fc-417d-aeb6-109ea91c3095 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:20.487842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a65de85-67fc-417d-aeb6-109ea91c3095 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:20.555369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a65de85-67fc-417d-aeb6-109ea91c3095 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:20.576933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a65de85-67fc-417d-aeb6-109ea91c3095 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:20.581732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a65de85-67fc-417d-aeb6-109ea91c3095 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:20.582426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a65de85-67fc-417d-aeb6-109ea91c3095 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:20.711903 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a65de85-67fc-417d-aeb6-109ea91c3095 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 200 len: 324 microversion: 2.1 time: 0.248081 Aug 04 14:17:20.712632 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2027/4077] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:17:20 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:20.725625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c8d8054-2c10-494d-bfb3-246d1bf67fc8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:20.726800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c8d8054-2c10-494d-bfb3-246d1bf67fc8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:20.746575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c8d8054-2c10-494d-bfb3-246d1bf67fc8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:20.748786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c8d8054-2c10-494d-bfb3-246d1bf67fc8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:20.761343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c8d8054-2c10-494d-bfb3-246d1bf67fc8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:20.761803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c8d8054-2c10-494d-bfb3-246d1bf67fc8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:21.544047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3c8d8054-2c10-494d-bfb3-246d1bf67fc8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:21.559664 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c8d8054-2c10-494d-bfb3-246d1bf67fc8 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1318 microversion: 2.1 time: 0.845572 Aug 04 14:17:21.560367 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2028/4078] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:20 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1318 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:21.567348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8319afd-bcba-481d-bc42-5e87f7941d1e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:21.568038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e8319afd-bcba-481d-bc42-5e87f7941d1e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:21.613161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8319afd-bcba-481d-bc42-5e87f7941d1e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:21.613624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8319afd-bcba-481d-bc42-5e87f7941d1e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:21.614441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8319afd-bcba-481d-bc42-5e87f7941d1e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:21.614871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8319afd-bcba-481d-bc42-5e87f7941d1e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:21.660940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:21.772200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:21.793656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:21.797003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:21.817457 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2fac6ab5-d298-4845-a381-98be03414da4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 1.864277 Aug 04 14:17:21.837156 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2051/4079] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:19 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:22.445925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8319afd-bcba-481d-bc42-5e87f7941d1e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:22.474658 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e8319afd-bcba-481d-bc42-5e87f7941d1e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.913003 Aug 04 14:17:22.477801 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2029/4080] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:21 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:22.512144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f711adf1-f87d-4470-ab75-221da97b0871 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:22.512773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f711adf1-f87d-4470-ab75-221da97b0871 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:22.533900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f711adf1-f87d-4470-ab75-221da97b0871 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:22.534364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f711adf1-f87d-4470-ab75-221da97b0871 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:22.547070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f711adf1-f87d-4470-ab75-221da97b0871 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:22.547797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f711adf1-f87d-4470-ab75-221da97b0871 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:22.609042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e247a0fe-5c21-446b-b8ef-34620c0fd552 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:22.610317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e247a0fe-5c21-446b-b8ef-34620c0fd552 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:22.628790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e247a0fe-5c21-446b-b8ef-34620c0fd552 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:22.629610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e247a0fe-5c21-446b-b8ef-34620c0fd552 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:22.630776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e247a0fe-5c21-446b-b8ef-34620c0fd552 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:22.640209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e247a0fe-5c21-446b-b8ef-34620c0fd552 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:23.273056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f711adf1-f87d-4470-ab75-221da97b0871 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:23.288074 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f711adf1-f87d-4470-ab75-221da97b0871 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.777662 Aug 04 14:17:23.299851 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2052/4081] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:22 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:23.315769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:23.322371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:23.348565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:23.349468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:23.351450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:23.353144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:23.471646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e247a0fe-5c21-446b-b8ef-34620c0fd552 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:23.492115 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e247a0fe-5c21-446b-b8ef-34620c0fd552 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1318 microversion: 2.1 time: 0.887136 Aug 04 14:17:23.506248 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2030/4082] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:22 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1318 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:23.514266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-d3171123-54f4-4104-b4ed-90b2c14fa02f req-6dbfc3fe-e912-4c3d-b339-f504b879ce5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9c2731-512a-423b-a54e-32f7e2171623", "tag": "fcaf7619-ad8a-4c0d-91da-0cf44e564f7f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:23.531605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d3171123-54f4-4104-b4ed-90b2c14fa02f req-6dbfc3fe-e912-4c3d-b339-f504b879ce5b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:23.532509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d3171123-54f4-4104-b4ed-90b2c14fa02f req-6dbfc3fe-e912-4c3d-b339-f504b879ce5b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:23.562663 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-d3171123-54f4-4104-b4ed-90b2c14fa02f req-6dbfc3fe-e912-4c3d-b339-f504b879ce5b service nova] Creating event network-changed:fcaf7619-ad8a-4c0d-91da-0cf44e564f7f for instance 8b9c2731-512a-423b-a54e-32f7e2171623 on n-h2-844627-10 Aug 04 14:17:23.575629 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-d3171123-54f4-4104-b4ed-90b2c14fa02f req-6dbfc3fe-e912-4c3d-b339-f504b879ce5b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067606 Aug 04 14:17:23.576596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2031/4083] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:23.585591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f85aa18e-f402-48b5-bfea-24a6510475d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:23.595428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f85aa18e-f402-48b5-bfea-24a6510475d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:23.619029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f85aa18e-f402-48b5-bfea-24a6510475d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:23.619647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f85aa18e-f402-48b5-bfea-24a6510475d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:23.621827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f85aa18e-f402-48b5-bfea-24a6510475d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:23.622429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f85aa18e-f402-48b5-bfea-24a6510475d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:23.986972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:24.027159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:24.028805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:24.030123 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-601b4da4-e686-4db9-9a07-bf55c90e7abe tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.722911 Aug 04 14:17:24.044840 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2053/4084] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:23 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:24.294505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f85aa18e-f402-48b5-bfea-24a6510475d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:24.334442 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f85aa18e-f402-48b5-bfea-24a6510475d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.755405 Aug 04 14:17:24.335069 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2032/4085] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:23 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:24.355963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebe80ab5-bd5a-47ff-a7ff-127d1648fd58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:24.356602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ebe80ab5-bd5a-47ff-a7ff-127d1648fd58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:24.366196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebe80ab5-bd5a-47ff-a7ff-127d1648fd58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:24.366720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebe80ab5-bd5a-47ff-a7ff-127d1648fd58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:24.367832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebe80ab5-bd5a-47ff-a7ff-127d1648fd58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:24.368284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebe80ab5-bd5a-47ff-a7ff-127d1648fd58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:24.441824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2096991196", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:24.554953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] validate_networks() for [('c36127b5-f11e-4aaf-a5b7-745a958df80e', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:17:25.447105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ebe80ab5-bd5a-47ff-a7ff-127d1648fd58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:25.463644 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ebe80ab5-bd5a-47ff-a7ff-127d1648fd58 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.112142 Aug 04 14:17:25.464997 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2033/4086] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:24 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:25.472325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f7c03f14-78e8-46ad-9196-294bae346155 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:25.473529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f7c03f14-78e8-46ad-9196-294bae346155 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:25.482418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7c03f14-78e8-46ad-9196-294bae346155 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:25.483428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7c03f14-78e8-46ad-9196-294bae346155 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:25.484564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7c03f14-78e8-46ad-9196-294bae346155 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:25.485402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7c03f14-78e8-46ad-9196-294bae346155 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:26.746538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f7c03f14-78e8-46ad-9196-294bae346155 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:26.756445 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f7c03f14-78e8-46ad-9196-294bae346155 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1318 microversion: 2.1 time: 1.288048 Aug 04 14:17:26.768809 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2034/4087] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:25 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1318 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:26.779348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:26.780440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:26.788226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:26.793716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:26.794918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:26.795589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:27.347242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:27.361081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:17:27.361660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:17:27.362200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:17:27.362720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:17:27.363513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:17:27.369924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:27.381918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:27.386728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:27.391044 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-718c51ce-6133-4248-9bdc-312648b5b6c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.619524 Aug 04 14:17:27.391781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:27.394536 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2035/4088] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:26 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:27.405475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:27.405475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:27.410384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6992bf3c-8360-42e7-a0ef-6ea2af62693f req-fa539703-5561-4d1a-8601-0b2026787a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe2d9d1-89d0-4c98-9428-79a8c8882a36", "tag": "f1b01ebf-9f7d-44d8-bc89-71147b6084f6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:27.456634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6992bf3c-8360-42e7-a0ef-6ea2af62693f req-fa539703-5561-4d1a-8601-0b2026787a5c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:27.463861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6992bf3c-8360-42e7-a0ef-6ea2af62693f req-fa539703-5561-4d1a-8601-0b2026787a5c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:27.497188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Getting quotas for project 739b5f24a38247d2b7bfb3f90192e445. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:17:27.510565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6992bf3c-8360-42e7-a0ef-6ea2af62693f req-fa539703-5561-4d1a-8601-0b2026787a5c service nova] Creating event network-changed:f1b01ebf-9f7d-44d8-bc89-71147b6084f6 for instance dfe2d9d1-89d0-4c98-9428-79a8c8882a36 on n-h2-844627-10 Aug 04 14:17:27.522995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Getting quotas for user e9a0ee5f76db459c9e27d5024892a9da and project 739b5f24a38247d2b7bfb3f90192e445. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:17:27.531625 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6992bf3c-8360-42e7-a0ef-6ea2af62693f req-fa539703-5561-4d1a-8601-0b2026787a5c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128559 Aug 04 14:17:27.534466 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2036/4089] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:27.550520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1143645971", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4d77cf6c-b556-48ab-92a8-04444fe680a2"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:27.573105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:17:27.590602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:17:27.731603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] validate_networks() for [('4d77cf6c-b556-48ab-92a8-04444fe680a2', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:17:27.750979 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff69b006-40c1-488e-85a1-4567b8592bce tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.719099 Aug 04 14:17:27.771834 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2054/4090] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:17:27.788522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1c40864-b651-4421-87f5-0e009b7d248d tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:27.789330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a1c40864-b651-4421-87f5-0e009b7d248d tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:28.238674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1c40864-b651-4421-87f5-0e009b7d248d tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:28.249994 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1c40864-b651-4421-87f5-0e009b7d248d tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1224 microversion: 2.1 time: 0.476579 Aug 04 14:17:28.250947 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2055/4091] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:27 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1224 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:28.271066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81e191ab-67cc-4af6-99a2-b3545048cd11 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:28.272090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81e191ab-67cc-4af6-99a2-b3545048cd11 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:28.292703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81e191ab-67cc-4af6-99a2-b3545048cd11 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:28.301458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81e191ab-67cc-4af6-99a2-b3545048cd11 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:28.306945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81e191ab-67cc-4af6-99a2-b3545048cd11 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:28.307785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81e191ab-67cc-4af6-99a2-b3545048cd11 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:29.012773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-81e191ab-67cc-4af6-99a2-b3545048cd11 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:29.050169 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81e191ab-67cc-4af6-99a2-b3545048cd11 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1318 microversion: 2.1 time: 0.789867 Aug 04 14:17:29.085264 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2056/4092] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:28 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1318 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:29.114415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:29.120147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:29.173472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:29.175304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:29.178449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:29.179563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:30.038686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:30.058261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:30.060293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:30.066951 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5329870b-5a1d-49ef-85da-8cab1c5e721d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.978620 Aug 04 14:17:30.068405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2057/4093] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:29 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:30.082644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc2afd2f-9bb7-4e98-b629-9ffa5c2bfff9 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:30.083629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dc2afd2f-9bb7-4e98-b629-9ffa5c2bfff9 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:30.098982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc2afd2f-9bb7-4e98-b629-9ffa5c2bfff9 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:30.103432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc2afd2f-9bb7-4e98-b629-9ffa5c2bfff9 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:30.105647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc2afd2f-9bb7-4e98-b629-9ffa5c2bfff9 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:30.107252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc2afd2f-9bb7-4e98-b629-9ffa5c2bfff9 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:30.942104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:17:30.944350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:17:30.945105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:17:30.945706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:17:30.946275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:17:30.975779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:30.978411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:30.980681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:30.999547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:31.010292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dc2afd2f-9bb7-4e98-b629-9ffa5c2bfff9 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:31.049080 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc2afd2f-9bb7-4e98-b629-9ffa5c2bfff9 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1276 microversion: 2.1 time: 0.951252 Aug 04 14:17:31.062793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:17:31.068503 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2058/4094] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:30 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1276 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:31.074937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-746b7e29-dfe6-47d7-a6a3-dd9a09d92cd9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:31.083355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for user fab9d445099545e98979afa009678007 and project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:17:31.084530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-746b7e29-dfe6-47d7-a6a3-dd9a09d92cd9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:31.109824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-746b7e29-dfe6-47d7-a6a3-dd9a09d92cd9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:31.112161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-746b7e29-dfe6-47d7-a6a3-dd9a09d92cd9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:31.114643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-746b7e29-dfe6-47d7-a6a3-dd9a09d92cd9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:31.117499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-746b7e29-dfe6-47d7-a6a3-dd9a09d92cd9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:31.125884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:17:31.133634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:17:31.292935 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d62e6d0-1673-45fc-b076-e664a45c236b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.754383 Aug 04 14:17:31.305246 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2037/4095] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:17:31.349472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:31.350401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:31.380760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:31.398380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:31.402636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:31.404483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:32.926537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:32.952794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:32.956140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:32.965754 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa22be25-db08-486c-84e3-e767fa9c4814 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 1.657778 Aug 04 14:17:32.968021 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2038/4096] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:31 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:32.974583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-746b7e29-dfe6-47d7-a6a3-dd9a09d92cd9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:32.988409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c787fb69-a806-44e8-b08d-744e99003dfe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:32.993797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c787fb69-a806-44e8-b08d-744e99003dfe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:33.012282 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-746b7e29-dfe6-47d7-a6a3-dd9a09d92cd9 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1318 microversion: 2.1 time: 1.940875 Aug 04 14:17:33.024338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c787fb69-a806-44e8-b08d-744e99003dfe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:33.027829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c787fb69-a806-44e8-b08d-744e99003dfe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:33.030118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c787fb69-a806-44e8-b08d-744e99003dfe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:33.037574 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2059/4097] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:31 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1318 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:33.038292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c787fb69-a806-44e8-b08d-744e99003dfe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:33.093113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aa943ce9-ff99-4ab4-9cc1-11dd306d930e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:33.096820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aa943ce9-ff99-4ab4-9cc1-11dd306d930e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:33.132440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa943ce9-ff99-4ab4-9cc1-11dd306d930e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:33.136845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa943ce9-ff99-4ab4-9cc1-11dd306d930e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:33.142411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa943ce9-ff99-4ab4-9cc1-11dd306d930e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:33.150081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa943ce9-ff99-4ab4-9cc1-11dd306d930e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:33.473822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aa943ce9-ff99-4ab4-9cc1-11dd306d930e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:33.500815 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aa943ce9-ff99-4ab4-9cc1-11dd306d930e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1282 microversion: 2.1 time: 0.459936 Aug 04 14:17:33.527898 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2060/4098] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:33 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1282 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:33.537492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-73272fca-0323-4e02-9f80-46d880b12ca1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: .version_select at 0x7f46f3ce9a60>, body: {"keypair": {"name": "tempest-keypair-1777609227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKthFveoTx6kLPRQFdIh1vE/a2hRRt4a5ZSxk6Vjouu7Ffe5sibK79Kly28GYh+BfSdCjPUjhEl2ZJo/01vhqA74e+EMujnerffAIGzkK80NCSTUt2A42kLxgZb5tSVNQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:33.572122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-73272fca-0323-4e02-9f80-46d880b12ca1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:17:33.582317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-73272fca-0323-4e02-9f80-46d880b12ca1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for user 0a5b06982b8b43ef98866e495427d381 and project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:17:33.657964 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-73272fca-0323-4e02-9f80-46d880b12ca1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128695 Aug 04 14:17:33.658683 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2061/4099] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:17:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:33.996014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:33.996811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:34.019583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:34.020037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:34.021090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:34.021553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:34.298010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c787fb69-a806-44e8-b08d-744e99003dfe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:34.317382 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c787fb69-a806-44e8-b08d-744e99003dfe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1219 microversion: 2.1 time: 1.343101 Aug 04 14:17:34.326777 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2039/4100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:32 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1219 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:34.343625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d5a6869-45ea-4c75-9249-1030e6394f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:34.345082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d5a6869-45ea-4c75-9249-1030e6394f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:34.363651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5a6869-45ea-4c75-9249-1030e6394f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:34.367493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5a6869-45ea-4c75-9249-1030e6394f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:34.371680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5a6869-45ea-4c75-9249-1030e6394f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:34.375092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5a6869-45ea-4c75-9249-1030e6394f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:35.409887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:35.434477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:35.444035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:35.449980 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe7be8ed-7744-46e9-ad08-56533d201118 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 1.458272 Aug 04 14:17:35.465911 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2062/4101] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:33 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:17:35.494314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c7bdffe7-eb30-49f5-aeff-ac09d6033344 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:35.501222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c7bdffe7-eb30-49f5-aeff-ac09d6033344 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:35.513681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d5a6869-45ea-4c75-9249-1030e6394f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:35.523432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe7-eb30-49f5-aeff-ac09d6033344 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:35.524159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe7-eb30-49f5-aeff-ac09d6033344 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:35.525603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe7-eb30-49f5-aeff-ac09d6033344 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:35.526224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7bdffe7-eb30-49f5-aeff-ac09d6033344 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:35.577411 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d5a6869-45ea-4c75-9249-1030e6394f00 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1318 microversion: 2.1 time: 1.233877 Aug 04 14:17:35.579259 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2040/4102] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:34 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1318 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:35.588082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c1c9fa25-ac53-4f5d-aaa9-b052ca0810c9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:35.602548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c1c9fa25-ac53-4f5d-aaa9-b052ca0810c9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:35.636573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9fa25-ac53-4f5d-aaa9-b052ca0810c9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:35.650398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9fa25-ac53-4f5d-aaa9-b052ca0810c9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:35.652422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9fa25-ac53-4f5d-aaa9-b052ca0810c9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:35.653515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1c9fa25-ac53-4f5d-aaa9-b052ca0810c9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:36.049077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c7bdffe7-eb30-49f5-aeff-ac09d6033344 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:36.065331 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c7bdffe7-eb30-49f5-aeff-ac09d6033344 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1282 microversion: 2.1 time: 0.586506 Aug 04 14:17:36.069374 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2063/4103] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:35 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1282 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:36.287352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1c9fa25-ac53-4f5d-aaa9-b052ca0810c9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:36.320415 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c1c9fa25-ac53-4f5d-aaa9-b052ca0810c9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1273 microversion: 2.1 time: 0.728728 Aug 04 14:17:36.322112 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2041/4104] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:35 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1273 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:36.485200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:36.487449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:36.515712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:36.520439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:36.523813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:36.538223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:36.604066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ae8d996-2c64-440c-904a-bc8e0793ab48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:36.615310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0ae8d996-2c64-440c-904a-bc8e0793ab48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:36.657350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ae8d996-2c64-440c-904a-bc8e0793ab48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:36.658700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ae8d996-2c64-440c-904a-bc8e0793ab48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:36.660108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ae8d996-2c64-440c-904a-bc8e0793ab48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:36.661054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ae8d996-2c64-440c-904a-bc8e0793ab48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:37.439107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:37.659987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0ae8d996-2c64-440c-904a-bc8e0793ab48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:37.677115 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0ae8d996-2c64-440c-904a-bc8e0793ab48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1318 microversion: 2.1 time: 1.081174 Aug 04 14:17:37.678084 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2042/4105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:36 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1318 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:37.687283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b989602b-ac66-468e-b6ed-37b00b40c987 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:37.688217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b989602b-ac66-468e-b6ed-37b00b40c987 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:37.705812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b989602b-ac66-468e-b6ed-37b00b40c987 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:37.706565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b989602b-ac66-468e-b6ed-37b00b40c987 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:37.707749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b989602b-ac66-468e-b6ed-37b00b40c987 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:37.708443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b989602b-ac66-468e-b6ed-37b00b40c987 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:38.503827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:38.549142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:38.551538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:38.556830 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b724e101-edc6-408d-b662-4bff33cfbe50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 2.075257 Aug 04 14:17:38.560225 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2064/4106] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:36 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:38.598958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a7ff59b3-0e58-4a05-9776-05b06a388645 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:38.602784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a7ff59b3-0e58-4a05-9776-05b06a388645 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:38.637764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7ff59b3-0e58-4a05-9776-05b06a388645 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:38.639665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7ff59b3-0e58-4a05-9776-05b06a388645 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:38.642058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7ff59b3-0e58-4a05-9776-05b06a388645 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:38.645050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7ff59b3-0e58-4a05-9776-05b06a388645 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:38.933216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b989602b-ac66-468e-b6ed-37b00b40c987 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:38.953701 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b989602b-ac66-468e-b6ed-37b00b40c987 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1324 microversion: 2.1 time: 1.274284 Aug 04 14:17:38.957506 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2043/4107] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:37 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1324 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:38.976973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0baba885-cdf3-49d5-9112-77ba972ca714 req-2d482b67-3f44-4eac-80d7-d5d4bec76e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe2d9d1-89d0-4c98-9428-79a8c8882a36", "name": "network-vif-plugged", "status": "completed", "tag": "f1b01ebf-9f7d-44d8-bc89-71147b6084f6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:38.988097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:39.017810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0baba885-cdf3-49d5-9112-77ba972ca714 req-2d482b67-3f44-4eac-80d7-d5d4bec76e51 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:39.018271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0baba885-cdf3-49d5-9112-77ba972ca714 req-2d482b67-3f44-4eac-80d7-d5d4bec76e51 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:39.048784 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0baba885-cdf3-49d5-9112-77ba972ca714 req-2d482b67-3f44-4eac-80d7-d5d4bec76e51 service nova] Creating event network-vif-plugged:f1b01ebf-9f7d-44d8-bc89-71147b6084f6 for instance dfe2d9d1-89d0-4c98-9428-79a8c8882a36 on n-h2-844627-10 Aug 04 14:17:39.061181 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0baba885-cdf3-49d5-9112-77ba972ca714 req-2d482b67-3f44-4eac-80d7-d5d4bec76e51 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102123 Aug 04 14:17:39.063184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a7ff59b3-0e58-4a05-9776-05b06a388645 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:39.063824 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2044/4108] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:39.074119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eabfcab1-5f77-4de9-845b-cbc842103a1f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:39.084968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eabfcab1-5f77-4de9-845b-cbc842103a1f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:39.096220 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a7ff59b3-0e58-4a05-9776-05b06a388645 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1273 microversion: 2.1 time: 0.533002 Aug 04 14:17:39.105602 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2065/4109] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:38 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1273 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:39.123375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eabfcab1-5f77-4de9-845b-cbc842103a1f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:39.127771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eabfcab1-5f77-4de9-845b-cbc842103a1f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:39.128968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eabfcab1-5f77-4de9-845b-cbc842103a1f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:39.131360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eabfcab1-5f77-4de9-845b-cbc842103a1f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:39.593973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:39.595379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:39.607726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:39.611416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:39.612855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:39.620240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:40.538224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:40.559309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:40.565910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:40.577366 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f66c89c6-138c-4efa-91ab-2bafe1cc5092 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.987005 Aug 04 14:17:40.579904 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2066/4110] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:39 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:17:40.711425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eabfcab1-5f77-4de9-845b-cbc842103a1f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:40.720657 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eabfcab1-5f77-4de9-845b-cbc842103a1f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1318 microversion: 2.1 time: 1.655279 Aug 04 14:17:40.726114 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2045/4111] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:39 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1318 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:40.740929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b5a3d7eb-3764-4fed-b500-349bb631001f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:40.747803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b5a3d7eb-3764-4fed-b500-349bb631001f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:40.799131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5a3d7eb-3764-4fed-b500-349bb631001f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:40.804512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5a3d7eb-3764-4fed-b500-349bb631001f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:40.806654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5a3d7eb-3764-4fed-b500-349bb631001f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:40.807358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5a3d7eb-3764-4fed-b500-349bb631001f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:40.835683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-991682190", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:41.045322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:41.110652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:41.153536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] validate_networks() for [('aae182f0-01e4-483b-8d95-1af990b09462', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:17:42.276891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b5a3d7eb-3764-4fed-b500-349bb631001f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:42.314210 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b5a3d7eb-3764-4fed-b500-349bb631001f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1324 microversion: 2.1 time: 1.585552 Aug 04 14:17:42.319400 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2046/4112] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:40 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1324 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:42.336934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd94fda7-585f-4fb3-8b80-d4211c4eb399 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:42.345362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd94fda7-585f-4fb3-8b80-d4211c4eb399 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:42.388818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd94fda7-585f-4fb3-8b80-d4211c4eb399 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:42.399119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd94fda7-585f-4fb3-8b80-d4211c4eb399 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:42.409647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd94fda7-585f-4fb3-8b80-d4211c4eb399 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:42.410469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd94fda7-585f-4fb3-8b80-d4211c4eb399 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:43.184271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fd94fda7-585f-4fb3-8b80-d4211c4eb399 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:43.204494 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd94fda7-585f-4fb3-8b80-d4211c4eb399 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1315 microversion: 2.1 time: 0.882889 Aug 04 14:17:43.206820 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2047/4113] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:42 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:43.227200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1798675847", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92919b9e-87d8-4c0f-81a1-d2a3d627e9d7"}], "security_groups": [{"name": "tempest-securitygroup--1248800163"}], "key_name": "tempest-keypair-1777609227", "user_data": "}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:43.598637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:44.893111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] validate_networks() for [('92919b9e-87d8-4c0f-81a1-d2a3d627e9d7', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:17:45.777388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:17:45.779420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:17:45.781515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:17:45.782746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:17:45.783811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:17:45.850375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:45.851169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:45.852179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:45.853104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:45.887317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Getting quotas for project 2b98f1d6353346fca5cd6346bae615f2. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:17:45.900346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Getting quotas for user c0c7b6a4b29b45349945e5051f6ad2c9 and project 2b98f1d6353346fca5cd6346bae615f2. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:17:45.936324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:17:45.939925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:17:46.015627 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b163deb3-f05d-4db4-b121-40c2e942f11c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.432163 Aug 04 14:17:46.017873 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2067/4114] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:17:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 5437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:17:46.027840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:46.029542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:46.045408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:46.046740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:46.049414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:46.050707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:46.562606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:17:46.563832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:17:46.564553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:17:46.565220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:17:46.565798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:17:46.585988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:46.597117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:46.600452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:46.601311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:46.602334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:46.602959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:46.607665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:46.608992 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-34028a68-a025-47db-9940-db780cb1f209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.589296 Aug 04 14:17:46.632387 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2068/4115] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:46 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:46.639436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bc611fb-2442-46b7-8005-3eb15a17d260 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:46.640386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4bc611fb-2442-46b7-8005-3eb15a17d260 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:46.648641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bc611fb-2442-46b7-8005-3eb15a17d260 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:46.649692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bc611fb-2442-46b7-8005-3eb15a17d260 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:46.651474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bc611fb-2442-46b7-8005-3eb15a17d260 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:46.652107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bc611fb-2442-46b7-8005-3eb15a17d260 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:46.656287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:46.710732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:17:46.727455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for user 0a5b06982b8b43ef98866e495427d381 and project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:17:46.781790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:17:46.800063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:17:46.935898 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e1d8901-5bf1-4725-9479-1dc018a84d72 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.725600 Aug 04 14:17:46.937534 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2048/4116] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:17:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 3730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:17:46.947411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ca0ef12-cfc9-419d-8776-e93f13918a55 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:46.949000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ca0ef12-cfc9-419d-8776-e93f13918a55 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:46.966909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ca0ef12-cfc9-419d-8776-e93f13918a55 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:46.967741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ca0ef12-cfc9-419d-8776-e93f13918a55 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:46.969483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ca0ef12-cfc9-419d-8776-e93f13918a55 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:46.970305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ca0ef12-cfc9-419d-8776-e93f13918a55 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:47.015591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:47.556820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4bc611fb-2442-46b7-8005-3eb15a17d260 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:47.586745 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4bc611fb-2442-46b7-8005-3eb15a17d260 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1509 microversion: 2.1 time: 0.950830 Aug 04 14:17:47.588300 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2069/4117] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:46 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1509 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:47.603812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-11abe84d-b69f-422f-abad-4910af640dfd req-fd2bada9-4c51-4799-8d1e-a682e99ea81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90aedd23-dedc-4ce9-91d8-da02f0f95e9a", "tag": "8c3190b7-98d8-4601-a148-9f3e97c4be74"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:47.631681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:47.638588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-11abe84d-b69f-422f-abad-4910af640dfd req-fd2bada9-4c51-4799-8d1e-a682e99ea81c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:47.639714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-11abe84d-b69f-422f-abad-4910af640dfd req-fd2bada9-4c51-4799-8d1e-a682e99ea81c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:47.699546 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-11abe84d-b69f-422f-abad-4910af640dfd req-fd2bada9-4c51-4799-8d1e-a682e99ea81c service nova] Creating event network-changed:8c3190b7-98d8-4601-a148-9f3e97c4be74 for instance 90aedd23-dedc-4ce9-91d8-da02f0f95e9a on n-h1-844627-10 Aug 04 14:17:47.724142 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-11abe84d-b69f-422f-abad-4910af640dfd req-fd2bada9-4c51-4799-8d1e-a682e99ea81c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132576 Aug 04 14:17:47.725616 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2070/4118] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:47.767853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ca0ef12-cfc9-419d-8776-e93f13918a55 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:47.791815 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ca0ef12-cfc9-419d-8776-e93f13918a55 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1324 microversion: 2.1 time: 0.851877 Aug 04 14:17:47.810387 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2049/4119] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:46 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1324 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:47.817069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3bf54d0-349c-434a-b9fc-20df1593703e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:47.817935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b3bf54d0-349c-434a-b9fc-20df1593703e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:47.849962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3bf54d0-349c-434a-b9fc-20df1593703e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:47.851350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3bf54d0-349c-434a-b9fc-20df1593703e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:47.857689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3bf54d0-349c-434a-b9fc-20df1593703e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:47.865730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3bf54d0-349c-434a-b9fc-20df1593703e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:47.908494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-89342f5d-e685-43ca-b94b-c460356dec95 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:47.914010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-89342f5d-e685-43ca-b94b-c460356dec95 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:47.925859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89342f5d-e685-43ca-b94b-c460356dec95 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:47.926741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89342f5d-e685-43ca-b94b-c460356dec95 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:47.927839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89342f5d-e685-43ca-b94b-c460356dec95 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:47.928637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89342f5d-e685-43ca-b94b-c460356dec95 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:48.105662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b3bf54d0-349c-434a-b9fc-20df1593703e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:48.117294 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3bf54d0-349c-434a-b9fc-20df1593703e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1220 microversion: 2.1 time: 0.305027 Aug 04 14:17:48.117904 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2050/4120] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:47 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1220 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:48.139515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-53fe10b3-44d7-4103-b955-5e16d50a7200 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:48.142004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-53fe10b3-44d7-4103-b955-5e16d50a7200 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:48.157836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53fe10b3-44d7-4103-b955-5e16d50a7200 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:48.158931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53fe10b3-44d7-4103-b955-5e16d50a7200 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:48.172507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53fe10b3-44d7-4103-b955-5e16d50a7200 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:48.173599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53fe10b3-44d7-4103-b955-5e16d50a7200 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:48.244158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-89342f5d-e685-43ca-b94b-c460356dec95 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:48.271042 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-89342f5d-e685-43ca-b94b-c460356dec95 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1315 microversion: 2.1 time: 0.543476 Aug 04 14:17:48.272383 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2071/4121] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:47 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:48.292451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e6b622af-fe2e-4e79-b7c8-fd733a772d56 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:48.293508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e6b622af-fe2e-4e79-b7c8-fd733a772d56 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:48.318363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6b622af-fe2e-4e79-b7c8-fd733a772d56 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:48.319237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6b622af-fe2e-4e79-b7c8-fd733a772d56 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:48.320343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6b622af-fe2e-4e79-b7c8-fd733a772d56 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:48.321140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6b622af-fe2e-4e79-b7c8-fd733a772d56 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:48.351074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-53fe10b3-44d7-4103-b955-5e16d50a7200 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:48.369536 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-53fe10b3-44d7-4103-b955-5e16d50a7200 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1246 microversion: 2.1 time: 0.236518 Aug 04 14:17:48.381851 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2051/4122] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:48 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1246 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:48.384914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:48.384914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:48.400548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:48.401409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:48.403331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:48.404349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:48.687649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e6b622af-fe2e-4e79-b7c8-fd733a772d56 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:48.699333 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e6b622af-fe2e-4e79-b7c8-fd733a772d56 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1509 microversion: 2.1 time: 0.421547 Aug 04 14:17:48.700504 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2072/4123] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:48 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:48.741049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3762effd-0019-4c00-8164-03492c3acf7f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:48.745267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3762effd-0019-4c00-8164-03492c3acf7f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:48.778178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3762effd-0019-4c00-8164-03492c3acf7f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:48.781720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3762effd-0019-4c00-8164-03492c3acf7f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:48.786346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3762effd-0019-4c00-8164-03492c3acf7f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:48.793577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3762effd-0019-4c00-8164-03492c3acf7f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:48.918948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:48.961094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:48.980694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:48.986805 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6dd06db7-905b-4f28-ab27-c031fc1389a9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.612137 Aug 04 14:17:48.991637 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2052/4124] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:48 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:49.016567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c9c509e-bbb5-4369-b43e-e5edb6e9ccb6 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:49.017578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c9c509e-bbb5-4369-b43e-e5edb6e9ccb6 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:49.028775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c9c509e-bbb5-4369-b43e-e5edb6e9ccb6 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:49.030426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c9c509e-bbb5-4369-b43e-e5edb6e9ccb6 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:49.031665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c9c509e-bbb5-4369-b43e-e5edb6e9ccb6 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:49.032352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c9c509e-bbb5-4369-b43e-e5edb6e9ccb6 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:49.045270 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3762effd-0019-4c00-8164-03492c3acf7f tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "PUT /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1081 microversion: 2.1 time: 0.313532 Aug 04 14:17:49.046230 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2073/4125] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:17:48 2022] PUT /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1081 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:17:49.079479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d6ee63e-cf93-4732-91ac-a7252b7e5c2a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:49.080972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3d6ee63e-cf93-4732-91ac-a7252b7e5c2a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:49.097891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d6ee63e-cf93-4732-91ac-a7252b7e5c2a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:49.103079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d6ee63e-cf93-4732-91ac-a7252b7e5c2a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:49.104469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d6ee63e-cf93-4732-91ac-a7252b7e5c2a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:49.105334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d6ee63e-cf93-4732-91ac-a7252b7e5c2a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:49.542565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9c9c509e-bbb5-4369-b43e-e5edb6e9ccb6 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:49.563477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3d6ee63e-cf93-4732-91ac-a7252b7e5c2a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:49.571787 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c9c509e-bbb5-4369-b43e-e5edb6e9ccb6 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1324 microversion: 2.1 time: 0.559330 Aug 04 14:17:49.577716 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2053/4126] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:48 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1324 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:49.584762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-454d915c-c8ba-4b67-870d-5240a1471138 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:49.585496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-454d915c-c8ba-4b67-870d-5240a1471138 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:49.585671 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3d6ee63e-cf93-4732-91ac-a7252b7e5c2a tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1507 microversion: 2.1 time: 0.510950 Aug 04 14:17:49.600436 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2074/4127] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:49 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1507 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:17:49.600722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-454d915c-c8ba-4b67-870d-5240a1471138 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:49.600722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-454d915c-c8ba-4b67-870d-5240a1471138 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:49.600722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-454d915c-c8ba-4b67-870d-5240a1471138 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:49.600722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-454d915c-c8ba-4b67-870d-5240a1471138 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:49.601538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb7433fc-e5ab-4444-a548-67e021912083 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:49.601538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb7433fc-e5ab-4444-a548-67e021912083 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:49.617213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb7433fc-e5ab-4444-a548-67e021912083 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:49.617939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb7433fc-e5ab-4444-a548-67e021912083 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:49.619058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb7433fc-e5ab-4444-a548-67e021912083 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:49.619671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb7433fc-e5ab-4444-a548-67e021912083 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:49.923159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-454d915c-c8ba-4b67-870d-5240a1471138 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:49.967306 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-454d915c-c8ba-4b67-870d-5240a1471138 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1268 microversion: 2.1 time: 0.385730 Aug 04 14:17:49.972415 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2054/4128] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:49 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1268 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:49.999109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d69935b4-4650-4f8a-844f-d4373f487979 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:50.000959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d69935b4-4650-4f8a-844f-d4373f487979 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:50.044230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d69935b4-4650-4f8a-844f-d4373f487979 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:50.047792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d69935b4-4650-4f8a-844f-d4373f487979 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:50.049086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d69935b4-4650-4f8a-844f-d4373f487979 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:50.051256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d69935b4-4650-4f8a-844f-d4373f487979 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:50.157884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bb7433fc-e5ab-4444-a548-67e021912083 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:50.174528 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb7433fc-e5ab-4444-a548-67e021912083 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1315 microversion: 2.1 time: 0.585085 Aug 04 14:17:50.175554 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2075/4129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:49 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:50.190015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c227c5a5-b753-4858-9326-a4bcdc1bff86 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:50.190979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c227c5a5-b753-4858-9326-a4bcdc1bff86 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:50.208859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c227c5a5-b753-4858-9326-a4bcdc1bff86 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:50.209788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c227c5a5-b753-4858-9326-a4bcdc1bff86 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:50.210915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c227c5a5-b753-4858-9326-a4bcdc1bff86 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:50.211636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c227c5a5-b753-4858-9326-a4bcdc1bff86 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:50.367010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d69935b4-4650-4f8a-844f-d4373f487979 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:50.391463 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d69935b4-4650-4f8a-844f-d4373f487979 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1312 microversion: 2.1 time: 0.414821 Aug 04 14:17:50.393685 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2055/4130] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:49 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:50.444213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-67a9514b-e9b9-4cd7-a9e9-b39a84cd6e37 req-b5e58c92-f73d-41d7-bc47-8a9a8f957f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12417b86-0c3b-4da6-8a39-8749c0d95322", "tag": "a866cc15-60d9-4d91-b52e-d11a952580ab"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:50.485895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-67a9514b-e9b9-4cd7-a9e9-b39a84cd6e37 req-b5e58c92-f73d-41d7-bc47-8a9a8f957f8a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:50.487000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-67a9514b-e9b9-4cd7-a9e9-b39a84cd6e37 req-b5e58c92-f73d-41d7-bc47-8a9a8f957f8a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:50.525223 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-67a9514b-e9b9-4cd7-a9e9-b39a84cd6e37 req-b5e58c92-f73d-41d7-bc47-8a9a8f957f8a service nova] Creating event network-changed:a866cc15-60d9-4d91-b52e-d11a952580ab for instance 12417b86-0c3b-4da6-8a39-8749c0d95322 on n-h2-844627-10 Aug 04 14:17:50.547021 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-67a9514b-e9b9-4cd7-a9e9-b39a84cd6e37 req-b5e58c92-f73d-41d7-bc47-8a9a8f957f8a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133567 Aug 04 14:17:50.548478 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2056/4131] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:50.560739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:50.562509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:50.580565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:50.581419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:50.583241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:50.584304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:50.669502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c227c5a5-b753-4858-9326-a4bcdc1bff86 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:50.678327 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c227c5a5-b753-4858-9326-a4bcdc1bff86 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1507 microversion: 2.1 time: 0.495937 Aug 04 14:17:50.686456 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2076/4132] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:50 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:50.697649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cbc86887-c3d0-4a79-b743-bf44ce05f126 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:50.698300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cbc86887-c3d0-4a79-b743-bf44ce05f126 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:50.712310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc86887-c3d0-4a79-b743-bf44ce05f126 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:50.720887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc86887-c3d0-4a79-b743-bf44ce05f126 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:50.721911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc86887-c3d0-4a79-b743-bf44ce05f126 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:50.722383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc86887-c3d0-4a79-b743-bf44ce05f126 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:51.721390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:51.739456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:51.741426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:51.742941 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e6f30061-776b-42a5-a5c8-75d50743597c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 1.192443 Aug 04 14:17:51.744087 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2057/4133] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:50 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:51.761269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3caad68d-38e7-4396-9b84-43e34bb0ce78 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:51.764104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3caad68d-38e7-4396-9b84-43e34bb0ce78 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:51.778465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3caad68d-38e7-4396-9b84-43e34bb0ce78 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:51.779218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3caad68d-38e7-4396-9b84-43e34bb0ce78 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:51.780225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3caad68d-38e7-4396-9b84-43e34bb0ce78 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:51.780849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3caad68d-38e7-4396-9b84-43e34bb0ce78 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:51.810672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cbc86887-c3d0-4a79-b743-bf44ce05f126 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:51.843365 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cbc86887-c3d0-4a79-b743-bf44ce05f126 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1324 microversion: 2.1 time: 1.153134 Aug 04 14:17:51.846626 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2077/4134] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:50 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1324 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:51.885203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23007f06-2583-40db-82ab-d8f404b9aa07 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:51.886277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-23007f06-2583-40db-82ab-d8f404b9aa07 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:51.908931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23007f06-2583-40db-82ab-d8f404b9aa07 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:51.909549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23007f06-2583-40db-82ab-d8f404b9aa07 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:51.911894 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3caad68d-38e7-4396-9b84-43e34bb0ce78 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "PUT /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1083 microversion: 2.1 time: 0.166453 Aug 04 14:17:51.914685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23007f06-2583-40db-82ab-d8f404b9aa07 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:51.915441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23007f06-2583-40db-82ab-d8f404b9aa07 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:51.925344 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2058/4135] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:17:51 2022] PUT /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1083 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:51.943765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0cc7ea5a-029b-4f54-8b85-b2da7cd4f0aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:51.944707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0cc7ea5a-029b-4f54-8b85-b2da7cd4f0aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:51.958985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cc7ea5a-029b-4f54-8b85-b2da7cd4f0aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:51.959813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cc7ea5a-029b-4f54-8b85-b2da7cd4f0aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:51.960829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cc7ea5a-029b-4f54-8b85-b2da7cd4f0aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:51.961546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cc7ea5a-029b-4f54-8b85-b2da7cd4f0aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:52.870218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-23007f06-2583-40db-82ab-d8f404b9aa07 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:52.901639 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-23007f06-2583-40db-82ab-d8f404b9aa07 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1316 microversion: 2.1 time: 1.037692 Aug 04 14:17:52.902820 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2078/4136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:51 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1316 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:52.918196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba54825e-cb18-40f3-8028-92a8f0c66c39 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:52.919271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba54825e-cb18-40f3-8028-92a8f0c66c39 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:52.946449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba54825e-cb18-40f3-8028-92a8f0c66c39 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:52.947203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba54825e-cb18-40f3-8028-92a8f0c66c39 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:52.948605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba54825e-cb18-40f3-8028-92a8f0c66c39 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:52.949391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba54825e-cb18-40f3-8028-92a8f0c66c39 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:52.950077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0cc7ea5a-029b-4f54-8b85-b2da7cd4f0aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:52.972481 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0cc7ea5a-029b-4f54-8b85-b2da7cd4f0aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1315 microversion: 2.1 time: 1.045163 Aug 04 14:17:52.975180 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2059/4137] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:51 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:52.984721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84766ec8-3b2d-4646-82b9-68e7564ffe48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:52.986541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84766ec8-3b2d-4646-82b9-68e7564ffe48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:52.998826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84766ec8-3b2d-4646-82b9-68e7564ffe48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:52.999916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84766ec8-3b2d-4646-82b9-68e7564ffe48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:53.001548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84766ec8-3b2d-4646-82b9-68e7564ffe48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:53.003176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84766ec8-3b2d-4646-82b9-68e7564ffe48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:53.433645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba54825e-cb18-40f3-8028-92a8f0c66c39 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:53.439528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84766ec8-3b2d-4646-82b9-68e7564ffe48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:53.445176 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba54825e-cb18-40f3-8028-92a8f0c66c39 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.540668 Aug 04 14:17:53.456968 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2079/4138] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:52 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:53.458238 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84766ec8-3b2d-4646-82b9-68e7564ffe48 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1509 microversion: 2.1 time: 0.478284 Aug 04 14:17:53.461910 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2060/4139] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:52 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:53.469465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:53.470363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:53.472949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-74a68a0f-8872-40fd-bebe-0e4e6c9fbf2f req-9d28c4a2-8e89-4a37-b5d7-32260c2b479b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aedd23-dedc-4ce9-91d8-da02f0f95e9a", "name": "network-vif-plugged", "status": "completed", "tag": "8c3190b7-98d8-4601-a148-9f3e97c4be74"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:53.486519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:53.487272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:53.488421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:53.491187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:53.498965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-74a68a0f-8872-40fd-bebe-0e4e6c9fbf2f req-9d28c4a2-8e89-4a37-b5d7-32260c2b479b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:53.499740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-74a68a0f-8872-40fd-bebe-0e4e6c9fbf2f req-9d28c4a2-8e89-4a37-b5d7-32260c2b479b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:53.525108 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-74a68a0f-8872-40fd-bebe-0e4e6c9fbf2f req-9d28c4a2-8e89-4a37-b5d7-32260c2b479b service nova] Creating event network-vif-plugged:8c3190b7-98d8-4601-a148-9f3e97c4be74 for instance 90aedd23-dedc-4ce9-91d8-da02f0f95e9a on n-h1-844627-10 Aug 04 14:17:53.531365 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-74a68a0f-8872-40fd-bebe-0e4e6c9fbf2f req-9d28c4a2-8e89-4a37-b5d7-32260c2b479b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067877 Aug 04 14:17:53.532272 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2061/4140] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:53.547351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-563e3893-a11e-46a9-9f56-2485dc976784 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:53.548356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-563e3893-a11e-46a9-9f56-2485dc976784 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:53.556907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-563e3893-a11e-46a9-9f56-2485dc976784 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:53.558219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-563e3893-a11e-46a9-9f56-2485dc976784 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:53.559514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-563e3893-a11e-46a9-9f56-2485dc976784 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:53.560945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-563e3893-a11e-46a9-9f56-2485dc976784 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:53.866075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:53.898114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:53.901829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:53.903991 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0bc24ead-5764-402f-8b15-560b5676326f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.446536 Aug 04 14:17:53.906091 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2080/4141] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:53 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:53.914091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a4b024a7-85e2-467c-bf0c-00b6e2cc767c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:53.916593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a4b024a7-85e2-467c-bf0c-00b6e2cc767c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:53.928656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4b024a7-85e2-467c-bf0c-00b6e2cc767c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:53.929146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4b024a7-85e2-467c-bf0c-00b6e2cc767c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:53.929954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4b024a7-85e2-467c-bf0c-00b6e2cc767c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:53.930397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4b024a7-85e2-467c-bf0c-00b6e2cc767c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.003278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-563e3893-a11e-46a9-9f56-2485dc976784 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:54.014584 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-563e3893-a11e-46a9-9f56-2485dc976784 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1324 microversion: 2.1 time: 0.479797 Aug 04 14:17:54.017365 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2062/4142] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:53 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:54.039161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08334679-d8c0-4136-8d07-57881c29347a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:54.040924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-08334679-d8c0-4136-8d07-57881c29347a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:54.064839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08334679-d8c0-4136-8d07-57881c29347a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.069586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08334679-d8c0-4136-8d07-57881c29347a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.071673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08334679-d8c0-4136-8d07-57881c29347a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.073092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08334679-d8c0-4136-8d07-57881c29347a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.177672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a4b024a7-85e2-467c-bf0c-00b6e2cc767c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:54.190795 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a4b024a7-85e2-467c-bf0c-00b6e2cc767c tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1509 microversion: 2.1 time: 0.283163 Aug 04 14:17:54.207531 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2081/4143] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:53 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:54.227646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a38520aa-a07a-45ad-ab81-bba236f16151 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:54.229013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a38520aa-a07a-45ad-ab81-bba236f16151 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:54.243002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a38520aa-a07a-45ad-ab81-bba236f16151 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.243471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a38520aa-a07a-45ad-ab81-bba236f16151 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.245631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a38520aa-a07a-45ad-ab81-bba236f16151 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.249813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a38520aa-a07a-45ad-ab81-bba236f16151 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.423828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08334679-d8c0-4136-8d07-57881c29347a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:54.433452 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08334679-d8c0-4136-8d07-57881c29347a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1316 microversion: 2.1 time: 0.414055 Aug 04 14:17:54.449171 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2063/4144] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:54 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:54.455629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1b823fd2-567a-4295-83aa-2069598ecdac tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:54.455629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b823fd2-567a-4295-83aa-2069598ecdac tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:54.462928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b823fd2-567a-4295-83aa-2069598ecdac tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.463487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b823fd2-567a-4295-83aa-2069598ecdac tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.464688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b823fd2-567a-4295-83aa-2069598ecdac tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.465265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b823fd2-567a-4295-83aa-2069598ecdac tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.500651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b823fd2-567a-4295-83aa-2069598ecdac tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:17:54.620537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a38520aa-a07a-45ad-ab81-bba236f16151 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:54.631890 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a38520aa-a07a-45ad-ab81-bba236f16151 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1315 microversion: 2.1 time: 0.422171 Aug 04 14:17:54.632769 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2082/4145] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:54 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:54.653147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e5ffb5fe-319f-48e2-b26d-e8a41fc96477 req-1348b71c-519c-40a3-83ef-becbfd2ed4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c416741-016d-4f02-9a57-507f0454876d", "tag": "e2a0c66d-f403-4a0a-8afd-7a706050968f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:54.670284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e5ffb5fe-319f-48e2-b26d-e8a41fc96477 req-1348b71c-519c-40a3-83ef-becbfd2ed4ea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.670413 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1b823fd2-567a-4295-83aa-2069598ecdac tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 204 len: 0 microversion: 2.1 time: 0.217330 Aug 04 14:17:54.670754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e5ffb5fe-319f-48e2-b26d-e8a41fc96477 req-1348b71c-519c-40a3-83ef-becbfd2ed4ea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.679325 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2064/4146] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:17:54 2022] DELETE /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:17:54.691368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4a0bf33-b56d-4f31-95ed-f68d6378025f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:54.692177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b4a0bf33-b56d-4f31-95ed-f68d6378025f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:54.693593 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e5ffb5fe-319f-48e2-b26d-e8a41fc96477 req-1348b71c-519c-40a3-83ef-becbfd2ed4ea service nova] Creating event network-changed:e2a0c66d-f403-4a0a-8afd-7a706050968f for instance 9c416741-016d-4f02-9a57-507f0454876d on n-h1-844627-10 Aug 04 14:17:54.699779 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e5ffb5fe-319f-48e2-b26d-e8a41fc96477 req-1348b71c-519c-40a3-83ef-becbfd2ed4ea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064862 Aug 04 14:17:54.700697 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2083/4147] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:54.706267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-988c2a76-ea6c-4c38-b295-a841b1f30343 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:54.706870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-988c2a76-ea6c-4c38-b295-a841b1f30343 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:54.707091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4a0bf33-b56d-4f31-95ed-f68d6378025f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.708041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4a0bf33-b56d-4f31-95ed-f68d6378025f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.709872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4a0bf33-b56d-4f31-95ed-f68d6378025f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.710419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4a0bf33-b56d-4f31-95ed-f68d6378025f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.715612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-988c2a76-ea6c-4c38-b295-a841b1f30343 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.716159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-988c2a76-ea6c-4c38-b295-a841b1f30343 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.716811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:54.717460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-988c2a76-ea6c-4c38-b295-a841b1f30343 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.718033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-988c2a76-ea6c-4c38-b295-a841b1f30343 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.757462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-988c2a76-ea6c-4c38-b295-a841b1f30343 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:17:54.816040 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.compute.api [None req-988c2a76-ea6c-4c38-b295-a841b1f30343 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Instance is already in deleting state, ignoring this request Aug 04 14:17:54.817207 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-988c2a76-ea6c-4c38-b295-a841b1f30343 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 204 len: 0 microversion: 2.1 time: 0.114934 Aug 04 14:17:54.818337 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2084/4148] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:17:54 2022] DELETE /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:17:54.832156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fd76b330-8a39-48df-a62e-37baf87f7080 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:54.834029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fd76b330-8a39-48df-a62e-37baf87f7080 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:54.841745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd76b330-8a39-48df-a62e-37baf87f7080 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.842481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd76b330-8a39-48df-a62e-37baf87f7080 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.843667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd76b330-8a39-48df-a62e-37baf87f7080 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:54.844501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd76b330-8a39-48df-a62e-37baf87f7080 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:54.850906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:55.010573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4a0bf33-b56d-4f31-95ed-f68d6378025f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:55.027772 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4a0bf33-b56d-4f31-95ed-f68d6378025f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.344747 Aug 04 14:17:55.044253 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2065/4149] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:54 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:55.061422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:55.064938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:55.088739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:55.091925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:55.095919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:55.098798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:55.107449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fd76b330-8a39-48df-a62e-37baf87f7080 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:55.128699 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fd76b330-8a39-48df-a62e-37baf87f7080 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1515 microversion: 2.1 time: 0.303810 Aug 04 14:17:55.131815 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2085/4150] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:54 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1515 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:55.152300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-63b19899-d61d-46fc-8048-93820e710ab8 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:55.154152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-63b19899-d61d-46fc-8048-93820e710ab8 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:55.170560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63b19899-d61d-46fc-8048-93820e710ab8 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:55.171257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63b19899-d61d-46fc-8048-93820e710ab8 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:55.172120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63b19899-d61d-46fc-8048-93820e710ab8 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:55.172568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63b19899-d61d-46fc-8048-93820e710ab8 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:55.421688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:55.424641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-63b19899-d61d-46fc-8048-93820e710ab8 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:55.431749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:55.433649 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-63b19899-d61d-46fc-8048-93820e710ab8 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1324 microversion: 2.1 time: 0.299703 Aug 04 14:17:55.433833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:55.435129 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d4226d0-e529-4b8f-afa3-d2e994d33e14 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.389210 Aug 04 14:17:55.436265 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2066/4151] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:55 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:55.436686 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2086/4152] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:55 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:55.457193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c31588d8-ecaa-460a-a96b-9d39677c3523 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:55.458348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c31588d8-ecaa-460a-a96b-9d39677c3523 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:55.471603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c31588d8-ecaa-460a-a96b-9d39677c3523 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:55.472548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c31588d8-ecaa-460a-a96b-9d39677c3523 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:55.474264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c31588d8-ecaa-460a-a96b-9d39677c3523 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:55.475850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c31588d8-ecaa-460a-a96b-9d39677c3523 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:55.547919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0fc74dba-6327-4d4a-af5d-d1b1c532db1b req-1b371a2a-8f2a-4896-8666-f34f8c5a55e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12417b86-0c3b-4da6-8a39-8749c0d95322", "name": "network-vif-plugged", "status": "completed", "tag": "a866cc15-60d9-4d91-b52e-d11a952580ab"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:55.566906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0fc74dba-6327-4d4a-af5d-d1b1c532db1b req-1b371a2a-8f2a-4896-8666-f34f8c5a55e2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:55.567584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0fc74dba-6327-4d4a-af5d-d1b1c532db1b req-1b371a2a-8f2a-4896-8666-f34f8c5a55e2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:55.585741 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0fc74dba-6327-4d4a-af5d-d1b1c532db1b req-1b371a2a-8f2a-4896-8666-f34f8c5a55e2 service nova] Creating event network-vif-plugged:a866cc15-60d9-4d91-b52e-d11a952580ab for instance 12417b86-0c3b-4da6-8a39-8749c0d95322 on n-h2-844627-10 Aug 04 14:17:55.592974 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0fc74dba-6327-4d4a-af5d-d1b1c532db1b req-1b371a2a-8f2a-4896-8666-f34f8c5a55e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048879 Aug 04 14:17:55.599335 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2087/4153] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:17:55.658536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1cb90292-5256-4938-a3be-2ecf57ef3ed2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:55.659837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1cb90292-5256-4938-a3be-2ecf57ef3ed2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:55.685966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1cb90292-5256-4938-a3be-2ecf57ef3ed2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:55.686962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1cb90292-5256-4938-a3be-2ecf57ef3ed2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:55.689876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1cb90292-5256-4938-a3be-2ecf57ef3ed2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:55.690515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1cb90292-5256-4938-a3be-2ecf57ef3ed2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:55.794570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c31588d8-ecaa-460a-a96b-9d39677c3523 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:55.808906 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c31588d8-ecaa-460a-a96b-9d39677c3523 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1316 microversion: 2.1 time: 0.357328 Aug 04 14:17:55.834341 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2067/4154] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:55 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:55.870172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:55.929544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:55.987144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1cb90292-5256-4938-a3be-2ecf57ef3ed2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:55.998204 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1cb90292-5256-4938-a3be-2ecf57ef3ed2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1315 microversion: 2.1 time: 0.346934 Aug 04 14:17:56.014416 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2088/4155] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:55 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:17:56.054596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3c4ffc7-74e4-4662-8efb-10a968a601f6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:56.057189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b3c4ffc7-74e4-4662-8efb-10a968a601f6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:56.069493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3c4ffc7-74e4-4662-8efb-10a968a601f6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:56.070771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3c4ffc7-74e4-4662-8efb-10a968a601f6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:56.074104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3c4ffc7-74e4-4662-8efb-10a968a601f6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:56.075329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3c4ffc7-74e4-4662-8efb-10a968a601f6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:56.167084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d187bff-8a55-4dac-826b-7240acdc48d3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:56.169362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6d187bff-8a55-4dac-826b-7240acdc48d3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:56.182616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d187bff-8a55-4dac-826b-7240acdc48d3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:56.188025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d187bff-8a55-4dac-826b-7240acdc48d3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:56.189392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d187bff-8a55-4dac-826b-7240acdc48d3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:56.190105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d187bff-8a55-4dac-826b-7240acdc48d3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:56.575308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b3c4ffc7-74e4-4662-8efb-10a968a601f6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:56.588510 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3c4ffc7-74e4-4662-8efb-10a968a601f6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.540968 Aug 04 14:17:56.590867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d187bff-8a55-4dac-826b-7240acdc48d3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:56.591275 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2068/4156] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:56 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:56.596822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d9bb333c-848f-4467-ad6e-a369523ed994 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:56.597910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d9bb333c-848f-4467-ad6e-a369523ed994 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:56.608107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9bb333c-848f-4467-ad6e-a369523ed994 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:56.609717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9bb333c-848f-4467-ad6e-a369523ed994 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:56.610841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9bb333c-848f-4467-ad6e-a369523ed994 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:56.611651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9bb333c-848f-4467-ad6e-a369523ed994 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:56.620399 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6d187bff-8a55-4dac-826b-7240acdc48d3 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1515 microversion: 2.1 time: 0.464214 Aug 04 14:17:56.622159 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2089/4157] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:56 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1515 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:56.647765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:56.649168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:56.656920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:56.664449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:56.665387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:56.667604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:56.668507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:56.744391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:56.959667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d9bb333c-848f-4467-ad6e-a369523ed994 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:56.970577 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d9bb333c-848f-4467-ad6e-a369523ed994 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1521 microversion: 2.1 time: 0.377959 Aug 04 14:17:56.972297 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2069/4158] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:56 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:56.978008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ba493eab-3685-4810-926c-c6eaca65beb4 req-b590a6bb-732a-407a-ad83-6d7bd1ac6c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4", "tag": "89262c5a-d9ee-45c1-b6d5-e91f0a6dc1c6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:56.999996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ba493eab-3685-4810-926c-c6eaca65beb4 req-b590a6bb-732a-407a-ad83-6d7bd1ac6c56 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.003406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ba493eab-3685-4810-926c-c6eaca65beb4 req-b590a6bb-732a-407a-ad83-6d7bd1ac6c56 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.019752 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ba493eab-3685-4810-926c-c6eaca65beb4 req-b590a6bb-732a-407a-ad83-6d7bd1ac6c56 service nova] Creating event network-changed:89262c5a-d9ee-45c1-b6d5-e91f0a6dc1c6 for instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 on n-h1-844627-10 Aug 04 14:17:57.027728 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ba493eab-3685-4810-926c-c6eaca65beb4 req-b590a6bb-732a-407a-ad83-6d7bd1ac6c56 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053390 Aug 04 14:17:57.028674 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2070/4159] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:57.041246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ab6de7c-0b67-41a5-9749-58eb06918f7f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:57.053997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ab6de7c-0b67-41a5-9749-58eb06918f7f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:57.058050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:57.072305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:57.074643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ab6de7c-0b67-41a5-9749-58eb06918f7f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.076147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ab6de7c-0b67-41a5-9749-58eb06918f7f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.076809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:57.078126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ab6de7c-0b67-41a5-9749-58eb06918f7f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.079143 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-624b5d22-38e8-44cc-bca5-2bdeccf18d10 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.443513 Aug 04 14:17:57.081109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ab6de7c-0b67-41a5-9749-58eb06918f7f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.081828 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2090/4160] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:56 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:57.087713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-96bbe5d8-5fe7-40b2-b88a-3c482161b8e9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:57.088561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-96bbe5d8-5fe7-40b2-b88a-3c482161b8e9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:57.116179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96bbe5d8-5fe7-40b2-b88a-3c482161b8e9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.122321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96bbe5d8-5fe7-40b2-b88a-3c482161b8e9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.123481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96bbe5d8-5fe7-40b2-b88a-3c482161b8e9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.124098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96bbe5d8-5fe7-40b2-b88a-3c482161b8e9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.503564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8ab6de7c-0b67-41a5-9749-58eb06918f7f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:57.521536 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ab6de7c-0b67-41a5-9749-58eb06918f7f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1316 microversion: 2.1 time: 0.487282 Aug 04 14:17:57.524614 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2071/4161] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:57 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:57.530091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-00cba508-c57e-4be2-9b12-dffab969ee2f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1761083746", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-00cba508-c57e-4be2-9b12-dffab969ee2f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Request method failure captured: Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 243 Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Tztz_QURohupBwY3T7ZJGBxrbdtK16nCyhu-Eg3RLRwJ5Qa4atWDBiM2CArznRlqHxQgKm06D9H3InppjQbx0OXMir5FYtS6Cul50Hm5TjOLa22zTdNPqcGftRjbHrAitgvbT_7Z4Dw73fXE13Au0yVtKrKd3iOdO5ijZ6DPeI0FM Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}] Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: e9a0ee5f76db459c9e27d5024892a9da Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1761083746", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1761083746', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'c36127b5-f11e-4aaf-a5b7-745a958df80e'}]}}} Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:57.534689 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-00cba508-c57e-4be2-9b12-dffab969ee2f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:57.545787 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-00cba508-c57e-4be2-9b12-dffab969ee2f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011373 Aug 04 14:17:57.549250 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2072/4162] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:17:57 2022] POST /compute/v2.1/servers => generated 175 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:17:57.555058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c2ae656d-2912-4f1d-88f7-90a577ce8b41 req-97268b64-ce0c-4705-8ef1-8a54714b612a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe2d9d1-89d0-4c98-9428-79a8c8882a36", "name": "network-vif-deleted", "tag": "f1b01ebf-9f7d-44d8-bc89-71147b6084f6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:57.565658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c2ae656d-2912-4f1d-88f7-90a577ce8b41 req-97268b64-ce0c-4705-8ef1-8a54714b612a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.566375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c2ae656d-2912-4f1d-88f7-90a577ce8b41 req-97268b64-ce0c-4705-8ef1-8a54714b612a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.579456 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c2ae656d-2912-4f1d-88f7-90a577ce8b41 req-97268b64-ce0c-4705-8ef1-8a54714b612a service nova] Creating event network-vif-deleted:f1b01ebf-9f7d-44d8-bc89-71147b6084f6 for instance dfe2d9d1-89d0-4c98-9428-79a8c8882a36 on n-h2-844627-10 Aug 04 14:17:57.586609 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c2ae656d-2912-4f1d-88f7-90a577ce8b41 req-97268b64-ce0c-4705-8ef1-8a54714b612a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035776 Aug 04 14:17:57.587674 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2073/4163] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:57.594788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7db448af-fc3c-491e-8916-8cc95e9858bc tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:57.595590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7db448af-fc3c-491e-8916-8cc95e9858bc tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: aadafa91-6e2c-4abf-ae12-6a37c9a0d04c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:57.602342 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-7db448af-fc3c-491e-8916-8cc95e9858bc tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] HTTP exception thrown: Instance aadafa91-6e2c-4abf-ae12-6a37c9a0d04c could not be found. Aug 04 14:17:57.607906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-96bbe5d8-5fe7-40b2-b88a-3c482161b8e9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7db448af-fc3c-491e-8916-8cc95e9858bc tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Request method failure captured: Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/aadafa91-6e2c-4abf-ae12-6a37c9a0d04c/metadata HTTP/1.1 Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Tztz_QURohupBwY3T7ZJGBxrbdtK16nCyhu-Eg3RLRwJ5Qa4atWDBiM2CArznRlqHxQgKm06D9H3InppjQbx0OXMir5FYtS6Cul50Hm5TjOLa22zTdNPqcGftRjbHrAitgvbT_7Z4Dw73fXE13Au0yVtKrKd3iOdO5ijZ6DPeI0FM Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}] Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: e9a0ee5f76db459c9e27d5024892a9da Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance aadafa91-6e2c-4abf-ae12-6a37c9a0d04c could not be found. Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': 'aadafa91-6e2c-4abf-ae12-6a37c9a0d04c'} Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aadafa91-6e2c-4abf-ae12-6a37c9a0d04c could not be found. Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aadafa91-6e2c-4abf-ae12-6a37c9a0d04c could not be found. Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:57.608480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:57.612543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:17:57.612543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:17:57.612543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aadafa91-6e2c-4abf-ae12-6a37c9a0d04c could not be found. Aug 04 14:17:57.612543 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.612543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7db448af-fc3c-491e-8916-8cc95e9858bc tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Returning 404 to user: Instance aadafa91-6e2c-4abf-ae12-6a37c9a0d04c could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:57.612856 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7db448af-fc3c-491e-8916-8cc95e9858bc tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/aadafa91-6e2c-4abf-ae12-6a37c9a0d04c/metadata" status: 404 len: 111 microversion: 2.1 time: 0.022282 Aug 04 14:17:57.627514 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2074/4164] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:17:57 2022] GET /compute/v2.1/servers/aadafa91-6e2c-4abf-ae12-6a37c9a0d04c/metadata => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:17:57.627644 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-96bbe5d8-5fe7-40b2-b88a-3c482161b8e9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1315 microversion: 2.1 time: 0.534010 Aug 04 14:17:57.627739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-14cc2413-2619-4f3c-888e-6c6479c408e4 req-97223b95-047e-4f46-9ff2-a041b9059fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9c2731-512a-423b-a54e-32f7e2171623", "name": "network-vif-plugged", "status": "completed", "tag": "fcaf7619-ad8a-4c0d-91da-0cf44e564f7f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:57.638402 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2091/4165] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:57 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:57.645855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e868fd7b-0059-40ef-a835-ab3625c08709 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:57.646509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e868fd7b-0059-40ef-a835-ab3625c08709 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:57.656432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e868fd7b-0059-40ef-a835-ab3625c08709 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.657079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e868fd7b-0059-40ef-a835-ab3625c08709 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.658382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e868fd7b-0059-40ef-a835-ab3625c08709 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.658806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e868fd7b-0059-40ef-a835-ab3625c08709 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.670261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-14cc2413-2619-4f3c-888e-6c6479c408e4 req-97223b95-047e-4f46-9ff2-a041b9059fd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.671196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-14cc2413-2619-4f3c-888e-6c6479c408e4 req-97223b95-047e-4f46-9ff2-a041b9059fd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.688811 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-14cc2413-2619-4f3c-888e-6c6479c408e4 req-97223b95-047e-4f46-9ff2-a041b9059fd4 service nova] Creating event network-vif-plugged:fcaf7619-ad8a-4c0d-91da-0cf44e564f7f for instance 8b9c2731-512a-423b-a54e-32f7e2171623 on n-h2-844627-10 Aug 04 14:17:57.699377 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-14cc2413-2619-4f3c-888e-6c6479c408e4 req-97223b95-047e-4f46-9ff2-a041b9059fd4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078154 Aug 04 14:17:57.701577 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2075/4166] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:17:57.715094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:57.716768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:57.729692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.730476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.731797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.732563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.776530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:57.777111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:57.777667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lazy-loading 'fault' on Instance uuid dfe2d9d1-89d0-4c98-9428-79a8c8882a36 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:17:57.882648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc33353bb874a57b82deab4669b998c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e494ac06713453d9e598f82cdadccd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:57.899114 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-717f100d-0dd3-40a7-9953-278f8c610be7 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 200 len: 1308 microversion: 2.1 time: 0.195000 Aug 04 14:17:57.900205 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2076/4167] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:57 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:57.909406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c13717d-323c-4352-99b6-246b444fcdf4 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-117551591", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c13717d-323c-4352-99b6-246b444fcdf4 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Request method failure captured: Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 498 Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Tztz_QURohupBwY3T7ZJGBxrbdtK16nCyhu-Eg3RLRwJ5Qa4atWDBiM2CArznRlqHxQgKm06D9H3InppjQbx0OXMir5FYtS6Cul50Hm5TjOLa22zTdNPqcGftRjbHrAitgvbT_7Z4Dw73fXE13Au0yVtKrKd3iOdO5ijZ6DPeI0FM Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}] Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: e9a0ee5f76db459c9e27d5024892a9da Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-117551591", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-117551591', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'c36127b5-f11e-4aaf-a5b7-745a958df80e'}]}}} Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 14:17:57.919478 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:57.924650 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:57.931286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c13717d-323c-4352-99b6-246b444fcdf4 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:57.933483 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c13717d-323c-4352-99b6-246b444fcdf4 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.031275 Aug 04 14:17:57.945631 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2077/4168] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:17:57 2022] POST /compute/v2.1/servers => generated 687 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:17:57.964561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e868fd7b-0059-40ef-a835-ab3625c08709 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:57.974009 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e868fd7b-0059-40ef-a835-ab3625c08709 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.332405 Aug 04 14:17:57.976047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2092/4169] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:57 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:17:58.043289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9ed76445-592f-4969-be03-9e3a2fe086bd tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-35511228", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9ed76445-592f-4969-be03-9e3a2fe086bd tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Request method failure captured: Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 498 Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Tztz_QURohupBwY3T7ZJGBxrbdtK16nCyhu-Eg3RLRwJ5Qa4atWDBiM2CArznRlqHxQgKm06D9H3InppjQbx0OXMir5FYtS6Cul50Hm5TjOLa22zTdNPqcGftRjbHrAitgvbT_7Z4Dw73fXE13Au0yVtKrKd3iOdO5ijZ6DPeI0FM Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}] Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: e9a0ee5f76db459c9e27d5024892a9da Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-35511228", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-35511228', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'c36127b5-f11e-4aaf-a5b7-745a958df80e'}]}}} Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 14:17:58.048601 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9ed76445-592f-4969-be03-9e3a2fe086bd tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:58.054931 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9ed76445-592f-4969-be03-9e3a2fe086bd tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.011617 Aug 04 14:17:58.065744 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2078/4170] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:17:58 2022] POST /compute/v2.1/servers => generated 689 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:17:58.147878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:58.151162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:58.169864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.170665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.172111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.172910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.197918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9df77937-b75d-4d2d-8028-b5cbe30aaa99 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-581561937", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9df77937-b75d-4d2d-8028-b5cbe30aaa99 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Request method failure captured: Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 753 Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Tztz_QURohupBwY3T7ZJGBxrbdtK16nCyhu-Eg3RLRwJ5Qa4atWDBiM2CArznRlqHxQgKm06D9H3InppjQbx0OXMir5FYtS6Cul50Hm5TjOLa22zTdNPqcGftRjbHrAitgvbT_7Z4Dw73fXE13Au0yVtKrKd3iOdO5ijZ6DPeI0FM Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}] Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: e9a0ee5f76db459c9e27d5024892a9da Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-581561937", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-581561937', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'c36127b5-f11e-4aaf-a5b7-745a958df80e'}]}}} Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:17:58.203450 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:17:58.205960 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:17:58.208059 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.208059 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.210478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9df77937-b75d-4d2d-8028-b5cbe30aaa99 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:58.211800 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9df77937-b75d-4d2d-8028-b5cbe30aaa99 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.020367 Aug 04 14:17:58.212636 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2079/4171] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:17:58 2022] POST /compute/v2.1/servers => generated 1197 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 04 14:17:58.293616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3210618d-080f-4fb0-9a0c-a2b22387e541 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-629537280", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3210618d-080f-4fb0-9a0c-a2b22387e541 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Request method failure captured: Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 1265 Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Tztz_QURohupBwY3T7ZJGBxrbdtK16nCyhu-Eg3RLRwJ5Qa4atWDBiM2CArznRlqHxQgKm06D9H3InppjQbx0OXMir5FYtS6Cul50Hm5TjOLa22zTdNPqcGftRjbHrAitgvbT_7Z4Dw73fXE13Au0yVtKrKd3iOdO5ijZ6DPeI0FM Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}] Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: e9a0ee5f76db459c9e27d5024892a9da Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-629537280", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c36127b5-f11e-4aaf-a5b7-745a958df80e"}]}} Aug 04 14:17:58.303357 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-629537280', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'c36127b5-f11e-4aaf-a5b7-745a958df80e'}]}}} Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.310271 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:17:58.311477 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:17:58.313118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 14:17:58.313118 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.313118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3210618d-080f-4fb0-9a0c-a2b22387e541 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:58.313118 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3210618d-080f-4fb0-9a0c-a2b22387e541 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.017807 Aug 04 14:17:58.313118 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2080/4172] 10.222.0.66 () {60 vars in 1148 bytes} [Thu Aug 4 14:17:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 04 14:17:58.320945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3003e7fb-0560-4067-a145-b61d3b8fcf25 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:58.321736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3003e7fb-0560-4067-a145-b61d3b8fcf25 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: c477c1c3-a282-4c40-aa52-e58863d71574] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:58.328989 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3003e7fb-0560-4067-a145-b61d3b8fcf25 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] HTTP exception thrown: Instance c477c1c3-a282-4c40-aa52-e58863d71574 could not be found. Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3003e7fb-0560-4067-a145-b61d3b8fcf25 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Request method failure captured: Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/c477c1c3-a282-4c40-aa52-e58863d71574/metadata/test2 HTTP/1.1 Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Tztz_QURohupBwY3T7ZJGBxrbdtK16nCyhu-Eg3RLRwJ5Qa4atWDBiM2CArznRlqHxQgKm06D9H3InppjQbx0OXMir5FYtS6Cul50Hm5TjOLa22zTdNPqcGftRjbHrAitgvbT_7Z4Dw73fXE13Au0yVtKrKd3iOdO5ijZ6DPeI0FM Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}] Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: e9a0ee5f76db459c9e27d5024892a9da Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance c477c1c3-a282-4c40-aa52-e58863d71574 could not be found. Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': 'c477c1c3-a282-4c40-aa52-e58863d71574', 'id': 'test2'} Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c477c1c3-a282-4c40-aa52-e58863d71574 could not be found. Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c477c1c3-a282-4c40-aa52-e58863d71574 could not be found. Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.330824 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.335722 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:17:58.335722 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:17:58.335722 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c477c1c3-a282-4c40-aa52-e58863d71574 could not be found. Aug 04 14:17:58.335722 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.337385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3003e7fb-0560-4067-a145-b61d3b8fcf25 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Returning 404 to user: Instance c477c1c3-a282-4c40-aa52-e58863d71574 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:58.338536 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3003e7fb-0560-4067-a145-b61d3b8fcf25 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/c477c1c3-a282-4c40-aa52-e58863d71574/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.022623 Aug 04 14:17:58.340388 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2081/4173] 10.222.0.66 () {58 vars in 1281 bytes} [Thu Aug 4 14:17:58 2022] GET /compute/v2.1/servers/c477c1c3-a282-4c40-aa52-e58863d71574/metadata/test2 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:17:58.360219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12c6d7f5-b133-46af-98a2-cac3b94dfdda tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:58.361074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12c6d7f5-b133-46af-98a2-cac3b94dfdda tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:58.372312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12c6d7f5-b133-46af-98a2-cac3b94dfdda tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.372803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12c6d7f5-b133-46af-98a2-cac3b94dfdda tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.373686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12c6d7f5-b133-46af-98a2-cac3b94dfdda tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.374140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12c6d7f5-b133-46af-98a2-cac3b94dfdda tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.408767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12c6d7f5-b133-46af-98a2-cac3b94dfdda tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:17:58.507368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:58.517300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:58.518935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:58.520768 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-472f44da-4831-4308-8d13-29ba8f63e2c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.387040 Aug 04 14:17:58.521738 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2093/4174] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:58 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:58.534326 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12c6d7f5-b133-46af-98a2-cac3b94dfdda tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "DELETE /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 204 len: 0 microversion: 2.1 time: 0.180017 Aug 04 14:17:58.536362 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2082/4175] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:17:58 2022] DELETE /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:17:58.549474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1fd00cc-abba-4924-990c-4fc84275324a tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:58.551578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1fd00cc-abba-4924-990c-4fc84275324a tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:58.564420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1fd00cc-abba-4924-990c-4fc84275324a tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.565180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1fd00cc-abba-4924-990c-4fc84275324a tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.566102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1fd00cc-abba-4924-990c-4fc84275324a tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.566562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1fd00cc-abba-4924-990c-4fc84275324a tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.573124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4e02b79-74cd-48db-bb58-6d55b546ab36 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:58.575246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4e02b79-74cd-48db-bb58-6d55b546ab36 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:58.589423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e02b79-74cd-48db-bb58-6d55b546ab36 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.590341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e02b79-74cd-48db-bb58-6d55b546ab36 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.592212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e02b79-74cd-48db-bb58-6d55b546ab36 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.593238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e02b79-74cd-48db-bb58-6d55b546ab36 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.833824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c1fd00cc-abba-4924-990c-4fc84275324a tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:58.849845 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1fd00cc-abba-4924-990c-4fc84275324a tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1527 microversion: 2.1 time: 0.308364 Aug 04 14:17:58.864167 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2094/4176] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:58 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1527 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:58.869532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d4e02b79-74cd-48db-bb58-6d55b546ab36 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:58.869784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8bf8f8c4-539a-40c4-bc9b-781c0885956d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:58.870471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8bf8f8c4-539a-40c4-bc9b-781c0885956d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:58.877221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bf8f8c4-539a-40c4-bc9b-781c0885956d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.877681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bf8f8c4-539a-40c4-bc9b-781c0885956d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.878480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bf8f8c4-539a-40c4-bc9b-781c0885956d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.878925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bf8f8c4-539a-40c4-bc9b-781c0885956d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.903260 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4e02b79-74cd-48db-bb58-6d55b546ab36 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1316 microversion: 2.1 time: 0.340724 Aug 04 14:17:58.907462 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2083/4177] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:58 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:58.925243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:58.926313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: dfe2d9d1-89d0-4c98-9428-79a8c8882a36] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:58.928783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:17:58.940237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.941113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.942939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.943571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.965089 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] HTTP exception thrown: Instance dfe2d9d1-89d0-4c98-9428-79a8c8882a36 could not be found. Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Request method failure captured: Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 HTTP/1.1 Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RFSLxoAqVmNo3z8MWpqq2a3JxiyJAglwHW1yzkZ8OfushzT0ly-XftFq8XpCtXYKCLUREc380-oEG3YtV6lgfJKwmsqxDkd9yUO2DXPski84KTGmHkDKmpm6fbzi1AujEKcA_w_4KF5YewvWarXXgeZ24msOoJUsLj3yOXQvbB5_U Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}] Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: cdc33353bb874a57b82deab4669b998c Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance dfe2d9d1-89d0-4c98-9428-79a8c8882a36 could not be found. Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dfe2d9d1-89d0-4c98-9428-79a8c8882a36'} Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfe2d9d1-89d0-4c98-9428-79a8c8882a36 could not be found. Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfe2d9d1-89d0-4c98-9428-79a8c8882a36 could not be found. Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:58.966807 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfe2d9d1-89d0-4c98-9428-79a8c8882a36 could not be found. Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Returning 404 to user: Instance dfe2d9d1-89d0-4c98-9428-79a8c8882a36 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d5afaa7e-955a-4dc3-827c-8a68b3948f06 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36" status: 404 len: 111 microversion: 2.1 time: 0.049043 Aug 04 14:17:58.975138 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2084/4178] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:58 2022] GET /compute/v2.1/servers/dfe2d9d1-89d0-4c98-9428-79a8c8882a36 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:17:58.980568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:58.981119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:58.990984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.991631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:58.992615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:58.993303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.013786 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] HTTP exception thrown: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Request method failure captured: Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 HTTP/1.1 Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RFSLxoAqVmNo3z8MWpqq2a3JxiyJAglwHW1yzkZ8OfushzT0ly-XftFq8XpCtXYKCLUREc380-oEG3YtV6lgfJKwmsqxDkd9yUO2DXPski84KTGmHkDKmpm6fbzi1AujEKcA_w_4KF5YewvWarXXgeZ24msOoJUsLj3yOXQvbB5_U Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}] Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: cdc33353bb874a57b82deab4669b998c Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'f3ffdabf-8907-428a-91e2-89a32616e683'} Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:17:59.015773 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Returning 404 to user: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:59.023316 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9f8b6007-babc-4e03-bccc-330da05acc79 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 404 len: 111 microversion: 2.1 time: 0.042806 Aug 04 14:17:59.028928 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2085/4179] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:17:58 2022] DELETE /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:17:59.034271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6837ac3d-2b6d-4e0b-a31f-68cc7b52491e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:59.036045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6837ac3d-2b6d-4e0b-a31f-68cc7b52491e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:59.048589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6837ac3d-2b6d-4e0b-a31f-68cc7b52491e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.049202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6837ac3d-2b6d-4e0b-a31f-68cc7b52491e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.050338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6837ac3d-2b6d-4e0b-a31f-68cc7b52491e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.051184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6837ac3d-2b6d-4e0b-a31f-68cc7b52491e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.108510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8bf8f8c4-539a-40c4-bc9b-781c0885956d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:59.120245 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8bf8f8c4-539a-40c4-bc9b-781c0885956d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1501 microversion: 2.1 time: 0.253867 Aug 04 14:17:59.121649 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2095/4180] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:58 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:59.130813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:59.133194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: f3ffdabf-8907-428a-91e2-89a32616e683] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:59.156116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.156523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.158123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.158809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.178759 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] HTTP exception thrown: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Request method failure captured: Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 HTTP/1.1 Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69RFSLxoAqVmNo3z8MWpqq2a3JxiyJAglwHW1yzkZ8OfushzT0ly-XftFq8XpCtXYKCLUREc380-oEG3YtV6lgfJKwmsqxDkd9yUO2DXPski84KTGmHkDKmpm6fbzi1AujEKcA_w_4KF5YewvWarXXgeZ24msOoJUsLj3yOXQvbB5_U Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}] Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: cdc33353bb874a57b82deab4669b998c Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'f3ffdabf-8907-428a-91e2-89a32616e683'} Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:59.180953 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.184573 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.184573 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:59.184573 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:59.184573 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:17:59.184573 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:17:59.184573 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. Aug 04 14:17:59.184573 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.185321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Returning 404 to user: Instance f3ffdabf-8907-428a-91e2-89a32616e683 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:59.190191 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-190970ac-3dfa-4259-9826-a0647c15d0ca tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683" status: 404 len: 111 microversion: 2.1 time: 0.066249 Aug 04 14:17:59.191487 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2096/4181] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:59 2022] GET /compute/v2.1/servers/f3ffdabf-8907-428a-91e2-89a32616e683 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:17:59.197339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5e881eea-0c8f-44b4-8fbe-a0aab0343eb8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:17:59.205446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e881eea-0c8f-44b4-8fbe-a0aab0343eb8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.206020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e881eea-0c8f-44b4-8fbe-a0aab0343eb8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.234894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5e881eea-0c8f-44b4-8fbe-a0aab0343eb8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Going to try to stop instance {{(pid=130960) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 14:17:59.256560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6837ac3d-2b6d-4e0b-a31f-68cc7b52491e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:59.266280 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6837ac3d-2b6d-4e0b-a31f-68cc7b52491e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.239434 Aug 04 14:17:59.267247 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2086/4182] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:59 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:17:59.274243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:59.281791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:59.295735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.296427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.297758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.298431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.303249 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5e881eea-0c8f-44b4-8fbe-a0aab0343eb8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322/action" status: 202 len: 0 microversion: 2.1 time: 0.109768 Aug 04 14:17:59.304108 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2097/4183] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:17:59 2022] POST /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:17:59.315677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-51f621da-25b5-4b29-ba3c-68eab2397a5b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:59.316588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-51f621da-25b5-4b29-ba3c-68eab2397a5b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:59.325354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51f621da-25b5-4b29-ba3c-68eab2397a5b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.326284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51f621da-25b5-4b29-ba3c-68eab2397a5b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.327315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51f621da-25b5-4b29-ba3c-68eab2397a5b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.328034 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] HTTP exception thrown: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.328512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51f621da-25b5-4b29-ba3c-68eab2397a5b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Request method failure captured: Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff HTTP/1.1 Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RFSLxoAqVmNo3z8MWpqq2a3JxiyJAglwHW1yzkZ8OfushzT0ly-XftFq8XpCtXYKCLUREc380-oEG3YtV6lgfJKwmsqxDkd9yUO2DXPski84KTGmHkDKmpm6fbzi1AujEKcA_w_4KF5YewvWarXXgeZ24msOoJUsLj3yOXQvbB5_U Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}] Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: cdc33353bb874a57b82deab4669b998c Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b4e03570-2c81-4cfa-bf53-a020e35cf3ff'} Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:17:59.337233 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Returning 404 to user: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3cca9866-8ae4-4970-89e9-bb6c8eded342 tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 404 len: 111 microversion: 2.1 time: 0.074155 Aug 04 14:17:59.351614 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2087/4184] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:17:59 2022] DELETE /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:17:59.355619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:59.355898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] [instance: b4e03570-2c81-4cfa-bf53-a020e35cf3ff] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:59.363410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.364077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.364925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.365373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.381963 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] HTTP exception thrown: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Request method failure captured: Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff HTTP/1.1 Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RFSLxoAqVmNo3z8MWpqq2a3JxiyJAglwHW1yzkZ8OfushzT0ly-XftFq8XpCtXYKCLUREc380-oEG3YtV6lgfJKwmsqxDkd9yUO2DXPski84KTGmHkDKmpm6fbzi1AujEKcA_w_4KF5YewvWarXXgeZ24msOoJUsLj3yOXQvbB5_U Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5e494ac06713453d9e598f82cdadccd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5e494ac06713453d9e598f82cdadccd2"}]}] Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 5e494ac06713453d9e598f82cdadccd2 Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-403580573 Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: cdc33353bb874a57b82deab4669b998c Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerDiskConfigTestJSON-403580573-project Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b4e03570-2c81-4cfa-bf53-a020e35cf3ff'} Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:17:59.384628 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] Returning 404 to user: Instance b4e03570-2c81-4cfa-bf53-a020e35cf3ff could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e7ba0ee9-afdf-4f77-9bbf-ed364a1238bb tempest-ServerDiskConfigTestJSON-403580573 tempest-ServerDiskConfigTestJSON-403580573-project] 10.222.0.66 "GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff" status: 404 len: 111 microversion: 2.1 time: 0.036125 Aug 04 14:17:59.393712 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2088/4185] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:59 2022] GET /compute/v2.1/servers/b4e03570-2c81-4cfa-bf53-a020e35cf3ff => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:17:59.568987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:59.573306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:59.587249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.588422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.590192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.591313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.607715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-51f621da-25b5-4b29-ba3c-68eab2397a5b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:59.628108 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-51f621da-25b5-4b29-ba3c-68eab2397a5b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.316436 Aug 04 14:17:59.628572 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2098/4186] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:59 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:17:59.872496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-84d2c608-513e-4fa6-894d-7e8ac5681b74 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:59.884413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-84d2c608-513e-4fa6-894d-7e8ac5681b74 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:17:59.890848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:59.897266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84d2c608-513e-4fa6-894d-7e8ac5681b74 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.901885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84d2c608-513e-4fa6-894d-7e8ac5681b74 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.902755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84d2c608-513e-4fa6-894d-7e8ac5681b74 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:17:59.903245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84d2c608-513e-4fa6-894d-7e8ac5681b74 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:17:59.916568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:59.920232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:17:59.923005 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-85b30292-bf45-47de-bb1c-b106fb5c0e0c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.361844 Aug 04 14:17:59.940760 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2089/4187] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:17:59 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:17:59.969905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-14d30720-8574-4d52-8b80-aad794b0c75a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:17:59.973612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-14d30720-8574-4d52-8b80-aad794b0c75a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:00.000025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14d30720-8574-4d52-8b80-aad794b0c75a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:00.000780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14d30720-8574-4d52-8b80-aad794b0c75a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:00.002681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14d30720-8574-4d52-8b80-aad794b0c75a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:00.004013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14d30720-8574-4d52-8b80-aad794b0c75a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:00.241234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-84d2c608-513e-4fa6-894d-7e8ac5681b74 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:00.263883 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-84d2c608-513e-4fa6-894d-7e8ac5681b74 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1527 microversion: 2.1 time: 0.394870 Aug 04 14:18:00.267637 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2099/4188] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:59 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1527 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:00.315206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-14d30720-8574-4d52-8b80-aad794b0c75a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:00.325719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2beeca20-06e5-46e8-b7f0-bef7edd29b1e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:00.328641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2beeca20-06e5-46e8-b7f0-bef7edd29b1e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:00.355098 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-14d30720-8574-4d52-8b80-aad794b0c75a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1316 microversion: 2.1 time: 0.410673 Aug 04 14:18:00.361640 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2090/4189] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:17:59 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:00.368810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2beeca20-06e5-46e8-b7f0-bef7edd29b1e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:00.370481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2beeca20-06e5-46e8-b7f0-bef7edd29b1e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:00.374366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2beeca20-06e5-46e8-b7f0-bef7edd29b1e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:00.376637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2beeca20-06e5-46e8-b7f0-bef7edd29b1e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:00.687132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b413c24a-ec02-42a9-8e53-c7d02fc11330 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:00.689481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b413c24a-ec02-42a9-8e53-c7d02fc11330 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:00.710548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b413c24a-ec02-42a9-8e53-c7d02fc11330 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:00.711713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b413c24a-ec02-42a9-8e53-c7d02fc11330 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:00.714142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b413c24a-ec02-42a9-8e53-c7d02fc11330 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:00.721097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b413c24a-ec02-42a9-8e53-c7d02fc11330 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:00.731276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2beeca20-06e5-46e8-b7f0-bef7edd29b1e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:00.762871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:00.781923 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2beeca20-06e5-46e8-b7f0-bef7edd29b1e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.481156 Aug 04 14:18:00.782549 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2100/4190] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:00 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:00.970461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:00.972696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:01.036551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:01.041482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:01.043504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:01.053630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:01.122361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b413c24a-ec02-42a9-8e53-c7d02fc11330 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:01.132299 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b413c24a-ec02-42a9-8e53-c7d02fc11330 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.469800 Aug 04 14:18:01.136950 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2091/4191] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:00 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:01.304616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc1d106b-5db5-482c-ad73-ab920a7eb877 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:01.305841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bc1d106b-5db5-482c-ad73-ab920a7eb877 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:01.319322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc1d106b-5db5-482c-ad73-ab920a7eb877 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:01.321417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc1d106b-5db5-482c-ad73-ab920a7eb877 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:01.322415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc1d106b-5db5-482c-ad73-ab920a7eb877 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:01.323227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc1d106b-5db5-482c-ad73-ab920a7eb877 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:01.343731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:01.366803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:01.369748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:01.375357 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d9ade2a-319b-43ed-b057-34a16755db3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1807 microversion: 2.20 time: 0.411715 Aug 04 14:18:01.377070 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2101/4192] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:18:00 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1807 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:18:01.417350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bfdd90c2-002d-4f45-b594-ce02da234fc7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:01.418644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bfdd90c2-002d-4f45-b594-ce02da234fc7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:01.434099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c2-002d-4f45-b594-ce02da234fc7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:01.435405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c2-002d-4f45-b594-ce02da234fc7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:01.437339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c2-002d-4f45-b594-ce02da234fc7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:01.438473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfdd90c2-002d-4f45-b594-ce02da234fc7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:01.448241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:01.548778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bc1d106b-5db5-482c-ad73-ab920a7eb877 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:01.560731 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bc1d106b-5db5-482c-ad73-ab920a7eb877 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1527 microversion: 2.1 time: 0.260967 Aug 04 14:18:01.561375 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2092/4193] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:01 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1527 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:01.730790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bfdd90c2-002d-4f45-b594-ce02da234fc7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:01.748687 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bfdd90c2-002d-4f45-b594-ce02da234fc7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1316 microversion: 2.1 time: 0.368980 Aug 04 14:18:01.763422 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2102/4194] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:01 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:01.826427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e5730a6-d393-476f-b167-d6933af00f64 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:01.832781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e5730a6-d393-476f-b167-d6933af00f64 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:01.850566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e5730a6-d393-476f-b167-d6933af00f64 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:01.854439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e5730a6-d393-476f-b167-d6933af00f64 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:01.855703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e5730a6-d393-476f-b167-d6933af00f64 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:01.858386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e5730a6-d393-476f-b167-d6933af00f64 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:02.136062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3e5730a6-d393-476f-b167-d6933af00f64 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:02.153565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e5730a6-d393-476f-b167-d6933af00f64 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.331712 Aug 04 14:18:02.155462 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2093/4195] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:01 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:02.172860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-600c749a-7445-41e1-a885-51cfc79e211b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:02.173774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-600c749a-7445-41e1-a885-51cfc79e211b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:02.183404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-600c749a-7445-41e1-a885-51cfc79e211b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:02.184215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-600c749a-7445-41e1-a885-51cfc79e211b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:02.185117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-600c749a-7445-41e1-a885-51cfc79e211b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:02.185570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-600c749a-7445-41e1-a885-51cfc79e211b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:02.389341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-600c749a-7445-41e1-a885-51cfc79e211b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:02.400149 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-600c749a-7445-41e1-a885-51cfc79e211b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.236708 Aug 04 14:18:02.402140 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2103/4196] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:02 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:02.423314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:02.424435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:02.442551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:02.443384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:02.445235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:02.446074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:02.607074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9a3a87cc-7a92-43d8-9564-b34e48df382c tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:02.610961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9a3a87cc-7a92-43d8-9564-b34e48df382c tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:02.644794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a3a87cc-7a92-43d8-9564-b34e48df382c tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:02.646903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a3a87cc-7a92-43d8-9564-b34e48df382c tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:02.648848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a3a87cc-7a92-43d8-9564-b34e48df382c tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:02.650075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a3a87cc-7a92-43d8-9564-b34e48df382c tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:03.135162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:03.147977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:03.149770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:03.151049 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75cb2f78-72c6-49f6-aee9-d904c77d9d49 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1794 microversion: 2.20 time: 0.738442 Aug 04 14:18:03.166944 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2094/4197] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:18:02 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1794 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:18:03.181074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2f2d8382-487c-414c-af52-e9a4e77a495a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:03.181074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f2d8382-487c-414c-af52-e9a4e77a495a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:03.182748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f2d8382-487c-414c-af52-e9a4e77a495a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:03.183221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f2d8382-487c-414c-af52-e9a4e77a495a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:03.184078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f2d8382-487c-414c-af52-e9a4e77a495a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:03.184518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f2d8382-487c-414c-af52-e9a4e77a495a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:03.413810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9a3a87cc-7a92-43d8-9564-b34e48df382c tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:03.438204 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9a3a87cc-7a92-43d8-9564-b34e48df382c tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1527 microversion: 2.1 time: 0.840548 Aug 04 14:18:03.455142 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2104/4198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:02 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1527 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:03.482469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-34705654-c92d-48fa-ace1-9f02034ba256 req-97c367fe-60fb-4af3-bfd6-0a40a912dd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c416741-016d-4f02-9a57-507f0454876d", "name": "network-vif-plugged", "status": "completed", "tag": "e2a0c66d-f403-4a0a-8afd-7a706050968f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:03.510187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-34705654-c92d-48fa-ace1-9f02034ba256 req-97c367fe-60fb-4af3-bfd6-0a40a912dd0c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:03.510694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-34705654-c92d-48fa-ace1-9f02034ba256 req-97c367fe-60fb-4af3-bfd6-0a40a912dd0c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:03.542954 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-34705654-c92d-48fa-ace1-9f02034ba256 req-97c367fe-60fb-4af3-bfd6-0a40a912dd0c service nova] Creating event network-vif-plugged:e2a0c66d-f403-4a0a-8afd-7a706050968f for instance 9c416741-016d-4f02-9a57-507f0454876d on n-h1-844627-10 Aug 04 14:18:03.554859 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-34705654-c92d-48fa-ace1-9f02034ba256 req-97c367fe-60fb-4af3-bfd6-0a40a912dd0c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095174 Aug 04 14:18:03.557292 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2105/4199] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:03.571596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-efbbef42-f50c-4cd7-a619-9907798af0c7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:03.574549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-efbbef42-f50c-4cd7-a619-9907798af0c7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:03.592577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efbbef42-f50c-4cd7-a619-9907798af0c7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:03.593839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efbbef42-f50c-4cd7-a619-9907798af0c7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:03.595630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efbbef42-f50c-4cd7-a619-9907798af0c7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:03.596793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efbbef42-f50c-4cd7-a619-9907798af0c7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:03.773635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2f2d8382-487c-414c-af52-e9a4e77a495a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:03.788300 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2f2d8382-487c-414c-af52-e9a4e77a495a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1316 microversion: 2.1 time: 0.619665 Aug 04 14:18:03.788808 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2095/4200] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:03 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1316 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:03.808907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-94449ac5-377b-4345-8682-8ef02337d296 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:03.809550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-94449ac5-377b-4345-8682-8ef02337d296 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:03.818799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94449ac5-377b-4345-8682-8ef02337d296 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:03.820988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94449ac5-377b-4345-8682-8ef02337d296 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:03.827887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94449ac5-377b-4345-8682-8ef02337d296 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:03.828624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94449ac5-377b-4345-8682-8ef02337d296 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:04.194971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-efbbef42-f50c-4cd7-a619-9907798af0c7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:04.210984 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-efbbef42-f50c-4cd7-a619-9907798af0c7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.649059 Aug 04 14:18:04.211687 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2106/4201] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:03 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:04.286599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-94449ac5-377b-4345-8682-8ef02337d296 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:04.304065 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-94449ac5-377b-4345-8682-8ef02337d296 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.510774 Aug 04 14:18:04.304684 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2096/4202] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:03 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:04.327479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-bc038022-477c-4ac7-8ed4-3b07fb86bb43 req-0c60c3cc-de26-4a0a-84b5-94d1b6244ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aedd23-dedc-4ce9-91d8-da02f0f95e9a", "name": "network-vif-deleted", "tag": "8c3190b7-98d8-4601-a148-9f3e97c4be74"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:04.338909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bc038022-477c-4ac7-8ed4-3b07fb86bb43 req-0c60c3cc-de26-4a0a-84b5-94d1b6244ab7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:04.339643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bc038022-477c-4ac7-8ed4-3b07fb86bb43 req-0c60c3cc-de26-4a0a-84b5-94d1b6244ab7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:04.360361 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-bc038022-477c-4ac7-8ed4-3b07fb86bb43 req-0c60c3cc-de26-4a0a-84b5-94d1b6244ab7 service nova] Creating event network-vif-deleted:8c3190b7-98d8-4601-a148-9f3e97c4be74 for instance 90aedd23-dedc-4ce9-91d8-da02f0f95e9a on n-h1-844627-10 Aug 04 14:18:04.372852 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-bc038022-477c-4ac7-8ed4-3b07fb86bb43 req-0c60c3cc-de26-4a0a-84b5-94d1b6244ab7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046767 Aug 04 14:18:04.374252 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2107/4203] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:18:04.489395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-450baaa4-7452-418a-bc0b-d467674d7a29 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:04.490030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-450baaa4-7452-418a-bc0b-d467674d7a29 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:04.497402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-450baaa4-7452-418a-bc0b-d467674d7a29 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:04.498139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-450baaa4-7452-418a-bc0b-d467674d7a29 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:04.499096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-450baaa4-7452-418a-bc0b-d467674d7a29 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:04.499754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-450baaa4-7452-418a-bc0b-d467674d7a29 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:04.604852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-450baaa4-7452-418a-bc0b-d467674d7a29 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:04.621205 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-450baaa4-7452-418a-bc0b-d467674d7a29 tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1309 microversion: 2.1 time: 0.136507 Aug 04 14:18:04.636228 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2097/4204] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:04 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1309 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:04.828345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a64488bb-8165-48d3-9a81-9e8d532ebb97 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:04.838139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a64488bb-8165-48d3-9a81-9e8d532ebb97 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:04.869656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a64488bb-8165-48d3-9a81-9e8d532ebb97 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:04.878575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a64488bb-8165-48d3-9a81-9e8d532ebb97 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:04.881024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a64488bb-8165-48d3-9a81-9e8d532ebb97 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:04.882507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a64488bb-8165-48d3-9a81-9e8d532ebb97 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:05.246801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-28d9b964-3756-4c04-b475-a298cca77e85 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:05.249689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-28d9b964-3756-4c04-b475-a298cca77e85 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:05.279275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28d9b964-3756-4c04-b475-a298cca77e85 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:05.279902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28d9b964-3756-4c04-b475-a298cca77e85 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:05.280977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28d9b964-3756-4c04-b475-a298cca77e85 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:05.281522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-28d9b964-3756-4c04-b475-a298cca77e85 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:06.008829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a64488bb-8165-48d3-9a81-9e8d532ebb97 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:06.030735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-28d9b964-3756-4c04-b475-a298cca77e85 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:06.031953 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a64488bb-8165-48d3-9a81-9e8d532ebb97 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1316 microversion: 2.1 time: 1.217875 Aug 04 14:18:06.039934 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-28d9b964-3756-4c04-b475-a298cca77e85 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.807582 Aug 04 14:18:06.047950 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2098/4205] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:05 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:06.066236 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2108/4206] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:04 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1316 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:06.071061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d8e582ae-8bd8-468c-97b4-23e168b98091 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:06.073160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d8e582ae-8bd8-468c-97b4-23e168b98091 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:06.100387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d8e582ae-8bd8-468c-97b4-23e168b98091 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:06.101361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d8e582ae-8bd8-468c-97b4-23e168b98091 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:06.106436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d8e582ae-8bd8-468c-97b4-23e168b98091 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:06.109102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-cfbe9f6e-6321-4f4c-a2c2-51d0a7fd43cb req-9ce9abd5-f90b-40a6-81ec-2b64e0fda021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4", "name": "network-vif-plugged", "status": "completed", "tag": "89262c5a-d9ee-45c1-b6d5-e91f0a6dc1c6"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:06.114176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d8e582ae-8bd8-468c-97b4-23e168b98091 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:06.134895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cfbe9f6e-6321-4f4c-a2c2-51d0a7fd43cb req-9ce9abd5-f90b-40a6-81ec-2b64e0fda021 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:06.140759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-cfbe9f6e-6321-4f4c-a2c2-51d0a7fd43cb req-9ce9abd5-f90b-40a6-81ec-2b64e0fda021 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:06.200058 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-cfbe9f6e-6321-4f4c-a2c2-51d0a7fd43cb req-9ce9abd5-f90b-40a6-81ec-2b64e0fda021 service nova] Creating event network-vif-plugged:89262c5a-d9ee-45c1-b6d5-e91f0a6dc1c6 for instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 on n-h1-844627-10 Aug 04 14:18:06.248932 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-cfbe9f6e-6321-4f4c-a2c2-51d0a7fd43cb req-9ce9abd5-f90b-40a6-81ec-2b64e0fda021 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169873 Aug 04 14:18:06.253356 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2109/4207] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:06.282857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:06.295547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:06.332660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:06.335934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:06.341431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:06.345943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:06.452101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:06.454699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:06.459303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lazy-loading 'fault' on Instance uuid 90aedd23-dedc-4ce9-91d8-da02f0f95e9a {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:18:06.757411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a0ee5f76db459c9e27d5024892a9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739b5f24a38247d2b7bfb3f90192e445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:06.801612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d8e582ae-8bd8-468c-97b4-23e168b98091 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:06.814585 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-79e8989b-5239-4694-b277-9c04f534fa5f tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 200 len: 1314 microversion: 2.1 time: 0.551086 Aug 04 14:18:06.819633 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2110/4208] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:06 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:06.841860 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d8e582ae-8bd8-468c-97b4-23e168b98091 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.787845 Aug 04 14:18:06.847768 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2099/4209] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:06 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:07.092186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3fef116b-92ff-4b53-8f9d-e5b2bc207e60 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:07.103323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a0ede07-4080-45bf-8c7f-9be0f53653f9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:07.106314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3fef116b-92ff-4b53-8f9d-e5b2bc207e60 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:07.107386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9a0ede07-4080-45bf-8c7f-9be0f53653f9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:07.128199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a0ede07-4080-45bf-8c7f-9be0f53653f9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:07.130535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a0ede07-4080-45bf-8c7f-9be0f53653f9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:07.132591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a0ede07-4080-45bf-8c7f-9be0f53653f9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:07.133022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fef116b-92ff-4b53-8f9d-e5b2bc207e60 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:07.133582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fef116b-92ff-4b53-8f9d-e5b2bc207e60 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:07.134558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fef116b-92ff-4b53-8f9d-e5b2bc207e60 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:07.134968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a0ede07-4080-45bf-8c7f-9be0f53653f9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:07.135131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fef116b-92ff-4b53-8f9d-e5b2bc207e60 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:07.793375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3fef116b-92ff-4b53-8f9d-e5b2bc207e60 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:07.815235 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3fef116b-92ff-4b53-8f9d-e5b2bc207e60 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1368 microversion: 2.1 time: 0.735305 Aug 04 14:18:07.819100 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2111/4210] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:07 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1368 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:07.828454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9a0ede07-4080-45bf-8c7f-9be0f53653f9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:07.841084 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a0ede07-4080-45bf-8c7f-9be0f53653f9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.745147 Aug 04 14:18:07.849672 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2100/4211] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:07 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:07.879302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:07.880690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] [instance: 90aedd23-dedc-4ce9-91d8-da02f0f95e9a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:07.889978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4530791-ff85-4e3d-bd95-10dd35b86fa7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:07.890707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e4530791-ff85-4e3d-bd95-10dd35b86fa7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:07.905502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:07.906008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:07.911081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:07.911657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:07.920018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4530791-ff85-4e3d-bd95-10dd35b86fa7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:07.930260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4530791-ff85-4e3d-bd95-10dd35b86fa7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:07.935058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4530791-ff85-4e3d-bd95-10dd35b86fa7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:07.936705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4530791-ff85-4e3d-bd95-10dd35b86fa7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:08.022109 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] HTTP exception thrown: Instance 90aedd23-dedc-4ce9-91d8-da02f0f95e9a could not be found. Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Request method failure captured: Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a HTTP/1.1 Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Tztz_QURohupBwY3T7ZJGBxrbdtK16nCyhu-Eg3RLRwJ5Qa4atWDBiM2CArznRlqHxQgKm06D9H3InppjQbx0OXMir5FYtS6Cul50Hm5TjOLa22zTdNPqcGftRjbHrAitgvbT_7Z4Dw73fXE13Au0yVtKrKd3iOdO5ijZ6DPeI0FM Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/739b5f24a38247d2b7bfb3f90192e445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/739b5f24a38247d2b7bfb3f90192e445"}]}] Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 739b5f24a38247d2b7bfb3f90192e445 Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1929070001 Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: e9a0ee5f76db459c9e27d5024892a9da Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1929070001-project Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 90aedd23-dedc-4ce9-91d8-da02f0f95e9a could not be found. Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '90aedd23-dedc-4ce9-91d8-da02f0f95e9a'} Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90aedd23-dedc-4ce9-91d8-da02f0f95e9a could not be found. Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90aedd23-dedc-4ce9-91d8-da02f0f95e9a could not be found. Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:08.037552 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90aedd23-dedc-4ce9-91d8-da02f0f95e9a could not be found. Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] Returning 404 to user: Instance 90aedd23-dedc-4ce9-91d8-da02f0f95e9a could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:18:08.045409 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81af6a27-b989-44b8-aa7e-16a047ca119e tempest-ServerMetadataNegativeTestJSON-1929070001 tempest-ServerMetadataNegativeTestJSON-1929070001-project] 10.222.0.66 "GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a" status: 404 len: 111 microversion: 2.1 time: 0.173386 Aug 04 14:18:08.046713 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2112/4212] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:07 2022] GET /compute/v2.1/servers/90aedd23-dedc-4ce9-91d8-da02f0f95e9a => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:18:08.053653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-41149028", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:08.190137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] validate_networks() for [('aae182f0-01e4-483b-8d95-1af990b09462', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:18:08.627263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e4530791-ff85-4e3d-bd95-10dd35b86fa7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:08.641790 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e4530791-ff85-4e3d-bd95-10dd35b86fa7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.755873 Aug 04 14:18:08.643688 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2101/4213] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:07 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:08.856835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e34475e1-0c30-4795-b627-9471a41a38be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:08.858414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e34475e1-0c30-4795-b627-9471a41a38be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:08.872574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e34475e1-0c30-4795-b627-9471a41a38be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:08.873551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e34475e1-0c30-4795-b627-9471a41a38be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:08.877405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e34475e1-0c30-4795-b627-9471a41a38be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:08.895709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e34475e1-0c30-4795-b627-9471a41a38be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:09.513614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e34475e1-0c30-4795-b627-9471a41a38be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:09.534676 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e34475e1-0c30-4795-b627-9471a41a38be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1558 microversion: 2.1 time: 0.681450 Aug 04 14:18:09.537111 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2102/4214] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:08 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1558 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:09.568625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c04818d-9cf1-4f21-8ce0-a06a3a03126d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:09.569704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7c04818d-9cf1-4f21-8ce0-a06a3a03126d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:09.612765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c04818d-9cf1-4f21-8ce0-a06a3a03126d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:09.614424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c04818d-9cf1-4f21-8ce0-a06a3a03126d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:09.618175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c04818d-9cf1-4f21-8ce0-a06a3a03126d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:09.619671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c04818d-9cf1-4f21-8ce0-a06a3a03126d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:09.826677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:18:09.828520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:18:09.830039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:18:09.830985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:18:09.832379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:18:09.870598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:09.871718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:09.874132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:09.875041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:09.888630 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c04818d-9cf1-4f21-8ce0-a06a3a03126d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.333581 Aug 04 14:18:09.890269 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2103/4215] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:18:09 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4/os-interface => generated 284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:18:09.917263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a9a80681-ca68-431e-a0bd-e64ecaff5f37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:09.918034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a9a80681-ca68-431e-a0bd-e64ecaff5f37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:09.952703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9a80681-ca68-431e-a0bd-e64ecaff5f37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:09.953192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9a80681-ca68-431e-a0bd-e64ecaff5f37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:09.954006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9a80681-ca68-431e-a0bd-e64ecaff5f37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:09.954453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9a80681-ca68-431e-a0bd-e64ecaff5f37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:09.963256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Getting quotas for project 2b98f1d6353346fca5cd6346bae615f2. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:18:09.993196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Getting quotas for user c0c7b6a4b29b45349945e5051f6ad2c9 and project 2b98f1d6353346fca5cd6346bae615f2. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:18:10.025252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:18:10.028243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:18:10.044781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:10.169568 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a98679f1-1609-476f-82a9-9c27cd8b94bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.120809 Aug 04 14:18:10.182772 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2113/4216] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:18:10.203621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1ae7444-6267-4cdb-9b77-3268e541283b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:10.211084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a1ae7444-6267-4cdb-9b77-3268e541283b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:10.447383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1ae7444-6267-4cdb-9b77-3268e541283b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:10.477501 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1ae7444-6267-4cdb-9b77-3268e541283b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1215 microversion: 2.1 time: 0.282871 Aug 04 14:18:10.497566 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2114/4217] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:10 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1215 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:10.563914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a9a80681-ca68-431e-a0bd-e64ecaff5f37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:10.579588 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a9a80681-ca68-431e-a0bd-e64ecaff5f37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.686816 Aug 04 14:18:10.581535 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2104/4218] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:09 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:11.521238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1fd9d75c-d049-48a7-b454-8d7d392886df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:11.522011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1fd9d75c-d049-48a7-b454-8d7d392886df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:11.541108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fd9d75c-d049-48a7-b454-8d7d392886df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:11.542940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fd9d75c-d049-48a7-b454-8d7d392886df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:11.544495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fd9d75c-d049-48a7-b454-8d7d392886df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:11.546290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fd9d75c-d049-48a7-b454-8d7d392886df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:11.617437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-271bb347-da6d-4c82-9994-86c929045b70 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:11.619093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-271bb347-da6d-4c82-9994-86c929045b70 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:11.635089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-271bb347-da6d-4c82-9994-86c929045b70 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:11.635930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-271bb347-da6d-4c82-9994-86c929045b70 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:11.637431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-271bb347-da6d-4c82-9994-86c929045b70 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:11.640803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-271bb347-da6d-4c82-9994-86c929045b70 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:11.744082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1fd9d75c-d049-48a7-b454-8d7d392886df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:11.768904 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1fd9d75c-d049-48a7-b454-8d7d392886df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1211 microversion: 2.1 time: 0.255498 Aug 04 14:18:11.774786 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2115/4219] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:11 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1211 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:12.221947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-04b68e96-015c-481a-9acf-01fa4eaacd44 req-8fa86450-14ad-428d-9cc2-12353bc1b97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4", "tag": "89262c5a-d9ee-45c1-b6d5-e91f0a6dc1c6"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:12.234425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-04b68e96-015c-481a-9acf-01fa4eaacd44 req-8fa86450-14ad-428d-9cc2-12353bc1b97d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:12.235179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-04b68e96-015c-481a-9acf-01fa4eaacd44 req-8fa86450-14ad-428d-9cc2-12353bc1b97d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:12.252204 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-04b68e96-015c-481a-9acf-01fa4eaacd44 req-8fa86450-14ad-428d-9cc2-12353bc1b97d service nova] Creating event network-changed:89262c5a-d9ee-45c1-b6d5-e91f0a6dc1c6 for instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 on n-h1-844627-10 Aug 04 14:18:12.262160 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-04b68e96-015c-481a-9acf-01fa4eaacd44 req-8fa86450-14ad-428d-9cc2-12353bc1b97d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047125 Aug 04 14:18:12.265902 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2116/4220] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 14:18:12.674137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-271bb347-da6d-4c82-9994-86c929045b70 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:12.709377 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-271bb347-da6d-4c82-9994-86c929045b70 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 1.096306 Aug 04 14:18:12.713754 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2105/4221] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:11 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:12.835626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-83299656-2a4d-454d-851d-1cad71e07687 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:12.843074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-83299656-2a4d-454d-851d-1cad71e07687 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:12.871643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83299656-2a4d-454d-851d-1cad71e07687 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:12.872438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83299656-2a4d-454d-851d-1cad71e07687 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:12.877967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83299656-2a4d-454d-851d-1cad71e07687 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:12.885456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83299656-2a4d-454d-851d-1cad71e07687 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:13.652957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-83299656-2a4d-454d-851d-1cad71e07687 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:13.675957 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-83299656-2a4d-454d-851d-1cad71e07687 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1273 microversion: 2.1 time: 0.861951 Aug 04 14:18:13.691667 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2117/4222] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:12 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1273 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:13.771238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbd27809-2190-4d40-b4c4-1fb0e574ea67 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:13.776714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cbd27809-2190-4d40-b4c4-1fb0e574ea67 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:13.805618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbd27809-2190-4d40-b4c4-1fb0e574ea67 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:13.807237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbd27809-2190-4d40-b4c4-1fb0e574ea67 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:13.808929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbd27809-2190-4d40-b4c4-1fb0e574ea67 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:13.810007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbd27809-2190-4d40-b4c4-1fb0e574ea67 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:14.233698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbd27809-2190-4d40-b4c4-1fb0e574ea67 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:14.253379 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbd27809-2190-4d40-b4c4-1fb0e574ea67 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.492528 Aug 04 14:18:14.256122 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2106/4223] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:13 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:14.711374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-822a16c6-c112-4b53-adb9-61d3a3a9361a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:14.712221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-822a16c6-c112-4b53-adb9-61d3a3a9361a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:14.740336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-822a16c6-c112-4b53-adb9-61d3a3a9361a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:14.740336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-822a16c6-c112-4b53-adb9-61d3a3a9361a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:14.747813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-822a16c6-c112-4b53-adb9-61d3a3a9361a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:14.749007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-822a16c6-c112-4b53-adb9-61d3a3a9361a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:15.014153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-822a16c6-c112-4b53-adb9-61d3a3a9361a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:15.029916 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-822a16c6-c112-4b53-adb9-61d3a3a9361a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1273 microversion: 2.1 time: 0.323442 Aug 04 14:18:15.031078 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2118/4224] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:14 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:15.298801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7fe837c4-977a-40ea-9221-b5d9774dfc47 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:15.300829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7fe837c4-977a-40ea-9221-b5d9774dfc47 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:15.313760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fe837c4-977a-40ea-9221-b5d9774dfc47 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:15.315832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fe837c4-977a-40ea-9221-b5d9774dfc47 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:15.317603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fe837c4-977a-40ea-9221-b5d9774dfc47 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:15.318148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fe837c4-977a-40ea-9221-b5d9774dfc47 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:15.946109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7fe837c4-977a-40ea-9221-b5d9774dfc47 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:15.963396 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7fe837c4-977a-40ea-9221-b5d9774dfc47 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.669459 Aug 04 14:18:15.978617 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2107/4225] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:15 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:16.058604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8360dc25-625c-48d8-b938-21177edadd32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:16.059501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8360dc25-625c-48d8-b938-21177edadd32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:16.071966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8360dc25-625c-48d8-b938-21177edadd32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:16.072844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8360dc25-625c-48d8-b938-21177edadd32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:16.074036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8360dc25-625c-48d8-b938-21177edadd32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:16.074726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8360dc25-625c-48d8-b938-21177edadd32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:16.793250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8360dc25-625c-48d8-b938-21177edadd32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:16.808047 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8360dc25-625c-48d8-b938-21177edadd32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1315 microversion: 2.1 time: 0.758043 Aug 04 14:18:16.821204 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2119/4226] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:16 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:17.002438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a209d88-2d3d-4580-a193-fd5311f10810 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:17.004055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1a209d88-2d3d-4580-a193-fd5311f10810 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:17.048682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a209d88-2d3d-4580-a193-fd5311f10810 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:17.049617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a209d88-2d3d-4580-a193-fd5311f10810 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:17.051362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a209d88-2d3d-4580-a193-fd5311f10810 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:17.052105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a209d88-2d3d-4580-a193-fd5311f10810 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:17.102713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:17.682567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1a209d88-2d3d-4580-a193-fd5311f10810 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:17.692174 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a209d88-2d3d-4580-a193-fd5311f10810 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.697875 Aug 04 14:18:17.693520 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2108/4227] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:16 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:17.836809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a3e8ebf8-b9f7-46c8-a0eb-287398128751 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:17.839344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a3e8ebf8-b9f7-46c8-a0eb-287398128751 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:17.897858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3e8ebf8-b9f7-46c8-a0eb-287398128751 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:17.901653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3e8ebf8-b9f7-46c8-a0eb-287398128751 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:17.906087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3e8ebf8-b9f7-46c8-a0eb-287398128751 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:17.908126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a3e8ebf8-b9f7-46c8-a0eb-287398128751 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:18.726483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a3e8ebf8-b9f7-46c8-a0eb-287398128751 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:18.735032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a7d575d5-8613-4720-9c5b-7f797936224b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:18.742114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a7d575d5-8613-4720-9c5b-7f797936224b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:18.755083 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a3e8ebf8-b9f7-46c8-a0eb-287398128751 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1315 microversion: 2.1 time: 0.926069 Aug 04 14:18:18.755859 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2120/4228] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:17 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:18.794010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7d575d5-8613-4720-9c5b-7f797936224b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:18.795027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7d575d5-8613-4720-9c5b-7f797936224b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:18.796175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7d575d5-8613-4720-9c5b-7f797936224b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:18.796862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a7d575d5-8613-4720-9c5b-7f797936224b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:18.916080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c6af1d4c-3578-4875-96c7-e292024369c3 req-7c2a74d8-c156-4c69-953b-7860e1254c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3014c326-6c39-41ef-ace6-c0cbe3259896", "tag": "a340b25a-275b-4d37-afa2-a3a7f8bcb4d3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:18.939828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c6af1d4c-3578-4875-96c7-e292024369c3 req-7c2a74d8-c156-4c69-953b-7860e1254c82 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:18.940306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c6af1d4c-3578-4875-96c7-e292024369c3 req-7c2a74d8-c156-4c69-953b-7860e1254c82 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:18.974804 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c6af1d4c-3578-4875-96c7-e292024369c3 req-7c2a74d8-c156-4c69-953b-7860e1254c82 service nova] Creating event network-changed:a340b25a-275b-4d37-afa2-a3a7f8bcb4d3 for instance 3014c326-6c39-41ef-ace6-c0cbe3259896 on n-h2-844627-10 Aug 04 14:18:18.986788 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c6af1d4c-3578-4875-96c7-e292024369c3 req-7c2a74d8-c156-4c69-953b-7860e1254c82 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074647 Aug 04 14:18:18.988857 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2121/4229] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:19.441609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a7d575d5-8613-4720-9c5b-7f797936224b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:19.451074 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a7d575d5-8613-4720-9c5b-7f797936224b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.737125 Aug 04 14:18:19.459102 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2109/4230] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:18 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:19.797234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-adefb271-0d47-482b-a03e-ec47ef806cc8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:19.798480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-adefb271-0d47-482b-a03e-ec47ef806cc8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:19.834288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-adefb271-0d47-482b-a03e-ec47ef806cc8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:19.835950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-adefb271-0d47-482b-a03e-ec47ef806cc8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:19.839387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-adefb271-0d47-482b-a03e-ec47ef806cc8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:19.840049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-adefb271-0d47-482b-a03e-ec47ef806cc8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:19.948859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:20.195862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-adefb271-0d47-482b-a03e-ec47ef806cc8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:20.213203 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-adefb271-0d47-482b-a03e-ec47ef806cc8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1315 microversion: 2.1 time: 0.429249 Aug 04 14:18:20.220632 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2122/4231] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:19 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:20.482757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-50828e32-7a55-440d-bf7c-fef4e7e77a7f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:20.483889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-50828e32-7a55-440d-bf7c-fef4e7e77a7f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:20.504909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50828e32-7a55-440d-bf7c-fef4e7e77a7f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:20.506251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50828e32-7a55-440d-bf7c-fef4e7e77a7f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:20.507927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50828e32-7a55-440d-bf7c-fef4e7e77a7f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:20.509063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50828e32-7a55-440d-bf7c-fef4e7e77a7f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:21.264590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:21.275667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0997dfa8-e770-43d2-8299-591a9c4da7fb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:21.276510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0997dfa8-e770-43d2-8299-591a9c4da7fb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:21.296155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0997dfa8-e770-43d2-8299-591a9c4da7fb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:21.298287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0997dfa8-e770-43d2-8299-591a9c4da7fb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:21.303501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0997dfa8-e770-43d2-8299-591a9c4da7fb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:21.304350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0997dfa8-e770-43d2-8299-591a9c4da7fb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:21.865883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-50828e32-7a55-440d-bf7c-fef4e7e77a7f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:21.905838 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-50828e32-7a55-440d-bf7c-fef4e7e77a7f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 1.414123 Aug 04 14:18:21.926182 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2110/4232] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:20 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:22.060846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0997dfa8-e770-43d2-8299-591a9c4da7fb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:22.081781 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0997dfa8-e770-43d2-8299-591a9c4da7fb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1315 microversion: 2.1 time: 0.817336 Aug 04 14:18:22.083708 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2123/4233] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:21 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:22.954625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b5d47982-9435-40c9-b716-98fc053ab88b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:22.962793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b5d47982-9435-40c9-b716-98fc053ab88b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:23.003765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5d47982-9435-40c9-b716-98fc053ab88b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:23.009119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5d47982-9435-40c9-b716-98fc053ab88b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:23.011635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5d47982-9435-40c9-b716-98fc053ab88b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:23.013515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5d47982-9435-40c9-b716-98fc053ab88b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:23.127559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d92b7bff-93e2-4f6a-8100-91a84b006747 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:23.133105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d92b7bff-93e2-4f6a-8100-91a84b006747 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:23.168321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d92b7bff-93e2-4f6a-8100-91a84b006747 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:23.177010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d92b7bff-93e2-4f6a-8100-91a84b006747 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:23.180614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d92b7bff-93e2-4f6a-8100-91a84b006747 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:23.189857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d92b7bff-93e2-4f6a-8100-91a84b006747 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:23.320973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:23.787188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b5d47982-9435-40c9-b716-98fc053ab88b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:23.819349 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b5d47982-9435-40c9-b716-98fc053ab88b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.868666 Aug 04 14:18:23.833393 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2111/4234] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:22 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:23.917740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d92b7bff-93e2-4f6a-8100-91a84b006747 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:23.937136 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d92b7bff-93e2-4f6a-8100-91a84b006747 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1315 microversion: 2.1 time: 0.822169 Aug 04 14:18:23.938798 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2124/4235] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:23 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:24.865927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4103685e-99e1-4b42-a578-2d84123c9ed5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:24.874705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4103685e-99e1-4b42-a578-2d84123c9ed5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:24.902360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4103685e-99e1-4b42-a578-2d84123c9ed5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:24.903385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4103685e-99e1-4b42-a578-2d84123c9ed5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:24.905718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4103685e-99e1-4b42-a578-2d84123c9ed5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:24.906525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4103685e-99e1-4b42-a578-2d84123c9ed5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:24.968345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a894dc52-dae4-4251-ab09-0edc8ddd2e4a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:24.970236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a894dc52-dae4-4251-ab09-0edc8ddd2e4a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:24.980489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a894dc52-dae4-4251-ab09-0edc8ddd2e4a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:24.981703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a894dc52-dae4-4251-ab09-0edc8ddd2e4a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:24.982993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a894dc52-dae4-4251-ab09-0edc8ddd2e4a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:24.983672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a894dc52-dae4-4251-ab09-0edc8ddd2e4a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:25.385399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4103685e-99e1-4b42-a578-2d84123c9ed5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:25.404073 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4103685e-99e1-4b42-a578-2d84123c9ed5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.545332 Aug 04 14:18:25.407889 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2112/4236] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:24 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:25.412412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a894dc52-dae4-4251-ab09-0edc8ddd2e4a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:25.445090 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a894dc52-dae4-4251-ab09-0edc8ddd2e4a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1315 microversion: 2.1 time: 0.480544 Aug 04 14:18:25.445709 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2125/4237] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:24 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:25.736160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf557ffb-34b0-4445-8f89-ab2e38fb0283 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Action: 'create', calling method: .version_select at 0x7f470569dca0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:25.793898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cf557ffb-34b0-4445-8f89-ab2e38fb0283 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Getting quotas for project a9fafacbe52c4b2d8b4994856856ff25. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:18:25.806384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cf557ffb-34b0-4445-8f89-ab2e38fb0283 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Getting quotas for user 6db61ab7f9834cceb9239ccb74524950 and project a9fafacbe52c4b2d8b4994856856ff25. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:18:25.906430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cf557ffb-34b0-4445-8f89-ab2e38fb0283 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Getting quotas for project a9fafacbe52c4b2d8b4994856856ff25. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:18:25.914729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cf557ffb-34b0-4445-8f89-ab2e38fb0283 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Getting quotas for user 6db61ab7f9834cceb9239ccb74524950 and project a9fafacbe52c4b2d8b4994856856ff25. Resources: {'server_groups'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:18:25.934767 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf557ffb-34b0-4445-8f89-ab2e38fb0283 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] 10.222.0.66 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.524821 Aug 04 14:18:25.937266 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2113/4238] 10.222.0.66 () {62 vars in 1214 bytes} [Thu Aug 4 14:18:25 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:25.949257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c2626b70-e0f0-4ea8-9a3f-9f6b5bc867f5 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:25.980628 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c2626b70-e0f0-4ea8-9a3f-9f6b5bc867f5 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.035727 Aug 04 14:18:25.983370 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2126/4239] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 14:18:25 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:26.004159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-45f61568-bfda-48eb-bad0-b3b903c03ac5 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:26.021003 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-45f61568-bfda-48eb-bad0-b3b903c03ac5 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] 10.222.0.66 "GET /compute/v2.1/os-server-groups/943d3195-682e-474f-ab77-3bf1924794c1" status: 200 len: 235 microversion: 2.64 time: 0.026912 Aug 04 14:18:26.036202 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2114/4240] 10.222.0.66 () {60 vars in 1304 bytes} [Thu Aug 4 14:18:25 2022] GET /compute/v2.1/os-server-groups/943d3195-682e-474f-ab77-3bf1924794c1 => generated 235 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:26.042444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ee6b707f-82d7-46b9-a3d9-16fbd2cbf68d tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:26.100723 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ee6b707f-82d7-46b9-a3d9-16fbd2cbf68d tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/943d3195-682e-474f-ab77-3bf1924794c1" status: 204 len: 0 microversion: 2.64 time: 0.062993 Aug 04 14:18:26.128330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c2be0350-dfb8-4e30-aa35-094b8808e820 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:26.129066 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2127/4241] 10.222.0.66 () {60 vars in 1307 bytes} [Thu Aug 4 14:18:26 2022] DELETE /compute/v2.1/os-server-groups/943d3195-682e-474f-ab77-3bf1924794c1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 14:18:26.147074 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-c2be0350-dfb8-4e30-aa35-094b8808e820 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] HTTP exception thrown: Instance group 943d3195-682e-474f-ab77-3bf1924794c1 could not be found. Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c2be0350-dfb8-4e30-aa35-094b8808e820 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Request method failure captured: Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-server-groups/943d3195-682e-474f-ab77-3bf1924794c1 HTTP/1.1 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UxZM_-fUL5jJmGjT6PwWur6LfCcr80_rHsOn3aNDoMTzINebTnqtzOovkobMraK4DyQs-6PdTmhvD7_J9Hxieaut0LfixUZAEMkDidfALuYI7BtBMuhzybaohjYpMCpcRIGZ9T78r8xm2A6Uk12Zt5Ohj3Zdo9hj5Y4NS-ly3tlW4 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.64 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: a9fafacbe52c4b2d8b4994856856ff25 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerGroup264TestJSON-112889252 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9fafacbe52c4b2d8b4994856856ff25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a9fafacbe52c4b2d8b4994856856ff25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a9fafacbe52c4b2d8b4994856856ff25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a9fafacbe52c4b2d8b4994856856ff25"}]}] Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerGroup264TestJSON-112889252 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: a9fafacbe52c4b2d8b4994856856ff25 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerGroup264TestJSON-112889252 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerGroup264TestJSON-112889252-project Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 6db61ab7f9834cceb9239ccb74524950 Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerGroup264TestJSON-112889252-project Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance group 943d3195-682e-474f-ab77-3bf1924794c1 could not be found. Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '943d3195-682e-474f-ab77-3bf1924794c1'} Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 943d3195-682e-474f-ab77-3bf1924794c1 could not be found. Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 943d3195-682e-474f-ab77-3bf1924794c1 could not be found. Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:26.150917 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:26.158734 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:26.158734 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:26.158734 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:18:26.158734 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:18:26.158734 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 943d3195-682e-474f-ab77-3bf1924794c1 could not be found. Aug 04 14:18:26.158734 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:26.158734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c2be0350-dfb8-4e30-aa35-094b8808e820 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] Returning 404 to user: Instance group 943d3195-682e-474f-ab77-3bf1924794c1 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:18:26.160902 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c2be0350-dfb8-4e30-aa35-094b8808e820 tempest-ServerGroup264TestJSON-112889252 tempest-ServerGroup264TestJSON-112889252-project] 10.222.0.66 "DELETE /compute/v2.1/os-server-groups/943d3195-682e-474f-ab77-3bf1924794c1" status: 404 len: 117 microversion: 2.64 time: 0.032940 Aug 04 14:18:26.182080 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2115/4242] 10.222.0.66 () {60 vars in 1307 bytes} [Thu Aug 4 14:18:26 2022] DELETE /compute/v2.1/os-server-groups/943d3195-682e-474f-ab77-3bf1924794c1 => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:18:26.431881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-04b12bfe-ecd3-4233-aa6b-c464e452a40f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:26.433557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-04b12bfe-ecd3-4233-aa6b-c464e452a40f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:26.455386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04b12bfe-ecd3-4233-aa6b-c464e452a40f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:26.456307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04b12bfe-ecd3-4233-aa6b-c464e452a40f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:26.457946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04b12bfe-ecd3-4233-aa6b-c464e452a40f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:26.458764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04b12bfe-ecd3-4233-aa6b-c464e452a40f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:26.488428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eebd8f56-fcad-4777-98e0-7aae468674c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:26.489636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eebd8f56-fcad-4777-98e0-7aae468674c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:26.551029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eebd8f56-fcad-4777-98e0-7aae468674c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:26.551514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eebd8f56-fcad-4777-98e0-7aae468674c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:26.552333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eebd8f56-fcad-4777-98e0-7aae468674c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:26.552809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eebd8f56-fcad-4777-98e0-7aae468674c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:27.765390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-04b12bfe-ecd3-4233-aa6b-c464e452a40f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:27.791521 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-04b12bfe-ecd3-4233-aa6b-c464e452a40f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 1.366132 Aug 04 14:18:27.793081 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2128/4243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:26 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:27.814323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b4aaff77-6bbe-4628-ac09-edf4e4d6fff2 req-b8c2d1f3-281c-4585-9dc0-1f6ae5dfca41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3014c326-6c39-41ef-ace6-c0cbe3259896", "name": "network-vif-plugged", "status": "completed", "tag": "a340b25a-275b-4d37-afa2-a3a7f8bcb4d3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:27.868656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b4aaff77-6bbe-4628-ac09-edf4e4d6fff2 req-b8c2d1f3-281c-4585-9dc0-1f6ae5dfca41 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:27.870069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b4aaff77-6bbe-4628-ac09-edf4e4d6fff2 req-b8c2d1f3-281c-4585-9dc0-1f6ae5dfca41 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:27.916071 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b4aaff77-6bbe-4628-ac09-edf4e4d6fff2 req-b8c2d1f3-281c-4585-9dc0-1f6ae5dfca41 service nova] Creating event network-vif-plugged:a340b25a-275b-4d37-afa2-a3a7f8bcb4d3 for instance 3014c326-6c39-41ef-ace6-c0cbe3259896 on n-h2-844627-10 Aug 04 14:18:27.933873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eebd8f56-fcad-4777-98e0-7aae468674c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:27.950683 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b4aaff77-6bbe-4628-ac09-edf4e4d6fff2 req-b8c2d1f3-281c-4585-9dc0-1f6ae5dfca41 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148668 Aug 04 14:18:27.959160 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2129/4244] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:27.967415 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eebd8f56-fcad-4777-98e0-7aae468674c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1315 microversion: 2.1 time: 1.490032 Aug 04 14:18:27.971907 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2116/4245] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:26 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1315 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:28.822185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b45e8382-5f4f-449e-bd88-4bfdf598ba9e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:28.822864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b45e8382-5f4f-449e-bd88-4bfdf598ba9e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:28.844251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b45e8382-5f4f-449e-bd88-4bfdf598ba9e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:28.844725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b45e8382-5f4f-449e-bd88-4bfdf598ba9e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:28.845595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b45e8382-5f4f-449e-bd88-4bfdf598ba9e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:28.846051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b45e8382-5f4f-449e-bd88-4bfdf598ba9e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:29.006900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38331d14-5c7b-458c-b9c1-51e7aa664ce7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:29.009309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-38331d14-5c7b-458c-b9c1-51e7aa664ce7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:29.012645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:29.028332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38331d14-5c7b-458c-b9c1-51e7aa664ce7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:29.029546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38331d14-5c7b-458c-b9c1-51e7aa664ce7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:29.031362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38331d14-5c7b-458c-b9c1-51e7aa664ce7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:29.032294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38331d14-5c7b-458c-b9c1-51e7aa664ce7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:29.452572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b45e8382-5f4f-449e-bd88-4bfdf598ba9e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:29.479321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-38331d14-5c7b-458c-b9c1-51e7aa664ce7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:29.498887 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b45e8382-5f4f-449e-bd88-4bfdf598ba9e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1511 microversion: 2.1 time: 0.678212 Aug 04 14:18:29.503383 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2130/4246] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:28 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1511 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:29.553014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-38331d14-5c7b-458c-b9c1-51e7aa664ce7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1315 microversion: 2.1 time: 0.547239 Aug 04 14:18:29.554356 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2117/4247] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:28 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:30.544672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-78f7f9d6-de69-48c3-9639-8065a458dda9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:30.545573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-78f7f9d6-de69-48c3-9639-8065a458dda9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:30.556051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78f7f9d6-de69-48c3-9639-8065a458dda9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:30.557077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78f7f9d6-de69-48c3-9639-8065a458dda9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:30.558466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78f7f9d6-de69-48c3-9639-8065a458dda9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:30.559226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78f7f9d6-de69-48c3-9639-8065a458dda9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:30.595571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-24aea7ee-bcd6-4e06-972b-048322256c30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:30.601431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-24aea7ee-bcd6-4e06-972b-048322256c30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:30.624361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24aea7ee-bcd6-4e06-972b-048322256c30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:30.631622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24aea7ee-bcd6-4e06-972b-048322256c30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:30.636006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24aea7ee-bcd6-4e06-972b-048322256c30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:30.637757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24aea7ee-bcd6-4e06-972b-048322256c30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:31.736618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-78f7f9d6-de69-48c3-9639-8065a458dda9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:31.746648 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-78f7f9d6-de69-48c3-9639-8065a458dda9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1488 microversion: 2.1 time: 1.208686 Aug 04 14:18:31.762817 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2131/4248] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:30 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1488 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:31.775271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d026750-0fa4-4201-94f0-39caa09f672a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:31.778743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d026750-0fa4-4201-94f0-39caa09f672a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:31.786819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d026750-0fa4-4201-94f0-39caa09f672a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:31.787636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d026750-0fa4-4201-94f0-39caa09f672a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:31.788713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d026750-0fa4-4201-94f0-39caa09f672a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:31.789437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d026750-0fa4-4201-94f0-39caa09f672a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:31.802885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-24aea7ee-bcd6-4e06-972b-048322256c30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:31.842483 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-24aea7ee-bcd6-4e06-972b-048322256c30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1503 microversion: 2.1 time: 1.251065 Aug 04 14:18:31.847114 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2118/4249] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:30 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1503 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:31.876543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0414d356-5c59-4d44-8bea-be8bc1fbd85a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:31.878180 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d026750-0fa4-4201-94f0-39caa09f672a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 200 len: 158 microversion: 2.1 time: 0.101114 Aug 04 14:18:31.878995 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2132/4250] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:18:31 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 158 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:31.889894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0414d356-5c59-4d44-8bea-be8bc1fbd85a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:31.899745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4ad1942-db3f-4301-a892-370b9c85b8bd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:31.905053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e4ad1942-db3f-4301-a892-370b9c85b8bd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:31.949895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0414d356-5c59-4d44-8bea-be8bc1fbd85a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:31.953235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0414d356-5c59-4d44-8bea-be8bc1fbd85a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:31.954308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0414d356-5c59-4d44-8bea-be8bc1fbd85a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:31.958860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0414d356-5c59-4d44-8bea-be8bc1fbd85a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:31.969556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4ad1942-db3f-4301-a892-370b9c85b8bd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:31.972062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4ad1942-db3f-4301-a892-370b9c85b8bd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:31.978113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4ad1942-db3f-4301-a892-370b9c85b8bd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:31.978547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4ad1942-db3f-4301-a892-370b9c85b8bd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:32.041709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0414d356-5c59-4d44-8bea-be8bc1fbd85a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:18:32.271426 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0414d356-5c59-4d44-8bea-be8bc1fbd85a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 204 len: 0 microversion: 2.1 time: 0.398428 Aug 04 14:18:32.275497 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2119/4251] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:18:31 2022] DELETE /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:18:32.285382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12a18fc5-4fb4-49f6-b0d2-df1ba7d9151f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:32.298662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12a18fc5-4fb4-49f6-b0d2-df1ba7d9151f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:32.309467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a18fc5-4fb4-49f6-b0d2-df1ba7d9151f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:32.310299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a18fc5-4fb4-49f6-b0d2-df1ba7d9151f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:32.313241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a18fc5-4fb4-49f6-b0d2-df1ba7d9151f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:32.314114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a18fc5-4fb4-49f6-b0d2-df1ba7d9151f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:33.407999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12a18fc5-4fb4-49f6-b0d2-df1ba7d9151f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:33.421303 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12a18fc5-4fb4-49f6-b0d2-df1ba7d9151f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1509 microversion: 2.1 time: 1.144009 Aug 04 14:18:33.427217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e4ad1942-db3f-4301-a892-370b9c85b8bd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:33.436590 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e4ad1942-db3f-4301-a892-370b9c85b8bd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.550665 Aug 04 14:18:33.437234 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2133/4253] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:31 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:33.439670 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2120/4252] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:32 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1509 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:33.470881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5388439f-dcdc-4cf0-8090-1155dcdb96cd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:33.472233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5388439f-dcdc-4cf0-8090-1155dcdb96cd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:33.491292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5388439f-dcdc-4cf0-8090-1155dcdb96cd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:33.491768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5388439f-dcdc-4cf0-8090-1155dcdb96cd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:33.492611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5388439f-dcdc-4cf0-8090-1155dcdb96cd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:33.494780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5388439f-dcdc-4cf0-8090-1155dcdb96cd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:34.314732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5388439f-dcdc-4cf0-8090-1155dcdb96cd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:34.358082 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5388439f-dcdc-4cf0-8090-1155dcdb96cd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.891608 Aug 04 14:18:34.387558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b580f6a3-ed13-4d03-9047-d4709d301515 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:34.392142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b580f6a3-ed13-4d03-9047-d4709d301515 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:34.399754 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2134/4254] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:33 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:34.404464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b580f6a3-ed13-4d03-9047-d4709d301515 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:34.411134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b580f6a3-ed13-4d03-9047-d4709d301515 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:34.413230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b580f6a3-ed13-4d03-9047-d4709d301515 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:34.415681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b580f6a3-ed13-4d03-9047-d4709d301515 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:34.448331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-34b85f0e-90da-40c3-bdc5-69b69702b1e3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:34.449780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-34b85f0e-90da-40c3-bdc5-69b69702b1e3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:34.458054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34b85f0e-90da-40c3-bdc5-69b69702b1e3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:34.458794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34b85f0e-90da-40c3-bdc5-69b69702b1e3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:34.459752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34b85f0e-90da-40c3-bdc5-69b69702b1e3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:34.461128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34b85f0e-90da-40c3-bdc5-69b69702b1e3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:34.921373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34b85f0e-90da-40c3-bdc5-69b69702b1e3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:34.939907 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-34b85f0e-90da-40c3-bdc5-69b69702b1e3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 200 len: 1509 microversion: 2.1 time: 0.495966 Aug 04 14:18:34.941398 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2135/4255] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:34 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 1509 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:35.016225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b580f6a3-ed13-4d03-9047-d4709d301515 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:35.076835 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b580f6a3-ed13-4d03-9047-d4709d301515 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.694262 Aug 04 14:18:35.085149 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2121/4256] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:34 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:35.104768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c7f07ab6-4e99-4634-b6f3-f9ad85119f19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:35.105470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c7f07ab6-4e99-4634-b6f3-f9ad85119f19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:35.123072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7f07ab6-4e99-4634-b6f3-f9ad85119f19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:35.123591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7f07ab6-4e99-4634-b6f3-f9ad85119f19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:35.124466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7f07ab6-4e99-4634-b6f3-f9ad85119f19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:35.125001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7f07ab6-4e99-4634-b6f3-f9ad85119f19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:35.568727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c7f07ab6-4e99-4634-b6f3-f9ad85119f19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:35.607828 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c7f07ab6-4e99-4634-b6f3-f9ad85119f19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.506567 Aug 04 14:18:35.612773 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2136/4257] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:35 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:35.752259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-310813349", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:35.898175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] validate_networks() for [('96c6b661-dcff-4d04-84a7-e976d11485e6', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:18:35.923413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:35.966405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-934182998", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4d77cf6c-b556-48ab-92a8-04444fe680a2"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:36.065807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] validate_networks() for [('4d77cf6c-b556-48ab-92a8-04444fe680a2', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:18:37.789236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:18:37.790468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:18:37.790468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:18:37.790768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:18:37.791170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:18:37.813310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:37.814418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:37.816074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:37.816783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:37.858128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:18:37.874490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for user fab9d445099545e98979afa009678007 and project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:18:37.907066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:18:37.921241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:18:38.015629 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-05cf4409-d0b8-430a-8280-35a3771ef7e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.053897 Aug 04 14:18:38.016329 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2137/4258] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:18:38.041279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:38.042478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:38.050354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.051144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.052174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.052909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.115791 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 HTTP/1.1 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '3014c326-6c39-41ef-ace6-c0cbe3259896'} Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:38.119427 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7074c4e-4e5a-4d9c-ac48-2c309742eced tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 404 len: 111 microversion: 2.1 time: 0.096805 Aug 04 14:18:38.123579 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2138/4259] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:38 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:18:38.141579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e00a171e-5d07-4a89-8b9e-7b59727fa7e2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:38.151330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e00a171e-5d07-4a89-8b9e-7b59727fa7e2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:38.169168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e00a171e-5d07-4a89-8b9e-7b59727fa7e2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.170808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e00a171e-5d07-4a89-8b9e-7b59727fa7e2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.172435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e00a171e-5d07-4a89-8b9e-7b59727fa7e2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.175308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e00a171e-5d07-4a89-8b9e-7b59727fa7e2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.239256 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e00a171e-5d07-4a89-8b9e-7b59727fa7e2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments/9c6068c0-b951-47b8-b6a2-49cee444c59f" status: 200 len: 194 microversion: 2.20 time: 0.116580 Aug 04 14:18:38.240353 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2139/4260] 10.222.0.66 () {60 vars in 1454 bytes} [Thu Aug 4 14:18:38 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments/9c6068c0-b951-47b8-b6a2-49cee444c59f => generated 194 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:38.246366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d6da5156-6c0d-4c44-b0ef-88827a58d069 req-4858e4a8-104e-4465-b80e-f94d3a939c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3014c326-6c39-41ef-ace6-c0cbe3259896", "name": "network-vif-deleted", "tag": "a340b25a-275b-4d37-afa2-a3a7f8bcb4d3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:38.273436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d6da5156-6c0d-4c44-b0ef-88827a58d069 req-4858e4a8-104e-4465-b80e-f94d3a939c38 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.277437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d6da5156-6c0d-4c44-b0ef-88827a58d069 req-4858e4a8-104e-4465-b80e-f94d3a939c38 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.300653 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d6da5156-6c0d-4c44-b0ef-88827a58d069 req-4858e4a8-104e-4465-b80e-f94d3a939c38 service nova] Creating event network-vif-deleted:a340b25a-275b-4d37-afa2-a3a7f8bcb4d3 for instance 3014c326-6c39-41ef-ace6-c0cbe3259896 on n-h2-844627-10 Aug 04 14:18:38.308451 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d6da5156-6c0d-4c44-b0ef-88827a58d069 req-4858e4a8-104e-4465-b80e-f94d3a939c38 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066435 Aug 04 14:18:38.309591 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2140/4261] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:38.316150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1c233803-b789-49ef-af76-0b8c59e9d8f2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:38.317155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1c233803-b789-49ef-af76-0b8c59e9d8f2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:38.347297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:18:38.347921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:18:38.348458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:18:38.349011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:18:38.349664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:18:38.384306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.387992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.396171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.402182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.433021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1c233803-b789-49ef-af76-0b8c59e9d8f2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:38.444325 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1c233803-b789-49ef-af76-0b8c59e9d8f2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1214 microversion: 2.1 time: 0.130424 Aug 04 14:18:38.447747 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2141/4262] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:38 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:38.469119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-940f85fa-ae22-4cbb-86ce-bf97727fd41f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:38.469119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-940f85fa-ae22-4cbb-86ce-bf97727fd41f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:38.476999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-940f85fa-ae22-4cbb-86ce-bf97727fd41f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.476999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-940f85fa-ae22-4cbb-86ce-bf97727fd41f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.476999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-940f85fa-ae22-4cbb-86ce-bf97727fd41f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.476999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-940f85fa-ae22-4cbb-86ce-bf97727fd41f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.488292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Getting quotas for project 284ac84d1a804131a8d614aa004a3e67. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:18:38.512410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Getting quotas for user c7ab34dc1521483ca16811f47fa8f8a2 and project 284ac84d1a804131a8d614aa004a3e67. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:18:38.548202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:18:38.550687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:18:38.635342 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7fa6347d-baa5-4932-9a81-9aa337357284 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.997893 Aug 04 14:18:38.636860 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2122/4263] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 3001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:18:38.644051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7b3ab81f-0181-43f4-b63e-73b96397f593 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:38.644901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7b3ab81f-0181-43f4-b63e-73b96397f593 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:38.654365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b3ab81f-0181-43f4-b63e-73b96397f593 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.655199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b3ab81f-0181-43f4-b63e-73b96397f593 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.656407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b3ab81f-0181-43f4-b63e-73b96397f593 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:38.657161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b3ab81f-0181-43f4-b63e-73b96397f593 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:38.865842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-7b3ab81f-0181-43f4-b63e-73b96397f593 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lazy-loading 'services' on Instance uuid 8b9c2731-512a-423b-a54e-32f7e2171623 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:18:39.025058 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7b3ab81f-0181-43f4-b63e-73b96397f593 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments/9c6068c0-b951-47b8-b6a2-49cee444c59f" status: 202 len: 0 microversion: 2.20 time: 0.385916 Aug 04 14:18:39.026279 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2123/4264] 10.222.0.66 () {60 vars in 1457 bytes} [Thu Aug 4 14:18:38 2022] DELETE /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments/9c6068c0-b951-47b8-b6a2-49cee444c59f => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:18:39.041431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-afbce17c-daa2-47b3-9a0b-fea84a2b8e3e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:39.045624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-afbce17c-daa2-47b3-9a0b-fea84a2b8e3e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:39.247210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-afbce17c-daa2-47b3-9a0b-fea84a2b8e3e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:39.257461 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-afbce17c-daa2-47b3-9a0b-fea84a2b8e3e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1222 microversion: 2.1 time: 0.228409 Aug 04 14:18:39.260220 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2124/4265] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:39 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:39.272318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a86e2aa-1a81-4817-b597-07114a5fa910 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:39.277339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-940f85fa-ae22-4cbb-86ce-bf97727fd41f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:39.284756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3a86e2aa-1a81-4817-b597-07114a5fa910 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:39.296780 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-940f85fa-ae22-4cbb-86ce-bf97727fd41f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.847685 Aug 04 14:18:39.306780 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2142/4266] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:38 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:39.308183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a86e2aa-1a81-4817-b597-07114a5fa910 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:39.309221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a86e2aa-1a81-4817-b597-07114a5fa910 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:39.311880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a86e2aa-1a81-4817-b597-07114a5fa910 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:39.312590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a86e2aa-1a81-4817-b597-07114a5fa910 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:39.358115 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a86e2aa-1a81-4817-b597-07114a5fa910 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096195 Aug 04 14:18:39.359706 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2125/4267] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:39 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:39.469565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-09adc894-1e02-4498-9cda-ddcd551bb465 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:39.470245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-09adc894-1e02-4498-9cda-ddcd551bb465 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:39.485559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09adc894-1e02-4498-9cda-ddcd551bb465 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:39.486027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09adc894-1e02-4498-9cda-ddcd551bb465 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:39.495577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09adc894-1e02-4498-9cda-ddcd551bb465 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:39.497215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09adc894-1e02-4498-9cda-ddcd551bb465 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:39.559774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3444416-5b13-44a4-8ee9-c4ae8923ea5b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3444416-5b13-44a4-8ee9-c4ae8923ea5b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 163 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": 12345, "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 12345 Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:18:39.564987 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 14:18:39.569526 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:39.571141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3444416-5b13-44a4-8ee9-c4ae8923ea5b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:18:39.574103 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3444416-5b13-44a4-8ee9-c4ae8923ea5b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019023 Aug 04 14:18:39.576038 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2126/4268] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:39 2022] POST /compute/v2.1/servers => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 14:18:39.635231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34644d42-04f1-4cbb-a22e-9364b7d501b4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:39.637289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-34644d42-04f1-4cbb-a22e-9364b7d501b4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:39.679001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34644d42-04f1-4cbb-a22e-9364b7d501b4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:39.679477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34644d42-04f1-4cbb-a22e-9364b7d501b4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:39.680297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34644d42-04f1-4cbb-a22e-9364b7d501b4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:39.680753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34644d42-04f1-4cbb-a22e-9364b7d501b4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:40.386656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-09adc894-1e02-4498-9cda-ddcd551bb465 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:40.411268 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-09adc894-1e02-4498-9cda-ddcd551bb465 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1218 microversion: 2.1 time: 0.946095 Aug 04 14:18:40.425566 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2143/4269] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:39 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1218 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:40.431562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bfca021b-231e-4437-b141-4157600ae568 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:40.432473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bfca021b-231e-4437-b141-4157600ae568 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:40.436279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=79,nova_api:DELETE=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:40.441396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfca021b-231e-4437-b141-4157600ae568 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:40.442240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfca021b-231e-4437-b141-4157600ae568 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:40.443368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfca021b-231e-4437-b141-4157600ae568 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:40.444023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfca021b-231e-4437-b141-4157600ae568 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:40.637328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-34644d42-04f1-4cbb-a22e-9364b7d501b4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:40.649583 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-34644d42-04f1-4cbb-a22e-9364b7d501b4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 1.067209 Aug 04 14:18:40.670642 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2127/4270] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:39 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:40.684109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22cacea5-4c29-4f9e-9ca3-cb3fa377b961 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:40.686459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22cacea5-4c29-4f9e-9ca3-cb3fa377b961 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:40.704993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22cacea5-4c29-4f9e-9ca3-cb3fa377b961 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:40.705562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22cacea5-4c29-4f9e-9ca3-cb3fa377b961 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:40.713808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22cacea5-4c29-4f9e-9ca3-cb3fa377b961 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:40.713808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22cacea5-4c29-4f9e-9ca3-cb3fa377b961 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:40.746354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bfca021b-231e-4437-b141-4157600ae568 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:40.760612 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bfca021b-231e-4437-b141-4157600ae568 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1274 microversion: 2.1 time: 0.333728 Aug 04 14:18:40.761543 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2144/4271] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:40 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1274 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:40.772639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b09fdf4f-8c0f-4cce-beff-d0aebc434033 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:40.779967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:40.780580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b09fdf4f-8c0f-4cce-beff-d0aebc434033 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:40.797227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09fdf4f-8c0f-4cce-beff-d0aebc434033 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:40.806373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09fdf4f-8c0f-4cce-beff-d0aebc434033 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:40.816892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09fdf4f-8c0f-4cce-beff-d0aebc434033 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:40.823614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09fdf4f-8c0f-4cce-beff-d0aebc434033 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:40.825233 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22cacea5-4c29-4f9e-9ca3-cb3fa377b961 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151406 Aug 04 14:18:40.833913 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2128/4272] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:40 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:41.445533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bee23104-f9bc-4c9a-bda5-177129a6a090 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:41.452045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bee23104-f9bc-4c9a-bda5-177129a6a090 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:41.479025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee23104-f9bc-4c9a-bda5-177129a6a090 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:41.485053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee23104-f9bc-4c9a-bda5-177129a6a090 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:41.487230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee23104-f9bc-4c9a-bda5-177129a6a090 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:41.488527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bee23104-f9bc-4c9a-bda5-177129a6a090 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:41.593224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b09fdf4f-8c0f-4cce-beff-d0aebc434033 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:41.604320 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b09fdf4f-8c0f-4cce-beff-d0aebc434033 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.841516 Aug 04 14:18:41.609501 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2145/4273] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:40 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:41.745174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bee23104-f9bc-4c9a-bda5-177129a6a090 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:41.760560 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bee23104-f9bc-4c9a-bda5-177129a6a090 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1272 microversion: 2.1 time: 0.326346 Aug 04 14:18:41.777558 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2129/4274] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:41 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1272 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:41.813138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-663047d2-1225-43cd-a768-f4ccd82c9e59 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:41.813733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-663047d2-1225-43cd-a768-f4ccd82c9e59 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:41.826759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-663047d2-1225-43cd-a768-f4ccd82c9e59 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:41.827239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-663047d2-1225-43cd-a768-f4ccd82c9e59 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:41.828038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-663047d2-1225-43cd-a768-f4ccd82c9e59 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:41.828480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-663047d2-1225-43cd-a768-f4ccd82c9e59 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:42.226433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b03ef5aa-b15b-4be3-ad88-d9d8a2171454 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:42.229637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b03ef5aa-b15b-4be3-ad88-d9d8a2171454 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:42.247518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b03ef5aa-b15b-4be3-ad88-d9d8a2171454 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:42.248218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b03ef5aa-b15b-4be3-ad88-d9d8a2171454 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:42.249243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b03ef5aa-b15b-4be3-ad88-d9d8a2171454 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:42.249843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b03ef5aa-b15b-4be3-ad88-d9d8a2171454 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:42.278458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-663047d2-1225-43cd-a768-f4ccd82c9e59 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:42.282264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:42.300297 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-663047d2-1225-43cd-a768-f4ccd82c9e59 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1280 microversion: 2.1 time: 0.492792 Aug 04 14:18:42.313399 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2146/4275] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:41 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1280 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:42.353528 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b03ef5aa-b15b-4be3-ad88-d9d8a2171454 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.515435 Aug 04 14:18:42.354249 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2130/4276] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:41 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:18:42.789492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-110527fe-30a0-4f65-bf5d-f66521bd1482 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:42.792084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-110527fe-30a0-4f65-bf5d-f66521bd1482 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:42.810561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-110527fe-30a0-4f65-bf5d-f66521bd1482 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:42.810994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-110527fe-30a0-4f65-bf5d-f66521bd1482 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:42.815560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-110527fe-30a0-4f65-bf5d-f66521bd1482 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:42.816021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-110527fe-30a0-4f65-bf5d-f66521bd1482 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:42.985346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-110527fe-30a0-4f65-bf5d-f66521bd1482 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:42.996810 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-110527fe-30a0-4f65-bf5d-f66521bd1482 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1272 microversion: 2.1 time: 0.214915 Aug 04 14:18:43.000052 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2147/4277] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:42 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:43.343171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-54d578c3-ea5a-40d7-a892-7daec5d05908 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:43.343832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-54d578c3-ea5a-40d7-a892-7daec5d05908 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:43.368713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54d578c3-ea5a-40d7-a892-7daec5d05908 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:43.373582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54d578c3-ea5a-40d7-a892-7daec5d05908 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:43.374730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54d578c3-ea5a-40d7-a892-7daec5d05908 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:43.375255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54d578c3-ea5a-40d7-a892-7daec5d05908 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:43.378476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-424df415-4fe3-4fce-ab97-e9ebc55d2ebb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:43.381334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-424df415-4fe3-4fce-ab97-e9ebc55d2ebb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:43.407975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-424df415-4fe3-4fce-ab97-e9ebc55d2ebb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:43.419889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-424df415-4fe3-4fce-ab97-e9ebc55d2ebb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:43.421145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-424df415-4fe3-4fce-ab97-e9ebc55d2ebb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:43.421676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-424df415-4fe3-4fce-ab97-e9ebc55d2ebb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:43.505198 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-424df415-4fe3-4fce-ab97-e9ebc55d2ebb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138695 Aug 04 14:18:43.510524 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2148/4278] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:43 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:44.023198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a7f15d95-4a15-451f-989c-a05ecfb4dff3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:44.024231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a7f15d95-4a15-451f-989c-a05ecfb4dff3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:44.046300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7f15d95-4a15-451f-989c-a05ecfb4dff3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:44.047485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7f15d95-4a15-451f-989c-a05ecfb4dff3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:44.051781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7f15d95-4a15-451f-989c-a05ecfb4dff3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:44.053553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7f15d95-4a15-451f-989c-a05ecfb4dff3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:44.210297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-54d578c3-ea5a-40d7-a892-7daec5d05908 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:44.227892 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-54d578c3-ea5a-40d7-a892-7daec5d05908 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1322 microversion: 2.1 time: 0.887934 Aug 04 14:18:44.229290 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2131/4279] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:43 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1322 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:44.519229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7dad17eb-b263-4626-b177-38054d42680a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:44.521811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7dad17eb-b263-4626-b177-38054d42680a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:44.539439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7dad17eb-b263-4626-b177-38054d42680a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:44.552092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7dad17eb-b263-4626-b177-38054d42680a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:44.553534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7dad17eb-b263-4626-b177-38054d42680a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:44.554203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7dad17eb-b263-4626-b177-38054d42680a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:44.621228 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7dad17eb-b263-4626-b177-38054d42680a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106376 Aug 04 14:18:44.622667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a7f15d95-4a15-451f-989c-a05ecfb4dff3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:44.631302 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a7f15d95-4a15-451f-989c-a05ecfb4dff3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1314 microversion: 2.1 time: 0.614746 Aug 04 14:18:44.636579 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2132/4280] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:44 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:18:44.639294 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2149/4281] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:44 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:44.991253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-614d72b6-982e-4f38-95a1-43e725890e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1273137239", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f6b97928-d248-495b-91ed-e6c35403a3fb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:45.135450 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-614d72b6-982e-4f38-95a1-43e725890e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Block Device f6b97928-d248-495b-91ed-e6c35403a3fb is not bootable. Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-614d72b6-982e-4f38-95a1-43e725890e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 358 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1273137239", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f6b97928-d248-495b-91ed-e6c35403a3fb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: exception: Block Device f6b97928-d248-495b-91ed-e6c35403a3fb is not bootable. Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1273137239', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f6b97928-d248-495b-91ed-e6c35403a3fb'}], 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f6b97928-d248-495b-91ed-e6c35403a3fb is not bootable. Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:45.150976 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f6b97928-d248-495b-91ed-e6c35403a3fb is not bootable. Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f6b97928-d248-495b-91ed-e6c35403a3fb is not bootable. Aug 04 14:18:45.157747 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:45.160782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-614d72b6-982e-4f38-95a1-43e725890e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Block Device f6b97928-d248-495b-91ed-e6c35403a3fb is not bootable. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:18:45.162188 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-614d72b6-982e-4f38-95a1-43e725890e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.175195 Aug 04 14:18:45.163467 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2133/4282] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:44 2022] POST /compute/v2.1/servers => generated 110 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:18:45.172007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-04f73431-7155-4bd3-9cc2-634fbb851aec tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:45.172771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-04f73431-7155-4bd3-9cc2-634fbb851aec tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:45.183562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04f73431-7155-4bd3-9cc2-634fbb851aec tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:45.184020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04f73431-7155-4bd3-9cc2-634fbb851aec tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:45.184822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04f73431-7155-4bd3-9cc2-634fbb851aec tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:45.185306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04f73431-7155-4bd3-9cc2-634fbb851aec tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:45.251965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-769687db-6a7d-4b70-bc57-2bbb9ec4fa3a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:45.255043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-769687db-6a7d-4b70-bc57-2bbb9ec4fa3a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:45.262233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-769687db-6a7d-4b70-bc57-2bbb9ec4fa3a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:45.263503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-769687db-6a7d-4b70-bc57-2bbb9ec4fa3a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:45.264670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-769687db-6a7d-4b70-bc57-2bbb9ec4fa3a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:45.265480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-769687db-6a7d-4b70-bc57-2bbb9ec4fa3a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:46.294071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-04f73431-7155-4bd3-9cc2-634fbb851aec tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:46.305400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-769687db-6a7d-4b70-bc57-2bbb9ec4fa3a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:46.321639 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-769687db-6a7d-4b70-bc57-2bbb9ec4fa3a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1322 microversion: 2.1 time: 1.074361 Aug 04 14:18:46.323188 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2134/4283] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:45 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1322 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:46.339592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13486e3e-1545-4543-a79f-52afa55137bf tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:46.341936 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-04f73431-7155-4bd3-9cc2-634fbb851aec tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 1.173433 Aug 04 14:18:46.342509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13486e3e-1545-4543-a79f-52afa55137bf tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:46.348712 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2150/4284] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:45 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:46.370796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4b2bd3cf-39cc-4234-980f-0d68ff3941de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:46.371216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13486e3e-1545-4543-a79f-52afa55137bf tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:46.371678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13486e3e-1545-4543-a79f-52afa55137bf tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:46.371861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4b2bd3cf-39cc-4234-980f-0d68ff3941de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:46.372529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13486e3e-1545-4543-a79f-52afa55137bf tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:46.373132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13486e3e-1545-4543-a79f-52afa55137bf tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:46.381282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b2bd3cf-39cc-4234-980f-0d68ff3941de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:46.381926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b2bd3cf-39cc-4234-980f-0d68ff3941de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:46.382849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b2bd3cf-39cc-4234-980f-0d68ff3941de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:46.383403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b2bd3cf-39cc-4234-980f-0d68ff3941de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:46.465372 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13486e3e-1545-4543-a79f-52afa55137bf tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138799 Aug 04 14:18:46.466793 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2135/4285] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:46 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:46.476280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6d33dde8-bcee-4655-9ceb-f64df9b7f7a8 req-af32a80f-86bb-4730-90cb-c1fee2ca31f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d1ed22-9377-4fbc-ae8b-543d1beffcaa", "tag": "b861c6f3-367f-4e61-9b65-f9765748ba2c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:46.497759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6d33dde8-bcee-4655-9ceb-f64df9b7f7a8 req-af32a80f-86bb-4730-90cb-c1fee2ca31f7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:46.498995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6d33dde8-bcee-4655-9ceb-f64df9b7f7a8 req-af32a80f-86bb-4730-90cb-c1fee2ca31f7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:46.533127 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6d33dde8-bcee-4655-9ceb-f64df9b7f7a8 req-af32a80f-86bb-4730-90cb-c1fee2ca31f7 service nova] Creating event network-changed:b861c6f3-367f-4e61-9b65-f9765748ba2c for instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa on n-h2-844627-10 Aug 04 14:18:46.543121 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6d33dde8-bcee-4655-9ceb-f64df9b7f7a8 req-af32a80f-86bb-4730-90cb-c1fee2ca31f7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073240 Aug 04 14:18:46.544424 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2136/4286] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:46.553663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bbaf702e-f5e0-4e86-8eff-cc5db9a2b717 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:46.554670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bbaf702e-f5e0-4e86-8eff-cc5db9a2b717 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:46.563516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbaf702e-f5e0-4e86-8eff-cc5db9a2b717 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:46.564382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbaf702e-f5e0-4e86-8eff-cc5db9a2b717 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:46.565532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbaf702e-f5e0-4e86-8eff-cc5db9a2b717 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:46.566187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbaf702e-f5e0-4e86-8eff-cc5db9a2b717 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:47.339538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4b2bd3cf-39cc-4234-980f-0d68ff3941de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:47.350986 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4b2bd3cf-39cc-4234-980f-0d68ff3941de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1314 microversion: 2.1 time: 0.997962 Aug 04 14:18:47.352210 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2151/4287] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:46 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1314 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:47.372283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6ffc01df-c7b5-4544-bd61-450b7eb6ceda tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:47.373359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6ffc01df-c7b5-4544-bd61-450b7eb6ceda tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:47.380479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bbaf702e-f5e0-4e86-8eff-cc5db9a2b717 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:47.402491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ffc01df-c7b5-4544-bd61-450b7eb6ceda tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:47.407215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ffc01df-c7b5-4544-bd61-450b7eb6ceda tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:47.410470 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bbaf702e-f5e0-4e86-8eff-cc5db9a2b717 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.862333 Aug 04 14:18:47.411925 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2137/4288] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:46 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:47.412812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ffc01df-c7b5-4544-bd61-450b7eb6ceda tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:47.413766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ffc01df-c7b5-4544-bd61-450b7eb6ceda tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:47.482967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9b500cef-118b-4966-81ed-0868656ddad0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:47.493328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9b500cef-118b-4966-81ed-0868656ddad0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:47.516366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b500cef-118b-4966-81ed-0868656ddad0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:47.518311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b500cef-118b-4966-81ed-0868656ddad0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:47.523818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b500cef-118b-4966-81ed-0868656ddad0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:47.527132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b500cef-118b-4966-81ed-0868656ddad0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:47.594460 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9b500cef-118b-4966-81ed-0868656ddad0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116622 Aug 04 14:18:47.595591 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2138/4289] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:47 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:47.769820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3d39ea25-be86-48c9-9895-da51be0a62c8 req-d864931d-0c15-46f6-946a-00e5b8f2b22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9", "tag": "9c9f1515-2d6f-4569-b095-ded0042ee91e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:47.785861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3d39ea25-be86-48c9-9895-da51be0a62c8 req-d864931d-0c15-46f6-946a-00e5b8f2b22a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:47.786787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3d39ea25-be86-48c9-9895-da51be0a62c8 req-d864931d-0c15-46f6-946a-00e5b8f2b22a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:47.806068 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3d39ea25-be86-48c9-9895-da51be0a62c8 req-d864931d-0c15-46f6-946a-00e5b8f2b22a service nova] Creating event network-changed:9c9f1515-2d6f-4569-b095-ded0042ee91e for instance 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 on n-h2-844627-10 Aug 04 14:18:47.813795 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3d39ea25-be86-48c9-9895-da51be0a62c8 req-d864931d-0c15-46f6-946a-00e5b8f2b22a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047871 Aug 04 14:18:47.817341 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2139/4290] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:18:47.839578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:48.135891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6ffc01df-c7b5-4544-bd61-450b7eb6ceda tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:48.190529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6ffc01df-c7b5-4544-bd61-450b7eb6ceda tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1322 microversion: 2.1 time: 0.833728 Aug 04 14:18:48.210921 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2152/4291] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:47 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1322 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:48.397568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa8344f8-4bda-492d-a5c2-229be7e3dc4a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:48.398421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa8344f8-4bda-492d-a5c2-229be7e3dc4a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:48.406141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa8344f8-4bda-492d-a5c2-229be7e3dc4a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:48.406590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa8344f8-4bda-492d-a5c2-229be7e3dc4a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:48.407584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa8344f8-4bda-492d-a5c2-229be7e3dc4a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:48.409599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa8344f8-4bda-492d-a5c2-229be7e3dc4a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:48.449854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:48.624617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fbf1e9f0-b7b2-49cc-9888-7fc360c064f0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:48.634416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fbf1e9f0-b7b2-49cc-9888-7fc360c064f0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:48.651484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:48.668068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbf1e9f0-b7b2-49cc-9888-7fc360c064f0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:48.668571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbf1e9f0-b7b2-49cc-9888-7fc360c064f0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:48.671420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbf1e9f0-b7b2-49cc-9888-7fc360c064f0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:48.675851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbf1e9f0-b7b2-49cc-9888-7fc360c064f0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:48.752109 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fbf1e9f0-b7b2-49cc-9888-7fc360c064f0 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143119 Aug 04 14:18:48.758065 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2153/4292] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:48 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:48.884082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa8344f8-4bda-492d-a5c2-229be7e3dc4a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:48.893280 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa8344f8-4bda-492d-a5c2-229be7e3dc4a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1314 microversion: 2.1 time: 0.500142 Aug 04 14:18:48.897479 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2140/4293] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:48 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:49.260181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-58ffe20f-797a-4d2c-9629-8ad5b2deff05 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:49.262058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-58ffe20f-797a-4d2c-9629-8ad5b2deff05 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:49.283688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58ffe20f-797a-4d2c-9629-8ad5b2deff05 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:49.284972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58ffe20f-797a-4d2c-9629-8ad5b2deff05 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:49.287945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58ffe20f-797a-4d2c-9629-8ad5b2deff05 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:49.289366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58ffe20f-797a-4d2c-9629-8ad5b2deff05 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:49.767699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b55888f-aacd-4770-8fca-a85b8eb40789 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:49.770085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b55888f-aacd-4770-8fca-a85b8eb40789 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:49.776617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:49.784701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b55888f-aacd-4770-8fca-a85b8eb40789 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:49.785796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b55888f-aacd-4770-8fca-a85b8eb40789 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:49.786805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b55888f-aacd-4770-8fca-a85b8eb40789 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:49.787470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b55888f-aacd-4770-8fca-a85b8eb40789 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:49.829187 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4b55888f-aacd-4770-8fca-a85b8eb40789 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066597 Aug 04 14:18:49.835103 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2141/4294] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:49 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:49.939172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-73bda356-4a74-40ce-91fb-c75007663e2a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:49.945860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-73bda356-4a74-40ce-91fb-c75007663e2a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:49.962022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-73bda356-4a74-40ce-91fb-c75007663e2a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:49.963154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-73bda356-4a74-40ce-91fb-c75007663e2a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:49.964124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-73bda356-4a74-40ce-91fb-c75007663e2a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:49.964715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-73bda356-4a74-40ce-91fb-c75007663e2a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:50.296277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-58ffe20f-797a-4d2c-9629-8ad5b2deff05 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:50.340427 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-58ffe20f-797a-4d2c-9629-8ad5b2deff05 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1322 microversion: 2.1 time: 1.081733 Aug 04 14:18:50.346706 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2154/4295] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:49 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1322 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:50.730592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-73bda356-4a74-40ce-91fb-c75007663e2a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:50.767078 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-73bda356-4a74-40ce-91fb-c75007663e2a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1314 microversion: 2.1 time: 0.833355 Aug 04 14:18:50.784459 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2142/4296] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:49 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:50.843804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6a2a7836-ae55-4f24-8803-4e63fa45d836 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:50.847035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6a2a7836-ae55-4f24-8803-4e63fa45d836 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:50.866088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a2a7836-ae55-4f24-8803-4e63fa45d836 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:50.869060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a2a7836-ae55-4f24-8803-4e63fa45d836 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:50.870214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a2a7836-ae55-4f24-8803-4e63fa45d836 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:50.874180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a2a7836-ae55-4f24-8803-4e63fa45d836 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:50.953596 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6a2a7836-ae55-4f24-8803-4e63fa45d836 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113175 Aug 04 14:18:50.955403 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2155/4297] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:50 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:18:51.370362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-377b8a2d-8be8-46e6-8e54-1ee4219c897e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:51.371036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-377b8a2d-8be8-46e6-8e54-1ee4219c897e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:51.382345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-377b8a2d-8be8-46e6-8e54-1ee4219c897e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:51.382797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-377b8a2d-8be8-46e6-8e54-1ee4219c897e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:51.383608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-377b8a2d-8be8-46e6-8e54-1ee4219c897e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:51.384059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-377b8a2d-8be8-46e6-8e54-1ee4219c897e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:51.816785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a181e69-55e1-4fa6-8694-99b6ad510fa1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:51.819025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8a181e69-55e1-4fa6-8694-99b6ad510fa1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:51.839158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a181e69-55e1-4fa6-8694-99b6ad510fa1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:51.839960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a181e69-55e1-4fa6-8694-99b6ad510fa1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:51.848305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a181e69-55e1-4fa6-8694-99b6ad510fa1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:51.849314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a181e69-55e1-4fa6-8694-99b6ad510fa1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:51.865398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-377b8a2d-8be8-46e6-8e54-1ee4219c897e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:51.880577 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-377b8a2d-8be8-46e6-8e54-1ee4219c897e tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1322 microversion: 2.1 time: 0.514409 Aug 04 14:18:51.881739 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2143/4298] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:51 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:51.977057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-93a9e044-26aa-42b4-82d8-28898457fedd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:51.981745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-93a9e044-26aa-42b4-82d8-28898457fedd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:51.995291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93a9e044-26aa-42b4-82d8-28898457fedd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:51.996589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93a9e044-26aa-42b4-82d8-28898457fedd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:51.999023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93a9e044-26aa-42b4-82d8-28898457fedd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:52.000385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-93a9e044-26aa-42b4-82d8-28898457fedd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:52.068986 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-93a9e044-26aa-42b4-82d8-28898457fedd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104290 Aug 04 14:18:52.070133 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2144/4299] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:51 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:18:52.306101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a181e69-55e1-4fa6-8694-99b6ad510fa1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:52.316530 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8a181e69-55e1-4fa6-8694-99b6ad510fa1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1314 microversion: 2.1 time: 0.508515 Aug 04 14:18:52.318233 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2156/4300] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:51 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:52.594676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-97461192", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:52.678829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] validate_networks() for [('d7a9a51a-3adb-46d9-b41b-e0664e5c3d53', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:18:52.920388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18560788-4475-401f-98a7-14fa248b9d7e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-381056486", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "destination_type": "local"}, {"source_type": "volume", "uuid": "2ac0ea9c-1eff-4a21-b0f7-ee60295e4fce", "destination_type": "invalid"}], "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18560788-4475-401f-98a7-14fa248b9d7e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 494 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-381056486", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "destination_type": "local"}, {"source_type": "volume", "uuid": "2ac0ea9c-1eff-4a21-b0f7-ee60295e4fce", "destination_type": "invalid"}], "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-381056486', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '2ac0ea9c-1eff-4a21-b0f7-ee60295e4fce', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:18:52.927064 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 14:18:52.931015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:52.934368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18560788-4475-401f-98a7-14fa248b9d7e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:18:52.935665 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18560788-4475-401f-98a7-14fa248b9d7e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019737 Aug 04 14:18:52.936922 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2157/4301] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:52 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:18:52.946187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-290d2765-ceb1-4399-989d-97a50bdc3fd1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:52.946823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-290d2765-ceb1-4399-989d-97a50bdc3fd1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:52.955708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-290d2765-ceb1-4399-989d-97a50bdc3fd1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:52.956028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-290d2765-ceb1-4399-989d-97a50bdc3fd1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:52.957216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-290d2765-ceb1-4399-989d-97a50bdc3fd1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:52.957687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-290d2765-ceb1-4399-989d-97a50bdc3fd1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.265313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-290d2765-ceb1-4399-989d-97a50bdc3fd1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:53.291402 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-290d2765-ceb1-4399-989d-97a50bdc3fd1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1322 microversion: 2.1 time: 0.351709 Aug 04 14:18:53.303853 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2158/4302] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:52 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:53.316301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-60657f42-12c7-421b-9b27-d17e64050d06 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:53.320712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-60657f42-12c7-421b-9b27-d17e64050d06 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:53.324554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:18:53.325342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:18:53.326191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:18:53.326952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:18:53.327911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:18:53.328268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-60657f42-12c7-421b-9b27-d17e64050d06 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.328739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-60657f42-12c7-421b-9b27-d17e64050d06 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.329582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-60657f42-12c7-421b-9b27-d17e64050d06 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.330556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-60657f42-12c7-421b-9b27-d17e64050d06 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.356545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.356960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.357971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.358599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.388085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Getting quotas for project 2274689c61ef4dfca8a1017f893a6037. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:18:53.401323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Getting quotas for user 1f2b1ca4f98f441f8508d33dd8e99ae1 and project 2274689c61ef4dfca8a1017f893a6037. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:18:53.416219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:18:53.418934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:18:53.477259 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a462bdbb-97bd-45d1-a0ca-ebbab576932e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.974450 Aug 04 14:18:53.478566 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2145/4303] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:18:53.484255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-23e17789-a0b8-4402-b536-1fa81e368dea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:53.487742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-23e17789-a0b8-4402-b536-1fa81e368dea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:53.496113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23e17789-a0b8-4402-b536-1fa81e368dea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.496920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23e17789-a0b8-4402-b536-1fa81e368dea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.497965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23e17789-a0b8-4402-b536-1fa81e368dea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.498649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23e17789-a0b8-4402-b536-1fa81e368dea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.543216 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-23e17789-a0b8-4402-b536-1fa81e368dea tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062725 Aug 04 14:18:53.545919 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2146/4304] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:18:53 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:53.553580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6cee3f60-4021-448b-8c2c-f7be1431d62f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:53.555124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6cee3f60-4021-448b-8c2c-f7be1431d62f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:53.578776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cee3f60-4021-448b-8c2c-f7be1431d62f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.580336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cee3f60-4021-448b-8c2c-f7be1431d62f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.581503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cee3f60-4021-448b-8c2c-f7be1431d62f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.582208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cee3f60-4021-448b-8c2c-f7be1431d62f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.807411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-60657f42-12c7-421b-9b27-d17e64050d06 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:53.833551 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-60657f42-12c7-421b-9b27-d17e64050d06 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.526570 Aug 04 14:18:53.834736 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2159/4305] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:53 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:53.858658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d49cd43f-d9a2-41bd-94cf-701b7a9746c7 req-622a3c84-82f9-4003-824c-10acc733b806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d1ed22-9377-4fbc-ae8b-543d1beffcaa", "name": "network-vif-plugged", "status": "completed", "tag": "b861c6f3-367f-4e61-9b65-f9765748ba2c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:53.886228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d49cd43f-d9a2-41bd-94cf-701b7a9746c7 req-622a3c84-82f9-4003-824c-10acc733b806 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.886953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d49cd43f-d9a2-41bd-94cf-701b7a9746c7 req-622a3c84-82f9-4003-824c-10acc733b806 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.904248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6cee3f60-4021-448b-8c2c-f7be1431d62f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:53.915539 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6cee3f60-4021-448b-8c2c-f7be1431d62f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1314 microversion: 2.1 time: 0.367502 Aug 04 14:18:53.926421 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2147/4306] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:53 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:53.926421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1e8f249-bbae-4a4b-81d5-86be2fccd4cb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:53.926421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e1e8f249-bbae-4a4b-81d5-86be2fccd4cb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:53.935041 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d49cd43f-d9a2-41bd-94cf-701b7a9746c7 req-622a3c84-82f9-4003-824c-10acc733b806 service nova] Creating event network-vif-plugged:b861c6f3-367f-4e61-9b65-f9765748ba2c for instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa on n-h2-844627-10 Aug 04 14:18:53.953196 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d49cd43f-d9a2-41bd-94cf-701b7a9746c7 req-622a3c84-82f9-4003-824c-10acc733b806 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113900 Aug 04 14:18:53.954298 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2160/4307] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:53.965788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd392139-4b53-4c9f-adaa-747b0d289e2a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:53.967946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd392139-4b53-4c9f-adaa-747b0d289e2a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:53.984820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd392139-4b53-4c9f-adaa-747b0d289e2a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.986890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd392139-4b53-4c9f-adaa-747b0d289e2a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:53.988100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd392139-4b53-4c9f-adaa-747b0d289e2a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:53.989709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd392139-4b53-4c9f-adaa-747b0d289e2a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:54.016336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e1e8f249-bbae-4a4b-81d5-86be2fccd4cb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:54.026324 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e1e8f249-bbae-4a4b-81d5-86be2fccd4cb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1212 microversion: 2.1 time: 0.108565 Aug 04 14:18:54.030302 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2148/4308] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:53 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:54.037942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-47514477-62ec-4fa8-a112-b34c5beedeeb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:54.039024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-47514477-62ec-4fa8-a112-b34c5beedeeb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:54.041454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:54.058518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47514477-62ec-4fa8-a112-b34c5beedeeb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:54.059838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd392139-4b53-4c9f-adaa-747b0d289e2a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:18:54.061669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47514477-62ec-4fa8-a112-b34c5beedeeb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:54.064926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47514477-62ec-4fa8-a112-b34c5beedeeb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:54.066557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47514477-62ec-4fa8-a112-b34c5beedeeb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:54.091230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:54.235287 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd392139-4b53-4c9f-adaa-747b0d289e2a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 204 len: 0 microversion: 2.20 time: 0.277371 Aug 04 14:18:54.236417 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2161/4309] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:18:53 2022] DELETE /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:18:54.256736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:54.258502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:54.272585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:54.273540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:54.275500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:54.276609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:54.519026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-47514477-62ec-4fa8-a112-b34c5beedeeb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:54.528680 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-47514477-62ec-4fa8-a112-b34c5beedeeb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.496867 Aug 04 14:18:54.544908 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2149/4310] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:54 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:54.545245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:54.545451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-23b00d6f-3cf3-4aff-b11c-9fe260091f16 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:54.545451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-23b00d6f-3cf3-4aff-b11c-9fe260091f16 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:54.550900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23b00d6f-3cf3-4aff-b11c-9fe260091f16 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:54.551487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:54.551949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23b00d6f-3cf3-4aff-b11c-9fe260091f16 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:54.553065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23b00d6f-3cf3-4aff-b11c-9fe260091f16 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:54.553618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:54.553950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23b00d6f-3cf3-4aff-b11c-9fe260091f16 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:54.554947 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-37e19a7d-7418-40f1-adbe-74e9061e4fa2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.310729 Aug 04 14:18:54.573296 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2162/4311] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:18:54 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:18:54.665634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd52e3b1-5653-43fd-813f-67777627c593 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-538282210", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd52e3b1-5653-43fd-813f-67777627c593 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 491 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-538282210", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-538282210', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:54.674557 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:54.680664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd52e3b1-5653-43fd-813f-67777627c593 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:18:54.688930 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cd52e3b1-5653-43fd-813f-67777627c593 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.021331 Aug 04 14:18:54.688930 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2163/4312] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:54 2022] POST /compute/v2.1/servers => generated 624 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:18:54.700359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4a08dccf-8e5e-44e4-a307-40289fa497ca tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:54.703055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4a08dccf-8e5e-44e4-a307-40289fa497ca tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:54.726640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a08dccf-8e5e-44e4-a307-40289fa497ca tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:54.727677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a08dccf-8e5e-44e4-a307-40289fa497ca tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:54.729277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a08dccf-8e5e-44e4-a307-40289fa497ca tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:54.738065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a08dccf-8e5e-44e4-a307-40289fa497ca tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:54.806389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:18:54.968233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-23b00d6f-3cf3-4aff-b11c-9fe260091f16 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:54.980118 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-23b00d6f-3cf3-4aff-b11c-9fe260091f16 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1322 microversion: 2.1 time: 0.443877 Aug 04 14:18:54.993713 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2150/4313] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:54 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:55.002319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-044183d3-420c-4bab-9e8d-edc5fec594d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:55.002958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-044183d3-420c-4bab-9e8d-edc5fec594d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:55.011900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-044183d3-420c-4bab-9e8d-edc5fec594d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:55.012380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-044183d3-420c-4bab-9e8d-edc5fec594d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:55.013565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-044183d3-420c-4bab-9e8d-edc5fec594d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:55.014400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-044183d3-420c-4bab-9e8d-edc5fec594d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:55.039597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4a08dccf-8e5e-44e4-a307-40289fa497ca tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:55.050465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4a08dccf-8e5e-44e4-a307-40289fa497ca tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.358857 Aug 04 14:18:55.051738 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2164/4314] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:54 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:55.090725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-436dbbc0-f1b4-46c3-b2c1-e1c6b2c333bf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:55.093048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-436dbbc0-f1b4-46c3-b2c1-e1c6b2c333bf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:55.113101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-436dbbc0-f1b4-46c3-b2c1-e1c6b2c333bf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:55.114907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-436dbbc0-f1b4-46c3-b2c1-e1c6b2c333bf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:55.117380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-436dbbc0-f1b4-46c3-b2c1-e1c6b2c333bf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:55.117830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-436dbbc0-f1b4-46c3-b2c1-e1c6b2c333bf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:55.262104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-044183d3-420c-4bab-9e8d-edc5fec594d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:55.276020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-436dbbc0-f1b4-46c3-b2c1-e1c6b2c333bf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:55.281651 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-044183d3-420c-4bab-9e8d-edc5fec594d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1314 microversion: 2.1 time: 0.285474 Aug 04 14:18:55.293799 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-436dbbc0-f1b4-46c3-b2c1-e1c6b2c333bf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1208 microversion: 2.1 time: 0.206740 Aug 04 14:18:55.293799 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2165/4315] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:55 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1208 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:55.304773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3048c29b-9cbc-40d8-a18b-aef7226411df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:55.304773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3048c29b-9cbc-40d8-a18b-aef7226411df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:55.318000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3048c29b-9cbc-40d8-a18b-aef7226411df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:55.318000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3048c29b-9cbc-40d8-a18b-aef7226411df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:55.318000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3048c29b-9cbc-40d8-a18b-aef7226411df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:55.318000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3048c29b-9cbc-40d8-a18b-aef7226411df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:55.321291 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2151/4316] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:54 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:55.586610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:55.592320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:55.623909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:55.628216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:55.630054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:55.633756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:56.139240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3048c29b-9cbc-40d8-a18b-aef7226411df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:56.147950 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3048c29b-9cbc-40d8-a18b-aef7226411df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.852791 Aug 04 14:18:56.161182 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2166/4317] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:55 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:56.172704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2e8ae669-cb3d-4a1c-85c7-fd78417792b3 req-81973345-bc0a-4a17-b158-a29363dbd022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9", "name": "network-vif-plugged", "status": "completed", "tag": "9c9f1515-2d6f-4569-b095-ded0042ee91e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:56.186359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2e8ae669-cb3d-4a1c-85c7-fd78417792b3 req-81973345-bc0a-4a17-b158-a29363dbd022 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:56.186895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2e8ae669-cb3d-4a1c-85c7-fd78417792b3 req-81973345-bc0a-4a17-b158-a29363dbd022 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:56.215313 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2e8ae669-cb3d-4a1c-85c7-fd78417792b3 req-81973345-bc0a-4a17-b158-a29363dbd022 service nova] Creating event network-vif-plugged:9c9f1515-2d6f-4569-b095-ded0042ee91e for instance 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 on n-h2-844627-10 Aug 04 14:18:56.222788 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2e8ae669-cb3d-4a1c-85c7-fd78417792b3 req-81973345-bc0a-4a17-b158-a29363dbd022 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066924 Aug 04 14:18:56.224042 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2167/4318] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:56.230158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dad3f8d1-2b49-4640-bf21-a4ff1b267bc1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:56.230925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dad3f8d1-2b49-4640-bf21-a4ff1b267bc1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:56.257995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dad3f8d1-2b49-4640-bf21-a4ff1b267bc1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:56.257995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dad3f8d1-2b49-4640-bf21-a4ff1b267bc1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:56.259440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dad3f8d1-2b49-4640-bf21-a4ff1b267bc1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:56.260153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dad3f8d1-2b49-4640-bf21-a4ff1b267bc1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:56.303877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:56.322738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:56.329294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:56.333334 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c1fc9bed-edf4-48eb-9e17-1ea79529c50e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.758355 Aug 04 14:18:56.333947 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2152/4319] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:18:55 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:18:56.346534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab1b6949-2528-4ee9-816e-b3e1c32e767f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab1b6949-2528-4ee9-816e-b3e1c32e767f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 416 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:56.356122 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:18:56.359812 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:18:56.366264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab1b6949-2528-4ee9-816e-b3e1c32e767f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:18:56.367519 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ab1b6949-2528-4ee9-816e-b3e1c32e767f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.030379 Aug 04 14:18:56.368618 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2153/4320] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:56 2022] POST /compute/v2.1/servers => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:18:56.375383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-377fac4c-9e15-4086-a113-843b3fa3ac7f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:56.376168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-377fac4c-9e15-4086-a113-843b3fa3ac7f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:56.384529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-377fac4c-9e15-4086-a113-843b3fa3ac7f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:56.385020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-377fac4c-9e15-4086-a113-843b3fa3ac7f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:56.387158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-377fac4c-9e15-4086-a113-843b3fa3ac7f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:56.387615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-377fac4c-9e15-4086-a113-843b3fa3ac7f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:56.607953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-377fac4c-9e15-4086-a113-843b3fa3ac7f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:56.629197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-377fac4c-9e15-4086-a113-843b3fa3ac7f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1270 microversion: 2.1 time: 0.258695 Aug 04 14:18:56.633815 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2154/4321] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:56 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1270 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:56.650836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4794165c-073c-485c-8e92-d1c93020d2b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:56.655238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4794165c-073c-485c-8e92-d1c93020d2b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:56.684587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4794165c-073c-485c-8e92-d1c93020d2b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:56.685374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4794165c-073c-485c-8e92-d1c93020d2b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:56.686802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4794165c-073c-485c-8e92-d1c93020d2b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:56.691985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4794165c-073c-485c-8e92-d1c93020d2b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:56.818875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dad3f8d1-2b49-4640-bf21-a4ff1b267bc1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:56.831062 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dad3f8d1-2b49-4640-bf21-a4ff1b267bc1 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1322 microversion: 2.1 time: 0.605608 Aug 04 14:18:56.834222 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2168/4322] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:56 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:56.851188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-69ed2f03-c7ec-430b-b020-97f3c774c3e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:56.851947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-69ed2f03-c7ec-430b-b020-97f3c774c3e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:56.862425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-69ed2f03-c7ec-430b-b020-97f3c774c3e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:56.866553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-69ed2f03-c7ec-430b-b020-97f3c774c3e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:56.867678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-69ed2f03-c7ec-430b-b020-97f3c774c3e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:56.870422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-69ed2f03-c7ec-430b-b020-97f3c774c3e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:57.281298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-69ed2f03-c7ec-430b-b020-97f3c774c3e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:57.296500 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-69ed2f03-c7ec-430b-b020-97f3c774c3e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.460864 Aug 04 14:18:57.300141 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2169/4323] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:56 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:57.322729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d82ce8f6-b710-4401-8725-81888b9cbfdd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:57.323175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4794165c-073c-485c-8e92-d1c93020d2b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:57.324048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d82ce8f6-b710-4401-8725-81888b9cbfdd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:57.332223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d82ce8f6-b710-4401-8725-81888b9cbfdd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:57.332976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d82ce8f6-b710-4401-8725-81888b9cbfdd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:57.334025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d82ce8f6-b710-4401-8725-81888b9cbfdd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:57.334631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d82ce8f6-b710-4401-8725-81888b9cbfdd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:57.358290 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4794165c-073c-485c-8e92-d1c93020d2b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1314 microversion: 2.1 time: 0.720575 Aug 04 14:18:57.389882 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2155/4324] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:56 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:57.398322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:57.399225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:57.410175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:57.410898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:57.412137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:57.412772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:57.912802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d82ce8f6-b710-4401-8725-81888b9cbfdd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:57.932213 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d82ce8f6-b710-4401-8725-81888b9cbfdd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.614258 Aug 04 14:18:57.950706 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2170/4325] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:57 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:18:57.968432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-640b3b8b-bc9d-423d-b87f-1d30990ea91a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:57.969682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-640b3b8b-bc9d-423d-b87f-1d30990ea91a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:57.995403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-640b3b8b-bc9d-423d-b87f-1d30990ea91a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:57.995844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-640b3b8b-bc9d-423d-b87f-1d30990ea91a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:57.996831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-640b3b8b-bc9d-423d-b87f-1d30990ea91a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:57.997582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-640b3b8b-bc9d-423d-b87f-1d30990ea91a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:58.043107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:58.054630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:58.055223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:58.056450 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a321255-7d5f-42d6-87a1-f949667dba30 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1722 microversion: 2.20 time: 0.665265 Aug 04 14:18:58.060768 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2156/4326] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:18:57 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1722 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:18:58.070836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f5750df-0ef4-48bf-affe-d9297602b09a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:58.073801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8f5750df-0ef4-48bf-affe-d9297602b09a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:58.095163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f5750df-0ef4-48bf-affe-d9297602b09a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:58.096146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f5750df-0ef4-48bf-affe-d9297602b09a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:58.097782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f5750df-0ef4-48bf-affe-d9297602b09a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:58.097782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f5750df-0ef4-48bf-affe-d9297602b09a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:58.683582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-640b3b8b-bc9d-423d-b87f-1d30990ea91a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:58.698303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8f5750df-0ef4-48bf-affe-d9297602b09a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:58.699667 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-640b3b8b-bc9d-423d-b87f-1d30990ea91a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1312 microversion: 2.1 time: 0.747175 Aug 04 14:18:58.700503 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2171/4327] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:57 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1312 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:58.723113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88adcfbd-23be-4bb3-b079-f97eba7c51b2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561099328", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": -1, "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:58.739928 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f5750df-0ef4-48bf-affe-d9297602b09a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1516 microversion: 2.1 time: 0.674487 Aug 04 14:18:58.741363 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2157/4328] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:58 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1516 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:58.756183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-60cf5503-0c66-4920-a157-7a86b7e067de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:58.757057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-60cf5503-0c66-4920-a157-7a86b7e067de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:58.764498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60cf5503-0c66-4920-a157-7a86b7e067de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:58.764984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60cf5503-0c66-4920-a157-7a86b7e067de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:58.766599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60cf5503-0c66-4920-a157-7a86b7e067de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:58.767172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60cf5503-0c66-4920-a157-7a86b7e067de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:58.779642 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-88adcfbd-23be-4bb3-b079-f97eba7c51b2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Flavor -1 could not be found. Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88adcfbd-23be-4bb3-b079-f97eba7c51b2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 205 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-561099328", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": -1, "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: exception: Flavor -1 could not be found. Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-561099328', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': -1, 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:58.783965 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88adcfbd-23be-4bb3-b079-f97eba7c51b2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-88adcfbd-23be-4bb3-b079-f97eba7c51b2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.068701 Aug 04 14:18:58.788809 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2172/4329] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:18:58 2022] POST /compute/v2.1/servers => generated 73 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 14:18:58.808522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5df2a45f-fb4c-4a34-9417-e993e7529ffb tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:58.814822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5df2a45f-fb4c-4a34-9417-e993e7529ffb tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:58.826701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5df2a45f-fb4c-4a34-9417-e993e7529ffb tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:58.828011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5df2a45f-fb4c-4a34-9417-e993e7529ffb tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:58.831135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5df2a45f-fb4c-4a34-9417-e993e7529ffb tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:58.832198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5df2a45f-fb4c-4a34-9417-e993e7529ffb tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:58.910994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-5df2a45f-fb4c-4a34-9417-e993e7529ffb tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lazy-loading 'flavor' on Instance uuid 35d1ed22-9377-4fbc-ae8b-543d1beffcaa {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:18:59.122440 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5df2a45f-fb4c-4a34-9417-e993e7529ffb tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action" status: 200 len: 32 microversion: 2.1 time: 0.326416 Aug 04 14:18:59.124322 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2173/4330] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:18:58 2022] POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action => generated 32 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:18:59.168102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-60cf5503-0c66-4920-a157-7a86b7e067de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:59.175281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cdd6144c-3a93-4d60-b8de-22f2e61b19c3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:59.181881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cdd6144c-3a93-4d60-b8de-22f2e61b19c3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:59.194407 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-60cf5503-0c66-4920-a157-7a86b7e067de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1501 microversion: 2.1 time: 0.449406 Aug 04 14:18:59.198290 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2158/4331] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:58 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1501 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:59.233008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-eccf046a-8099-4518-a865-5e579ff0b1c5 req-5cd8a74d-c3ed-4f40-bfc7-0a8f645d29f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac15523-1339-4320-b680-25b9841be7f5", "tag": "219cba40-80ba-4263-bf6e-a413ed6a24b0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:59.253814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-eccf046a-8099-4518-a865-5e579ff0b1c5 req-5cd8a74d-c3ed-4f40-bfc7-0a8f645d29f4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.256666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-eccf046a-8099-4518-a865-5e579ff0b1c5 req-5cd8a74d-c3ed-4f40-bfc7-0a8f645d29f4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.267611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cdd6144c-3a93-4d60-b8de-22f2e61b19c3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.268498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cdd6144c-3a93-4d60-b8de-22f2e61b19c3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.276443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cdd6144c-3a93-4d60-b8de-22f2e61b19c3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.277367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cdd6144c-3a93-4d60-b8de-22f2e61b19c3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.288506 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-eccf046a-8099-4518-a865-5e579ff0b1c5 req-5cd8a74d-c3ed-4f40-bfc7-0a8f645d29f4 service nova] Creating event network-changed:219cba40-80ba-4263-bf6e-a413ed6a24b0 for instance eac15523-1339-4320-b680-25b9841be7f5 on n-h1-844627-10 Aug 04 14:18:59.304203 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-eccf046a-8099-4518-a865-5e579ff0b1c5 req-5cd8a74d-c3ed-4f40-bfc7-0a8f645d29f4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100941 Aug 04 14:18:59.308262 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2159/4332] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:18:59.331503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:59.333695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:59.349549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.351337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.353889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.354933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.560708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:59.615416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:59.618307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cdd6144c-3a93-4d60-b8de-22f2e61b19c3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:59.618562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:18:59.628219 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ce60e7eb-8a8d-432e-94f2-8f933a0b164e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 200 len: 1655 microversion: 2.20 time: 0.308806 Aug 04 14:18:59.629322 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2160/4333] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:18:59 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 1655 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:18:59.631056 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cdd6144c-3a93-4d60-b8de-22f2e61b19c3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.506086 Aug 04 14:18:59.634391 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2174/4334] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:59 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:18:59.650779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c5d83706-362e-4c69-9fc1-b1210e6301e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:18:59.655187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c5d83706-362e-4c69-9fc1-b1210e6301e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:59.673893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-80700a7a-ba3f-4cb0-b82a-8a67c1e3717a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:59.674830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-80700a7a-ba3f-4cb0-b82a-8a67c1e3717a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:59.676317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5d83706-362e-4c69-9fc1-b1210e6301e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.678407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5d83706-362e-4c69-9fc1-b1210e6301e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.680273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5d83706-362e-4c69-9fc1-b1210e6301e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.682384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5d83706-362e-4c69-9fc1-b1210e6301e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.685140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80700a7a-ba3f-4cb0-b82a-8a67c1e3717a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.686029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80700a7a-ba3f-4cb0-b82a-8a67c1e3717a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.687023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80700a7a-ba3f-4cb0-b82a-8a67c1e3717a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.687636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80700a7a-ba3f-4cb0-b82a-8a67c1e3717a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.801759 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c5d83706-362e-4c69-9fc1-b1210e6301e3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 14 microversion: 2.1 time: 0.165008 Aug 04 14:18:59.806356 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2175/4335] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:18:59 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:18:59.815115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-745acf6f-bde4-448d-a923-ae970c7b1e1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:18:59.825158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-745acf6f-bde4-448d-a923-ae970c7b1e1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:18:59.843374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-745acf6f-bde4-448d-a923-ae970c7b1e1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.843836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-745acf6f-bde4-448d-a923-ae970c7b1e1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:18:59.844845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-745acf6f-bde4-448d-a923-ae970c7b1e1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:18:59.845588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-745acf6f-bde4-448d-a923-ae970c7b1e1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.041556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-80700a7a-ba3f-4cb0-b82a-8a67c1e3717a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:00.073495 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-80700a7a-ba3f-4cb0-b82a-8a67c1e3717a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.420833 Aug 04 14:19:00.074147 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2161/4336] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:59 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:00.083907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-191fbce8-ebdb-4451-9c38-e59cee1841d3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:00.084943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-191fbce8-ebdb-4451-9c38-e59cee1841d3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:00.098485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-191fbce8-ebdb-4451-9c38-e59cee1841d3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.099221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-191fbce8-ebdb-4451-9c38-e59cee1841d3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.100239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-191fbce8-ebdb-4451-9c38-e59cee1841d3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.100910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-191fbce8-ebdb-4451-9c38-e59cee1841d3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.293765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-745acf6f-bde4-448d-a923-ae970c7b1e1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:00.307806 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-745acf6f-bde4-448d-a923-ae970c7b1e1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.499812 Aug 04 14:19:00.320904 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2176/4337] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:18:59 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:00.325170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-bbce1949-0854-4c57-ae6f-77873c514840 req-4b6941f6-2975-4a10-83a7-62a4294c072a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9c2731-512a-423b-a54e-32f7e2171623", "name": "network-vif-deleted", "tag": "fcaf7619-ad8a-4c0d-91da-0cf44e564f7f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:00.352917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bbce1949-0854-4c57-ae6f-77873c514840 req-4b6941f6-2975-4a10-83a7-62a4294c072a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.355502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bbce1949-0854-4c57-ae6f-77873c514840 req-4b6941f6-2975-4a10-83a7-62a4294c072a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.391261 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-bbce1949-0854-4c57-ae6f-77873c514840 req-4b6941f6-2975-4a10-83a7-62a4294c072a service nova] Creating event network-vif-deleted:fcaf7619-ad8a-4c0d-91da-0cf44e564f7f for instance 8b9c2731-512a-423b-a54e-32f7e2171623 on n-h2-844627-10 Aug 04 14:19:00.406936 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-bbce1949-0854-4c57-ae6f-77873c514840 req-4b6941f6-2975-4a10-83a7-62a4294c072a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089418 Aug 04 14:19:00.410306 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2177/4338] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:00.447066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cb0a7b7-381b-4c87-b268-7c5cfdb0580e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1866987697", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:00.448662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-191fbce8-ebdb-4451-9c38-e59cee1841d3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cb0a7b7-381b-4c87-b268-7c5cfdb0580e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 173 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1866987697", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1866987697', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi -1 Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:19:00.457812 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 14:19:00.468184 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.473019 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-191fbce8-ebdb-4451-9c38-e59cee1841d3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1312 microversion: 2.1 time: 0.384800 Aug 04 14:19:00.473019 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2162/4339] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:00 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1312 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:00.474531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cb0a7b7-381b-4c87-b268-7c5cfdb0580e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:00.476623 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8cb0a7b7-381b-4c87-b268-7c5cfdb0580e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.041761 Aug 04 14:19:00.478433 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2178/4340] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:19:00 2022] POST /compute/v2.1/servers => generated 145 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:19:00.487760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f49dd953-f08e-404f-8400-9623a09fe39a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:00.488403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f49dd953-f08e-404f-8400-9623a09fe39a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:00.495226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f49dd953-f08e-404f-8400-9623a09fe39a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.495758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f49dd953-f08e-404f-8400-9623a09fe39a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.496568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f49dd953-f08e-404f-8400-9623a09fe39a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.497052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f49dd953-f08e-404f-8400-9623a09fe39a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.667587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:00.673904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:00.706591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.707858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.709556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.710611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.735270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f49dd953-f08e-404f-8400-9623a09fe39a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:00.741348 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] HTTP exception thrown: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Request method failure captured: Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 HTTP/1.1 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69QVzKbtet42t3roKnv7vyWEdxN20V0JIyra5zHAEmxljp_nLALM38mPhFYzcbPsWq_bOGl_b7CKP2_04jgzfCQEUsbmYrkAtZJsYggXWmLaAgzwmsdlsraTB6rfeCVD5RDeHucrTElXvsLhbalEHUIvTuw6OAqni-WjLs6Uepwz9e8 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dd3c60073acc4679bbf967680287239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dd3c60073acc4679bbf967680287239e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}] Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: be1de13158f1415e9fc93ab6fcf28b30 Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '8b9c2731-512a-423b-a54e-32f7e2171623'} Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.745583 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:00.754483 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.754483 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:00.754483 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:00.754483 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:00.754483 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:00.754483 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:00.754483 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:19:00.754483 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:00.756815 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f49dd953-f08e-404f-8400-9623a09fe39a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.261760 Aug 04 14:19:00.756815 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2163/4341] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:00 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:00.758302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Returning 404 to user: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:00.760859 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ad52db92-643d-4878-9c4c-53e1e5d41514 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 404 len: 111 microversion: 2.20 time: 0.110280 Aug 04 14:19:00.762399 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2179/4342] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:00 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:19:00.767902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a0eff3b5-4b3f-4741-bc6f-4734226361a8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:00.768576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a0eff3b5-4b3f-4741-bc6f-4734226361a8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:00.775835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0eff3b5-4b3f-4741-bc6f-4734226361a8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.776309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0eff3b5-4b3f-4741-bc6f-4734226361a8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.777344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0eff3b5-4b3f-4741-bc6f-4734226361a8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.777805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0eff3b5-4b3f-4741-bc6f-4734226361a8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.778892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-144e9697-86f3-4ece-a05d-38120a5a7e99 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '.version_select at 0x7f4700264c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:00.826050 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-144e9697-86f3-4ece-a05d-38120a5a7e99 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190541258" status: 204 len: 0 microversion: 2.20 time: 0.055727 Aug 04 14:19:00.829249 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2180/4343] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 14:19:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190541258 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:19:00.859192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86facd50-133b-43d1-ae74-01f390430c78 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:00.870848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-86facd50-133b-43d1-ae74-01f390430c78 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:00.892825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86facd50-133b-43d1-ae74-01f390430c78 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.893704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86facd50-133b-43d1-ae74-01f390430c78 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.897526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86facd50-133b-43d1-ae74-01f390430c78 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:00.897997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86facd50-133b-43d1-ae74-01f390430c78 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:00.991756 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86facd50-133b-43d1-ae74-01f390430c78 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 14 microversion: 2.1 time: 0.158205 Aug 04 14:19:01.000932 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2181/4344] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:00 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:19:01.027918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a0eff3b5-4b3f-4741-bc6f-4734226361a8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:01.038273 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a0eff3b5-4b3f-4741-bc6f-4734226361a8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.274961 Aug 04 14:19:01.039256 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2164/4345] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:00 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:01.116779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-221afe2a-cc3d-475a-b31e-c73ce51013ca tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:01.118986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-221afe2a-cc3d-475a-b31e-c73ce51013ca tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:01.166546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-221afe2a-cc3d-475a-b31e-c73ce51013ca tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:01.170223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-221afe2a-cc3d-475a-b31e-c73ce51013ca tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:01.180439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-221afe2a-cc3d-475a-b31e-c73ce51013ca tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:01.181530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-221afe2a-cc3d-475a-b31e-c73ce51013ca tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:01.225885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f25f8b7-78c5-4f4f-8528-1707e40ec7ce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1271281464", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:01.241212 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8f25f8b7-78c5-4f4f-8528-1707e40ec7ce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f25f8b7-78c5-4f4f-8528-1707e40ec7ce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 216 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1271281464", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1271281464', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:01.243293 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:01.247245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:01.247245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:01.247245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:01.247245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:01.247245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:01.247245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 14:19:01.247245 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:01.249478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f25f8b7-78c5-4f4f-8528-1707e40ec7ce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:01.253508 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f25f8b7-78c5-4f4f-8528-1707e40ec7ce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.033214 Aug 04 14:19:01.254448 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2165/4346] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:19:01 2022] POST /compute/v2.1/servers => generated 123 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 14:19:01.268406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bfe823f4-f757-4ac1-be4e-520a02a62a63 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:01.269794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bfe823f4-f757-4ac1-be4e-520a02a62a63 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:01.278320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfe823f4-f757-4ac1-be4e-520a02a62a63 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:01.279332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfe823f4-f757-4ac1-be4e-520a02a62a63 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:01.280557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfe823f4-f757-4ac1-be4e-520a02a62a63 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:01.284258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfe823f4-f757-4ac1-be4e-520a02a62a63 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:01.554931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bfe823f4-f757-4ac1-be4e-520a02a62a63 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:01.566812 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bfe823f4-f757-4ac1-be4e-520a02a62a63 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.303882 Aug 04 14:19:01.567525 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2166/4347] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:01 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:01.585369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-79e7cb0f-a7f9-47e6-b5da-2d75df7aa5c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:01.586118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-79e7cb0f-a7f9-47e6-b5da-2d75df7aa5c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:01.596231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79e7cb0f-a7f9-47e6-b5da-2d75df7aa5c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:01.598395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79e7cb0f-a7f9-47e6-b5da-2d75df7aa5c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:01.605728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79e7cb0f-a7f9-47e6-b5da-2d75df7aa5c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:01.605728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79e7cb0f-a7f9-47e6-b5da-2d75df7aa5c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:01.609555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-221afe2a-cc3d-475a-b31e-c73ce51013ca tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:01.618465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-221afe2a-cc3d-475a-b31e-c73ce51013ca tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.519751 Aug 04 14:19:01.623379 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2182/4348] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:01 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:01.628662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b09c972e-119a-45b2-979b-f475790fcee3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:01.640645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b09c972e-119a-45b2-979b-f475790fcee3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:01.648789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09c972e-119a-45b2-979b-f475790fcee3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:01.649617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09c972e-119a-45b2-979b-f475790fcee3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:01.650721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09c972e-119a-45b2-979b-f475790fcee3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:01.652567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09c972e-119a-45b2-979b-f475790fcee3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:01.923927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-79e7cb0f-a7f9-47e6-b5da-2d75df7aa5c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:01.933262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b09c972e-119a-45b2-979b-f475790fcee3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:01.947578 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-79e7cb0f-a7f9-47e6-b5da-2d75df7aa5c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1312 microversion: 2.1 time: 0.377722 Aug 04 14:19:01.948604 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2167/4349] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:01 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:01.974606 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b09c972e-119a-45b2-979b-f475790fcee3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.349597 Aug 04 14:19:01.976108 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2183/4350] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:01 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:02.045081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e9d11eb-be6b-42c5-910d-90659c189912 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:02.045081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e9d11eb-be6b-42c5-910d-90659c189912 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:02.045081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e9d11eb-be6b-42c5-910d-90659c189912 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:02.045081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e9d11eb-be6b-42c5-910d-90659c189912 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:02.045081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e9d11eb-be6b-42c5-910d-90659c189912 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:02.136591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e9d11eb-be6b-42c5-910d-90659c189912 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:02.136591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:02.139064 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e9d11eb-be6b-42c5-910d-90659c189912 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 14 microversion: 2.1 time: 0.133033 Aug 04 14:19:02.139456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6e92a401-9605-4ce9-8d42-c66685f579b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'create', calling method: .version_select at 0x7f46f3c43670>, body: {"keypair": {"name": "tempest-keypair-1640067023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKgchcS//HbHvNf8N3rX51KHjnH1HUL1so/DYr9dh0JMRuBuotETsmuICaMcDyvV6C7wMILX12CAUdvaU+5vPakYwH3k7p6OnaQpNPBHuUjWnumMjlspu5VSoYxd0Temg=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:02.139722 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2168/4351] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:02 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:19:02.148738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0118a227-c9dd-47d8-b0b0-a9f0583e8897 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-569299669", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "key_name": "tempest-key-899111887", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:02.161991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-6e92a401-9605-4ce9-8d42-c66685f579b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Getting quotas for project dd3c60073acc4679bbf967680287239e. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:19:02.172189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-6e92a401-9605-4ce9-8d42-c66685f579b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Getting quotas for user be1de13158f1415e9fc93ab6fcf28b30 and project dd3c60073acc4679bbf967680287239e. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:19:02.216083 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6e92a401-9605-4ce9-8d42-c66685f579b8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.092500 Aug 04 14:19:02.217829 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2184/4352] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 14:19:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 14:19:02.251179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-0118a227-c9dd-47d8-b0b0-a9f0583e8897 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] validate_networks() for [('aae182f0-01e4-483b-8d95-1af990b09462', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:19:02.606731 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-0118a227-c9dd-47d8-b0b0-a9f0583e8897 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Invalid key_name provided. Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0118a227-c9dd-47d8-b0b0-a9f0583e8897 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 245 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-569299669", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "key_name": "tempest-key-899111887", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid key_name provided. Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-569299669', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'key_name': 'tempest-key-899111887', 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-899111887 not found for user c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:02.611932 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 04 14:19:02.615782 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:02.618398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0118a227-c9dd-47d8-b0b0-a9f0583e8897 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid key_name provided. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:02.619505 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0118a227-c9dd-47d8-b0b0-a9f0583e8897 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.479170 Aug 04 14:19:02.620333 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2169/4353] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:19:02 2022] POST /compute/v2.1/servers => generated 70 bytes in 481 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 14:19:02.631377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d12b2bd-e669-471d-9bb7-b5144c9b81dc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:02.632674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3d12b2bd-e669-471d-9bb7-b5144c9b81dc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:02.640463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d12b2bd-e669-471d-9bb7-b5144c9b81dc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:02.641036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d12b2bd-e669-471d-9bb7-b5144c9b81dc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:02.641916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d12b2bd-e669-471d-9bb7-b5144c9b81dc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:02.642570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d12b2bd-e669-471d-9bb7-b5144c9b81dc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:02.660318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-27451a24-2f00-4e4a-9f1c-fe3d4ae74a22 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:02.661113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-27451a24-2f00-4e4a-9f1c-fe3d4ae74a22 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:02.684808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27451a24-2f00-4e4a-9f1c-fe3d4ae74a22 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:02.685954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27451a24-2f00-4e4a-9f1c-fe3d4ae74a22 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:02.688736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27451a24-2f00-4e4a-9f1c-fe3d4ae74a22 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:02.690642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27451a24-2f00-4e4a-9f1c-fe3d4ae74a22 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:02.953308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3d12b2bd-e669-471d-9bb7-b5144c9b81dc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:02.959585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:02.978384 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3d12b2bd-e669-471d-9bb7-b5144c9b81dc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.351802 Aug 04 14:19:02.980131 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2185/4354] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:02 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:02.995322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-863a8bbc-2a5f-4c9d-8cda-a9cd6fb081b2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:02.997193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-863a8bbc-2a5f-4c9d-8cda-a9cd6fb081b2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:03.028546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-863a8bbc-2a5f-4c9d-8cda-a9cd6fb081b2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:03.029574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-863a8bbc-2a5f-4c9d-8cda-a9cd6fb081b2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:03.031012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-863a8bbc-2a5f-4c9d-8cda-a9cd6fb081b2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:03.031743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-863a8bbc-2a5f-4c9d-8cda-a9cd6fb081b2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:03.094579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-27451a24-2f00-4e4a-9f1c-fe3d4ae74a22 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:03.106151 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-27451a24-2f00-4e4a-9f1c-fe3d4ae74a22 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.449885 Aug 04 14:19:03.121604 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2170/4355] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:02 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:03.127243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e45b76ba-9cf4-4837-bed5-962bb1835389 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:03.128631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e45b76ba-9cf4-4837-bed5-962bb1835389 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:03.139832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e45b76ba-9cf4-4837-bed5-962bb1835389 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:03.140587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e45b76ba-9cf4-4837-bed5-962bb1835389 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:03.143564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e45b76ba-9cf4-4837-bed5-962bb1835389 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:03.145057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e45b76ba-9cf4-4837-bed5-962bb1835389 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:03.373627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:03.413576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-863a8bbc-2a5f-4c9d-8cda-a9cd6fb081b2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:03.428105 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-863a8bbc-2a5f-4c9d-8cda-a9cd6fb081b2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1312 microversion: 2.1 time: 0.445914 Aug 04 14:19:03.429840 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2186/4356] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:02 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1312 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:03.437812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-28276250-bb52-4e04-a78c-4785277af5fd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:03.443051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-28276250-bb52-4e04-a78c-4785277af5fd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:03.464300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28276250-bb52-4e04-a78c-4785277af5fd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:03.465570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28276250-bb52-4e04-a78c-4785277af5fd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:03.467585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28276250-bb52-4e04-a78c-4785277af5fd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:03.468645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28276250-bb52-4e04-a78c-4785277af5fd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:03.546247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e45b76ba-9cf4-4837-bed5-962bb1835389 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:03.553523 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-28276250-bb52-4e04-a78c-4785277af5fd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 14 microversion: 2.1 time: 0.119067 Aug 04 14:19:03.554333 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2187/4357] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:03 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:19:03.561520 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e45b76ba-9cf4-4837-bed5-962bb1835389 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.438296 Aug 04 14:19:03.562466 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2171/4358] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:03 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:03.661732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4f3252f-9a86-454a-947f-2c1106ce97bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1355286982", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:03.675282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:03.822630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.security_group_api [None req-b4f3252f-9a86-454a-947f-2c1106ce97bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Neutron security group does_not_exist not found {{(pid=130960) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 04 14:19:03.823900 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-b4f3252f-9a86-454a-947f-2c1106ce97bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4f3252f-9a86-454a-947f-2c1106ce97bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 258 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1355286982", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1355286982', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 04 14:19:03.839588 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 04 14:19:03.844828 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:03.851989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4f3252f-9a86-454a-947f-2c1106ce97bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:03.854270 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b4f3252f-9a86-454a-947f-2c1106ce97bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.195784 Aug 04 14:19:03.855149 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2188/4359] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:19:03 2022] POST /compute/v2.1/servers => generated 106 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:19:03.867233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4aa7b695-e8a6-4fb5-86e9-8fb0fe0defb9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:03.867870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4aa7b695-e8a6-4fb5-86e9-8fb0fe0defb9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:03.888295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4aa7b695-e8a6-4fb5-86e9-8fb0fe0defb9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:03.893796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4aa7b695-e8a6-4fb5-86e9-8fb0fe0defb9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:03.895016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4aa7b695-e8a6-4fb5-86e9-8fb0fe0defb9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:03.895643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4aa7b695-e8a6-4fb5-86e9-8fb0fe0defb9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.026184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:04.134346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-50199fbe-c36b-4d2f-99b1-0f75bc109ac9 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:04.136343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4aa7b695-e8a6-4fb5-86e9-8fb0fe0defb9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:04.138186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-50199fbe-c36b-4d2f-99b1-0f75bc109ac9 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:04.150883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50199fbe-c36b-4d2f-99b1-0f75bc109ac9 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.151923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50199fbe-c36b-4d2f-99b1-0f75bc109ac9 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.154176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50199fbe-c36b-4d2f-99b1-0f75bc109ac9 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.155240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50199fbe-c36b-4d2f-99b1-0f75bc109ac9 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.170997 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4aa7b695-e8a6-4fb5-86e9-8fb0fe0defb9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.307962 Aug 04 14:19:04.172540 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2172/4360] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:03 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:04.196166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d25e4a2-1515-4b33-9487-87a81448ba2d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:04.196850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1d25e4a2-1515-4b33-9487-87a81448ba2d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:04.204343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d25e4a2-1515-4b33-9487-87a81448ba2d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.205317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d25e4a2-1515-4b33-9487-87a81448ba2d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.207587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d25e4a2-1515-4b33-9487-87a81448ba2d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.208040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d25e4a2-1515-4b33-9487-87a81448ba2d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.527061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-50199fbe-c36b-4d2f-99b1-0f75bc109ac9 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:04.558020 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-50199fbe-c36b-4d2f-99b1-0f75bc109ac9 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.432810 Aug 04 14:19:04.559115 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2189/4361] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:04 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:04.583440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1d25e4a2-1515-4b33-9487-87a81448ba2d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:04.585439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c4f1b8b8-70ea-4188-99e1-3fe15e746052 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:04.586384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c4f1b8b8-70ea-4188-99e1-3fe15e746052 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:04.595475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4f1b8b8-70ea-4188-99e1-3fe15e746052 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.596293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4f1b8b8-70ea-4188-99e1-3fe15e746052 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.597146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4f1b8b8-70ea-4188-99e1-3fe15e746052 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.597688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4f1b8b8-70ea-4188-99e1-3fe15e746052 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.601772 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d25e4a2-1515-4b33-9487-87a81448ba2d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.410144 Aug 04 14:19:04.603204 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2173/4362] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:04 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:04.614107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dcc544a3-b71c-447b-aae6-4b6c40b442c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:04.619462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dcc544a3-b71c-447b-aae6-4b6c40b442c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:04.630870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcc544a3-b71c-447b-aae6-4b6c40b442c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.631657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcc544a3-b71c-447b-aae6-4b6c40b442c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.634076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcc544a3-b71c-447b-aae6-4b6c40b442c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.634941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcc544a3-b71c-447b-aae6-4b6c40b442c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.731205 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dcc544a3-b71c-447b-aae6-4b6c40b442c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 14 microversion: 2.1 time: 0.125859 Aug 04 14:19:04.732172 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2174/4363] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:04 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:19:04.750338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-022a2c7c-17f5-4ad8-987f-74d4976c1666 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:04.751933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-022a2c7c-17f5-4ad8-987f-74d4976c1666 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 907dbec7-76d2-445d-8e94-0131bd1217ae] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:04.768454 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-022a2c7c-17f5-4ad8-987f-74d4976c1666 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 907dbec7-76d2-445d-8e94-0131bd1217ae could not be found. Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-022a2c7c-17f5-4ad8-987f-74d4976c1666 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/907dbec7-76d2-445d-8e94-0131bd1217ae HTTP/1.1 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 907dbec7-76d2-445d-8e94-0131bd1217ae could not be found. Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '907dbec7-76d2-445d-8e94-0131bd1217ae'} Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907dbec7-76d2-445d-8e94-0131bd1217ae could not be found. Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907dbec7-76d2-445d-8e94-0131bd1217ae could not be found. Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:04.782013 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907dbec7-76d2-445d-8e94-0131bd1217ae could not be found. Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-022a2c7c-17f5-4ad8-987f-74d4976c1666 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 907dbec7-76d2-445d-8e94-0131bd1217ae could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:04.787183 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-022a2c7c-17f5-4ad8-987f-74d4976c1666 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "DELETE /compute/v2.1/servers/907dbec7-76d2-445d-8e94-0131bd1217ae" status: 404 len: 111 microversion: 2.1 time: 0.050663 Aug 04 14:19:04.797426 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2175/4364] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:19:04 2022] DELETE /compute/v2.1/servers/907dbec7-76d2-445d-8e94-0131bd1217ae => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:04.805224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-23ad6504-2c2c-4aa0-b40d-1b97314a2c3a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:04.806204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-23ad6504-2c2c-4aa0-b40d-1b97314a2c3a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:04.819732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23ad6504-2c2c-4aa0-b40d-1b97314a2c3a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.820892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23ad6504-2c2c-4aa0-b40d-1b97314a2c3a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.822670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23ad6504-2c2c-4aa0-b40d-1b97314a2c3a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:04.823770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23ad6504-2c2c-4aa0-b40d-1b97314a2c3a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:04.874288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c4f1b8b8-70ea-4188-99e1-3fe15e746052 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:04.884529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c4f1b8b8-70ea-4188-99e1-3fe15e746052 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1312 microversion: 2.1 time: 0.309656 Aug 04 14:19:04.888501 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2190/4365] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:04 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1312 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:05.061658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-23ad6504-2c2c-4aa0-b40d-1b97314a2c3a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:05.071525 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-23ad6504-2c2c-4aa0-b40d-1b97314a2c3a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.272313 Aug 04 14:19:05.072196 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2176/4366] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:04 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:05.095886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd3de739-2b8d-43f5-8fa0-d49a55343b32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:05.096535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd3de739-2b8d-43f5-8fa0-d49a55343b32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:05.104526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd3de739-2b8d-43f5-8fa0-d49a55343b32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:05.105027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd3de739-2b8d-43f5-8fa0-d49a55343b32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:05.106133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd3de739-2b8d-43f5-8fa0-d49a55343b32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:05.106845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd3de739-2b8d-43f5-8fa0-d49a55343b32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:05.346391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dd3de739-2b8d-43f5-8fa0-d49a55343b32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:05.365284 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd3de739-2b8d-43f5-8fa0-d49a55343b32 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.272931 Aug 04 14:19:05.366394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2191/4367] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:05 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:05.402164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70852367-a909-49fa-a43a-1bdabd401e25 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:05.403382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70852367-a909-49fa-a43a-1bdabd401e25 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Failed to fetch instance by id 9223372036854775808 {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 14:19:05.404727 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-70852367-a909-49fa-a43a-1bdabd401e25 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70852367-a909-49fa-a43a-1bdabd401e25 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 9223372036854775808 could not be found. Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9223372036854775808'} Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:05.407827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:05.416574 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:05.416574 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:05.416574 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:05.416574 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 04 14:19:05.416574 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:05.416574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70852367-a909-49fa-a43a-1bdabd401e25 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:05.417766 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70852367-a909-49fa-a43a-1bdabd401e25 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.024450 Aug 04 14:19:05.421749 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2177/4368] 10.222.0.66 () {58 vars in 1188 bytes} [Thu Aug 4 14:19:05 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:19:05.434174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d9e1938-4123-41be-89ac-4416b2c867e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:05.434972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2d9e1938-4123-41be-89ac-4416b2c867e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:05.443186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d9e1938-4123-41be-89ac-4416b2c867e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:05.443638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d9e1938-4123-41be-89ac-4416b2c867e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:05.445221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d9e1938-4123-41be-89ac-4416b2c867e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:05.445990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d9e1938-4123-41be-89ac-4416b2c867e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:05.599724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5be354b4-9b85-42b1-845c-5a90398418b3 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:05.600807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5be354b4-9b85-42b1-845c-5a90398418b3 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:05.612031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5be354b4-9b85-42b1-845c-5a90398418b3 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:05.612963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5be354b4-9b85-42b1-845c-5a90398418b3 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:05.614232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5be354b4-9b85-42b1-845c-5a90398418b3 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:05.615237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5be354b4-9b85-42b1-845c-5a90398418b3 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:05.645360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2d9e1938-4123-41be-89ac-4416b2c867e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:05.656763 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2d9e1938-4123-41be-89ac-4416b2c867e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.229932 Aug 04 14:19:05.658536 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2192/4369] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:05 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:05.679869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ed73e09d-b84c-4c59-a51c-1e3ed19ac722 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:05.680506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ed73e09d-b84c-4c59-a51c-1e3ed19ac722 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:05.704705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed73e09d-b84c-4c59-a51c-1e3ed19ac722 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:05.706149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed73e09d-b84c-4c59-a51c-1e3ed19ac722 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:05.720825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed73e09d-b84c-4c59-a51c-1e3ed19ac722 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:05.726127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed73e09d-b84c-4c59-a51c-1e3ed19ac722 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:05.961884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5be354b4-9b85-42b1-845c-5a90398418b3 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:05.981270 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5be354b4-9b85-42b1-845c-5a90398418b3 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.385714 Aug 04 14:19:05.983412 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2178/4370] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:05 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:06.001484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4dca7e29-fe38-4d37-a81a-9f1fbb42e615 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:06.003615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ed73e09d-b84c-4c59-a51c-1e3ed19ac722 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:06.006798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4dca7e29-fe38-4d37-a81a-9f1fbb42e615 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:06.018710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dca7e29-fe38-4d37-a81a-9f1fbb42e615 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:06.019167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dca7e29-fe38-4d37-a81a-9f1fbb42e615 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:06.019305 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ed73e09d-b84c-4c59-a51c-1e3ed19ac722 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.343255 Aug 04 14:19:06.020239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dca7e29-fe38-4d37-a81a-9f1fbb42e615 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:06.020653 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2193/4371] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:05 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:06.021196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dca7e29-fe38-4d37-a81a-9f1fbb42e615 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:06.040627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1667379356", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "221ce427-a2e0-4876-a7d7-372ae236e973"}], "security_groups": [{"name": "tempest-securitygroup--419169567"}], "key_name": "tempest-keypair-1640067023", "user_data": "}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:06.086856 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4dca7e29-fe38-4d37-a81a-9f1fbb42e615 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 14 microversion: 2.1 time: 0.100539 Aug 04 14:19:06.088372 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2179/4372] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:05 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:19:06.105552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0892c3d2-b241-402d-8a0a-9368445ab7a6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:06.112653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0892c3d2-b241-402d-8a0a-9368445ab7a6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:06.123096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0892c3d2-b241-402d-8a0a-9368445ab7a6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:06.124572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0892c3d2-b241-402d-8a0a-9368445ab7a6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:06.125781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0892c3d2-b241-402d-8a0a-9368445ab7a6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:06.126786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0892c3d2-b241-402d-8a0a-9368445ab7a6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:06.338602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] validate_networks() for [('221ce427-a2e0-4876-a7d7-372ae236e973', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:19:06.570908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0892c3d2-b241-402d-8a0a-9368445ab7a6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:06.581857 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0892c3d2-b241-402d-8a0a-9368445ab7a6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1312 microversion: 2.1 time: 0.491933 Aug 04 14:19:06.586545 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2180/4373] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:06 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1312 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:06.606724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf0753f2-b1bc-428b-b83d-949ddd01359c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:06.607261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf0753f2-b1bc-428b-b83d-949ddd01359c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Failed to fetch instance by id -1 {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 14:19:06.607794 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-bf0753f2-b1bc-428b-b83d-949ddd01359c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance -1 could not be found. Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf0753f2-b1bc-428b-b83d-949ddd01359c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance -1 could not be found. Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '-1'} Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:06.609524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:06.617669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:06.617669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:06.617669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 04 14:19:06.617669 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:06.617669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf0753f2-b1bc-428b-b83d-949ddd01359c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance -1 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:06.626418 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf0753f2-b1bc-428b-b83d-949ddd01359c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.035561 Aug 04 14:19:06.627851 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2181/4374] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:19:06 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:19:06.638292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1edee479-6f18-473e-b4be-595982de5a65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:06.641608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1edee479-6f18-473e-b4be-595982de5a65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:06.656490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1edee479-6f18-473e-b4be-595982de5a65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:06.658663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1edee479-6f18-473e-b4be-595982de5a65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:06.665647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1edee479-6f18-473e-b4be-595982de5a65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:06.666252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1edee479-6f18-473e-b4be-595982de5a65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:07.735118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:19:07.735673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:19:07.736110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:19:07.736732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:19:07.737193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:19:07.749743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:07.758981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:07.761174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:07.762177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:07.763162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1edee479-6f18-473e-b4be-595982de5a65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:07.784483 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1edee479-6f18-473e-b4be-595982de5a65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 1.151361 Aug 04 14:19:07.785324 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2182/4375] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:06 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:07.791949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6faa4dec-6701-48dc-8ab7-306e417a6620 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:07.792921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6faa4dec-6701-48dc-8ab7-306e417a6620 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:07.801487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6faa4dec-6701-48dc-8ab7-306e417a6620 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:07.802215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6faa4dec-6701-48dc-8ab7-306e417a6620 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:07.803294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6faa4dec-6701-48dc-8ab7-306e417a6620 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:07.803688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6faa4dec-6701-48dc-8ab7-306e417a6620 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:07.816633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Getting quotas for project dd3c60073acc4679bbf967680287239e. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:19:07.832925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Getting quotas for user be1de13158f1415e9fc93ab6fcf28b30 and project dd3c60073acc4679bbf967680287239e. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:19:07.865564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:19:07.872416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:19:07.966097 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5cfdb72-5061-47fb-8861-0ece0271e008 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.942010 Aug 04 14:19:07.967341 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2194/4376] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:19:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:19:07.983532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-90babf6d-566f-472d-afe2-abba3577f284 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:07.993662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-90babf6d-566f-472d-afe2-abba3577f284 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:08.007363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90babf6d-566f-472d-afe2-abba3577f284 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.007906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90babf6d-566f-472d-afe2-abba3577f284 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.008849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90babf6d-566f-472d-afe2-abba3577f284 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.009298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90babf6d-566f-472d-afe2-abba3577f284 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.013299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6faa4dec-6701-48dc-8ab7-306e417a6620 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:08.021844 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6faa4dec-6701-48dc-8ab7-306e417a6620 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.235168 Aug 04 14:19:08.022762 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2183/4377] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:07 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:08.032759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-73b2b274-830e-44ee-969f-c669f966244d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:08.034067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-73b2b274-830e-44ee-969f-c669f966244d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:08.042367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-73b2b274-830e-44ee-969f-c669f966244d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.042833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-73b2b274-830e-44ee-969f-c669f966244d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.044260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-73b2b274-830e-44ee-969f-c669f966244d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.044715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-73b2b274-830e-44ee-969f-c669f966244d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.058855 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-90babf6d-566f-472d-afe2-abba3577f284 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 14 microversion: 2.1 time: 0.087523 Aug 04 14:19:08.060232 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2195/4378] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:07 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:19:08.072478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-beabbaeb-b936-475a-8931-9024aeb2fdf3 req-11e403d3-9873-4292-ada1-e283e981bfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac15523-1339-4320-b680-25b9841be7f5", "name": "network-vif-plugged", "status": "completed", "tag": "219cba40-80ba-4263-bf6e-a413ed6a24b0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:08.095616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-beabbaeb-b936-475a-8931-9024aeb2fdf3 req-11e403d3-9873-4292-ada1-e283e981bfe7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.096500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-beabbaeb-b936-475a-8931-9024aeb2fdf3 req-11e403d3-9873-4292-ada1-e283e981bfe7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.123757 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-beabbaeb-b936-475a-8931-9024aeb2fdf3 req-11e403d3-9873-4292-ada1-e283e981bfe7 service nova] Creating event network-vif-plugged:219cba40-80ba-4263-bf6e-a413ed6a24b0 for instance eac15523-1339-4320-b680-25b9841be7f5 on n-h1-844627-10 Aug 04 14:19:08.129608 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-beabbaeb-b936-475a-8931-9024aeb2fdf3 req-11e403d3-9873-4292-ada1-e283e981bfe7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066938 Aug 04 14:19:08.130610 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2196/4379] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:08.137180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd6d0146-90b3-4a34-ab7e-73da48c37c86 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:08.137906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cd6d0146-90b3-4a34-ab7e-73da48c37c86 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:08.162516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd6d0146-90b3-4a34-ab7e-73da48c37c86 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.163389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd6d0146-90b3-4a34-ab7e-73da48c37c86 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.165646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd6d0146-90b3-4a34-ab7e-73da48c37c86 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.166108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd6d0146-90b3-4a34-ab7e-73da48c37c86 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.326332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-73b2b274-830e-44ee-969f-c669f966244d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:08.362933 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-73b2b274-830e-44ee-969f-c669f966244d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1312 microversion: 2.1 time: 0.338689 Aug 04 14:19:08.363858 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2184/4380] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:08 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1312 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:08.369002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-11ab9c00-dd96-433d-8f66-d857ea39b440 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:08.369639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-11ab9c00-dd96-433d-8f66-d857ea39b440 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:08.512184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-11ab9c00-dd96-433d-8f66-d857ea39b440 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:08.513279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cd6d0146-90b3-4a34-ab7e-73da48c37c86 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:08.520218 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cd6d0146-90b3-4a34-ab7e-73da48c37c86 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.388299 Aug 04 14:19:08.527466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-11ab9c00-dd96-433d-8f66-d857ea39b440 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:08.533145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-11ab9c00-dd96-433d-8f66-d857ea39b440 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:08.534828 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-11ab9c00-dd96-433d-8f66-d857ea39b440 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1282 microversion: 2.20 time: 0.169781 Aug 04 14:19:08.536914 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2185/4381] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:08 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:08.537106 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2197/4382] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:08 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:08.548901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e10bbf32-2290-4ac2-a5e0-e811e047b6f1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:08.550322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e10bbf32-2290-4ac2-a5e0-e811e047b6f1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 6e6be879-054b-4abf-8ad8-a3834152753d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:08.557844 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e10bbf32-2290-4ac2-a5e0-e811e047b6f1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 6e6be879-054b-4abf-8ad8-a3834152753d could not be found. Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e10bbf32-2290-4ac2-a5e0-e811e047b6f1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/6e6be879-054b-4abf-8ad8-a3834152753d/action HTTP/1.1 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 19 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: {"forceDelete": {}} Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 6e6be879-054b-4abf-8ad8-a3834152753d could not be found. Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '6e6be879-054b-4abf-8ad8-a3834152753d', 'body': {'forceDelete': {}}} Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6be879-054b-4abf-8ad8-a3834152753d could not be found. Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6be879-054b-4abf-8ad8-a3834152753d could not be found. Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:08.564315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:08.573417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:08.573417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:08.573417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6be879-054b-4abf-8ad8-a3834152753d could not be found. Aug 04 14:19:08.573417 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:08.573417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e10bbf32-2290-4ac2-a5e0-e811e047b6f1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 6e6be879-054b-4abf-8ad8-a3834152753d could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:08.573417 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e10bbf32-2290-4ac2-a5e0-e811e047b6f1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/6e6be879-054b-4abf-8ad8-a3834152753d/action" status: 404 len: 111 microversion: 2.1 time: 0.023270 Aug 04 14:19:08.573417 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2186/4383] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:08 2022] POST /compute/v2.1/servers/6e6be879-054b-4abf-8ad8-a3834152753d/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:08.587604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae35ad03-cb6e-42f0-92e4-1b6b351f7634 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:08.589469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ae35ad03-cb6e-42f0-92e4-1b6b351f7634 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:08.602538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae35ad03-cb6e-42f0-92e4-1b6b351f7634 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.603333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae35ad03-cb6e-42f0-92e4-1b6b351f7634 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.604703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae35ad03-cb6e-42f0-92e4-1b6b351f7634 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.605892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae35ad03-cb6e-42f0-92e4-1b6b351f7634 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.847789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ae35ad03-cb6e-42f0-92e4-1b6b351f7634 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:08.858818 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae35ad03-cb6e-42f0-92e4-1b6b351f7634 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.281212 Aug 04 14:19:08.860011 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2198/4384] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:08 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:08.884431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ee085a2c-55e2-4cee-b486-351df14a1549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:08.886000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ee085a2c-55e2-4cee-b486-351df14a1549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:08.894257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee085a2c-55e2-4cee-b486-351df14a1549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.895000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee085a2c-55e2-4cee-b486-351df14a1549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:08.896160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee085a2c-55e2-4cee-b486-351df14a1549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:08.896821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee085a2c-55e2-4cee-b486-351df14a1549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.069929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1d02a828-e3be-46cd-b2fe-adb4eac33c6c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:09.071218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1d02a828-e3be-46cd-b2fe-adb4eac33c6c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:09.074580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ee085a2c-55e2-4cee-b486-351df14a1549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:09.083066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d02a828-e3be-46cd-b2fe-adb4eac33c6c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.083888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d02a828-e3be-46cd-b2fe-adb4eac33c6c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.085374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d02a828-e3be-46cd-b2fe-adb4eac33c6c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.086162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d02a828-e3be-46cd-b2fe-adb4eac33c6c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.100516 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ee085a2c-55e2-4cee-b486-351df14a1549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.220374 Aug 04 14:19:09.102380 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2187/4385] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:08 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:09.119478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a50e055c-a45a-4553-8a98-8f2d2abbf945 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:09.124934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a50e055c-a45a-4553-8a98-8f2d2abbf945 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:09.135657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a50e055c-a45a-4553-8a98-8f2d2abbf945 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.136564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a50e055c-a45a-4553-8a98-8f2d2abbf945 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.138242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a50e055c-a45a-4553-8a98-8f2d2abbf945 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.139004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a50e055c-a45a-4553-8a98-8f2d2abbf945 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.215480 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a50e055c-a45a-4553-8a98-8f2d2abbf945 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 14 microversion: 2.1 time: 0.110512 Aug 04 14:19:09.216193 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2188/4386] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:09 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:19:09.226844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2af2ada5-f5d3-4a3d-ab1a-0ea8673d0ee7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:09.230455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2af2ada5-f5d3-4a3d-ab1a-0ea8673d0ee7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 5ffcc590-3118-4991-8d04-4d2491e8effe] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:09.241184 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2af2ada5-f5d3-4a3d-ab1a-0ea8673d0ee7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 5ffcc590-3118-4991-8d04-4d2491e8effe could not be found. Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2af2ada5-f5d3-4a3d-ab1a-0ea8673d0ee7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/5ffcc590-3118-4991-8d04-4d2491e8effe/action HTTP/1.1 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 39 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: {"os-getConsoleOutput": {"length": 10}} Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 5ffcc590-3118-4991-8d04-4d2491e8effe could not be found. Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '5ffcc590-3118-4991-8d04-4d2491e8effe', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ffcc590-3118-4991-8d04-4d2491e8effe could not be found. Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ffcc590-3118-4991-8d04-4d2491e8effe could not be found. Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:09.249923 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:09.258277 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:09.258277 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:09.258277 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:09.258277 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:09.258277 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ffcc590-3118-4991-8d04-4d2491e8effe could not be found. Aug 04 14:19:09.258277 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:09.259474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2af2ada5-f5d3-4a3d-ab1a-0ea8673d0ee7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 5ffcc590-3118-4991-8d04-4d2491e8effe could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:09.262091 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2af2ada5-f5d3-4a3d-ab1a-0ea8673d0ee7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/5ffcc590-3118-4991-8d04-4d2491e8effe/action" status: 404 len: 111 microversion: 2.1 time: 0.042631 Aug 04 14:19:09.266848 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2189/4387] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:09 2022] POST /compute/v2.1/servers/5ffcc590-3118-4991-8d04-4d2491e8effe/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:09.278438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-17dcca35-f42d-49df-907c-f86152183095 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:09.280483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-17dcca35-f42d-49df-907c-f86152183095 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:09.294088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17dcca35-f42d-49df-907c-f86152183095 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.294879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17dcca35-f42d-49df-907c-f86152183095 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.296332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17dcca35-f42d-49df-907c-f86152183095 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.297165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17dcca35-f42d-49df-907c-f86152183095 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.362005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d02a828-e3be-46cd-b2fe-adb4eac33c6c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:09.377037 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1d02a828-e3be-46cd-b2fe-adb4eac33c6c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.319508 Aug 04 14:19:09.391927 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2199/4388] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:09 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:09.408651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-319bb5c2-b707-4a8c-bb81-8e87d1dae036 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:09.410268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-319bb5c2-b707-4a8c-bb81-8e87d1dae036 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:09.426487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-319bb5c2-b707-4a8c-bb81-8e87d1dae036 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.427657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-319bb5c2-b707-4a8c-bb81-8e87d1dae036 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.429227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-319bb5c2-b707-4a8c-bb81-8e87d1dae036 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.430359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-319bb5c2-b707-4a8c-bb81-8e87d1dae036 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.651334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-17dcca35-f42d-49df-907c-f86152183095 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:09.670918 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-17dcca35-f42d-49df-907c-f86152183095 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.400776 Aug 04 14:19:09.672361 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2190/4389] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:09 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:09.682756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:09.685654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:09.698916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.699613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.700684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.701705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.774247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-319bb5c2-b707-4a8c-bb81-8e87d1dae036 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:09.803040 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-319bb5c2-b707-4a8c-bb81-8e87d1dae036 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1312 microversion: 2.1 time: 0.403208 Aug 04 14:19:09.803040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2200/4390] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:09 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1312 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:09.809784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d064858c-fc4c-487d-8264-a88b1039d109 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:09.810685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d064858c-fc4c-487d-8264-a88b1039d109 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:09.821927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d064858c-fc4c-487d-8264-a88b1039d109 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.822492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d064858c-fc4c-487d-8264-a88b1039d109 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.824400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d064858c-fc4c-487d-8264-a88b1039d109 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:09.825002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d064858c-fc4c-487d-8264-a88b1039d109 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:09.834358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:09.852455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:09.856108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:09.858783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-04b9eb9b-628e-4f83-9f60-72f2e3b9a288 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1278 microversion: 2.20 time: 0.183043 Aug 04 14:19:09.860057 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2191/4391] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:09 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:10.084278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d064858c-fc4c-487d-8264-a88b1039d109 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:10.096982 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d064858c-fc4c-487d-8264-a88b1039d109 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.291342 Aug 04 14:19:10.097857 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2201/4392] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:09 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:10.130443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d0fc821a-aa6d-4188-9fcd-e74aced2dd23 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:10.131334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d0fc821a-aa6d-4188-9fcd-e74aced2dd23 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: c2b221da-4862-45b4-ae12-b91eb09a2fd4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:10.139783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-d0fc821a-aa6d-4188-9fcd-e74aced2dd23 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance c2b221da-4862-45b4-ae12-b91eb09a2fd4 could not be found. Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d0fc821a-aa6d-4188-9fcd-e74aced2dd23 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/c2b221da-4862-45b4-ae12-b91eb09a2fd4 HTTP/1.1 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance c2b221da-4862-45b4-ae12-b91eb09a2fd4 could not be found. Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'c2b221da-4862-45b4-ae12-b91eb09a2fd4'} Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b221da-4862-45b4-ae12-b91eb09a2fd4 could not be found. Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b221da-4862-45b4-ae12-b91eb09a2fd4 could not be found. Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:10.142261 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:10.148536 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:10.148536 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:10.148536 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:10.148536 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b221da-4862-45b4-ae12-b91eb09a2fd4 could not be found. Aug 04 14:19:10.148536 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:10.148536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d0fc821a-aa6d-4188-9fcd-e74aced2dd23 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance c2b221da-4862-45b4-ae12-b91eb09a2fd4 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:10.148536 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d0fc821a-aa6d-4188-9fcd-e74aced2dd23 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/c2b221da-4862-45b4-ae12-b91eb09a2fd4" status: 404 len: 111 microversion: 2.1 time: 0.019675 Aug 04 14:19:10.148536 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2192/4393] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:10 2022] GET /compute/v2.1/servers/c2b221da-4862-45b4-ae12-b91eb09a2fd4 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:10.156266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-28b797e8-ac31-4bbc-8924-f487374bc121 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:10.156949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-28b797e8-ac31-4bbc-8924-f487374bc121 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:10.164779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28b797e8-ac31-4bbc-8924-f487374bc121 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.165560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28b797e8-ac31-4bbc-8924-f487374bc121 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.166365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28b797e8-ac31-4bbc-8924-f487374bc121 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.166806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28b797e8-ac31-4bbc-8924-f487374bc121 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.232223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ccfec60a-1f62-4074-840f-8e770d3102fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:10.237352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ccfec60a-1f62-4074-840f-8e770d3102fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:10.250219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccfec60a-1f62-4074-840f-8e770d3102fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.252212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccfec60a-1f62-4074-840f-8e770d3102fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.254378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccfec60a-1f62-4074-840f-8e770d3102fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.255288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccfec60a-1f62-4074-840f-8e770d3102fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.337804 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ccfec60a-1f62-4074-840f-8e770d3102fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 14 microversion: 2.1 time: 0.111856 Aug 04 14:19:10.339842 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2193/4394] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:10 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:19:10.395759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-28b797e8-ac31-4bbc-8924-f487374bc121 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:10.406192 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-28b797e8-ac31-4bbc-8924-f487374bc121 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.253751 Aug 04 14:19:10.412839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5a5af4a-9e73-4717-b24d-5efce95267fc tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:10.413982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d5a5af4a-9e73-4717-b24d-5efce95267fc tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:10.422248 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2202/4395] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:10 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:10.426323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5a5af4a-9e73-4717-b24d-5efce95267fc tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.427489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5a5af4a-9e73-4717-b24d-5efce95267fc tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.428763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5a5af4a-9e73-4717-b24d-5efce95267fc tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.429605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5a5af4a-9e73-4717-b24d-5efce95267fc tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.433931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fde299e9-2402-42f8-8a20-877e6ef39d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:10.434916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fde299e9-2402-42f8-8a20-877e6ef39d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:10.442587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fde299e9-2402-42f8-8a20-877e6ef39d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.443385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fde299e9-2402-42f8-8a20-877e6ef39d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.444531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fde299e9-2402-42f8-8a20-877e6ef39d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.445782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fde299e9-2402-42f8-8a20-877e6ef39d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.882631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fde299e9-2402-42f8-8a20-877e6ef39d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:10.895927 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fde299e9-2402-42f8-8a20-877e6ef39d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.466001 Aug 04 14:19:10.896712 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2203/4396] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:10 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:10.904464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d5a5af4a-9e73-4717-b24d-5efce95267fc tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:10.910336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:10.923149 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d5a5af4a-9e73-4717-b24d-5efce95267fc tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.517327 Aug 04 14:19:10.942594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1a345b61-e06b-411b-8ca4-63646ac142f4 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:10.942594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1a345b61-e06b-411b-8ca4-63646ac142f4 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:10.945787 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2194/4397] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:10 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:10.953820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a345b61-e06b-411b-8ca4-63646ac142f4 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.955588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a345b61-e06b-411b-8ca4-63646ac142f4 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.956455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:10.957580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a345b61-e06b-411b-8ca4-63646ac142f4 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.958555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a345b61-e06b-411b-8ca4-63646ac142f4 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.958985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:10.993047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.993846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:10.994853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:10.995535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.128249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:11.154404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:11.161302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:11.165595 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a17e9038-97a2-4d33-809e-0ece587943ef tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1340 microversion: 2.20 time: 0.214332 Aug 04 14:19:11.166432 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2195/4398] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:10 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1340 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:11.251003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1a345b61-e06b-411b-8ca4-63646ac142f4 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:11.267285 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1a345b61-e06b-411b-8ca4-63646ac142f4 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1498 microversion: 2.1 time: 0.368236 Aug 04 14:19:11.272163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2204/4399] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:10 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1498 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:11.289624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c266689-fa1b-4837-a228-17f90a0dcf5a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-258110609", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c266689-fa1b-4837-a228-17f90a0dcf5a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 237 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-258110609", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-258110609', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:11.325338 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c266689-fa1b-4837-a228-17f90a0dcf5a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c266689-fa1b-4837-a228-17f90a0dcf5a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042938 Aug 04 14:19:11.345578 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2205/4400] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:19:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:19:11.353356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a02f606c-2af1-43b5-9648-4bd21e33abe2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:11.353356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a02f606c-2af1-43b5-9648-4bd21e33abe2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:11.357896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f6cb775-3ebf-419c-881f-933d9bd71bc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:11.362367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3f6cb775-3ebf-419c-881f-933d9bd71bc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:11.396628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a02f606c-2af1-43b5-9648-4bd21e33abe2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.397488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a02f606c-2af1-43b5-9648-4bd21e33abe2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.398864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a02f606c-2af1-43b5-9648-4bd21e33abe2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.399642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a02f606c-2af1-43b5-9648-4bd21e33abe2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.405836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f6cb775-3ebf-419c-881f-933d9bd71bc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.406721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f6cb775-3ebf-419c-881f-933d9bd71bc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.407923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f6cb775-3ebf-419c-881f-933d9bd71bc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.408700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f6cb775-3ebf-419c-881f-933d9bd71bc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.428632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:11.440420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-3f6cb775-3ebf-419c-881f-933d9bd71bc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lazy-loading 'flavor' on Instance uuid eac15523-1339-4320-b680-25b9841be7f5 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:19:11.457388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a02f606c-2af1-43b5-9648-4bd21e33abe2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:19:11.575648 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3f6cb775-3ebf-419c-881f-933d9bd71bc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "POST /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5/action" status: 200 len: 32 microversion: 2.1 time: 0.242858 Aug 04 14:19:11.578376 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2206/4401] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:11 2022] POST /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:19:11.593219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cecf8c6a-0770-4384-92ee-cc52d1c288b9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:11.595752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cecf8c6a-0770-4384-92ee-cc52d1c288b9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:11.616146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-0770-4384-92ee-cc52d1c288b9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.617508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-0770-4384-92ee-cc52d1c288b9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.619333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-0770-4384-92ee-cc52d1c288b9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.622088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cecf8c6a-0770-4384-92ee-cc52d1c288b9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.639456 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a02f606c-2af1-43b5-9648-4bd21e33abe2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 204 len: 0 microversion: 2.42 time: 0.470555 Aug 04 14:19:11.640671 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2196/4402] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:19:11 2022] DELETE /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:19:11.653064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-912301b1-dee6-4335-a2b7-8a5f927b90b1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:11.656535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-912301b1-dee6-4335-a2b7-8a5f927b90b1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:11.676166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-912301b1-dee6-4335-a2b7-8a5f927b90b1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.676732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-912301b1-dee6-4335-a2b7-8a5f927b90b1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.677735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-912301b1-dee6-4335-a2b7-8a5f927b90b1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.678589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-912301b1-dee6-4335-a2b7-8a5f927b90b1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.943785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cecf8c6a-0770-4384-92ee-cc52d1c288b9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:11.961176 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cecf8c6a-0770-4384-92ee-cc52d1c288b9 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.378324 Aug 04 14:19:11.962048 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2207/4403] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:11 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:11.983692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5cced570-5287-4b83-902c-fdc5ac4d8095 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:11.984629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5cced570-5287-4b83-902c-fdc5ac4d8095 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:11.994938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cced570-5287-4b83-902c-fdc5ac4d8095 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.995708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cced570-5287-4b83-902c-fdc5ac4d8095 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:11.997153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cced570-5287-4b83-902c-fdc5ac4d8095 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:11.998242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cced570-5287-4b83-902c-fdc5ac4d8095 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:12.295498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5cced570-5287-4b83-902c-fdc5ac4d8095 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:12.315712 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5cced570-5287-4b83-902c-fdc5ac4d8095 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.351202 Aug 04 14:19:12.317009 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2208/4404] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:11 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:12.326318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:12.328063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:12.343294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:12.344822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:12.346728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:12.347915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:12.668941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:12.689868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:12.693928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:12.696270 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62ae1d52-2890-4f73-819c-f12873c75950 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 2961 microversion: 2.42 time: 0.376836 Aug 04 14:19:12.697443 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2209/4405] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:12 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 2961 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:12.712326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9ad2a2af-e3b4-4ff7-a531-a67177b4a968 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:12.715677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9ad2a2af-e3b4-4ff7-a531-a67177b4a968 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:12.733723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ad2a2af-e3b4-4ff7-a531-a67177b4a968 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:12.734534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ad2a2af-e3b4-4ff7-a531-a67177b4a968 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:12.736533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ad2a2af-e3b4-4ff7-a531-a67177b4a968 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:12.737373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ad2a2af-e3b4-4ff7-a531-a67177b4a968 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:12.988656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ad2a2af-e3b4-4ff7-a531-a67177b4a968 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:13.008490 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9ad2a2af-e3b4-4ff7-a531-a67177b4a968 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.307887 Aug 04 14:19:13.009132 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2210/4406] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:12 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:13.023975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-395cb61c-e31f-4c11-ac48-bf211e4738ae tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:13.025231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-395cb61c-e31f-4c11-ac48-bf211e4738ae tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:13.034097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-395cb61c-e31f-4c11-ac48-bf211e4738ae tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.034560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-395cb61c-e31f-4c11-ac48-bf211e4738ae tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.035366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-395cb61c-e31f-4c11-ac48-bf211e4738ae tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.035803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-395cb61c-e31f-4c11-ac48-bf211e4738ae tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.274356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-395cb61c-e31f-4c11-ac48-bf211e4738ae tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:13.292780 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-395cb61c-e31f-4c11-ac48-bf211e4738ae tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.280261 Aug 04 14:19:13.294749 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2211/4407] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:13 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:13.304542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:13.305956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:13.325079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.326056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.327789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.328824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.554513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:13.572339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:13.575389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:13.577548 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8d3b7eda-83eb-4fe7-9037-eb041c40fe47 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1407 microversion: 2.20 time: 0.280894 Aug 04 14:19:13.579942 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2212/4408] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:13 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:13.591157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43ce6299-5d90-498e-be57-432802292f61 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:13.592359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-43ce6299-5d90-498e-be57-432802292f61 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:13.610035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43ce6299-5d90-498e-be57-432802292f61 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.611498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43ce6299-5d90-498e-be57-432802292f61 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.613294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43ce6299-5d90-498e-be57-432802292f61 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.614219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-43ce6299-5d90-498e-be57-432802292f61 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.743285 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-912301b1-dee6-4335-a2b7-8a5f927b90b1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action" status: 200 len: 16401 microversion: 2.1 time: 2.099854 Aug 04 14:19:13.745196 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2197/4409] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:11 2022] POST /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9/action => generated 16401 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:19:13.756175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2ed675d6-a683-4e66-b133-e07c21a141a0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1523822133", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2ed675d6-a683-4e66-b133-e07c21a141a0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 235 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1523822133", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1523822133', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:13.770361 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 14:19:13.778884 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:13.783931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2ed675d6-a683-4e66-b133-e07c21a141a0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:13.785439 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2ed675d6-a683-4e66-b133-e07c21a141a0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.038397 Aug 04 14:19:13.786200 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2198/4410] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:19:13 2022] POST /compute/v2.1/servers => generated 133 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:19:13.795894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f08d888a-3b0c-4de2-93ea-335bc549a2bf req-2ed7cddd-69af-4234-b2b4-d287e1ce34fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d980c4-8034-4898-83d5-bcc0ad62a973", "tag": "10153aad-a7c0-4ba3-ae0d-2844ce1198a3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:13.814469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:13.838464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f08d888a-3b0c-4de2-93ea-335bc549a2bf req-2ed7cddd-69af-4234-b2b4-d287e1ce34fa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.839211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f08d888a-3b0c-4de2-93ea-335bc549a2bf req-2ed7cddd-69af-4234-b2b4-d287e1ce34fa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.847399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-43ce6299-5d90-498e-be57-432802292f61 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:13.856706 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-43ce6299-5d90-498e-be57-432802292f61 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.274599 Aug 04 14:19:13.858278 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2213/4411] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:13 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:13.864105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:13.864819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:13.873140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.873790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.874715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.875264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.894532 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f08d888a-3b0c-4de2-93ea-335bc549a2bf req-2ed7cddd-69af-4234-b2b4-d287e1ce34fa service nova] Creating event network-changed:10153aad-a7c0-4ba3-ae0d-2844ce1198a3 for instance 44d980c4-8034-4898-83d5-bcc0ad62a973 on n-h1-844627-10 Aug 04 14:19:13.905350 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f08d888a-3b0c-4de2-93ea-335bc549a2bf req-2ed7cddd-69af-4234-b2b4-d287e1ce34fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116709 Aug 04 14:19:13.907911 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2199/4412] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:13.920339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a12b96a3-5f6b-430e-b9cf-4422802814ff tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:13.922018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a12b96a3-5f6b-430e-b9cf-4422802814ff tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:13.933810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a12b96a3-5f6b-430e-b9cf-4422802814ff tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.934995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a12b96a3-5f6b-430e-b9cf-4422802814ff tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:13.937763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a12b96a3-5f6b-430e-b9cf-4422802814ff tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:13.939394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a12b96a3-5f6b-430e-b9cf-4422802814ff tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:14.317336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:14.325291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a12b96a3-5f6b-430e-b9cf-4422802814ff tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:14.336892 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a12b96a3-5f6b-430e-b9cf-4422802814ff tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.426363 Aug 04 14:19:14.338931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:14.344129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:14.347173 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-afde911a-2c12-4c9e-9e42-3ccb1ed88d5c tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 2961 microversion: 2.42 time: 0.487257 Aug 04 14:19:14.349895 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2200/4413] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:13 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:14.361091 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2214/4414] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:13 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 2961 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:14.389977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-711b06f1-9e3e-4d61-a404-043179ea84be tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:14.389977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-711b06f1-9e3e-4d61-a404-043179ea84be tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:14.400049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0319c8c1-14f9-47d5-a0ef-00ed9b615caa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:14.401673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0319c8c1-14f9-47d5-a0ef-00ed9b615caa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:14.403402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-711b06f1-9e3e-4d61-a404-043179ea84be tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:14.405277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-711b06f1-9e3e-4d61-a404-043179ea84be tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:14.407859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-711b06f1-9e3e-4d61-a404-043179ea84be tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:14.409021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-711b06f1-9e3e-4d61-a404-043179ea84be tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:14.419425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0319c8c1-14f9-47d5-a0ef-00ed9b615caa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:14.421843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0319c8c1-14f9-47d5-a0ef-00ed9b615caa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:14.423622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0319c8c1-14f9-47d5-a0ef-00ed9b615caa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:14.424447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0319c8c1-14f9-47d5-a0ef-00ed9b615caa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:14.656643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0319c8c1-14f9-47d5-a0ef-00ed9b615caa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:14.670516 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0319c8c1-14f9-47d5-a0ef-00ed9b615caa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.318672 Aug 04 14:19:14.672090 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2201/4415] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:14 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:14.674854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-711b06f1-9e3e-4d61-a404-043179ea84be tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:14.685704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64cd01e1-b203-42dd-9871-0ea08e63cc16 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:14.686702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-64cd01e1-b203-42dd-9871-0ea08e63cc16 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:14.688917 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-711b06f1-9e3e-4d61-a404-043179ea84be tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.325680 Aug 04 14:19:14.691065 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2215/4416] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:14 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:14.697531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64cd01e1-b203-42dd-9871-0ea08e63cc16 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:14.697998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64cd01e1-b203-42dd-9871-0ea08e63cc16 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:14.698810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64cd01e1-b203-42dd-9871-0ea08e63cc16 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:14.699264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64cd01e1-b203-42dd-9871-0ea08e63cc16 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:14.703232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:14.705297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:14.718745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:14.719988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:14.721416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:14.722159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.045433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-64cd01e1-b203-42dd-9871-0ea08e63cc16 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.057532 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-64cd01e1-b203-42dd-9871-0ea08e63cc16 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.383184 Aug 04 14:19:15.072961 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2202/4417] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:14 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:15.081216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.081615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55d25af7-dfaf-4c57-9ac7-8395d00cb822 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:15.082356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55d25af7-dfaf-4c57-9ac7-8395d00cb822 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:15.098693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55d25af7-dfaf-4c57-9ac7-8395d00cb822 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.101817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55d25af7-dfaf-4c57-9ac7-8395d00cb822 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.102124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.103567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.104919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55d25af7-dfaf-4c57-9ac7-8395d00cb822 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.105367 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-000d5954-6cb0-4cf8-add7-57ea9a81222a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1407 microversion: 2.20 time: 0.412239 Aug 04 14:19:15.105805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55d25af7-dfaf-4c57-9ac7-8395d00cb822 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.106463 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2216/4418] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:14 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:15.112693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-004e283c-a904-4fe6-9207-b3c6296c9ad8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:15.113408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-004e283c-a904-4fe6-9207-b3c6296c9ad8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:15.122820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-004e283c-a904-4fe6-9207-b3c6296c9ad8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.123533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-004e283c-a904-4fe6-9207-b3c6296c9ad8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.124820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-004e283c-a904-4fe6-9207-b3c6296c9ad8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.125589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-004e283c-a904-4fe6-9207-b3c6296c9ad8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.422323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-55d25af7-dfaf-4c57-9ac7-8395d00cb822 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.426406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-004e283c-a904-4fe6-9207-b3c6296c9ad8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.430828 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55d25af7-dfaf-4c57-9ac7-8395d00cb822 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.365062 Aug 04 14:19:15.431429 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2203/4419] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:15 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:15.436226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-182d0b75-a2f0-4afb-9111-7798b1a10108 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:15.436861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-182d0b75-a2f0-4afb-9111-7798b1a10108 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:15.451867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-182d0b75-a2f0-4afb-9111-7798b1a10108 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.453260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-182d0b75-a2f0-4afb-9111-7798b1a10108 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.455362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-182d0b75-a2f0-4afb-9111-7798b1a10108 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.456006 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-004e283c-a904-4fe6-9207-b3c6296c9ad8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.348067 Aug 04 14:19:15.468907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-182d0b75-a2f0-4afb-9111-7798b1a10108 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.469145 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2217/4420] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:15 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:15.469145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:15.469145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:15.479987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.479987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.479987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.479987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.747619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-182d0b75-a2f0-4afb-9111-7798b1a10108 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.765230 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-182d0b75-a2f0-4afb-9111-7798b1a10108 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.332632 Aug 04 14:19:15.766196 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2204/4421] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:15 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:15.785858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-364693c4-c54d-491d-be9c-95c65a2cf985 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:15.786765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-364693c4-c54d-491d-be9c-95c65a2cf985 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: d2318201-3c64-42ad-a0b5-8cb6296f2e14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:15.801306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.811694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.813419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:15.814849 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae916321-4c6f-4250-bc5e-33f08e4ae9ec tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 2961 microversion: 2.42 time: 0.356833 Aug 04 14:19:15.815481 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2218/4422] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:15 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 2961 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:15.817349 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-364693c4-c54d-491d-be9c-95c65a2cf985 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance d2318201-3c64-42ad-a0b5-8cb6296f2e14 could not be found. Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-364693c4-c54d-491d-be9c-95c65a2cf985 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/d2318201-3c64-42ad-a0b5-8cb6296f2e14/action HTTP/1.1 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 13 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: {"pause": {}} Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d2318201-3c64-42ad-a0b5-8cb6296f2e14 could not be found. Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd2318201-3c64-42ad-a0b5-8cb6296f2e14', 'body': {'pause': {}}} Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2318201-3c64-42ad-a0b5-8cb6296f2e14 could not be found. Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2318201-3c64-42ad-a0b5-8cb6296f2e14 could not be found. Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:15.822133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:15.826117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:15.826117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:15.826117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2318201-3c64-42ad-a0b5-8cb6296f2e14 could not be found. Aug 04 14:19:15.826117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:15.826117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-364693c4-c54d-491d-be9c-95c65a2cf985 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance d2318201-3c64-42ad-a0b5-8cb6296f2e14 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:15.826117 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-364693c4-c54d-491d-be9c-95c65a2cf985 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/d2318201-3c64-42ad-a0b5-8cb6296f2e14/action" status: 404 len: 111 microversion: 2.1 time: 0.043526 Aug 04 14:19:15.828543 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2205/4423] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:15 2022] POST /compute/v2.1/servers/d2318201-3c64-42ad-a0b5-8cb6296f2e14/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:15.832791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-531871bc-16bd-4a10-92e3-33f6ccc2125b tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:15.836744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-531871bc-16bd-4a10-92e3-33f6ccc2125b tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:15.837396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e37775b5-4c12-42fa-8bfe-d7fba61c2a69 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:15.838030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e37775b5-4c12-42fa-8bfe-d7fba61c2a69 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:15.845671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-531871bc-16bd-4a10-92e3-33f6ccc2125b tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.846290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-531871bc-16bd-4a10-92e3-33f6ccc2125b tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.847617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-531871bc-16bd-4a10-92e3-33f6ccc2125b tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.848435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-531871bc-16bd-4a10-92e3-33f6ccc2125b tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.856118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e37775b5-4c12-42fa-8bfe-d7fba61c2a69 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.857166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e37775b5-4c12-42fa-8bfe-d7fba61c2a69 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:15.858059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e37775b5-4c12-42fa-8bfe-d7fba61c2a69 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:15.858525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e37775b5-4c12-42fa-8bfe-d7fba61c2a69 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.130102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-531871bc-16bd-4a10-92e3-33f6ccc2125b tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:16.165592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-531871bc-16bd-4a10-92e3-33f6ccc2125b tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.347013 Aug 04 14:19:16.182331 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2219/4424] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:15 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:16.199290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e37775b5-4c12-42fa-8bfe-d7fba61c2a69 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:16.209158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6beed72c-0780-47e9-8151-f5d0c2e75307 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:16.210381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6beed72c-0780-47e9-8151-f5d0c2e75307 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:16.215113 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e37775b5-4c12-42fa-8bfe-d7fba61c2a69 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.384542 Aug 04 14:19:16.216977 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2206/4425] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:15 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:16.223611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:16.224360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:16.233252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.233851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.235668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.236221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.254758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6beed72c-0780-47e9-8151-f5d0c2e75307 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.255987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6beed72c-0780-47e9-8151-f5d0c2e75307 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.257958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6beed72c-0780-47e9-8151-f5d0c2e75307 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.259131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6beed72c-0780-47e9-8151-f5d0c2e75307 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.636243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:16.647833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6beed72c-0780-47e9-8151-f5d0c2e75307 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:16.658017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:16.663046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:16.666362 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2847e311-bb30-4bc8-bd97-4a9fc07fa01e tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1407 microversion: 2.20 time: 0.446613 Aug 04 14:19:16.668897 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2207/4426] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:16 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:16.675399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7ae996f4-7e06-43e3-83b4-8ffa2161b6dd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:16.676268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7ae996f4-7e06-43e3-83b4-8ffa2161b6dd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:16.685337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ae996f4-7e06-43e3-83b4-8ffa2161b6dd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.686064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ae996f4-7e06-43e3-83b4-8ffa2161b6dd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.687386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ae996f4-7e06-43e3-83b4-8ffa2161b6dd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.688751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7ae996f4-7e06-43e3-83b4-8ffa2161b6dd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.696617 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6beed72c-0780-47e9-8151-f5d0c2e75307 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.512254 Aug 04 14:19:16.700718 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2220/4427] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:16 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:16.712066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dbb562ca-c75c-4d08-b541-872ed8715e09 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:16.713964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dbb562ca-c75c-4d08-b541-872ed8715e09 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:16.723463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbb562ca-c75c-4d08-b541-872ed8715e09 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.724272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbb562ca-c75c-4d08-b541-872ed8715e09 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.726542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbb562ca-c75c-4d08-b541-872ed8715e09 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.728242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbb562ca-c75c-4d08-b541-872ed8715e09 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.738824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:16.836232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7ae996f4-7e06-43e3-83b4-8ffa2161b6dd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Locking {{(pid=130961) lock /opt/stack/nova/nova/compute/api.py:4781}} Aug 04 14:19:16.922789 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7ae996f4-7e06-43e3-83b4-8ffa2161b6dd tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.251830 Aug 04 14:19:16.927803 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2208/4428] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:16 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:16.937780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08dcf963-c6be-4cee-abed-50f8aefdb059 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:16.939920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-08dcf963-c6be-4cee-abed-50f8aefdb059 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:16.948582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08dcf963-c6be-4cee-abed-50f8aefdb059 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.949376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08dcf963-c6be-4cee-abed-50f8aefdb059 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.950569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08dcf963-c6be-4cee-abed-50f8aefdb059 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.951258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08dcf963-c6be-4cee-abed-50f8aefdb059 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.956679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dbb562ca-c75c-4d08-b541-872ed8715e09 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:16.965919 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dbb562ca-c75c-4d08-b541-872ed8715e09 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.262650 Aug 04 14:19:16.967305 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2221/4429] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:16 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:16.973564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:16.974486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:16.994896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.995754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:16.997230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:16.998355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:17.349271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08dcf963-c6be-4cee-abed-50f8aefdb059 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:17.363936 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08dcf963-c6be-4cee-abed-50f8aefdb059 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.430588 Aug 04 14:19:17.365292 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2209/4430] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:16 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:17.386569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-650df8b4-20b2-4e85-9c45-795294ca768e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:17.387224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-650df8b4-20b2-4e85-9c45-795294ca768e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:17.406372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-650df8b4-20b2-4e85-9c45-795294ca768e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:17.409195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-650df8b4-20b2-4e85-9c45-795294ca768e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:17.410020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-650df8b4-20b2-4e85-9c45-795294ca768e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:17.415754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-650df8b4-20b2-4e85-9c45-795294ca768e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:17.421105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:17.422879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:17.473222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:17.478140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:17.485286 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7949dbb2-6418-4b0a-86a2-b89acd06ba5d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 2919 microversion: 2.42 time: 0.515915 Aug 04 14:19:17.502434 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2222/4431] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:16 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 2919 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:17.533938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6768c6dd-2f46-4436-8ea0-63c58255f32d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:17.535129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6768c6dd-2f46-4436-8ea0-63c58255f32d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:17.566962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6768c6dd-2f46-4436-8ea0-63c58255f32d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:17.567891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6768c6dd-2f46-4436-8ea0-63c58255f32d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:17.578085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6768c6dd-2f46-4436-8ea0-63c58255f32d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:17.578942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6768c6dd-2f46-4436-8ea0-63c58255f32d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:17.778134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:17.817392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-650df8b4-20b2-4e85-9c45-795294ca768e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:17.838771 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-650df8b4-20b2-4e85-9c45-795294ca768e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.458223 Aug 04 14:19:17.839803 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2210/4432] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:17 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:17.853989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=10 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:17.867993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-209b345d-d3e2-4d47-8fd2-b313ced66b51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:17.869953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-209b345d-d3e2-4d47-8fd2-b313ced66b51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:17.886397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-209b345d-d3e2-4d47-8fd2-b313ced66b51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:17.887468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-209b345d-d3e2-4d47-8fd2-b313ced66b51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:17.889604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-209b345d-d3e2-4d47-8fd2-b313ced66b51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:17.891993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-209b345d-d3e2-4d47-8fd2-b313ced66b51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:17.962483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6768c6dd-2f46-4436-8ea0-63c58255f32d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:17.973998 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6768c6dd-2f46-4436-8ea0-63c58255f32d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.469529 Aug 04 14:19:17.974873 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2223/4433] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:17 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:18.045625 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-209b345d-d3e2-4d47-8fd2-b313ced66b51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 202 len: 0 microversion: 2.1 time: 0.190187 Aug 04 14:19:18.048335 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2211/4434] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:17 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:18.094587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:18.118540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:18.178697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3d31ad18-cc86-478e-9540-9e390a1400e7 req-81f3ae78-13e5-4148-8f55-672d082a6be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-unplugged", "status": "completed", "tag": "2929d1af-7745-46e1-b7dd-8c5635506a57"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:18.179352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:18.181950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:18.185831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:18.187356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:18.231900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3d31ad18-cc86-478e-9540-9e390a1400e7 req-81f3ae78-13e5-4148-8f55-672d082a6be2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:18.233648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3d31ad18-cc86-478e-9540-9e390a1400e7 req-81f3ae78-13e5-4148-8f55-672d082a6be2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:18.269201 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3d31ad18-cc86-478e-9540-9e390a1400e7 req-81f3ae78-13e5-4148-8f55-672d082a6be2 service nova] Creating event network-vif-unplugged:2929d1af-7745-46e1-b7dd-8c5635506a57 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:18.282887 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3d31ad18-cc86-478e-9540-9e390a1400e7 req-81f3ae78-13e5-4148-8f55-672d082a6be2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.304581 Aug 04 14:19:18.287277 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2224/4435] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:18.296649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06555b06-5e38-40f9-8064-afb210e58707 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:18.339109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06555b06-5e38-40f9-8064-afb210e58707 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:18.339622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06555b06-5e38-40f9-8064-afb210e58707 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:18.396783 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-06555b06-5e38-40f9-8064-afb210e58707 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] HTTP exception thrown: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b is locked Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06555b06-5e38-40f9-8064-afb210e58707 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Request method failure captured: Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action HTTP/1.1 Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 15 Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69PdQ6CdUQxNSy7TkA4fBGjPoslvq7Ft85Pm1SsCCTmFUUA03IvGoXACFxjT0F4hgNK860bOV6Gr03a6EeVgBEsLZ4N2k5i2V30HcZSbG5Ve4RZWPCMWlwkc_zt54N8YIO0cwDQj8IvSMG3SP6RPiuzPKHKqgqT6_uqL9iRVucAGG6I Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}] Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-748027196 Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: fab9d445099545e98979afa009678007 Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: {"os-stop": {}} Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b is locked Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '11f82140-ff26-411a-8d4f-eb49f24bc20b', 'body': {'os-stop': {}}} Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b is locked Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b is locked Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b is locked Aug 04 14:19:18.400492 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:18.411056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06555b06-5e38-40f9-8064-afb210e58707 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Returning 409 to user: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b is locked {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:18.421273 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-06555b06-5e38-40f9-8064-afb210e58707 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 409 len: 107 microversion: 2.1 time: 0.129106 Aug 04 14:19:18.424567 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2225/4436] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:18 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 107 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:19:18.442717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2d03de4-f669-44b4-b5a7-9ea904b88e4d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:18.444635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e2d03de4-f669-44b4-b5a7-9ea904b88e4d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:18.489822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2d03de4-f669-44b4-b5a7-9ea904b88e4d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:18.491566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2d03de4-f669-44b4-b5a7-9ea904b88e4d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:18.496918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2d03de4-f669-44b4-b5a7-9ea904b88e4d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:18.498395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2d03de4-f669-44b4-b5a7-9ea904b88e4d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:18.523767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:18.624189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:18.693240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:18.713258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:18.738037 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-091f2a9e-4f65-4e26-a674-461e5de5a5a3 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1407 microversion: 2.20 time: 0.676260 Aug 04 14:19:18.756919 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2212/4437] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:18 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1407 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:18.784392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c4844c08-3786-423c-8ba7-07b00a3ecc94 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:18.785942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c4844c08-3786-423c-8ba7-07b00a3ecc94 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:18.823661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4844c08-3786-423c-8ba7-07b00a3ecc94 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:18.824397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4844c08-3786-423c-8ba7-07b00a3ecc94 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:18.825929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4844c08-3786-423c-8ba7-07b00a3ecc94 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:18.826761 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4844c08-3786-423c-8ba7-07b00a3ecc94 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:19.114154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e2d03de4-f669-44b4-b5a7-9ea904b88e4d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:19.137444 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e2d03de4-f669-44b4-b5a7-9ea904b88e4d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.710699 Aug 04 14:19:19.139268 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2226/4438] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:18 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:19.159540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b4bc1bc8-cd51-4241-a62f-c940c8360f1a req-3da432be-9800-4262-b319-e7c94e394a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-deleted", "tag": "2929d1af-7745-46e1-b7dd-8c5635506a57"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:19.204433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b4bc1bc8-cd51-4241-a62f-c940c8360f1a req-3da432be-9800-4262-b319-e7c94e394a47 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:19.205269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b4bc1bc8-cd51-4241-a62f-c940c8360f1a req-3da432be-9800-4262-b319-e7c94e394a47 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:19.231359 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b4bc1bc8-cd51-4241-a62f-c940c8360f1a req-3da432be-9800-4262-b319-e7c94e394a47 service nova] Creating event network-vif-deleted:2929d1af-7745-46e1-b7dd-8c5635506a57 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:19.242536 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b4bc1bc8-cd51-4241-a62f-c940c8360f1a req-3da432be-9800-4262-b319-e7c94e394a47 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101157 Aug 04 14:19:19.244919 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2227/4439] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:19.258051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9804902a-20b5-4849-a888-ef2584fa51c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:19.258294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9804902a-20b5-4849-a888-ef2584fa51c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:19.272595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9804902a-20b5-4849-a888-ef2584fa51c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:19.273117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9804902a-20b5-4849-a888-ef2584fa51c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:19.274788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9804902a-20b5-4849-a888-ef2584fa51c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:19.275586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9804902a-20b5-4849-a888-ef2584fa51c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:19.398062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9804902a-20b5-4849-a888-ef2584fa51c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Unlocking {{(pid=130960) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 04 14:19:19.403373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c4844c08-3786-423c-8ba7-07b00a3ecc94 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:19.436588 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c4844c08-3786-423c-8ba7-07b00a3ecc94 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1490 microversion: 2.1 time: 0.692907 Aug 04 14:19:19.452563 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2213/4440] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:18 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1490 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:19.453505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:19.455517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:19.475669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:19.476079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:19.478610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:19.479838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:19.588494 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9804902a-20b5-4849-a888-ef2584fa51c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.338098 Aug 04 14:19:19.590286 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2228/4441] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:19 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:19.598614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3254e2a6-3de7-4503-b0be-6e5301155933 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:19.599814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3254e2a6-3de7-4503-b0be-6e5301155933 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:19.614899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3254e2a6-3de7-4503-b0be-6e5301155933 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:19.617002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3254e2a6-3de7-4503-b0be-6e5301155933 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:19.618138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3254e2a6-3de7-4503-b0be-6e5301155933 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:19.618889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3254e2a6-3de7-4503-b0be-6e5301155933 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:19.864104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:19.897940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:19.903211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:19.911000 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49eedcd9-b747-4054-8ab3-bf3c34560e3e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 2711 microversion: 2.42 time: 0.470307 Aug 04 14:19:19.916170 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2214/4442] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:19 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 2711 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:19.926096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:19.938828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:19.957708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:19.971389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:19.973547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:19.974681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:20.061617 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Cannot 'pause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state paused Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action HTTP/1.1 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 13 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: {"pause": {}} Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: exception: Cannot 'pause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state paused Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d', 'body': {'pause': {}}} Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9c416741-016d-4f02-9a57-507f0454876d in vm_state paused. Cannot pause while the instance is in this state. Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state paused Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:20.066036 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:20.074760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:20.074760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:20.074760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:20.074760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state paused Aug 04 14:19:20.074760 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:20.078159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 409 to user: Cannot 'pause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state paused {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:20.085975 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0eecc170-b4d3-4ffa-9f1f-bac062af4f1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 409 len: 143 microversion: 2.1 time: 0.161815 Aug 04 14:19:20.087573 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2215/4443] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:19 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 143 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:19:20.107874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a3666a8-cae8-4cb1-a154-25d57a6ecd12 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:20.164628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3254e2a6-3de7-4503-b0be-6e5301155933 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:20.185305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a3666a8-cae8-4cb1-a154-25d57a6ecd12 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:20.186308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a3666a8-cae8-4cb1-a154-25d57a6ecd12 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.050s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:20.223265 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3254e2a6-3de7-4503-b0be-6e5301155933 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.631150 Aug 04 14:19:20.233251 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2229/4444] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:19 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:20.253157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:20.257429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:20.307884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9a3666a8-cae8-4cb1-a154-25d57a6ecd12 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Going to try to stop instance {{(pid=130961) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 14:19:20.318204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:20.319454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:20.324581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:20.327781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:20.435801 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a3666a8-cae8-4cb1-a154-25d57a6ecd12 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.345849 Aug 04 14:19:20.442031 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2216/4445] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:20 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:20.460380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d70efb6-f404-4b45-a2c4-4074d9a5c3f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:20.462065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6d70efb6-f404-4b45-a2c4-4074d9a5c3f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:20.474738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d70efb6-f404-4b45-a2c4-4074d9a5c3f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:20.476109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d70efb6-f404-4b45-a2c4-4074d9a5c3f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:20.478041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d70efb6-f404-4b45-a2c4-4074d9a5c3f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:20.479464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d70efb6-f404-4b45-a2c4-4074d9a5c3f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:20.621549 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d70efb6-f404-4b45-a2c4-4074d9a5c3f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 202 len: 0 microversion: 2.1 time: 0.177058 Aug 04 14:19:20.627087 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2217/4446] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:20 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:20.660326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1ce99521-d7a7-4bb4-8797-40b1ee0fd546 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:20.663607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1ce99521-d7a7-4bb4-8797-40b1ee0fd546 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:20.685562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ce99521-d7a7-4bb4-8797-40b1ee0fd546 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:20.686462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ce99521-d7a7-4bb4-8797-40b1ee0fd546 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:20.687493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ce99521-d7a7-4bb4-8797-40b1ee0fd546 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:20.688648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ce99521-d7a7-4bb4-8797-40b1ee0fd546 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:20.894498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:20.924234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:20.951366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:20.955234 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3aca640b-6c7e-4c7f-837e-1e8c4cd30c50 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1407 microversion: 2.20 time: 0.715690 Aug 04 14:19:20.972908 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2230/4447] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:20 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1407 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:20.984272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7c2859f0-a1fe-4855-a705-ccacde765f4c req-febf9936-9c8d-45bf-a7bf-bf78ce0210f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-unplugged", "status": "completed", "tag": "d470b701-7300-4fa0-a043-83ad11cf1a6e"}, {"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-unplugged", "status": "completed", "tag": "66b17b90-0211-4216-98ba-ebedb5d38090"}, {"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-unplugged", "status": "completed", "tag": "c7dc083d-72bd-44a5-a860-49733935c554"}, {"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-unplugged", "status": "completed", "tag": "33360f7e-a160-4b97-8979-cdcad2ec3c38"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:20.984587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1ce99521-d7a7-4bb4-8797-40b1ee0fd546 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:21.026976 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1ce99521-d7a7-4bb4-8797-40b1ee0fd546 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.393623 Aug 04 14:19:21.031129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:21.052914 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2218/4448] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:20 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:21.053248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7c2859f0-a1fe-4855-a705-ccacde765f4c req-febf9936-9c8d-45bf-a7bf-bf78ce0210f3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:21.053248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7c2859f0-a1fe-4855-a705-ccacde765f4c req-febf9936-9c8d-45bf-a7bf-bf78ce0210f3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:21.060288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-026efe9b-8e25-4420-8576-b41ae97d2551 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:21.061825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-026efe9b-8e25-4420-8576-b41ae97d2551 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:21.090611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-026efe9b-8e25-4420-8576-b41ae97d2551 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:21.092089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-026efe9b-8e25-4420-8576-b41ae97d2551 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:21.093907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-026efe9b-8e25-4420-8576-b41ae97d2551 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:21.095300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-026efe9b-8e25-4420-8576-b41ae97d2551 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:21.128059 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7c2859f0-a1fe-4855-a705-ccacde765f4c req-febf9936-9c8d-45bf-a7bf-bf78ce0210f3 service nova] Creating event network-vif-unplugged:d470b701-7300-4fa0-a043-83ad11cf1a6e for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:21.129394 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7c2859f0-a1fe-4855-a705-ccacde765f4c req-febf9936-9c8d-45bf-a7bf-bf78ce0210f3 service nova] Creating event network-vif-unplugged:66b17b90-0211-4216-98ba-ebedb5d38090 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:21.132018 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7c2859f0-a1fe-4855-a705-ccacde765f4c req-febf9936-9c8d-45bf-a7bf-bf78ce0210f3 service nova] Creating event network-vif-unplugged:c7dc083d-72bd-44a5-a860-49733935c554 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:21.133456 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7c2859f0-a1fe-4855-a705-ccacde765f4c req-febf9936-9c8d-45bf-a7bf-bf78ce0210f3 service nova] Creating event network-vif-unplugged:33360f7e-a160-4b97-8979-cdcad2ec3c38 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:21.160370 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7c2859f0-a1fe-4855-a705-ccacde765f4c req-febf9936-9c8d-45bf-a7bf-bf78ce0210f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.191095 Aug 04 14:19:21.184580 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2231/4449] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:21.228339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88f0f027-1cc3-43b7-bf5e-7bfbdf58f375 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:21.231147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-88f0f027-1cc3-43b7-bf5e-7bfbdf58f375 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:21.243759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88f0f027-1cc3-43b7-bf5e-7bfbdf58f375 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:21.244577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88f0f027-1cc3-43b7-bf5e-7bfbdf58f375 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:21.246095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88f0f027-1cc3-43b7-bf5e-7bfbdf58f375 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:21.246960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88f0f027-1cc3-43b7-bf5e-7bfbdf58f375 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:21.660764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-88f0f027-1cc3-43b7-bf5e-7bfbdf58f375 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:21.702669 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-88f0f027-1cc3-43b7-bf5e-7bfbdf58f375 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.506005 Aug 04 14:19:21.706565 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2232/4450] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:21 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:21.722206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:21.732585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:21.762550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:21.763752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:21.768262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:21.786486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:21.801101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-026efe9b-8e25-4420-8576-b41ae97d2551 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:21.830291 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-026efe9b-8e25-4420-8576-b41ae97d2551 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.793567 Aug 04 14:19:21.832289 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2219/4451] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:21 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:21.838155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70dc1f7a-2007-4f16-99e3-5bb428b1432c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:21.839054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70dc1f7a-2007-4f16-99e3-5bb428b1432c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:21.847026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70dc1f7a-2007-4f16-99e3-5bb428b1432c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:21.847801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70dc1f7a-2007-4f16-99e3-5bb428b1432c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:21.848853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70dc1f7a-2007-4f16-99e3-5bb428b1432c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:21.849697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70dc1f7a-2007-4f16-99e3-5bb428b1432c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:22.252443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:22.265399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-70dc1f7a-2007-4f16-99e3-5bb428b1432c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:22.276606 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70dc1f7a-2007-4f16-99e3-5bb428b1432c tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.442756 Aug 04 14:19:22.281033 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2220/4452] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:21 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:22.282652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:22.284848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:22.291879 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-51dd9ec1-edbd-49eb-a469-34ea6996bd86 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 2617 microversion: 2.42 time: 0.583356 Aug 04 14:19:22.293631 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2233/4453] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:21 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 2617 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:22.295533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b73bd858-c8f9-4ce9-9314-3fea8da9f5f1 req-009d1748-1115-4021-9dd9-ed3acfe8db05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-deleted", "tag": "d470b701-7300-4fa0-a043-83ad11cf1a6e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:22.303537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-87b661a6-8835-4533-b119-30634fbcbf51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:22.306280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-87b661a6-8835-4533-b119-30634fbcbf51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:22.317760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b73bd858-c8f9-4ce9-9314-3fea8da9f5f1 req-009d1748-1115-4021-9dd9-ed3acfe8db05 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:22.323127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b73bd858-c8f9-4ce9-9314-3fea8da9f5f1 req-009d1748-1115-4021-9dd9-ed3acfe8db05 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:22.328455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87b661a6-8835-4533-b119-30634fbcbf51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:22.330056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87b661a6-8835-4533-b119-30634fbcbf51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:22.331476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87b661a6-8835-4533-b119-30634fbcbf51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:22.332196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87b661a6-8835-4533-b119-30634fbcbf51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:22.374378 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b73bd858-c8f9-4ce9-9314-3fea8da9f5f1 req-009d1748-1115-4021-9dd9-ed3acfe8db05 service nova] Creating event network-vif-deleted:d470b701-7300-4fa0-a043-83ad11cf1a6e for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:22.386091 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b73bd858-c8f9-4ce9-9314-3fea8da9f5f1 req-009d1748-1115-4021-9dd9-ed3acfe8db05 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099349 Aug 04 14:19:22.387698 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2221/4454] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:22.420501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:22.426363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:22.442804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:22.446551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:22.448560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:22.449843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:22.961312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-87b661a6-8835-4533-b119-30634fbcbf51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:22.974956 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-87b661a6-8835-4533-b119-30634fbcbf51 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.679829 Aug 04 14:19:22.979150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2234/4455] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:22 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:23.001376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a782eaf8-1f8e-4cdc-87ab-ad961f6a0a1d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:23.002768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a782eaf8-1f8e-4cdc-87ab-ad961f6a0a1d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:23.017737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a782eaf8-1f8e-4cdc-87ab-ad961f6a0a1d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.019670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a782eaf8-1f8e-4cdc-87ab-ad961f6a0a1d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.020746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a782eaf8-1f8e-4cdc-87ab-ad961f6a0a1d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.022846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a782eaf8-1f8e-4cdc-87ab-ad961f6a0a1d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.038648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.071343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.095520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.098925 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f40fbedb-15d7-417c-a826-ce47e9b07943 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1407 microversion: 2.20 time: 0.708761 Aug 04 14:19:23.117002 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2222/4456] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:22 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1407 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:23.133579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0c0ace4-318e-47f7-8e9b-b4311a699736 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:23.134270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0c0ace4-318e-47f7-8e9b-b4311a699736 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:23.143272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c0ace4-318e-47f7-8e9b-b4311a699736 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.144075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c0ace4-318e-47f7-8e9b-b4311a699736 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.146066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c0ace4-318e-47f7-8e9b-b4311a699736 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.146945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0c0ace4-318e-47f7-8e9b-b4311a699736 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.362452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a782eaf8-1f8e-4cdc-87ab-ad961f6a0a1d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.372593 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a782eaf8-1f8e-4cdc-87ab-ad961f6a0a1d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.377728 Aug 04 14:19:23.373874 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2235/4457] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:22 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:23.380756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:23.383943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:23.391668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.392388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.393402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.394019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.411618 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896/action HTTP/1.1 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 28 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: {"reboot": {"type": "SOFT"}} Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '3014c326-6c39-41ef-ace6-c0cbe3259896', 'body': {'reboot': {'type': 'SOFT'}}} Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:23.414099 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:23.419201 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:23.420042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f0c0ace4-318e-47f7-8e9b-b4311a699736 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.421448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:23.422591 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-097264d2-cc53-473c-ba3c-7421469cbbc0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896/action" status: 404 len: 111 microversion: 2.1 time: 0.047401 Aug 04 14:19:23.423516 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2236/4458] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:23 2022] POST /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:23.426188 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0c0ace4-318e-47f7-8e9b-b4311a699736 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.306845 Aug 04 14:19:23.429502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-08ad83f8-a448-4014-87c9-122159458962 req-6a82ecf3-05ee-4e23-8034-9e71f96b2c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d980c4-8034-4898-83d5-bcc0ad62a973", "name": "network-vif-plugged", "status": "completed", "tag": "10153aad-a7c0-4ba3-ae0d-2844ce1198a3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:23.440752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-08ad83f8-a448-4014-87c9-122159458962 req-6a82ecf3-05ee-4e23-8034-9e71f96b2c20 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.441549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-08ad83f8-a448-4014-87c9-122159458962 req-6a82ecf3-05ee-4e23-8034-9e71f96b2c20 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.442059 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2223/4459] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:23 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:23.447734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61e84858-575f-4dd5-944c-f5852a406064 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:23.448363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61e84858-575f-4dd5-944c-f5852a406064 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:23.456253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61e84858-575f-4dd5-944c-f5852a406064 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.456716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61e84858-575f-4dd5-944c-f5852a406064 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.457402 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-08ad83f8-a448-4014-87c9-122159458962 req-6a82ecf3-05ee-4e23-8034-9e71f96b2c20 service nova] Creating event network-vif-plugged:10153aad-a7c0-4ba3-ae0d-2844ce1198a3 for instance 44d980c4-8034-4898-83d5-bcc0ad62a973 on n-h1-844627-10 Aug 04 14:19:23.457558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61e84858-575f-4dd5-944c-f5852a406064 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.457977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61e84858-575f-4dd5-944c-f5852a406064 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.463535 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-08ad83f8-a448-4014-87c9-122159458962 req-6a82ecf3-05ee-4e23-8034-9e71f96b2c20 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038425 Aug 04 14:19:23.464326 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2237/4460] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:23.472358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:23.477478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:23.486302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.487125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.488162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.488810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.647763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.662519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:23.668530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.671168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.672618 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-96dba3c5-ce22-40ed-81bc-08baa63db4b1 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 2257 microversion: 2.42 time: 0.206727 Aug 04 14:19:23.673281 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2238/4461] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:23 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 2257 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:23.684974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-548888d4-9c46-4df3-9526-09a946698b84 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:23.684974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-548888d4-9c46-4df3-9526-09a946698b84 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:23.687687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-548888d4-9c46-4df3-9526-09a946698b84 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.694380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-548888d4-9c46-4df3-9526-09a946698b84 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.694380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-548888d4-9c46-4df3-9526-09a946698b84 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:23.694380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-548888d4-9c46-4df3-9526-09a946698b84 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:23.757679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61e84858-575f-4dd5-944c-f5852a406064 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.765822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:23.770154 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61e84858-575f-4dd5-944c-f5852a406064 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.326630 Aug 04 14:19:23.771642 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2224/4462] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:23 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:23.959892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-548888d4-9c46-4df3-9526-09a946698b84 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:23.976250 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-548888d4-9c46-4df3-9526-09a946698b84 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.301459 Aug 04 14:19:23.977668 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2239/4463] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:23 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:24.013981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-107d104a-5196-439d-92bf-521d4765a7e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:24.015063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-107d104a-5196-439d-92bf-521d4765a7e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:24.026991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-107d104a-5196-439d-92bf-521d4765a7e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.027651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-107d104a-5196-439d-92bf-521d4765a7e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.028646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-107d104a-5196-439d-92bf-521d4765a7e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.029336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-107d104a-5196-439d-92bf-521d4765a7e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.155373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:24.158087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:24.171213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.172421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.174065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.174979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.336722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-107d104a-5196-439d-92bf-521d4765a7e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:24.348817 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-107d104a-5196-439d-92bf-521d4765a7e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.339359 Aug 04 14:19:24.365652 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2225/4464] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:24 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:24.371264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72f7c266-a4ad-4ac3-9218-567f2d261420 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:24.374553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-72f7c266-a4ad-4ac3-9218-567f2d261420 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 85207914-1cc7-4b50-998e-aef2012fa492] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:24.382425 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-72f7c266-a4ad-4ac3-9218-567f2d261420 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 85207914-1cc7-4b50-998e-aef2012fa492 could not be found. Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72f7c266-a4ad-4ac3-9218-567f2d261420 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/85207914-1cc7-4b50-998e-aef2012fa492/action HTTP/1.1 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 28 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: {"reboot": {"type": "SOFT"}} Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 85207914-1cc7-4b50-998e-aef2012fa492 could not be found. Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '85207914-1cc7-4b50-998e-aef2012fa492', 'body': {'reboot': {'type': 'SOFT'}}} Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85207914-1cc7-4b50-998e-aef2012fa492 could not be found. Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85207914-1cc7-4b50-998e-aef2012fa492 could not be found. Aug 04 14:19:24.384112 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85207914-1cc7-4b50-998e-aef2012fa492 could not be found. Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72f7c266-a4ad-4ac3-9218-567f2d261420 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 85207914-1cc7-4b50-998e-aef2012fa492 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:24.388033 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-72f7c266-a4ad-4ac3-9218-567f2d261420 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/85207914-1cc7-4b50-998e-aef2012fa492/action" status: 404 len: 111 microversion: 2.1 time: 0.018847 Aug 04 14:19:24.390112 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2226/4465] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:24 2022] POST /compute/v2.1/servers/85207914-1cc7-4b50-998e-aef2012fa492/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:24.395864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0add9e0f-c9ea-4afd-8dc5-0aa7842ab874 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:24.396297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0add9e0f-c9ea-4afd-8dc5-0aa7842ab874 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:24.408228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0add9e0f-c9ea-4afd-8dc5-0aa7842ab874 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.408699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0add9e0f-c9ea-4afd-8dc5-0aa7842ab874 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.409591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0add9e0f-c9ea-4afd-8dc5-0aa7842ab874 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.410081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0add9e0f-c9ea-4afd-8dc5-0aa7842ab874 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.441967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:24.453371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:24.455119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:24.456340 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f86f6537-08ff-4c1b-b6e8-9ccee345aca4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1407 microversion: 2.20 time: 0.317761 Aug 04 14:19:24.456967 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2240/4466] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:24 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:24.462344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d752338-4819-4aef-bed9-e9adbe0c3461 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:24.463334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d752338-4819-4aef-bed9-e9adbe0c3461 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:24.472759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d752338-4819-4aef-bed9-e9adbe0c3461 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.472759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d752338-4819-4aef-bed9-e9adbe0c3461 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.473533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d752338-4819-4aef-bed9-e9adbe0c3461 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.473980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d752338-4819-4aef-bed9-e9adbe0c3461 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.645074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0add9e0f-c9ea-4afd-8dc5-0aa7842ab874 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:24.665808 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0add9e0f-c9ea-4afd-8dc5-0aa7842ab874 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.272860 Aug 04 14:19:24.671017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d752338-4819-4aef-bed9-e9adbe0c3461 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:24.688621 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2227/4467] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:24 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:24.690953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8faeaa9e-b80b-4524-aa56-7f5268523f82 req-16962dbe-7344-468c-833d-2cb821ae1cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-deleted", "tag": "33360f7e-a160-4b97-8979-cdcad2ec3c38"}, {"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-deleted", "tag": "c7dc083d-72bd-44a5-a860-49733935c554"}, {"server_uuid": "eaf17622-cd7a-4eec-a280-3ddf0a36b238", "name": "network-vif-deleted", "tag": "66b17b90-0211-4216-98ba-ebedb5d38090"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:24.704239 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d752338-4819-4aef-bed9-e9adbe0c3461 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.245210 Aug 04 14:19:24.705272 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2241/4468] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:24 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:24.705798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8faeaa9e-b80b-4524-aa56-7f5268523f82 req-16962dbe-7344-468c-833d-2cb821ae1cce service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.706250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8faeaa9e-b80b-4524-aa56-7f5268523f82 req-16962dbe-7344-468c-833d-2cb821ae1cce service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.715319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d352af6-b198-4218-af19-bfbe988d6917 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:24.718101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2d352af6-b198-4218-af19-bfbe988d6917 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:24.722836 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8faeaa9e-b80b-4524-aa56-7f5268523f82 req-16962dbe-7344-468c-833d-2cb821ae1cce service nova] Creating event network-vif-deleted:33360f7e-a160-4b97-8979-cdcad2ec3c38 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:24.723252 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8faeaa9e-b80b-4524-aa56-7f5268523f82 req-16962dbe-7344-468c-833d-2cb821ae1cce service nova] Creating event network-vif-deleted:c7dc083d-72bd-44a5-a860-49733935c554 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:24.723752 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8faeaa9e-b80b-4524-aa56-7f5268523f82 req-16962dbe-7344-468c-833d-2cb821ae1cce service nova] Creating event network-vif-deleted:66b17b90-0211-4216-98ba-ebedb5d38090 for instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 on n-h2-844627-10 Aug 04 14:19:24.730911 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8faeaa9e-b80b-4524-aa56-7f5268523f82 req-16962dbe-7344-468c-833d-2cb821ae1cce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044183 Aug 04 14:19:24.731817 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2228/4469] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:24.735734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d352af6-b198-4218-af19-bfbe988d6917 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.736363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d352af6-b198-4218-af19-bfbe988d6917 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.737583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d352af6-b198-4218-af19-bfbe988d6917 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.738384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d352af6-b198-4218-af19-bfbe988d6917 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.739110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:24.739840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:24.746965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.747439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.748253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.749040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.886305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:24.904648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:24.908499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:24.910719 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61979fae-ab4c-4795-9cad-0e4c2372502d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.177432 Aug 04 14:19:24.924907 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2229/4470] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:24 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:24.924907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e986081-baea-4bd5-a3ef-67ca82fbeccb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:24.925400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8e986081-baea-4bd5-a3ef-67ca82fbeccb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:24.939996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e986081-baea-4bd5-a3ef-67ca82fbeccb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.941527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e986081-baea-4bd5-a3ef-67ca82fbeccb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:24.942851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e986081-baea-4bd5-a3ef-67ca82fbeccb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:24.943632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e986081-baea-4bd5-a3ef-67ca82fbeccb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.075335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2d352af6-b198-4218-af19-bfbe988d6917 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:25.099639 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2d352af6-b198-4218-af19-bfbe988d6917 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.391428 Aug 04 14:19:25.102055 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2242/4471] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:24 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:25.114710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c6a848b7-a5ab-4c62-8940-f62826786ca5 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:25.116216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c6a848b7-a5ab-4c62-8940-f62826786ca5 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:25.127995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6a848b7-a5ab-4c62-8940-f62826786ca5 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.128931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6a848b7-a5ab-4c62-8940-f62826786ca5 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.130377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6a848b7-a5ab-4c62-8940-f62826786ca5 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.131166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6a848b7-a5ab-4c62-8940-f62826786ca5 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.211680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8e986081-baea-4bd5-a3ef-67ca82fbeccb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:25.227433 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e986081-baea-4bd5-a3ef-67ca82fbeccb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.313772 Aug 04 14:19:25.229137 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2230/4472] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:24 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:25.248861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:25.253126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:25.260653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.261272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.262189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.262647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.297160 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896/action HTTP/1.1 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 65 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3014c326-6c39-41ef-ace6-c0cbe3259896', 'body': {'rebuild': {'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9'}}} Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 14:19:25.300706 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8a307072-c808-4c39-944f-593bfd4ee0e4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896/action" status: 404 len: 111 microversion: 2.1 time: 0.058324 Aug 04 14:19:25.309827 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2231/4473] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:25 2022] POST /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:19:25.327078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4dbb8b72-ab3d-4267-bd7a-da9b9ec66ce5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:25.328202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4dbb8b72-ab3d-4267-bd7a-da9b9ec66ce5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:25.337066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dbb8b72-ab3d-4267-bd7a-da9b9ec66ce5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.337629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dbb8b72-ab3d-4267-bd7a-da9b9ec66ce5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.338841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dbb8b72-ab3d-4267-bd7a-da9b9ec66ce5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.339398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dbb8b72-ab3d-4267-bd7a-da9b9ec66ce5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.365390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c6a848b7-a5ab-4c62-8940-f62826786ca5 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:25.374918 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c6a848b7-a5ab-4c62-8940-f62826786ca5 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.270270 Aug 04 14:19:25.376464 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2243/4474] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:25 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:25.485408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:25.487991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:25.501303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.502698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.504616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.506365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.614502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4dbb8b72-ab3d-4267-bd7a-da9b9ec66ce5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:25.637472 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4dbb8b72-ab3d-4267-bd7a-da9b9ec66ce5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.323820 Aug 04 14:19:25.651624 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2232/4475] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:25 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:25.676523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb5e8ee2-1630-46cc-b2ab-bc05c6b01727 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:25.677553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb5e8ee2-1630-46cc-b2ab-bc05c6b01727 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:25.686409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb5e8ee2-1630-46cc-b2ab-bc05c6b01727 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.687420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb5e8ee2-1630-46cc-b2ab-bc05c6b01727 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.689116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb5e8ee2-1630-46cc-b2ab-bc05c6b01727 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.690350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb5e8ee2-1630-46cc-b2ab-bc05c6b01727 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.837250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:25.854129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:25.857303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:25.859650 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6a7a6ee0-ef11-4bc4-bb4b-08d2c6b9a209 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1407 microversion: 2.20 time: 0.381232 Aug 04 14:19:25.860980 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2244/4476] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:25 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1407 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:25.871495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd749fca-6c51-4056-9dab-66840e5131a1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:25.872689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cd749fca-6c51-4056-9dab-66840e5131a1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:25.885839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd749fca-6c51-4056-9dab-66840e5131a1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.886663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd749fca-6c51-4056-9dab-66840e5131a1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.888152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd749fca-6c51-4056-9dab-66840e5131a1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.889699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd749fca-6c51-4056-9dab-66840e5131a1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.927100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb5e8ee2-1630-46cc-b2ab-bc05c6b01727 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:25.944800 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb5e8ee2-1630-46cc-b2ab-bc05c6b01727 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.272801 Aug 04 14:19:25.945917 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2233/4477] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:25 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:25.956644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:25.958208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:25.970679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.971515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:25.973132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:25.973960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.062258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cd749fca-6c51-4056-9dab-66840e5131a1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:26.072992 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cd749fca-6c51-4056-9dab-66840e5131a1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.210009 Aug 04 14:19:26.083256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:26.086512 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2245/4478] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:25 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:26.092734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6281a1de-040f-4bbc-9a75-23f7975f5a70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:26.097022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6281a1de-040f-4bbc-9a75-23f7975f5a70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 32f738f1-3aea-4550-b99a-ffdcb751a424] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:26.103672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:26.105136 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-6281a1de-040f-4bbc-9a75-23f7975f5a70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 32f738f1-3aea-4550-b99a-ffdcb751a424 could not be found. Aug 04 14:19:26.106613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6281a1de-040f-4bbc-9a75-23f7975f5a70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/32f738f1-3aea-4550-b99a-ffdcb751a424/action HTTP/1.1 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 65 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 32f738f1-3aea-4550-b99a-ffdcb751a424 could not be found. Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '32f738f1-3aea-4550-b99a-ffdcb751a424', 'body': {'rebuild': {'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9'}}} Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f738f1-3aea-4550-b99a-ffdcb751a424 could not be found. Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 14:19:26.107373 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f738f1-3aea-4550-b99a-ffdcb751a424 could not be found. Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f738f1-3aea-4550-b99a-ffdcb751a424 could not be found. Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.122347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6281a1de-040f-4bbc-9a75-23f7975f5a70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 32f738f1-3aea-4550-b99a-ffdcb751a424 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:26.124290 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-94dd5612-adc2-4930-9f38-b5db5eae4c17 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.160653 Aug 04 14:19:26.124469 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6281a1de-040f-4bbc-9a75-23f7975f5a70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/32f738f1-3aea-4550-b99a-ffdcb751a424/action" status: 404 len: 111 microversion: 2.1 time: 0.023285 Aug 04 14:19:26.124469 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2246/4479] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:26 2022] POST /compute/v2.1/servers/32f738f1-3aea-4550-b99a-ffdcb751a424/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:26.130829 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2234/4480] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:25 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:26.133401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e839d178-0567-4d99-a5de-cccf11084930 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:26.134120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e839d178-0567-4d99-a5de-cccf11084930 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:26.138902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0be6ab00-7d88-480a-9151-04e530e4241d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:26.139993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0be6ab00-7d88-480a-9151-04e530e4241d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:26.143782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e839d178-0567-4d99-a5de-cccf11084930 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.144491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e839d178-0567-4d99-a5de-cccf11084930 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.145720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e839d178-0567-4d99-a5de-cccf11084930 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.146404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e839d178-0567-4d99-a5de-cccf11084930 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.152095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be6ab00-7d88-480a-9151-04e530e4241d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.152806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be6ab00-7d88-480a-9151-04e530e4241d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.154322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be6ab00-7d88-480a-9151-04e530e4241d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.154971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0be6ab00-7d88-480a-9151-04e530e4241d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.429185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0be6ab00-7d88-480a-9151-04e530e4241d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:26.439145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e839d178-0567-4d99-a5de-cccf11084930 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:26.446155 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0be6ab00-7d88-480a-9151-04e530e4241d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.315020 Aug 04 14:19:26.447229 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2235/4481] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:26 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:26.451140 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e839d178-0567-4d99-a5de-cccf11084930 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.330435 Aug 04 14:19:26.465132 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2247/4482] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:26 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:26.469511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0e994e3a-706d-4ac4-bcd0-b6968a0c56c6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:26.469511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0e994e3a-706d-4ac4-bcd0-b6968a0c56c6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:26.477712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e994e3a-706d-4ac4-bcd0-b6968a0c56c6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.478196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e994e3a-706d-4ac4-bcd0-b6968a0c56c6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.479569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e994e3a-706d-4ac4-bcd0-b6968a0c56c6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.480733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e994e3a-706d-4ac4-bcd0-b6968a0c56c6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.486595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-db231e29-c9b7-4d2a-a40c-7deda72eb86e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:26.487451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-db231e29-c9b7-4d2a-a40c-7deda72eb86e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:26.500158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db231e29-c9b7-4d2a-a40c-7deda72eb86e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.501425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db231e29-c9b7-4d2a-a40c-7deda72eb86e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.502936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db231e29-c9b7-4d2a-a40c-7deda72eb86e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.503766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db231e29-c9b7-4d2a-a40c-7deda72eb86e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.865402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0e994e3a-706d-4ac4-bcd0-b6968a0c56c6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:26.869259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-db231e29-c9b7-4d2a-a40c-7deda72eb86e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:26.885658 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-db231e29-c9b7-4d2a-a40c-7deda72eb86e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.404283 Aug 04 14:19:26.886756 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2248/4483] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:26 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:26.902444 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0e994e3a-706d-4ac4-bcd0-b6968a0c56c6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1522 microversion: 2.1 time: 0.443074 Aug 04 14:19:26.904218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:26.909729 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2236/4484] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:26 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:26.918421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:26.920966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-befca3f4-4ef2-4699-a424-2dd256773e59 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:26.922967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-befca3f4-4ef2-4699-a424-2dd256773e59 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 51b98e3a-0c5b-4d17-9491-f81e0711eb77] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:26.931285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.932498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.934528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.935576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.939029 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-befca3f4-4ef2-4699-a424-2dd256773e59 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 51b98e3a-0c5b-4d17-9491-f81e0711eb77 could not be found. Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-befca3f4-4ef2-4699-a424-2dd256773e59 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/51b98e3a-0c5b-4d17-9491-f81e0711eb77/action HTTP/1.1 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 15 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: {"restore": {}} Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 51b98e3a-0c5b-4d17-9491-f81e0711eb77 could not be found. Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '51b98e3a-0c5b-4d17-9491-f81e0711eb77', 'body': {'restore': {}}} Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b98e3a-0c5b-4d17-9491-f81e0711eb77 could not be found. Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b98e3a-0c5b-4d17-9491-f81e0711eb77 could not be found. Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:26.942057 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:26.946806 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:26.946806 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:26.946806 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b98e3a-0c5b-4d17-9491-f81e0711eb77 could not be found. Aug 04 14:19:26.946806 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:26.948304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-befca3f4-4ef2-4699-a424-2dd256773e59 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 51b98e3a-0c5b-4d17-9491-f81e0711eb77 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:26.949646 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-befca3f4-4ef2-4699-a424-2dd256773e59 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/51b98e3a-0c5b-4d17-9491-f81e0711eb77/action" status: 404 len: 111 microversion: 2.1 time: 0.038464 Aug 04 14:19:26.950927 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2237/4485] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:26 2022] POST /compute/v2.1/servers/51b98e3a-0c5b-4d17-9491-f81e0711eb77/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:26.960172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa961bcd-21ac-463d-a56e-3bb067972b62 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:26.960809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa961bcd-21ac-463d-a56e-3bb067972b62 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:26.979554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa961bcd-21ac-463d-a56e-3bb067972b62 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.979988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa961bcd-21ac-463d-a56e-3bb067972b62 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:26.980804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa961bcd-21ac-463d-a56e-3bb067972b62 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:26.981271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa961bcd-21ac-463d-a56e-3bb067972b62 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.203515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:27.216961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:27.220101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:27.222219 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b452821d-7c75-420b-b0ef-c845b37581c2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1598 microversion: 2.20 time: 0.333763 Aug 04 14:19:27.223546 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2249/4486] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:26 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1598 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:27.223985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa961bcd-21ac-463d-a56e-3bb067972b62 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:27.232224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-db624852-ab54-435e-9a87-f234db9a6984 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:27.233311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-db624852-ab54-435e-9a87-f234db9a6984 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:27.239891 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa961bcd-21ac-463d-a56e-3bb067972b62 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.283313 Aug 04 14:19:27.252112 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2238/4487] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:26 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:27.252112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:27.252112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:27.259535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.260295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.261195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db624852-ab54-435e-9a87-f234db9a6984 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.261410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.261988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.262633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db624852-ab54-435e-9a87-f234db9a6984 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.264292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db624852-ab54-435e-9a87-f234db9a6984 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.265322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db624852-ab54-435e-9a87-f234db9a6984 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.381234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:27.398474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:27.401142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:27.402834 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a7ab587-ca92-4914-a3ce-efd7b2f11529 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.160080 Aug 04 14:19:27.403961 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2239/4488] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:27 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:27.412068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90c23ecb-0e11-4034-a8aa-fda18e9f3295 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:27.413017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-90c23ecb-0e11-4034-a8aa-fda18e9f3295 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:27.435314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90c23ecb-0e11-4034-a8aa-fda18e9f3295 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.436334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90c23ecb-0e11-4034-a8aa-fda18e9f3295 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.437460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90c23ecb-0e11-4034-a8aa-fda18e9f3295 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.438270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90c23ecb-0e11-4034-a8aa-fda18e9f3295 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.588943 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90c23ecb-0e11-4034-a8aa-fda18e9f3295 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.182876 Aug 04 14:19:27.590317 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2240/4489] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 14:19:27 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:19:27.594498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-db624852-ab54-435e-9a87-f234db9a6984 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:27.599285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-81b08677-9b1e-4e6d-8bb3-5e33b1a9aea2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:27.600103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-81b08677-9b1e-4e6d-8bb3-5e33b1a9aea2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:27.615134 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-db624852-ab54-435e-9a87-f234db9a6984 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.390093 Aug 04 14:19:27.616165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81b08677-9b1e-4e6d-8bb3-5e33b1a9aea2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.617051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81b08677-9b1e-4e6d-8bb3-5e33b1a9aea2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.618641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81b08677-9b1e-4e6d-8bb3-5e33b1a9aea2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.619260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81b08677-9b1e-4e6d-8bb3-5e33b1a9aea2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.619484 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2250/4490] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:27 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:27.631130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f2baad82-e9dc-4b0c-a63f-68b2094a8505 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:27.632846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2baad82-e9dc-4b0c-a63f-68b2094a8505 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:27.650264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2baad82-e9dc-4b0c-a63f-68b2094a8505 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.651573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2baad82-e9dc-4b0c-a63f-68b2094a8505 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:27.654805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2baad82-e9dc-4b0c-a63f-68b2094a8505 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:27.656583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2baad82-e9dc-4b0c-a63f-68b2094a8505 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:28.263271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-81b08677-9b1e-4e6d-8bb3-5e33b1a9aea2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:28.283053 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-81b08677-9b1e-4e6d-8bb3-5e33b1a9aea2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.688503 Aug 04 14:19:28.284093 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2241/4491] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:27 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:28.306827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f2baad82-e9dc-4b0c-a63f-68b2094a8505 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:28.320532 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f2baad82-e9dc-4b0c-a63f-68b2094a8505 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.699226 Aug 04 14:19:28.321838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9355b152-5091-4362-b677-11f5201f04ea tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:28.323022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9355b152-5091-4362-b677-11f5201f04ea tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:28.326900 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2251/4492] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:27 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:28.348588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:28.350730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:28.364247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:28.364473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9355b152-5091-4362-b677-11f5201f04ea tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:28.365207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9355b152-5091-4362-b677-11f5201f04ea tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:28.367120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9355b152-5091-4362-b677-11f5201f04ea tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:28.368268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9355b152-5091-4362-b677-11f5201f04ea tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:28.372424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:28.374673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:28.375172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:28.407500 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Cannot 'restore' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action HTTP/1.1 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 15 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: {"restore": {}} Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: exception: Cannot 'restore' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d', 'body': {'restore': {}}} Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9c416741-016d-4f02-9a57-507f0454876d in vm_state active. Cannot restore while the instance is in this state. Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:28.409891 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:28.416748 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:28.416748 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:28.416748 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:28.416748 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:19:28.416748 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:28.416748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 409 to user: Cannot 'restore' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:28.416748 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-101367ee-8235-490c-8e26-af92bbf1c288 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 409 len: 145 microversion: 2.1 time: 0.087556 Aug 04 14:19:28.421369 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2252/4493] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:28 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 145 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:19:28.428620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5412268c-771f-4f48-b572-45cc09afda79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:28.429782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5412268c-771f-4f48-b572-45cc09afda79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:28.451697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5412268c-771f-4f48-b572-45cc09afda79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:28.452521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5412268c-771f-4f48-b572-45cc09afda79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:28.455332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5412268c-771f-4f48-b572-45cc09afda79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:28.455705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5412268c-771f-4f48-b572-45cc09afda79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:28.496810 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5412268c-771f-4f48-b572-45cc09afda79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4/ips" status: 200 len: 150 microversion: 2.1 time: 0.072311 Aug 04 14:19:28.497960 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2253/4494] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:19:28 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4/ips => generated 150 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:28.507910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9276f47f-5468-4054-8263-2a263060432c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:28.509162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9276f47f-5468-4054-8263-2a263060432c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:28.517533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9276f47f-5468-4054-8263-2a263060432c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:28.518001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9276f47f-5468-4054-8263-2a263060432c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:28.518831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9276f47f-5468-4054-8263-2a263060432c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:28.519449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9276f47f-5468-4054-8263-2a263060432c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:29.333081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9355b152-5091-4362-b677-11f5201f04ea tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:29.353858 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9355b152-5091-4362-b677-11f5201f04ea tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1502 microversion: 2.1 time: 1.052569 Aug 04 14:19:29.355789 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2242/4495] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:28 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1502 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:29.374332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:29.376798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:29.398278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:29.399241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:29.404136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:29.404903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:29.417938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9276f47f-5468-4054-8263-2a263060432c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:29.456592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9276f47f-5468-4054-8263-2a263060432c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.956273 Aug 04 14:19:29.457742 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2254/4496] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:28 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:29.507816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cceca16-91a6-45b6-9704-7adbb178c810"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:29.510536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:29.518396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:29.518848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:29.521840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:29.522842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:29.608198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:29.638921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:29.643221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:29.647098 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e9ebf06-aa47-470c-aae0-939474fd9cfc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.289578 Aug 04 14:19:29.648439 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2243/4497] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:29 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:29.680827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9babe97-30c6-4d23-bee3-77f503ae933e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:29.682082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f9babe97-30c6-4d23-bee3-77f503ae933e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:29.696375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9babe97-30c6-4d23-bee3-77f503ae933e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:29.697118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9babe97-30c6-4d23-bee3-77f503ae933e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:29.698503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9babe97-30c6-4d23-bee3-77f503ae933e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:29.699620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9babe97-30c6-4d23-bee3-77f503ae933e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:29.726060 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Invalid volume: volume 8cceca16-91a6-45b6-9704-7adbb178c810 is already attached to instances: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4/os-volume_attachments HTTP/1.1 Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 74 Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: {"volumeAttachment": {"volumeId": "8cceca16-91a6-45b6-9704-7adbb178c810"}} Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid volume: volume 8cceca16-91a6-45b6-9704-7adbb178c810 is already attached to instances: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'server_id': 'd4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4', 'body': {'volumeAttachment': {'volumeId': '8cceca16-91a6-45b6-9704-7adbb178c810'}}} Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8cceca16-91a6-45b6-9704-7adbb178c810 is already attached to instances: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:29.727769 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8cceca16-91a6-45b6-9704-7adbb178c810 is already attached to instances: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8cceca16-91a6-45b6-9704-7adbb178c810 is already attached to instances: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 400 to user: Invalid volume: volume 8cceca16-91a6-45b6-9704-7adbb178c810 is already attached to instances: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7561985b-e87d-453c-8b86-3f14f98a40e1 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.254879 Aug 04 14:19:29.731526 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2255/4498] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:19:29 2022] POST /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4/os-volume_attachments => generated 174 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:19:29.740177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d418eec8-4515-456b-848a-bbf0e29a9c25 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:29.740736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d418eec8-4515-456b-848a-bbf0e29a9c25 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:29.751448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d418eec8-4515-456b-848a-bbf0e29a9c25 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:29.759249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d418eec8-4515-456b-848a-bbf0e29a9c25 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:29.760552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d418eec8-4515-456b-848a-bbf0e29a9c25 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:29.761701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d418eec8-4515-456b-848a-bbf0e29a9c25 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:30.364982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f9babe97-30c6-4d23-bee3-77f503ae933e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:30.379486 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f9babe97-30c6-4d23-bee3-77f503ae933e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.711759 Aug 04 14:19:30.381165 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2244/4499] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:29 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:30.390451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d418eec8-4515-456b-848a-bbf0e29a9c25 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:30.403395 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d418eec8-4515-456b-848a-bbf0e29a9c25 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.668467 Aug 04 14:19:30.408902 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2256/4500] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:29 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:30.418875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5ccd5b12-ab32-48a6-91d3-3e6d376a4519 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:30.419826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5ccd5b12-ab32-48a6-91d3-3e6d376a4519 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:30.429539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a52d349e-aec6-465a-87bb-374a5eb48904 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Action: 'create', calling method: .version_select at 0x7f470569dd30>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-875901181", "description": "tempest-description-1924140501"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:30.448404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ccd5b12-ab32-48a6-91d3-3e6d376a4519 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:30.448909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ccd5b12-ab32-48a6-91d3-3e6d376a4519 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:30.452032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ccd5b12-ab32-48a6-91d3-3e6d376a4519 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:30.452437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ccd5b12-ab32-48a6-91d3-3e6d376a4519 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:30.467366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:30.893449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5ccd5b12-ab32-48a6-91d3-3e6d376a4519 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:30.915133 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5ccd5b12-ab32-48a6-91d3-3e6d376a4519 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.504065 Aug 04 14:19:30.917010 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2257/4501] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:30 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:30.927183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5b5fd357-a335-42db-a305-325a32790947 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:30.928854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b5fd357-a335-42db-a305-325a32790947 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:30.949398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b5fd357-a335-42db-a305-325a32790947 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:30.950685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b5fd357-a335-42db-a305-325a32790947 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:30.962862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b5fd357-a335-42db-a305-325a32790947 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:30.964296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b5fd357-a335-42db-a305-325a32790947 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:31.032399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b5fd357-a335-42db-a305-325a32790947 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:19:31.363172 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5b5fd357-a335-42db-a305-325a32790947 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 204 len: 0 microversion: 2.1 time: 0.440561 Aug 04 14:19:31.385247 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2258/4502] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:19:30 2022] DELETE /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:19:31.428385 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a52d349e-aec6-465a-87bb-374a5eb48904 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.045431 Aug 04 14:19:31.429965 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2245/4503] 10.222.0.66 () {60 vars in 1180 bytes} [Thu Aug 4 14:19:30 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:31.436560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa25da38-4be0-43fa-b385-696bf1160b7d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:31.438577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa25da38-4be0-43fa-b385-696bf1160b7d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 2558ee3a-1ae8-455b-a8f9-86e1dd31a755] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:31.448640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:31.450143 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-aa25da38-4be0-43fa-b385-696bf1160b7d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 2558ee3a-1ae8-455b-a8f9-86e1dd31a755 could not be found. Aug 04 14:19:31.455312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa25da38-4be0-43fa-b385-696bf1160b7d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/2558ee3a-1ae8-455b-a8f9-86e1dd31a755/action HTTP/1.1 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 14 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: {"resume": {}} Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 2558ee3a-1ae8-455b-a8f9-86e1dd31a755 could not be found. Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '2558ee3a-1ae8-455b-a8f9-86e1dd31a755', 'body': {'resume': {}}} Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2558ee3a-1ae8-455b-a8f9-86e1dd31a755 could not be found. Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2558ee3a-1ae8-455b-a8f9-86e1dd31a755 could not be found. Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:31.459550 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:31.464133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:31.464133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:31.464133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2558ee3a-1ae8-455b-a8f9-86e1dd31a755 could not be found. Aug 04 14:19:31.464133 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:31.465471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa25da38-4be0-43fa-b385-696bf1160b7d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 2558ee3a-1ae8-455b-a8f9-86e1dd31a755 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:31.466523 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa25da38-4be0-43fa-b385-696bf1160b7d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/2558ee3a-1ae8-455b-a8f9-86e1dd31a755/action" status: 404 len: 111 microversion: 2.1 time: 0.035229 Aug 04 14:19:31.467286 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2246/4504] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:31 2022] POST /compute/v2.1/servers/2558ee3a-1ae8-455b-a8f9-86e1dd31a755/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:31.476147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:31.477388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:31.478602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:31.478779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-16bc943b-211e-4a94-ac6f-f8d152657325 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:31.479384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-16bc943b-211e-4a94-ac6f-f8d152657325 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:31.479578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:31.501537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16bc943b-211e-4a94-ac6f-f8d152657325 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:31.502125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16bc943b-211e-4a94-ac6f-f8d152657325 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:31.504157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16bc943b-211e-4a94-ac6f-f8d152657325 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:31.504777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16bc943b-211e-4a94-ac6f-f8d152657325 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:31.519177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:31.814032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:31.838188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:31.843132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:31.846805 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba3b2e20-8cf6-4deb-97f3-7fbf7889b795 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.458860 Aug 04 14:19:31.848185 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2259/4505] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:31 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:31.859676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8edb87c8-5911-4a9b-9ff0-068a2946dadf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:31.862301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8edb87c8-5911-4a9b-9ff0-068a2946dadf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:31.878729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8edb87c8-5911-4a9b-9ff0-068a2946dadf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:31.879871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8edb87c8-5911-4a9b-9ff0-068a2946dadf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:31.881699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8edb87c8-5911-4a9b-9ff0-068a2946dadf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:31.883303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8edb87c8-5911-4a9b-9ff0-068a2946dadf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:31.902115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-16bc943b-211e-4a94-ac6f-f8d152657325 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:31.912326 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-16bc943b-211e-4a94-ac6f-f8d152657325 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1683 microversion: 2.1 time: 0.443366 Aug 04 14:19:31.926779 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2247/4506] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:31 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1683 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:31.938550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bfd8fec8-41ef-410a-aae3-66008b8aeb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:31.939446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bfd8fec8-41ef-410a-aae3-66008b8aeb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:31.948960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfd8fec8-41ef-410a-aae3-66008b8aeb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:31.949741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfd8fec8-41ef-410a-aae3-66008b8aeb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:31.951079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfd8fec8-41ef-410a-aae3-66008b8aeb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:31.951704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfd8fec8-41ef-410a-aae3-66008b8aeb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:32.180570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8edb87c8-5911-4a9b-9ff0-068a2946dadf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:32.191093 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8edb87c8-5911-4a9b-9ff0-068a2946dadf tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.340933 Aug 04 14:19:32.197858 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2260/4507] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:31 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:32.206011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-32ac4af6-6621-498f-a8ad-5a7158b83524 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-875901181"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:32.206630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-32ac4af6-6621-498f-a8ad-5a7158b83524 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:32.221727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32ac4af6-6621-498f-a8ad-5a7158b83524 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:32.222418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32ac4af6-6621-498f-a8ad-5a7158b83524 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:32.223664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32ac4af6-6621-498f-a8ad-5a7158b83524 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:32.224536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32ac4af6-6621-498f-a8ad-5a7158b83524 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:32.295332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bfd8fec8-41ef-410a-aae3-66008b8aeb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:32.312252 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bfd8fec8-41ef-410a-aae3-66008b8aeb37 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1656 microversion: 2.1 time: 0.378971 Aug 04 14:19:32.315545 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2248/4508] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:31 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1656 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:32.436182 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.network.security_group_api [None req-32ac4af6-6621-498f-a8ad-5a7158b83524 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Adding security group a6a118c6-2049-4477-b0a2-e4bd292adedf to port b861c6f3-367f-4e61-9b65-f9765748ba2c Aug 04 14:19:32.485022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7855ad39-f58b-4246-8dd5-7f640a702d8b req-68f2470d-ae8c-46da-8409-c0a291c98ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d980c4-8034-4898-83d5-bcc0ad62a973", "tag": "10153aad-a7c0-4ba3-ae0d-2844ce1198a3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:32.503518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7855ad39-f58b-4246-8dd5-7f640a702d8b req-68f2470d-ae8c-46da-8409-c0a291c98ac6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:32.512192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7855ad39-f58b-4246-8dd5-7f640a702d8b req-68f2470d-ae8c-46da-8409-c0a291c98ac6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:32.538576 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7855ad39-f58b-4246-8dd5-7f640a702d8b req-68f2470d-ae8c-46da-8409-c0a291c98ac6 service nova] Creating event network-changed:10153aad-a7c0-4ba3-ae0d-2844ce1198a3 for instance 44d980c4-8034-4898-83d5-bcc0ad62a973 on n-h1-844627-10 Aug 04 14:19:32.547323 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7855ad39-f58b-4246-8dd5-7f640a702d8b req-68f2470d-ae8c-46da-8409-c0a291c98ac6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229723 Aug 04 14:19:32.553282 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2249/4509] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:32.567992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1045e540-c4ea-43f0-97c7-3dac34f0f6dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:32.569000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1045e540-c4ea-43f0-97c7-3dac34f0f6dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:32.571256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:32.595750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1045e540-c4ea-43f0-97c7-3dac34f0f6dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:32.599180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1045e540-c4ea-43f0-97c7-3dac34f0f6dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:32.600158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1045e540-c4ea-43f0-97c7-3dac34f0f6dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:32.600712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1045e540-c4ea-43f0-97c7-3dac34f0f6dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:32.897404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1045e540-c4ea-43f0-97c7-3dac34f0f6dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:32.911475 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1045e540-c4ea-43f0-97c7-3dac34f0f6dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.356299 Aug 04 14:19:32.912073 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2250/4510] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:32 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:32.922570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8681b498-9aa8-416f-8283-7ff4e5f72a32 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:32.956689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8681b498-9aa8-416f-8283-7ff4e5f72a32 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:32.957761 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8681b498-9aa8-416f-8283-7ff4e5f72a32 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:33.023005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8681b498-9aa8-416f-8283-7ff4e5f72a32 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Going to try to start instance {{(pid=130961) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 14:19:33.174206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8681b498-9aa8-416f-8283-7ff4e5f72a32 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.260184 Aug 04 14:19:33.176442 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2251/4511] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:32 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:33.201115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:33.202442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:33.219571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:33.220098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:33.238513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:33.239244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:33.258725 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-32ac4af6-6621-498f-a8ad-5a7158b83524 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action" status: 202 len: 0 microversion: 2.1 time: 1.059566 Aug 04 14:19:33.260115 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2261/4512] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:32 2022] POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action => generated 0 bytes in 1061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:33.266093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2b3dd44-ea79-444a-b2d7-e208a205eee0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:33.266877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e2b3dd44-ea79-444a-b2d7-e208a205eee0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:33.283579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2b3dd44-ea79-444a-b2d7-e208a205eee0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:33.284043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2b3dd44-ea79-444a-b2d7-e208a205eee0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:33.286450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2b3dd44-ea79-444a-b2d7-e208a205eee0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:33.290053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2b3dd44-ea79-444a-b2d7-e208a205eee0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:33.513666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:33.536007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:33.539110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:33.541871 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2675a40b-f82e-4607-8768-e8e7b8136c1a tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.360941 Aug 04 14:19:33.578836 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2252/4513] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:33 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:33.602702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b4ddc2e-ea2a-4210-9fe2-b6f873fce36c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:33.603674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4b4ddc2e-ea2a-4210-9fe2-b6f873fce36c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:33.648521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b4ddc2e-ea2a-4210-9fe2-b6f873fce36c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:33.649249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b4ddc2e-ea2a-4210-9fe2-b6f873fce36c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:33.650620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b4ddc2e-ea2a-4210-9fe2-b6f873fce36c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:33.651815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4b4ddc2e-ea2a-4210-9fe2-b6f873fce36c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:34.125859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e2b3dd44-ea79-444a-b2d7-e208a205eee0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:34.139890 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e2b3dd44-ea79-444a-b2d7-e208a205eee0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.878280 Aug 04 14:19:34.144167 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2262/4514] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:33 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:34.149559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-96ae3257-277a-4612-9251-14fdfd07965d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:34.158598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-96ae3257-277a-4612-9251-14fdfd07965d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:34.172686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96ae3257-277a-4612-9251-14fdfd07965d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:34.173449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96ae3257-277a-4612-9251-14fdfd07965d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:34.174480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96ae3257-277a-4612-9251-14fdfd07965d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:34.175122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96ae3257-277a-4612-9251-14fdfd07965d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:34.216411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4b4ddc2e-ea2a-4210-9fe2-b6f873fce36c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:34.233114 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4b4ddc2e-ea2a-4210-9fe2-b6f873fce36c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 200 len: 1683 microversion: 2.1 time: 0.651427 Aug 04 14:19:34.237245 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2253/4515] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:33 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 1683 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:34.252359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b39baaee-19ed-456d-a2be-0f31e8eac5d1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:34.265708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b39baaee-19ed-456d-a2be-0f31e8eac5d1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:34.277098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b39baaee-19ed-456d-a2be-0f31e8eac5d1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:34.278229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b39baaee-19ed-456d-a2be-0f31e8eac5d1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:34.280107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b39baaee-19ed-456d-a2be-0f31e8eac5d1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:34.285847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b39baaee-19ed-456d-a2be-0f31e8eac5d1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:34.680438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-96ae3257-277a-4612-9251-14fdfd07965d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:34.690771 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-96ae3257-277a-4612-9251-14fdfd07965d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1665 microversion: 2.1 time: 0.545205 Aug 04 14:19:34.715511 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2263/4516] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:34 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1665 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:34.721733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-13250f6d-0847-4415-b18b-69a70e02296a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-875901181"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:34.723107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-13250f6d-0847-4415-b18b-69a70e02296a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:34.738762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13250f6d-0847-4415-b18b-69a70e02296a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:34.741433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13250f6d-0847-4415-b18b-69a70e02296a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:34.744347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13250f6d-0847-4415-b18b-69a70e02296a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:34.747667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13250f6d-0847-4415-b18b-69a70e02296a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:34.886055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b39baaee-19ed-456d-a2be-0f31e8eac5d1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:34.906768 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b39baaee-19ed-456d-a2be-0f31e8eac5d1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.667520 Aug 04 14:19:34.908200 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2254/4517] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:34 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:34.916249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:34.918444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:34.939545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:34.940007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:34.941126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:34.941284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:35.010087 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Cannot 'resume' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action HTTP/1.1 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 14 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: {"resume": {}} Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: exception: Cannot 'resume' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d', 'body': {'resume': {}}} Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9c416741-016d-4f02-9a57-507f0454876d in vm_state active. Cannot resume while the instance is in this state. Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:35.011859 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:35.027703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:35.027703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:35.027703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:35.027703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:19:35.027703 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:35.027703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 409 to user: Cannot 'resume' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:35.027703 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-820492c7-cf40-4a58-a288-d6d57a2362dd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 409 len: 144 microversion: 2.1 time: 0.103995 Aug 04 14:19:35.027703 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2255/4518] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:34 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 144 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:19:35.031719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:35.032311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:35.041440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:35.041900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:35.042719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:35.043266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:35.424196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:35.438762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:35.441807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:35.444341 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e8baaa98-b210-43c2-87b4-1da03cac7c3b tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.417651 Aug 04 14:19:35.463967 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2256/4519] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:35 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:35.490634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-4fd5c3c4-9960-4582-9efb-ee5d784aca81 req-036d58a3-6885-48ad-8295-0fdc03e2b584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d1ed22-9377-4fbc-ae8b-543d1beffcaa", "tag": "b861c6f3-367f-4e61-9b65-f9765748ba2c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:35.517077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4fd5c3c4-9960-4582-9efb-ee5d784aca81 req-036d58a3-6885-48ad-8295-0fdc03e2b584 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:35.517539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4fd5c3c4-9960-4582-9efb-ee5d784aca81 req-036d58a3-6885-48ad-8295-0fdc03e2b584 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:35.554039 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-4fd5c3c4-9960-4582-9efb-ee5d784aca81 req-036d58a3-6885-48ad-8295-0fdc03e2b584 service nova] Creating event network-changed:b861c6f3-367f-4e61-9b65-f9765748ba2c for instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa on n-h2-844627-10 Aug 04 14:19:35.587935 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-4fd5c3c4-9960-4582-9efb-ee5d784aca81 req-036d58a3-6885-48ad-8295-0fdc03e2b584 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099899 Aug 04 14:19:35.588658 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2257/4520] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:35.593581 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.network.security_group_api [None req-13250f6d-0847-4415-b18b-69a70e02296a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Removing security group a6a118c6-2049-4477-b0a2-e4bd292adedf from port b861c6f3-367f-4e61-9b65-f9765748ba2c Aug 04 14:19:35.599844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-394b9d20-8e67-432e-aea4-9cb9c775cddd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:35.601908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-394b9d20-8e67-432e-aea4-9cb9c775cddd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:35.615302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-394b9d20-8e67-432e-aea4-9cb9c775cddd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:35.620233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-394b9d20-8e67-432e-aea4-9cb9c775cddd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:35.621514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-394b9d20-8e67-432e-aea4-9cb9c775cddd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:35.622222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-394b9d20-8e67-432e-aea4-9cb9c775cddd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:36.968414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-394b9d20-8e67-432e-aea4-9cb9c775cddd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:37.003413 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-394b9d20-8e67-432e-aea4-9cb9c775cddd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 1.412708 Aug 04 14:19:37.016925 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2258/4521] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:35 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:37.050485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:37.057194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:37.067233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:37.068167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:37.070770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:37.071592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:37.130352 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 HTTP/1.1 Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4'} Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:37.132357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:37.137785 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:37.137785 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:37.137785 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:37.137785 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:37.137785 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:37.137785 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:19:37.137785 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:19:37.170519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:37.175738 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f147b29c-b980-4548-8743-ba195005a130 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 404 len: 111 microversion: 2.1 time: 0.148363 Aug 04 14:19:37.181383 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2259/4522] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:37 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:37.202807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8bdf636a-5884-4d0a-bb3d-fbc003adcbc5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:37.207230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8bdf636a-5884-4d0a-bb3d-fbc003adcbc5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:37.227116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bdf636a-5884-4d0a-bb3d-fbc003adcbc5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:37.227335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bdf636a-5884-4d0a-bb3d-fbc003adcbc5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:37.230637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bdf636a-5884-4d0a-bb3d-fbc003adcbc5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:37.233481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bdf636a-5884-4d0a-bb3d-fbc003adcbc5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:38.089280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8bdf636a-5884-4d0a-bb3d-fbc003adcbc5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:38.100911 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8bdf636a-5884-4d0a-bb3d-fbc003adcbc5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1665 microversion: 2.1 time: 0.916487 Aug 04 14:19:38.115953 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2260/4523] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:37 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1665 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:38.115953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-934d8b04-6df4-4928-982a-3d14cd1d8190 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:38.115953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-934d8b04-6df4-4928-982a-3d14cd1d8190 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:38.119580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-934d8b04-6df4-4928-982a-3d14cd1d8190 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:38.120046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-934d8b04-6df4-4928-982a-3d14cd1d8190 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:38.120858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-934d8b04-6df4-4928-982a-3d14cd1d8190 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:38.121339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-934d8b04-6df4-4928-982a-3d14cd1d8190 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:38.246975 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-13250f6d-0847-4415-b18b-69a70e02296a tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action" status: 202 len: 0 microversion: 2.1 time: 3.529973 Aug 04 14:19:38.258129 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2264/4524] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:34 2022] POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action => generated 0 bytes in 3534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:38.271600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-081b9f5b-053b-480e-8dbb-fbfab0ea3ad0 req-4cb7ff1c-a7de-4a8d-9839-cb9b4311c3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4", "name": "network-vif-deleted", "tag": "89262c5a-d9ee-45c1-b6d5-e91f0a6dc1c6"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:38.313686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-081b9f5b-053b-480e-8dbb-fbfab0ea3ad0 req-4cb7ff1c-a7de-4a8d-9839-cb9b4311c3f9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:38.314060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-081b9f5b-053b-480e-8dbb-fbfab0ea3ad0 req-4cb7ff1c-a7de-4a8d-9839-cb9b4311c3f9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:38.347783 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-081b9f5b-053b-480e-8dbb-fbfab0ea3ad0 req-4cb7ff1c-a7de-4a8d-9839-cb9b4311c3f9 service nova] Creating event network-vif-deleted:89262c5a-d9ee-45c1-b6d5-e91f0a6dc1c6 for instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 on n-h1-844627-10 Aug 04 14:19:38.369082 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-081b9f5b-053b-480e-8dbb-fbfab0ea3ad0 req-4cb7ff1c-a7de-4a8d-9839-cb9b4311c3f9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109263 Aug 04 14:19:38.369717 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2265/4525] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:38.387540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:38.395613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:38.409114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:38.410763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:38.414097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:38.419154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:38.620006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:38.646646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:38.661115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:38.690178 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1fadcb2e-8b8c-44f0-bb41-e685bd4785dc tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.290822 Aug 04 14:19:38.706367 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2266/4526] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:38 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:38.743869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba627b20-3a4a-4901-9746-c6ae96487e90 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:38.747384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba627b20-3a4a-4901-9746-c6ae96487e90 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:38.774869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba627b20-3a4a-4901-9746-c6ae96487e90 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:38.776176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba627b20-3a4a-4901-9746-c6ae96487e90 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:38.778230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba627b20-3a4a-4901-9746-c6ae96487e90 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:38.779789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba627b20-3a4a-4901-9746-c6ae96487e90 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:38.831316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-934d8b04-6df4-4928-982a-3d14cd1d8190 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:38.848817 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-934d8b04-6df4-4928-982a-3d14cd1d8190 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.745108 Aug 04 14:19:38.850596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2261/4527] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:38 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:38.861713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08f02718-0ce5-4ac3-b467-d4f82db0c2ec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '.version_select at 0x7f47001cfee0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:38.971276 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08f02718-0ce5-4ac3-b467-d4f82db0c2ec tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777609227" status: 202 len: 0 microversion: 2.1 time: 0.118291 Aug 04 14:19:38.974932 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2262/4528] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777609227 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:39.004025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0df9dbc3-9d83-411d-8af2-68730f88ea6c req-8aa76e91-1c9a-47bc-a370-e72f42411b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d1ed22-9377-4fbc-ae8b-543d1beffcaa", "tag": "b861c6f3-367f-4e61-9b65-f9765748ba2c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:39.063412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0df9dbc3-9d83-411d-8af2-68730f88ea6c req-8aa76e91-1c9a-47bc-a370-e72f42411b29 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:39.064358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0df9dbc3-9d83-411d-8af2-68730f88ea6c req-8aa76e91-1c9a-47bc-a370-e72f42411b29 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:39.125535 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0df9dbc3-9d83-411d-8af2-68730f88ea6c req-8aa76e91-1c9a-47bc-a370-e72f42411b29 service nova] Creating event network-changed:b861c6f3-367f-4e61-9b65-f9765748ba2c for instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa on n-h2-844627-10 Aug 04 14:19:39.167919 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0df9dbc3-9d83-411d-8af2-68730f88ea6c req-8aa76e91-1c9a-47bc-a370-e72f42411b29 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188534 Aug 04 14:19:39.180998 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2263/4529] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:39.215433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8dba2e5f-bfd1-4754-ba2d-eb84af0f6593 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Action: 'create', calling method: .version_select at 0x7f4700e48940>, body: {"pool": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:39.226619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba627b20-3a4a-4901-9746-c6ae96487e90 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:39.261617 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba627b20-3a4a-4901-9746-c6ae96487e90 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.553236 Aug 04 14:19:39.277410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2267/4530] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:38 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:39.282832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2b53c66-39c0-4453-ac6d-99ac51130128 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:39.286421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d2b53c66-39c0-4453-ac6d-99ac51130128 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:39.299540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2b53c66-39c0-4453-ac6d-99ac51130128 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:39.302247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2b53c66-39c0-4453-ac6d-99ac51130128 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:39.303136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2b53c66-39c0-4453-ac6d-99ac51130128 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:39.303584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2b53c66-39c0-4453-ac6d-99ac51130128 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:39.960216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d2b53c66-39c0-4453-ac6d-99ac51130128 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:39.974456 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2b53c66-39c0-4453-ac6d-99ac51130128 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.704408 Aug 04 14:19:39.975294 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2268/4531] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:39 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:39.985824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5248dfb7-3212-40b3-874d-d8845d5607f0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5248dfb7-3212-40b3-874d-d8845d5607f0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 160 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "aae182f0-01e4-483b-8d95-1af990b09462"}]}} Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'body': {'server': {'name': '', 'imageRef': 'bd2a109f-56ba-4543-91dd-d0a2429000b9', 'flavorRef': '452', 'networks': [{'uuid': 'aae182f0-01e4-483b-8d95-1af990b09462'}]}}} Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi '' Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:19:39.996589 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 14:19:40.001500 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:40.005911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5248dfb7-3212-40b3-874d-d8845d5607f0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:40.007887 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5248dfb7-3212-40b3-874d-d8845d5607f0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.030754 Aug 04 14:19:40.009151 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2269/4532] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:19:39 2022] POST /compute/v2.1/servers => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:19:40.016844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:40.018562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:40.033095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:40.034597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:40.035744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:40.036489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:40.260377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:40.287678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:40.293903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:40.297574 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c203b23-b0b4-45c1-8b41-346efabd4226 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.286827 Aug 04 14:19:40.299186 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2270/4533] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:40 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:40.317384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53aa9b46-09ea-47bc-9cb3-a631072a7b3e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:40.319112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-53aa9b46-09ea-47bc-9cb3-a631072a7b3e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:40.340527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53aa9b46-09ea-47bc-9cb3-a631072a7b3e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:40.345031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53aa9b46-09ea-47bc-9cb3-a631072a7b3e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:40.348504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53aa9b46-09ea-47bc-9cb3-a631072a7b3e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:40.354650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-53aa9b46-09ea-47bc-9cb3-a631072a7b3e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:41.113832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-53aa9b46-09ea-47bc-9cb3-a631072a7b3e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:41.134185 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-53aa9b46-09ea-47bc-9cb3-a631072a7b3e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.833357 Aug 04 14:19:41.135492 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2271/4534] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:40 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:41.141483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc5b2ebf-0bf5-497a-bed2-e2945c4eec7a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:41.148300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc5b2ebf-0bf5-497a-bed2-e2945c4eec7a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:41.171467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc5b2ebf-0bf5-497a-bed2-e2945c4eec7a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:41.173092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc5b2ebf-0bf5-497a-bed2-e2945c4eec7a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:41.174282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc5b2ebf-0bf5-497a-bed2-e2945c4eec7a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:41.175030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc5b2ebf-0bf5-497a-bed2-e2945c4eec7a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:42.067259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc5b2ebf-0bf5-497a-bed2-e2945c4eec7a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:42.083673 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc5b2ebf-0bf5-497a-bed2-e2945c4eec7a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.946338 Aug 04 14:19:42.085220 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2272/4535] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:41 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:42.097908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7a888dbf-4be9-4849-9527-a600ceb0d969 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:42.099702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a888dbf-4be9-4849-9527-a600ceb0d969 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:42.115104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a888dbf-4be9-4849-9527-a600ceb0d969 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:42.126146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a888dbf-4be9-4849-9527-a600ceb0d969 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:42.129433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a888dbf-4be9-4849-9527-a600ceb0d969 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:42.130639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a888dbf-4be9-4849-9527-a600ceb0d969 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:42.529431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7a888dbf-4be9-4849-9527-a600ceb0d969 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:42.542677 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7a888dbf-4be9-4849-9527-a600ceb0d969 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.453722 Aug 04 14:19:42.543723 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2273/4536] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:42 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:42.555819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0036a045-acff-4ae8-b3f7-f40533f5c4bb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:42.557442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0036a045-acff-4ae8-b3f7-f40533f5c4bb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:42.571831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0036a045-acff-4ae8-b3f7-f40533f5c4bb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:42.573058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0036a045-acff-4ae8-b3f7-f40533f5c4bb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:42.575821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0036a045-acff-4ae8-b3f7-f40533f5c4bb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:42.576986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0036a045-acff-4ae8-b3f7-f40533f5c4bb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:42.610506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:42.721538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-0036a045-acff-4ae8-b3f7-f40533f5c4bb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lazy-loading 'services' on Instance uuid df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:19:42.847732 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0036a045-acff-4ae8-b3f7-f40533f5c4bb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments/8cceca16-91a6-45b6-9704-7adbb178c810" status: 202 len: 0 microversion: 2.1 time: 0.293283 Aug 04 14:19:42.847732 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2274/4537] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:19:42 2022] DELETE /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments/8cceca16-91a6-45b6-9704-7adbb178c810 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:42.848065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:42.849967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:42.860554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:42.861358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:42.862403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:42.863036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:43.519150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:43.532172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:43.534274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:43.535556 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-095e9daa-f6fe-40bf-8898-790c8efc78ac tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.693895 Aug 04 14:19:43.536557 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2275/4538] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:42 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:43.542223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b6cb7a5-1423-4766-9296-503422eca726 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:43.542839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b6cb7a5-1423-4766-9296-503422eca726 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:43.551238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b6cb7a5-1423-4766-9296-503422eca726 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:43.551450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b6cb7a5-1423-4766-9296-503422eca726 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:43.552362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b6cb7a5-1423-4766-9296-503422eca726 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:43.552640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b6cb7a5-1423-4766-9296-503422eca726 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:43.632338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b6cb7a5-1423-4766-9296-503422eca726 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Unlocking {{(pid=130960) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 04 14:19:43.768548 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b6cb7a5-1423-4766-9296-503422eca726 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.230130 Aug 04 14:19:43.770454 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2276/4539] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:43 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:43.782902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-61dfb572-60b4-46b7-8b80-ea410cf68862 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:43.784171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-61dfb572-60b4-46b7-8b80-ea410cf68862 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:43.797060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61dfb572-60b4-46b7-8b80-ea410cf68862 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:43.798267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61dfb572-60b4-46b7-8b80-ea410cf68862 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:43.800242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61dfb572-60b4-46b7-8b80-ea410cf68862 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:43.801650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61dfb572-60b4-46b7-8b80-ea410cf68862 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.135408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-61dfb572-60b4-46b7-8b80-ea410cf68862 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:44.158171 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-61dfb572-60b4-46b7-8b80-ea410cf68862 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.385192 Aug 04 14:19:44.174177 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2277/4540] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:43 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:44.184603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f2fe67cd-3037-4c40-8e79-532a9ab925b1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:44.185807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2fe67cd-3037-4c40-8e79-532a9ab925b1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:44.196590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2fe67cd-3037-4c40-8e79-532a9ab925b1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.197450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2fe67cd-3037-4c40-8e79-532a9ab925b1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.198497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2fe67cd-3037-4c40-8e79-532a9ab925b1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.199113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2fe67cd-3037-4c40-8e79-532a9ab925b1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.341093 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8dba2e5f-bfd1-4754-ba2d-eb84af0f6593 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.157822 Aug 04 14:19:44.342290 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2264/4541] 10.222.0.66 () {60 vars in 1170 bytes} [Thu Aug 4 14:19:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:44.355910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cff1f229-664b-4b97-979b-981205cb8707 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:44.360519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cff1f229-664b-4b97-979b-981205cb8707 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:44.370589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cff1f229-664b-4b97-979b-981205cb8707 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.371218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cff1f229-664b-4b97-979b-981205cb8707 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.372406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cff1f229-664b-4b97-979b-981205cb8707 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.373090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cff1f229-664b-4b97-979b-981205cb8707 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.396461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f2fe67cd-3037-4c40-8e79-532a9ab925b1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:44.411569 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f2fe67cd-3037-4c40-8e79-532a9ab925b1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.235100 Aug 04 14:19:44.412904 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2278/4542] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:44 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:44.422229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-496a7f96-c94e-44a9-b9f5-2227c8f522b5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:44.423978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-496a7f96-c94e-44a9-b9f5-2227c8f522b5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:44.431504 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cff1f229-664b-4b97-979b-981205cb8707 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086490 Aug 04 14:19:44.433155 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2265/4543] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:44 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:44.440513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.201"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:44.443828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:44.445098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:44.453510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.454390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.455918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.456795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.458828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-496a7f96-c94e-44a9-b9f5-2227c8f522b5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.459937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-496a7f96-c94e-44a9-b9f5-2227c8f522b5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.461243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-496a7f96-c94e-44a9-b9f5-2227c8f522b5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.461921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-496a7f96-c94e-44a9-b9f5-2227c8f522b5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.490792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Acquired lock "refresh_cache-35d1ed22-9377-4fbc-ae8b-543d1beffcaa" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 14:19:44.799690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-496a7f96-c94e-44a9-b9f5-2227c8f522b5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:44.812084 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-496a7f96-c94e-44a9-b9f5-2227c8f522b5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.397731 Aug 04 14:19:44.824908 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2279/4544] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:44 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:44.824908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-117e0662-f112-4e86-98a2-c1702a6c054b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:44.824908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-117e0662-f112-4e86-98a2-c1702a6c054b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 94235657-63da-4e0b-8528-e7d5444f32c4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:44.835410 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-117e0662-f112-4e86-98a2-c1702a6c054b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 94235657-63da-4e0b-8528-e7d5444f32c4 could not be found. Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-117e0662-f112-4e86-98a2-c1702a6c054b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/94235657-63da-4e0b-8528-e7d5444f32c4/action HTTP/1.1 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 14 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: {"shelve": {}} Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 94235657-63da-4e0b-8528-e7d5444f32c4 could not be found. Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '94235657-63da-4e0b-8528-e7d5444f32c4', 'body': {'shelve': {}}} Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94235657-63da-4e0b-8528-e7d5444f32c4 could not be found. Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94235657-63da-4e0b-8528-e7d5444f32c4 could not be found. Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:44.845089 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:44.852958 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:44.852958 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:44.852958 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94235657-63da-4e0b-8528-e7d5444f32c4 could not be found. Aug 04 14:19:44.852958 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:44.854279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-117e0662-f112-4e86-98a2-c1702a6c054b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 94235657-63da-4e0b-8528-e7d5444f32c4 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:44.855514 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-117e0662-f112-4e86-98a2-c1702a6c054b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/94235657-63da-4e0b-8528-e7d5444f32c4/action" status: 404 len: 111 microversion: 2.1 time: 0.040520 Aug 04 14:19:44.856611 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2280/4545] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:44 2022] POST /compute/v2.1/servers/94235657-63da-4e0b-8528-e7d5444f32c4/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:19:44.862546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:44.863717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:44.874846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.874846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.875839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:44.876480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:44.983177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:44.998485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:45.001858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:45.004033 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9456c926-f7aa-4f97-bf9b-de475e19629d tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.146054 Aug 04 14:19:45.005124 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2281/4546] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:44 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:45.014277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d3c89db-39cb-440d-a22f-4c950b7a9df1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:45.016005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d3c89db-39cb-440d-a22f-4c950b7a9df1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:45.028219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d3c89db-39cb-440d-a22f-4c950b7a9df1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:45.029204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d3c89db-39cb-440d-a22f-4c950b7a9df1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:45.031645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d3c89db-39cb-440d-a22f-4c950b7a9df1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:45.032773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d3c89db-39cb-440d-a22f-4c950b7a9df1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:45.358026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5d3c89db-39cb-440d-a22f-4c950b7a9df1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:45.369796 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d3c89db-39cb-440d-a22f-4c950b7a9df1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.363172 Aug 04 14:19:45.370795 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2282/4547] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:45 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:45.376555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4b2b19ba-eb4d-402e-8e7e-d0d0f3c8732c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:45.377207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4b2b19ba-eb4d-402e-8e7e-d0d0f3c8732c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:45.385023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b2b19ba-eb4d-402e-8e7e-d0d0f3c8732c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:45.389542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b2b19ba-eb4d-402e-8e7e-d0d0f3c8732c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:45.391432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b2b19ba-eb4d-402e-8e7e-d0d0f3c8732c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:45.393655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b2b19ba-eb4d-402e-8e7e-d0d0f3c8732c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:45.830949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4b2b19ba-eb4d-402e-8e7e-d0d0f3c8732c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:45.856456 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4b2b19ba-eb4d-402e-8e7e-d0d0f3c8732c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.483945 Aug 04 14:19:45.857738 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2283/4548] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:45 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:45.879763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f06134b-861b-4a79-bbff-4f44ca23a696 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:45.881931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f06134b-861b-4a79-bbff-4f44ca23a696 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:45.892431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f06134b-861b-4a79-bbff-4f44ca23a696 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:45.893316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f06134b-861b-4a79-bbff-4f44ca23a696 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:45.894912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f06134b-861b-4a79-bbff-4f44ca23a696 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:45.896678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f06134b-861b-4a79-bbff-4f44ca23a696 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:46.322395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5f06134b-861b-4a79-bbff-4f44ca23a696 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:46.339661 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f06134b-861b-4a79-bbff-4f44ca23a696 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1504 microversion: 2.1 time: 0.464232 Aug 04 14:19:46.340738 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2284/4549] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:45 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1504 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:46.351770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-95d2ac16-d888-4342-9c46-333dcdb12e5f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:46.353390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-95d2ac16-d888-4342-9c46-333dcdb12e5f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:46.367776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95d2ac16-d888-4342-9c46-333dcdb12e5f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:46.368539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95d2ac16-d888-4342-9c46-333dcdb12e5f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:46.369632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95d2ac16-d888-4342-9c46-333dcdb12e5f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:46.370269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95d2ac16-d888-4342-9c46-333dcdb12e5f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:46.645821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-95d2ac16-d888-4342-9c46-333dcdb12e5f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:46.657615 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-95d2ac16-d888-4342-9c46-333dcdb12e5f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.313868 Aug 04 14:19:46.658854 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2285/4550] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:46 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:46.680977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6c78d39-9dd2-4d7f-bf5f-1531f4ff9738 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:46.686292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6c78d39-9dd2-4d7f-bf5f-1531f4ff9738 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:46.695995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6c78d39-9dd2-4d7f-bf5f-1531f4ff9738 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:46.696888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6c78d39-9dd2-4d7f-bf5f-1531f4ff9738 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:46.698358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6c78d39-9dd2-4d7f-bf5f-1531f4ff9738 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:46.699352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6c78d39-9dd2-4d7f-bf5f-1531f4ff9738 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:46.775919 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6c78d39-9dd2-4d7f-bf5f-1531f4ff9738 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109042 Aug 04 14:19:46.787989 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2286/4551] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:46 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:46.792069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Building network info cache for instance {{(pid=130961) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 14:19:46.811416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3385afe-0fa3-4fec-9d51-78f72a98d921 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:46.813303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3385afe-0fa3-4fec-9d51-78f72a98d921 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:46.824186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3385afe-0fa3-4fec-9d51-78f72a98d921 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:46.825206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3385afe-0fa3-4fec-9d51-78f72a98d921 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:46.826932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3385afe-0fa3-4fec-9d51-78f72a98d921 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:46.827648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3385afe-0fa3-4fec-9d51-78f72a98d921 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:47.187468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f3385afe-0fa3-4fec-9d51-78f72a98d921 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:47.209806 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3385afe-0fa3-4fec-9d51-78f72a98d921 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.417912 Aug 04 14:19:47.217581 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2287/4552] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:46 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:47.231236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:47.240057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:47.257948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:47.259108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:47.260925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:47.265445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:47.426782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:47.448732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:47.450465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:47.451774 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-88efd5be-188b-466f-ade1-8c6c068be7f2 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.232088 Aug 04 14:19:47.464816 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2288/4553] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:47 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:47.464816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d4b8d2b-d6d0-4c51-8d4a-b9d612abed6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:47.464816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d4b8d2b-d6d0-4c51-8d4a-b9d612abed6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:47.484578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d2b-d6d0-4c51-8d4a-b9d612abed6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:47.484578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d2b-d6d0-4c51-8d4a-b9d612abed6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:47.484578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d2b-d6d0-4c51-8d4a-b9d612abed6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:47.484578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d4b8d2b-d6d0-4c51-8d4a-b9d612abed6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:47.520175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:47.585145 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d4b8d2b-d6d0-4c51-8d4a-b9d612abed6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.131030 Aug 04 14:19:47.590826 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2289/4554] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:47 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:47.594900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e9b0b621-c6e6-458a-8693-8ff208e2f9be req-74a5cf6f-e407-4717-98fe-212e9fbbcd0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d1ed22-9377-4fbc-ae8b-543d1beffcaa", "tag": "b861c6f3-367f-4e61-9b65-f9765748ba2c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:47.610732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e9b0b621-c6e6-458a-8693-8ff208e2f9be req-74a5cf6f-e407-4717-98fe-212e9fbbcd0c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:47.611509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e9b0b621-c6e6-458a-8693-8ff208e2f9be req-74a5cf6f-e407-4717-98fe-212e9fbbcd0c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:47.631710 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e9b0b621-c6e6-458a-8693-8ff208e2f9be req-74a5cf6f-e407-4717-98fe-212e9fbbcd0c service nova] Creating event network-changed:b861c6f3-367f-4e61-9b65-f9765748ba2c for instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa on n-h2-844627-10 Aug 04 14:19:47.638754 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e9b0b621-c6e6-458a-8693-8ff208e2f9be req-74a5cf6f-e407-4717-98fe-212e9fbbcd0c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049619 Aug 04 14:19:47.640198 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2290/4555] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:47.664178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5da5ecd5-3380-4beb-a792-0c0ea3bc131d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:47.666109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5da5ecd5-3380-4beb-a792-0c0ea3bc131d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:47.676020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5da5ecd5-3380-4beb-a792-0c0ea3bc131d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:47.677269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5da5ecd5-3380-4beb-a792-0c0ea3bc131d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:47.678176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5da5ecd5-3380-4beb-a792-0c0ea3bc131d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:47.678630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5da5ecd5-3380-4beb-a792-0c0ea3bc131d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:47.715102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-5da5ecd5-3380-4beb-a792-0c0ea3bc131d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lazy-loading 'flavor' on Instance uuid 9c416741-016d-4f02-9a57-507f0454876d {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:19:48.270646 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5da5ecd5-3380-4beb-a792-0c0ea3bc131d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 202 len: 0 microversion: 2.1 time: 0.628448 Aug 04 14:19:48.272047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2291/4556] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:47 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:48.302244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-baf2f69b-1a18-4c56-83bb-e2f2312c5968 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:48.303665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-baf2f69b-1a18-4c56-83bb-e2f2312c5968 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:48.316465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-baf2f69b-1a18-4c56-83bb-e2f2312c5968 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:48.317228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-baf2f69b-1a18-4c56-83bb-e2f2312c5968 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:48.318595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-baf2f69b-1a18-4c56-83bb-e2f2312c5968 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:48.319320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-baf2f69b-1a18-4c56-83bb-e2f2312c5968 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:48.371342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Updating instance_info_cache with network_info: [{"id": "b861c6f3-367f-4e61-9b65-f9765748ba2c", "address": "fa:16:3e:fd:71:70", "network": {"id": "96c6b661-dcff-4d04-84a7-e976d11485e6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-347267582-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "284ac84d1a804131a8d614aa004a3e67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb861c6f3-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130961) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 14:19:48.393158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Releasing lock "refresh_cache-35d1ed22-9377-4fbc-ae8b-543d1beffcaa" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 14:19:48.394507 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-62aa515a-3449-4993-a704-3b1491c5a535 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action" status: 202 len: 0 microversion: 2.1 time: 3.959878 Aug 04 14:19:48.396092 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2266/4557] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:44 2022] POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action => generated 0 bytes in 3962 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 14:19:48.403207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e225213b-43a9-4cb6-ae28-58a3e24084fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:48.404266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e225213b-43a9-4cb6-ae28-58a3e24084fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:48.412915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e225213b-43a9-4cb6-ae28-58a3e24084fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:48.413720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e225213b-43a9-4cb6-ae28-58a3e24084fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:48.414701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e225213b-43a9-4cb6-ae28-58a3e24084fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:48.415629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e225213b-43a9-4cb6-ae28-58a3e24084fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:48.422676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:48.640769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-baf2f69b-1a18-4c56-83bb-e2f2312c5968 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:48.657170 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-baf2f69b-1a18-4c56-83bb-e2f2312c5968 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1484 microversion: 2.1 time: 0.383366 Aug 04 14:19:48.658888 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2292/4558] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:48 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1484 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:48.681532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4d1a0599-6f18-4e08-a1c5-35ff9e4cf6e9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:48.684319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4d1a0599-6f18-4e08-a1c5-35ff9e4cf6e9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:48.692916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d1a0599-6f18-4e08-a1c5-35ff9e4cf6e9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:48.693239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d1a0599-6f18-4e08-a1c5-35ff9e4cf6e9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:48.694161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d1a0599-6f18-4e08-a1c5-35ff9e4cf6e9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:48.694616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d1a0599-6f18-4e08-a1c5-35ff9e4cf6e9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:48.744941 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4d1a0599-6f18-4e08-a1c5-35ff9e4cf6e9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085925 Aug 04 14:19:48.749422 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2293/4559] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:48 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:48.758783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a0b9e292-2c4a-4499-bd3e-00aa2f487efc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:48.759773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a0b9e292-2c4a-4499-bd3e-00aa2f487efc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:48.768516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0b9e292-2c4a-4499-bd3e-00aa2f487efc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:48.769019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0b9e292-2c4a-4499-bd3e-00aa2f487efc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:48.769838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0b9e292-2c4a-4499-bd3e-00aa2f487efc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:48.770452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0b9e292-2c4a-4499-bd3e-00aa2f487efc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:48.805473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e225213b-43a9-4cb6-ae28-58a3e24084fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:48.822074 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e225213b-43a9-4cb6-ae28-58a3e24084fe tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1654 microversion: 2.1 time: 0.424338 Aug 04 14:19:48.822762 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2267/4560] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:48 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1654 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:48.833894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.201"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:49.549073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a0b9e292-2c4a-4499-bd3e-00aa2f487efc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:49.561994 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a0b9e292-2c4a-4499-bd3e-00aa2f487efc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.814561 Aug 04 14:19:49.562989 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2294/4561] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:48 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:49.570514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:49.571415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:49.572046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:49.579645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:49.580100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:49.580908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:49.581352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:49.585593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:49.587992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:49.590366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:49.591619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:49.721834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:49.738077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:49.740269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:49.742269 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e7d599b6-4be9-43b3-a193-0ed28736f93e tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.174891 Aug 04 14:19:49.744950 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2295/4562] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:49 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:49.755414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-509892701", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:49.829876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] validate_networks() for [('d7a9a51a-3adb-46d9-b41b-e0664e5c3d53', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:19:49.960362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Acquired lock "refresh_cache-35d1ed22-9377-4fbc-ae8b-543d1beffcaa" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 14:19:50.633234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:19:50.633811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:19:50.634292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:19:50.634722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:19:50.635559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:19:50.647301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:50.647951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:50.648609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:50.649123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:50.671378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Getting quotas for project 2274689c61ef4dfca8a1017f893a6037. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:19:50.678025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Getting quotas for user 1f2b1ca4f98f441f8508d33dd8e99ae1 and project 2274689c61ef4dfca8a1017f893a6037. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:19:50.698260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:19:50.701190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:19:50.756032 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e21a758-280e-4c08-9b9b-731f394080b8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.010839 Aug 04 14:19:50.757028 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2296/4563] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:19:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:19:50.772103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0d76bacf-9c96-4a2a-9360-981d9bf751e7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:50.772737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0d76bacf-9c96-4a2a-9360-981d9bf751e7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:50.784589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d76bacf-9c96-4a2a-9360-981d9bf751e7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:50.785965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d76bacf-9c96-4a2a-9360-981d9bf751e7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:50.786917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d76bacf-9c96-4a2a-9360-981d9bf751e7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:50.787699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d76bacf-9c96-4a2a-9360-981d9bf751e7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:50.872036 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0d76bacf-9c96-4a2a-9360-981d9bf751e7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.113377 Aug 04 14:19:50.873295 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2297/4564] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:50 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:50.881046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2afbbfd4-aed8-4173-97fc-e09ac9561c32 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:50.884394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2afbbfd4-aed8-4173-97fc-e09ac9561c32 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:50.901024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2afbbfd4-aed8-4173-97fc-e09ac9561c32 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:50.901884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2afbbfd4-aed8-4173-97fc-e09ac9561c32 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:50.902813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2afbbfd4-aed8-4173-97fc-e09ac9561c32 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:50.903507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2afbbfd4-aed8-4173-97fc-e09ac9561c32 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:50.978209 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2afbbfd4-aed8-4173-97fc-e09ac9561c32 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103328 Aug 04 14:19:50.978914 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2298/4565] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:50 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:50.988380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Building network info cache for instance {{(pid=130961) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 14:19:50.995911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b2163e65-f5c3-4150-b070-34f5b8984ab0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:50.996535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b2163e65-f5c3-4150-b070-34f5b8984ab0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:51.017259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2163e65-f5c3-4150-b070-34f5b8984ab0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:51.017844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2163e65-f5c3-4150-b070-34f5b8984ab0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:51.018578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2163e65-f5c3-4150-b070-34f5b8984ab0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:51.019598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2163e65-f5c3-4150-b070-34f5b8984ab0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:51.288720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b2163e65-f5c3-4150-b070-34f5b8984ab0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:51.318312 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b2163e65-f5c3-4150-b070-34f5b8984ab0 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.331807 Aug 04 14:19:51.318312 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2299/4566] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:50 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:51.353671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:51.354298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:51.380345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:51.382561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:51.384849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:51.385389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:51.540283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:51.555664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:51.557588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:51.559477 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ce1929c-7b6e-4d34-b207-56d693e38cae tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.217191 Aug 04 14:19:51.560483 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2300/4567] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:51 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:51.565743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-40fc6efb-c6a4-4655-96b0-f202e782463e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:51.566698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-40fc6efb-c6a4-4655-96b0-f202e782463e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:51.573643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40fc6efb-c6a4-4655-96b0-f202e782463e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:51.574422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40fc6efb-c6a4-4655-96b0-f202e782463e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:51.575474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40fc6efb-c6a4-4655-96b0-f202e782463e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:51.576121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40fc6efb-c6a4-4655-96b0-f202e782463e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:51.667606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-40fc6efb-c6a4-4655-96b0-f202e782463e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:51.688003 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-40fc6efb-c6a4-4655-96b0-f202e782463e tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1217 microversion: 2.1 time: 0.126107 Aug 04 14:19:51.695602 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2301/4568] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:51 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:51.701956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-74ba5378-26f7-4aeb-9662-1afd7471ca7b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:51.704296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-74ba5378-26f7-4aeb-9662-1afd7471ca7b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:51.712147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74ba5378-26f7-4aeb-9662-1afd7471ca7b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:51.712899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74ba5378-26f7-4aeb-9662-1afd7471ca7b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:51.714304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74ba5378-26f7-4aeb-9662-1afd7471ca7b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:51.716119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74ba5378-26f7-4aeb-9662-1afd7471ca7b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:52.043776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74ba5378-26f7-4aeb-9662-1afd7471ca7b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:52.053579 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-74ba5378-26f7-4aeb-9662-1afd7471ca7b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.356141 Aug 04 14:19:52.066531 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2302/4569] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:51 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:52.072814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-42c8ee90-a74a-425b-9e2e-8820861b0e69 req-1323643d-82dc-4aff-864f-b2eac49b18b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d1ed22-9377-4fbc-ae8b-543d1beffcaa", "tag": "b861c6f3-367f-4e61-9b65-f9765748ba2c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:52.088979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-42c8ee90-a74a-425b-9e2e-8820861b0e69 req-1323643d-82dc-4aff-864f-b2eac49b18b8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:52.089702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-42c8ee90-a74a-425b-9e2e-8820861b0e69 req-1323643d-82dc-4aff-864f-b2eac49b18b8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:52.094670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:52.113938 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-42c8ee90-a74a-425b-9e2e-8820861b0e69 req-1323643d-82dc-4aff-864f-b2eac49b18b8 service nova] Creating event network-changed:b861c6f3-367f-4e61-9b65-f9765748ba2c for instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa on n-h2-844627-10 Aug 04 14:19:52.123503 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-42c8ee90-a74a-425b-9e2e-8820861b0e69 req-1323643d-82dc-4aff-864f-b2eac49b18b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054226 Aug 04 14:19:52.125445 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2303/4570] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:52.131710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-63f39828-bb76-4d44-b017-ce0dba37b8e8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:52.137347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-63f39828-bb76-4d44-b017-ce0dba37b8e8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:52.160532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63f39828-bb76-4d44-b017-ce0dba37b8e8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:52.161036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63f39828-bb76-4d44-b017-ce0dba37b8e8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:52.161880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63f39828-bb76-4d44-b017-ce0dba37b8e8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:52.162326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63f39828-bb76-4d44-b017-ce0dba37b8e8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:52.243897 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-63f39828-bb76-4d44-b017-ce0dba37b8e8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116827 Aug 04 14:19:52.249894 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2304/4571] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:52 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:52.261934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-61af7835-1a50-4ee1-a30b-312d6c4b3901 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:52.262734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-61af7835-1a50-4ee1-a30b-312d6c4b3901 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:52.270630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61af7835-1a50-4ee1-a30b-312d6c4b3901 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:52.271260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61af7835-1a50-4ee1-a30b-312d6c4b3901 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:52.272478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61af7835-1a50-4ee1-a30b-312d6c4b3901 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:52.273059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-61af7835-1a50-4ee1-a30b-312d6c4b3901 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:52.385758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Updating instance_info_cache with network_info: [{"id": "b861c6f3-367f-4e61-9b65-f9765748ba2c", "address": "fa:16:3e:fd:71:70", "network": {"id": "96c6b661-dcff-4d04-84a7-e976d11485e6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-347267582-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "284ac84d1a804131a8d614aa004a3e67", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb861c6f3-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130961) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 14:19:52.403664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Releasing lock "refresh_cache-35d1ed22-9377-4fbc-ae8b-543d1beffcaa" {{(pid=130961) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 14:19:52.404902 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49284424-5b03-4dbd-8183-4d52e7af7907 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action" status: 202 len: 0 microversion: 2.1 time: 3.580838 Aug 04 14:19:52.406323 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2268/4572] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:19:48 2022] POST /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa/action => generated 0 bytes in 3583 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 14:19:52.420211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ad5fef4b-9106-4d19-a6e4-09866b3786ac tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:52.424059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ad5fef4b-9106-4d19-a6e4-09866b3786ac tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:52.455622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad5fef4b-9106-4d19-a6e4-09866b3786ac tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:52.456360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad5fef4b-9106-4d19-a6e4-09866b3786ac tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:52.457641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad5fef4b-9106-4d19-a6e4-09866b3786ac tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:52.458304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad5fef4b-9106-4d19-a6e4-09866b3786ac tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:52.785076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-61af7835-1a50-4ee1-a30b-312d6c4b3901 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:52.798033 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-61af7835-1a50-4ee1-a30b-312d6c4b3901 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.545656 Aug 04 14:19:52.799476 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2305/4573] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:52 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:52.805465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2309b0ed-77e0-4d7a-87f3-974c9800dea6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '.version_select at 0x7f46f3074040>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:52.964908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ad5fef4b-9106-4d19-a6e4-09866b3786ac tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:52.979892 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ad5fef4b-9106-4d19-a6e4-09866b3786ac tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.571611 Aug 04 14:19:52.981221 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2269/4574] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:52 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:52.990049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:52.991058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:53.013437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:53.014283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:53.015577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:53.016329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:53.163162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:53.181279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:53.184479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7ab6120c547b592479d79344d6850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99a5688f72e43d0be0f0b8e175344b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:53.186683 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5619f518-7cb5-434a-9bd5-8c7de67f0f7f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 200 len: 1603 microversion: 2.42 time: 0.204013 Aug 04 14:19:53.188275 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2270/4575] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:52 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 1603 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:19:53.194420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-91bd7398-2fae-4b45-93d1-c3e1c92ce90d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:53.195571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-91bd7398-2fae-4b45-93d1-c3e1c92ce90d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:53.213564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91bd7398-2fae-4b45-93d1-c3e1c92ce90d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:53.213959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91bd7398-2fae-4b45-93d1-c3e1c92ce90d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:53.214843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91bd7398-2fae-4b45-93d1-c3e1c92ce90d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:53.215291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91bd7398-2fae-4b45-93d1-c3e1c92ce90d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:54.259212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-91bd7398-2fae-4b45-93d1-c3e1c92ce90d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:54.286658 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-91bd7398-2fae-4b45-93d1-c3e1c92ce90d tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1313 microversion: 2.1 time: 1.095793 Aug 04 14:19:54.289016 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2271/4576] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:53 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1313 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:54.305698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7207a55e-5adf-4d17-89ed-a3e0033d6a7d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:54.307282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7207a55e-5adf-4d17-89ed-a3e0033d6a7d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:54.339408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7207a55e-5adf-4d17-89ed-a3e0033d6a7d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:54.340588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7207a55e-5adf-4d17-89ed-a3e0033d6a7d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:54.347300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7207a55e-5adf-4d17-89ed-a3e0033d6a7d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:54.351482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7207a55e-5adf-4d17-89ed-a3e0033d6a7d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:54.674805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7207a55e-5adf-4d17-89ed-a3e0033d6a7d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:54.696506 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7207a55e-5adf-4d17-89ed-a3e0033d6a7d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.403567 Aug 04 14:19:54.697210 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2272/4577] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:54 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:54.704199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5c366928-9e07-4a55-bd57-99e2465554b6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:54.707884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5c366928-9e07-4a55-bd57-99e2465554b6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:54.718411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c366928-9e07-4a55-bd57-99e2465554b6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:54.720764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c366928-9e07-4a55-bd57-99e2465554b6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:54.722123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c366928-9e07-4a55-bd57-99e2465554b6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:54.723662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c366928-9e07-4a55-bd57-99e2465554b6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:54.787122 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5c366928-9e07-4a55-bd57-99e2465554b6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088017 Aug 04 14:19:54.788737 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2273/4578] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:54 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:54.799405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5093d267-a830-47b0-be14-803390a7df18 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:54.800904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5093d267-a830-47b0-be14-803390a7df18 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:54.820454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5093d267-a830-47b0-be14-803390a7df18 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:54.820964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5093d267-a830-47b0-be14-803390a7df18 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:54.826369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5093d267-a830-47b0-be14-803390a7df18 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:54.826369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5093d267-a830-47b0-be14-803390a7df18 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.020021 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2309b0ed-77e0-4d7a-87f3-974c9800dea6 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "DELETE /compute/v2.1/os-floating-ips/33115550-cc7c-49d6-b274-1460bd111c94" status: 202 len: 0 microversion: 2.1 time: 2.218828 Aug 04 14:19:55.029545 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2306/4579] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:19:52 2022] DELETE /compute/v2.1/os-floating-ips/33115550-cc7c-49d6-b274-1460bd111c94 => generated 0 bytes in 2222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:55.036696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:55.039668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:55.060361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:55.061236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.064620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:55.065677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.101367 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] HTTP exception thrown: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Request method failure captured: Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 HTTP/1.1 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69PFiiVttCTqqVFi1ozi-YiC3bZuA8o0VpcTsWogjl1DL0lE3RjsHZek9-Po5WDTEzhgvOxME8dl8C5qLiYNKT4-J7hoS4JEHBMibqaebzNjtGp2pVnfqvNN812e85X_oI5leXmNGYkLU6XtCGjNnnBI7f1QWiNgVjTu8S2lVWQpFMw Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c99a5688f72e43d0be0f0b8e175344b0 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-310591802 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c99a5688f72e43d0be0f0b8e175344b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c99a5688f72e43d0be0f0b8e175344b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c99a5688f72e43d0be0f0b8e175344b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c99a5688f72e43d0be0f0b8e175344b0"}]}] Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TaggedBootDevicesTest_v242-310591802 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c99a5688f72e43d0be0f0b8e175344b0 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-310591802 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TaggedBootDevicesTest_v242-310591802-project Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a8f7ab6120c547b592479d79344d6850 Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TaggedBootDevicesTest_v242-310591802-project Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'eaf17622-cd7a-4eec-a280-3ddf0a36b238'} Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:55.106056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:19:55.119821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:55.119821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:19:55.119821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:19:55.119821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:19:55.119821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:19:55.119821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:19:55.119821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:19:55.119821 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:19:55.123248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5093d267-a830-47b0-be14-803390a7df18 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:55.123879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Returning 404 to user: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:19:55.127737 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3f75a51b-5bdf-4043-a740-e6e51de120b6 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 404 len: 111 microversion: 2.42 time: 0.101871 Aug 04 14:19:55.130116 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2307/4580] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:19:55 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:19:55.149740 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5093d267-a830-47b0-be14-803390a7df18 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.358434 Aug 04 14:19:55.153505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0fbb018e-38b0-4be5-a41a-fadf814b8d47 req-a703796c-ec01-4e6d-81d5-4bdde18dd669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "444faa71-7547-4fc3-9a24-587f64fe4725", "tag": "11891ab9-6db2-45ad-bc4b-0b6c6b803638"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:55.165150 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2274/4581] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:54 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:55.171890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3bad81d4-cd7a-47cc-a056-35ada795562d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:55.177486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3bad81d4-cd7a-47cc-a056-35ada795562d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:55.187481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3bad81d4-cd7a-47cc-a056-35ada795562d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:55.187744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0fbb018e-38b0-4be5-a41a-fadf814b8d47 req-a703796c-ec01-4e6d-81d5-4bdde18dd669 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:55.187744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0fbb018e-38b0-4be5-a41a-fadf814b8d47 req-a703796c-ec01-4e6d-81d5-4bdde18dd669 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.188094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3bad81d4-cd7a-47cc-a056-35ada795562d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.190272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3bad81d4-cd7a-47cc-a056-35ada795562d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:55.191063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3bad81d4-cd7a-47cc-a056-35ada795562d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.202702 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0fbb018e-38b0-4be5-a41a-fadf814b8d47 req-a703796c-ec01-4e6d-81d5-4bdde18dd669 service nova] Creating event network-changed:11891ab9-6db2-45ad-bc4b-0b6c6b803638 for instance 444faa71-7547-4fc3-9a24-587f64fe4725 on n-h2-844627-10 Aug 04 14:19:55.208735 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0fbb018e-38b0-4be5-a41a-fadf814b8d47 req-a703796c-ec01-4e6d-81d5-4bdde18dd669 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075953 Aug 04 14:19:55.210144 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2308/4582] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:55.217430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4b780928-df65-44d6-9c61-baf536938e38 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '.version_select at 0x7f46f300f0d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:55.527123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3bad81d4-cd7a-47cc-a056-35ada795562d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:55.536427 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3bad81d4-cd7a-47cc-a056-35ada795562d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.369057 Aug 04 14:19:55.537160 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2275/4583] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:55 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:55.543528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a008a4b2-28e3-4809-b76a-5520983aa90f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '.version_select at 0x7f4700316670>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:55.572701 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a008a4b2-28e3-4809-b76a-5520983aa90f tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-828973960" status: 204 len: 0 microversion: 2.42 time: 0.033509 Aug 04 14:19:55.577100 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2276/4584] 10.222.0.66 () {60 vars in 1259 bytes} [Thu Aug 4 14:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-828973960 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:19:55.580305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-531bc886-516e-4fe7-894d-ec33f1fc479c tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:55.581037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-531bc886-516e-4fe7-894d-ec33f1fc479c tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:55.589418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-531bc886-516e-4fe7-894d-ec33f1fc479c tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:55.589893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-531bc886-516e-4fe7-894d-ec33f1fc479c tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.590864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-531bc886-516e-4fe7-894d-ec33f1fc479c tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:55.592524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-531bc886-516e-4fe7-894d-ec33f1fc479c tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.747855 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4b780928-df65-44d6-9c61-baf536938e38 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "DELETE /compute/v2.1/os-security-groups/a6a118c6-2049-4477-b0a2-e4bd292adedf" status: 202 len: 0 microversion: 2.1 time: 0.536004 Aug 04 14:19:55.748924 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2309/4585] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 14:19:55 2022] DELETE /compute/v2.1/os-security-groups/a6a118c6-2049-4477-b0a2-e4bd292adedf => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:19:55.755140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4fbdc122-febe-4b6a-a3eb-63ff05cfa4dc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:55.755954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4fbdc122-febe-4b6a-a3eb-63ff05cfa4dc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:55.766134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fbdc122-febe-4b6a-a3eb-63ff05cfa4dc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:55.766999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fbdc122-febe-4b6a-a3eb-63ff05cfa4dc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.768327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fbdc122-febe-4b6a-a3eb-63ff05cfa4dc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:55.769190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fbdc122-febe-4b6a-a3eb-63ff05cfa4dc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:55.984921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-531bc886-516e-4fe7-894d-ec33f1fc479c tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:55.996280 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-531bc886-516e-4fe7-894d-ec33f1fc479c tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1313 microversion: 2.1 time: 0.421556 Aug 04 14:19:56.009661 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2277/4586] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:55 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:56.019285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fe6de6a5-38b9-4218-9deb-024007cbba11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:56.020111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fe6de6a5-38b9-4218-9deb-024007cbba11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:56.026988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fe6de6a5-38b9-4218-9deb-024007cbba11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.027694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fe6de6a5-38b9-4218-9deb-024007cbba11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.028658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fe6de6a5-38b9-4218-9deb-024007cbba11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.029135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fe6de6a5-38b9-4218-9deb-024007cbba11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.059886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fe6de6a5-38b9-4218-9deb-024007cbba11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:19:56.075083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4fbdc122-febe-4b6a-a3eb-63ff05cfa4dc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:56.092212 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4fbdc122-febe-4b6a-a3eb-63ff05cfa4dc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.341606 Aug 04 14:19:56.104905 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2310/4587] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:55 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:56.104905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-44819f3a-0e7f-4868-97dc-c49a3faee940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:56.105665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-44819f3a-0e7f-4868-97dc-c49a3faee940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:56.118075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44819f3a-0e7f-4868-97dc-c49a3faee940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.120368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44819f3a-0e7f-4868-97dc-c49a3faee940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.121987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44819f3a-0e7f-4868-97dc-c49a3faee940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.125196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44819f3a-0e7f-4868-97dc-c49a3faee940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.185547 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-44819f3a-0e7f-4868-97dc-c49a3faee940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089235 Aug 04 14:19:56.187494 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2311/4588] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:56 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:56.192990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-03d6d237-00f0-4838-b5a3-4d2096a37e60 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:56.194160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03d6d237-00f0-4838-b5a3-4d2096a37e60 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:56.198282 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fe6de6a5-38b9-4218-9deb-024007cbba11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "DELETE /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 204 len: 0 microversion: 2.1 time: 0.186800 Aug 04 14:19:56.199433 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2278/4589] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:19:56 2022] DELETE /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:19:56.201974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03d6d237-00f0-4838-b5a3-4d2096a37e60 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.203201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03d6d237-00f0-4838-b5a3-4d2096a37e60 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.204308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03d6d237-00f0-4838-b5a3-4d2096a37e60 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.204774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03d6d237-00f0-4838-b5a3-4d2096a37e60 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.209685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6fd6aa6b-6495-40fa-9820-f0ec5da9dd48 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:56.210428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6fd6aa6b-6495-40fa-9820-f0ec5da9dd48 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:56.219197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fd6aa6b-6495-40fa-9820-f0ec5da9dd48 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.219793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fd6aa6b-6495-40fa-9820-f0ec5da9dd48 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.221231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fd6aa6b-6495-40fa-9820-f0ec5da9dd48 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.221714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fd6aa6b-6495-40fa-9820-f0ec5da9dd48 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.472574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-03d6d237-00f0-4838-b5a3-4d2096a37e60 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:56.491864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6fd6aa6b-6495-40fa-9820-f0ec5da9dd48 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:56.497273 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-03d6d237-00f0-4838-b5a3-4d2096a37e60 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.308248 Aug 04 14:19:56.498813 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2312/4590] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:56 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:56.501718 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6fd6aa6b-6495-40fa-9820-f0ec5da9dd48 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.300805 Aug 04 14:19:56.504915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c798a8df-e7ed-4f02-acee-fa75fa569a11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:56.505857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c798a8df-e7ed-4f02-acee-fa75fa569a11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:56.514090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c798a8df-e7ed-4f02-acee-fa75fa569a11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.515338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c798a8df-e7ed-4f02-acee-fa75fa569a11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.516473 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2279/4591] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:56 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:56.517071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c798a8df-e7ed-4f02-acee-fa75fa569a11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:56.517778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c798a8df-e7ed-4f02-acee-fa75fa569a11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:56.753865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c798a8df-e7ed-4f02-acee-fa75fa569a11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:56.772783 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c798a8df-e7ed-4f02-acee-fa75fa569a11 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1508 microversion: 2.1 time: 0.271468 Aug 04 14:19:56.775317 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2313/4592] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:56 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:57.028917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4a5c3779-4ce3-4539-b51d-8c2a1a2aaaac tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:57.030098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4a5c3779-4ce3-4539-b51d-8c2a1a2aaaac tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:57.042617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a5c3779-4ce3-4539-b51d-8c2a1a2aaaac tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:57.043452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a5c3779-4ce3-4539-b51d-8c2a1a2aaaac tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:57.044949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a5c3779-4ce3-4539-b51d-8c2a1a2aaaac tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:57.045768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a5c3779-4ce3-4539-b51d-8c2a1a2aaaac tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:57.212006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-13ef1921-6ca1-484c-9e1a-c78e4d7252b9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:57.221927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-13ef1921-6ca1-484c-9e1a-c78e4d7252b9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:57.241826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13ef1921-6ca1-484c-9e1a-c78e4d7252b9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:57.244362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13ef1921-6ca1-484c-9e1a-c78e4d7252b9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:57.246839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13ef1921-6ca1-484c-9e1a-c78e4d7252b9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:57.247989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13ef1921-6ca1-484c-9e1a-c78e4d7252b9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:57.317412 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-13ef1921-6ca1-484c-9e1a-c78e4d7252b9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119422 Aug 04 14:19:57.317726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4a5c3779-4ce3-4539-b51d-8c2a1a2aaaac tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:57.319172 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2314/4593] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:57 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:57.332206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4a5c3779-4ce3-4539-b51d-8c2a1a2aaaac tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1313 microversion: 2.1 time: 0.310501 Aug 04 14:19:57.333562 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2280/4594] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:57 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:57.528755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b6be07d-70e8-4a29-b12a-7e28a6a4224f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:57.530057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1b6be07d-70e8-4a29-b12a-7e28a6a4224f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:57.543535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b6be07d-70e8-4a29-b12a-7e28a6a4224f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:57.546258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b6be07d-70e8-4a29-b12a-7e28a6a4224f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:57.548019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b6be07d-70e8-4a29-b12a-7e28a6a4224f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:57.549166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b6be07d-70e8-4a29-b12a-7e28a6a4224f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:57.805491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fdc4479a-6819-423d-b873-c818a114412d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:57.808509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fdc4479a-6819-423d-b873-c818a114412d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:57.839466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fdc4479a-6819-423d-b873-c818a114412d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:57.840018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fdc4479a-6819-423d-b873-c818a114412d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:57.843202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fdc4479a-6819-423d-b873-c818a114412d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:57.844020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fdc4479a-6819-423d-b873-c818a114412d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:57.946475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1b6be07d-70e8-4a29-b12a-7e28a6a4224f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:57.992161 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1b6be07d-70e8-4a29-b12a-7e28a6a4224f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.470489 Aug 04 14:19:57.993335 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2315/4595] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:57 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:58.263207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fdc4479a-6819-423d-b873-c818a114412d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:58.280230 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fdc4479a-6819-423d-b873-c818a114412d tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1508 microversion: 2.1 time: 0.483563 Aug 04 14:19:58.292197 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2281/4596] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:57 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1508 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:58.336810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3022a205-5f17-4814-9663-1cb6d463df3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:58.341440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3022a205-5f17-4814-9663-1cb6d463df3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:58.358795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3022a205-5f17-4814-9663-1cb6d463df3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:58.360463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3022a205-5f17-4814-9663-1cb6d463df3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:58.362533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3022a205-5f17-4814-9663-1cb6d463df3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:58.363701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3022a205-5f17-4814-9663-1cb6d463df3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:58.373384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-065303ae-69b2-490e-9331-df8ecd828f57 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:58.374937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-065303ae-69b2-490e-9331-df8ecd828f57 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:58.387519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-065303ae-69b2-490e-9331-df8ecd828f57 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:58.389120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-065303ae-69b2-490e-9331-df8ecd828f57 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:58.391930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-065303ae-69b2-490e-9331-df8ecd828f57 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:58.393123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-065303ae-69b2-490e-9331-df8ecd828f57 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:58.403071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:19:58.441879 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3022a205-5f17-4814-9663-1cb6d463df3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113925 Aug 04 14:19:58.443415 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2316/4597] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:58 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:19:59.040717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20f1ed64-a663-425f-bad3-a292a0c5cc1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:59.041822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-065303ae-69b2-490e-9331-df8ecd828f57 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:59.042718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-20f1ed64-a663-425f-bad3-a292a0c5cc1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:59.059869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20f1ed64-a663-425f-bad3-a292a0c5cc1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:59.061242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20f1ed64-a663-425f-bad3-a292a0c5cc1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:59.063891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20f1ed64-a663-425f-bad3-a292a0c5cc1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:59.065147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20f1ed64-a663-425f-bad3-a292a0c5cc1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:59.066353 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-065303ae-69b2-490e-9331-df8ecd828f57 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1313 microversion: 2.1 time: 0.704105 Aug 04 14:19:59.074800 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2282/4598] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:58 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:19:59.322035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a762d9cb-7a0f-4bf0-97ff-145fc8e74da4 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:59.324672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a762d9cb-7a0f-4bf0-97ff-145fc8e74da4 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:59.336607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a762d9cb-7a0f-4bf0-97ff-145fc8e74da4 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:59.338049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a762d9cb-7a0f-4bf0-97ff-145fc8e74da4 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:59.340085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a762d9cb-7a0f-4bf0-97ff-145fc8e74da4 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:59.341381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a762d9cb-7a0f-4bf0-97ff-145fc8e74da4 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:59.371646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-20f1ed64-a663-425f-bad3-a292a0c5cc1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:59.406437 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-20f1ed64-a663-425f-bad3-a292a0c5cc1b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.373381 Aug 04 14:19:59.426479 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2317/4599] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:59 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:59.456143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b9e3e55-6647-40fe-a197-f990765a7646 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:19:59.458904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1b9e3e55-6647-40fe-a197-f990765a7646 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:19:59.477156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b9e3e55-6647-40fe-a197-f990765a7646 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:59.480945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b9e3e55-6647-40fe-a197-f990765a7646 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:59.483996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b9e3e55-6647-40fe-a197-f990765a7646 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:59.485414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b9e3e55-6647-40fe-a197-f990765a7646 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:59.606284 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1b9e3e55-6647-40fe-a197-f990765a7646 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154824 Aug 04 14:19:59.609297 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2318/4600] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:19:59 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:19:59.737214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a762d9cb-7a0f-4bf0-97ff-145fc8e74da4 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ab34dc1521483ca16811f47fa8f8a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284ac84d1a804131a8d614aa004a3e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:19:59.818529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a2ceec6a-7c3e-425d-a152-74ae9131cad3 req-6d217d62-64de-4fb8-b710-5e6ecf901b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d1ed22-9377-4fbc-ae8b-543d1beffcaa", "name": "network-vif-deleted", "tag": "b861c6f3-367f-4e61-9b65-f9765748ba2c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:19:59.829032 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a762d9cb-7a0f-4bf0-97ff-145fc8e74da4 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 200 len: 1508 microversion: 2.1 time: 0.510739 Aug 04 14:19:59.830198 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2283/4601] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:19:59 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 1508 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:19:59.833890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a2ceec6a-7c3e-425d-a152-74ae9131cad3 req-6d217d62-64de-4fb8-b710-5e6ecf901b27 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:19:59.834714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a2ceec6a-7c3e-425d-a152-74ae9131cad3 req-6d217d62-64de-4fb8-b710-5e6ecf901b27 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:19:59.854439 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a2ceec6a-7c3e-425d-a152-74ae9131cad3 req-6d217d62-64de-4fb8-b710-5e6ecf901b27 service nova] Creating event network-vif-deleted:b861c6f3-367f-4e61-9b65-f9765748ba2c for instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa on n-h2-844627-10 Aug 04 14:19:59.862843 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a2ceec6a-7c3e-425d-a152-74ae9131cad3 req-6d217d62-64de-4fb8-b710-5e6ecf901b27 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067020 Aug 04 14:19:59.869447 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2319/4602] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 14:19:59.973050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-56a43d78-2c28-45e7-bec1-bf9f9fb6eec6 req-fdfcf68f-83d7-4820-9f5e-45f2c2dab9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "444faa71-7547-4fc3-9a24-587f64fe4725", "name": "network-vif-plugged", "status": "completed", "tag": "11891ab9-6db2-45ad-bc4b-0b6c6b803638"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:00.028553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-56a43d78-2c28-45e7-bec1-bf9f9fb6eec6 req-fdfcf68f-83d7-4820-9f5e-45f2c2dab9bf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:00.029324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-56a43d78-2c28-45e7-bec1-bf9f9fb6eec6 req-fdfcf68f-83d7-4820-9f5e-45f2c2dab9bf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:00.083467 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-56a43d78-2c28-45e7-bec1-bf9f9fb6eec6 req-fdfcf68f-83d7-4820-9f5e-45f2c2dab9bf service nova] Creating event network-vif-plugged:11891ab9-6db2-45ad-bc4b-0b6c6b803638 for instance 444faa71-7547-4fc3-9a24-587f64fe4725 on n-h2-844627-10 Aug 04 14:20:00.093037 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-56a43d78-2c28-45e7-bec1-bf9f9fb6eec6 req-fdfcf68f-83d7-4820-9f5e-45f2c2dab9bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133146 Aug 04 14:20:00.094069 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2284/4603] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:00.100048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e1d4066e-7a1f-4199-99bb-995c8356b8bd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:00.107585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e1d4066e-7a1f-4199-99bb-995c8356b8bd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:00.137951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1d4066e-7a1f-4199-99bb-995c8356b8bd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:00.138854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1d4066e-7a1f-4199-99bb-995c8356b8bd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:00.173952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1d4066e-7a1f-4199-99bb-995c8356b8bd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:00.175831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1d4066e-7a1f-4199-99bb-995c8356b8bd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:00.439528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ea9e3e5f-dbf9-470c-b92c-a23b58601368 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:00.440813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ea9e3e5f-dbf9-470c-b92c-a23b58601368 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:00.468168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea9e3e5f-dbf9-470c-b92c-a23b58601368 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:00.469853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea9e3e5f-dbf9-470c-b92c-a23b58601368 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:00.475501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea9e3e5f-dbf9-470c-b92c-a23b58601368 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:00.478685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea9e3e5f-dbf9-470c-b92c-a23b58601368 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:00.636548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e1d4066e-7a1f-4199-99bb-995c8356b8bd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:00.671250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:00.683589 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e1d4066e-7a1f-4199-99bb-995c8356b8bd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1313 microversion: 2.1 time: 0.595202 Aug 04 14:20:00.689021 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2320/4604] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:00 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:00.698698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f821c3c7-46d6-4a39-b86e-e53326c0ab59 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:00.708080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f821c3c7-46d6-4a39-b86e-e53326c0ab59 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:00.712209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:00.741151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f821c3c7-46d6-4a39-b86e-e53326c0ab59 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:00.751363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f821c3c7-46d6-4a39-b86e-e53326c0ab59 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:00.754808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f821c3c7-46d6-4a39-b86e-e53326c0ab59 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:00.758078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f821c3c7-46d6-4a39-b86e-e53326c0ab59 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:00.875253 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f821c3c7-46d6-4a39-b86e-e53326c0ab59 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.183606 Aug 04 14:20:00.886261 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2321/4605] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:20:00 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d/os-volume_attachments => generated 25 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:20:00.909360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:00.910763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] [instance: 35d1ed22-9377-4fbc-ae8b-543d1beffcaa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:00.942618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:00.942618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:00.946298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:00.946298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:01.011992 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] HTTP exception thrown: Instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa could not be found. Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Request method failure captured: Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa HTTP/1.1 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69U7gAcbpVvpjHQ8-6KRdt5agH-nopmR8pXwjgLRwSA527fh8Tpy9YSyVxenOGsyJl3rLl7jktTfvfeGu7enocvjn8BmCVQBI7gWIpwBoG5CVehqhTSyAyS2x27lUzL9JyxKaWcEZm_EN9DUloeiu1a2uEMigfzJlhpKNQNPPmMyq4c Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 284ac84d1a804131a8d614aa004a3e67 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-450009179 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/284ac84d1a804131a8d614aa004a3e67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_284ac84d1a804131a8d614aa004a3e67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/284ac84d1a804131a8d614aa004a3e67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/284ac84d1a804131a8d614aa004a3e67"}]}] Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-450009179 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 284ac84d1a804131a8d614aa004a3e67 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-450009179 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerRescueTestJSONUnderV235-450009179-project Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c7ab34dc1521483ca16811f47fa8f8a2 Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-450009179-project Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa could not be found. Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '35d1ed22-9377-4fbc-ae8b-543d1beffcaa'} Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa could not be found. Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa could not be found. Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:01.021881 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa could not be found. Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] Returning 404 to user: Instance 35d1ed22-9377-4fbc-ae8b-543d1beffcaa could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a85353e5-343a-43c8-b742-113264570a21 tempest-ServerRescueTestJSONUnderV235-450009179 tempest-ServerRescueTestJSONUnderV235-450009179-project] 10.222.0.66 "GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa" status: 404 len: 111 microversion: 2.1 time: 0.136294 Aug 04 14:20:01.036435 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2322/4606] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:00 2022] GET /compute/v2.1/servers/35d1ed22-9377-4fbc-ae8b-543d1beffcaa => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:20:01.098558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6e3cf453-697c-4da9-880f-c0131b77653a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:01.099473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6e3cf453-697c-4da9-880f-c0131b77653a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:01.131660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e3cf453-697c-4da9-880f-c0131b77653a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:01.132785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e3cf453-697c-4da9-880f-c0131b77653a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:01.134709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e3cf453-697c-4da9-880f-c0131b77653a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:01.146114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6e3cf453-697c-4da9-880f-c0131b77653a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:01.286745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ea9e3e5f-dbf9-470c-b92c-a23b58601368 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:01.294103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6e3cf453-697c-4da9-880f-c0131b77653a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:20:01.316787 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ea9e3e5f-dbf9-470c-b92c-a23b58601368 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.884860 Aug 04 14:20:01.334693 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2285/4607] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:00 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:01.448132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:01.481428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:01.525855 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6e3cf453-697c-4da9-880f-c0131b77653a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 204 len: 0 microversion: 2.1 time: 0.434329 Aug 04 14:20:01.527717 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2323/4608] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:20:01 2022] DELETE /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:20:01.540932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c9f8b2c4-716a-4481-8829-51e6852680a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:01.543651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c9f8b2c4-716a-4481-8829-51e6852680a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:01.565641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9f8b2c4-716a-4481-8829-51e6852680a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:01.567132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9f8b2c4-716a-4481-8829-51e6852680a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:01.569484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9f8b2c4-716a-4481-8829-51e6852680a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:01.571112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9f8b2c4-716a-4481-8829-51e6852680a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:01.743746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2f35e224-c68f-48bd-982a-e7f151f302f1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:01.749882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2f35e224-c68f-48bd-982a-e7f151f302f1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:01.781571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f35e224-c68f-48bd-982a-e7f151f302f1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:01.782586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f35e224-c68f-48bd-982a-e7f151f302f1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:01.784131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f35e224-c68f-48bd-982a-e7f151f302f1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:01.785097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f35e224-c68f-48bd-982a-e7f151f302f1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:01.995608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c9f8b2c4-716a-4481-8829-51e6852680a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:02.018392 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c9f8b2c4-716a-4481-8829-51e6852680a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1682 microversion: 2.1 time: 0.483535 Aug 04 14:20:02.019819 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2286/4609] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:01 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1682 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:02.276279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2f35e224-c68f-48bd-982a-e7f151f302f1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:02.294475 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2f35e224-c68f-48bd-982a-e7f151f302f1 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1313 microversion: 2.1 time: 0.558892 Aug 04 14:20:02.311614 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2324/4610] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:01 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1313 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:02.353558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c56de44-cefa-46f9-bf0e-04a79e7f1432 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:02.354619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7c56de44-cefa-46f9-bf0e-04a79e7f1432 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:02.363207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c56de44-cefa-46f9-bf0e-04a79e7f1432 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:02.364066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c56de44-cefa-46f9-bf0e-04a79e7f1432 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:02.365234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c56de44-cefa-46f9-bf0e-04a79e7f1432 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:02.365959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c56de44-cefa-46f9-bf0e-04a79e7f1432 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:02.665394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c56de44-cefa-46f9-bf0e-04a79e7f1432 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:02.674500 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c56de44-cefa-46f9-bf0e-04a79e7f1432 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.325362 Aug 04 14:20:02.675210 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2287/4611] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:02 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:03.059040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c379c240-108e-4f0b-888d-759f08cfdbdb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:03.060090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c379c240-108e-4f0b-888d-759f08cfdbdb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:03.081422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c379c240-108e-4f0b-888d-759f08cfdbdb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:03.082257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c379c240-108e-4f0b-888d-759f08cfdbdb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:03.094932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c379c240-108e-4f0b-888d-759f08cfdbdb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:03.096142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c379c240-108e-4f0b-888d-759f08cfdbdb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:03.334984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-45c3bac4-e1b4-44b4-9bc0-cf0439682028 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:03.335894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-45c3bac4-e1b4-44b4-9bc0-cf0439682028 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:03.339365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:03.345336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45c3bac4-e1b4-44b4-9bc0-cf0439682028 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:03.346068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45c3bac4-e1b4-44b4-9bc0-cf0439682028 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:03.347108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45c3bac4-e1b4-44b4-9bc0-cf0439682028 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:03.347724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45c3bac4-e1b4-44b4-9bc0-cf0439682028 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:03.643823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c379c240-108e-4f0b-888d-759f08cfdbdb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:03.662190 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c379c240-108e-4f0b-888d-759f08cfdbdb tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1682 microversion: 2.1 time: 0.601933 Aug 04 14:20:03.673488 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2325/4612] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:03 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1682 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:03.697669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da28275e-bf76-4d4a-9bc9-9b800a46b7c6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:03.698304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-da28275e-bf76-4d4a-9bc9-9b800a46b7c6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:03.709373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da28275e-bf76-4d4a-9bc9-9b800a46b7c6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:03.709844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da28275e-bf76-4d4a-9bc9-9b800a46b7c6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:03.710662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da28275e-bf76-4d4a-9bc9-9b800a46b7c6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:03.711117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da28275e-bf76-4d4a-9bc9-9b800a46b7c6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:03.739855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-45c3bac4-e1b4-44b4-9bc0-cf0439682028 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:03.759728 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-45c3bac4-e1b4-44b4-9bc0-cf0439682028 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1500 microversion: 2.1 time: 0.427941 Aug 04 14:20:03.761884 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2288/4613] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:03 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1500 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:03.790747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec3aa7ac-2274-41da-9464-e79428dec554 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:03.797137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ec3aa7ac-2274-41da-9464-e79428dec554 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:03.808317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec3aa7ac-2274-41da-9464-e79428dec554 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:03.809217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec3aa7ac-2274-41da-9464-e79428dec554 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:03.810283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec3aa7ac-2274-41da-9464-e79428dec554 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:03.811020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec3aa7ac-2274-41da-9464-e79428dec554 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:03.851390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-ec3aa7ac-2274-41da-9464-e79428dec554 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lazy-loading 'flavor' on Instance uuid 444faa71-7547-4fc3-9a24-587f64fe4725 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:20:04.071815 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec3aa7ac-2274-41da-9464-e79428dec554 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "POST /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725/action" status: 200 len: 32 microversion: 2.1 time: 0.289895 Aug 04 14:20:04.078359 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2289/4614] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:20:03 2022] POST /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725/action => generated 32 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:20:04.088949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:04.090601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:04.111646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:04.112822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:04.114515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:04.115524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:04.179613 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] HTTP exception thrown: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Request method failure captured: Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 HTTP/1.1 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69PFiiVttCTqqVFi1ozi-YiC3bZuA8o0VpcTsWogjl1DL0lE3RjsHZek9-Po5WDTEzhgvOxME8dl8C5qLiYNKT4-J7hoS4JEHBMibqaebzNjtGp2pVnfqvNN812e85X_oI5leXmNGYkLU6XtCGjNnnBI7f1QWiNgVjTu8S2lVWQpFMw Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c99a5688f72e43d0be0f0b8e175344b0 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-310591802 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c99a5688f72e43d0be0f0b8e175344b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c99a5688f72e43d0be0f0b8e175344b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c99a5688f72e43d0be0f0b8e175344b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c99a5688f72e43d0be0f0b8e175344b0"}]}] Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TaggedBootDevicesTest_v242-310591802 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c99a5688f72e43d0be0f0b8e175344b0 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-310591802 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TaggedBootDevicesTest_v242-310591802-project Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: a8f7ab6120c547b592479d79344d6850 Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TaggedBootDevicesTest_v242-310591802-project Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'eaf17622-cd7a-4eec-a280-3ddf0a36b238'} Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:20:04.209592 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Returning 404 to user: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-778e0388-1a8e-41c8-bb13-50832af5e407 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 404 len: 111 microversion: 2.42 time: 0.123255 Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2290/4615] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:20:04 2022] DELETE /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9475e1ed-c6d0-4a13-9360-bfc0c9d87ab8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:04.224290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9475e1ed-c6d0-4a13-9360-bfc0c9d87ab8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:04.239852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9475e1ed-c6d0-4a13-9360-bfc0c9d87ab8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:04.240480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9475e1ed-c6d0-4a13-9360-bfc0c9d87ab8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:04.243261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9475e1ed-c6d0-4a13-9360-bfc0c9d87ab8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:04.251865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9475e1ed-c6d0-4a13-9360-bfc0c9d87ab8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:04.340332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-da28275e-bf76-4d4a-9bc9-9b800a46b7c6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:04.350967 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-da28275e-bf76-4d4a-9bc9-9b800a46b7c6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.657009 Aug 04 14:20:04.352032 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2326/4616] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:03 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:04.357378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:04.358838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] [instance: eaf17622-cd7a-4eec-a280-3ddf0a36b238] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:04.368976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:04.369789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:04.370766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:04.371556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:04.397084 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] HTTP exception thrown: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Request method failure captured: Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 HTTP/1.1 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69PFiiVttCTqqVFi1ozi-YiC3bZuA8o0VpcTsWogjl1DL0lE3RjsHZek9-Po5WDTEzhgvOxME8dl8C5qLiYNKT4-J7hoS4JEHBMibqaebzNjtGp2pVnfqvNN812e85X_oI5leXmNGYkLU6XtCGjNnnBI7f1QWiNgVjTu8S2lVWQpFMw Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: c99a5688f72e43d0be0f0b8e175344b0 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-310591802 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c99a5688f72e43d0be0f0b8e175344b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c99a5688f72e43d0be0f0b8e175344b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c99a5688f72e43d0be0f0b8e175344b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c99a5688f72e43d0be0f0b8e175344b0"}]}] Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TaggedBootDevicesTest_v242-310591802 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: c99a5688f72e43d0be0f0b8e175344b0 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-310591802 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TaggedBootDevicesTest_v242-310591802-project Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a8f7ab6120c547b592479d79344d6850 Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TaggedBootDevicesTest_v242-310591802-project Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'eaf17622-cd7a-4eec-a280-3ddf0a36b238'} Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.401087 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:04.405944 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.405944 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:04.405944 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:04.405944 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:04.405944 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:04.405944 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:04.405944 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. Aug 04 14:20:04.405944 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:04.406658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] Returning 404 to user: Instance eaf17622-cd7a-4eec-a280-3ddf0a36b238 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:04.408309 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a867631f-58df-4af2-b395-af72fa0261b5 tempest-TaggedBootDevicesTest_v242-310591802 tempest-TaggedBootDevicesTest_v242-310591802-project] 10.222.0.66 "GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238" status: 404 len: 111 microversion: 2.42 time: 0.054779 Aug 04 14:20:04.409402 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2327/4617] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:20:04 2022] GET /compute/v2.1/servers/eaf17622-cd7a-4eec-a280-3ddf0a36b238 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:20:04.706519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35e23dfc-26dd-460e-aeb1-cf6d2c4454c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:04.707864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-35e23dfc-26dd-460e-aeb1-cf6d2c4454c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:04.721067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35e23dfc-26dd-460e-aeb1-cf6d2c4454c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:04.721869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35e23dfc-26dd-460e-aeb1-cf6d2c4454c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:04.723257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35e23dfc-26dd-460e-aeb1-cf6d2c4454c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:04.724062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35e23dfc-26dd-460e-aeb1-cf6d2c4454c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:04.821095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9475e1ed-c6d0-4a13-9360-bfc0c9d87ab8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:04.848626 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9475e1ed-c6d0-4a13-9360-bfc0c9d87ab8 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.640143 Aug 04 14:20:04.855482 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2291/4618] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:04 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:05.387579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-778d85e0-b68b-4c3c-93e6-49e76699fde5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:05.388221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-778d85e0-b68b-4c3c-93e6-49e76699fde5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:05.402998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-778d85e0-b68b-4c3c-93e6-49e76699fde5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:05.406128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-778d85e0-b68b-4c3c-93e6-49e76699fde5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:05.407311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-778d85e0-b68b-4c3c-93e6-49e76699fde5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:05.408847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-778d85e0-b68b-4c3c-93e6-49e76699fde5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:05.444061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-35e23dfc-26dd-460e-aeb1-cf6d2c4454c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:05.455037 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-35e23dfc-26dd-460e-aeb1-cf6d2c4454c2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1682 microversion: 2.1 time: 0.755877 Aug 04 14:20:05.475107 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2328/4619] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:04 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1682 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:05.880404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82d45853-2c50-4e33-a785-e4037e580f5f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:05.882047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-82d45853-2c50-4e33-a785-e4037e580f5f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:05.891130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82d45853-2c50-4e33-a785-e4037e580f5f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:05.891883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82d45853-2c50-4e33-a785-e4037e580f5f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:05.892913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82d45853-2c50-4e33-a785-e4037e580f5f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:05.893577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82d45853-2c50-4e33-a785-e4037e580f5f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:06.469323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-778d85e0-b68b-4c3c-93e6-49e76699fde5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:06.509160 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-778d85e0-b68b-4c3c-93e6-49e76699fde5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 1.120514 Aug 04 14:20:06.510986 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2292/4620] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:05 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:06.540160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c5fd8d2-8c9d-43ac-a009-54fd62f29cf3 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:06.542636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8c5fd8d2-8c9d-43ac-a009-54fd62f29cf3 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:06.568069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c5fd8d2-8c9d-43ac-a009-54fd62f29cf3 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:06.569507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c5fd8d2-8c9d-43ac-a009-54fd62f29cf3 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:06.570363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c5fd8d2-8c9d-43ac-a009-54fd62f29cf3 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:06.571005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c5fd8d2-8c9d-43ac-a009-54fd62f29cf3 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:06.788035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8c5fd8d2-8c9d-43ac-a009-54fd62f29cf3 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:06.806400 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8c5fd8d2-8c9d-43ac-a009-54fd62f29cf3 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1615 microversion: 2.1 time: 0.292961 Aug 04 14:20:06.812178 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2293/4621] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:06 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1615 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:06.969292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82d45853-2c50-4e33-a785-e4037e580f5f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:06.998243 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-82d45853-2c50-4e33-a785-e4037e580f5f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 1.123229 Aug 04 14:20:07.002377 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2329/4622] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:05 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:07.562304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d8315be-87c6-4286-9bc3-c305624f6fa2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:07.565316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7d8315be-87c6-4286-9bc3-c305624f6fa2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:07.584135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d8315be-87c6-4286-9bc3-c305624f6fa2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:07.585620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d8315be-87c6-4286-9bc3-c305624f6fa2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:07.590426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d8315be-87c6-4286-9bc3-c305624f6fa2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:07.591794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d8315be-87c6-4286-9bc3-c305624f6fa2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:07.852838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ed1ba2d2-329f-4917-addd-6eb080197067 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:07.853681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ed1ba2d2-329f-4917-addd-6eb080197067 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:07.878153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed1ba2d2-329f-4917-addd-6eb080197067 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:07.878641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed1ba2d2-329f-4917-addd-6eb080197067 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:07.879824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed1ba2d2-329f-4917-addd-6eb080197067 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:07.880303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed1ba2d2-329f-4917-addd-6eb080197067 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:08.147460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ed1ba2d2-329f-4917-addd-6eb080197067 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:08.172098 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ed1ba2d2-329f-4917-addd-6eb080197067 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 200 len: 1327 microversion: 2.1 time: 0.319432 Aug 04 14:20:08.188909 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2330/4623] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:07 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 1327 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:08.194572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3a3106cf-7796-419c-9b29-2ccb45a9c35b req-b13d7e0a-9373-4670-9f08-f3207e90452d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d", "name": "network-vif-deleted", "tag": "89667c90-91f3-4574-83a4-7ed1a8cc99ff"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:08.198851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7d8315be-87c6-4286-9bc3-c305624f6fa2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:08.216849 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7d8315be-87c6-4286-9bc3-c305624f6fa2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.672463 Aug 04 14:20:08.221205 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2294/4624] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:07 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:08.231519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c091781-4e26-4e67-bc3d-e23e0c9bcbc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:08.237812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c091781-4e26-4e67-bc3d-e23e0c9bcbc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:08.240524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3a3106cf-7796-419c-9b29-2ccb45a9c35b req-b13d7e0a-9373-4670-9f08-f3207e90452d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:08.249794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3a3106cf-7796-419c-9b29-2ccb45a9c35b req-b13d7e0a-9373-4670-9f08-f3207e90452d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:08.259070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c091781-4e26-4e67-bc3d-e23e0c9bcbc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:08.259537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c091781-4e26-4e67-bc3d-e23e0c9bcbc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:08.260350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c091781-4e26-4e67-bc3d-e23e0c9bcbc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:08.260802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c091781-4e26-4e67-bc3d-e23e0c9bcbc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:08.271759 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3a3106cf-7796-419c-9b29-2ccb45a9c35b req-b13d7e0a-9373-4670-9f08-f3207e90452d service nova] Creating event network-vif-deleted:89667c90-91f3-4574-83a4-7ed1a8cc99ff for instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d on n-h1-844627-10 Aug 04 14:20:08.283685 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3a3106cf-7796-419c-9b29-2ccb45a9c35b req-b13d7e0a-9373-4670-9f08-f3207e90452d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107876 Aug 04 14:20:08.288497 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2331/4625] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:08.534204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3c091781-4e26-4e67-bc3d-e23e0c9bcbc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:08.551527 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c091781-4e26-4e67-bc3d-e23e0c9bcbc5 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.328770 Aug 04 14:20:08.552596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2295/4626] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:08 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:09.212470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:09.214123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:09.226631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:09.227442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:09.228495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:09.229238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:09.252263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4dccf5f7-f47c-475d-842e-e095f5b68d4f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:09.253870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4dccf5f7-f47c-475d-842e-e095f5b68d4f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:09.263385 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d HTTP/1.1 Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d'} Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:09.267358 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:09.275641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:09.275641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:09.275641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:09.275641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:09.275641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:09.275641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:20:09.275641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:09.276621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dccf5f7-f47c-475d-842e-e095f5b68d4f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:09.276621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dccf5f7-f47c-475d-842e-e095f5b68d4f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:09.276621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dccf5f7-f47c-475d-842e-e095f5b68d4f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:09.276621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4dccf5f7-f47c-475d-842e-e095f5b68d4f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:09.279139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:09.280822 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-48ab1f90-8ee7-45f3-98fe-b02d647422b2 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 404 len: 111 microversion: 2.1 time: 0.072636 Aug 04 14:20:09.282156 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2332/4627] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:09 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:20:09.294696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7de26d72-c3da-4d84-afff-3a9a7fb6ee6c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '.version_select at 0x7f46f3026dc0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:09.336465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7de26d72-c3da-4d84-afff-3a9a7fb6ee6c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994326237" status: 202 len: 0 microversion: 2.1 time: 0.049927 Aug 04 14:20:09.337532 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2333/4628] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:20:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994326237 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:20:09.599990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9e6bada-c093-401b-923c-cbbafeacc8b9 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:09.600971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a9e6bada-c093-401b-923c-cbbafeacc8b9 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:09.611236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9e6bada-c093-401b-923c-cbbafeacc8b9 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:09.612001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9e6bada-c093-401b-923c-cbbafeacc8b9 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:09.613233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9e6bada-c093-401b-923c-cbbafeacc8b9 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:09.614322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9e6bada-c093-401b-923c-cbbafeacc8b9 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:09.901622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4dccf5f7-f47c-475d-842e-e095f5b68d4f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:09.915195 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4dccf5f7-f47c-475d-842e-e095f5b68d4f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 0.667428 Aug 04 14:20:09.931219 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2296/4629] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:09 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:10.069894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a9e6bada-c093-401b-923c-cbbafeacc8b9 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:10.093734 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a9e6bada-c093-401b-923c-cbbafeacc8b9 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.506294 Aug 04 14:20:10.095253 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2334/4630] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:09 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:10.959247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:10.975764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:10.978164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-29844849-1760-459c-be82-ad74d6d3c9b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: .version_select at 0x7f46f3026e50>, body: {"keypair": {"name": "tempest-keypair-604762767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCO0BZB2BRCG2bYV/e9/WzV1n4cSSlIq68Gep43pz+d0x+acZ4yNRHvYRe3HVpr8ixVOzkPKwXcvKfjEDhuibwjXld4Xr6I04BGf67WfAh6VmxENEUqhgL4ZWzXXOxlAag=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:10.991884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:10.992768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:11.001334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:11.002746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:11.029557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-29844849-1760-459c-be82-ad74d6d3c9b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:20:11.048397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-29844849-1760-459c-be82-ad74d6d3c9b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for user 0a5b06982b8b43ef98866e495427d381 and project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:20:11.130232 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-29844849-1760-459c-be82-ad74d6d3c9b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156343 Aug 04 14:20:11.131264 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2335/4631] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:20:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:11.136345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-72faf346-eeb6-458e-85b0-b03a7f923eb0 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:11.146096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-72faf346-eeb6-458e-85b0-b03a7f923eb0 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:11.182025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72faf346-eeb6-458e-85b0-b03a7f923eb0 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:11.189999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72faf346-eeb6-458e-85b0-b03a7f923eb0 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:11.190861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72faf346-eeb6-458e-85b0-b03a7f923eb0 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:11.208338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-72faf346-eeb6-458e-85b0-b03a7f923eb0 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:11.797832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:11.817078 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1532 microversion: 2.1 time: 0.878887 Aug 04 14:20:11.818219 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2297/4632] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:10 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1532 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:11.819639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:11.820784 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001438 Aug 04 14:20:11.829828 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2298/4633] 10.222.0.66 () {56 vars in 886 bytes} [Thu Aug 4 14:20:11 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 14:20:11.831658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:11.832938 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001780 Aug 04 14:20:11.840651 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2299/4634] 10.222.0.66 () {54 vars in 1035 bytes} [Thu Aug 4 14:20:11 2022] GET /compute/v2/ => generated 379 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 04 14:20:11.842510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:11.846021 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002430 Aug 04 14:20:11.860636 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2300/4635] 10.222.0.66 () {54 vars in 1041 bytes} [Thu Aug 4 14:20:11 2022] GET /compute/v2.1/ => generated 388 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:11.863287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:11.865185 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-74087d53-f1a4-4a65-81c3-f65e1c59c10f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002423 Aug 04 14:20:11.866254 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2301/4636] 10.222.0.66 () {56 vars in 886 bytes} [Thu Aug 4 14:20:11 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 14:20:12.111077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-72faf346-eeb6-458e-85b0-b03a7f923eb0 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:12.130688 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-72faf346-eeb6-458e-85b0-b03a7f923eb0 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.997541 Aug 04 14:20:12.133435 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2336/4637] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:11 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:12.785601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5dd86a8f-d1be-42ac-ae98-73980cf78c65 req-21982206-91b5-45f7-a293-55141bae44d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c416741-016d-4f02-9a57-507f0454876d", "name": "network-vif-plugged", "status": "completed", "tag": "e2a0c66d-f403-4a0a-8afd-7a706050968f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:12.841169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5dd86a8f-d1be-42ac-ae98-73980cf78c65 req-21982206-91b5-45f7-a293-55141bae44d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:12.841976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5dd86a8f-d1be-42ac-ae98-73980cf78c65 req-21982206-91b5-45f7-a293-55141bae44d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:12.847258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:12.868778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f189f7ab-7aad-456a-adf7-d8e170261230 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:12.869447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f189f7ab-7aad-456a-adf7-d8e170261230 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:12.869757 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5dd86a8f-d1be-42ac-ae98-73980cf78c65 req-21982206-91b5-45f7-a293-55141bae44d1 service nova] Creating event network-vif-plugged:e2a0c66d-f403-4a0a-8afd-7a706050968f for instance 9c416741-016d-4f02-9a57-507f0454876d on n-h1-844627-10 Aug 04 14:20:12.892999 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5dd86a8f-d1be-42ac-ae98-73980cf78c65 req-21982206-91b5-45f7-a293-55141bae44d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113271 Aug 04 14:20:12.894238 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2302/4638] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:12.897902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f189f7ab-7aad-456a-adf7-d8e170261230 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:12.902145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f189f7ab-7aad-456a-adf7-d8e170261230 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:12.903523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f189f7ab-7aad-456a-adf7-d8e170261230 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:12.907905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f189f7ab-7aad-456a-adf7-d8e170261230 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:13.172144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4759fd1-c346-450e-9a08-3d3ac36369a2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:13.173241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4759fd1-c346-450e-9a08-3d3ac36369a2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:13.181901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4759fd1-c346-450e-9a08-3d3ac36369a2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:13.182844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4759fd1-c346-450e-9a08-3d3ac36369a2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:13.184028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4759fd1-c346-450e-9a08-3d3ac36369a2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:13.184718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4759fd1-c346-450e-9a08-3d3ac36369a2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:13.936082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f189f7ab-7aad-456a-adf7-d8e170261230 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:13.957141 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f189f7ab-7aad-456a-adf7-d8e170261230 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1532 microversion: 2.1 time: 1.093931 Aug 04 14:20:13.998772 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2337/4639] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:12 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1532 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:14.006589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d4759fd1-c346-450e-9a08-3d3ac36369a2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:14.034956 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4759fd1-c346-450e-9a08-3d3ac36369a2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.867112 Aug 04 14:20:14.042366 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2303/4640] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:13 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:15.009718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df7bd537-7742-4ee1-af58-f395c8cadc2a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:15.011140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df7bd537-7742-4ee1-af58-f395c8cadc2a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:15.023572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df7bd537-7742-4ee1-af58-f395c8cadc2a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:15.026889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df7bd537-7742-4ee1-af58-f395c8cadc2a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:15.030439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df7bd537-7742-4ee1-af58-f395c8cadc2a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:15.033241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df7bd537-7742-4ee1-af58-f395c8cadc2a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:15.097241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a1563dc9-b7eb-4a5d-9268-f42e24de5be2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:15.098353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a1563dc9-b7eb-4a5d-9268-f42e24de5be2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:15.135938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1563dc9-b7eb-4a5d-9268-f42e24de5be2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:15.143007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1563dc9-b7eb-4a5d-9268-f42e24de5be2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:15.144424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1563dc9-b7eb-4a5d-9268-f42e24de5be2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:15.147184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1563dc9-b7eb-4a5d-9268-f42e24de5be2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:15.365984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df7bd537-7742-4ee1-af58-f395c8cadc2a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:15.381962 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df7bd537-7742-4ee1-af58-f395c8cadc2a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1532 microversion: 2.1 time: 0.379012 Aug 04 14:20:15.383232 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2338/4641] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:15 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1532 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:15.388518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-97074842", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92919b9e-87d8-4c0f-81a1-d2a3d627e9d7"}], "security_groups": [{"name": "tempest-securitygroup--437403264"}], "key_name": "tempest-keypair-604762767", "user_data": "}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:15.521559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a1563dc9-b7eb-4a5d-9268-f42e24de5be2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:15.542029 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a1563dc9-b7eb-4a5d-9268-f42e24de5be2 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.448325 Aug 04 14:20:15.543485 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2304/4642] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:15 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:15.596323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] validate_networks() for [('92919b9e-87d8-4c0f-81a1-d2a3d627e9d7', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:20:15.971789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-838270c4-2835-465b-bcdd-8e950884f336 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Action: 'create', calling method: .version_select at 0x7f470031a700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-763783454", "metadata": {"Type": "work"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-838270c4-2835-465b-bcdd-8e950884f336 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Request method failure captured: Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 121 Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Wfq5DdtQPjb_cNHthlnzxUlNaWNpqfvlUiQfFD8WwQ03SrolnvO-nMnE1q_J-0Lgl66eQz6rJCJLlJ8-ofEC_T6sCTRGlvVUIgDGrLpt74qNQ9d2afkT0XwYjC9t_ut_bcQFY2B9b4IKBfY1xMc2Dw2lpTXlhPranMMedQ-MTnd7I Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}] Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f8e13a0cc30f4e538e33b3f6c833c04c Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-763783454", "metadata": {"Type": "work"}}} Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-763783454', 'metadata': {'Type': 'work'}}}} Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:20:15.979894 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 14:20:15.984307 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:15.987657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-838270c4-2835-465b-bcdd-8e950884f336 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:15.991188 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-838270c4-2835-465b-bcdd-8e950884f336 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.182190 Aug 04 14:20:15.991904 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2305/4643] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Aug 4 14:20:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 14:20:16.008787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0cf864d2-4d22-4ce5-8df9-cea77dbbeab3 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Action: 'create', calling method: .version_select at 0x7f47055fe430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1681745465", "metadata": {"Type": "work"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0cf864d2-4d22-4ce5-8df9-cea77dbbeab3 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Request method failure captured: Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 120 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Wfq5DdtQPjb_cNHthlnzxUlNaWNpqfvlUiQfFD8WwQ03SrolnvO-nMnE1q_J-0Lgl66eQz6rJCJLlJ8-ofEC_T6sCTRGlvVUIgDGrLpt74qNQ9d2afkT0XwYjC9t_ut_bcQFY2B9b4IKBfY1xMc2Dw2lpTXlhPranMMedQ-MTnd7I Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}] Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f8e13a0cc30f4e538e33b3f6c833c04c Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1681745465", "metadata": {"Type": "work"}}} Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1681745465', 'metadata': {'Type': 'work'}}}} Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi '0' Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:20:16.015797 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0cf864d2-4d22-4ce5-8df9-cea77dbbeab3 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:16.019792 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0cf864d2-4d22-4ce5-8df9-cea77dbbeab3 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017327 Aug 04 14:20:16.025931 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2306/4644] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Aug 4 14:20:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 14:20:16.037911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-edd79360-ee66-4eb3-b797-d2c0f3f81b0e tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Action: 'create', calling method: .version_select at 0x7f46f337f940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-583550103", "metadata": {"Type": "work"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-edd79360-ee66-4eb3-b797-d2c0f3f81b0e tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Request method failure captured: Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 118 Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Wfq5DdtQPjb_cNHthlnzxUlNaWNpqfvlUiQfFD8WwQ03SrolnvO-nMnE1q_J-0Lgl66eQz6rJCJLlJ8-ofEC_T6sCTRGlvVUIgDGrLpt74qNQ9d2afkT0XwYjC9t_ut_bcQFY2B9b4IKBfY1xMc2Dw2lpTXlhPranMMedQ-MTnd7I Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}] Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f8e13a0cc30f4e538e33b3f6c833c04c Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-583550103", "metadata": {"Type": "work"}}} Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-583550103', 'metadata': {'Type': 'work'}}}} Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi '' Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:20:16.044445 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-edd79360-ee66-4eb3-b797-d2c0f3f81b0e tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:16.050163 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-edd79360-ee66-4eb3-b797-d2c0f3f81b0e tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018931 Aug 04 14:20:16.053339 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2307/4645] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Aug 4 14:20:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:20:16.059517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e155bee8-1e5f-45f7-8b4d-49f2e3e1048e tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Calling method '.version_select at 0x7f470020ce50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e155bee8-1e5f-45f7-8b4d-49f2e3e1048e tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] HTTP exception thrown: Volume tempest-invalid-1339696988 could not be found. Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e155bee8-1e5f-45f7-8b4d-49f2e3e1048e tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Request method failure captured: Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1339696988 HTTP/1.1 Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Wfq5DdtQPjb_cNHthlnzxUlNaWNpqfvlUiQfFD8WwQ03SrolnvO-nMnE1q_J-0Lgl66eQz6rJCJLlJ8-ofEC_T6sCTRGlvVUIgDGrLpt74qNQ9d2afkT0XwYjC9t_ut_bcQFY2B9b4IKBfY1xMc2Dw2lpTXlhPranMMedQ-MTnd7I Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}] Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f8e13a0cc30f4e538e33b3f6c833c04c Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: exception: Volume tempest-invalid-1339696988 could not be found. Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'tempest-invalid-1339696988'} Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1339696988 could not be found. (HTTP 404) (Request-ID: req-bcfc18fc-8e31-4949-9dbd-25a5521c5451) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 14:20:16.101373 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1339696988 could not be found. Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1339696988 could not be found. Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1339696988 could not be found. Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.106471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e155bee8-1e5f-45f7-8b4d-49f2e3e1048e tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Returning 404 to user: Volume tempest-invalid-1339696988 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:16.110367 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e155bee8-1e5f-45f7-8b4d-49f2e3e1048e tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1339696988" status: 404 len: 99 microversion: 2.1 time: 0.053668 Aug 04 14:20:16.111213 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2308/4646] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 14:20:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1339696988 => generated 99 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 14:20:16.129368 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f08afa13-4791-4965-8fb9-c4bcce8e3c54 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009919 Aug 04 14:20:16.130919 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2309/4647] 10.222.0.66 () {58 vars in 1140 bytes} [Thu Aug 4 14:20:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 04 14:20:16.145125 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c4fd9d72-8cc1-49cd-98f5-a955c5e56720 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008372 Aug 04 14:20:16.147060 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2310/4648] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 14:20:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 14:20:16.160617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8edd924c-db22-4ff7-b88d-797a842e1fcc tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Calling method '.version_select at 0x7f46f337fd30>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:16.200740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:20:16.204851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:20:16.205576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:20:16.206098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:20:16.206632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:20:16.220170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:16.220821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:16.221827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:16.222516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:16.231096 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8edd924c-db22-4ff7-b88d-797a842e1fcc tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] HTTP exception thrown: Volume f0b0627e-260a-45bf-b5eb-d8444ad8aa81 could not be found. Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8edd924c-db22-4ff7-b88d-797a842e1fcc tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Request method failure captured: Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/os-volumes/f0b0627e-260a-45bf-b5eb-d8444ad8aa81 HTTP/1.1 Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Wfq5DdtQPjb_cNHthlnzxUlNaWNpqfvlUiQfFD8WwQ03SrolnvO-nMnE1q_J-0Lgl66eQz6rJCJLlJ8-ofEC_T6sCTRGlvVUIgDGrLpt74qNQ9d2afkT0XwYjC9t_ut_bcQFY2B9b4IKBfY1xMc2Dw2lpTXlhPranMMedQ-MTnd7I Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}] Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f8e13a0cc30f4e538e33b3f6c833c04c Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: exception: Volume f0b0627e-260a-45bf-b5eb-d8444ad8aa81 could not be found. Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'f0b0627e-260a-45bf-b5eb-d8444ad8aa81'} Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0b0627e-260a-45bf-b5eb-d8444ad8aa81 could not be found. (HTTP 404) (Request-ID: req-e2b49a19-9d4e-4be2-9375-bc901d1f33b7) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 14:20:16.233170 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0b0627e-260a-45bf-b5eb-d8444ad8aa81 could not be found. Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0b0627e-260a-45bf-b5eb-d8444ad8aa81 could not be found. Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0b0627e-260a-45bf-b5eb-d8444ad8aa81 could not be found. Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8edd924c-db22-4ff7-b88d-797a842e1fcc tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Returning 404 to user: Volume f0b0627e-260a-45bf-b5eb-d8444ad8aa81 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8edd924c-db22-4ff7-b88d-797a842e1fcc tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/f0b0627e-260a-45bf-b5eb-d8444ad8aa81" status: 404 len: 109 microversion: 2.1 time: 0.082128 Aug 04 14:20:16.240197 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2311/4649] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:20:16 2022] DELETE /compute/v2.1/os-volumes/f0b0627e-260a-45bf-b5eb-d8444ad8aa81 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:20:16.245426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2852a475-5832-4bb0-b33c-0936d1021db3 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Calling method '.version_select at 0x7f470031a790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:16.274353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:20:16.282815 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2852a475-5832-4bb0-b33c-0936d1021db3 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] HTTP exception thrown: Volume c1852fac-630b-4f48-b985-f84e9a71e3c2 could not be found. Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2852a475-5832-4bb0-b33c-0936d1021db3 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Request method failure captured: Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-volumes/c1852fac-630b-4f48-b985-f84e9a71e3c2 HTTP/1.1 Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Wfq5DdtQPjb_cNHthlnzxUlNaWNpqfvlUiQfFD8WwQ03SrolnvO-nMnE1q_J-0Lgl66eQz6rJCJLlJ8-ofEC_T6sCTRGlvVUIgDGrLpt74qNQ9d2afkT0XwYjC9t_ut_bcQFY2B9b4IKBfY1xMc2Dw2lpTXlhPranMMedQ-MTnd7I Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b607d5ac75c2458c8d2d0c3ecc1226f8"}]}] Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b607d5ac75c2458c8d2d0c3ecc1226f8 Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesNegativeTest-481033119 Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: f8e13a0cc30f4e538e33b3f6c833c04c Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesNegativeTest-481033119-project Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: exception: Volume c1852fac-630b-4f48-b985-f84e9a71e3c2 could not be found. Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'c1852fac-630b-4f48-b985-f84e9a71e3c2'} Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1852fac-630b-4f48-b985-f84e9a71e3c2 could not be found. (HTTP 404) (Request-ID: req-3b96f72e-b97c-4956-b5fe-ec3bb0967eea) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 14:20:16.284839 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1852fac-630b-4f48-b985-f84e9a71e3c2 could not be found. Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1852fac-630b-4f48-b985-f84e9a71e3c2 could not be found. Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1852fac-630b-4f48-b985-f84e9a71e3c2 could not be found. Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2852a475-5832-4bb0-b33c-0936d1021db3 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] Returning 404 to user: Volume c1852fac-630b-4f48-b985-f84e9a71e3c2 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2852a475-5832-4bb0-b33c-0936d1021db3 tempest-VolumesNegativeTest-481033119 tempest-VolumesNegativeTest-481033119-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1852fac-630b-4f48-b985-f84e9a71e3c2" status: 404 len: 109 microversion: 2.1 time: 0.045142 Aug 04 14:20:16.292392 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2312/4650] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:20:16 2022] GET /compute/v2.1/os-volumes/c1852fac-630b-4f48-b985-f84e9a71e3c2 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:20:16.298806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for user 0a5b06982b8b43ef98866e495427d381 and project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:20:16.317383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:20:16.322056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:20:16.408048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbaf5dcb-7299-4bd8-b9e6-b37feb8badb8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:16.408683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cbaf5dcb-7299-4bd8-b9e6-b37feb8badb8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:16.427958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbaf5dcb-7299-4bd8-b9e6-b37feb8badb8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:16.427958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbaf5dcb-7299-4bd8-b9e6-b37feb8badb8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:16.428679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbaf5dcb-7299-4bd8-b9e6-b37feb8badb8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:16.429159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbaf5dcb-7299-4bd8-b9e6-b37feb8badb8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:16.462432 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8bb81660-891e-4ff8-80cd-52fabbba6dce tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.078122 Aug 04 14:20:16.469163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2339/4651] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:20:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:20:16.474307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e6c21e55-bbaf-4282-9f47-ecf566cef72e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:16.474942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e6c21e55-bbaf-4282-9f47-ecf566cef72e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:16.735314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e6c21e55-bbaf-4282-9f47-ecf566cef72e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:16.778926 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e6c21e55-bbaf-4282-9f47-ecf566cef72e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1239 microversion: 2.1 time: 0.308174 Aug 04 14:20:16.783859 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2340/4652] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:16 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1239 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:16.793191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ada204bc-d1d8-4e4a-bf7f-3f65ab645e40 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:16.808500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ada204bc-d1d8-4e4a-bf7f-3f65ab645e40 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:16.855852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ada204bc-d1d8-4e4a-bf7f-3f65ab645e40 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:16.856538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ada204bc-d1d8-4e4a-bf7f-3f65ab645e40 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:16.867851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ada204bc-d1d8-4e4a-bf7f-3f65ab645e40 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:16.868725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ada204bc-d1d8-4e4a-bf7f-3f65ab645e40 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:16.933834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbaf5dcb-7299-4bd8-b9e6-b37feb8badb8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:16.958638 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbaf5dcb-7299-4bd8-b9e6-b37feb8badb8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1532 microversion: 2.1 time: 0.555170 Aug 04 14:20:16.964387 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2313/4653] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:16 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1532 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:17.294300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ada204bc-d1d8-4e4a-bf7f-3f65ab645e40 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:17.323436 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ada204bc-d1d8-4e4a-bf7f-3f65ab645e40 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.527781 Aug 04 14:20:17.327143 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2341/4654] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:16 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:17.802320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b5b0ef72-c2a5-470f-ab0c-bd8fd4ba82de tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:17.803855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b5b0ef72-c2a5-470f-ab0c-bd8fd4ba82de tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:17.823168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5b0ef72-c2a5-470f-ab0c-bd8fd4ba82de tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:17.823820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5b0ef72-c2a5-470f-ab0c-bd8fd4ba82de tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:17.824803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5b0ef72-c2a5-470f-ab0c-bd8fd4ba82de tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:17.825328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5b0ef72-c2a5-470f-ab0c-bd8fd4ba82de tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:18.002603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b5b0ef72-c2a5-470f-ab0c-bd8fd4ba82de tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:18.010436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-47fc0867-21d1-4d37-bf16-458ed0b13949 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:18.012565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-47fc0867-21d1-4d37-bf16-458ed0b13949 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:18.028856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47fc0867-21d1-4d37-bf16-458ed0b13949 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:18.029978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47fc0867-21d1-4d37-bf16-458ed0b13949 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:18.031263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47fc0867-21d1-4d37-bf16-458ed0b13949 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:18.032222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47fc0867-21d1-4d37-bf16-458ed0b13949 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:18.039360 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b5b0ef72-c2a5-470f-ab0c-bd8fd4ba82de tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1243 microversion: 2.1 time: 0.241197 Aug 04 14:20:18.052784 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2314/4655] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:17 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1243 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:18.363674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f5f87351-20ac-4484-929e-965ad7578e7a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:18.372233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f5f87351-20ac-4484-929e-965ad7578e7a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:18.389509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5f87351-20ac-4484-929e-965ad7578e7a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:18.390484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5f87351-20ac-4484-929e-965ad7578e7a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:18.392935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5f87351-20ac-4484-929e-965ad7578e7a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:18.395677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5f87351-20ac-4484-929e-965ad7578e7a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:18.415976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-47fc0867-21d1-4d37-bf16-458ed0b13949 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:18.451485 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-47fc0867-21d1-4d37-bf16-458ed0b13949 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 0.446238 Aug 04 14:20:18.458796 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2342/4656] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:18 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:19.081616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1546289d-b661-44fa-8193-a0be653f58a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:19.082945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1546289d-b661-44fa-8193-a0be653f58a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:19.189420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1546289d-b661-44fa-8193-a0be653f58a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:19.198436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1546289d-b661-44fa-8193-a0be653f58a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:19.205161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1546289d-b661-44fa-8193-a0be653f58a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:19.214451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1546289d-b661-44fa-8193-a0be653f58a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:19.656141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1546289d-b661-44fa-8193-a0be653f58a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:19.690658 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1546289d-b661-44fa-8193-a0be653f58a5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1297 microversion: 2.1 time: 0.613584 Aug 04 14:20:19.704021 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2343/4657] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:19 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1297 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:19.771434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6007c176-5242-426d-93a5-c4c232425b26 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:19.772601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6007c176-5242-426d-93a5-c4c232425b26 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:19.791946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6007c176-5242-426d-93a5-c4c232425b26 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:19.792854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6007c176-5242-426d-93a5-c4c232425b26 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:19.793814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6007c176-5242-426d-93a5-c4c232425b26 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:19.794423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6007c176-5242-426d-93a5-c4c232425b26 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:20.061218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f5f87351-20ac-4484-929e-965ad7578e7a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:20.078546 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f5f87351-20ac-4484-929e-965ad7578e7a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 1.720271 Aug 04 14:20:20.101669 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2315/4658] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:18 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:20.459230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6007c176-5242-426d-93a5-c4c232425b26 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:20.492060 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6007c176-5242-426d-93a5-c4c232425b26 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 0.752201 Aug 04 14:20:20.497887 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2344/4659] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:19 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:20.753687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e38fa622-ed0b-4161-ba86-eca85aabdd3d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:20.757310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e38fa622-ed0b-4161-ba86-eca85aabdd3d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:20.783821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e38fa622-ed0b-4161-ba86-eca85aabdd3d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:20.790602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e38fa622-ed0b-4161-ba86-eca85aabdd3d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:20.794095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e38fa622-ed0b-4161-ba86-eca85aabdd3d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:20.796341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e38fa622-ed0b-4161-ba86-eca85aabdd3d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:21.041776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e38fa622-ed0b-4161-ba86-eca85aabdd3d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:21.079799 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e38fa622-ed0b-4161-ba86-eca85aabdd3d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1297 microversion: 2.1 time: 0.341419 Aug 04 14:20:21.080675 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2316/4660] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:20 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1297 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:21.115389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e29e03fc-5fb2-413a-8e50-9c2974b453dd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:21.119430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e29e03fc-5fb2-413a-8e50-9c2974b453dd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:21.145163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e29e03fc-5fb2-413a-8e50-9c2974b453dd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:21.149686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e29e03fc-5fb2-413a-8e50-9c2974b453dd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:21.156817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e29e03fc-5fb2-413a-8e50-9c2974b453dd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:21.160458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e29e03fc-5fb2-413a-8e50-9c2974b453dd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:21.542986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a947e5b-e022-4273-83b6-394529cc8984 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:21.570734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a947e5b-e022-4273-83b6-394529cc8984 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:21.624607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a947e5b-e022-4273-83b6-394529cc8984 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:21.625778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a947e5b-e022-4273-83b6-394529cc8984 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:21.627428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a947e5b-e022-4273-83b6-394529cc8984 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:21.628353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a947e5b-e022-4273-83b6-394529cc8984 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:22.116114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e29e03fc-5fb2-413a-8e50-9c2974b453dd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:22.121794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:22.160850 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e29e03fc-5fb2-413a-8e50-9c2974b453dd tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 1.055322 Aug 04 14:20:22.180918 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2345/4661] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:21 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:22.210245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1e19602b-8326-4622-94bb-a9f2c5c3b6ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:22.210803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1e19602b-8326-4622-94bb-a9f2c5c3b6ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:22.229333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e19602b-8326-4622-94bb-a9f2c5c3b6ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:22.229795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e19602b-8326-4622-94bb-a9f2c5c3b6ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:22.233934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e19602b-8326-4622-94bb-a9f2c5c3b6ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:22.234406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e19602b-8326-4622-94bb-a9f2c5c3b6ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:22.518784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a947e5b-e022-4273-83b6-394529cc8984 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:22.543598 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a947e5b-e022-4273-83b6-394529cc8984 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 1.008761 Aug 04 14:20:22.547707 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2317/4662] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:21 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:22.881956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1e19602b-8326-4622-94bb-a9f2c5c3b6ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:22.895465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1e19602b-8326-4622-94bb-a9f2c5c3b6ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1364 microversion: 2.1 time: 0.721295 Aug 04 14:20:22.897785 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2346/4663] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:22 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1364 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:23.202540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c7f2801-69ac-41cd-8035-ae03bc470a27 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:23.203031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c7f2801-69ac-41cd-8035-ae03bc470a27 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:23.234397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c7f2801-69ac-41cd-8035-ae03bc470a27 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:23.244050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c7f2801-69ac-41cd-8035-ae03bc470a27 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:23.252526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c7f2801-69ac-41cd-8035-ae03bc470a27 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:23.253421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c7f2801-69ac-41cd-8035-ae03bc470a27 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:23.570743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-de0d21f2-b1c3-4da9-89a9-c6158802ec68 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:23.571552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-de0d21f2-b1c3-4da9-89a9-c6158802ec68 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:23.590219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de0d21f2-b1c3-4da9-89a9-c6158802ec68 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:23.592820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de0d21f2-b1c3-4da9-89a9-c6158802ec68 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:23.592820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de0d21f2-b1c3-4da9-89a9-c6158802ec68 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:23.592820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de0d21f2-b1c3-4da9-89a9-c6158802ec68 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:23.885550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9c7f2801-69ac-41cd-8035-ae03bc470a27 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:23.920795 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c7f2801-69ac-41cd-8035-ae03bc470a27 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.725679 Aug 04 14:20:23.922507 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2318/4664] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:23 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:23.959063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b48d463c-57be-43f5-bcc8-05db8dd2047e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:23.960229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b48d463c-57be-43f5-bcc8-05db8dd2047e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:23.983412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b48d463c-57be-43f5-bcc8-05db8dd2047e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:23.984607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b48d463c-57be-43f5-bcc8-05db8dd2047e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:23.986536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b48d463c-57be-43f5-bcc8-05db8dd2047e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:23.987561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b48d463c-57be-43f5-bcc8-05db8dd2047e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:24.547439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-de0d21f2-b1c3-4da9-89a9-c6158802ec68 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:24.559967 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-de0d21f2-b1c3-4da9-89a9-c6158802ec68 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 0.993700 Aug 04 14:20:24.563300 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2347/4665] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:23 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:24.581408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3a3d231a-b5cb-44e8-a991-4c7ced8ea7a4 req-fef58edb-f32e-45fd-be9a-f8ac710cd312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99315bc-8884-4e97-87ec-9f88968eb678", "tag": "e1eb5647-f5f2-44b5-bd85-3a37146feba1"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:24.620207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3a3d231a-b5cb-44e8-a991-4c7ced8ea7a4 req-fef58edb-f32e-45fd-be9a-f8ac710cd312 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:24.626918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3a3d231a-b5cb-44e8-a991-4c7ced8ea7a4 req-fef58edb-f32e-45fd-be9a-f8ac710cd312 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:24.684221 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3a3d231a-b5cb-44e8-a991-4c7ced8ea7a4 req-fef58edb-f32e-45fd-be9a-f8ac710cd312 service nova] Creating event network-changed:e1eb5647-f5f2-44b5-bd85-3a37146feba1 for instance d99315bc-8884-4e97-87ec-9f88968eb678 on n-h2-844627-10 Aug 04 14:20:24.707380 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3a3d231a-b5cb-44e8-a991-4c7ced8ea7a4 req-fef58edb-f32e-45fd-be9a-f8ac710cd312 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137536 Aug 04 14:20:24.711925 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2348/4666] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:24.843084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b48d463c-57be-43f5-bcc8-05db8dd2047e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:24.851489 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b48d463c-57be-43f5-bcc8-05db8dd2047e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1364 microversion: 2.1 time: 0.908547 Aug 04 14:20:24.858587 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2319/4667] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:23 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1364 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:25.011637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9282d945-386b-4272-bf1f-97653577efa3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:25.016394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9282d945-386b-4272-bf1f-97653577efa3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:25.043329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9282d945-386b-4272-bf1f-97653577efa3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:25.044273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9282d945-386b-4272-bf1f-97653577efa3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:25.045507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9282d945-386b-4272-bf1f-97653577efa3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:25.046209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9282d945-386b-4272-bf1f-97653577efa3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:25.592162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-814c5b60-5a05-4587-949b-f93546f37430 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:25.593141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-814c5b60-5a05-4587-949b-f93546f37430 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:25.625049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-814c5b60-5a05-4587-949b-f93546f37430 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:25.627671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-814c5b60-5a05-4587-949b-f93546f37430 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:25.634214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-814c5b60-5a05-4587-949b-f93546f37430 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:25.635303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-814c5b60-5a05-4587-949b-f93546f37430 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:25.662275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9282d945-386b-4272-bf1f-97653577efa3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:25.678724 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9282d945-386b-4272-bf1f-97653577efa3 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.714032 Aug 04 14:20:25.680018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2349/4668] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:24 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:25.892623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fdb90aad-9f08-4b8e-8808-9c5661114615 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:25.893893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fdb90aad-9f08-4b8e-8808-9c5661114615 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:25.901482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdb90aad-9f08-4b8e-8808-9c5661114615 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:25.902730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdb90aad-9f08-4b8e-8808-9c5661114615 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:25.903766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdb90aad-9f08-4b8e-8808-9c5661114615 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:25.905095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fdb90aad-9f08-4b8e-8808-9c5661114615 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:25.953305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-814c5b60-5a05-4587-949b-f93546f37430 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:25.964594 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-814c5b60-5a05-4587-949b-f93546f37430 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 0.379500 Aug 04 14:20:25.984087 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2320/4669] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:25 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:26.239620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:26.390003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fdb90aad-9f08-4b8e-8808-9c5661114615 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:26.406623 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fdb90aad-9f08-4b8e-8808-9c5661114615 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1364 microversion: 2.1 time: 0.518405 Aug 04 14:20:26.423427 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2350/4670] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:25 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1364 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:26.717781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d0428288-eb17-4e09-a108-a06bfcc2246b tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:26.720921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d0428288-eb17-4e09-a108-a06bfcc2246b tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:26.742218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d0428288-eb17-4e09-a108-a06bfcc2246b tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:26.743332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d0428288-eb17-4e09-a108-a06bfcc2246b tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:26.749167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d0428288-eb17-4e09-a108-a06bfcc2246b tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:26.749882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d0428288-eb17-4e09-a108-a06bfcc2246b tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:27.016481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64a407b2-9715-42ce-950e-5ae391ddd557 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:27.017504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64a407b2-9715-42ce-950e-5ae391ddd557 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:27.033124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:27.036085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64a407b2-9715-42ce-950e-5ae391ddd557 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:27.036954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64a407b2-9715-42ce-950e-5ae391ddd557 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:27.037950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64a407b2-9715-42ce-950e-5ae391ddd557 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:27.038648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64a407b2-9715-42ce-950e-5ae391ddd557 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:27.123110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d0428288-eb17-4e09-a108-a06bfcc2246b tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:27.132983 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d0428288-eb17-4e09-a108-a06bfcc2246b tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.431919 Aug 04 14:20:27.173959 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2321/4671] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:26 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:27.441213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7f7247d3-ab80-4009-85db-dd26048440db tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:27.441962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7f7247d3-ab80-4009-85db-dd26048440db tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:27.455439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f7247d3-ab80-4009-85db-dd26048440db tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:27.455893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f7247d3-ab80-4009-85db-dd26048440db tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:27.464779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f7247d3-ab80-4009-85db-dd26048440db tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:27.468076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f7247d3-ab80-4009-85db-dd26048440db tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:27.580099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-64a407b2-9715-42ce-950e-5ae391ddd557 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:27.597969 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-64a407b2-9715-42ce-950e-5ae391ddd557 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 0.609502 Aug 04 14:20:27.598907 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2351/4672] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:26 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:28.171885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-912bcb55-4ff6-47ed-9d97-b84fb99ffd2a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:28.172572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-912bcb55-4ff6-47ed-9d97-b84fb99ffd2a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:28.182833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7f7247d3-ab80-4009-85db-dd26048440db tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:28.190490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-912bcb55-4ff6-47ed-9d97-b84fb99ffd2a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:28.190954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-912bcb55-4ff6-47ed-9d97-b84fb99ffd2a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:28.192044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-912bcb55-4ff6-47ed-9d97-b84fb99ffd2a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:28.192488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-912bcb55-4ff6-47ed-9d97-b84fb99ffd2a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:28.229272 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7f7247d3-ab80-4009-85db-dd26048440db tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1364 microversion: 2.1 time: 0.793762 Aug 04 14:20:28.256658 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2322/4673] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:27 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1364 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:28.565106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-912bcb55-4ff6-47ed-9d97-b84fb99ffd2a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:28.589229 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-912bcb55-4ff6-47ed-9d97-b84fb99ffd2a tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.420756 Aug 04 14:20:28.598843 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2352/4674] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:28 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:28.633988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ee018a1-9126-4296-af99-6ff4617dc8ef tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:28.635038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0ee018a1-9126-4296-af99-6ff4617dc8ef tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:28.646789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ee018a1-9126-4296-af99-6ff4617dc8ef tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:28.647302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ee018a1-9126-4296-af99-6ff4617dc8ef tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:28.651120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ee018a1-9126-4296-af99-6ff4617dc8ef tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:28.651826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0ee018a1-9126-4296-af99-6ff4617dc8ef tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:29.273125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a2cc9020-8090-4e39-a5ee-ca14a991fc53 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:29.274247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a2cc9020-8090-4e39-a5ee-ca14a991fc53 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:29.321117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2cc9020-8090-4e39-a5ee-ca14a991fc53 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:29.321587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2cc9020-8090-4e39-a5ee-ca14a991fc53 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:29.322463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2cc9020-8090-4e39-a5ee-ca14a991fc53 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:29.326846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2cc9020-8090-4e39-a5ee-ca14a991fc53 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:30.105715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0ee018a1-9126-4296-af99-6ff4617dc8ef tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:30.131905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a2cc9020-8090-4e39-a5ee-ca14a991fc53 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:30.173108 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0ee018a1-9126-4296-af99-6ff4617dc8ef tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 1.513744 Aug 04 14:20:30.197378 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2323/4675] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:28 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:30.218496 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a2cc9020-8090-4e39-a5ee-ca14a991fc53 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1364 microversion: 2.1 time: 0.949790 Aug 04 14:20:30.221647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dd8a9895-f52a-46ba-a18f-117858781b9f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:30.222101 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2353/4676] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:29 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1364 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:30.225880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dd8a9895-f52a-46ba-a18f-117858781b9f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:30.256658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd8a9895-f52a-46ba-a18f-117858781b9f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:30.258311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd8a9895-f52a-46ba-a18f-117858781b9f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:30.261623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd8a9895-f52a-46ba-a18f-117858781b9f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:30.269010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd8a9895-f52a-46ba-a18f-117858781b9f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:30.611788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd8a9895-f52a-46ba-a18f-117858781b9f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:30.623151 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dd8a9895-f52a-46ba-a18f-117858781b9f tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.423564 Aug 04 14:20:30.624526 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2324/4677] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:30 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:31.233909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1d42bc62-585a-4b37-9470-3ec45837dcb2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:31.235950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1d42bc62-585a-4b37-9470-3ec45837dcb2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:31.268592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c7c37087-f2e9-45b4-91fb-8dfeda1a07fc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:31.269665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c7c37087-f2e9-45b4-91fb-8dfeda1a07fc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:31.295841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7c37087-f2e9-45b4-91fb-8dfeda1a07fc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:31.307299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d42bc62-585a-4b37-9470-3ec45837dcb2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:31.310281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d42bc62-585a-4b37-9470-3ec45837dcb2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:31.314264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7c37087-f2e9-45b4-91fb-8dfeda1a07fc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:31.319428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d42bc62-585a-4b37-9470-3ec45837dcb2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:31.321573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7c37087-f2e9-45b4-91fb-8dfeda1a07fc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:31.322519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7c37087-f2e9-45b4-91fb-8dfeda1a07fc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:31.330396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d42bc62-585a-4b37-9470-3ec45837dcb2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:32.811226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d42bc62-585a-4b37-9470-3ec45837dcb2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:32.857508 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1d42bc62-585a-4b37-9470-3ec45837dcb2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 1.643196 Aug 04 14:20:32.858133 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2354/4678] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:31 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:32.875980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-651d08f7-bc9a-4c92-a635-8895b0e4aa04 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:32.876616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-651d08f7-bc9a-4c92-a635-8895b0e4aa04 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:32.906554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:32.908537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-651d08f7-bc9a-4c92-a635-8895b0e4aa04 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:32.909069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-651d08f7-bc9a-4c92-a635-8895b0e4aa04 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:32.912835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-651d08f7-bc9a-4c92-a635-8895b0e4aa04 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:32.913357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-651d08f7-bc9a-4c92-a635-8895b0e4aa04 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:32.972095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c7c37087-f2e9-45b4-91fb-8dfeda1a07fc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:33.020559 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c7c37087-f2e9-45b4-91fb-8dfeda1a07fc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1364 microversion: 2.1 time: 1.749149 Aug 04 14:20:33.024050 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2325/4679] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:31 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1364 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:33.479108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-651d08f7-bc9a-4c92-a635-8895b0e4aa04 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:33.527166 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-651d08f7-bc9a-4c92-a635-8895b0e4aa04 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.667556 Aug 04 14:20:33.534293 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2355/4680] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:32 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:33.904907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-829ae97d-211a-4130-ba4e-14bfe934d566 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:33.906035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-829ae97d-211a-4130-ba4e-14bfe934d566 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:33.925744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=52 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:33.953279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-829ae97d-211a-4130-ba4e-14bfe934d566 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:33.954134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-829ae97d-211a-4130-ba4e-14bfe934d566 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:33.955671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-829ae97d-211a-4130-ba4e-14bfe934d566 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:33.956489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-829ae97d-211a-4130-ba4e-14bfe934d566 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:34.067631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c6684cc-977e-4c09-9e25-6d806e454111 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:34.077896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8c6684cc-977e-4c09-9e25-6d806e454111 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:34.140321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c6684cc-977e-4c09-9e25-6d806e454111 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:34.175418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c6684cc-977e-4c09-9e25-6d806e454111 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:34.180191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c6684cc-977e-4c09-9e25-6d806e454111 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:34.184795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c6684cc-977e-4c09-9e25-6d806e454111 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:34.889332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-829ae97d-211a-4130-ba4e-14bfe934d566 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:34.927267 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-829ae97d-211a-4130-ba4e-14bfe934d566 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 1.031811 Aug 04 14:20:34.928639 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2326/4681] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:33 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:34.973086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cdca7fbb-47b4-4ef9-b35c-fbf792cc7939 req-33e6c83b-a974-4655-934b-4a8edd89c1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99315bc-8884-4e97-87ec-9f88968eb678", "name": "network-vif-plugged", "status": "completed", "tag": "e1eb5647-f5f2-44b5-bd85-3a37146feba1"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:35.026378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cdca7fbb-47b4-4ef9-b35c-fbf792cc7939 req-33e6c83b-a974-4655-934b-4a8edd89c1fc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:35.029509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cdca7fbb-47b4-4ef9-b35c-fbf792cc7939 req-33e6c83b-a974-4655-934b-4a8edd89c1fc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:35.045307 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cdca7fbb-47b4-4ef9-b35c-fbf792cc7939 req-33e6c83b-a974-4655-934b-4a8edd89c1fc service nova] Creating event network-vif-plugged:e1eb5647-f5f2-44b5-bd85-3a37146feba1 for instance d99315bc-8884-4e97-87ec-9f88968eb678 on n-h2-844627-10 Aug 04 14:20:35.052268 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cdca7fbb-47b4-4ef9-b35c-fbf792cc7939 req-33e6c83b-a974-4655-934b-4a8edd89c1fc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104073 Aug 04 14:20:35.059650 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2327/4682] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:35.066538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c397993b-5572-49c4-b6a2-5353d3a474eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:35.067997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c397993b-5572-49c4-b6a2-5353d3a474eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:35.076085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c397993b-5572-49c4-b6a2-5353d3a474eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:35.076861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c397993b-5572-49c4-b6a2-5353d3a474eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:35.078367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c397993b-5572-49c4-b6a2-5353d3a474eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:35.079009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c397993b-5572-49c4-b6a2-5353d3a474eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:35.109760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:35.155873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8c6684cc-977e-4c09-9e25-6d806e454111 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:35.178819 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c6684cc-977e-4c09-9e25-6d806e454111 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1364 microversion: 2.1 time: 1.125562 Aug 04 14:20:35.181595 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2356/4683] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:34 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1364 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:35.509722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c397993b-5572-49c4-b6a2-5353d3a474eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:35.538116 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c397993b-5572-49c4-b6a2-5353d3a474eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1486 microversion: 2.1 time: 0.475961 Aug 04 14:20:35.545073 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2328/4684] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:35 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1486 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:35.574742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c2b64297-391e-43e0-b11e-5b86b0162569 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:35.575748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c2b64297-391e-43e0-b11e-5b86b0162569 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:35.627249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2b64297-391e-43e0-b11e-5b86b0162569 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:35.628371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2b64297-391e-43e0-b11e-5b86b0162569 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:35.633700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2b64297-391e-43e0-b11e-5b86b0162569 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:35.634698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2b64297-391e-43e0-b11e-5b86b0162569 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:35.854050 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c2b64297-391e-43e0-b11e-5b86b0162569 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "POST /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725/action" status: 202 len: 0 microversion: 2.1 time: 0.282082 Aug 04 14:20:35.855768 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2357/4685] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:20:35 2022] POST /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:20:35.892223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-db81e80b-8ebf-4d47-9e67-d50200cab2c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:35.894707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-db81e80b-8ebf-4d47-9e67-d50200cab2c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:35.918366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db81e80b-8ebf-4d47-9e67-d50200cab2c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:35.924272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db81e80b-8ebf-4d47-9e67-d50200cab2c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:35.928069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db81e80b-8ebf-4d47-9e67-d50200cab2c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:35.929488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-db81e80b-8ebf-4d47-9e67-d50200cab2c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:35.991216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ba2a9fd-2e47-4e0d-ba80-5e541b7dad0c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:35.996288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2ba2a9fd-2e47-4e0d-ba80-5e541b7dad0c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:36.031211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ba2a9fd-2e47-4e0d-ba80-5e541b7dad0c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:36.032139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ba2a9fd-2e47-4e0d-ba80-5e541b7dad0c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:36.035962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ba2a9fd-2e47-4e0d-ba80-5e541b7dad0c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:36.039345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ba2a9fd-2e47-4e0d-ba80-5e541b7dad0c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:36.704183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2ba2a9fd-2e47-4e0d-ba80-5e541b7dad0c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:36.723129 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ba2a9fd-2e47-4e0d-ba80-5e541b7dad0c tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 0.751930 Aug 04 14:20:36.723938 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2358/4686] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:35 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:36.737813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d0dff33c-34e8-4b82-a35a-6af33655a56f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:36.738717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d0dff33c-34e8-4b82-a35a-6af33655a56f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:36.762758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0dff33c-34e8-4b82-a35a-6af33655a56f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:36.763279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0dff33c-34e8-4b82-a35a-6af33655a56f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:36.788709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0dff33c-34e8-4b82-a35a-6af33655a56f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:36.796463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0dff33c-34e8-4b82-a35a-6af33655a56f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:36.833586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-db81e80b-8ebf-4d47-9e67-d50200cab2c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:36.845453 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-db81e80b-8ebf-4d47-9e67-d50200cab2c6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1494 microversion: 2.1 time: 0.982542 Aug 04 14:20:36.854312 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2329/4687] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:35 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1494 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:37.451218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d0dff33c-34e8-4b82-a35a-6af33655a56f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:37.481683 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d0dff33c-34e8-4b82-a35a-6af33655a56f tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1364 microversion: 2.1 time: 0.756117 Aug 04 14:20:37.484333 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2359/4688] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:36 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1364 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:37.765875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4abd2fed-c5ff-492a-8aac-6492a91aa5bd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:37.766556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4abd2fed-c5ff-492a-8aac-6492a91aa5bd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:37.780262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4abd2fed-c5ff-492a-8aac-6492a91aa5bd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:37.781218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4abd2fed-c5ff-492a-8aac-6492a91aa5bd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:37.782601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4abd2fed-c5ff-492a-8aac-6492a91aa5bd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:37.783401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4abd2fed-c5ff-492a-8aac-6492a91aa5bd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:37.887062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5a138f86-64fc-440a-b984-6285deba1597 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:37.889410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5a138f86-64fc-440a-b984-6285deba1597 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:37.904382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a138f86-64fc-440a-b984-6285deba1597 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:37.905274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a138f86-64fc-440a-b984-6285deba1597 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:37.910560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a138f86-64fc-440a-b984-6285deba1597 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:37.911395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a138f86-64fc-440a-b984-6285deba1597 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:38.512665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5a138f86-64fc-440a-b984-6285deba1597 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:38.530385 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5a138f86-64fc-440a-b984-6285deba1597 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1494 microversion: 2.1 time: 0.648723 Aug 04 14:20:38.531514 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2360/4689] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:37 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1494 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:38.543510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-111d931f-4b46-4d7c-a303-cd166d6add79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:38.550118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-111d931f-4b46-4d7c-a303-cd166d6add79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:38.567179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-111d931f-4b46-4d7c-a303-cd166d6add79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:38.567964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4abd2fed-c5ff-492a-8aac-6492a91aa5bd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:38.569696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-111d931f-4b46-4d7c-a303-cd166d6add79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:38.572106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-111d931f-4b46-4d7c-a303-cd166d6add79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:38.574962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-111d931f-4b46-4d7c-a303-cd166d6add79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:38.581825 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4abd2fed-c5ff-492a-8aac-6492a91aa5bd tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 0.820102 Aug 04 14:20:38.583205 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2330/4690] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:37 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:39.559297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ddd5617-15ba-4586-baaa-c47c65351ccc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:39.560928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ddd5617-15ba-4586-baaa-c47c65351ccc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:39.576987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ddd5617-15ba-4586-baaa-c47c65351ccc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:39.577799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ddd5617-15ba-4586-baaa-c47c65351ccc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:39.578845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ddd5617-15ba-4586-baaa-c47c65351ccc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:39.579504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ddd5617-15ba-4586-baaa-c47c65351ccc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:39.647569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-111d931f-4b46-4d7c-a303-cd166d6add79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:39.663567 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-111d931f-4b46-4d7c-a303-cd166d6add79 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1555 microversion: 2.1 time: 1.129038 Aug 04 14:20:39.666516 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2361/4691] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:38 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1555 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:39.677541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b9f6aeac-43ea-429c-a98b-2f58478e77a1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:39.679142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b9f6aeac-43ea-429c-a98b-2f58478e77a1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:39.732314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9f6aeac-43ea-429c-a98b-2f58478e77a1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:39.736891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9f6aeac-43ea-429c-a98b-2f58478e77a1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:39.743736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9f6aeac-43ea-429c-a98b-2f58478e77a1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:39.745199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9f6aeac-43ea-429c-a98b-2f58478e77a1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:39.852534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:39.930928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ddd5617-15ba-4586-baaa-c47c65351ccc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:39.946430 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ddd5617-15ba-4586-baaa-c47c65351ccc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1494 microversion: 2.1 time: 0.392389 Aug 04 14:20:39.948447 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2331/4692] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:39 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1494 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:39.956415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c81dc8b4-f6e4-45cc-94a0-17ea6e937005 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:39.959545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c81dc8b4-f6e4-45cc-94a0-17ea6e937005 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:39.989267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c81dc8b4-f6e4-45cc-94a0-17ea6e937005 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:39.989864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c81dc8b4-f6e4-45cc-94a0-17ea6e937005 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:39.991434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c81dc8b4-f6e4-45cc-94a0-17ea6e937005 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:39.992145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c81dc8b4-f6e4-45cc-94a0-17ea6e937005 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:40.348102 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c81dc8b4-f6e4-45cc-94a0-17ea6e937005 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.397618 Aug 04 14:20:40.349108 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2332/4693] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:20:39 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-interface => generated 285 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:40.418130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b9f6aeac-43ea-429c-a98b-2f58478e77a1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:40.437922 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b9f6aeac-43ea-429c-a98b-2f58478e77a1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 0.769350 Aug 04 14:20:40.438733 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2362/4694] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:39 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:40.992906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0dd1a88-1e88-4ae8-9e41-5b05854e55ea tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:40.994258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0dd1a88-1e88-4ae8-9e41-5b05854e55ea tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:41.056862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0dd1a88-1e88-4ae8-9e41-5b05854e55ea tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:41.058832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0dd1a88-1e88-4ae8-9e41-5b05854e55ea tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:41.067975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0dd1a88-1e88-4ae8-9e41-5b05854e55ea tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:41.068778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0dd1a88-1e88-4ae8-9e41-5b05854e55ea tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:41.467193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c8a6eb25-00b4-4036-a9ca-34537de27ef8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:41.472097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c8a6eb25-00b4-4036-a9ca-34537de27ef8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:41.505607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8a6eb25-00b4-4036-a9ca-34537de27ef8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:41.507665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8a6eb25-00b4-4036-a9ca-34537de27ef8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:41.509652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8a6eb25-00b4-4036-a9ca-34537de27ef8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:41.511861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8a6eb25-00b4-4036-a9ca-34537de27ef8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:42.475352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f0dd1a88-1e88-4ae8-9e41-5b05854e55ea tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:42.519819 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0dd1a88-1e88-4ae8-9e41-5b05854e55ea tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1500 microversion: 2.1 time: 1.542130 Aug 04 14:20:42.520998 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2333/4695] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:40 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1500 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:42.569664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6fc71027-551e-4fc5-bb9f-b4fe690f1760 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:42.572179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6fc71027-551e-4fc5-bb9f-b4fe690f1760 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:42.594495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fc71027-551e-4fc5-bb9f-b4fe690f1760 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:42.601664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fc71027-551e-4fc5-bb9f-b4fe690f1760 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:42.603950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fc71027-551e-4fc5-bb9f-b4fe690f1760 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:42.610289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c8a6eb25-00b4-4036-a9ca-34537de27ef8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:42.613086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fc71027-551e-4fc5-bb9f-b4fe690f1760 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:42.639251 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c8a6eb25-00b4-4036-a9ca-34537de27ef8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 1.175247 Aug 04 14:20:42.643913 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2363/4696] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:41 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:42.722961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6fc71027-551e-4fc5-bb9f-b4fe690f1760 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:20:43.076500 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6fc71027-551e-4fc5-bb9f-b4fe690f1760 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "DELETE /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 204 len: 0 microversion: 2.1 time: 0.522218 Aug 04 14:20:43.077695 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2334/4697] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:20:42 2022] DELETE /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:20:43.100303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d906223-4e91-4b37-b246-d6b54006d9b6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:43.109506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d906223-4e91-4b37-b246-d6b54006d9b6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:43.150336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d906223-4e91-4b37-b246-d6b54006d9b6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:43.151224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d906223-4e91-4b37-b246-d6b54006d9b6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:43.157028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d906223-4e91-4b37-b246-d6b54006d9b6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:43.164417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d906223-4e91-4b37-b246-d6b54006d9b6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:43.679986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7868008-05dc-4283-aa9e-1c3ddc80b82b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:43.683300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7868008-05dc-4283-aa9e-1c3ddc80b82b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:43.692723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7868008-05dc-4283-aa9e-1c3ddc80b82b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:43.694454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7868008-05dc-4283-aa9e-1c3ddc80b82b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:43.695541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7868008-05dc-4283-aa9e-1c3ddc80b82b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:43.696170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7868008-05dc-4283-aa9e-1c3ddc80b82b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:44.246926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d906223-4e91-4b37-b246-d6b54006d9b6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:44.297743 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d906223-4e91-4b37-b246-d6b54006d9b6 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 1.205983 Aug 04 14:20:44.334821 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2364/4698] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:43 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:44.668065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d0829f43-2b97-404c-81cc-4d456e950a82 req-72a389bb-2ecd-401a-9494-9152a589d7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99315bc-8884-4e97-87ec-9f88968eb678", "tag": "e1eb5647-f5f2-44b5-bd85-3a37146feba1"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:44.712827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d0829f43-2b97-404c-81cc-4d456e950a82 req-72a389bb-2ecd-401a-9494-9152a589d7b6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:44.714251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d0829f43-2b97-404c-81cc-4d456e950a82 req-72a389bb-2ecd-401a-9494-9152a589d7b6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:44.737391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7868008-05dc-4283-aa9e-1c3ddc80b82b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:44.778018 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d0829f43-2b97-404c-81cc-4d456e950a82 req-72a389bb-2ecd-401a-9494-9152a589d7b6 service nova] Creating event network-changed:e1eb5647-f5f2-44b5-bd85-3a37146feba1 for instance d99315bc-8884-4e97-87ec-9f88968eb678 on n-h2-844627-10 Aug 04 14:20:44.778279 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7868008-05dc-4283-aa9e-1c3ddc80b82b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 1.106990 Aug 04 14:20:44.783841 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2335/4699] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:43 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:44.807838 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d0829f43-2b97-404c-81cc-4d456e950a82 req-72a389bb-2ecd-401a-9494-9152a589d7b6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.471364 Aug 04 14:20:44.812830 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2365/4700] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:45.343729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5c7998e7-ce63-4cf3-9a07-deb3eaba0362 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:45.349012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5c7998e7-ce63-4cf3-9a07-deb3eaba0362 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:45.384848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c7998e7-ce63-4cf3-9a07-deb3eaba0362 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:45.386049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c7998e7-ce63-4cf3-9a07-deb3eaba0362 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:45.387956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c7998e7-ce63-4cf3-9a07-deb3eaba0362 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:45.395635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c7998e7-ce63-4cf3-9a07-deb3eaba0362 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:45.728973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-950c797c-63dc-45dc-9a9e-670dadc36f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:45.734173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-950c797c-63dc-45dc-9a9e-670dadc36f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:45.787488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-950c797c-63dc-45dc-9a9e-670dadc36f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:45.788570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-950c797c-63dc-45dc-9a9e-670dadc36f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:45.796736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-950c797c-63dc-45dc-9a9e-670dadc36f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:45.800500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-950c797c-63dc-45dc-9a9e-670dadc36f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:45.885691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5c7998e7-ce63-4cf3-9a07-deb3eaba0362 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:45.919744 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5c7998e7-ce63-4cf3-9a07-deb3eaba0362 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 0.588176 Aug 04 14:20:45.938751 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2336/4701] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:45 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:45.948148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8419adbb-55ef-46f8-895f-c74f6377428e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:45.967781 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-950c797c-63dc-45dc-9a9e-670dadc36f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/ips" status: 200 len: 150 microversion: 2.20 time: 0.252721 Aug 04 14:20:45.982481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8419adbb-55ef-46f8-895f-c74f6377428e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:45.994305 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2366/4702] 10.222.0.66 () {60 vars in 1289 bytes} [Thu Aug 4 14:20:45 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/ips => generated 150 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:20:46.021337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8419adbb-55ef-46f8-895f-c74f6377428e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:46.022386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8419adbb-55ef-46f8-895f-c74f6377428e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:46.023895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8419adbb-55ef-46f8-895f-c74f6377428e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:46.024721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8419adbb-55ef-46f8-895f-c74f6377428e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:46.981912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ada87865-fde9-48b0-86c8-345c7f250562 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:46.984116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ada87865-fde9-48b0-86c8-345c7f250562 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:47.009205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ada87865-fde9-48b0-86c8-345c7f250562 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:47.010117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ada87865-fde9-48b0-86c8-345c7f250562 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:47.011284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ada87865-fde9-48b0-86c8-345c7f250562 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:47.012073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ada87865-fde9-48b0-86c8-345c7f250562 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:48.543608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8419adbb-55ef-46f8-895f-c74f6377428e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:48.609196 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8419adbb-55ef-46f8-895f-c74f6377428e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1527 microversion: 2.1 time: 2.658030 Aug 04 14:20:48.615151 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2337/4703] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:45 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1527 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:48.672949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-25956159-0e19-49d8-80d0-7a72f41a195e req-97221f3a-418b-48df-bdab-2fa3cc0fd4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "444faa71-7547-4fc3-9a24-587f64fe4725", "name": "network-vif-deleted", "tag": "11891ab9-6db2-45ad-bc4b-0b6c6b803638"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:48.760743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-25956159-0e19-49d8-80d0-7a72f41a195e req-97221f3a-418b-48df-bdab-2fa3cc0fd4ea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:48.761723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-25956159-0e19-49d8-80d0-7a72f41a195e req-97221f3a-418b-48df-bdab-2fa3cc0fd4ea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:48.837080 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-25956159-0e19-49d8-80d0-7a72f41a195e req-97221f3a-418b-48df-bdab-2fa3cc0fd4ea service nova] Creating event network-vif-deleted:11891ab9-6db2-45ad-bc4b-0b6c6b803638 for instance 444faa71-7547-4fc3-9a24-587f64fe4725 on n-h2-844627-10 Aug 04 14:20:48.852217 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-25956159-0e19-49d8-80d0-7a72f41a195e req-97221f3a-418b-48df-bdab-2fa3cc0fd4ea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225751 Aug 04 14:20:48.858146 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2338/4704] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:49.157412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ada87865-fde9-48b0-86c8-345c7f250562 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:49.178101 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ada87865-fde9-48b0-86c8-345c7f250562 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 200 len: 1506 microversion: 2.1 time: 2.212495 Aug 04 14:20:49.180060 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2367/4705] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:46 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 1506 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:49.410775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2d772101-ca5d-44e0-9913-2762f6789651 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:49.419638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2d772101-ca5d-44e0-9913-2762f6789651 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:49.434375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d772101-ca5d-44e0-9913-2762f6789651 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:49.435820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d772101-ca5d-44e0-9913-2762f6789651 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:49.437898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d772101-ca5d-44e0-9913-2762f6789651 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:49.439011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d772101-ca5d-44e0-9913-2762f6789651 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:49.631392 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2d772101-ca5d-44e0-9913-2762f6789651 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.231338 Aug 04 14:20:49.656178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5c5d091e-ce45-466e-9324-fe2903d8b954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:49.657042 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2339/4706] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:20:49 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:20:49.666161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5c5d091e-ce45-466e-9324-fe2903d8b954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:49.686588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f13cd5e9-1142-471c-b817-1a0dbd159989 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:49.688214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f13cd5e9-1142-471c-b817-1a0dbd159989 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:49.698310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5c5d091e-ce45-466e-9324-fe2903d8b954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:49.702525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5c5d091e-ce45-466e-9324-fe2903d8b954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:49.708601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5c5d091e-ce45-466e-9324-fe2903d8b954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:49.709767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5c5d091e-ce45-466e-9324-fe2903d8b954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:49.711514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f13cd5e9-1142-471c-b817-1a0dbd159989 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:49.713174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f13cd5e9-1142-471c-b817-1a0dbd159989 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:49.718196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f13cd5e9-1142-471c-b817-1a0dbd159989 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:49.721005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f13cd5e9-1142-471c-b817-1a0dbd159989 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:50.564422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5c5d091e-ce45-466e-9324-fe2903d8b954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:50.607835 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5c5d091e-ce45-466e-9324-fe2903d8b954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1671 microversion: 2.1 time: 0.963493 Aug 04 14:20:50.610250 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2368/4707] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:49 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1671 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:50.655757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:50.658750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: 444faa71-7547-4fc3-9a24-587f64fe4725] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:50.678187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:50.679876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:50.682492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:50.683960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:50.718389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f13cd5e9-1142-471c-b817-1a0dbd159989 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:50.732012 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f13cd5e9-1142-471c-b817-1a0dbd159989 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1509 microversion: 2.1 time: 1.058115 Aug 04 14:20:50.733465 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2340/4708] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:49 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1509 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:50.744316 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] HTTP exception thrown: Instance 444faa71-7547-4fc3-9a24-587f64fe4725 could not be found. Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Request method failure captured: Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 HTTP/1.1 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69VMa_ZYDBGTvoWC4kevUhu8VJJImMrzR9h8Z6pvi4E_e5JVc_WdYe-2RZkkyKhJ1nZdkEMLPr6QOrsGt0Dhwyw2wq6Jd__dJ-7MHT8DY7l4S9kkEYIPHLw2t7mwGcLZArJQLEnhnvSbzvaAVvCIIhr3OqVl0N3_XAueEq4QUKhWET0 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2274689c61ef4dfca8a1017f893a6037 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerRescueTestJSON-898492079 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2274689c61ef4dfca8a1017f893a6037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2274689c61ef4dfca8a1017f893a6037"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2274689c61ef4dfca8a1017f893a6037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2274689c61ef4dfca8a1017f893a6037"}]}] Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerRescueTestJSON-898492079 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2274689c61ef4dfca8a1017f893a6037 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerRescueTestJSON-898492079 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerRescueTestJSON-898492079-project Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 1f2b1ca4f98f441f8508d33dd8e99ae1 Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerRescueTestJSON-898492079-project Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 444faa71-7547-4fc3-9a24-587f64fe4725 could not be found. Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '444faa71-7547-4fc3-9a24-587f64fe4725'} Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 444faa71-7547-4fc3-9a24-587f64fe4725 could not be found. Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 444faa71-7547-4fc3-9a24-587f64fe4725 could not be found. Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:50.751441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:50.755735 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:50.755735 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:50.755735 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:50.755735 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:50.755735 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:50.755735 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 444faa71-7547-4fc3-9a24-587f64fe4725 could not be found. Aug 04 14:20:50.755735 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:20:50.761229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Returning 404 to user: Instance 444faa71-7547-4fc3-9a24-587f64fe4725 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:50.762686 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-77de7187-fbd0-4d41-a92e-e6d1fae14963 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725" status: 404 len: 111 microversion: 2.1 time: 0.148731 Aug 04 14:20:50.776461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf1b823b-511e-4ff9-80f4-20b61134c4eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:50.777364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf1b823b-511e-4ff9-80f4-20b61134c4eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:50.783433 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2369/4709] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:50 2022] GET /compute/v2.1/servers/444faa71-7547-4fc3-9a24-587f64fe4725 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:20:50.788750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1b823b-511e-4ff9-80f4-20b61134c4eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:50.791715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1b823b-511e-4ff9-80f4-20b61134c4eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:50.793104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1b823b-511e-4ff9-80f4-20b61134c4eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:50.793987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf1b823b-511e-4ff9-80f4-20b61134c4eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:50.859553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf1b823b-511e-4ff9-80f4-20b61134c4eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:20:50.925926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-74c291b8-7b73-4b85-af29-2adf95c9f681 req-599b55c3-5aa0-4be3-9ff1-54cd255155b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c416741-016d-4f02-9a57-507f0454876d", "name": "network-vif-unplugged", "status": "completed", "tag": "e2a0c66d-f403-4a0a-8afd-7a706050968f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:50.963251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-74c291b8-7b73-4b85-af29-2adf95c9f681 req-599b55c3-5aa0-4be3-9ff1-54cd255155b8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:50.963877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-74c291b8-7b73-4b85-af29-2adf95c9f681 req-599b55c3-5aa0-4be3-9ff1-54cd255155b8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:50.988024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:20:50.998244 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-74c291b8-7b73-4b85-af29-2adf95c9f681 req-599b55c3-5aa0-4be3-9ff1-54cd255155b8 service nova] Creating event network-vif-unplugged:e2a0c66d-f403-4a0a-8afd-7a706050968f for instance 9c416741-016d-4f02-9a57-507f0454876d on n-h1-844627-10 Aug 04 14:20:51.007315 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-74c291b8-7b73-4b85-af29-2adf95c9f681 req-599b55c3-5aa0-4be3-9ff1-54cd255155b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089193 Aug 04 14:20:51.008748 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2370/4710] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:20:51.092166 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf1b823b-511e-4ff9-80f4-20b61134c4eb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 204 len: 0 microversion: 2.1 time: 0.323061 Aug 04 14:20:51.092917 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2341/4711] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:20:50 2022] DELETE /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:20:51.115070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd7c46f3-d88a-46f9-a41a-aed04aabafbc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:51.116220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd7c46f3-d88a-46f9-a41a-aed04aabafbc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:51.125514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd7c46f3-d88a-46f9-a41a-aed04aabafbc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:51.126605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd7c46f3-d88a-46f9-a41a-aed04aabafbc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:51.127951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd7c46f3-d88a-46f9-a41a-aed04aabafbc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:51.128858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd7c46f3-d88a-46f9-a41a-aed04aabafbc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:51.168959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37946451-8711-426d-8df4-2f0c14961dfa tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:51.169667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-37946451-8711-426d-8df4-2f0c14961dfa tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:51.178965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37946451-8711-426d-8df4-2f0c14961dfa tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:51.179710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37946451-8711-426d-8df4-2f0c14961dfa tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:51.180821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37946451-8711-426d-8df4-2f0c14961dfa tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:51.181986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37946451-8711-426d-8df4-2f0c14961dfa tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:51.217268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-37946451-8711-426d-8df4-2f0c14961dfa tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lazy-loading 'flavor' on Instance uuid 44d980c4-8034-4898-83d5-bcc0ad62a973 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:20:51.373470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dd7c46f3-d88a-46f9-a41a-aed04aabafbc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:51.393566 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd7c46f3-d88a-46f9-a41a-aed04aabafbc tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1490 microversion: 2.1 time: 0.293668 Aug 04 14:20:51.395554 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2371/4712] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:51 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1490 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:51.660641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c3c19afc-f735-4c83-b0e9-d42995f3ad85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:51.665267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c3c19afc-f735-4c83-b0e9-d42995f3ad85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:51.688005 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37946451-8711-426d-8df4-2f0c14961dfa tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/action" status: 202 len: 0 microversion: 2.20 time: 0.533596 Aug 04 14:20:51.690198 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2342/4713] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 14:20:51 2022] POST /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:20:51.698136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3c19afc-f735-4c83-b0e9-d42995f3ad85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:51.701615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3c19afc-f735-4c83-b0e9-d42995f3ad85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:51.707703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3c19afc-f735-4c83-b0e9-d42995f3ad85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:51.710158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3c19afc-f735-4c83-b0e9-d42995f3ad85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:51.727129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:51.728721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:51.750225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:51.755424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:51.757683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:51.758625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:52.229832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c3c19afc-f735-4c83-b0e9-d42995f3ad85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:52.261751 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c3c19afc-f735-4c83-b0e9-d42995f3ad85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1671 microversion: 2.1 time: 0.619507 Aug 04 14:20:52.263337 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2372/4714] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:51 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1671 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:52.306309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:52.313718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebd6fbbf-cadf-47a1-aecc-350c355a4b81 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:52.315167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ebd6fbbf-cadf-47a1-aecc-350c355a4b81 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:52.319598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:52.323784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:52.326407 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa527065-b363-40c8-a5cc-b89111f73546 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 0.628400 Aug 04 14:20:52.328225 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2343/4715] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:20:51 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:20:52.330857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebd6fbbf-cadf-47a1-aecc-350c355a4b81 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:52.331581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebd6fbbf-cadf-47a1-aecc-350c355a4b81 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:52.332610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebd6fbbf-cadf-47a1-aecc-350c355a4b81 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:52.333337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebd6fbbf-cadf-47a1-aecc-350c355a4b81 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:52.427555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e374e99-fb47-408e-859b-94b8dd0ae948 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:52.428639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e374e99-fb47-408e-859b-94b8dd0ae948 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:52.448472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e374e99-fb47-408e-859b-94b8dd0ae948 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:52.452959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e374e99-fb47-408e-859b-94b8dd0ae948 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:52.454245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e374e99-fb47-408e-859b-94b8dd0ae948 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:52.454950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e374e99-fb47-408e-859b-94b8dd0ae948 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:52.825375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ebd6fbbf-cadf-47a1-aecc-350c355a4b81 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:52.846800 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ebd6fbbf-cadf-47a1-aecc-350c355a4b81 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1509 microversion: 2.1 time: 0.567858 Aug 04 14:20:52.848306 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2373/4716] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:52 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1509 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:52.887950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5e374e99-fb47-408e-859b-94b8dd0ae948 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:52.902863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e374e99-fb47-408e-859b-94b8dd0ae948 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1490 microversion: 2.1 time: 0.484058 Aug 04 14:20:52.905082 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2344/4717] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:52 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1490 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:53.317265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2a4e063f-8ed1-408b-825c-c94948731ef5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:53.318415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2a4e063f-8ed1-408b-825c-c94948731ef5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:53.332001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a4e063f-8ed1-408b-825c-c94948731ef5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:53.333287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a4e063f-8ed1-408b-825c-c94948731ef5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:53.335189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a4e063f-8ed1-408b-825c-c94948731ef5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:53.336411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a4e063f-8ed1-408b-825c-c94948731ef5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:53.367713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:53.368853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:53.388650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:53.393408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:53.394994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:53.398313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:53.815669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a4e063f-8ed1-408b-825c-c94948731ef5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:53.845465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2a4e063f-8ed1-408b-825c-c94948731ef5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1676 microversion: 2.1 time: 0.536639 Aug 04 14:20:53.851063 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2374/4718] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:53 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1676 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:53.871573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:53.888723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-237fdff3-26d7-4490-8f31-cebc01f96e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:53.894378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-237fdff3-26d7-4490-8f31-cebc01f96e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:53.905819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:53.909052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:53.911317 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2bd0f74b-4b5b-4d5e-b64d-95d462e251a4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 0.551760 Aug 04 14:20:53.912815 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2345/4719] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:20:53 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:20:53.920458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-237fdff3-26d7-4490-8f31-cebc01f96e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:53.921404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-237fdff3-26d7-4490-8f31-cebc01f96e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:53.922894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-237fdff3-26d7-4490-8f31-cebc01f96e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:53.923941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-237fdff3-26d7-4490-8f31-cebc01f96e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:53.937761 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-39615255-1250-46f6-9186-2f785704d063 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:53.942561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-39615255-1250-46f6-9186-2f785704d063 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:53.971431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39615255-1250-46f6-9186-2f785704d063 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:53.973460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39615255-1250-46f6-9186-2f785704d063 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:53.975723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39615255-1250-46f6-9186-2f785704d063 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:53.977198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39615255-1250-46f6-9186-2f785704d063 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:54.342398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-237fdff3-26d7-4490-8f31-cebc01f96e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:54.357143 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-237fdff3-26d7-4490-8f31-cebc01f96e4b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1509 microversion: 2.1 time: 0.474619 Aug 04 14:20:54.358043 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2375/4720] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:53 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:54.498212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-39615255-1250-46f6-9186-2f785704d063 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:54.525223 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-39615255-1250-46f6-9186-2f785704d063 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1490 microversion: 2.1 time: 0.598848 Aug 04 14:20:54.526372 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2346/4721] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:53 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1490 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:54.879363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7b71835-6c93-4924-b277-0aa4997a0c0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:54.880452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d7b71835-6c93-4924-b277-0aa4997a0c0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:54.895358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b71835-6c93-4924-b277-0aa4997a0c0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:54.896765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b71835-6c93-4924-b277-0aa4997a0c0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:54.898555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b71835-6c93-4924-b277-0aa4997a0c0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:54.899664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7b71835-6c93-4924-b277-0aa4997a0c0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:54.946540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:54.947630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:54.972697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:54.973737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:54.975255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:54.986247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:55.367926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d7b71835-6c93-4924-b277-0aa4997a0c0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:55.385620 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d7b71835-6c93-4924-b277-0aa4997a0c0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1676 microversion: 2.1 time: 0.513096 Aug 04 14:20:55.386265 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2376/4722] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:54 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1676 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:20:55.400505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bdd52915-98c0-444a-916f-d3a0b653a12e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:55.401432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bdd52915-98c0-444a-916f-d3a0b653a12e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:55.415295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdd52915-98c0-444a-916f-d3a0b653a12e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:55.416072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdd52915-98c0-444a-916f-d3a0b653a12e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:55.417118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdd52915-98c0-444a-916f-d3a0b653a12e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:55.417739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bdd52915-98c0-444a-916f-d3a0b653a12e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:55.574644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:55.645941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:55.653393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:55.660075 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1aff1e4d-0d9a-4e85-ad87-0fd54512ed1b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 0.721184 Aug 04 14:20:55.687306 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2347/4723] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:20:54 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:20:55.696908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a275051-7e68-4dcc-be6d-35af2468a8bb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:55.705217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a275051-7e68-4dcc-be6d-35af2468a8bb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:55.734560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a275051-7e68-4dcc-be6d-35af2468a8bb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:55.735326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a275051-7e68-4dcc-be6d-35af2468a8bb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:55.739178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a275051-7e68-4dcc-be6d-35af2468a8bb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:55.739929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a275051-7e68-4dcc-be6d-35af2468a8bb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:55.930957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2a275051-7e68-4dcc-be6d-35af2468a8bb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2b1ca4f98f441f8508d33dd8e99ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2274689c61ef4dfca8a1017f893a6037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:55.949323 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a275051-7e68-4dcc-be6d-35af2468a8bb tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 200 len: 1448 microversion: 2.1 time: 0.259757 Aug 04 14:20:55.963221 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2348/4724] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:55 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 1448 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:56.043779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-17d93616-4d1b-4419-8be8-cef2c39f7eca req-4a6a4ff1-8595-439f-b36c-6cb5aadff12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac15523-1339-4320-b680-25b9841be7f5", "name": "network-vif-deleted", "tag": "219cba40-80ba-4263-bf6e-a413ed6a24b0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:56.066417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-17d93616-4d1b-4419-8be8-cef2c39f7eca req-4a6a4ff1-8595-439f-b36c-6cb5aadff12e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:56.101624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-17d93616-4d1b-4419-8be8-cef2c39f7eca req-4a6a4ff1-8595-439f-b36c-6cb5aadff12e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:56.171104 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-17d93616-4d1b-4419-8be8-cef2c39f7eca req-4a6a4ff1-8595-439f-b36c-6cb5aadff12e service nova] Creating event network-vif-deleted:219cba40-80ba-4263-bf6e-a413ed6a24b0 for instance eac15523-1339-4320-b680-25b9841be7f5 on n-h1-844627-10 Aug 04 14:20:56.193830 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-17d93616-4d1b-4419-8be8-cef2c39f7eca req-4a6a4ff1-8595-439f-b36c-6cb5aadff12e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162464 Aug 04 14:20:56.195637 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2349/4725] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:20:56.369070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bdd52915-98c0-444a-916f-d3a0b653a12e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:56.385267 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bdd52915-98c0-444a-916f-d3a0b653a12e tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1512 microversion: 2.1 time: 0.988294 Aug 04 14:20:56.386397 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2377/4726] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:55 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1512 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:56.426764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d8ad331-c53f-489a-9339-6a75cc55a681 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:56.428152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3d8ad331-c53f-489a-9339-6a75cc55a681 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:56.441391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d8ad331-c53f-489a-9339-6a75cc55a681 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:56.442467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d8ad331-c53f-489a-9339-6a75cc55a681 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:56.443396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4aab4899-dd0f-4985-9a82-c8e74b64a8d6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:56.444555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d8ad331-c53f-489a-9339-6a75cc55a681 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:56.444981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4aab4899-dd0f-4985-9a82-c8e74b64a8d6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:56.445971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d8ad331-c53f-489a-9339-6a75cc55a681 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:56.466791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aab4899-dd0f-4985-9a82-c8e74b64a8d6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:56.467726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aab4899-dd0f-4985-9a82-c8e74b64a8d6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:56.469240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aab4899-dd0f-4985-9a82-c8e74b64a8d6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:56.470104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aab4899-dd0f-4985-9a82-c8e74b64a8d6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.092480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4aab4899-dd0f-4985-9a82-c8e74b64a8d6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:57.101910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4aab4899-dd0f-4985-9a82-c8e74b64a8d6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.673985 Aug 04 14:20:57.117222 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2378/4727] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:56 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:57.136088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:57.138346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:57.166286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3d8ad331-c53f-489a-9339-6a75cc55a681 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:57.205082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.207264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.209329 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3d8ad331-c53f-489a-9339-6a75cc55a681 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1452 microversion: 2.1 time: 0.789116 Aug 04 14:20:57.211662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.213260 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2350/4728] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:56 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1452 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:57.216465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.246172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:57.250867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] [instance: eac15523-1339-4320-b680-25b9841be7f5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:57.277455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.283256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.287402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.288609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.322375 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] HTTP exception thrown: Instance eac15523-1339-4320-b680-25b9841be7f5 could not be found. Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Request method failure captured: Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 HTTP/1.1 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69VMa_ZYDBGTvoWC4kevUhu8VJJImMrzR9h8Z6pvi4E_e5JVc_WdYe-2RZkkyKhJ1nZdkEMLPr6QOrsGt0Dhwyw2wq6Jd__dJ-7MHT8DY7l4S9kkEYIPHLw2t7mwGcLZArJQLEnhnvSbzvaAVvCIIhr3OqVl0N3_XAueEq4QUKhWET0 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2274689c61ef4dfca8a1017f893a6037 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerRescueTestJSON-898492079 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2274689c61ef4dfca8a1017f893a6037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2274689c61ef4dfca8a1017f893a6037"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2274689c61ef4dfca8a1017f893a6037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2274689c61ef4dfca8a1017f893a6037"}]}] Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerRescueTestJSON-898492079 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2274689c61ef4dfca8a1017f893a6037 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerRescueTestJSON-898492079 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerRescueTestJSON-898492079-project Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 1f2b1ca4f98f441f8508d33dd8e99ae1 Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerRescueTestJSON-898492079-project Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance eac15523-1339-4320-b680-25b9841be7f5 could not be found. Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'eac15523-1339-4320-b680-25b9841be7f5'} Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac15523-1339-4320-b680-25b9841be7f5 could not be found. Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac15523-1339-4320-b680-25b9841be7f5 could not be found. Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:57.324524 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac15523-1339-4320-b680-25b9841be7f5 could not be found. Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] Returning 404 to user: Instance eac15523-1339-4320-b680-25b9841be7f5 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b422ca87-f7f8-42b0-9d76-96974be70790 tempest-ServerRescueTestJSON-898492079 tempest-ServerRescueTestJSON-898492079-project] 10.222.0.66 "GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5" status: 404 len: 111 microversion: 2.1 time: 0.106033 Aug 04 14:20:57.329636 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2351/4729] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:57 2022] GET /compute/v2.1/servers/eac15523-1339-4320-b680-25b9841be7f5 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:20:57.333074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:57.333880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:57.343231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.345045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.345877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.346390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.382407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lazy-loading 'flavor' on Instance uuid 9c416741-016d-4f02-9a57-507f0454876d {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:20:57.399335 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Cannot 'shelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state shelved_offloaded Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action HTTP/1.1 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 14 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: {"shelve": {}} Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: exception: Cannot 'shelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state shelved_offloaded Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d', 'body': {'shelve': {}}} Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9c416741-016d-4f02-9a57-507f0454876d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 04 14:20:57.401733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state shelved_offloaded Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state shelved_offloaded Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 409 to user: Cannot 'shelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state shelved_offloaded {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8432d8af-1217-4d46-95a0-4a6a1475d611 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 409 len: 155 microversion: 2.1 time: 0.075526 Aug 04 14:20:57.407733 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2352/4730] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:20:57 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 155 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:20:57.415822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df145207-5566-4a01-ad46-e2815efffa21 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:20:57.416596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-df145207-5566-4a01-ad46-e2815efffa21 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:57.423637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df145207-5566-4a01-ad46-e2815efffa21 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.424199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df145207-5566-4a01-ad46-e2815efffa21 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.425202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df145207-5566-4a01-ad46-e2815efffa21 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.425884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df145207-5566-4a01-ad46-e2815efffa21 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.540504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-df145207-5566-4a01-ad46-e2815efffa21 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130961) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 14:20:57.694594 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-df145207-5566-4a01-ad46-e2815efffa21 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 202 len: 0 microversion: 2.1 time: 0.283849 Aug 04 14:20:57.695301 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2353/4731] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:20:57 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:20:57.710083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f42b73e8-ce00-4634-98ed-dc4c4ca2baf2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:57.711012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f42b73e8-ce00-4634-98ed-dc4c4ca2baf2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:57.729809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f42b73e8-ce00-4634-98ed-dc4c4ca2baf2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.730313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f42b73e8-ce00-4634-98ed-dc4c4ca2baf2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.731692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f42b73e8-ce00-4634-98ed-dc4c4ca2baf2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:57.732588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f42b73e8-ce00-4634-98ed-dc4c4ca2baf2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:57.756568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:57.808561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:57.815493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:57.820380 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6dc008a-1660-4de5-a55d-0cfd38ca2c57 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 0.696537 Aug 04 14:20:57.821050 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2379/4732] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:20:57 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:20:58.256181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f42b73e8-ce00-4634-98ed-dc4c4ca2baf2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:20:58.271999 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f42b73e8-ce00-4634-98ed-dc4c4ca2baf2 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1460 microversion: 2.1 time: 0.570645 Aug 04 14:20:58.280993 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2354/4733] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:57 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1460 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:20:58.862245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:58.862997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:58.881347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:58.881806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:58.882682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:58.883128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:59.309352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-53acae61-3622-4e00-a562-340f7e3ac0bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:20:59.312756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-53acae61-3622-4e00-a562-340f7e3ac0bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:20:59.327255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53acae61-3622-4e00-a562-340f7e3ac0bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:59.328913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53acae61-3622-4e00-a562-340f7e3ac0bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:20:59.330665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53acae61-3622-4e00-a562-340f7e3ac0bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:20:59.332353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53acae61-3622-4e00-a562-340f7e3ac0bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:00.173098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:00.189710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:00.196942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:00.198514 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d595704-6882-4545-bfed-0832cf3bdb9b tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 1.342001 Aug 04 14:21:00.223498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-53acae61-3622-4e00-a562-340f7e3ac0bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:00.224102 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2380/4734] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:20:58 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:00.235012 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-53acae61-3622-4e00-a562-340f7e3ac0bb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1460 microversion: 2.1 time: 0.934460 Aug 04 14:21:00.236850 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2355/4735] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:20:59 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1460 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:01.236301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:01.261408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:01.268722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b04d8d85-6893-4ba0-98a7-3c04a77993df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:01.270012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b04d8d85-6893-4ba0-98a7-3c04a77993df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:01.288403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:01.298482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:01.300946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:01.315375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b04d8d85-6893-4ba0-98a7-3c04a77993df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:01.323857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b04d8d85-6893-4ba0-98a7-3c04a77993df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:01.325300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:01.342146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b04d8d85-6893-4ba0-98a7-3c04a77993df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:01.342867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b04d8d85-6893-4ba0-98a7-3c04a77993df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:01.362653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:01.457929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:02.032728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:02.051098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b04d8d85-6893-4ba0-98a7-3c04a77993df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:02.060944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:02.065215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:02.068545 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-863bd7ea-402d-4fc3-be88-f6bf6f69736d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 0.842436 Aug 04 14:21:02.070410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2381/4736] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:01 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:21:02.078781 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b04d8d85-6893-4ba0-98a7-3c04a77993df tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.822120 Aug 04 14:21:02.084989 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2356/4737] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:01 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:21:03.142401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:03.143478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:03.189283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=55 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:03.189845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b536f5b0-ee5e-47e9-a856-7a726230eea1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:03.190973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b536f5b0-ee5e-47e9-a856-7a726230eea1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:03.225846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:03.226715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:03.227353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b536f5b0-ee5e-47e9-a856-7a726230eea1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:03.228240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:03.228683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b536f5b0-ee5e-47e9-a856-7a726230eea1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:03.229087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:03.230726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b536f5b0-ee5e-47e9-a856-7a726230eea1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:03.232363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b536f5b0-ee5e-47e9-a856-7a726230eea1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:03.823385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:03.859248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:03.862914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b536f5b0-ee5e-47e9-a856-7a726230eea1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:03.863259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:03.880464 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7bf372c4-c89b-423b-afaa-7a63803a2c64 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 0.747200 Aug 04 14:21:03.880792 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b536f5b0-ee5e-47e9-a856-7a726230eea1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.743289 Aug 04 14:21:03.883504 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2382/4738] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:03 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:03.893802 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2357/4739] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:03 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:04.952905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:04.954569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:04.962381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64afa77d-c2e0-48c6-887c-91d9aee98d6a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:04.963459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64afa77d-c2e0-48c6-887c-91d9aee98d6a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:04.974250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:05.025069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64afa77d-c2e0-48c6-887c-91d9aee98d6a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:05.029666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64afa77d-c2e0-48c6-887c-91d9aee98d6a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:05.033418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64afa77d-c2e0-48c6-887c-91d9aee98d6a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:05.034332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64afa77d-c2e0-48c6-887c-91d9aee98d6a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:05.034548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:05.035038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:05.042734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:05.043919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:05.825870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:05.856740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:05.863170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:05.876562 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-596d3114-31f2-47eb-93a5-b2146cffb940 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 0.925748 Aug 04 14:21:05.887131 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2358/4740] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:04 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:21:05.896216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-64afa77d-c2e0-48c6-887c-91d9aee98d6a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:05.908175 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-64afa77d-c2e0-48c6-887c-91d9aee98d6a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.964552 Aug 04 14:21:05.912274 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2383/4741] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:04 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:06.911987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:06.914451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:06.932127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:06.933704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:06.936550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:06.938258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:06.967519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b7b0d3bf-4a3e-4ac4-8e3d-7c6bd71581b8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:06.969185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b7b0d3bf-4a3e-4ac4-8e3d-7c6bd71581b8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:07.035059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7b0d3bf-4a3e-4ac4-8e3d-7c6bd71581b8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:07.038915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7b0d3bf-4a3e-4ac4-8e3d-7c6bd71581b8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:07.042743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7b0d3bf-4a3e-4ac4-8e3d-7c6bd71581b8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:07.044721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7b0d3bf-4a3e-4ac4-8e3d-7c6bd71581b8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:08.823461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b7b0d3bf-4a3e-4ac4-8e3d-7c6bd71581b8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:08.959972 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b7b0d3bf-4a3e-4ac4-8e3d-7c6bd71581b8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 1.938680 Aug 04 14:21:08.984432 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2384/4742] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:06 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:09.086253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:09.115596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:09.125382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:09.131463 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb81d291-3d74-471f-bade-f67c37ec1f53 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1743 microversion: 2.20 time: 2.227446 Aug 04 14:21:09.139875 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2359/4743] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:06 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1743 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:09.990864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf6df967-59bb-4936-b57f-dbcd8b7565f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:09.991722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf6df967-59bb-4936-b57f-dbcd8b7565f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:10.033808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf6df967-59bb-4936-b57f-dbcd8b7565f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:10.034277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf6df967-59bb-4936-b57f-dbcd8b7565f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:10.035246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf6df967-59bb-4936-b57f-dbcd8b7565f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:10.035824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf6df967-59bb-4936-b57f-dbcd8b7565f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:10.162301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:10.163213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:10.202662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:10.203137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:10.208183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:10.208744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:11.017901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bf6df967-59bb-4936-b57f-dbcd8b7565f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:11.050367 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf6df967-59bb-4936-b57f-dbcd8b7565f3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 1.060887 Aug 04 14:21:11.054823 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2385/4744] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:09 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:11.208110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:11.237906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:11.246126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:11.253552 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-07ee5423-87e2-406d-af02-8c95cbd5e74c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1743 microversion: 2.20 time: 1.096212 Aug 04 14:21:11.255485 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2360/4745] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:10 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1743 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:21:12.091343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7f03818-66d3-4e03-b662-65fbc913fe45 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:12.095864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7f03818-66d3-4e03-b662-65fbc913fe45 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:12.118114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7f03818-66d3-4e03-b662-65fbc913fe45 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:12.135562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7f03818-66d3-4e03-b662-65fbc913fe45 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:12.137769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7f03818-66d3-4e03-b662-65fbc913fe45 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:12.141664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7f03818-66d3-4e03-b662-65fbc913fe45 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:12.205350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1538792927", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "42efd379-85ff-4e73-95a2-9c8778e16c45"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:12.944196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7f03818-66d3-4e03-b662-65fbc913fe45 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:12.959305 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7f03818-66d3-4e03-b662-65fbc913fe45 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.872246 Aug 04 14:21:12.960127 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2361/4746] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:12 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:21:12.974266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:12.982550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:13.007732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:13.008444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:13.009510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:13.009975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:13.407516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:13.451735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:13.455034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:13.474800 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ed7b6c6b-883a-460d-850f-276994ad966a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1738 microversion: 2.20 time: 0.508015 Aug 04 14:21:13.475930 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2362/4747] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:12 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1738 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:13.984013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4fcfa09e-bf99-41e1-9dd8-63c4ee555549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:13.985405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4fcfa09e-bf99-41e1-9dd8-63c4ee555549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:14.001782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fcfa09e-bf99-41e1-9dd8-63c4ee555549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:14.005055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fcfa09e-bf99-41e1-9dd8-63c4ee555549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:14.007515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fcfa09e-bf99-41e1-9dd8-63c4ee555549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:14.008520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fcfa09e-bf99-41e1-9dd8-63c4ee555549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:14.444470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4fcfa09e-bf99-41e1-9dd8-63c4ee555549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:14.460534 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4fcfa09e-bf99-41e1-9dd8-63c4ee555549 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.483124 Aug 04 14:21:14.466947 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2363/4748] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:13 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:14.511535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:14.517564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:14.558070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:14.559267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:14.565038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:14.569903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:15.034341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:15.071165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:15.074983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:15.084435 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f3e68631-d14c-40af-9ba1-99ae9a47cf35 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1738 microversion: 2.20 time: 0.584063 Aug 04 14:21:15.113199 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2364/4749] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:14 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1738 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:15.130689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f27e8ace-9b56-4c16-9ab9-860541f90b93 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:15.131534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f27e8ace-9b56-4c16-9ab9-860541f90b93 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:15.160657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f27e8ace-9b56-4c16-9ab9-860541f90b93 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:15.163284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f27e8ace-9b56-4c16-9ab9-860541f90b93 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:15.165119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f27e8ace-9b56-4c16-9ab9-860541f90b93 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:15.169976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f27e8ace-9b56-4c16-9ab9-860541f90b93 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:15.287877 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f27e8ace-9b56-4c16-9ab9-860541f90b93 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/ips" status: 200 len: 150 microversion: 2.1 time: 0.172147 Aug 04 14:21:15.293611 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2365/4750] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:21:15 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/ips => generated 150 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:15.319903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-4f67497b-ba75-46cf-b7a9-1db5b4331483 req-3d702a63-ebe3-49ae-9f37-c02ead5510a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d980c4-8034-4898-83d5-bcc0ad62a973", "name": "network-vif-plugged", "status": "completed", "tag": "10153aad-a7c0-4ba3-ae0d-2844ce1198a3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:15.375299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4f67497b-ba75-46cf-b7a9-1db5b4331483 req-3d702a63-ebe3-49ae-9f37-c02ead5510a2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:15.377923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4f67497b-ba75-46cf-b7a9-1db5b4331483 req-3d702a63-ebe3-49ae-9f37-c02ead5510a2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:15.481476 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-4f67497b-ba75-46cf-b7a9-1db5b4331483 req-3d702a63-ebe3-49ae-9f37-c02ead5510a2 service nova] Creating event network-vif-plugged:10153aad-a7c0-4ba3-ae0d-2844ce1198a3 for instance 44d980c4-8034-4898-83d5-bcc0ad62a973 on n-h1-844627-10 Aug 04 14:21:15.515894 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-4f67497b-ba75-46cf-b7a9-1db5b4331483 req-3d702a63-ebe3-49ae-9f37-c02ead5510a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218563 Aug 04 14:21:15.527070 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2366/4751] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:15.562833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-478d6974-40ef-4efd-b86e-098578f099d1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:15.577026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-478d6974-40ef-4efd-b86e-098578f099d1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:15.598291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-478d6974-40ef-4efd-b86e-098578f099d1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:15.609353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-478d6974-40ef-4efd-b86e-098578f099d1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:15.615095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-478d6974-40ef-4efd-b86e-098578f099d1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:15.617421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-478d6974-40ef-4efd-b86e-098578f099d1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:16.605889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-478d6974-40ef-4efd-b86e-098578f099d1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:16.640702 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-478d6974-40ef-4efd-b86e-098578f099d1 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 1.107064 Aug 04 14:21:16.653331 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2367/4752] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:15 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:16.699955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:16.715719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:16.753091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:16.754328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:16.760776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:16.762038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:17.431469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:17.464335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:17.476588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:17.479029 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4999c0f9-2f64-4f1d-9cca-57fc6e07c971 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1738 microversion: 2.20 time: 0.808306 Aug 04 14:21:17.490285 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2368/4753] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:16 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1738 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:18.302303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-517127645", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": "none"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:21.041288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=29 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:22.246979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:27.454770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=68 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:28.339365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=23 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:31.227288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] validate_networks() for [('42efd379-85ff-4e73-95a2-9c8778e16c45', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:21:31.261358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:21:31.267302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:21:31.270386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:21:31.277989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:21:31.278716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:21:31.312352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:31.313212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:31.319579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:31.320666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:31.380342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Getting quotas for project 10875130e43741928b52195b788e6511. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:21:31.393687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Getting quotas for user 9ea276fc00164079b98262c7dc74b987 and project 10875130e43741928b52195b788e6511. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:21:31.421022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:21:31.426088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:21:31.572975 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3ba222cd-3c09-4489-a177-4e73d6af142c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 14.080321 Aug 04 14:21:31.574713 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2369/4754] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:21:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 14084 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:21:31.602612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0bd4f654-79d9-406e-a8c3-61da11222cb3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:31.605841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0bd4f654-79d9-406e-a8c3-61da11222cb3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:31.623083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0bd4f654-79d9-406e-a8c3-61da11222cb3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:31.624401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0bd4f654-79d9-406e-a8c3-61da11222cb3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:31.628722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0bd4f654-79d9-406e-a8c3-61da11222cb3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:31.629767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0bd4f654-79d9-406e-a8c3-61da11222cb3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:32.487284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0bd4f654-79d9-406e-a8c3-61da11222cb3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:32.511362 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0bd4f654-79d9-406e-a8c3-61da11222cb3 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.921028 Aug 04 14:21:32.536392 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2370/4755] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:31 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:32.582791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:32.583914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:32.602910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:32.603492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:32.606604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:32.608115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:33.487387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:33.517488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:33.536720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:33.550045 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fad5290e-9068-43be-a1b9-f641bbd90db9 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1738 microversion: 2.20 time: 1.010125 Aug 04 14:21:33.553764 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2371/4756] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:32 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1738 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:33.570057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fc56db61-8345-4f25-ac4c-0597f8ee9397 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "669613e0-8309-46ed-952f-7c5ec82053af"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:33.575388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fc56db61-8345-4f25-ac4c-0597f8ee9397 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:33.591169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc56db61-8345-4f25-ac4c-0597f8ee9397 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:33.601169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc56db61-8345-4f25-ac4c-0597f8ee9397 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:33.602703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc56db61-8345-4f25-ac4c-0597f8ee9397 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:33.607479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc56db61-8345-4f25-ac4c-0597f8ee9397 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:33.875293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:21:33.877974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:21:33.879356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:21:33.880433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:21:33.881561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:21:33.925169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:33.928664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:33.930632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:33.931775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:34.011220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Getting quotas for project b108c35b8f88424abc6434fe90131ae9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:21:34.038929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Getting quotas for user 799d555452494231945a643dd3da8116 and project b108c35b8f88424abc6434fe90131ae9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:21:34.095774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:21:34.102636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:21:34.419777 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5fb28905-c70b-4e65-9795-d2fccb62cbdd tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 23.331171 Aug 04 14:21:34.430124 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2386/4757] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:21:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 23342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:21:34.452324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:34.453955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:34.462827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:34.463559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:34.464694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:34.465372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:34.600020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:34.627131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:34.629407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:34.633189 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-70c3f445-1fd6-4908-95b9-2d8711ad0518 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1281 microversion: 2.54 time: 0.186205 Aug 04 14:21:34.651574 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2387/4758] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:34 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:34.668899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b6db330-c806-47ea-92a9-24d3391cc1d7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:34.689831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1b6db330-c806-47ea-92a9-24d3391cc1d7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:34.703809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b6db330-c806-47ea-92a9-24d3391cc1d7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:34.704282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b6db330-c806-47ea-92a9-24d3391cc1d7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:34.713331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b6db330-c806-47ea-92a9-24d3391cc1d7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:34.714744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b6db330-c806-47ea-92a9-24d3391cc1d7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:34.753169 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fc56db61-8345-4f25-ac4c-0597f8ee9397 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.195810 Aug 04 14:21:34.767521 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2372/4759] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:21:33 2022] POST /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments => generated 194 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:34.789046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f6817a39-206b-4bfe-b4f0-738bed5914e6 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:34.790599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f6817a39-206b-4bfe-b4f0-738bed5914e6 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:35.050433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1b6db330-c806-47ea-92a9-24d3391cc1d7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:35.059404 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1b6db330-c806-47ea-92a9-24d3391cc1d7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.404213 Aug 04 14:21:35.077899 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2388/4760] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:34 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:35.084462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:35.085098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:35.105196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:35.105912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:35.108748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:35.109468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:35.118755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f6817a39-206b-4bfe-b4f0-738bed5914e6 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:35.131519 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f6817a39-206b-4bfe-b4f0-738bed5914e6 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1217 microversion: 2.1 time: 0.359862 Aug 04 14:21:35.132116 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2373/4761] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:34 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1217 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:35.524303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:35.577362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:35.590568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:35.608062 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-332df187-ee60-434e-9b58-10484fce8729 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1738 microversion: 2.20 time: 0.513301 Aug 04 14:21:35.610083 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2389/4762] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:35 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1738 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:35.663847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:35.666726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:35.687709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:35.688570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:35.689718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:35.690363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:35.828246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:35.859663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:35.863545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:35.866948 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-65a90793-14ad-4f7d-ab02-9461e8ec8673 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1329 microversion: 2.54 time: 0.211830 Aug 04 14:21:35.870964 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2374/4763] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:35 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1329 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:36.103007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ab0b228-df3f-46a9-8608-a9d1b3e858cb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:36.109939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4ab0b228-df3f-46a9-8608-a9d1b3e858cb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:36.140524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ab0b228-df3f-46a9-8608-a9d1b3e858cb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:36.142328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ab0b228-df3f-46a9-8608-a9d1b3e858cb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:36.148292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ab0b228-df3f-46a9-8608-a9d1b3e858cb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:36.149767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ab0b228-df3f-46a9-8608-a9d1b3e858cb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:36.175123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e7f3cfb-1396-4ec2-9bb2-7a6530067738 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:36.176938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4e7f3cfb-1396-4ec2-9bb2-7a6530067738 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:36.213132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cfb-1396-4ec2-9bb2-7a6530067738 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:36.221654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cfb-1396-4ec2-9bb2-7a6530067738 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:36.222968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cfb-1396-4ec2-9bb2-7a6530067738 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:36.238735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e7f3cfb-1396-4ec2-9bb2-7a6530067738 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:36.514910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e7f3cfb-1396-4ec2-9bb2-7a6530067738 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:36.525725 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e7f3cfb-1396-4ec2-9bb2-7a6530067738 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1213 microversion: 2.1 time: 0.360806 Aug 04 14:21:36.556344 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2375/4764] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:36 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1213 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:36.629067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4ab0b228-df3f-46a9-8608-a9d1b3e858cb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:36.653422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:36.656617 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4ab0b228-df3f-46a9-8608-a9d1b3e858cb tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.572115 Aug 04 14:21:36.657664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:36.665753 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2390/4765] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:36 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:36.670854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:36.671553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:36.672626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:36.673042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:36.902248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:36.905405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:36.924793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:36.925257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:36.926130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:36.928221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:37.124739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:37.143940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:37.167867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:37.171083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:37.172629 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-604fd28b-68ec-4916-a5ce-65f33501d82d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1738 microversion: 2.20 time: 0.528311 Aug 04 14:21:37.172937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:37.174575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:37.175936 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2376/4766] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:36 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1738 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:37.187053 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7a9b704f-0078-4d25-b9c7-c2c544d4f7a0 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1335 microversion: 2.54 time: 0.292861 Aug 04 14:21:37.202075 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2391/4767] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:36 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1335 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:21:37.551865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-802e4768-db0e-4b52-8d5f-88c98c372582 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:37.552729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-802e4768-db0e-4b52-8d5f-88c98c372582 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:37.563015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-802e4768-db0e-4b52-8d5f-88c98c372582 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:37.565758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-802e4768-db0e-4b52-8d5f-88c98c372582 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:37.569775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-802e4768-db0e-4b52-8d5f-88c98c372582 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:37.570248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-802e4768-db0e-4b52-8d5f-88c98c372582 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:37.695412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c251194-fc0f-423d-a8d0-6465130d2857 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:37.696389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c251194-fc0f-423d-a8d0-6465130d2857 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:37.719269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c251194-fc0f-423d-a8d0-6465130d2857 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:37.719910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c251194-fc0f-423d-a8d0-6465130d2857 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:37.720906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c251194-fc0f-423d-a8d0-6465130d2857 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:37.721657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c251194-fc0f-423d-a8d0-6465130d2857 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:37.795775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-802e4768-db0e-4b52-8d5f-88c98c372582 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:37.822198 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-802e4768-db0e-4b52-8d5f-88c98c372582 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1275 microversion: 2.1 time: 0.275001 Aug 04 14:21:37.829368 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2377/4768] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:37 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:38.219197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:38.220213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:38.249880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:38.250648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:38.268782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:38.272223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:38.394178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c251194-fc0f-423d-a8d0-6465130d2857 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:38.409295 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c251194-fc0f-423d-a8d0-6465130d2857 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.727088 Aug 04 14:21:38.409932 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2392/4769] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:37 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:38.425237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:38.427729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:38.449938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:38.450632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:38.455137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:38.456662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:38.684013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:38.704450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:38.722520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:38.723369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:38.724573 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b7ce798f-600a-4758-973a-94b74d4518b2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1720 microversion: 2.20 time: 0.527859 Aug 04 14:21:38.726521 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2378/4770] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:38 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1720 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:21:38.762809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:38.775772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:38.779268 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b29d45d0-526a-4f6c-99f0-a1c191787101 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1335 microversion: 2.54 time: 0.367825 Aug 04 14:21:38.789410 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2393/4771] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:38 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1335 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:38.851694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7b5324b-70fe-4fbe-98ce-87ec221e9d99 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:38.852625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7b5324b-70fe-4fbe-98ce-87ec221e9d99 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:38.866855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7b5324b-70fe-4fbe-98ce-87ec221e9d99 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:38.868024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7b5324b-70fe-4fbe-98ce-87ec221e9d99 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:38.869832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7b5324b-70fe-4fbe-98ce-87ec221e9d99 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:38.882316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7b5324b-70fe-4fbe-98ce-87ec221e9d99 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:39.203210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d7b5324b-70fe-4fbe-98ce-87ec221e9d99 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:39.216170 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7b5324b-70fe-4fbe-98ce-87ec221e9d99 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1317 microversion: 2.1 time: 0.368365 Aug 04 14:21:39.220919 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2379/4772] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:38 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:39.434842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1523e339-cc3d-4728-ae3c-de91e985d6d4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:39.437023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1523e339-cc3d-4728-ae3c-de91e985d6d4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:39.452705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1523e339-cc3d-4728-ae3c-de91e985d6d4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:39.457975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1523e339-cc3d-4728-ae3c-de91e985d6d4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:39.460242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1523e339-cc3d-4728-ae3c-de91e985d6d4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:39.472112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1523e339-cc3d-4728-ae3c-de91e985d6d4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:39.742579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-14e7a5e3-b641-4e9e-af73-6b9e9799ed8e req-526ad7ba-2bdb-406a-96ed-e8cf9ee9900c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c416741-016d-4f02-9a57-507f0454876d", "name": "network-vif-plugged", "status": "completed", "tag": "e2a0c66d-f403-4a0a-8afd-7a706050968f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:39.788159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-14e7a5e3-b641-4e9e-af73-6b9e9799ed8e req-526ad7ba-2bdb-406a-96ed-e8cf9ee9900c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:39.788904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-14e7a5e3-b641-4e9e-af73-6b9e9799ed8e req-526ad7ba-2bdb-406a-96ed-e8cf9ee9900c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:39.848615 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-14e7a5e3-b641-4e9e-af73-6b9e9799ed8e req-526ad7ba-2bdb-406a-96ed-e8cf9ee9900c service nova] Creating event network-vif-plugged:e2a0c66d-f403-4a0a-8afd-7a706050968f for instance 9c416741-016d-4f02-9a57-507f0454876d on n-h1-844627-10 Aug 04 14:21:39.855421 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-14e7a5e3-b641-4e9e-af73-6b9e9799ed8e req-526ad7ba-2bdb-406a-96ed-e8cf9ee9900c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124755 Aug 04 14:21:39.861628 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2380/4773] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:39.877514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:39.878481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:39.893605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:39.901025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:39.902376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:39.903095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:39.957438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1523e339-cc3d-4728-ae3c-de91e985d6d4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:39.973368 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1523e339-cc3d-4728-ae3c-de91e985d6d4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.543983 Aug 04 14:21:39.985820 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2394/4774] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:39 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:40.001209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:40.002046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:40.014552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:40.015251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:40.016533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:40.017543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:40.243811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:40.260009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:40.265655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:40.271775 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f2ec316a-a6e4-4f70-a213-adbada771861 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1335 microversion: 2.54 time: 0.284538 Aug 04 14:21:40.272425 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2395/4775] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:39 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1335 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:40.299123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-798b6044-f9a0-4b16-ae7d-3fdcc4fcd8ad tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:40.299820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-798b6044-f9a0-4b16-ae7d-3fdcc4fcd8ad tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:40.320974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-798b6044-f9a0-4b16-ae7d-3fdcc4fcd8ad tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:40.321538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-798b6044-f9a0-4b16-ae7d-3fdcc4fcd8ad tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:40.322652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-798b6044-f9a0-4b16-ae7d-3fdcc4fcd8ad tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:40.325524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-798b6044-f9a0-4b16-ae7d-3fdcc4fcd8ad tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:40.395897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:40.410933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:40.413188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:40.415085 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-79d793bf-70e0-49c2-a5bf-7124a7b859c4 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1720 microversion: 2.20 time: 0.551753 Aug 04 14:21:40.416393 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2381/4776] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:39 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1720 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:40.816368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-798b6044-f9a0-4b16-ae7d-3fdcc4fcd8ad tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:40.837667 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-798b6044-f9a0-4b16-ae7d-3fdcc4fcd8ad tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1317 microversion: 2.1 time: 0.542423 Aug 04 14:21:40.841377 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2396/4777] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:40 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:41.005735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e7f374c-8e34-4621-98fb-b5386c5d8673 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:41.007856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e7f374c-8e34-4621-98fb-b5386c5d8673 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:41.031302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e7f374c-8e34-4621-98fb-b5386c5d8673 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:41.032720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e7f374c-8e34-4621-98fb-b5386c5d8673 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:41.034552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e7f374c-8e34-4621-98fb-b5386c5d8673 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:41.036455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e7f374c-8e34-4621-98fb-b5386c5d8673 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:41.119012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7ddd1e64-8884-47b3-b396-96be1964e874 req-81e1d72d-43f7-4f27-b444-75d7d2d1e8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbdb8e1d-5392-4c38-86e8-46816d53392f", "tag": "834926ef-c033-432e-9245-bcc97ea3f607"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:41.202523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7ddd1e64-8884-47b3-b396-96be1964e874 req-81e1d72d-43f7-4f27-b444-75d7d2d1e8e2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:41.203806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7ddd1e64-8884-47b3-b396-96be1964e874 req-81e1d72d-43f7-4f27-b444-75d7d2d1e8e2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:41.257964 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7ddd1e64-8884-47b3-b396-96be1964e874 req-81e1d72d-43f7-4f27-b444-75d7d2d1e8e2 service nova] Creating event network-changed:834926ef-c033-432e-9245-bcc97ea3f607 for instance bbdb8e1d-5392-4c38-86e8-46816d53392f on n-h2-844627-10 Aug 04 14:21:41.271398 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7ddd1e64-8884-47b3-b396-96be1964e874 req-81e1d72d-43f7-4f27-b444-75d7d2d1e8e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163599 Aug 04 14:21:41.273522 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2397/4778] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:41.321549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:41.324000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:41.344495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:41.346303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:41.348847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:41.350517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:41.360908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:42.051353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:42.065517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:42.069632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:42.074610 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-973b6123-90ba-402a-bfbc-2694720df16f tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1356 microversion: 2.54 time: 0.776422 Aug 04 14:21:42.077839 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2398/4779] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:41 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1356 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:42.102657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:42.104109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:42.121656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:42.122783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:42.135661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:42.138495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:42.159292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7e7f374c-8e34-4621-98fb-b5386c5d8673 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:42.185240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e7f374c-8e34-4621-98fb-b5386c5d8673 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 1.187688 Aug 04 14:21:42.194716 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2382/4780] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:40 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:21:42.204389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2cf978ac-dc3d-4612-aafc-30de3724a814 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:42.217812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2cf978ac-dc3d-4612-aafc-30de3724a814 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:42.234474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2cf978ac-dc3d-4612-aafc-30de3724a814 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:42.236388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2cf978ac-dc3d-4612-aafc-30de3724a814 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:42.238027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2cf978ac-dc3d-4612-aafc-30de3724a814 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:42.238871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2cf978ac-dc3d-4612-aafc-30de3724a814 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:42.739015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:42.750491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:42.752288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:42.753974 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9779bb17-18d5-4896-996b-2b7a83ec5034 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1720 microversion: 2.20 time: 0.674422 Aug 04 14:21:42.768850 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2399/4781] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:42 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1720 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:42.768850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-bdec5213-23b2-4904-9694-f1966211d1e7 req-6d61649c-164b-4245-a7d5-655cda5a223e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d980c4-8034-4898-83d5-bcc0ad62a973", "name": "network-vif-unplugged", "status": "completed", "tag": "10153aad-a7c0-4ba3-ae0d-2844ce1198a3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:42.773300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bdec5213-23b2-4904-9694-f1966211d1e7 req-6d61649c-164b-4245-a7d5-655cda5a223e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:42.773910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bdec5213-23b2-4904-9694-f1966211d1e7 req-6d61649c-164b-4245-a7d5-655cda5a223e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:42.801102 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-bdec5213-23b2-4904-9694-f1966211d1e7 req-6d61649c-164b-4245-a7d5-655cda5a223e service nova] Creating event network-vif-unplugged:10153aad-a7c0-4ba3-ae0d-2844ce1198a3 for instance 44d980c4-8034-4898-83d5-bcc0ad62a973 on n-h1-844627-10 Aug 04 14:21:42.808644 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-bdec5213-23b2-4904-9694-f1966211d1e7 req-6d61649c-164b-4245-a7d5-655cda5a223e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052225 Aug 04 14:21:42.809914 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2400/4782] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:42.816086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d6a0a500-4a46-4ea6-aa98-cafd626d8dc5 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Action: 'create', calling method: .version_select at 0x7f46f2ff43a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-343421255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjgG91Iav7vf7Odf0M22vo3uWDpN1jAGFXO5Ug1lS0JZ+qjMnEcP8CTUNU3+zZy/X8KSTY0Iqd8g+sRrCvNfWPdEfotEugYwZYC13S2kPH6Sn474sPcdB04myOHdRS5oQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:42.817104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2cf978ac-dc3d-4612-aafc-30de3724a814 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:42.837036 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2cf978ac-dc3d-4612-aafc-30de3724a814 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1317 microversion: 2.1 time: 0.640107 Aug 04 14:21:42.848922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d6a0a500-4a46-4ea6-aa98-cafd626d8dc5 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Getting quotas for project 10875130e43741928b52195b788e6511. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:21:42.848922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d6a0a500-4a46-4ea6-aa98-cafd626d8dc5 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Getting quotas for user 9ea276fc00164079b98262c7dc74b987 and project 10875130e43741928b52195b788e6511. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:21:42.850240 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2383/4783] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:42 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:42.904700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d6a0a500-4a46-4ea6-aa98-cafd626d8dc5 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.093028 Aug 04 14:21:42.905996 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2401/4784] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 14:21:42 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 14:21:42.919834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-343421255", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:42.923216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:42.934263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:42.935513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:42.937872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:42.938933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.127773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:21:43.129156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:21:43.130230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:21:43.131297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:21:43.132471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:21:43.216546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c2a01f34-ed60-4168-8cd7-234c49a7c762 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:43.217505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c2a01f34-ed60-4168-8cd7-234c49a7c762 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:43.237297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2a01f34-ed60-4168-8cd7-234c49a7c762 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.238040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2a01f34-ed60-4168-8cd7-234c49a7c762 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.239195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2a01f34-ed60-4168-8cd7-234c49a7c762 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.239885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2a01f34-ed60-4168-8cd7-234c49a7c762 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.335995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:43.396059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:43.433945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.434694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.435894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.436610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.496093 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa9d4c34-feea-410a-844d-8ace3db6c96c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "POST /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628/action" status: 202 len: 1138 microversion: 2.54 time: 0.581410 Aug 04 14:21:43.497471 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2384/4785] 10.222.0.66 () {62 vars in 1320 bytes} [Thu Aug 4 14:21:42 2022] POST /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628/action => generated 1138 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 14:21:43.529428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:43.530466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:43.546200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.546823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.547961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.548458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.732617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:43.754305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:43.757188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:43.759350 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dbcf67b9-840b-4882-a3eb-323f4090c706 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.233798 Aug 04 14:21:43.761059 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2385/4786] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:43 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:43.767933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c2a01f34-ed60-4168-8cd7-234c49a7c762 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:43.792108 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c2a01f34-ed60-4168-8cd7-234c49a7c762 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.580260 Aug 04 14:21:43.805012 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2402/4787] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:43 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:43.819858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:43.822816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:43.841772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.844368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.847565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.848586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.885638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c6cbd169-4b78-47a2-9981-228d508be890 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:43.886307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c6cbd169-4b78-47a2-9981-228d508be890 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:43.899268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6cbd169-4b78-47a2-9981-228d508be890 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.899736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6cbd169-4b78-47a2-9981-228d508be890 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.900561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6cbd169-4b78-47a2-9981-228d508be890 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:43.901049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6cbd169-4b78-47a2-9981-228d508be890 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:43.974105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:45.044567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:45.054446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:45.056481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:45.058638 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-184248a0-ac27-4934-a580-768d2048eb84 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1720 microversion: 2.20 time: 1.261102 Aug 04 14:21:45.059390 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2386/4788] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:43 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1720 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:45.064533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:45.065682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:45.077729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:45.082078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:45.083199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:45.086735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:45.133386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:45.346975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c6cbd169-4b78-47a2-9981-228d508be890 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:45.367962 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c6cbd169-4b78-47a2-9981-228d508be890 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1317 microversion: 2.1 time: 1.486561 Aug 04 14:21:45.370405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2403/4789] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:43 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1317 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:45.388314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81dc5c9c-4759-4360-afd7-77014fee7a43 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:45.395513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81dc5c9c-4759-4360-afd7-77014fee7a43 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:45.420899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81dc5c9c-4759-4360-afd7-77014fee7a43 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:45.421737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81dc5c9c-4759-4360-afd7-77014fee7a43 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:45.423448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81dc5c9c-4759-4360-afd7-77014fee7a43 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:45.433282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81dc5c9c-4759-4360-afd7-77014fee7a43 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:45.498676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:45.524087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:45.524087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:45.524505 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d1c95701-f881-4d52-bff1-accedbf7d5c2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.463508 Aug 04 14:21:45.528390 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2387/4790] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:45 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:46.105016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:46.106041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:46.116262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:46.116745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:46.119035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:46.121122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:46.166243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-81dc5c9c-4759-4360-afd7-77014fee7a43 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:46.184640 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81dc5c9c-4759-4360-afd7-77014fee7a43 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1518 microversion: 2.1 time: 0.810616 Aug 04 14:21:46.190989 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2404/4791] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:45 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1518 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:46.392549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c0e820f0-d151-4cd5-b542-5709b7c3fa97 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:46.394162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c0e820f0-d151-4cd5-b542-5709b7c3fa97 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:46.401191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0e820f0-d151-4cd5-b542-5709b7c3fa97 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:46.401968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0e820f0-d151-4cd5-b542-5709b7c3fa97 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:46.402948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0e820f0-d151-4cd5-b542-5709b7c3fa97 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:46.403558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c0e820f0-d151-4cd5-b542-5709b7c3fa97 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:46.441475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:47.219249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:47.240375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:47.244463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:47.248491 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-da9e556e-d540-4dcb-912a-d7bfb6f28719 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1663 microversion: 2.20 time: 1.149064 Aug 04 14:21:47.252096 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2388/4792] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:46 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1663 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:21:47.265324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:47.268343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:47.282970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:47.283852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:47.284942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:47.285917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:47.634377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:47.643103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c0e820f0-d151-4cd5-b542-5709b7c3fa97 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:47.669529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c0e820f0-d151-4cd5-b542-5709b7c3fa97 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1317 microversion: 2.1 time: 1.275313 Aug 04 14:21:47.687189 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2405/4793] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:46 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1317 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:47.692942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:47.694760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:47.696046 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1fb98f24-0294-45c0-a186-52b8d5856098 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.442154 Aug 04 14:21:47.696650 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2389/4794] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:47 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:47.714865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1baac498-2897-4ba2-90df-2e039411ae8b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:47.718239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42743fbd-1f33-4bfd-aa95-0fb9f708c7bc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6917ba1b-8a83-406f-8f32-36794d2fe8b4"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:47.721433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-42743fbd-1f33-4bfd-aa95-0fb9f708c7bc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:47.725833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1baac498-2897-4ba2-90df-2e039411ae8b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:47.732064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42743fbd-1f33-4bfd-aa95-0fb9f708c7bc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:47.734618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42743fbd-1f33-4bfd-aa95-0fb9f708c7bc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:47.737987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42743fbd-1f33-4bfd-aa95-0fb9f708c7bc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:47.739021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42743fbd-1f33-4bfd-aa95-0fb9f708c7bc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:47.746438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1baac498-2897-4ba2-90df-2e039411ae8b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:47.747178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1baac498-2897-4ba2-90df-2e039411ae8b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:47.750551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1baac498-2897-4ba2-90df-2e039411ae8b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:47.751395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1baac498-2897-4ba2-90df-2e039411ae8b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:48.248808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1baac498-2897-4ba2-90df-2e039411ae8b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:48.264797 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1baac498-2897-4ba2-90df-2e039411ae8b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.569332 Aug 04 14:21:48.266081 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2406/4795] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:47 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:48.288854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-25d81148-25ab-4a49-b011-8b88d8ca655b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:48.290648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-25d81148-25ab-4a49-b011-8b88d8ca655b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:48.314387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25d81148-25ab-4a49-b011-8b88d8ca655b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:48.315137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25d81148-25ab-4a49-b011-8b88d8ca655b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:48.316420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25d81148-25ab-4a49-b011-8b88d8ca655b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:48.317083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25d81148-25ab-4a49-b011-8b88d8ca655b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:48.398032 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-42743fbd-1f33-4bfd-aa95-0fb9f708c7bc tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.687623 Aug 04 14:21:48.401762 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2390/4796] 10.222.0.66 () {62 vars in 1364 bytes} [Thu Aug 4 14:21:47 2022] POST /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/os-volume_attachments => generated 188 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:21:48.496522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-47e318e5-d367-4718-b6f3-e3aa1212df1c req-bacc71af-4f8a-4110-95f9-aca88e7567c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbdb8e1d-5392-4c38-86e8-46816d53392f", "name": "network-vif-plugged", "status": "completed", "tag": "834926ef-c033-432e-9245-bcc97ea3f607"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:48.538564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-47e318e5-d367-4718-b6f3-e3aa1212df1c req-bacc71af-4f8a-4110-95f9-aca88e7567c0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:48.544843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-47e318e5-d367-4718-b6f3-e3aa1212df1c req-bacc71af-4f8a-4110-95f9-aca88e7567c0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:48.593650 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-47e318e5-d367-4718-b6f3-e3aa1212df1c req-bacc71af-4f8a-4110-95f9-aca88e7567c0 service nova] Creating event network-vif-plugged:834926ef-c033-432e-9245-bcc97ea3f607 for instance bbdb8e1d-5392-4c38-86e8-46816d53392f on n-h2-844627-10 Aug 04 14:21:48.613277 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-47e318e5-d367-4718-b6f3-e3aa1212df1c req-bacc71af-4f8a-4110-95f9-aca88e7567c0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126001 Aug 04 14:21:48.614345 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2391/4797] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:48.672341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-25d81148-25ab-4a49-b011-8b88d8ca655b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:48.699719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-761cc905-bddd-47c2-8afb-d19caa350b71 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:48.708231 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-25d81148-25ab-4a49-b011-8b88d8ca655b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.423312 Aug 04 14:21:48.708765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-761cc905-bddd-47c2-8afb-d19caa350b71 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:48.722735 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2407/4798] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:48 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:48.732316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-761cc905-bddd-47c2-8afb-d19caa350b71 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:48.745161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:48.746144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-761cc905-bddd-47c2-8afb-d19caa350b71 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:48.747188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-761cc905-bddd-47c2-8afb-d19caa350b71 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:48.747651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-761cc905-bddd-47c2-8afb-d19caa350b71 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:48.753156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:48.761707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:48.779660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:48.786379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:48.788345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:49.013186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:49.030946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:49.035696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:49.038490 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff8b2a69-aa31-46c1-b095-8de2bdce8212 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.313680 Aug 04 14:21:49.040405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2408/4799] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:48 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:49.056291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b7e46de1-1c4c-47f9-a3dd-337da5e8f436 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:49.059431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b7e46de1-1c4c-47f9-a3dd-337da5e8f436 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:49.072623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7e46de1-1c4c-47f9-a3dd-337da5e8f436 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:49.073651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7e46de1-1c4c-47f9-a3dd-337da5e8f436 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:49.075166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7e46de1-1c4c-47f9-a3dd-337da5e8f436 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:49.076514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7e46de1-1c4c-47f9-a3dd-337da5e8f436 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:49.104165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-761cc905-bddd-47c2-8afb-d19caa350b71 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:49.115883 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-761cc905-bddd-47c2-8afb-d19caa350b71 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1317 microversion: 2.1 time: 0.424470 Aug 04 14:21:49.117146 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2392/4800] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:48 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:21:49.124597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c532c28-34e6-4091-81ae-24e6003ee87f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:49.125390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7c532c28-34e6-4091-81ae-24e6003ee87f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:49.134063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c532c28-34e6-4091-81ae-24e6003ee87f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:49.134927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c532c28-34e6-4091-81ae-24e6003ee87f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:49.135949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c532c28-34e6-4091-81ae-24e6003ee87f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:49.136548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c532c28-34e6-4091-81ae-24e6003ee87f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:49.340451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b7e46de1-1c4c-47f9-a3dd-337da5e8f436 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:49.353983 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b7e46de1-1c4c-47f9-a3dd-337da5e8f436 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.310300 Aug 04 14:21:49.356685 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2409/4801] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:49 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:49.382833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-560d2b35-b03c-423f-869b-1f8a043acefa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:49.402281 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-560d2b35-b03c-423f-869b-1f8a043acefa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 5d1e7170-7fe9-4270-a077-226794f4b655 has no mapping to a cell. Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-560d2b35-b03c-423f-869b-1f8a043acefa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/5d1e7170-7fe9-4270-a077-226794f4b655/action HTTP/1.1 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 15 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: {"os-stop": {}} Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 5d1e7170-7fe9-4270-a077-226794f4b655 has no mapping to a cell. Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '5d1e7170-7fe9-4270-a077-226794f4b655', 'body': {'os-stop': {}}} Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 5d1e7170-7fe9-4270-a077-226794f4b655 has no mapping to a cell. Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:21:49.432558 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d1e7170-7fe9-4270-a077-226794f4b655 has no mapping to a cell. Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d1e7170-7fe9-4270-a077-226794f4b655 has no mapping to a cell. Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-560d2b35-b03c-423f-869b-1f8a043acefa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 5d1e7170-7fe9-4270-a077-226794f4b655 has no mapping to a cell. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-560d2b35-b03c-423f-869b-1f8a043acefa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/5d1e7170-7fe9-4270-a077-226794f4b655/action" status: 404 len: 117 microversion: 2.1 time: 0.064041 Aug 04 14:21:49.444420 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2410/4802] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:21:49 2022] POST /compute/v2.1/servers/5d1e7170-7fe9-4270-a077-226794f4b655/action => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:21:49.459818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6dfaaaa4-8d6f-439c-9d55-8b6b819c758f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:49.467524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6dfaaaa4-8d6f-439c-9d55-8b6b819c758f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:49.486945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dfaaaa4-8d6f-439c-9d55-8b6b819c758f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:49.487916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dfaaaa4-8d6f-439c-9d55-8b6b819c758f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:49.497051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dfaaaa4-8d6f-439c-9d55-8b6b819c758f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:49.498771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dfaaaa4-8d6f-439c-9d55-8b6b819c758f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:49.598527 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c532c28-34e6-4091-81ae-24e6003ee87f tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/os-volume_attachments/6917ba1b-8a83-406f-8f32-36794d2fe8b4" status: 202 len: 0 microversion: 2.20 time: 0.479545 Aug 04 14:21:49.599534 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2393/4803] 10.222.0.66 () {60 vars in 1457 bytes} [Thu Aug 4 14:21:49 2022] DELETE /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/os-volume_attachments/6917ba1b-8a83-406f-8f32-36794d2fe8b4 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:21:49.696539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c47f8e2c-9a4a-41a2-876b-3ad620024437 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:49.697736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c47f8e2c-9a4a-41a2-876b-3ad620024437 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:49.710179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c47f8e2c-9a4a-41a2-876b-3ad620024437 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:49.711483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c47f8e2c-9a4a-41a2-876b-3ad620024437 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:49.713341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c47f8e2c-9a4a-41a2-876b-3ad620024437 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:49.714507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c47f8e2c-9a4a-41a2-876b-3ad620024437 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:49.790796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c47f8e2c-9a4a-41a2-876b-3ad620024437 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130961) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 14:21:49.961642 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c47f8e2c-9a4a-41a2-876b-3ad620024437 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "POST /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/action" status: 202 len: 0 microversion: 2.20 time: 0.271125 Aug 04 14:21:49.969099 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2394/4804] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 14:21:49 2022] POST /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:21:49.985783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:49.986990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:50.004542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:50.005440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:50.008544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:50.008940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:50.076220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:50.083590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6dfaaaa4-8d6f-439c-9d55-8b6b819c758f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:50.097164 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6dfaaaa4-8d6f-439c-9d55-8b6b819c758f tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.648974 Aug 04 14:21:50.101237 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2411/4805] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:49 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:50.132250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:50.138481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:50.161715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:50.162697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:50.167161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:50.173382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:50.474738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:50.522672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:50.525578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:50.527883 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-57eb2849-aea3-49c4-b58c-4a02660667a6 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.424631 Aug 04 14:21:50.566588 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2412/4806] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:50 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:50.582401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a558f271-d673-4d5a-87a2-007e19e42dce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:50.583541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a558f271-d673-4d5a-87a2-007e19e42dce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:50.624391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a558f271-d673-4d5a-87a2-007e19e42dce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:50.625429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a558f271-d673-4d5a-87a2-007e19e42dce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:50.627057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a558f271-d673-4d5a-87a2-007e19e42dce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:50.628354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a558f271-d673-4d5a-87a2-007e19e42dce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:50.847652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:50.868934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:50.873840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:50.877037 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-055e4fe6-e693-4bb7-aa9a-ca03a670782a tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1671 microversion: 2.20 time: 0.903717 Aug 04 14:21:50.879269 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2395/4807] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:49 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1671 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:21:50.899796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b8223012-0919-4d12-b4b3-3021c78b9aa1 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:50.914289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b8223012-0919-4d12-b4b3-3021c78b9aa1 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:50.923882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8223012-0919-4d12-b4b3-3021c78b9aa1 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:50.924339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8223012-0919-4d12-b4b3-3021c78b9aa1 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:50.925482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8223012-0919-4d12-b4b3-3021c78b9aa1 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:50.926141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8223012-0919-4d12-b4b3-3021c78b9aa1 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:51.154700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a558f271-d673-4d5a-87a2-007e19e42dce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:51.169964 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a558f271-d673-4d5a-87a2-007e19e42dce tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.599616 Aug 04 14:21:51.184155 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2413/4808] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:50 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:51.242529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd7dcd91-6991-429c-879d-b048a8ddf3e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:51.243981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bd7dcd91-6991-429c-879d-b048a8ddf3e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: cdb510a8-588c-458c-8ebf-b7be2147d9a9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:51.272559 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-bd7dcd91-6991-429c-879d-b048a8ddf3e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance cdb510a8-588c-458c-8ebf-b7be2147d9a9 could not be found. Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd7dcd91-6991-429c-879d-b048a8ddf3e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/cdb510a8-588c-458c-8ebf-b7be2147d9a9/action HTTP/1.1 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 15 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: {"suspend": {}} Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance cdb510a8-588c-458c-8ebf-b7be2147d9a9 could not be found. Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'cdb510a8-588c-458c-8ebf-b7be2147d9a9', 'body': {'suspend': {}}} Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb510a8-588c-458c-8ebf-b7be2147d9a9 could not be found. Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb510a8-588c-458c-8ebf-b7be2147d9a9 could not be found. Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:21:51.277703 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:21:51.287904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:21:51.287904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:21:51.287904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb510a8-588c-458c-8ebf-b7be2147d9a9 could not be found. Aug 04 14:21:51.287904 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:51.287904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd7dcd91-6991-429c-879d-b048a8ddf3e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance cdb510a8-588c-458c-8ebf-b7be2147d9a9 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:21:51.287904 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd7dcd91-6991-429c-879d-b048a8ddf3e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/cdb510a8-588c-458c-8ebf-b7be2147d9a9/action" status: 404 len: 111 microversion: 2.1 time: 0.059966 Aug 04 14:21:51.287904 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2414/4809] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:21:51 2022] POST /compute/v2.1/servers/cdb510a8-588c-458c-8ebf-b7be2147d9a9/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:21:51.306816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-658f4155-0258-4da6-802a-c88bfb3871d8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:51.309243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-658f4155-0258-4da6-802a-c88bfb3871d8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:51.327586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-658f4155-0258-4da6-802a-c88bfb3871d8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:51.328598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-658f4155-0258-4da6-802a-c88bfb3871d8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:51.331798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-658f4155-0258-4da6-802a-c88bfb3871d8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:51.333819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-658f4155-0258-4da6-802a-c88bfb3871d8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:51.424727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8223012-0919-4d12-b4b3-3021c78b9aa1 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:51.446105 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b8223012-0919-4d12-b4b3-3021c78b9aa1 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1506 microversion: 2.1 time: 0.564574 Aug 04 14:21:51.447823 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2396/4810] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:50 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:51.515564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-850239fd-4339-4dca-9672-6a03d382506b tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:51.516722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-850239fd-4339-4dca-9672-6a03d382506b tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:51.572669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-850239fd-4339-4dca-9672-6a03d382506b tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:51.576388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-850239fd-4339-4dca-9672-6a03d382506b tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:51.583039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-850239fd-4339-4dca-9672-6a03d382506b tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:51.584642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-850239fd-4339-4dca-9672-6a03d382506b tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:51.715666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-850239fd-4339-4dca-9672-6a03d382506b tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:51.723482 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-850239fd-4339-4dca-9672-6a03d382506b tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f/os-instance-actions/req-5fb28905-c70b-4e65-9795-d2fccb62cbdd" status: 200 len: 313 microversion: 2.1 time: 0.241223 Aug 04 14:21:51.745555 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2397/4811] 10.222.0.66 () {58 vars in 1419 bytes} [Thu Aug 4 14:21:51 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f/os-instance-actions/req-5fb28905-c70b-4e65-9795-d2fccb62cbdd => generated 313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:51.759362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:51.769054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:51.800137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:51.800988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:51.802421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:51.803158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:51.821932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-658f4155-0258-4da6-802a-c88bfb3871d8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:51.843245 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-658f4155-0258-4da6-802a-c88bfb3871d8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.550235 Aug 04 14:21:51.846139 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2415/4812] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:51 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:21:51.858453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0cd20bf1-f215-46ee-811e-e3b6d34be6e7 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:51.863220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0cd20bf1-f215-46ee-811e-e3b6d34be6e7 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:51.877540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cd20bf1-f215-46ee-811e-e3b6d34be6e7 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:51.879484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cd20bf1-f215-46ee-811e-e3b6d34be6e7 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:51.884544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cd20bf1-f215-46ee-811e-e3b6d34be6e7 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:51.886549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0cd20bf1-f215-46ee-811e-e3b6d34be6e7 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:52.022901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:52.053415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:52.060747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:52.063971 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3da5c299-8429-458f-bfa6-93321a150119 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.315762 Aug 04 14:21:52.079350 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2398/4813] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:51 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:52.084354 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0cd20bf1-f215-46ee-811e-e3b6d34be6e7 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "POST /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f/action" status: 202 len: 0 microversion: 2.1 time: 0.234402 Aug 04 14:21:52.090301 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2416/4814] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:21:51 2022] POST /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:21:52.113090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec60c5ce-620a-4bd3-a28f-e91b58f0cffa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:52.114267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ec60c5ce-620a-4bd3-a28f-e91b58f0cffa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:52.115498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:52.117636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:52.133518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:52.134827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:52.136977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:52.138201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:52.159455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec60c5ce-620a-4bd3-a28f-e91b58f0cffa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:52.160248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec60c5ce-620a-4bd3-a28f-e91b58f0cffa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:52.163892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec60c5ce-620a-4bd3-a28f-e91b58f0cffa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:52.167109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec60c5ce-620a-4bd3-a28f-e91b58f0cffa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:52.781273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:52.802636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:52.810320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:52.814627 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-755ffb8d-27a1-49dc-b5fd-b875a67192de tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1673 microversion: 2.20 time: 0.721467 Aug 04 14:21:52.816481 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2417/4815] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:52 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1673 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:52.826871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4061f5ad-bd66-44a2-ac31-d5d9a4249573 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:52.828416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4061f5ad-bd66-44a2-ac31-d5d9a4249573 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:52.837075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ec60c5ce-620a-4bd3-a28f-e91b58f0cffa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:52.844417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4061f5ad-bd66-44a2-ac31-d5d9a4249573 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:52.845543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4061f5ad-bd66-44a2-ac31-d5d9a4249573 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:52.847754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4061f5ad-bd66-44a2-ac31-d5d9a4249573 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:52.849158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4061f5ad-bd66-44a2-ac31-d5d9a4249573 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:52.870088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=10 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:52.877581 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec60c5ce-620a-4bd3-a28f-e91b58f0cffa tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.791721 Aug 04 14:21:52.878287 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2399/4816] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:52 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:52.898565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "669613e0-8309-46ed-952f-7c5ec82053af"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:52.917427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:52.929963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:52.930459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:52.931315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:52.931781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:53.219220 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Invalid volume: volume 669613e0-8309-46ed-952f-7c5ec82053af is already attached to instances: d99315bc-8884-4e97-87ec-9f88968eb678 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments HTTP/1.1 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 74 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: {"volumeAttachment": {"volumeId": "669613e0-8309-46ed-952f-7c5ec82053af"}} Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid volume: volume 669613e0-8309-46ed-952f-7c5ec82053af is already attached to instances: d99315bc-8884-4e97-87ec-9f88968eb678 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': 'd99315bc-8884-4e97-87ec-9f88968eb678', 'body': {'volumeAttachment': {'volumeId': '669613e0-8309-46ed-952f-7c5ec82053af'}}} Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 669613e0-8309-46ed-952f-7c5ec82053af is already attached to instances: d99315bc-8884-4e97-87ec-9f88968eb678 Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:21:53.227162 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 669613e0-8309-46ed-952f-7c5ec82053af is already attached to instances: d99315bc-8884-4e97-87ec-9f88968eb678 Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 669613e0-8309-46ed-952f-7c5ec82053af is already attached to instances: d99315bc-8884-4e97-87ec-9f88968eb678 Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 400 to user: Invalid volume: volume 669613e0-8309-46ed-952f-7c5ec82053af is already attached to instances: d99315bc-8884-4e97-87ec-9f88968eb678 {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b016fc67-a3b2-46d1-a79a-b6e36093fa06 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.349582 Aug 04 14:21:53.241146 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2400/4817] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:21:52 2022] POST /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments => generated 174 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:21:53.262787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a65b165b-c092-4509-aee4-26f7cb627ecc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:53.263533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a65b165b-c092-4509-aee4-26f7cb627ecc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:53.288319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a65b165b-c092-4509-aee4-26f7cb627ecc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:53.289226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a65b165b-c092-4509-aee4-26f7cb627ecc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:53.290868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a65b165b-c092-4509-aee4-26f7cb627ecc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:53.292096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a65b165b-c092-4509-aee4-26f7cb627ecc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:53.358880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-a65b165b-c092-4509-aee4-26f7cb627ecc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lazy-loading 'flavor' on Instance uuid 9c416741-016d-4f02-9a57-507f0454876d {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:21:53.524344 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a65b165b-c092-4509-aee4-26f7cb627ecc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 202 len: 0 microversion: 2.1 time: 0.292720 Aug 04 14:21:53.525048 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2401/4818] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:21:53 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:21:53.538068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:53.538810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:53.562278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:53.562747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:53.565091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:53.569034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:53.645938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4061f5ad-bd66-44a2-ac31-d5d9a4249573 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:53.662364 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4061f5ad-bd66-44a2-ac31-d5d9a4249573 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1508 microversion: 2.1 time: 0.843730 Aug 04 14:21:53.663681 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2418/4819] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:52 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1508 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:53.675806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f2d8ed02-a104-4661-9c8a-bc608781938c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:53.676758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2d8ed02-a104-4661-9c8a-bc608781938c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:53.698137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2d8ed02-a104-4661-9c8a-bc608781938c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:53.699028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2d8ed02-a104-4661-9c8a-bc608781938c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:53.700174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2d8ed02-a104-4661-9c8a-bc608781938c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:53.701140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2d8ed02-a104-4661-9c8a-bc608781938c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:53.797345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:53.822217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:53.832862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:53.834542 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e3e9633d-b646-4c5d-8f01-a89dc149e99c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.301239 Aug 04 14:21:53.837920 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2402/4820] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:53 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:53.843397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3fed46b4-69aa-4bc1-acac-6064ff529127 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:53.844272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3fed46b4-69aa-4bc1-acac-6064ff529127 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:53.851982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fed46b4-69aa-4bc1-acac-6064ff529127 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:53.852748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fed46b4-69aa-4bc1-acac-6064ff529127 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:53.853782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fed46b4-69aa-4bc1-acac-6064ff529127 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:53.855062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3fed46b4-69aa-4bc1-acac-6064ff529127 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:54.004683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-f2d8ed02-a104-4661-9c8a-bc608781938c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lazy-loading 'services' on Instance uuid d99315bc-8884-4e97-87ec-9f88968eb678 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:21:54.311548 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f2d8ed02-a104-4661-9c8a-bc608781938c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments/669613e0-8309-46ed-952f-7c5ec82053af" status: 202 len: 0 microversion: 2.1 time: 0.645808 Aug 04 14:21:54.317470 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2419/4821] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:21:53 2022] DELETE /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments/669613e0-8309-46ed-952f-7c5ec82053af => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:21:54.347213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:54.384097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:54.400759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3fed46b4-69aa-4bc1-acac-6064ff529127 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:54.433032 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3fed46b4-69aa-4bc1-acac-6064ff529127 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1513 microversion: 2.1 time: 0.592546 Aug 04 14:21:54.434543 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2403/4822] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:53 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1513 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:54.444688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:54.447410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:54.448623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:54.449510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:54.455987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4245c13c-1c12-4965-81f9-6ce1db793116 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:54.468499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4245c13c-1c12-4965-81f9-6ce1db793116 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:54.503556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4245c13c-1c12-4965-81f9-6ce1db793116 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:54.504235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4245c13c-1c12-4965-81f9-6ce1db793116 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:54.517895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4245c13c-1c12-4965-81f9-6ce1db793116 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:54.519181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4245c13c-1c12-4965-81f9-6ce1db793116 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:54.582000 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4245c13c-1c12-4965-81f9-6ce1db793116 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145609 Aug 04 14:21:54.584151 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2404/4823] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:21:54 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:54.702537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7794cbd7-bd19-4c36-9da3-8e739845cbda tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:54.703609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7794cbd7-bd19-4c36-9da3-8e739845cbda tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:54.711672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7794cbd7-bd19-4c36-9da3-8e739845cbda tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:54.712511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7794cbd7-bd19-4c36-9da3-8e739845cbda tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:54.713709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7794cbd7-bd19-4c36-9da3-8e739845cbda tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:54.714502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7794cbd7-bd19-4c36-9da3-8e739845cbda tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:55.573629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:55.608560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:55.611913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:55.614623 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8a48daa5-670d-40d7-a3cb-c2bdbc518c7d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 1.299132 Aug 04 14:21:55.629394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2420/4824] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:54 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:55.656641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7794cbd7-bd19-4c36-9da3-8e739845cbda tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:55.662236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:55.663744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:55.679455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:55.680311 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7794cbd7-bd19-4c36-9da3-8e739845cbda tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1508 microversion: 2.1 time: 0.983696 Aug 04 14:21:55.680948 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2405/4825] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:54 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1508 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:21:55.697360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:55.697586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b1c55663-683e-43da-911d-01d4de536375 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:55.699764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:55.704936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:55.714048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b1c55663-683e-43da-911d-01d4de536375 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:55.714048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:55.723443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1c55663-683e-43da-911d-01d4de536375 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:55.723887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1c55663-683e-43da-911d-01d4de536375 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:55.725006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1c55663-683e-43da-911d-01d4de536375 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:55.726005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1c55663-683e-43da-911d-01d4de536375 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:55.968325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:56.003312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:56.012553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:56.018518 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3307b251-dba9-45ab-88ba-062b57ba0ba3 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.382443 Aug 04 14:21:56.019641 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2421/4826] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:55 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:56.064082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d939eaa-5e75-4b07-9162-8fab0a79d263 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:56.065283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6d939eaa-5e75-4b07-9162-8fab0a79d263 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:56.077029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d939eaa-5e75-4b07-9162-8fab0a79d263 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.077692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d939eaa-5e75-4b07-9162-8fab0a79d263 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:56.079068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d939eaa-5e75-4b07-9162-8fab0a79d263 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.079921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d939eaa-5e75-4b07-9162-8fab0a79d263 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:56.139128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:56.293481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b1c55663-683e-43da-911d-01d4de536375 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:56.342092 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b1c55663-683e-43da-911d-01d4de536375 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.651521 Aug 04 14:21:56.345736 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2406/4827] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:55 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:56.360925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02222ce3-3633-4c2d-98e6-0fcf9801bcf6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:56.368429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-02222ce3-3633-4c2d-98e6-0fcf9801bcf6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:56.388489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02222ce3-3633-4c2d-98e6-0fcf9801bcf6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.390272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02222ce3-3633-4c2d-98e6-0fcf9801bcf6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:56.392393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02222ce3-3633-4c2d-98e6-0fcf9801bcf6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.394067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02222ce3-3633-4c2d-98e6-0fcf9801bcf6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:56.453917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d939eaa-5e75-4b07-9162-8fab0a79d263 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:56.478831 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-02222ce3-3633-4c2d-98e6-0fcf9801bcf6 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129953 Aug 04 14:21:56.481297 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2407/4828] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:21:56 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:56.481516 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6d939eaa-5e75-4b07-9162-8fab0a79d263 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1496 microversion: 2.1 time: 0.445422 Aug 04 14:21:56.482827 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2422/4829] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:56 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1496 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:56.493491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-524f8441-21b0-4db5-831e-a1bd0c1adb17 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:56.495773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-524f8441-21b0-4db5-831e-a1bd0c1adb17 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:56.511151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-524f8441-21b0-4db5-831e-a1bd0c1adb17 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.512489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-524f8441-21b0-4db5-831e-a1bd0c1adb17 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:56.514581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-524f8441-21b0-4db5-831e-a1bd0c1adb17 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.515934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-524f8441-21b0-4db5-831e-a1bd0c1adb17 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:56.518226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:56.519140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:56.552145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.553270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:56.555810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.556550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:56.664536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lazy-loading 'flavor' on Instance uuid 9c416741-016d-4f02-9a57-507f0454876d {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:21:56.724307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Cannot 'suspend' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state suspended Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action HTTP/1.1 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 15 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: {"suspend": {}} Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: exception: Cannot 'suspend' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state suspended Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d', 'body': {'suspend': {}}} Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9c416741-016d-4f02-9a57-507f0454876d in vm_state suspended. Cannot suspend while the instance is in this state. Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 04 14:21:56.730279 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state suspended Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state suspended Aug 04 14:21:56.736979 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:21:56.741480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 409 to user: Cannot 'suspend' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state suspended {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:21:56.743478 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a16d8d0-dbc5-484d-a9f3-0a34f9a15861 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 409 len: 148 microversion: 2.1 time: 0.232264 Aug 04 14:21:56.746173 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2423/4830] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:21:56 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 148 bytes in 236 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 14:21:56.789641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:56.800295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:56.841998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:56.852307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.860460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:56.871104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:56.874630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:57.056085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-524f8441-21b0-4db5-831e-a1bd0c1adb17 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:57.072581 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-524f8441-21b0-4db5-831e-a1bd0c1adb17 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.585913 Aug 04 14:21:57.074572 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2408/4831] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:56 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:57.083480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebacbf8d-8feb-4ebd-b1b7-68f35732d7e8 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:57.087407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ebacbf8d-8feb-4ebd-b1b7-68f35732d7e8 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:57.107654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebacbf8d-8feb-4ebd-b1b7-68f35732d7e8 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:57.108721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebacbf8d-8feb-4ebd-b1b7-68f35732d7e8 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:57.110103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebacbf8d-8feb-4ebd-b1b7-68f35732d7e8 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:57.112030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebacbf8d-8feb-4ebd-b1b7-68f35732d7e8 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:57.743268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:57.774225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:57.780333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:57.790981 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4fadfda-1433-43a5-a17f-d8df3a612537 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 1.042430 Aug 04 14:21:57.813241 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2424/4832] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:56 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:57.839241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fd99a1aa-1c47-49ce-a193-1ca1324a90e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:21:57.840612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fd99a1aa-1c47-49ce-a193-1ca1324a90e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:57.851709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd99a1aa-1c47-49ce-a193-1ca1324a90e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:57.852857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd99a1aa-1c47-49ce-a193-1ca1324a90e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:57.855163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd99a1aa-1c47-49ce-a193-1ca1324a90e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:57.856213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fd99a1aa-1c47-49ce-a193-1ca1324a90e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:57.893357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ebacbf8d-8feb-4ebd-b1b7-68f35732d7e8 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:57.964316 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ebacbf8d-8feb-4ebd-b1b7-68f35732d7e8 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1506 microversion: 2.1 time: 0.885129 Aug 04 14:21:57.966816 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2409/4833] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:57 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1506 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:21:57.989396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:57.993143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:58.004253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.005127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:58.006592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.007415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:58.073395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:21:58.154418 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fd99a1aa-1c47-49ce-a193-1ca1324a90e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 202 len: 0 microversion: 2.1 time: 0.338245 Aug 04 14:21:58.157432 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2425/4834] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:21:57 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:21:58.181652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-03f904cb-7a12-465d-8ed0-7c7fcbcd04ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:58.188120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03f904cb-7a12-465d-8ed0-7c7fcbcd04ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:58.234858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-7a12-465d-8ed0-7c7fcbcd04ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.235902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-7a12-465d-8ed0-7c7fcbcd04ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:58.237388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-7a12-465d-8ed0-7c7fcbcd04ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.243436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-7a12-465d-8ed0-7c7fcbcd04ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:58.530952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:58.578852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:58.582524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:21:58.596684 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6fd91f55-5bc0-4e14-b19e-e7a529b44aeb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.628012 Aug 04 14:21:58.602732 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2410/4835] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:21:57 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:21:58.622015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-20eab8f1-86ba-45b1-8274-56c8b999d981 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:58.626813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-20eab8f1-86ba-45b1-8274-56c8b999d981 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:58.640267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20eab8f1-86ba-45b1-8274-56c8b999d981 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.641469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20eab8f1-86ba-45b1-8274-56c8b999d981 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:58.643179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20eab8f1-86ba-45b1-8274-56c8b999d981 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.644542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20eab8f1-86ba-45b1-8274-56c8b999d981 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:58.710985 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-20eab8f1-86ba-45b1-8274-56c8b999d981 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105081 Aug 04 14:21:58.724461 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2411/4836] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:21:58 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:58.733271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e838c51e-011b-467b-8305-d34f491fcc29 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '.version_select at 0x7f470569d8b0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:58.734221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e838c51e-011b-467b-8305-d34f491fcc29 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:58.743988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e838c51e-011b-467b-8305-d34f491fcc29 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.745573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e838c51e-011b-467b-8305-d34f491fcc29 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:58.746701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e838c51e-011b-467b-8305-d34f491fcc29 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.747786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e838c51e-011b-467b-8305-d34f491fcc29 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:58.802038 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e838c51e-011b-467b-8305-d34f491fcc29 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.073799 Aug 04 14:21:58.804386 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2412/4837] 10.222.0.66 () {58 vars in 1296 bytes} [Thu Aug 4 14:21:58 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f/os-instance-actions => generated 611 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:21:58.822174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37d33315-1817-4c4a-a8ce-6faeeb364120 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:21:58.823685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-37d33315-1817-4c4a-a8ce-6faeeb364120 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:21:58.834852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37d33315-1817-4c4a-a8ce-6faeeb364120 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.835816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37d33315-1817-4c4a-a8ce-6faeeb364120 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:21:58.837191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37d33315-1817-4c4a-a8ce-6faeeb364120 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:21:58.837999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37d33315-1817-4c4a-a8ce-6faeeb364120 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:00.447640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-03f904cb-7a12-465d-8ed0-7c7fcbcd04ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:00.461564 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-03f904cb-7a12-465d-8ed0-7c7fcbcd04ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 2.301754 Aug 04 14:22:00.469815 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2426/4838] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:58 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:00.479823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc4c78cb-7ffb-4a8d-a7d4-617fee0b9942 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:00.480662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bc4c78cb-7ffb-4a8d-a7d4-617fee0b9942 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:00.504454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc4c78cb-7ffb-4a8d-a7d4-617fee0b9942 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:00.504932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc4c78cb-7ffb-4a8d-a7d4-617fee0b9942 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:00.505982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc4c78cb-7ffb-4a8d-a7d4-617fee0b9942 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:00.506610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc4c78cb-7ffb-4a8d-a7d4-617fee0b9942 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:00.600253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bc4c78cb-7ffb-4a8d-a7d4-617fee0b9942 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:22:00.847937 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bc4c78cb-7ffb-4a8d-a7d4-617fee0b9942 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 204 len: 0 microversion: 2.1 time: 0.376250 Aug 04 14:22:00.849352 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2427/4839] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:22:00 2022] DELETE /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:22:00.863276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:00.868973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:00.889854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:00.891964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:00.895331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:00.896745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:00.949442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-37d33315-1817-4c4a-a8ce-6faeeb364120 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:00.989232 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37d33315-1817-4c4a-a8ce-6faeeb364120 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1502 microversion: 2.1 time: 2.182770 Aug 04 14:22:01.035952 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2413/4840] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:21:58 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1502 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:01.058769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:01.059950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:01.086431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:01.087325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:01.089372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:01.090257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:01.429001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:01.440321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:01.442016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:01.443294 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-583a6d20-95f8-404a-96ec-403ab5592e8e tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.405700 Aug 04 14:22:01.443873 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2414/4841] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:01 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:01.465493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-928f8fa8-d51e-4e3b-a3b6-d777d753dd7e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:01.468126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-928f8fa8-d51e-4e3b-a3b6-d777d753dd7e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:01.475502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-928f8fa8-d51e-4e3b-a3b6-d777d753dd7e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:01.476220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-928f8fa8-d51e-4e3b-a3b6-d777d753dd7e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:01.477540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-928f8fa8-d51e-4e3b-a3b6-d777d753dd7e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:01.478215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-928f8fa8-d51e-4e3b-a3b6-d777d753dd7e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:01.554344 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-928f8fa8-d51e-4e3b-a3b6-d777d753dd7e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095977 Aug 04 14:22:01.558303 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2415/4842] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:22:01 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:01.570969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eddd5b59-63b5-44ea-a92d-625ac8debedf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:01.571865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eddd5b59-63b5-44ea-a92d-625ac8debedf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:01.586713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eddd5b59-63b5-44ea-a92d-625ac8debedf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:01.591508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eddd5b59-63b5-44ea-a92d-625ac8debedf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:01.596365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eddd5b59-63b5-44ea-a92d-625ac8debedf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:01.597206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eddd5b59-63b5-44ea-a92d-625ac8debedf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:01.800379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:01.824114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:01.831411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:01.835784 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab0b3c97-919e-404c-a91a-840d6aa9e880 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 0.983838 Aug 04 14:22:01.837500 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2428/4843] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:00 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:01.852185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aaa6e7b7-3b23-46d4-8b92-85607a3ede4d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:01.854832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aaa6e7b7-3b23-46d4-8b92-85607a3ede4d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:01.890032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aaa6e7b7-3b23-46d4-8b92-85607a3ede4d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:01.890616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aaa6e7b7-3b23-46d4-8b92-85607a3ede4d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:01.893962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aaa6e7b7-3b23-46d4-8b92-85607a3ede4d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:01.896743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aaa6e7b7-3b23-46d4-8b92-85607a3ede4d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:03.728403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eddd5b59-63b5-44ea-a92d-625ac8debedf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:03.757842 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eddd5b59-63b5-44ea-a92d-625ac8debedf tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 2.198191 Aug 04 14:22:03.763332 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2416/4844] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:01 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:03.813848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-afeef83d-dffb-478f-bc8e-3b64eb42f372 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:03.816657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-afeef83d-dffb-478f-bc8e-3b64eb42f372 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:03.845618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afeef83d-dffb-478f-bc8e-3b64eb42f372 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:03.847156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afeef83d-dffb-478f-bc8e-3b64eb42f372 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:03.849264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afeef83d-dffb-478f-bc8e-3b64eb42f372 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:03.854508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afeef83d-dffb-478f-bc8e-3b64eb42f372 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:04.214489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aaa6e7b7-3b23-46d4-8b92-85607a3ede4d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:04.238812 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aaa6e7b7-3b23-46d4-8b92-85607a3ede4d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1512 microversion: 2.1 time: 2.389155 Aug 04 14:22:04.246465 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2429/4845] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:01 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1512 bytes in 2407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:04.264443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:04.267683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:04.290801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:04.292235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:04.295690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:04.301424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:04.532828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:04.550495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:04.556558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:04.560487 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-07923a18-5b38-4f3b-b5f1-fecca096c897 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.310544 Aug 04 14:22:04.562363 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2430/4846] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:04 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:04.579049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3b6c0e6f-0965-4b2d-b66c-34b1afccf5f5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:04.592631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3b6c0e6f-0965-4b2d-b66c-34b1afccf5f5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:04.613303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b6c0e6f-0965-4b2d-b66c-34b1afccf5f5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:04.615449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b6c0e6f-0965-4b2d-b66c-34b1afccf5f5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:04.619532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b6c0e6f-0965-4b2d-b66c-34b1afccf5f5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:04.621710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b6c0e6f-0965-4b2d-b66c-34b1afccf5f5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:04.715088 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3b6c0e6f-0965-4b2d-b66c-34b1afccf5f5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147642 Aug 04 14:22:04.718182 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2431/4847] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:22:04 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:04.736414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:04.740302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:04.766147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:04.768204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:04.771113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:04.773231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:04.875429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-afeef83d-dffb-478f-bc8e-3b64eb42f372 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:04.891577 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-afeef83d-dffb-478f-bc8e-3b64eb42f372 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1502 microversion: 2.1 time: 1.125848 Aug 04 14:22:04.913734 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2417/4848] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:03 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1502 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:04.924390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2128282412", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4d77cf6c-b556-48ab-92a8-04444fe680a2"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:05.067672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] validate_networks() for [('4d77cf6c-b556-48ab-92a8-04444fe680a2', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:22:05.722921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:05.748581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:05.750457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:05.751863 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f376b6b0-61e3-4afe-a562-94671a0e52ed tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 1.030995 Aug 04 14:22:05.753038 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2432/4849] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:04 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:05.758193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc27daf1-1dbf-42c6-891d-e0683fac149d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:05.759176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc27daf1-1dbf-42c6-891d-e0683fac149d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:05.766792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc27daf1-1dbf-42c6-891d-e0683fac149d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:05.767615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc27daf1-1dbf-42c6-891d-e0683fac149d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:05.768637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc27daf1-1dbf-42c6-891d-e0683fac149d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:05.769351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc27daf1-1dbf-42c6-891d-e0683fac149d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:07.024988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc27daf1-1dbf-42c6-891d-e0683fac149d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d555452494231945a643dd3da8116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b108c35b8f88424abc6434fe90131ae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:07.067893 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc27daf1-1dbf-42c6-891d-e0683fac149d tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 200 len: 1512 microversion: 2.1 time: 1.313299 Aug 04 14:22:07.076185 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2433/4850] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:05 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 1512 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:07.114374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:07.114917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:07.136637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:07.137437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:07.138447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:07.139134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:07.563557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:07.606853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:07.610612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:07.616396 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4ec1d2d1-9aef-41a2-9a12-e9a19aab47ca tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.536074 Aug 04 14:22:07.619686 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2434/4851] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:07 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:07.642771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f6ede755-08ea-425c-a60b-e1074962001c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:07.659633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f6ede755-08ea-425c-a60b-e1074962001c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:07.687876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6ede755-08ea-425c-a60b-e1074962001c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:07.690968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6ede755-08ea-425c-a60b-e1074962001c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:07.696433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6ede755-08ea-425c-a60b-e1074962001c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:07.697559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6ede755-08ea-425c-a60b-e1074962001c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:07.782238 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f6ede755-08ea-425c-a60b-e1074962001c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157666 Aug 04 14:22:07.805323 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2435/4852] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:22:07 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:22:07.819258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3ec2e26f-2755-4d2b-a89d-e6b95a185c12 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:07.825305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3ec2e26f-2755-4d2b-a89d-e6b95a185c12 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:07.864323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ec2e26f-2755-4d2b-a89d-e6b95a185c12 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:07.872181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ec2e26f-2755-4d2b-a89d-e6b95a185c12 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:07.873926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ec2e26f-2755-4d2b-a89d-e6b95a185c12 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:07.880329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ec2e26f-2755-4d2b-a89d-e6b95a185c12 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:07.994073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:08.035393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:22:08.037446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:22:08.038509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:22:08.040434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:22:08.041034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:22:08.076606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:08.077493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:08.082650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:08.083985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:08.132642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:22:08.146542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for user fab9d445099545e98979afa009678007 and project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:22:08.201915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:22:08.213941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:22:08.385253 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e1e5f29-6da0-4622-8577-0f1d8c115dda tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.466137 Aug 04 14:22:08.387846 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2418/4853] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:22:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:22:08.412752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:08.413900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:08.451293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:08.456037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:08.458899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:08.460459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:08.577544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3ec2e26f-2755-4d2b-a89d-e6b95a185c12 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:08.619017 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3ec2e26f-2755-4d2b-a89d-e6b95a185c12 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.810626 Aug 04 14:22:08.620654 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2436/4854] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:07 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:08.639446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2da8e38b-5b23-41a8-a56f-b950f2a7eb4a req-9ec7b2bb-d44b-462a-b1a9-a52b12050e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbdb8e1d-5392-4c38-86e8-46816d53392f", "name": "network-vif-deleted", "tag": "834926ef-c033-432e-9245-bcc97ea3f607"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:08.725103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2da8e38b-5b23-41a8-a56f-b950f2a7eb4a req-9ec7b2bb-d44b-462a-b1a9-a52b12050e73 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:08.731854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2da8e38b-5b23-41a8-a56f-b950f2a7eb4a req-9ec7b2bb-d44b-462a-b1a9-a52b12050e73 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:08.785825 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2da8e38b-5b23-41a8-a56f-b950f2a7eb4a req-9ec7b2bb-d44b-462a-b1a9-a52b12050e73 service nova] Creating event network-vif-deleted:834926ef-c033-432e-9245-bcc97ea3f607 for instance bbdb8e1d-5392-4c38-86e8-46816d53392f on n-h2-844627-10 Aug 04 14:22:08.800855 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2da8e38b-5b23-41a8-a56f-b950f2a7eb4a req-9ec7b2bb-d44b-462a-b1a9-a52b12050e73 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174091 Aug 04 14:22:08.809822 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2437/4855] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:08.816344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a2f41bdb-7384-46c7-be5a-b94c94e625b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:08.823372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a2f41bdb-7384-46c7-be5a-b94c94e625b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:08.842489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2f41bdb-7384-46c7-be5a-b94c94e625b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:08.843307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2f41bdb-7384-46c7-be5a-b94c94e625b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:08.844336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2f41bdb-7384-46c7-be5a-b94c94e625b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:08.845163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2f41bdb-7384-46c7-be5a-b94c94e625b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:08.942846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a2f41bdb-7384-46c7-be5a-b94c94e625b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:22:09.129253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:09.223474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:09.238292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:09.251042 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-435712c7-f089-4a44-a55b-a7e16a1d51d8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 0.853467 Aug 04 14:22:09.253638 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2419/4856] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:08 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:09.290240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:09.292693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] [instance: bbdb8e1d-5392-4c38-86e8-46816d53392f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:09.318295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:09.321801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:09.324056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:09.332327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:09.340370 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a2f41bdb-7384-46c7-be5a-b94c94e625b8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 204 len: 0 microversion: 2.1 time: 0.526244 Aug 04 14:22:09.348257 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2438/4857] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:22:08 2022] DELETE /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:22:09.368989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f0c03540-e714-477e-a096-ad4f713a06c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:09.371312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0c03540-e714-477e-a096-ad4f713a06c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:09.412111 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] HTTP exception thrown: Instance bbdb8e1d-5392-4c38-86e8-46816d53392f could not be found. Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Request method failure captured: Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f HTTP/1.1 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69XW4jw0a7eSKk6m9o2wsFCQG848prJmEDKIfM-WRIwcvTFKtqY4nBV-Nvahv6-iqAQlJVE2EmxL4-MMWXf5TngMqB63TYiSTfZ-TW7EdJXdUTWIssCvq5MY3wuqu6QU95PZm9uFhhJjgApEGjqipQsyRkNvxcu-KrDkGmGUZQGI4Eg Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b108c35b8f88424abc6434fe90131ae9 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-InstanceActionsTestJSON-2044155399 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b108c35b8f88424abc6434fe90131ae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b108c35b8f88424abc6434fe90131ae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b108c35b8f88424abc6434fe90131ae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b108c35b8f88424abc6434fe90131ae9"}]}] Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-InstanceActionsTestJSON-2044155399 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b108c35b8f88424abc6434fe90131ae9 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2044155399 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-InstanceActionsTestJSON-2044155399-project Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 799d555452494231945a643dd3da8116 Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-InstanceActionsTestJSON-2044155399-project Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance bbdb8e1d-5392-4c38-86e8-46816d53392f could not be found. Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'bbdb8e1d-5392-4c38-86e8-46816d53392f'} Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbdb8e1d-5392-4c38-86e8-46816d53392f could not be found. Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbdb8e1d-5392-4c38-86e8-46816d53392f could not be found. Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:09.422341 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:09.431746 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:09.431746 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:09.431746 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:09.431746 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:09.431746 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:09.431746 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbdb8e1d-5392-4c38-86e8-46816d53392f could not be found. Aug 04 14:22:09.431746 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:09.435363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] Returning 404 to user: Instance bbdb8e1d-5392-4c38-86e8-46816d53392f could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:09.437588 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-de6d70b4-e45e-46cc-85cd-d9fd89c6e028 tempest-InstanceActionsTestJSON-2044155399 tempest-InstanceActionsTestJSON-2044155399-project] 10.222.0.66 "GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f" status: 404 len: 111 microversion: 2.1 time: 0.180861 Aug 04 14:22:09.439114 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2420/4858] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:09 2022] GET /compute/v2.1/servers/bbdb8e1d-5392-4c38-86e8-46816d53392f => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:22:09.464612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:09.468653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:09.499632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:09.500395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:09.502061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:09.502988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:09.812568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f0c03540-e714-477e-a096-ad4f713a06c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:09.859115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:09.868788 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f0c03540-e714-477e-a096-ad4f713a06c7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1215 microversion: 2.1 time: 0.520300 Aug 04 14:22:09.870803 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2439/4859] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:09 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1215 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:09.910618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:09.920815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff0a5102-f278-481a-9052-886e039463e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:09.926346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff0a5102-f278-481a-9052-886e039463e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:09.928027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:09.936014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9e6cafcc-1fbb-4dd4-b623-c5a2264517e1 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.494594 Aug 04 14:22:09.955222 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2421/4860] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:09 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:09.960159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76c71e52-a3e2-44c8-a969-8d989edc2223 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:09.961234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76c71e52-a3e2-44c8-a969-8d989edc2223 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:09.971155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff0a5102-f278-481a-9052-886e039463e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:09.972139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff0a5102-f278-481a-9052-886e039463e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:09.973296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff0a5102-f278-481a-9052-886e039463e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:09.974053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff0a5102-f278-481a-9052-886e039463e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:09.977749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76c71e52-a3e2-44c8-a969-8d989edc2223 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:09.979141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76c71e52-a3e2-44c8-a969-8d989edc2223 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:09.981007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76c71e52-a3e2-44c8-a969-8d989edc2223 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:09.982110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76c71e52-a3e2-44c8-a969-8d989edc2223 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:10.573885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff0a5102-f278-481a-9052-886e039463e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:10.586601 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff0a5102-f278-481a-9052-886e039463e7 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.673608 Aug 04 14:22:10.588334 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2440/4861] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:09 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:10.595772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:10.597823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:10.608221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:10.609363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:10.610542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:10.611248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:10.979412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76c71e52-a3e2-44c8-a969-8d989edc2223 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:11.011050 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76c71e52-a3e2-44c8-a969-8d989edc2223 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1679 microversion: 2.1 time: 1.056536 Aug 04 14:22:11.030040 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2422/4862] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:09 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1679 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:11.042912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cd8cedcb-f030-4613-86ae-27b70f2e8f37 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:11.044718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cd8cedcb-f030-4613-86ae-27b70f2e8f37 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 4b954a46-ebbb-477c-b83e-5fbf2aa71618] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:11.051681 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-cd8cedcb-f030-4613-86ae-27b70f2e8f37 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 4b954a46-ebbb-477c-b83e-5fbf2aa71618 could not be found. Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cd8cedcb-f030-4613-86ae-27b70f2e8f37 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/4b954a46-ebbb-477c-b83e-5fbf2aa71618/action HTTP/1.1 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 15 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: {"unpause": {}} Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4b954a46-ebbb-477c-b83e-5fbf2aa71618 could not be found. Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4b954a46-ebbb-477c-b83e-5fbf2aa71618', 'body': {'unpause': {}}} Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b954a46-ebbb-477c-b83e-5fbf2aa71618 could not be found. Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b954a46-ebbb-477c-b83e-5fbf2aa71618 could not be found. Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:11.054653 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:11.058978 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:11.058978 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:11.058978 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b954a46-ebbb-477c-b83e-5fbf2aa71618 could not be found. Aug 04 14:22:11.058978 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:11.061469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cd8cedcb-f030-4613-86ae-27b70f2e8f37 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 4b954a46-ebbb-477c-b83e-5fbf2aa71618 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:11.062719 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cd8cedcb-f030-4613-86ae-27b70f2e8f37 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/4b954a46-ebbb-477c-b83e-5fbf2aa71618/action" status: 404 len: 111 microversion: 2.1 time: 0.030277 Aug 04 14:22:11.064708 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2423/4863] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:22:11 2022] POST /compute/v2.1/servers/4b954a46-ebbb-477c-b83e-5fbf2aa71618/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:22:11.071778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-30be13d5-696b-4567-ac4c-808ce0d2d5d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:11.075364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-30be13d5-696b-4567-ac4c-808ce0d2d5d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:11.096101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30be13d5-696b-4567-ac4c-808ce0d2d5d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:11.097038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30be13d5-696b-4567-ac4c-808ce0d2d5d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:11.098255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30be13d5-696b-4567-ac4c-808ce0d2d5d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:11.099126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30be13d5-696b-4567-ac4c-808ce0d2d5d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:11.345271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-30be13d5-696b-4567-ac4c-808ce0d2d5d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:11.366533 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-30be13d5-696b-4567-ac4c-808ce0d2d5d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1267 microversion: 2.1 time: 0.298442 Aug 04 14:22:11.368103 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2424/4864] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:11 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:11.377826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:11.379399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:11.394570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:11.395381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:11.396771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:11.397781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:11.661307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:11.675205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:11.678160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:11.680246 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2a8322d8-9526-496e-b8ae-c1fe48ed3da2 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 1.090136 Aug 04 14:22:11.696911 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2441/4865] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:10 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:11.715231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e30fa3d5-8e0d-4671-9393-90d8eac8e78a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:11.718505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e30fa3d5-8e0d-4671-9393-90d8eac8e78a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:11.718813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:11.736148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:11.739279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:11.745095 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-239ffe2c-0d49-4f0b-8652-a98f6c88d433 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.372557 Aug 04 14:22:11.746183 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2425/4866] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:11 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:11.761333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e30fa3d5-8e0d-4671-9393-90d8eac8e78a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:11.761333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e30fa3d5-8e0d-4671-9393-90d8eac8e78a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:11.761333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e30fa3d5-8e0d-4671-9393-90d8eac8e78a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:11.761333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e30fa3d5-8e0d-4671-9393-90d8eac8e78a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:12.044279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-82d0c405-2a93-402a-829a-2eea3bed932d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:12.047190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-82d0c405-2a93-402a-829a-2eea3bed932d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:12.063117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82d0c405-2a93-402a-829a-2eea3bed932d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:12.065611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82d0c405-2a93-402a-829a-2eea3bed932d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:12.067783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82d0c405-2a93-402a-829a-2eea3bed932d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:12.068773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82d0c405-2a93-402a-829a-2eea3bed932d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:12.130159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e30fa3d5-8e0d-4671-9393-90d8eac8e78a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:12.167922 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e30fa3d5-8e0d-4671-9393-90d8eac8e78a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.468307 Aug 04 14:22:12.201949 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2442/4867] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:11 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:12.218684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18e1f20f-78c0-4746-9149-00d509f2e198 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:12.219750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-18e1f20f-78c0-4746-9149-00d509f2e198 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:12.233607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18e1f20f-78c0-4746-9149-00d509f2e198 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:12.234433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18e1f20f-78c0-4746-9149-00d509f2e198 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:12.238173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18e1f20f-78c0-4746-9149-00d509f2e198 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:12.239255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18e1f20f-78c0-4746-9149-00d509f2e198 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.053736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-82d0c405-2a93-402a-829a-2eea3bed932d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:13.064461 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-82d0c405-2a93-402a-829a-2eea3bed932d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1679 microversion: 2.1 time: 1.029325 Aug 04 14:22:13.078915 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2426/4868] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:12 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1679 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:13.084424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-884a4ee5-fd3d-4562-8182-28ffd12bab19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:13.085352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-884a4ee5-fd3d-4562-8182-28ffd12bab19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:13.092992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-884a4ee5-fd3d-4562-8182-28ffd12bab19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.093751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-884a4ee5-fd3d-4562-8182-28ffd12bab19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.094750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-884a4ee5-fd3d-4562-8182-28ffd12bab19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.095361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-884a4ee5-fd3d-4562-8182-28ffd12bab19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.124339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-18e1f20f-78c0-4746-9149-00d509f2e198 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:13.152141 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18e1f20f-78c0-4746-9149-00d509f2e198 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.941667 Aug 04 14:22:13.155343 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2443/4869] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:12 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:13.169329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:13.174546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:13.196986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.198943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.201491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.202915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.236191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-884a4ee5-fd3d-4562-8182-28ffd12bab19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:13.246436 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-884a4ee5-fd3d-4562-8182-28ffd12bab19 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1273 microversion: 2.1 time: 0.165518 Aug 04 14:22:13.261982 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2427/4870] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:13 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:13.267387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:13.268329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:13.276213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.277257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.278432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.279102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.482466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:13.513803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:13.518249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:13.520813 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a6076f54-e776-4e52-b3c4-c2add010aad7 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1407 microversion: 2.54 time: 0.256668 Aug 04 14:22:13.544197 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2428/4871] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:13 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:13.568832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:13.570707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:13.587012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.587892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.589518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.590356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.616916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:13.632798 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Cannot 'unpause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action HTTP/1.1 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 15 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: {"unpause": {}} Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: exception: Cannot 'unpause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d', 'body': {'unpause': {}}} Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9c416741-016d-4f02-9a57-507f0454876d in vm_state active. Cannot unpause while the instance is in this state. Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:13.634376 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:13.648159 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:13.648159 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:13.648159 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:13.648159 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:22:13.648159 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:13.648159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 409 to user: Cannot 'unpause' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:13.648159 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e8b09bc6-f45d-4009-acc6-b1d7766f6f30 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 409 len: 145 microversion: 2.1 time: 0.090257 Aug 04 14:22:13.650572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:13.650827 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2429/4872] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:22:13 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 145 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:22:13.650827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61639f4c-e678-40f4-9e1e-ae91df59967b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:13.653297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:13.653592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61639f4c-e678-40f4-9e1e-ae91df59967b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:13.653805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:13.653805 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cd1fadee-928b-4634-8625-65ef1d9b9a42 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 0.494148 Aug 04 14:22:13.658749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61639f4c-e678-40f4-9e1e-ae91df59967b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.659215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61639f4c-e678-40f4-9e1e-ae91df59967b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:13.660468 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2444/4873] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:13 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:13.661768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61639f4c-e678-40f4-9e1e-ae91df59967b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:13.662481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61639f4c-e678-40f4-9e1e-ae91df59967b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:14.087574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1ceebcef-0946-45fb-9b3a-f91b3c14b02e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:14.088341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1ceebcef-0946-45fb-9b3a-f91b3c14b02e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:14.108045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ceebcef-0946-45fb-9b3a-f91b3c14b02e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:14.108515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ceebcef-0946-45fb-9b3a-f91b3c14b02e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:14.109385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ceebcef-0946-45fb-9b3a-f91b3c14b02e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:14.109840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1ceebcef-0946-45fb-9b3a-f91b3c14b02e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:14.368283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61639f4c-e678-40f4-9e1e-ae91df59967b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:14.375320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1ceebcef-0946-45fb-9b3a-f91b3c14b02e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:14.401208 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1ceebcef-0946-45fb-9b3a-f91b3c14b02e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 200 len: 1612 microversion: 2.1 time: 0.318385 Aug 04 14:22:14.402208 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2445/4874] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:14 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 1612 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:22:14.412508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1e22537-fa82-498d-b7f8-83e41541e4be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:14.416919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1e22537-fa82-498d-b7f8-83e41541e4be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:14.425505 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61639f4c-e678-40f4-9e1e-ae91df59967b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.780213 Aug 04 14:22:14.447525 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2430/4875] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:13 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:22:14.463561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e22537-fa82-498d-b7f8-83e41541e4be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:14.472680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e22537-fa82-498d-b7f8-83e41541e4be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:14.481879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e22537-fa82-498d-b7f8-83e41541e4be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:14.490265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5a07fa56-7c5d-4f9c-bd6f-05393b10bb41 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:14.490627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1e22537-fa82-498d-b7f8-83e41541e4be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:14.500502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5a07fa56-7c5d-4f9c-bd6f-05393b10bb41 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:14.549721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a07fa56-7c5d-4f9c-bd6f-05393b10bb41 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:14.550976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a07fa56-7c5d-4f9c-bd6f-05393b10bb41 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:14.552956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a07fa56-7c5d-4f9c-bd6f-05393b10bb41 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:14.556213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a07fa56-7c5d-4f9c-bd6f-05393b10bb41 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:15.366681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5a07fa56-7c5d-4f9c-bd6f-05393b10bb41 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:15.396013 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5a07fa56-7c5d-4f9c-bd6f-05393b10bb41 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.929336 Aug 04 14:22:15.397981 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2431/4876] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:14 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:15.405968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:15.407216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:15.424541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:15.425935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:15.427660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:15.428780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:15.435446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1e22537-fa82-498d-b7f8-83e41541e4be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:15.449842 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1e22537-fa82-498d-b7f8-83e41541e4be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1315 microversion: 2.1 time: 1.044678 Aug 04 14:22:15.451623 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2446/4877] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:14 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1315 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:15.463417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:15.465071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:15.477907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:15.482869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:15.485358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:15.486296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:15.701247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:15.731306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:15.742791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:15.744342 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a194263-bb7c-4917-b383-a123deee2016 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1413 microversion: 2.54 time: 0.344918 Aug 04 14:22:15.744980 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2432/4878] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:15 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1413 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:15.750489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-31f092fb-bd50-4e50-a605-3af40548b3ff req-87282b6e-d200-4935-ba9d-e935932f28d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99315bc-8884-4e97-87ec-9f88968eb678", "name": "network-vif-deleted", "tag": "e1eb5647-f5f2-44b5-bd85-3a37146feba1"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:15.786409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-31f092fb-bd50-4e50-a605-3af40548b3ff req-87282b6e-d200-4935-ba9d-e935932f28d0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:15.787235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-31f092fb-bd50-4e50-a605-3af40548b3ff req-87282b6e-d200-4935-ba9d-e935932f28d0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:15.824798 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-31f092fb-bd50-4e50-a605-3af40548b3ff req-87282b6e-d200-4935-ba9d-e935932f28d0 service nova] Creating event network-vif-deleted:e1eb5647-f5f2-44b5-bd85-3a37146feba1 for instance d99315bc-8884-4e97-87ec-9f88968eb678 on n-h2-844627-10 Aug 04 14:22:15.838745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-31f092fb-bd50-4e50-a605-3af40548b3ff req-87282b6e-d200-4935-ba9d-e935932f28d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091998 Aug 04 14:22:15.846133 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2433/4879] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:15.856133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e95a4ae-97ad-4857-b701-ca17dffcaea8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:15.860195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e95a4ae-97ad-4857-b701-ca17dffcaea8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: e7f306c9-5376-4149-92e6-0c161a02e505] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:15.878963 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1e95a4ae-97ad-4857-b701-ca17dffcaea8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance e7f306c9-5376-4149-92e6-0c161a02e505 could not be found. Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e95a4ae-97ad-4857-b701-ca17dffcaea8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/e7f306c9-5376-4149-92e6-0c161a02e505/action HTTP/1.1 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 18 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: {"unshelve": null} Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e7f306c9-5376-4149-92e6-0c161a02e505 could not be found. Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e7f306c9-5376-4149-92e6-0c161a02e505', 'body': {'unshelve': None}} Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7f306c9-5376-4149-92e6-0c161a02e505 could not be found. Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f306c9-5376-4149-92e6-0c161a02e505 could not be found. Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.881390 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f306c9-5376-4149-92e6-0c161a02e505 could not be found. Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e95a4ae-97ad-4857-b701-ca17dffcaea8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance e7f306c9-5376-4149-92e6-0c161a02e505 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:15.886862 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e95a4ae-97ad-4857-b701-ca17dffcaea8 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/e7f306c9-5376-4149-92e6-0c161a02e505/action" status: 404 len: 111 microversion: 2.1 time: 0.038235 Aug 04 14:22:15.887517 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2434/4880] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:22:15 2022] POST /compute/v2.1/servers/e7f306c9-5376-4149-92e6-0c161a02e505/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:22:15.895209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:15.895746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:15.915083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:15.921069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:15.922495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:15.922786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:15.954767 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 HTTP/1.1 Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd99315bc-8884-4e97-87ec-9f88968eb678'} Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:15.956385 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.960440 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:15.960440 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:15.960440 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:15.960440 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:15.960440 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:15.960440 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:22:15.960440 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:15.960440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:15.960440 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5250749b-a29d-438c-be1f-b239038b5d7a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 404 len: 111 microversion: 2.1 time: 0.069613 Aug 04 14:22:15.965665 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2435/4881] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:15 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:22:15.983551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5c7e4f9e-b06f-4b3a-95c2-11dd4979c9d6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:15.984511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5c7e4f9e-b06f-4b3a-95c2-11dd4979c9d6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:15.991900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c7e4f9e-b06f-4b3a-95c2-11dd4979c9d6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:15.992636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c7e4f9e-b06f-4b3a-95c2-11dd4979c9d6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:15.994451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c7e4f9e-b06f-4b3a-95c2-11dd4979c9d6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:15.995268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c7e4f9e-b06f-4b3a-95c2-11dd4979c9d6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:16.126975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:16.156573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:16.162267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:16.170373 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bfdfd8d0-c3e8-4540-bf85-b8b5380664a8 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 0.716674 Aug 04 14:22:16.171203 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2447/4882] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:15 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:16.184422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8fd20636-d291-4aea-9b9e-3c12299a12aa tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '.version_select at 0x7f46f2f4c700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:16.218521 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8fd20636-d291-4aea-9b9e-3c12299a12aa tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604762767" status: 202 len: 0 microversion: 2.1 time: 0.045233 Aug 04 14:22:16.221045 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2448/4883] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 14:22:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604762767 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:22:16.465507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5c7e4f9e-b06f-4b3a-95c2-11dd4979c9d6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:16.476466 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5c7e4f9e-b06f-4b3a-95c2-11dd4979c9d6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.509570 Aug 04 14:22:16.480431 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2436/4884] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:15 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:16.493480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1fb4437a-a8c7-4955-9b4a-9e99befffdb0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:16.494909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1fb4437a-a8c7-4955-9b4a-9e99befffdb0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:16.504432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fb4437a-a8c7-4955-9b4a-9e99befffdb0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:16.505255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fb4437a-a8c7-4955-9b4a-9e99befffdb0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:16.506318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fb4437a-a8c7-4955-9b4a-9e99befffdb0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:16.506954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fb4437a-a8c7-4955-9b4a-9e99befffdb0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:16.517806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-58d1d6cf-d365-4c76-8bc4-1a6064684dd5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:16.518727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-58d1d6cf-d365-4c76-8bc4-1a6064684dd5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:16.534062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58d1d6cf-d365-4c76-8bc4-1a6064684dd5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:16.535526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58d1d6cf-d365-4c76-8bc4-1a6064684dd5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:16.536598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58d1d6cf-d365-4c76-8bc4-1a6064684dd5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:16.542741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58d1d6cf-d365-4c76-8bc4-1a6064684dd5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:17.295782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1fb4437a-a8c7-4955-9b4a-9e99befffdb0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:17.321892 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1fb4437a-a8c7-4955-9b4a-9e99befffdb0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1315 microversion: 2.1 time: 0.834697 Aug 04 14:22:17.333076 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2449/4885] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:16 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:22:17.342571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:17.355625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:17.383709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:17.385436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:17.387372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:17.388546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:17.541359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-58d1d6cf-d365-4c76-8bc4-1a6064684dd5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:17.575906 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-58d1d6cf-d365-4c76-8bc4-1a6064684dd5 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 1.061596 Aug 04 14:22:17.577365 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2437/4886] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:16 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:22:17.611997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:17.614782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:17.627976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:17.629446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:17.631320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:17.632476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:17.694456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:17.719950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:17.730597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:17.733609 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5258f83e-78bf-4787-b189-1f2405524553 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1413 microversion: 2.54 time: 0.398162 Aug 04 14:22:17.761035 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2450/4887] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:17 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1413 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:17.786957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:17.789717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:17.805181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:17.809094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:17.810265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:17.812737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:17.867934 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Cannot 'unshelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action HTTP/1.1 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 18 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: {"unshelve": null} Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: exception: Cannot 'unshelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d', 'body': {'unshelve': None}} Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9c416741-016d-4f02-9a57-507f0454876d in vm_state active. Cannot unshelve while the instance is in this state. Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 14:22:17.870183 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active Aug 04 14:22:17.874233 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:17.876713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 409 to user: Cannot 'unshelve' instance 9c416741-016d-4f02-9a57-507f0454876d while it is in vm_state active {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:17.878023 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a9446c35-b00c-49c4-b9a0-023007bf535a tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action" status: 409 len: 146 microversion: 2.1 time: 0.115130 Aug 04 14:22:17.884087 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2451/4888] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:22:17 2022] POST /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d/action => generated 146 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:22:17.893517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d10110b5-ea99-4cc7-8e6f-208a64cee5ee tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:17.898220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d10110b5-ea99-4cc7-8e6f-208a64cee5ee tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:17.906640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d10110b5-ea99-4cc7-8e6f-208a64cee5ee tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:17.908602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d10110b5-ea99-4cc7-8e6f-208a64cee5ee tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:17.910227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d10110b5-ea99-4cc7-8e6f-208a64cee5ee tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:17.910898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d10110b5-ea99-4cc7-8e6f-208a64cee5ee tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:18.116745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:18.131304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:18.144676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:18.154316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:18.157095 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-de1598a8-0cbd-4b3c-b2de-ab9f87f75629 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 0.565914 Aug 04 14:22:18.177953 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2438/4889] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:17 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:18.345202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e1bd793-4e8e-4bb9-86f9-fdb2b02d7c1c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:18.345837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4e1bd793-4e8e-4bb9-86f9-fdb2b02d7c1c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:18.348380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:18.355315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e1bd793-4e8e-4bb9-86f9-fdb2b02d7c1c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:18.356089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e1bd793-4e8e-4bb9-86f9-fdb2b02d7c1c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:18.357103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e1bd793-4e8e-4bb9-86f9-fdb2b02d7c1c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:18.357709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e1bd793-4e8e-4bb9-86f9-fdb2b02d7c1c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:18.696854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d10110b5-ea99-4cc7-8e6f-208a64cee5ee tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:18.709445 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d10110b5-ea99-4cc7-8e6f-208a64cee5ee tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.817473 Aug 04 14:22:18.727420 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2452/4890] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:17 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:18.751299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7dcb97fa-503e-42dd-bba4-c40e86087d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:18.753493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7dcb97fa-503e-42dd-bba4-c40e86087d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:18.778311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7dcb97fa-503e-42dd-bba4-c40e86087d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:18.783450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7dcb97fa-503e-42dd-bba4-c40e86087d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:18.786227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7dcb97fa-503e-42dd-bba4-c40e86087d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:18.787529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7dcb97fa-503e-42dd-bba4-c40e86087d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:18.991672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e1bd793-4e8e-4bb9-86f9-fdb2b02d7c1c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:19.005193 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e1bd793-4e8e-4bb9-86f9-fdb2b02d7c1c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1315 microversion: 2.1 time: 0.663918 Aug 04 14:22:19.006314 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2439/4891] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:18 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:19.014052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3e7ac085-f917-4157-ae2d-88deabc6ff63 req-86f326ed-444b-4dcb-8c86-7fcc7c19dd76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4480884a-f303-453b-9b47-6f5b91ef2a14", "tag": "407ba1bf-3231-4192-88ac-38ce7dbbbc56"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:19.029467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3e7ac085-f917-4157-ae2d-88deabc6ff63 req-86f326ed-444b-4dcb-8c86-7fcc7c19dd76 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:19.030797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3e7ac085-f917-4157-ae2d-88deabc6ff63 req-86f326ed-444b-4dcb-8c86-7fcc7c19dd76 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:19.048412 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3e7ac085-f917-4157-ae2d-88deabc6ff63 req-86f326ed-444b-4dcb-8c86-7fcc7c19dd76 service nova] Creating event network-changed:407ba1bf-3231-4192-88ac-38ce7dbbbc56 for instance 4480884a-f303-453b-9b47-6f5b91ef2a14 on n-h2-844627-10 Aug 04 14:22:19.055700 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3e7ac085-f917-4157-ae2d-88deabc6ff63 req-86f326ed-444b-4dcb-8c86-7fcc7c19dd76 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047704 Aug 04 14:22:19.057269 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2440/4892] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:19.064623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:19.066662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:19.077307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:19.078223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:19.079424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:19.080485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:19.355771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:19.381148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:19.386181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:19.388989 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3ab64050-ca06-4db6-9ebe-f4a4677f66d2 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1413 microversion: 2.54 time: 0.330000 Aug 04 14:22:19.390492 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2441/4893] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:19 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1413 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:19.403385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:19.405410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:19.432957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:19.433760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:19.438830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:19.439630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:19.867739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:20.061834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7dcb97fa-503e-42dd-bba4-c40e86087d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:20.082045 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7dcb97fa-503e-42dd-bba4-c40e86087d49 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 1.352092 Aug 04 14:22:20.083720 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2453/4894] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:18 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:20.125748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-24cd0c19-c465-446b-81d8-4664e35236ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: .version_select at 0x7f46f2f4c3a0>, body: {"keypair": {"name": "tempest-keypair-1082824537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWkaPhcBPpcoB49TVK5ap6V/R2rT9IegoIx26P6DyP6oCuM3WVNatlU5GsnlxsJa7TFT05rQNgxNLz5SAnMGvbUydNY0aAqs+ArlGyH8A8VmrEG5EA5g8AFlp75k3mk+Q=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:20.173343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-24cd0c19-c465-446b-81d8-4664e35236ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:22:20.186261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-24cd0c19-c465-446b-81d8-4664e35236ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for user 0a5b06982b8b43ef98866e495427d381 and project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:22:20.222024 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-24cd0c19-c465-446b-81d8-4664e35236ad tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121922 Aug 04 14:22:20.233668 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2454/4895] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:22:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:20.239364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-00fac93f-4f7a-4813-a45e-9fcc4cd5fe85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:20.240461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-00fac93f-4f7a-4813-a45e-9fcc4cd5fe85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:20.248894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00fac93f-4f7a-4813-a45e-9fcc4cd5fe85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:20.249658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00fac93f-4f7a-4813-a45e-9fcc4cd5fe85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:20.251934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00fac93f-4f7a-4813-a45e-9fcc4cd5fe85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:20.252631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-00fac93f-4f7a-4813-a45e-9fcc4cd5fe85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:20.272969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:20.283368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:20.310471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:20.315270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:20.327206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c41dbbf-42e9-462a-ab0c-648a5f926397 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 0.926084 Aug 04 14:22:20.341381 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2442/4896] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:19 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:20.352299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-28e8cb60-2ae6-466c-b69b-966ab6d181bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-195964496_updated"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:20.358981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-28e8cb60-2ae6-466c-b69b-966ab6d181bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 53b57e45-ac58-4953-9a5b-7fa1964b7f2f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:20.365883 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-28e8cb60-2ae6-466c-b69b-966ab6d181bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 53b57e45-ac58-4953-9a5b-7fa1964b7f2f could not be found. Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-28e8cb60-2ae6-466c-b69b-966ab6d181bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: request: PUT /compute/v2.1/servers/53b57e45-ac58-4953-9a5b-7fa1964b7f2f HTTP/1.1 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 80 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-195964496_updated"}} Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 53b57e45-ac58-4953-9a5b-7fa1964b7f2f could not be found. Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '53b57e45-ac58-4953-9a5b-7fa1964b7f2f', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-195964496_updated'}}} Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b57e45-ac58-4953-9a5b-7fa1964b7f2f could not be found. Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 04 14:22:20.369542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b57e45-ac58-4953-9a5b-7fa1964b7f2f could not be found. Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b57e45-ac58-4953-9a5b-7fa1964b7f2f could not be found. Aug 04 14:22:20.379537 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:20.382706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-28e8cb60-2ae6-466c-b69b-966ab6d181bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 53b57e45-ac58-4953-9a5b-7fa1964b7f2f could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:20.384099 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-28e8cb60-2ae6-466c-b69b-966ab6d181bc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "PUT /compute/v2.1/servers/53b57e45-ac58-4953-9a5b-7fa1964b7f2f" status: 404 len: 111 microversion: 2.1 time: 0.041491 Aug 04 14:22:20.385973 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2443/4897] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:22:20 2022] PUT /compute/v2.1/servers/53b57e45-ac58-4953-9a5b-7fa1964b7f2f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:22:20.400258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e88c86a2-4db4-4f41-aeba-d218ce1aa6c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:20.401391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e88c86a2-4db4-4f41-aeba-d218ce1aa6c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:20.426223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e88c86a2-4db4-4f41-aeba-d218ce1aa6c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:20.426693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e88c86a2-4db4-4f41-aeba-d218ce1aa6c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:20.427597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e88c86a2-4db4-4f41-aeba-d218ce1aa6c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:20.428363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e88c86a2-4db4-4f41-aeba-d218ce1aa6c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:21.083976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-00fac93f-4f7a-4813-a45e-9fcc4cd5fe85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:21.092728 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-00fac93f-4f7a-4813-a45e-9fcc4cd5fe85 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1315 microversion: 2.1 time: 0.857645 Aug 04 14:22:21.097471 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2455/4898] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:20 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:21.107878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:21.108392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:21.135976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:21.136434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:21.137615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:21.138072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:21.264980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e88c86a2-4db4-4f41-aeba-d218ce1aa6c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:21.295937 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e88c86a2-4db4-4f41-aeba-d218ce1aa6c4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.901963 Aug 04 14:22:21.305567 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2444/4899] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:20 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:22:21.359334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f30172a5-f236-4b73-afe8-be2262cfdef4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:21.362227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f30172a5-f236-4b73-afe8-be2262cfdef4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:21.377397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f30172a5-f236-4b73-afe8-be2262cfdef4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:21.378752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f30172a5-f236-4b73-afe8-be2262cfdef4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:21.383582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f30172a5-f236-4b73-afe8-be2262cfdef4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:21.385526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f30172a5-f236-4b73-afe8-be2262cfdef4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:21.413383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:21.429557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:21.434436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:21.440583 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-67dedde4-89e3-49f5-8aea-145e483e8904 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1413 microversion: 2.54 time: 0.333731 Aug 04 14:22:21.452126 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2456/4900] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:21 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1413 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:21.471785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:21.474942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:21.500116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:21.504800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:21.506250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:21.506815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:22.504143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f30172a5-f236-4b73-afe8-be2262cfdef4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:22.524145 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f30172a5-f236-4b73-afe8-be2262cfdef4 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 1.176158 Aug 04 14:22:22.525624 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2445/4901] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:21 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:22.533562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f2f4ffc9-c41f-4476-a3da-4c6ccafec08f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:22.535422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f2f4ffc9-c41f-4476-a3da-4c6ccafec08f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:22.550077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2f4ffc9-c41f-4476-a3da-4c6ccafec08f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:22.550877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2f4ffc9-c41f-4476-a3da-4c6ccafec08f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:22.551939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2f4ffc9-c41f-4476-a3da-4c6ccafec08f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:22.554158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2f4ffc9-c41f-4476-a3da-4c6ccafec08f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:22.573165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:22.605088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:22.608236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:22.627014 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df6776bf-b03f-4a51-b055-45e4be1cce3c tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 1.180585 Aug 04 14:22:22.629693 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2457/4902] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:21 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:22.665439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-949ab5f2-16c9-47db-a772-9d2e71224845 req-86580260-cb58-41d4-a7d2-cb38f376a049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d980c4-8034-4898-83d5-bcc0ad62a973", "name": "network-vif-plugged", "status": "completed", "tag": "10153aad-a7c0-4ba3-ae0d-2844ce1198a3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:22.700453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-949ab5f2-16c9-47db-a772-9d2e71224845 req-86580260-cb58-41d4-a7d2-cb38f376a049 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:22.702776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-949ab5f2-16c9-47db-a772-9d2e71224845 req-86580260-cb58-41d4-a7d2-cb38f376a049 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:22.742904 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-949ab5f2-16c9-47db-a772-9d2e71224845 req-86580260-cb58-41d4-a7d2-cb38f376a049 service nova] Creating event network-vif-plugged:10153aad-a7c0-4ba3-ae0d-2844ce1198a3 for instance 44d980c4-8034-4898-83d5-bcc0ad62a973 on n-h1-844627-10 Aug 04 14:22:22.753129 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-949ab5f2-16c9-47db-a772-9d2e71224845 req-86580260-cb58-41d4-a7d2-cb38f376a049 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120036 Aug 04 14:22:22.754417 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2458/4903] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:22.761473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:22.762543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:22.769970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:22.770844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:22.771861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:22.772488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:23.166551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:23.188641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f2f4ffc9-c41f-4476-a3da-4c6ccafec08f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:23.206986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:23.213481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:23.226880 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-36d8235b-78f1-40ee-a218-cd4ab5edc49c tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1398 microversion: 2.54 time: 0.470589 Aug 04 14:22:23.229021 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2459/4904] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:22 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1398 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:23.246874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82d50179-eb71-48a2-9c12-3571377c9e65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:23.253452 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f2f4ffc9-c41f-4476-a3da-4c6ccafec08f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1315 microversion: 2.1 time: 0.726437 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82d50179-eb71-48a2-9c12-3571377c9e65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d HTTP/1.1 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 280 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:23.265188 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 14:22:23.272053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:23.275997 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2446/4905] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:22 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:23.281089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82d50179-eb71-48a2-9c12-3571377c9e65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:23.281089 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-82d50179-eb71-48a2-9c12-3571377c9e65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "PUT /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 400 len: 619 microversion: 2.1 time: 0.048324 Aug 04 14:22:23.281089 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2460/4906] 10.222.0.66 () {60 vars in 1257 bytes} [Thu Aug 4 14:22:23 2022] PUT /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 619 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:22:23.281680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1ab13b72-5502-4e18-bad0-e49dc98500eb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '.version_select at 0x7f46f36ff700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:23.305485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb2b797c-e842-41f8-a055-6ad6defb4137 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:23.311023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb2b797c-e842-41f8-a055-6ad6defb4137 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:23.329691 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1ab13b72-5502-4e18-bad0-e49dc98500eb tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-343421255" status: 204 len: 0 microversion: 2.54 time: 0.056893 Aug 04 14:22:23.334718 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2447/4907] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 14:22:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-343421255 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:22:23.350602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb2b797c-e842-41f8-a055-6ad6defb4137 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:23.351605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb2b797c-e842-41f8-a055-6ad6defb4137 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:23.352588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8f283b4-f4b9-4dd4-b7d9-285f816e4529 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:23.354806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb2b797c-e842-41f8-a055-6ad6defb4137 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:23.355008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e8f283b4-f4b9-4dd4-b7d9-285f816e4529 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:23.359482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb2b797c-e842-41f8-a055-6ad6defb4137 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:23.389316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:23.391652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8f283b4-f4b9-4dd4-b7d9-285f816e4529 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:23.392145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8f283b4-f4b9-4dd4-b7d9-285f816e4529 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:23.393040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8f283b4-f4b9-4dd4-b7d9-285f816e4529 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:23.393494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8f283b4-f4b9-4dd4-b7d9-285f816e4529 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:23.484282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e8f283b4-f4b9-4dd4-b7d9-285f816e4529 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:22:23.631714 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e8f283b4-f4b9-4dd4-b7d9-285f816e4529 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 204 len: 0 microversion: 2.54 time: 0.291149 Aug 04 14:22:23.637335 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2448/4908] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:22:23 2022] DELETE /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:22:23.647512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:23.649282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:23.659351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:23.660672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:23.663632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:23.664440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:23.925830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bb2b797c-e842-41f8-a055-6ad6defb4137 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:23.940734 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb2b797c-e842-41f8-a055-6ad6defb4137 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.654226 Aug 04 14:22:23.952941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:23.953829 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2461/4909] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:23 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:23.954637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:23.969746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:23.969746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:23.981645 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c80d7528-c0c3-45b0-83fc-4881d1e433fa tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1404 microversion: 2.54 time: 0.341262 Aug 04 14:22:23.990023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:23.990953 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2449/4910] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:23 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1404 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:23.991411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:23.999363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1696aced-aa11-46f8-8c15-6a5cac15929d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:24.000923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1696aced-aa11-46f8-8c15-6a5cac15929d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:24.002437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:24.006873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:24.008015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:24.010418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:24.011445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:24.022049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1696aced-aa11-46f8-8c15-6a5cac15929d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:24.023256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1696aced-aa11-46f8-8c15-6a5cac15929d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:24.025155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1696aced-aa11-46f8-8c15-6a5cac15929d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:24.026474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1696aced-aa11-46f8-8c15-6a5cac15929d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:24.390210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1696aced-aa11-46f8-8c15-6a5cac15929d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:24.434168 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1696aced-aa11-46f8-8c15-6a5cac15929d tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.438025 Aug 04 14:22:24.438487 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2450/4911] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:23 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:24.470969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d873fe54-8c66-43fc-b8a6-609ce610f5c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:24.472669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d873fe54-8c66-43fc-b8a6-609ce610f5c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:24.501549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d873fe54-8c66-43fc-b8a6-609ce610f5c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:24.501813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d873fe54-8c66-43fc-b8a6-609ce610f5c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:24.504916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d873fe54-8c66-43fc-b8a6-609ce610f5c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:24.512338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d873fe54-8c66-43fc-b8a6-609ce610f5c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:24.864557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:24.891244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:24.895549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:24.898585 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aa0d133c-2d8a-4cd3-81d9-f33d8a73bb2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 0.927008 Aug 04 14:22:24.902214 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2462/4912] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:23 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:24.914120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c390dcff-e52d-453b-a7c9-45de59ab15e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c390dcff-e52d-453b-a7c9-45de59ab15e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: request: PUT /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d HTTP/1.1 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 24 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: {"server": {"name": ""}} Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d', 'body': {'server': {'name': ''}}} Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise error Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi '' Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 14:22:24.924069 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c390dcff-e52d-453b-a7c9-45de59ab15e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:24.943020 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c390dcff-e52d-453b-a7c9-45de59ab15e6 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "PUT /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 400 len: 108 microversion: 2.1 time: 0.035985 Aug 04 14:22:24.952407 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2463/4913] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:22:24 2022] PUT /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 108 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:22:24.964742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e073a112-5cbc-46d0-bfe1-ae1e8ea2e903 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:24.966363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e073a112-5cbc-46d0-bfe1-ae1e8ea2e903 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:24.987989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e073a112-5cbc-46d0-bfe1-ae1e8ea2e903 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:24.989415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e073a112-5cbc-46d0-bfe1-ae1e8ea2e903 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:24.991365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e073a112-5cbc-46d0-bfe1-ae1e8ea2e903 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:24.992786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e073a112-5cbc-46d0-bfe1-ae1e8ea2e903 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:25.787743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d873fe54-8c66-43fc-b8a6-609ce610f5c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:25.792312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e073a112-5cbc-46d0-bfe1-ae1e8ea2e903 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:25.801605 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d873fe54-8c66-43fc-b8a6-609ce610f5c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1315 microversion: 2.1 time: 1.361392 Aug 04 14:22:25.804149 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2451/4914] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:24 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1315 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:25.812719 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e073a112-5cbc-46d0-bfe1-ae1e8ea2e903 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1505 microversion: 2.1 time: 0.857223 Aug 04 14:22:25.813069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:25.813614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:25.822732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:25.823807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:25.825407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:25.826031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:25.829545 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2464/4915] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:24 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1505 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:25.857666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e7c517d7-19be-4fa8-8a91-79601e62c332 req-b131cc87-2261-4474-93c8-89834149c948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4480884a-f303-453b-9b47-6f5b91ef2a14", "name": "network-vif-plugged", "status": "completed", "tag": "407ba1bf-3231-4192-88ac-38ce7dbbbc56"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:25.898190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e7c517d7-19be-4fa8-8a91-79601e62c332 req-b131cc87-2261-4474-93c8-89834149c948 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:25.906386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e7c517d7-19be-4fa8-8a91-79601e62c332 req-b131cc87-2261-4474-93c8-89834149c948 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:25.939697 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e7c517d7-19be-4fa8-8a91-79601e62c332 req-b131cc87-2261-4474-93c8-89834149c948 service nova] Creating event network-vif-plugged:407ba1bf-3231-4192-88ac-38ce7dbbbc56 for instance 4480884a-f303-453b-9b47-6f5b91ef2a14 on n-h2-844627-10 Aug 04 14:22:25.951779 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e7c517d7-19be-4fa8-8a91-79601e62c332 req-b131cc87-2261-4474-93c8-89834149c948 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119782 Aug 04 14:22:25.953831 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2465/4916] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:25.970851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:25.973748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:25.989306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:25.990614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:25.992454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:25.993550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:26.022999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:26.044937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:26.047181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:26.052570 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-16664211-5949-4642-997c-7ce250e1dc4a tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1404 microversion: 2.54 time: 0.246999 Aug 04 14:22:26.054405 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2452/4917] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:25 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1404 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:26.662502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:26.680291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:26.683900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:26.686321 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1eac44d-35bf-4ffe-91b7-b8714c947b67 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 0.729972 Aug 04 14:22:26.694456 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2466/4918] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:25 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:26.866058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-797e77bc-7b50-40a1-901b-a4e8be69d76c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:26.870638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-797e77bc-7b50-40a1-901b-a4e8be69d76c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:26.889844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-797e77bc-7b50-40a1-901b-a4e8be69d76c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:26.890733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-797e77bc-7b50-40a1-901b-a4e8be69d76c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:26.894269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-797e77bc-7b50-40a1-901b-a4e8be69d76c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:26.895958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-797e77bc-7b50-40a1-901b-a4e8be69d76c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:27.079785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:27.081229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:27.106605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:27.108136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:27.109186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:27.112218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:27.280161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:27.280988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:27.281589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lazy-loading 'fault' on Instance uuid 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:22:28.161876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:28.179983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:28.187208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ea276fc00164079b98262c7dc74b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10875130e43741928b52195b788e6511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:28.195733 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e0f56a08-8be8-42b8-9e56-26603d482c01 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 200 len: 1409 microversion: 2.54 time: 1.119777 Aug 04 14:22:28.199357 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2467/4919] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:27 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 1409 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:28.215746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:28.217691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:28.241563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:28.242449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:28.245590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:28.247098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:28.439038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-797e77bc-7b50-40a1-901b-a4e8be69d76c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:28.454037 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-797e77bc-7b50-40a1-901b-a4e8be69d76c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1315 microversion: 2.1 time: 1.606874 Aug 04 14:22:28.455916 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2453/4920] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:26 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1315 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:29.005936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:29.034642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:29.042238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:29.044525 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e8c32720-1fbb-46ca-af5c-0014dd703afb tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1729 microversion: 2.20 time: 0.840010 Aug 04 14:22:29.050239 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2468/4921] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:28 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1729 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:22:29.228754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:29.234274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] [instance: 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:29.265950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:29.266728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:29.268626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:29.269382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:29.300227 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] HTTP exception thrown: Instance 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 could not be found. Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Request method failure captured: Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 HTTP/1.1 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Xc8EVM0w0jltyO1up_qWuPwws8itS8-HNC9XcrSc3ft2Mmvfjsrth--aYgNZ6RW_YulVvt8sJ4bANUmy2bdsvgkGAV4_04yCZknZ0nMitsQ6ZxNSd2YqYpsethL8yBFw-owiM4JT_NoyM1U7dVMlP_aNNo0EpW40MAW6aqBH6XDlQ Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.54 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 10875130e43741928b52195b788e6511 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerShowV254Test-416074650 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/10875130e43741928b52195b788e6511"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_10875130e43741928b52195b788e6511"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/10875130e43741928b52195b788e6511"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/10875130e43741928b52195b788e6511"}]}] Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerShowV254Test-416074650 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 10875130e43741928b52195b788e6511 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerShowV254Test-416074650 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerShowV254Test-416074650-project Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 9ea276fc00164079b98262c7dc74b987 Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerShowV254Test-416074650-project Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 could not be found. Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628'} Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 could not be found. Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 could not be found. Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:29.304897 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:29.310219 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:29.310219 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:29.310219 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:29.310219 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:29.310219 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:29.310219 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 could not be found. Aug 04 14:22:29.310219 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:29.310898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] Returning 404 to user: Instance 5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:29.311478 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-119abcf1-6857-441f-a2f7-803c8b6a8f18 tempest-ServerShowV254Test-416074650 tempest-ServerShowV254Test-416074650-project] 10.222.0.66 "GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628" status: 404 len: 111 microversion: 2.54 time: 0.092245 Aug 04 14:22:29.316996 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2454/4922] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:29 2022] GET /compute/v2.1/servers/5dd9becf-9a7b-4e4a-9d7c-ec8f8cdcb628 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:22:29.476990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf499228-58b6-4f40-9e63-2ce734b5fcfb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:29.479282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf499228-58b6-4f40-9e63-2ce734b5fcfb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:29.496813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf499228-58b6-4f40-9e63-2ce734b5fcfb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:29.497744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf499228-58b6-4f40-9e63-2ce734b5fcfb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:29.499359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf499228-58b6-4f40-9e63-2ce734b5fcfb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:29.500159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf499228-58b6-4f40-9e63-2ce734b5fcfb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:30.085197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:30.086445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:30.114559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:30.126097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:30.132459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:30.135578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:30.171860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bf499228-58b6-4f40-9e63-2ce734b5fcfb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:30.197150 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf499228-58b6-4f40-9e63-2ce734b5fcfb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1501 microversion: 2.1 time: 0.724750 Aug 04 14:22:30.213990 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2469/4923] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:29 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1501 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:30.245703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-446299757", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92919b9e-87d8-4c0f-81a1-d2a3d627e9d7"}], "security_groups": [{"name": "tempest-securitygroup--1939060074"}], "key_name": "tempest-keypair-1082824537", "user_data": "}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:30.272475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:30.527899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] validate_networks() for [('92919b9e-87d8-4c0f-81a1-d2a3d627e9d7', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:22:30.690529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:30.704019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:30.715380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:30.716745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9a8ec0e0-61c5-4ba3-a1aa-e5f233fa99cd tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1716 microversion: 2.20 time: 0.641423 Aug 04 14:22:30.717813 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2455/4924] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:22:30 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1716 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:22:30.737226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e6d7e7d-3bcc-4a61-99ca-44e4c45ef3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:30.737925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e6d7e7d-3bcc-4a61-99ca-44e4c45ef3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:30.757336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e6d7e7d-3bcc-4a61-99ca-44e4c45ef3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:30.758198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e6d7e7d-3bcc-4a61-99ca-44e4c45ef3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:30.759770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e6d7e7d-3bcc-4a61-99ca-44e4c45ef3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:30.760464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e6d7e7d-3bcc-4a61-99ca-44e4c45ef3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:31.309344 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.network.security_group_api [None req-6e6d7e7d-3bcc-4a61-99ca-44e4c45ef3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Removing security group 51d8681a-b811-40d5-ba40-43b1f2213ba8 from port 407ba1bf-3231-4192-88ac-38ce7dbbbc56 Aug 04 14:22:32.760939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:22:32.763632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:22:32.767541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:22:32.769085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:22:32.777246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:22:32.824951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:32.826716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:32.828572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:32.829728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:32.896287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:22:32.912658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Getting quotas for user 0a5b06982b8b43ef98866e495427d381 and project 9a2b9bbf2acf40e894f49d12ef51e0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:22:32.963242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:22:32.968219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:22:33.126747 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-247d9079-b008-4fa2-8f1e-7fe02468d431 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.891143 Aug 04 14:22:33.133458 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2470/4925] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:22:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:22:33.147022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-97a2d5bb-66e5-4a9c-a7e8-ba7552c698be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:33.148109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-97a2d5bb-66e5-4a9c-a7e8-ba7552c698be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:33.176910 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e6d7e7d-3bcc-4a61-99ca-44e4c45ef3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14/action" status: 202 len: 0 microversion: 2.1 time: 2.457652 Aug 04 14:22:33.179604 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2456/4926] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:22:30 2022] POST /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14/action => generated 0 bytes in 2461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:22:33.191529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b712a140-94f2-4a57-86dc-72a4a9a9589d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:33.191756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b712a140-94f2-4a57-86dc-72a4a9a9589d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:33.233620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b712a140-94f2-4a57-86dc-72a4a9a9589d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:33.234339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b712a140-94f2-4a57-86dc-72a4a9a9589d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:33.238419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b712a140-94f2-4a57-86dc-72a4a9a9589d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:33.242881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b712a140-94f2-4a57-86dc-72a4a9a9589d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:34.530223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b712a140-94f2-4a57-86dc-72a4a9a9589d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:34.535122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-97a2d5bb-66e5-4a9c-a7e8-ba7552c698be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:34.550474 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-97a2d5bb-66e5-4a9c-a7e8-ba7552c698be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1241 microversion: 2.1 time: 1.407963 Aug 04 14:22:34.554163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2471/4927] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:33 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1241 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:34.559826 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b712a140-94f2-4a57-86dc-72a4a9a9589d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1459 microversion: 2.1 time: 1.374644 Aug 04 14:22:34.563196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-24855324-56a8-4552-833e-eb37ea358668 req-cd3de352-8640-44b6-be43-620285e5ac24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4480884a-f303-453b-9b47-6f5b91ef2a14", "tag": "407ba1bf-3231-4192-88ac-38ce7dbbbc56"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:34.574337 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2457/4928] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:33 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1459 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:34.588510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fe0940a2-e7b9-43b3-a323-2e7e2df8f321 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Action: 'create', calling method: .version_select at 0x7f46f36408b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1960577295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxKO5me7v/bhmbSVTmma/e53d0Wz7/I+mMVu3a7qRo7z4NUSE2+A5IsIGJ4B/U+dJrTAitDPe8VxxkcgQbJGWodJUEm4MASRwSOAf1RHuRCObKYTpX7tZzqEq/Wj0lODg=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:34.616536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-24855324-56a8-4552-833e-eb37ea358668 req-cd3de352-8640-44b6-be43-620285e5ac24 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:34.622253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-24855324-56a8-4552-833e-eb37ea358668 req-cd3de352-8640-44b6-be43-620285e5ac24 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:34.644076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fe0940a2-e7b9-43b3-a323-2e7e2df8f321 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:22:34.656424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fe0940a2-e7b9-43b3-a323-2e7e2df8f321 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for user b691f49b0fe64e8a99ca896ddba38334 and project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:22:34.717858 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fe0940a2-e7b9-43b3-a323-2e7e2df8f321 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.142126 Aug 04 14:22:34.718895 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2458/4929] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:22:34 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:34.750294 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-24855324-56a8-4552-833e-eb37ea358668 req-cd3de352-8640-44b6-be43-620285e5ac24 service nova] Creating event network-changed:407ba1bf-3231-4192-88ac-38ce7dbbbc56 for instance 4480884a-f303-453b-9b47-6f5b91ef2a14 on n-h2-844627-10 Aug 04 14:22:34.770134 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-24855324-56a8-4552-833e-eb37ea358668 req-cd3de352-8640-44b6-be43-620285e5ac24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214170 Aug 04 14:22:34.776495 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2472/4930] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:34.778647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7b906c9a-d5a9-4d1a-bc44-6d0090335ef9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:34.783322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7b906c9a-d5a9-4d1a-bc44-6d0090335ef9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:34.815802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b906c9a-d5a9-4d1a-bc44-6d0090335ef9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:34.816717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b906c9a-d5a9-4d1a-bc44-6d0090335ef9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:34.817993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b906c9a-d5a9-4d1a-bc44-6d0090335ef9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:34.818692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7b906c9a-d5a9-4d1a-bc44-6d0090335ef9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:35.521288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc294204-6b2e-4660-8c89-da9ac3ab4c6d tempest-ExtensionsTest-1456413930 tempest-ExtensionsTest-1456413930-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:35.531966 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bc294204-6b2e-4660-8c89-da9ac3ab4c6d tempest-ExtensionsTest-1456413930 tempest-ExtensionsTest-1456413930-project] 10.222.0.66 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.344208 Aug 04 14:22:35.542810 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2473/4931] 10.222.0.66 () {58 vars in 1170 bytes} [Thu Aug 4 14:22:35 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:35.579079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ba87982-8120-4b2b-80be-9a54207db1f9 tempest-ExtensionsTest-1456413930 tempest-ExtensionsTest-1456413930-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:35.595666 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ba87982-8120-4b2b-80be-9a54207db1f9 tempest-ExtensionsTest-1456413930 tempest-ExtensionsTest-1456413930-project] 10.222.0.66 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.048266 Aug 04 14:22:35.599275 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2474/4932] 10.222.0.66 () {58 vars in 1134 bytes} [Thu Aug 4 14:22:35 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:22:35.631624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7f5fa6ed-a757-4037-8596-552f46d6930d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:35.644674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7f5fa6ed-a757-4037-8596-552f46d6930d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:35.672519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f5fa6ed-a757-4037-8596-552f46d6930d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:35.674079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f5fa6ed-a757-4037-8596-552f46d6930d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:35.674548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f5fa6ed-a757-4037-8596-552f46d6930d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:35.677303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f5fa6ed-a757-4037-8596-552f46d6930d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:35.763157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7b906c9a-d5a9-4d1a-bc44-6d0090335ef9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:35.782102 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7b906c9a-d5a9-4d1a-bc44-6d0090335ef9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.032256 Aug 04 14:22:35.782764 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2459/4933] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:34 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:35.821984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:35.824138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:35.853240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:35.853767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:35.854650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:35.855107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:35.914178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7f5fa6ed-a757-4037-8596-552f46d6930d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:35.925541 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7f5fa6ed-a757-4037-8596-552f46d6930d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1301 microversion: 2.1 time: 0.322493 Aug 04 14:22:35.938927 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:35.943326 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2475/4934] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:35 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1301 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 HTTP/1.1 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3014c326-6c39-41ef-ace6-c0cbe3259896'} Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:22:35.946911 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:35.951571 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f9fb1542-0e2f-408a-8b9e-e869e8ddcb70 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 404 len: 111 microversion: 2.1 time: 0.156715 Aug 04 14:22:35.958888 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2460/4935] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:22:35 2022] DELETE /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:22:35.966619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d3b3a3e-5727-4f37-ad74-e985008e68c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:35.966856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:35.967451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 3014c326-6c39-41ef-ace6-c0cbe3259896] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:35.968112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3d3b3a3e-5727-4f37-ad74-e985008e68c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:35.989263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d3b3a3e-5727-4f37-ad74-e985008e68c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:35.990165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d3b3a3e-5727-4f37-ad74-e985008e68c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:35.991096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d3b3a3e-5727-4f37-ad74-e985008e68c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:35.992331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:35.992963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d3b3a3e-5727-4f37-ad74-e985008e68c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:36.002449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:36.003309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:36.010285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:36.060773 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 HTTP/1.1 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '3014c326-6c39-41ef-ace6-c0cbe3259896'} Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:36.075315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:36.079617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:36.079617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:36.079617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:36.079617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:36.079617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:36.079617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. Aug 04 14:22:36.079617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:36.079617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 3014c326-6c39-41ef-ace6-c0cbe3259896 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:36.079617 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-684fb060-0de0-471d-bb35-13a484484c65 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896" status: 404 len: 111 microversion: 2.1 time: 0.114655 Aug 04 14:22:36.084017 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2461/4936] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:35 2022] GET /compute/v2.1/servers/3014c326-6c39-41ef-ace6-c0cbe3259896 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:22:36.095481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c9e044f1-876e-4faa-a586-c0370dce3f35 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:36.097223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c9e044f1-876e-4faa-a586-c0370dce3f35 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:36.106047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9e044f1-876e-4faa-a586-c0370dce3f35 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:36.106580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9e044f1-876e-4faa-a586-c0370dce3f35 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:36.107442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9e044f1-876e-4faa-a586-c0370dce3f35 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:36.108058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9e044f1-876e-4faa-a586-c0370dce3f35 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:36.183873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c9e044f1-876e-4faa-a586-c0370dce3f35 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:22:36.409814 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c9e044f1-876e-4faa-a586-c0370dce3f35 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 204 len: 0 microversion: 2.1 time: 0.321374 Aug 04 14:22:36.417246 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2462/4937] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:22:36 2022] DELETE /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:22:36.423302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d78ddd5f-48f0-4410-a52c-6d2aa9ba34cc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:36.430383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d78ddd5f-48f0-4410-a52c-6d2aa9ba34cc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:36.445728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d78ddd5f-48f0-4410-a52c-6d2aa9ba34cc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:36.449425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d78ddd5f-48f0-4410-a52c-6d2aa9ba34cc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:36.450536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d78ddd5f-48f0-4410-a52c-6d2aa9ba34cc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:36.453633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d78ddd5f-48f0-4410-a52c-6d2aa9ba34cc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:37.599531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d78ddd5f-48f0-4410-a52c-6d2aa9ba34cc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:37.619883 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d78ddd5f-48f0-4410-a52c-6d2aa9ba34cc tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 1.200023 Aug 04 14:22:37.623232 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2463/4938] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:36 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:37.642285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3d3b3a3e-5727-4f37-ad74-e985008e68c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:37.669341 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3d3b3a3e-5727-4f37-ad74-e985008e68c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.717324 Aug 04 14:22:37.671941 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2476/4939] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:35 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:37.674474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5b58e76c-c002-46a5-82d3-8d15e7c88c03 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:37.675402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b58e76c-c002-46a5-82d3-8d15e7c88c03 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:37.691512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b58e76c-c002-46a5-82d3-8d15e7c88c03 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:37.692112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b58e76c-c002-46a5-82d3-8d15e7c88c03 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:37.695823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0dc07ba5-82b1-46a6-99b9-e985c4beaee4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:37.696716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0dc07ba5-82b1-46a6-99b9-e985c4beaee4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:37.697389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b58e76c-c002-46a5-82d3-8d15e7c88c03 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:37.697956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b58e76c-c002-46a5-82d3-8d15e7c88c03 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:37.715366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dc07ba5-82b1-46a6-99b9-e985c4beaee4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:37.716016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dc07ba5-82b1-46a6-99b9-e985c4beaee4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:37.716961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dc07ba5-82b1-46a6-99b9-e985c4beaee4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:37.717726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dc07ba5-82b1-46a6-99b9-e985c4beaee4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:38.118160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5b58e76c-c002-46a5-82d3-8d15e7c88c03 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:38.134673 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5b58e76c-c002-46a5-82d3-8d15e7c88c03 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1299 microversion: 2.1 time: 0.480193 Aug 04 14:22:38.175399 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2464/4940] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:37 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1299 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:38.660676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e312bec-f53a-444d-9b41-17fe31d9cb11 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:38.673958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e312bec-f53a-444d-9b41-17fe31d9cb11 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:38.716573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e312bec-f53a-444d-9b41-17fe31d9cb11 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:38.718995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e312bec-f53a-444d-9b41-17fe31d9cb11 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:38.721112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e312bec-f53a-444d-9b41-17fe31d9cb11 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:38.723162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e312bec-f53a-444d-9b41-17fe31d9cb11 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:38.862516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0dc07ba5-82b1-46a6-99b9-e985c4beaee4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:38.873206 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0dc07ba5-82b1-46a6-99b9-e985c4beaee4 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.182020 Aug 04 14:22:38.874351 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2477/4941] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:37 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:38.918741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3153e100-8d64-4076-888e-8344a5a1046f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:38.919703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3153e100-8d64-4076-888e-8344a5a1046f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:38.935027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3153e100-8d64-4076-888e-8344a5a1046f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:38.935713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3153e100-8d64-4076-888e-8344a5a1046f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:38.936499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3153e100-8d64-4076-888e-8344a5a1046f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:38.937547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3153e100-8d64-4076-888e-8344a5a1046f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:39.645900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e312bec-f53a-444d-9b41-17fe31d9cb11 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0c7b6a4b29b45349945e5051f6ad2c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b98f1d6353346fca5cd6346bae615f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:39.677031 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e312bec-f53a-444d-9b41-17fe31d9cb11 tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 200 len: 1511 microversion: 2.1 time: 1.029254 Aug 04 14:22:39.688894 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2465/4942] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:38 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 1511 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:39.691891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-40b52e35-325e-4e20-86a8-1104844e4238 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:39.693529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-40b52e35-325e-4e20-86a8-1104844e4238 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:39.710299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40b52e35-325e-4e20-86a8-1104844e4238 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:39.712050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40b52e35-325e-4e20-86a8-1104844e4238 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:39.714121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40b52e35-325e-4e20-86a8-1104844e4238 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:39.715168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40b52e35-325e-4e20-86a8-1104844e4238 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:39.902453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3153e100-8d64-4076-888e-8344a5a1046f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:39.918250 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3153e100-8d64-4076-888e-8344a5a1046f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 1.006322 Aug 04 14:22:39.918878 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2478/4943] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:38 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:39.963488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-40b52e35-325e-4e20-86a8-1104844e4238 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:39.977396 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-40b52e35-325e-4e20-86a8-1104844e4238 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1299 microversion: 2.1 time: 0.297426 Aug 04 14:22:39.978789 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2466/4944] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:39 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1299 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:40.347426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1829774365", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4d77cf6c-b556-48ab-92a8-04444fe680a2"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:40.456325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] validate_networks() for [('4d77cf6c-b556-48ab-92a8-04444fe680a2', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:22:40.579353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-20e43454-6258-4308-9c78-173a19823add req-7b8ff519-59e2-4907-9c65-c62b52616c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c416741-016d-4f02-9a57-507f0454876d", "name": "network-vif-deleted", "tag": "e2a0c66d-f403-4a0a-8afd-7a706050968f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:40.596639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-20e43454-6258-4308-9c78-173a19823add req-7b8ff519-59e2-4907-9c65-c62b52616c09 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:40.597556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-20e43454-6258-4308-9c78-173a19823add req-7b8ff519-59e2-4907-9c65-c62b52616c09 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:40.637976 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-20e43454-6258-4308-9c78-173a19823add req-7b8ff519-59e2-4907-9c65-c62b52616c09 service nova] Creating event network-vif-deleted:e2a0c66d-f403-4a0a-8afd-7a706050968f for instance 9c416741-016d-4f02-9a57-507f0454876d on n-h1-844627-10 Aug 04 14:22:40.645569 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-20e43454-6258-4308-9c78-173a19823add req-7b8ff519-59e2-4907-9c65-c62b52616c09 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069749 Aug 04 14:22:40.646854 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2467/4945] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:41.347384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:41.348274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] [instance: 9c416741-016d-4f02-9a57-507f0454876d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:41.364049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:41.364934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:41.365995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:41.366696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:41.387182 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] HTTP exception thrown: Instance 9c416741-016d-4f02-9a57-507f0454876d could not be found. Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Request method failure captured: Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d HTTP/1.1 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69UDpy8Fy9nWm-Zn_sPI4pMoHEeq23k5JqjIq8MeUFoNb6WkHOxOKhzrRhT62rvl6PWJxU7_8DAXF_LWq8VtK99VZpuITUIrt1EkR5Zvwr0UcwAEiK95yx-8oU1QfsZltxVxgprKT4b3JuNN585xw5Javz0hwyp14qKI0rnG3TQntkg Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2b98f1d6353346fca5cd6346bae615f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2b98f1d6353346fca5cd6346bae615f2"}]}] Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2b98f1d6353346fca5cd6346bae615f2 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-176628113 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: c0c7b6a4b29b45349945e5051f6ad2c9 Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-176628113-project Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 9c416741-016d-4f02-9a57-507f0454876d could not be found. Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9c416741-016d-4f02-9a57-507f0454876d'} Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c416741-016d-4f02-9a57-507f0454876d could not be found. Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c416741-016d-4f02-9a57-507f0454876d could not be found. Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:22:41.389248 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:41.394501 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:22:41.394501 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:22:41.394501 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:22:41.394501 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:22:41.394501 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:22:41.394501 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c416741-016d-4f02-9a57-507f0454876d could not be found. Aug 04 14:22:41.394501 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:22:41.396338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] Returning 404 to user: Instance 9c416741-016d-4f02-9a57-507f0454876d could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:22:41.398180 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a8443e39-11b4-4e9d-8fa4-4cda1c5e468b tempest-ServersNegativeTestJSON-176628113 tempest-ServersNegativeTestJSON-176628113-project] 10.222.0.66 "GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d" status: 404 len: 111 microversion: 2.1 time: 0.699816 Aug 04 14:22:41.399434 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2468/4946] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:40 2022] GET /compute/v2.1/servers/9c416741-016d-4f02-9a57-507f0454876d => generated 111 bytes in 702 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:22:41.406005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-995b88a0-ca17-4d51-8fc2-305bc3f85a45 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:41.407720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-995b88a0-ca17-4d51-8fc2-305bc3f85a45 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:41.416927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-995b88a0-ca17-4d51-8fc2-305bc3f85a45 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:41.417803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-995b88a0-ca17-4d51-8fc2-305bc3f85a45 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:41.418779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-995b88a0-ca17-4d51-8fc2-305bc3f85a45 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:41.419356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-995b88a0-ca17-4d51-8fc2-305bc3f85a45 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:41.440929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:42.097570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-995b88a0-ca17-4d51-8fc2-305bc3f85a45 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:42.109967 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-995b88a0-ca17-4d51-8fc2-305bc3f85a45 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1367 microversion: 2.1 time: 0.708229 Aug 04 14:22:42.110873 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2469/4947] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:41 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1367 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:42.863985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:42.927051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:22:42.929063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:22:42.929693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:22:42.930119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:22:42.931079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:22:42.942987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:42.943539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:42.944587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:42.945066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:42.972577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:22:42.984286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Getting quotas for user fab9d445099545e98979afa009678007 and project 2451f47c5ae54b75aa16479731e5d9bd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:22:43.005832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:22:43.009178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:22:43.082851 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-56e0a02f-2d3f-4443-95cd-f6099e1779d8 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.739259 Aug 04 14:22:43.085224 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2479/4948] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:22:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:22:43.096560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0052a73e-cdbd-4b23-b37b-76bb5cb6e00a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:43.098265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0052a73e-cdbd-4b23-b37b-76bb5cb6e00a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:43.160635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b3dbfa91-1c9b-4802-9654-f7f181b89764 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:43.162391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b3dbfa91-1c9b-4802-9654-f7f181b89764 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:43.202927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3dbfa91-1c9b-4802-9654-f7f181b89764 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:43.210223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3dbfa91-1c9b-4802-9654-f7f181b89764 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:43.219727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3dbfa91-1c9b-4802-9654-f7f181b89764 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:43.220751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3dbfa91-1c9b-4802-9654-f7f181b89764 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:43.233573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:43.257937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0052a73e-cdbd-4b23-b37b-76bb5cb6e00a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:43.266702 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0052a73e-cdbd-4b23-b37b-76bb5cb6e00a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1215 microversion: 2.1 time: 0.174052 Aug 04 14:22:43.293380 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2470/4949] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:43 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1215 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:43.886804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b3dbfa91-1c9b-4802-9654-f7f181b89764 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:43.922528 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b3dbfa91-1c9b-4802-9654-f7f181b89764 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1367 microversion: 2.1 time: 0.778515 Aug 04 14:22:43.957349 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2480/4950] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:43 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1367 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:44.123471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2052379875", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "25e00e67-3403-494e-a98b-d60f599c367e"}], "key_name": "tempest-TestNetworkBasicOps-1960577295", "security_groups": [{"name": "tempest-secgroup-smoke-1090075400"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:44.288584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f5f02c8-ca01-4232-88d6-55125f2bb2ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:44.289594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f5f02c8-ca01-4232-88d6-55125f2bb2ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:44.313073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f5f02c8-ca01-4232-88d6-55125f2bb2ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:44.322121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f5f02c8-ca01-4232-88d6-55125f2bb2ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:44.326363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f5f02c8-ca01-4232-88d6-55125f2bb2ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:44.327620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f5f02c8-ca01-4232-88d6-55125f2bb2ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:44.560609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6f5f02c8-ca01-4232-88d6-55125f2bb2ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:44.580060 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f5f02c8-ca01-4232-88d6-55125f2bb2ee tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1219 microversion: 2.1 time: 0.294226 Aug 04 14:22:44.598148 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2481/4951] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:44 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1219 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:22:44.791933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] validate_networks() for [('25e00e67-3403-494e-a98b-d60f599c367e', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:22:45.003880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-44afb39e-19a1-4ab0-9066-bafd8e2cea6d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:45.004509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-44afb39e-19a1-4ab0-9066-bafd8e2cea6d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:45.017670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44afb39e-19a1-4ab0-9066-bafd8e2cea6d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:45.018572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44afb39e-19a1-4ab0-9066-bafd8e2cea6d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:45.019683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44afb39e-19a1-4ab0-9066-bafd8e2cea6d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:45.020385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44afb39e-19a1-4ab0-9066-bafd8e2cea6d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:46.451772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-44afb39e-19a1-4ab0-9066-bafd8e2cea6d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:46.491933 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-44afb39e-19a1-4ab0-9066-bafd8e2cea6d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1367 microversion: 2.1 time: 1.491496 Aug 04 14:22:46.530866 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2482/4952] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:44 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1367 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:46.564335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f54ac1b9-664e-4256-be86-1d5ed1859155 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:46.566183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f54ac1b9-664e-4256-be86-1d5ed1859155 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:46.604232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f54ac1b9-664e-4256-be86-1d5ed1859155 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:46.605218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f54ac1b9-664e-4256-be86-1d5ed1859155 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:46.606265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f54ac1b9-664e-4256-be86-1d5ed1859155 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:46.606915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f54ac1b9-664e-4256-be86-1d5ed1859155 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:47.053749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f54ac1b9-664e-4256-be86-1d5ed1859155 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:47.071604 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f54ac1b9-664e-4256-be86-1d5ed1859155 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1273 microversion: 2.1 time: 0.537210 Aug 04 14:22:47.089288 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2483/4953] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:46 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1273 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:47.099063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f8d0cef6-d126-4830-82ea-698c92678d8c req-e2d8e6ee-a3b1-4b4f-8f1e-a821efafef65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b674f7bb-a83a-4eb5-9f9d-bcca0740b251", "tag": "8248b82d-db83-41f2-96f5-341d876f60ea"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:47.119924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f8d0cef6-d126-4830-82ea-698c92678d8c req-e2d8e6ee-a3b1-4b4f-8f1e-a821efafef65 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:47.121331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f8d0cef6-d126-4830-82ea-698c92678d8c req-e2d8e6ee-a3b1-4b4f-8f1e-a821efafef65 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:47.148680 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f8d0cef6-d126-4830-82ea-698c92678d8c req-e2d8e6ee-a3b1-4b4f-8f1e-a821efafef65 service nova] Creating event network-changed:8248b82d-db83-41f2-96f5-341d876f60ea for instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 on n-h2-844627-10 Aug 04 14:22:47.171530 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f8d0cef6-d126-4830-82ea-698c92678d8c req-e2d8e6ee-a3b1-4b4f-8f1e-a821efafef65 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091048 Aug 04 14:22:47.173870 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2484/4954] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:47.538697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5038796e-f376-44fe-bab8-1b20766ac710 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:47.539614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5038796e-f376-44fe-bab8-1b20766ac710 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:47.555105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5038796e-f376-44fe-bab8-1b20766ac710 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:47.556021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5038796e-f376-44fe-bab8-1b20766ac710 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:47.556837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5038796e-f376-44fe-bab8-1b20766ac710 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:47.564177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5038796e-f376-44fe-bab8-1b20766ac710 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:49.500958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5038796e-f376-44fe-bab8-1b20766ac710 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:49.515124 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5038796e-f376-44fe-bab8-1b20766ac710 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1367 microversion: 2.1 time: 1.980970 Aug 04 14:22:49.529093 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2485/4955] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:47 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1367 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:22:49.586636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:22:49.587445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:22:49.588841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:22:49.591608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:22:49.592562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:22:49.639482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:49.642014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:49.646067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:49.646998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:49.737729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:22:49.769673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for user b691f49b0fe64e8a99ca896ddba38334 and project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:22:49.829415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:22:49.841965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:22:49.847487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3b944c03-afdc-453a-b419-00bf9db8f152 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:49.848349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3b944c03-afdc-453a-b419-00bf9db8f152 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:49.860977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b944c03-afdc-453a-b419-00bf9db8f152 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:49.861437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b944c03-afdc-453a-b419-00bf9db8f152 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:49.862247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b944c03-afdc-453a-b419-00bf9db8f152 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:49.862698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b944c03-afdc-453a-b419-00bf9db8f152 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:49.967887 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ff1489b8-7a19-4f5b-b365-814b424d7da5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 5.848370 Aug 04 14:22:49.970154 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2471/4956] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:22:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 5851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:22:49.985078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6c719648-3f2e-42a7-a32b-08f0e6d4ba54 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:49.987923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6c719648-3f2e-42a7-a32b-08f0e6d4ba54 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:50.718451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6c719648-3f2e-42a7-a32b-08f0e6d4ba54 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:50.752515 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6c719648-3f2e-42a7-a32b-08f0e6d4ba54 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1249 microversion: 2.1 time: 0.757613 Aug 04 14:22:50.754632 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2472/4957] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:49 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1249 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:50.786604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9202dff9-deeb-4d47-9009-b2657ab91ae7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:50.799408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9202dff9-deeb-4d47-9009-b2657ab91ae7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:50.817406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9202dff9-deeb-4d47-9009-b2657ab91ae7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:50.827320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9202dff9-deeb-4d47-9009-b2657ab91ae7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:50.829709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9202dff9-deeb-4d47-9009-b2657ab91ae7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:50.831533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9202dff9-deeb-4d47-9009-b2657ab91ae7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:50.906980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3b944c03-afdc-453a-b419-00bf9db8f152 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:50.918456 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3b944c03-afdc-453a-b419-00bf9db8f152 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1273 microversion: 2.1 time: 1.386743 Aug 04 14:22:50.919130 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2486/4958] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:49 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1273 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:51.503481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9202dff9-deeb-4d47-9009-b2657ab91ae7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:51.527637 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9202dff9-deeb-4d47-9009-b2657ab91ae7 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1367 microversion: 2.1 time: 0.768885 Aug 04 14:22:51.528266 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2473/4959] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:50 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1367 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:51.783756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a811a0ba-7d0c-4f71-8154-8baf25850c8c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:51.791252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a811a0ba-7d0c-4f71-8154-8baf25850c8c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:51.815932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a811a0ba-7d0c-4f71-8154-8baf25850c8c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:51.817191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a811a0ba-7d0c-4f71-8154-8baf25850c8c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:51.818988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a811a0ba-7d0c-4f71-8154-8baf25850c8c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:51.820181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a811a0ba-7d0c-4f71-8154-8baf25850c8c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:51.956480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c3f04f4-fe5b-483a-9e01-620dcfdec44c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:51.957493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c3f04f4-fe5b-483a-9e01-620dcfdec44c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:51.973911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c3f04f4-fe5b-483a-9e01-620dcfdec44c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:51.974426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c3f04f4-fe5b-483a-9e01-620dcfdec44c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:51.975478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c3f04f4-fe5b-483a-9e01-620dcfdec44c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:51.976289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c3f04f4-fe5b-483a-9e01-620dcfdec44c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:52.168324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a811a0ba-7d0c-4f71-8154-8baf25850c8c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:52.199852 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a811a0ba-7d0c-4f71-8154-8baf25850c8c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1319 microversion: 2.1 time: 0.423232 Aug 04 14:22:52.200982 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2487/4960] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:51 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:52.577489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1aa57fb3-915e-4f97-b753-c296451ad263 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:52.579244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1aa57fb3-915e-4f97-b753-c296451ad263 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:52.592310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1aa57fb3-915e-4f97-b753-c296451ad263 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:52.594049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1aa57fb3-915e-4f97-b753-c296451ad263 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:52.596029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1aa57fb3-915e-4f97-b753-c296451ad263 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:52.597374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1aa57fb3-915e-4f97-b753-c296451ad263 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:52.955135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:53.012272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=14 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:53.262695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3c3f04f4-fe5b-483a-9e01-620dcfdec44c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:53.295237 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c3f04f4-fe5b-483a-9e01-620dcfdec44c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1315 microversion: 2.1 time: 1.342604 Aug 04 14:22:53.296243 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2474/4961] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:51 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1315 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:53.309804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cdb1b5a6-5b69-45de-98f5-1c6fb76aaa8b tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:53.311938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cdb1b5a6-5b69-45de-98f5-1c6fb76aaa8b tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:53.339568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5a6-5b69-45de-98f5-1c6fb76aaa8b tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:53.340401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5a6-5b69-45de-98f5-1c6fb76aaa8b tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:53.343435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5a6-5b69-45de-98f5-1c6fb76aaa8b tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:53.344752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cdb1b5a6-5b69-45de-98f5-1c6fb76aaa8b tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:53.427238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1aa57fb3-915e-4f97-b753-c296451ad263 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:53.437164 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1aa57fb3-915e-4f97-b753-c296451ad263 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1367 microversion: 2.1 time: 0.868047 Aug 04 14:22:53.446302 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2488/4962] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:52 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1367 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:53.993462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cdb1b5a6-5b69-45de-98f5-1c6fb76aaa8b tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:54.012131 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cdb1b5a6-5b69-45de-98f5-1c6fb76aaa8b tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1307 microversion: 2.1 time: 0.709528 Aug 04 14:22:54.013261 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2475/4963] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:53 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1307 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:54.338632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-25ef37ad-1c99-4b5b-830d-5f98a5737ee3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:54.339636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-25ef37ad-1c99-4b5b-830d-5f98a5737ee3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:54.344913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:54.361804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25ef37ad-1c99-4b5b-830d-5f98a5737ee3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:54.361804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25ef37ad-1c99-4b5b-830d-5f98a5737ee3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:54.363684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25ef37ad-1c99-4b5b-830d-5f98a5737ee3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:54.364668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25ef37ad-1c99-4b5b-830d-5f98a5737ee3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:54.463579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51d43b0d-3490-4aec-b881-4369c1ac618a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:54.464390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-51d43b0d-3490-4aec-b881-4369c1ac618a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:54.493191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:54.502500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51d43b0d-3490-4aec-b881-4369c1ac618a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:54.503194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51d43b0d-3490-4aec-b881-4369c1ac618a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:54.506170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51d43b0d-3490-4aec-b881-4369c1ac618a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:54.506832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51d43b0d-3490-4aec-b881-4369c1ac618a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:55.287325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-25ef37ad-1c99-4b5b-830d-5f98a5737ee3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:55.301031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-51d43b0d-3490-4aec-b881-4369c1ac618a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:55.313970 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-25ef37ad-1c99-4b5b-830d-5f98a5737ee3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1315 microversion: 2.1 time: 0.980328 Aug 04 14:22:55.314325 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-51d43b0d-3490-4aec-b881-4369c1ac618a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1367 microversion: 2.1 time: 0.855243 Aug 04 14:22:55.314971 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2476/4964] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:54 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1367 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:55.333211 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2489/4965] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:54 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:55.336657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13fba41e-f1ec-44d7-a545-46ce3c486d02 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:55.338078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13fba41e-f1ec-44d7-a545-46ce3c486d02 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:55.339867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-765cfa57-b45e-40cb-b7c0-3276b9e59722 req-799b8b28-bbc6-4b8a-807c-055f262d15c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b674f7bb-a83a-4eb5-9f9d-bcca0740b251", "name": "network-vif-plugged", "status": "completed", "tag": "8248b82d-db83-41f2-96f5-341d876f60ea"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:55.370650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13fba41e-f1ec-44d7-a545-46ce3c486d02 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:55.370650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13fba41e-f1ec-44d7-a545-46ce3c486d02 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:55.370650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13fba41e-f1ec-44d7-a545-46ce3c486d02 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:55.370650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13fba41e-f1ec-44d7-a545-46ce3c486d02 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:55.378311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-765cfa57-b45e-40cb-b7c0-3276b9e59722 req-799b8b28-bbc6-4b8a-807c-055f262d15c2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:55.381572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-765cfa57-b45e-40cb-b7c0-3276b9e59722 req-799b8b28-bbc6-4b8a-807c-055f262d15c2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:55.458619 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-765cfa57-b45e-40cb-b7c0-3276b9e59722 req-799b8b28-bbc6-4b8a-807c-055f262d15c2 service nova] Creating event network-vif-plugged:8248b82d-db83-41f2-96f5-341d876f60ea for instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 on n-h2-844627-10 Aug 04 14:22:55.486034 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-765cfa57-b45e-40cb-b7c0-3276b9e59722 req-799b8b28-bbc6-4b8a-807c-055f262d15c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150415 Aug 04 14:22:55.488042 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2490/4966] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:56.082119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-597508925", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "ee60847c-2b65-4918-9e97-a0ad01eafa82"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:56.230911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] validate_networks() for [('ee60847c-2b65-4918-9e97-a0ad01eafa82', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:22:56.567779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-13fba41e-f1ec-44d7-a545-46ce3c486d02 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:56.585694 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13fba41e-f1ec-44d7-a545-46ce3c486d02 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 1.269610 Aug 04 14:22:56.586820 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2477/4967] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:55 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:56.591554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-272bce0c-814d-494b-9cc7-16e2be41b5dc req-69cd2f46-00cd-4a5d-be58-b6db49b45ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b", "tag": "688a69e0-ad1b-4bf0-b7d0-abe23e04c91e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:56.619047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-272bce0c-814d-494b-9cc7-16e2be41b5dc req-69cd2f46-00cd-4a5d-be58-b6db49b45ecc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:56.619758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-272bce0c-814d-494b-9cc7-16e2be41b5dc req-69cd2f46-00cd-4a5d-be58-b6db49b45ecc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:56.645079 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-272bce0c-814d-494b-9cc7-16e2be41b5dc req-69cd2f46-00cd-4a5d-be58-b6db49b45ecc service nova] Creating event network-changed:688a69e0-ad1b-4bf0-b7d0-abe23e04c91e for instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b on n-h1-844627-10 Aug 04 14:22:56.657875 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-272bce0c-814d-494b-9cc7-16e2be41b5dc req-69cd2f46-00cd-4a5d-be58-b6db49b45ecc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069619 Aug 04 14:22:56.658740 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2478/4968] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:56.664486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-53236cbc-4e89-4d8a-af09-13246d98cdbf tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:56.666003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-53236cbc-4e89-4d8a-af09-13246d98cdbf tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:56.682871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53236cbc-4e89-4d8a-af09-13246d98cdbf tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:56.683293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53236cbc-4e89-4d8a-af09-13246d98cdbf tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:56.684109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53236cbc-4e89-4d8a-af09-13246d98cdbf tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:56.684571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53236cbc-4e89-4d8a-af09-13246d98cdbf tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:57.267826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-53236cbc-4e89-4d8a-af09-13246d98cdbf tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:57.282321 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-53236cbc-4e89-4d8a-af09-13246d98cdbf tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1367 microversion: 2.1 time: 0.621970 Aug 04 14:22:57.301283 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2479/4969] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:56 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1367 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:57.314499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-50f66616-b741-4f1e-a549-8ce394ae0183 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:57.315106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-50f66616-b741-4f1e-a549-8ce394ae0183 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:57.330523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50f66616-b741-4f1e-a549-8ce394ae0183 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:57.330991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50f66616-b741-4f1e-a549-8ce394ae0183 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:57.331818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50f66616-b741-4f1e-a549-8ce394ae0183 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:57.332280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-50f66616-b741-4f1e-a549-8ce394ae0183 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:58.572118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-50f66616-b741-4f1e-a549-8ce394ae0183 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:58.593787 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-50f66616-b741-4f1e-a549-8ce394ae0183 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1315 microversion: 2.1 time: 1.291231 Aug 04 14:22:58.594385 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2480/4970] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:57 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1315 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:58.605504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1b3b6d73-255b-4742-b771-b7ae8b1f78f3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:58.612604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b3b6d73-255b-4742-b771-b7ae8b1f78f3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:58.631045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b3b6d73-255b-4742-b771-b7ae8b1f78f3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:58.631672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b3b6d73-255b-4742-b771-b7ae8b1f78f3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:58.632765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b3b6d73-255b-4742-b771-b7ae8b1f78f3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:58.640705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b3b6d73-255b-4742-b771-b7ae8b1f78f3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:59.309694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:22:59.310850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:22:59.311500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:22:59.312160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:22:59.313194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:22:59.331328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:59.332450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:59.333819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:59.334526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:59.390684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b3b6d73-255b-4742-b771-b7ae8b1f78f3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:59.396543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Getting quotas for project 0454122f542643889f0b402c246c296c. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:22:59.408173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Getting quotas for user 99d92a052e27400a823afcc40d426f51 and project 0454122f542643889f0b402c246c296c. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:22:59.424887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:22:59.428353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:22:59.451736 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1b3b6d73-255b-4742-b771-b7ae8b1f78f3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 0.849133 Aug 04 14:22:59.470398 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2481/4971] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:58 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:59.499554 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d9943f15-ee35-43d8-9517-8973e04ba686 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.816506 Aug 04 14:22:59.500697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84414e3e-2065-4d4c-b353-96c9a44b87be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:59.501614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84414e3e-2065-4d4c-b353-96c9a44b87be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:59.505065 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2491/4972] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:22:59.515223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0c268e89-3cd5-4b4c-87f9-36de06fffbce req-cf419162-86c0-4b26-82e4-ff73f7097df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca9cba7f-359b-4431-acc3-5ac483f57d70", "tag": "95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:22:59.527053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84414e3e-2065-4d4c-b353-96c9a44b87be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:59.528244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84414e3e-2065-4d4c-b353-96c9a44b87be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:59.530063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84414e3e-2065-4d4c-b353-96c9a44b87be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:59.531425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84414e3e-2065-4d4c-b353-96c9a44b87be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:59.578233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0c268e89-3cd5-4b4c-87f9-36de06fffbce req-cf419162-86c0-4b26-82e4-ff73f7097df2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:22:59.579213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0c268e89-3cd5-4b4c-87f9-36de06fffbce req-cf419162-86c0-4b26-82e4-ff73f7097df2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:22:59.614760 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0c268e89-3cd5-4b4c-87f9-36de06fffbce req-cf419162-86c0-4b26-82e4-ff73f7097df2 service nova] Creating event network-changed:95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90 for instance ca9cba7f-359b-4431-acc3-5ac483f57d70 on n-h1-844627-10 Aug 04 14:22:59.642726 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0c268e89-3cd5-4b4c-87f9-36de06fffbce req-cf419162-86c0-4b26-82e4-ff73f7097df2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135487 Aug 04 14:22:59.644502 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2492/4973] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:22:59.666762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-071c4abd-32af-44cc-a40c-df98418b3135 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:59.668563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-071c4abd-32af-44cc-a40c-df98418b3135 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:22:59.693788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:22:59.929598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-071c4abd-32af-44cc-a40c-df98418b3135 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:22:59.954920 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-071c4abd-32af-44cc-a40c-df98418b3135 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1224 microversion: 2.1 time: 0.308444 Aug 04 14:22:59.977298 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2493/4974] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:59 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1224 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:22:59.977298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f51d8345-403c-494a-b332-3d87254876c6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:22:59.977298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f51d8345-403c-494a-b332-3d87254876c6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:00.004750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f51d8345-403c-494a-b332-3d87254876c6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:00.013560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f51d8345-403c-494a-b332-3d87254876c6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:00.014832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f51d8345-403c-494a-b332-3d87254876c6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:00.015778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f51d8345-403c-494a-b332-3d87254876c6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:00.648248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84414e3e-2065-4d4c-b353-96c9a44b87be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:00.689991 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84414e3e-2065-4d4c-b353-96c9a44b87be tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1557 microversion: 2.1 time: 1.216614 Aug 04 14:23:00.691108 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2482/4975] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:59 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1557 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:00.730569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d6db26ee-4b4a-4c83-bf3c-d3b7e43f3c66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:00.732208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d6db26ee-4b4a-4c83-bf3c-d3b7e43f3c66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:00.742293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=14 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:00.766181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6db26ee-4b4a-4c83-bf3c-d3b7e43f3c66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:00.770982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6db26ee-4b4a-4c83-bf3c-d3b7e43f3c66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:00.773477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6db26ee-4b4a-4c83-bf3c-d3b7e43f3c66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:00.774680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6db26ee-4b4a-4c83-bf3c-d3b7e43f3c66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:00.946687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f51d8345-403c-494a-b332-3d87254876c6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:00.982742 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f51d8345-403c-494a-b332-3d87254876c6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1315 microversion: 2.1 time: 1.014614 Aug 04 14:23:01.001414 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2494/4976] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:22:59 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:01.034359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da89f91e-b79a-40ed-b9ba-ba6c93c261bc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:01.036616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-da89f91e-b79a-40ed-b9ba-ba6c93c261bc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:01.069344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da89f91e-b79a-40ed-b9ba-ba6c93c261bc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:01.070824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da89f91e-b79a-40ed-b9ba-ba6c93c261bc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:01.075550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da89f91e-b79a-40ed-b9ba-ba6c93c261bc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:01.077236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da89f91e-b79a-40ed-b9ba-ba6c93c261bc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:02.208809 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-da89f91e-b79a-40ed-b9ba-ba6c93c261bc tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.205013 Aug 04 14:23:02.215670 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2495/4977] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:23:01 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-interface => generated 284 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:02.244120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d9af1e5a-fb96-4def-b7ab-fff07879e7bb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:02.252568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d6db26ee-4b4a-4c83-bf3c-d3b7e43f3c66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:02.264627 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d6db26ee-4b4a-4c83-bf3c-d3b7e43f3c66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 1.571986 Aug 04 14:23:02.270098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d9af1e5a-fb96-4def-b7ab-fff07879e7bb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:02.280562 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2483/4978] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:00 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:02.293945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b7ae6664-5c93-4f8f-9bf1-e26742c05a3b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:02.297629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9af1e5a-fb96-4def-b7ab-fff07879e7bb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:02.297808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b7ae6664-5c93-4f8f-9bf1-e26742c05a3b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:02.298222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9af1e5a-fb96-4def-b7ab-fff07879e7bb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:02.299465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9af1e5a-fb96-4def-b7ab-fff07879e7bb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:02.301862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9af1e5a-fb96-4def-b7ab-fff07879e7bb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:02.312383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7ae6664-5c93-4f8f-9bf1-e26742c05a3b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:02.317593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7ae6664-5c93-4f8f-9bf1-e26742c05a3b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:02.319356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7ae6664-5c93-4f8f-9bf1-e26742c05a3b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:02.324287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7ae6664-5c93-4f8f-9bf1-e26742c05a3b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:02.696052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d9af1e5a-fb96-4def-b7ab-fff07879e7bb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:02.731066 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d9af1e5a-fb96-4def-b7ab-fff07879e7bb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1282 microversion: 2.1 time: 0.502959 Aug 04 14:23:02.733292 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2496/4979] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:02 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1282 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:03.025545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7ae6664-5c93-4f8f-9bf1-e26742c05a3b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:03.044001 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b7ae6664-5c93-4f8f-9bf1-e26742c05a3b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1315 microversion: 2.1 time: 0.761864 Aug 04 14:23:03.047780 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2484/4980] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:02 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:03.302733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9ed35a2e-d643-4cf6-be39-b7022eaff1f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:03.304501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9ed35a2e-d643-4cf6-be39-b7022eaff1f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:03.313755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ed35a2e-d643-4cf6-be39-b7022eaff1f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:03.314707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ed35a2e-d643-4cf6-be39-b7022eaff1f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:03.316328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ed35a2e-d643-4cf6-be39-b7022eaff1f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:03.317458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ed35a2e-d643-4cf6-be39-b7022eaff1f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:03.761099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2fa249e7-ddbe-453e-b3ea-bca5b6a3fed9 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:03.762725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2fa249e7-ddbe-453e-b3ea-bca5b6a3fed9 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:03.773423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa249e7-ddbe-453e-b3ea-bca5b6a3fed9 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:03.774573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa249e7-ddbe-453e-b3ea-bca5b6a3fed9 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:03.775709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa249e7-ddbe-453e-b3ea-bca5b6a3fed9 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:03.776564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2fa249e7-ddbe-453e-b3ea-bca5b6a3fed9 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:04.231833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2fa249e7-ddbe-453e-b3ea-bca5b6a3fed9 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:04.263345 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2fa249e7-ddbe-453e-b3ea-bca5b6a3fed9 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1282 microversion: 2.1 time: 0.511188 Aug 04 14:23:04.268032 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2485/4981] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:03 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1282 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:04.279221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ca81ed0f-f3c6-456c-8792-f8f491dab954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:04.281173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ca81ed0f-f3c6-456c-8792-f8f491dab954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:04.296824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca81ed0f-f3c6-456c-8792-f8f491dab954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:04.298016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca81ed0f-f3c6-456c-8792-f8f491dab954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:04.299557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca81ed0f-f3c6-456c-8792-f8f491dab954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:04.300663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ca81ed0f-f3c6-456c-8792-f8f491dab954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:04.359970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ed35a2e-d643-4cf6-be39-b7022eaff1f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:04.399326 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9ed35a2e-d643-4cf6-be39-b7022eaff1f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 1.088637 Aug 04 14:23:04.417906 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2497/4982] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:03 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:04.843709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-39d6d3ba-1148-46e3-ae17-05bd3fab9899 req-117d14f5-e945-4864-a619-947ffbe52c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b674f7bb-a83a-4eb5-9f9d-bcca0740b251", "tag": "8248b82d-db83-41f2-96f5-341d876f60ea"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:04.863592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-39d6d3ba-1148-46e3-ae17-05bd3fab9899 req-117d14f5-e945-4864-a619-947ffbe52c19 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:04.864858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-39d6d3ba-1148-46e3-ae17-05bd3fab9899 req-117d14f5-e945-4864-a619-947ffbe52c19 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:04.895156 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-39d6d3ba-1148-46e3-ae17-05bd3fab9899 req-117d14f5-e945-4864-a619-947ffbe52c19 service nova] Creating event network-changed:8248b82d-db83-41f2-96f5-341d876f60ea for instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 on n-h2-844627-10 Aug 04 14:23:04.913797 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-39d6d3ba-1148-46e3-ae17-05bd3fab9899 req-117d14f5-e945-4864-a619-947ffbe52c19 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087429 Aug 04 14:23:04.915658 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2498/4983] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:05.291759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab4e027d-9361-40e3-8cf1-19c9ae1313cf tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:05.292483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ab4e027d-9361-40e3-8cf1-19c9ae1313cf tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:05.305333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab4e027d-9361-40e3-8cf1-19c9ae1313cf tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:05.305790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab4e027d-9361-40e3-8cf1-19c9ae1313cf tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:05.311880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab4e027d-9361-40e3-8cf1-19c9ae1313cf tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:05.312415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab4e027d-9361-40e3-8cf1-19c9ae1313cf tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:05.575731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ca81ed0f-f3c6-456c-8792-f8f491dab954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:05.585119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ab4e027d-9361-40e3-8cf1-19c9ae1313cf tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:05.588580 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ca81ed0f-f3c6-456c-8792-f8f491dab954 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1315 microversion: 2.1 time: 1.318130 Aug 04 14:23:05.601271 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab4e027d-9361-40e3-8cf1-19c9ae1313cf tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1282 microversion: 2.1 time: 0.308367 Aug 04 14:23:05.601271 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2499/4984] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:05 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1282 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:05.611539 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2486/4985] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:04 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1315 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:05.616495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-811261d0-bda3-4049-82d7-cf08010b91d1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:05.618075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-811261d0-bda3-4049-82d7-cf08010b91d1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:05.635591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-811261d0-bda3-4049-82d7-cf08010b91d1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:05.636283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-811261d0-bda3-4049-82d7-cf08010b91d1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:05.637358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-811261d0-bda3-4049-82d7-cf08010b91d1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:05.637973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-811261d0-bda3-4049-82d7-cf08010b91d1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:06.140179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-811261d0-bda3-4049-82d7-cf08010b91d1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:06.152892 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-811261d0-bda3-4049-82d7-cf08010b91d1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 0.552518 Aug 04 14:23:06.153538 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2500/4986] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:05 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:06.610593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c177386b-a23e-4de8-b107-8f41fb21f8aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:06.611459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c177386b-a23e-4de8-b107-8f41fb21f8aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:06.628845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b4e12b9-eba7-464b-ae6c-a42b41c0593c tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:06.629778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b4e12b9-eba7-464b-ae6c-a42b41c0593c tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:06.635676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c177386b-a23e-4de8-b107-8f41fb21f8aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:06.636137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c177386b-a23e-4de8-b107-8f41fb21f8aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:06.637147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c177386b-a23e-4de8-b107-8f41fb21f8aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:06.637595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c177386b-a23e-4de8-b107-8f41fb21f8aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:06.676558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b4e12b9-eba7-464b-ae6c-a42b41c0593c tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:06.687240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b4e12b9-eba7-464b-ae6c-a42b41c0593c tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:06.696491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b4e12b9-eba7-464b-ae6c-a42b41c0593c tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:06.698004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b4e12b9-eba7-464b-ae6c-a42b41c0593c tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:06.752802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:07.992304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c177386b-a23e-4de8-b107-8f41fb21f8aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:08.027315 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c177386b-a23e-4de8-b107-8f41fb21f8aa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1315 microversion: 2.1 time: 1.419657 Aug 04 14:23:08.032294 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2487/4987] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:06 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1315 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:08.047585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-d1deb04c-6f26-439d-bebb-455a8d263222 req-499e9486-3692-4673-8868-f8139e0177e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b", "name": "network-vif-plugged", "status": "completed", "tag": "688a69e0-ad1b-4bf0-b7d0-abe23e04c91e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:08.073787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d1deb04c-6f26-439d-bebb-455a8d263222 req-499e9486-3692-4673-8868-f8139e0177e3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:08.074849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d1deb04c-6f26-439d-bebb-455a8d263222 req-499e9486-3692-4673-8868-f8139e0177e3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:08.090386 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-d1deb04c-6f26-439d-bebb-455a8d263222 req-499e9486-3692-4673-8868-f8139e0177e3 service nova] Creating event network-vif-plugged:688a69e0-ad1b-4bf0-b7d0-abe23e04c91e for instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b on n-h1-844627-10 Aug 04 14:23:08.098620 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-d1deb04c-6f26-439d-bebb-455a8d263222 req-499e9486-3692-4673-8868-f8139e0177e3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063189 Aug 04 14:23:08.102574 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2488/4988] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:08.116598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3356395e-39c2-4762-97f2-cb350513f3c6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:08.117780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3356395e-39c2-4762-97f2-cb350513f3c6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:08.136280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3356395e-39c2-4762-97f2-cb350513f3c6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:08.139737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3356395e-39c2-4762-97f2-cb350513f3c6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:08.140970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3356395e-39c2-4762-97f2-cb350513f3c6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:08.142973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3356395e-39c2-4762-97f2-cb350513f3c6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:08.219007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b4e12b9-eba7-464b-ae6c-a42b41c0593c tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:08.240284 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b4e12b9-eba7-464b-ae6c-a42b41c0593c tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1324 microversion: 2.1 time: 1.616188 Aug 04 14:23:08.257711 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2501/4989] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:06 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1324 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:08.599521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3356395e-39c2-4762-97f2-cb350513f3c6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:08.610621 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3356395e-39c2-4762-97f2-cb350513f3c6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 0.506543 Aug 04 14:23:08.618058 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2489/4990] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:08 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:08.930005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d79a75ec-4907-4e9d-b793-68c1995bd1b1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'create', calling method: .version_select at 0x7f46f2f24af0>, body: {"keypair": {"name": "tempest-keypair-1731601807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfN5/f/D01WsqpDedyTNmBojjYaqR5mZEWS2AqaXYys9EpdxEC3CCVHcMO4V3sA6dhFPeW98mhM6IoUlfvIFo+eLQHIjTS6KLJ+nwQcFTyMdSNYG0hbpY2tMy/CVCTl1w=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:08.971504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d79a75ec-4907-4e9d-b793-68c1995bd1b1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Getting quotas for project f1974046389c4e9ebb504fef09c743e8. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:23:08.987369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d79a75ec-4907-4e9d-b793-68c1995bd1b1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Getting quotas for user b231e5922ccb4e119b8254841c0fe86e and project f1974046389c4e9ebb504fef09c743e8. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:23:09.045304 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d79a75ec-4907-4e9d-b793-68c1995bd1b1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.657154 Aug 04 14:23:09.057428 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2502/4991] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:23:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:09.061027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51b83651-7e53-4862-9be7-8bfb523c7417 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:09.061887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-51b83651-7e53-4862-9be7-8bfb523c7417 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:09.071050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51b83651-7e53-4862-9be7-8bfb523c7417 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:09.071959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51b83651-7e53-4862-9be7-8bfb523c7417 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:09.073049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51b83651-7e53-4862-9be7-8bfb523c7417 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:09.074671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51b83651-7e53-4862-9be7-8bfb523c7417 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:09.080647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:09.270137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b93ebc8-bd91-47e4-97c7-56772f372c93 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:09.271330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b93ebc8-bd91-47e4-97c7-56772f372c93 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:09.301636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b93ebc8-bd91-47e4-97c7-56772f372c93 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:09.302424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b93ebc8-bd91-47e4-97c7-56772f372c93 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:09.303782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b93ebc8-bd91-47e4-97c7-56772f372c93 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:09.305298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b93ebc8-bd91-47e4-97c7-56772f372c93 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:09.362168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:09.548073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-51b83651-7e53-4862-9be7-8bfb523c7417 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:09.558633 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-51b83651-7e53-4862-9be7-8bfb523c7417 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1315 microversion: 2.1 time: 0.502843 Aug 04 14:23:09.572703 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2490/4992] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:09 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:09.640023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b031cf59-3dd5-4e76-b3c7-8c11e0488729 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:09.640658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b031cf59-3dd5-4e76-b3c7-8c11e0488729 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:09.671305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b031cf59-3dd5-4e76-b3c7-8c11e0488729 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:09.674577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b031cf59-3dd5-4e76-b3c7-8c11e0488729 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:09.682211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b031cf59-3dd5-4e76-b3c7-8c11e0488729 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:09.683038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b031cf59-3dd5-4e76-b3c7-8c11e0488729 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:09.901632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b93ebc8-bd91-47e4-97c7-56772f372c93 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:09.947943 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b93ebc8-bd91-47e4-97c7-56772f372c93 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1324 microversion: 2.1 time: 0.683143 Aug 04 14:23:09.958336 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2503/4993] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:09 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1324 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:09.986055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-12011245-234a-4550-8fdd-5ea26129d89d req-70405dbb-394e-4593-abaa-7f7f4e9472d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3052d5-94cf-4b8b-9468-a8710b8ed0cb", "tag": "1e8b6fc6-2b45-4b37-b492-1922814c04b5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:10.058951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-12011245-234a-4550-8fdd-5ea26129d89d req-70405dbb-394e-4593-abaa-7f7f4e9472d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:10.059933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-12011245-234a-4550-8fdd-5ea26129d89d req-70405dbb-394e-4593-abaa-7f7f4e9472d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:10.898902 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-12011245-234a-4550-8fdd-5ea26129d89d req-70405dbb-394e-4593-abaa-7f7f4e9472d1 service nova] Creating event network-changed:1e8b6fc6-2b45-4b37-b492-1922814c04b5 for instance 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb on n-h2-844627-10 Aug 04 14:23:10.906832 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-12011245-234a-4550-8fdd-5ea26129d89d req-70405dbb-394e-4593-abaa-7f7f4e9472d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.942203 Aug 04 14:23:10.908047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2504/4994] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:10.915580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a88ee015-c9ac-4b54-ac6f-841e0e1d748e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:10.917352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a88ee015-c9ac-4b54-ac6f-841e0e1d748e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:10.925277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a88ee015-c9ac-4b54-ac6f-841e0e1d748e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:10.926010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a88ee015-c9ac-4b54-ac6f-841e0e1d748e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:10.927026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a88ee015-c9ac-4b54-ac6f-841e0e1d748e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:10.927650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a88ee015-c9ac-4b54-ac6f-841e0e1d748e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:11.452224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b031cf59-3dd5-4e76-b3c7-8c11e0488729 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:11.464672 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b031cf59-3dd5-4e76-b3c7-8c11e0488729 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 1.829038 Aug 04 14:23:11.466273 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2491/4995] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:09 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:11.483123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d60fc88-71d6-4c7b-b5da-6ad512475c58 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:11.485664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8d60fc88-71d6-4c7b-b5da-6ad512475c58 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:11.524572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d60fc88-71d6-4c7b-b5da-6ad512475c58 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:11.533362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d60fc88-71d6-4c7b-b5da-6ad512475c58 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:11.534583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d60fc88-71d6-4c7b-b5da-6ad512475c58 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:11.535629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d60fc88-71d6-4c7b-b5da-6ad512475c58 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:12.128855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a88ee015-c9ac-4b54-ac6f-841e0e1d748e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:12.148837 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a88ee015-c9ac-4b54-ac6f-841e0e1d748e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1502 microversion: 2.1 time: 1.231838 Aug 04 14:23:12.172201 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2505/4996] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:10 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1502 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:12.189804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0568fddb-b103-4b82-8bdf-c633af532573 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:12.190659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0568fddb-b103-4b82-8bdf-c633af532573 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:12.204175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0568fddb-b103-4b82-8bdf-c633af532573 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:12.204895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0568fddb-b103-4b82-8bdf-c633af532573 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:12.205943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0568fddb-b103-4b82-8bdf-c633af532573 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:12.206479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0568fddb-b103-4b82-8bdf-c633af532573 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:12.308334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d60fc88-71d6-4c7b-b5da-6ad512475c58 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:12.337029 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d60fc88-71d6-4c7b-b5da-6ad512475c58 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1324 microversion: 2.1 time: 0.868263 Aug 04 14:23:12.338134 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2492/4997] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:11 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1324 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:12.442792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2017176511", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ecb455b-0802-460a-8a57-2c8e424655e2"}], "security_groups": [{"name": "tempest-securitygroup--1880543717"}], "key_name": "tempest-keypair-1731601807", "user_data": "}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:12.510735 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0568fddb-b103-4b82-8bdf-c633af532573 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b/action" status: 202 len: 0 microversion: 2.1 time: 0.335932 Aug 04 14:23:12.512150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2506/4998] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:23:12 2022] POST /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:23:12.522005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1486a8c9-725e-4cdf-ad6b-0db2cabd68b6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:12.525489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1486a8c9-725e-4cdf-ad6b-0db2cabd68b6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:12.549771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1486a8c9-725e-4cdf-ad6b-0db2cabd68b6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:12.552402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1486a8c9-725e-4cdf-ad6b-0db2cabd68b6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:12.553868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1486a8c9-725e-4cdf-ad6b-0db2cabd68b6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:12.559477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1486a8c9-725e-4cdf-ad6b-0db2cabd68b6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:12.982113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] validate_networks() for [('8ecb455b-0802-460a-8a57-2c8e424655e2', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:23:13.150927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1486a8c9-725e-4cdf-ad6b-0db2cabd68b6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:13.164307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1486a8c9-725e-4cdf-ad6b-0db2cabd68b6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 0.650394 Aug 04 14:23:13.165502 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2507/4999] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:12 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:13.177803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-422460f7-5a2c-4b0b-a1fb-a10a32ea9957 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:13.188194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-422460f7-5a2c-4b0b-a1fb-a10a32ea9957 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:13.201454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-422460f7-5a2c-4b0b-a1fb-a10a32ea9957 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:13.201933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-422460f7-5a2c-4b0b-a1fb-a10a32ea9957 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:13.202744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-422460f7-5a2c-4b0b-a1fb-a10a32ea9957 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:13.203192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-422460f7-5a2c-4b0b-a1fb-a10a32ea9957 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:13.865444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-422460f7-5a2c-4b0b-a1fb-a10a32ea9957 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:13.899582 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-422460f7-5a2c-4b0b-a1fb-a10a32ea9957 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1487 microversion: 2.1 time: 0.726292 Aug 04 14:23:13.901169 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2508/5000] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:13 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1487 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:13.911302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f81f3335-33cc-49cf-8bc8-b875c2d1490d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:13.913492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f81f3335-33cc-49cf-8bc8-b875c2d1490d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:13.928284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81f3335-33cc-49cf-8bc8-b875c2d1490d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:13.930494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81f3335-33cc-49cf-8bc8-b875c2d1490d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:13.933152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81f3335-33cc-49cf-8bc8-b875c2d1490d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:13.934702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f81f3335-33cc-49cf-8bc8-b875c2d1490d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:14.445700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f81f3335-33cc-49cf-8bc8-b875c2d1490d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:14.448224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:23:14.448961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:23:14.449472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:23:14.449898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:23:14.450315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:23:14.456088 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f81f3335-33cc-49cf-8bc8-b875c2d1490d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1324 microversion: 2.1 time: 0.552406 Aug 04 14:23:14.457315 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2509/5001] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:13 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1324 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:14.463857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:14.464319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:14.465255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:14.465694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:14.470092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9fe30726-e2ee-4dcd-804c-bd54df980feb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:14.471375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9fe30726-e2ee-4dcd-804c-bd54df980feb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:14.483871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fe30726-e2ee-4dcd-804c-bd54df980feb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:14.485015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fe30726-e2ee-4dcd-804c-bd54df980feb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:14.486757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fe30726-e2ee-4dcd-804c-bd54df980feb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:14.487760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fe30726-e2ee-4dcd-804c-bd54df980feb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:14.502809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Getting quotas for project f1974046389c4e9ebb504fef09c743e8. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:23:14.512571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Getting quotas for user b231e5922ccb4e119b8254841c0fe86e and project f1974046389c4e9ebb504fef09c743e8. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:23:14.526136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-9fe30726-e2ee-4dcd-804c-bd54df980feb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lazy-loading 'flavor' on Instance uuid 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:23:14.533418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:23:14.536472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:23:14.619189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a50f3e6f-589f-47ba-892e-310776f01c6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.183464 Aug 04 14:23:14.625277 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2493/5002] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:23:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:23:14.639869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cc6eec29-8691-434f-ba96-1b29e0c45d7e req-fd8df7f3-158c-43e4-b88f-5d1543b1c15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9cba7f-359b-4431-acc3-5ac483f57d70", "name": "network-vif-plugged", "status": "completed", "tag": "95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:14.671673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cc6eec29-8691-434f-ba96-1b29e0c45d7e req-fd8df7f3-158c-43e4-b88f-5d1543b1c15e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:14.672196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cc6eec29-8691-434f-ba96-1b29e0c45d7e req-fd8df7f3-158c-43e4-b88f-5d1543b1c15e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:14.728166 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cc6eec29-8691-434f-ba96-1b29e0c45d7e req-fd8df7f3-158c-43e4-b88f-5d1543b1c15e service nova] Creating event network-vif-plugged:95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90 for instance ca9cba7f-359b-4431-acc3-5ac483f57d70 on n-h1-844627-10 Aug 04 14:23:14.744936 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cc6eec29-8691-434f-ba96-1b29e0c45d7e req-fd8df7f3-158c-43e4-b88f-5d1543b1c15e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114048 Aug 04 14:23:14.746362 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2494/5003] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:14.769517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-083145f1-fa83-4e73-80c0-9ae8a0971144 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:14.770373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-083145f1-fa83-4e73-80c0-9ae8a0971144 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:14.817879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-083145f1-fa83-4e73-80c0-9ae8a0971144 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:14.819404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-083145f1-fa83-4e73-80c0-9ae8a0971144 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:14.821388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-083145f1-fa83-4e73-80c0-9ae8a0971144 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:14.822232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-083145f1-fa83-4e73-80c0-9ae8a0971144 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:14.984761 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9fe30726-e2ee-4dcd-804c-bd54df980feb tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b/action" status: 202 len: 0 microversion: 2.1 time: 0.520921 Aug 04 14:23:14.987677 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2510/5004] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:23:14 2022] POST /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:23:15.001958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1d87d5e-d6f2-4383-82f4-28d1253ee553 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:15.004788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1d87d5e-d6f2-4383-82f4-28d1253ee553 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:15.823568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c1d87d5e-d6f2-4383-82f4-28d1253ee553 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:15.829487 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1d87d5e-d6f2-4383-82f4-28d1253ee553 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1238 microversion: 2.1 time: 0.836137 Aug 04 14:23:15.829487 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2511/5005] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:14 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1238 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:15.843995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a56762d5-16ef-404d-b138-8b210e497c1f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:15.844629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a56762d5-16ef-404d-b138-8b210e497c1f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:15.857317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a56762d5-16ef-404d-b138-8b210e497c1f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:15.857715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a56762d5-16ef-404d-b138-8b210e497c1f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:15.858464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a56762d5-16ef-404d-b138-8b210e497c1f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:15.858912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a56762d5-16ef-404d-b138-8b210e497c1f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:15.949558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-083145f1-fa83-4e73-80c0-9ae8a0971144 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:15.957825 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-083145f1-fa83-4e73-80c0-9ae8a0971144 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 1.209177 Aug 04 14:23:15.958416 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2495/5006] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:14 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:15.973866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c98bd88d-84b6-45e4-b5f9-7312e523619e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:15.975093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c98bd88d-84b6-45e4-b5f9-7312e523619e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:15.990601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c98bd88d-84b6-45e4-b5f9-7312e523619e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:15.992997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c98bd88d-84b6-45e4-b5f9-7312e523619e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:15.997660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c98bd88d-84b6-45e4-b5f9-7312e523619e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:15.998148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c98bd88d-84b6-45e4-b5f9-7312e523619e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:16.353511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c98bd88d-84b6-45e4-b5f9-7312e523619e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:16.367597 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c98bd88d-84b6-45e4-b5f9-7312e523619e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1324 microversion: 2.1 time: 0.404699 Aug 04 14:23:16.369887 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2496/5007] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:15 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:16.387805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a56762d5-16ef-404d-b138-8b210e497c1f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:16.415950 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a56762d5-16ef-404d-b138-8b210e497c1f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1493 microversion: 2.1 time: 0.587153 Aug 04 14:23:16.417797 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2512/5008] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:15 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1493 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:16.867950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5b706533-8f0b-42fc-91ca-1d108fe49f49 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:16.869351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b706533-8f0b-42fc-91ca-1d108fe49f49 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:16.883866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b706533-8f0b-42fc-91ca-1d108fe49f49 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:16.885176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b706533-8f0b-42fc-91ca-1d108fe49f49 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:16.887149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b706533-8f0b-42fc-91ca-1d108fe49f49 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:16.888313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b706533-8f0b-42fc-91ca-1d108fe49f49 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:17.005891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0456bc36-5d09-4f5f-a76e-161ef75adf14 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:17.006901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0456bc36-5d09-4f5f-a76e-161ef75adf14 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:17.009816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5b706533-8f0b-42fc-91ca-1d108fe49f49 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:17.026867 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5b706533-8f0b-42fc-91ca-1d108fe49f49 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1290 microversion: 2.1 time: 0.166575 Aug 04 14:23:17.027929 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2497/5009] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:16 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1290 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:17.065608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0456bc36-5d09-4f5f-a76e-161ef75adf14 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:17.067007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0456bc36-5d09-4f5f-a76e-161ef75adf14 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:17.069033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0456bc36-5d09-4f5f-a76e-161ef75adf14 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:17.071181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0456bc36-5d09-4f5f-a76e-161ef75adf14 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:17.319120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-81b07755-8b06-4968-84b6-71790377d4e9 req-b98d1e6b-ea3b-4da1-a996-60080107114d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3052d5-94cf-4b8b-9468-a8710b8ed0cb", "name": "network-vif-plugged", "status": "completed", "tag": "1e8b6fc6-2b45-4b37-b492-1922814c04b5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:17.329797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0456bc36-5d09-4f5f-a76e-161ef75adf14 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:17.340740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-81b07755-8b06-4968-84b6-71790377d4e9 req-b98d1e6b-ea3b-4da1-a996-60080107114d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:17.342112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-81b07755-8b06-4968-84b6-71790377d4e9 req-b98d1e6b-ea3b-4da1-a996-60080107114d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:17.361062 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0456bc36-5d09-4f5f-a76e-161ef75adf14 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1375 microversion: 2.1 time: 0.363718 Aug 04 14:23:17.362226 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2513/5010] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:16 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1375 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:17.369604 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-81b07755-8b06-4968-84b6-71790377d4e9 req-b98d1e6b-ea3b-4da1-a996-60080107114d service nova] Creating event network-vif-plugged:1e8b6fc6-2b45-4b37-b492-1922814c04b5 for instance 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb on n-h2-844627-10 Aug 04 14:23:17.380733 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-81b07755-8b06-4968-84b6-71790377d4e9 req-b98d1e6b-ea3b-4da1-a996-60080107114d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068273 Aug 04 14:23:17.383440 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2498/5011] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:17.409469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba628c63-4603-4602-ab03-352c5fc80800 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:17.410496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba628c63-4603-4602-ab03-352c5fc80800 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:17.433222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba628c63-4603-4602-ab03-352c5fc80800 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:17.434307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba628c63-4603-4602-ab03-352c5fc80800 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:17.435911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba628c63-4603-4602-ab03-352c5fc80800 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:17.441216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba628c63-4603-4602-ab03-352c5fc80800 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:17.447539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2f7c63dd-28ab-48c6-b72d-ae10a3712ae5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:17.450882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f7c63dd-28ab-48c6-b72d-ae10a3712ae5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:17.470721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f7c63dd-28ab-48c6-b72d-ae10a3712ae5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:17.485299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f7c63dd-28ab-48c6-b72d-ae10a3712ae5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:17.491728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f7c63dd-28ab-48c6-b72d-ae10a3712ae5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:17.493640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f7c63dd-28ab-48c6-b72d-ae10a3712ae5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:18.084447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba628c63-4603-4602-ab03-352c5fc80800 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:18.094330 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba628c63-4603-4602-ab03-352c5fc80800 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1324 microversion: 2.1 time: 0.690096 Aug 04 14:23:18.098229 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2514/5012] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:17 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1324 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:18.109698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5728f955-8d1a-4575-96c2-e7e509dff0da tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:18.123642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5728f955-8d1a-4575-96c2-e7e509dff0da tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:18.143654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5728f955-8d1a-4575-96c2-e7e509dff0da tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:18.155203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5728f955-8d1a-4575-96c2-e7e509dff0da tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:18.156413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5728f955-8d1a-4575-96c2-e7e509dff0da tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:18.164150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5728f955-8d1a-4575-96c2-e7e509dff0da tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:18.220946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2f7c63dd-28ab-48c6-b72d-ae10a3712ae5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:18.243301 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2f7c63dd-28ab-48c6-b72d-ae10a3712ae5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1514 microversion: 2.1 time: 0.805582 Aug 04 14:23:18.277042 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2499/5013] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:17 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1514 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:18.357123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5728f955-8d1a-4575-96c2-e7e509dff0da tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:18.370457 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5728f955-8d1a-4575-96c2-e7e509dff0da tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1308 microversion: 2.1 time: 0.266867 Aug 04 14:23:18.371697 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2515/5014] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:18 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:18.393783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d53ca925-abe5-487d-8f2e-9f4431c5b875 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:18.395601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d53ca925-abe5-487d-8f2e-9f4431c5b875 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:18.409387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d53ca925-abe5-487d-8f2e-9f4431c5b875 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:18.410532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d53ca925-abe5-487d-8f2e-9f4431c5b875 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:18.413161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d53ca925-abe5-487d-8f2e-9f4431c5b875 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:18.414575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d53ca925-abe5-487d-8f2e-9f4431c5b875 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:18.727031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d53ca925-abe5-487d-8f2e-9f4431c5b875 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:18.768301 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d53ca925-abe5-487d-8f2e-9f4431c5b875 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1548 microversion: 2.1 time: 0.387352 Aug 04 14:23:18.770552 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2500/5015] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:18 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1548 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:18.801702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77ce49be-33e4-4a6e-be94-f26ab64e6e15 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:18.802797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-77ce49be-33e4-4a6e-be94-f26ab64e6e15 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:18.831161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77ce49be-33e4-4a6e-be94-f26ab64e6e15 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:18.835055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77ce49be-33e4-4a6e-be94-f26ab64e6e15 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:18.840347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77ce49be-33e4-4a6e-be94-f26ab64e6e15 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:18.846966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77ce49be-33e4-4a6e-be94-f26ab64e6e15 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:19.172727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7106ad34-5163-4832-bffc-d269828219da tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:19.174280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7106ad34-5163-4832-bffc-d269828219da tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:19.189359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7106ad34-5163-4832-bffc-d269828219da tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:19.190818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7106ad34-5163-4832-bffc-d269828219da tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:19.193338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7106ad34-5163-4832-bffc-d269828219da tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:19.194790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7106ad34-5163-4832-bffc-d269828219da tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:19.227084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-77ce49be-33e4-4a6e-be94-f26ab64e6e15 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:19.249483 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-77ce49be-33e4-4a6e-be94-f26ab64e6e15 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1548 microversion: 2.1 time: 0.461028 Aug 04 14:23:19.251786 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2516/5016] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:18 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1548 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:19.307832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd5fd9af-c2d2-4f97-9e86-e7ecfc19ac6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:19.339264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bd5fd9af-c2d2-4f97-9e86-e7ecfc19ac6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:19.408367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd5fd9af-c2d2-4f97-9e86-e7ecfc19ac6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:19.409311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd5fd9af-c2d2-4f97-9e86-e7ecfc19ac6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:19.410465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd5fd9af-c2d2-4f97-9e86-e7ecfc19ac6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:19.411127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd5fd9af-c2d2-4f97-9e86-e7ecfc19ac6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:19.868324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd5fd9af-c2d2-4f97-9e86-e7ecfc19ac6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:19.872683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:19.888552 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd5fd9af-c2d2-4f97-9e86-e7ecfc19ac6c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1514 microversion: 2.1 time: 0.599518 Aug 04 14:23:19.889583 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2517/5017] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:19 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1514 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:19.901113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7106ad34-5163-4832-bffc-d269828219da tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:19.909237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2870d8da-6e52-41e5-b190-1a3f1e0bbb43 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:19.913146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2870d8da-6e52-41e5-b190-1a3f1e0bbb43 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:19.930976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2870d8da-6e52-41e5-b190-1a3f1e0bbb43 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:19.931410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2870d8da-6e52-41e5-b190-1a3f1e0bbb43 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:19.934008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7106ad34-5163-4832-bffc-d269828219da tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1324 microversion: 2.1 time: 0.803745 Aug 04 14:23:19.935066 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2501/5018] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:19 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1324 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:19.940017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2870d8da-6e52-41e5-b190-1a3f1e0bbb43 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:19.941115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2870d8da-6e52-41e5-b190-1a3f1e0bbb43 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:20.538518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2870d8da-6e52-41e5-b190-1a3f1e0bbb43 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:20.555933 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2870d8da-6e52-41e5-b190-1a3f1e0bbb43 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1364 microversion: 2.1 time: 0.660907 Aug 04 14:23:20.557826 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2518/5019] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:19 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1364 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:20.934446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-328ea49d-a664-4689-8246-7cb4f01dd75d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:20.935546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-328ea49d-a664-4689-8246-7cb4f01dd75d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:20.951314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-328ea49d-a664-4689-8246-7cb4f01dd75d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:20.952142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-328ea49d-a664-4689-8246-7cb4f01dd75d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:20.953732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-328ea49d-a664-4689-8246-7cb4f01dd75d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:20.954526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-328ea49d-a664-4689-8246-7cb4f01dd75d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:20.966102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9ec155e5-9eb8-4651-b306-a817455294eb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:20.967223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9ec155e5-9eb8-4651-b306-a817455294eb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:20.987791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ec155e5-9eb8-4651-b306-a817455294eb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:20.989250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ec155e5-9eb8-4651-b306-a817455294eb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:20.990560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ec155e5-9eb8-4651-b306-a817455294eb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:20.991682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ec155e5-9eb8-4651-b306-a817455294eb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:21.454740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-328ea49d-a664-4689-8246-7cb4f01dd75d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:21.485777 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-328ea49d-a664-4689-8246-7cb4f01dd75d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1514 microversion: 2.1 time: 0.558271 Aug 04 14:23:21.485777 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2502/5020] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:20 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1514 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:21.563215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ec155e5-9eb8-4651-b306-a817455294eb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:21.580553 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9ec155e5-9eb8-4651-b306-a817455294eb tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1520 microversion: 2.1 time: 0.620793 Aug 04 14:23:21.584496 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2519/5021] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:20 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1520 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:21.625948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c050ead-5257-428b-a023-1bcff709633a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:21.630706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c050ead-5257-428b-a023-1bcff709633a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:21.646465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:21.647436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:21.670420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c050ead-5257-428b-a023-1bcff709633a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:21.671304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c050ead-5257-428b-a023-1bcff709633a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:21.672693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c050ead-5257-428b-a023-1bcff709633a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:21.673771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c050ead-5257-428b-a023-1bcff709633a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:21.694247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:21.694790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:21.698267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:21.698734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:21.771112 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] HTTP exception thrown: Action 999 not found Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Request method failure captured: Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb/os-instance-actions/999 HTTP/1.1 Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Y_oVk_ACzXrnJfuaGwULAy0BoIU9ufxTgJ6T8oA0Jwkyg9VAOR80vgvsyRH1UsLbWPa48YAri9BG6h5q_yLkOXeLNmX-I0pRm8smFjLOBH1v-JGAvZ12_sXZjxmMoPL5UxuWdnJsfER-Fd-tE-44V9v4BrFdlHFcyaGUsEsc3xKmE Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 0454122f542643889f0b402c246c296c Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-185127128 Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0454122f542643889f0b402c246c296c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0454122f542643889f0b402c246c296c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0454122f542643889f0b402c246c296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0454122f542643889f0b402c246c296c"}]}] Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-185127128 Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 0454122f542643889f0b402c246c296c Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-185127128 Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-InstanceActionsNegativeTestJSON-185127128-project Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 99d92a052e27400a823afcc40d426f51 Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-185127128-project Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: exception: Action 999 not found Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'server_id': '1f3052d5-94cf-4b8b-9468-a8710b8ed0cb', 'id': '999'} Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 04 14:23:21.782382 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:21.790783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Returning 404 to user: Action 999 not found {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:23:21.791741 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7051d216-a67e-4466-86f8-57181be86419 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.181121 Aug 04 14:23:21.798599 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2520/5022] 10.222.0.66 () {58 vars in 1308 bytes} [Thu Aug 4 14:23:21 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb/os-instance-actions/999 => generated 66 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 14:23:21.813666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b114784-c391-445b-a122-95c846a9119d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '.version_select at 0x7f46f300f4c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:21.814347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b114784-c391-445b-a122-95c846a9119d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 809833d6-7f21-4024-abe8-e8e35ce7638c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:21.827865 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-8b114784-c391-445b-a122-95c846a9119d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] HTTP exception thrown: Instance 809833d6-7f21-4024-abe8-e8e35ce7638c could not be found. Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b114784-c391-445b-a122-95c846a9119d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Request method failure captured: Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/809833d6-7f21-4024-abe8-e8e35ce7638c/os-instance-actions HTTP/1.1 Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69Y_oVk_ACzXrnJfuaGwULAy0BoIU9ufxTgJ6T8oA0Jwkyg9VAOR80vgvsyRH1UsLbWPa48YAri9BG6h5q_yLkOXeLNmX-I0pRm8smFjLOBH1v-JGAvZ12_sXZjxmMoPL5UxuWdnJsfER-Fd-tE-44V9v4BrFdlHFcyaGUsEsc3xKmE Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 0454122f542643889f0b402c246c296c Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-185127128 Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0454122f542643889f0b402c246c296c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0454122f542643889f0b402c246c296c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0454122f542643889f0b402c246c296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0454122f542643889f0b402c246c296c"}]}] Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-185127128 Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 0454122f542643889f0b402c246c296c Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-185127128 Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-InstanceActionsNegativeTestJSON-185127128-project Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 99d92a052e27400a823afcc40d426f51 Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-185127128-project Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 809833d6-7f21-4024-abe8-e8e35ce7638c could not be found. Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'server_id': '809833d6-7f21-4024-abe8-e8e35ce7638c'} Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 809833d6-7f21-4024-abe8-e8e35ce7638c could not be found. Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:23:21.831242 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 809833d6-7f21-4024-abe8-e8e35ce7638c could not be found. Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 809833d6-7f21-4024-abe8-e8e35ce7638c could not be found. Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b114784-c391-445b-a122-95c846a9119d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Returning 404 to user: Instance 809833d6-7f21-4024-abe8-e8e35ce7638c could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:23:21.836531 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b114784-c391-445b-a122-95c846a9119d tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/809833d6-7f21-4024-abe8-e8e35ce7638c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.034053 Aug 04 14:23:21.842594 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2521/5023] 10.222.0.66 () {58 vars in 1296 bytes} [Thu Aug 4 14:23:21 2022] GET /compute/v2.1/servers/809833d6-7f21-4024-abe8-e8e35ce7638c/os-instance-actions => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:23:21.853846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-58c44c9b-19fa-4540-9922-427783bc09aa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:21.854697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-58c44c9b-19fa-4540-9922-427783bc09aa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:21.872417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c44c9b-19fa-4540-9922-427783bc09aa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:21.873300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c44c9b-19fa-4540-9922-427783bc09aa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:21.874792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c44c9b-19fa-4540-9922-427783bc09aa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:21.875905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c44c9b-19fa-4540-9922-427783bc09aa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:21.945669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-58c44c9b-19fa-4540-9922-427783bc09aa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:23:22.126428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:22.132272 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-58c44c9b-19fa-4540-9922-427783bc09aa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 204 len: 0 microversion: 2.1 time: 0.287231 Aug 04 14:23:22.134323 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2522/5024] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:23:21 2022] DELETE /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:23:22.146585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-24e74bbc-2a1d-4112-b5d5-a5a2729a7389 req-8e24972d-89aa-4544-a910-034e7f7ed4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b", "name": "network-vif-plugged", "status": "completed", "tag": "688a69e0-ad1b-4bf0-b7d0-abe23e04c91e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:22.169225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-24e74bbc-2a1d-4112-b5d5-a5a2729a7389 req-8e24972d-89aa-4544-a910-034e7f7ed4f2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:22.171144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-24e74bbc-2a1d-4112-b5d5-a5a2729a7389 req-8e24972d-89aa-4544-a910-034e7f7ed4f2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:22.203415 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-24e74bbc-2a1d-4112-b5d5-a5a2729a7389 req-8e24972d-89aa-4544-a910-034e7f7ed4f2 service nova] Creating event network-vif-plugged:688a69e0-ad1b-4bf0-b7d0-abe23e04c91e for instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b on n-h1-844627-10 Aug 04 14:23:22.215458 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-24e74bbc-2a1d-4112-b5d5-a5a2729a7389 req-8e24972d-89aa-4544-a910-034e7f7ed4f2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077612 Aug 04 14:23:22.216668 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2523/5025] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:22.227475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6023c734-9a12-494b-b6f6-de7d10833cd0 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:22.228630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6023c734-9a12-494b-b6f6-de7d10833cd0 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:22.243280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6023c734-9a12-494b-b6f6-de7d10833cd0 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:22.244105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6023c734-9a12-494b-b6f6-de7d10833cd0 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:22.245565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6023c734-9a12-494b-b6f6-de7d10833cd0 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:22.246403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6023c734-9a12-494b-b6f6-de7d10833cd0 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:22.262258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c050ead-5257-428b-a023-1bcff709633a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:22.275811 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c050ead-5257-428b-a023-1bcff709633a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1364 microversion: 2.1 time: 0.686623 Aug 04 14:23:22.278522 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2503/5026] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:21 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1364 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:22.522687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d3a940f8-353c-4eed-8af4-890f3eefa9d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:22.524533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d3a940f8-353c-4eed-8af4-890f3eefa9d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:22.548077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3a940f8-353c-4eed-8af4-890f3eefa9d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:22.553400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3a940f8-353c-4eed-8af4-890f3eefa9d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:22.557449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3a940f8-353c-4eed-8af4-890f3eefa9d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:22.561469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3a940f8-353c-4eed-8af4-890f3eefa9d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:22.729816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6023c734-9a12-494b-b6f6-de7d10833cd0 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:22.745544 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6023c734-9a12-494b-b6f6-de7d10833cd0 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1526 microversion: 2.1 time: 0.526355 Aug 04 14:23:22.747441 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2524/5027] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:22 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1526 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:23.003862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-c9fce305-3cd6-437a-b195-f59fbc8ce245 req-d0139cd6-07bf-49fd-98f1-4b17cb74c548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d11d60d0-a4c4-4d98-8a2a-d504dc959fd5", "tag": "22c7a006-7d5f-4fe5-8105-96290a57a1be"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:23.020157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c9fce305-3cd6-437a-b195-f59fbc8ce245 req-d0139cd6-07bf-49fd-98f1-4b17cb74c548 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:23.035724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-c9fce305-3cd6-437a-b195-f59fbc8ce245 req-d0139cd6-07bf-49fd-98f1-4b17cb74c548 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:23.060131 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-c9fce305-3cd6-437a-b195-f59fbc8ce245 req-d0139cd6-07bf-49fd-98f1-4b17cb74c548 service nova] Creating event network-changed:22c7a006-7d5f-4fe5-8105-96290a57a1be for instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 on n-h1-844627-10 Aug 04 14:23:23.067164 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-c9fce305-3cd6-437a-b195-f59fbc8ce245 req-d0139cd6-07bf-49fd-98f1-4b17cb74c548 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078081 Aug 04 14:23:23.068211 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2525/5028] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:23:23.179884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d3a940f8-353c-4eed-8af4-890f3eefa9d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:23.221428 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d3a940f8-353c-4eed-8af4-890f3eefa9d3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 0.704452 Aug 04 14:23:23.224569 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2504/5029] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:22 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:23.312578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b7571429-3ccc-4da5-be65-3048ed025299 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:23.313345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b7571429-3ccc-4da5-be65-3048ed025299 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:23.324842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7571429-3ccc-4da5-be65-3048ed025299 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:23.325239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7571429-3ccc-4da5-be65-3048ed025299 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:23.326062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7571429-3ccc-4da5-be65-3048ed025299 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:23.326516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7571429-3ccc-4da5-be65-3048ed025299 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:23.785853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-24f1fd40-aedc-4c29-9ff3-3ffb7813fc9e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:23.787175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-24f1fd40-aedc-4c29-9ff3-3ffb7813fc9e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:23.813022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24f1fd40-aedc-4c29-9ff3-3ffb7813fc9e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:23.813845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24f1fd40-aedc-4c29-9ff3-3ffb7813fc9e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:23.825266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24f1fd40-aedc-4c29-9ff3-3ffb7813fc9e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:23.833670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24f1fd40-aedc-4c29-9ff3-3ffb7813fc9e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:23.894189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b7571429-3ccc-4da5-be65-3048ed025299 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:23.905054 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b7571429-3ccc-4da5-be65-3048ed025299 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1364 microversion: 2.1 time: 0.598109 Aug 04 14:23:23.917541 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2526/5030] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:23 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1364 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:24.265818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-702a1df9-2c42-4ffa-a3be-5013e2bb332f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:24.266452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-702a1df9-2c42-4ffa-a3be-5013e2bb332f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:24.289611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-702a1df9-2c42-4ffa-a3be-5013e2bb332f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:24.291021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-702a1df9-2c42-4ffa-a3be-5013e2bb332f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:24.292271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-702a1df9-2c42-4ffa-a3be-5013e2bb332f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:24.297725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-702a1df9-2c42-4ffa-a3be-5013e2bb332f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:24.488210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:24.522606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:24.618487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-24f1fd40-aedc-4c29-9ff3-3ffb7813fc9e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:24.628505 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-24f1fd40-aedc-4c29-9ff3-3ffb7813fc9e tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1526 microversion: 2.1 time: 0.851729 Aug 04 14:23:24.631281 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2505/5031] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:23 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1526 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:24.639765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c93d5524-027e-480c-b92a-97657b997ce9 req-c763bc4c-ed6c-4d6a-a8fc-59193ff6700d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca9cba7f-359b-4431-acc3-5ac483f57d70", "tag": "95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:24.661904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:24.688784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c93d5524-027e-480c-b92a-97657b997ce9 req-c763bc4c-ed6c-4d6a-a8fc-59193ff6700d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:24.691597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c93d5524-027e-480c-b92a-97657b997ce9 req-c763bc4c-ed6c-4d6a-a8fc-59193ff6700d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:24.731799 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c93d5524-027e-480c-b92a-97657b997ce9 req-c763bc4c-ed6c-4d6a-a8fc-59193ff6700d service nova] Creating event network-changed:95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90 for instance ca9cba7f-359b-4431-acc3-5ac483f57d70 on n-h1-844627-10 Aug 04 14:23:24.765092 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c93d5524-027e-480c-b92a-97657b997ce9 req-c763bc4c-ed6c-4d6a-a8fc-59193ff6700d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128986 Aug 04 14:23:24.765936 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2506/5032] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:24.951422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bfc628c2-65f0-42d6-8766-d1eeb66cc6b4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:24.952604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bfc628c2-65f0-42d6-8766-d1eeb66cc6b4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:24.969906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc628c2-65f0-42d6-8766-d1eeb66cc6b4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:24.970924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc628c2-65f0-42d6-8766-d1eeb66cc6b4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:24.972765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc628c2-65f0-42d6-8766-d1eeb66cc6b4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:24.973804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfc628c2-65f0-42d6-8766-d1eeb66cc6b4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:25.238253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-702a1df9-2c42-4ffa-a3be-5013e2bb332f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:25.259679 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-702a1df9-2c42-4ffa-a3be-5013e2bb332f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 0.998861 Aug 04 14:23:25.260305 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2527/5033] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:24 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:25.683400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86b62a29-1192-40b3-854a-1edff6baca13 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:25.688822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-86b62a29-1192-40b3-854a-1edff6baca13 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:25.727447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86b62a29-1192-40b3-854a-1edff6baca13 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:25.731466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86b62a29-1192-40b3-854a-1edff6baca13 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:25.737411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86b62a29-1192-40b3-854a-1edff6baca13 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:25.741286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86b62a29-1192-40b3-854a-1edff6baca13 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:25.858291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=14 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:25.878454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bfc628c2-65f0-42d6-8766-d1eeb66cc6b4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:25.942351 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bfc628c2-65f0-42d6-8766-d1eeb66cc6b4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1364 microversion: 2.1 time: 1.002805 Aug 04 14:23:25.943495 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2507/5034] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:24 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1364 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:26.302458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f50308b1-a316-4ce0-83aa-1920eda5b0ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:26.303444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f50308b1-a316-4ce0-83aa-1920eda5b0ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:26.321581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f50308b1-a316-4ce0-83aa-1920eda5b0ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:26.322225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f50308b1-a316-4ce0-83aa-1920eda5b0ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:26.323315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f50308b1-a316-4ce0-83aa-1920eda5b0ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:26.324053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f50308b1-a316-4ce0-83aa-1920eda5b0ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:27.134439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-86b62a29-1192-40b3-854a-1edff6baca13 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d92a052e27400a823afcc40d426f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0454122f542643889f0b402c246c296c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:27.164652 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86b62a29-1192-40b3-854a-1edff6baca13 tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 200 len: 1484 microversion: 2.1 time: 1.505083 Aug 04 14:23:27.193299 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2528/5035] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:25 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 1484 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:27.199099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-66e27da1-58a9-4a8a-aff4-af2024ae63f3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:27.204346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-66e27da1-58a9-4a8a-aff4-af2024ae63f3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:27.217211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66e27da1-58a9-4a8a-aff4-af2024ae63f3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:27.222288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66e27da1-58a9-4a8a-aff4-af2024ae63f3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:27.223673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66e27da1-58a9-4a8a-aff4-af2024ae63f3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:27.227044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66e27da1-58a9-4a8a-aff4-af2024ae63f3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:27.439164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f50308b1-a316-4ce0-83aa-1920eda5b0ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:27.452997 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f50308b1-a316-4ce0-83aa-1920eda5b0ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 1.152455 Aug 04 14:23:27.468910 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2508/5036] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:26 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:27.470033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-89db3682-bd8d-411d-8f55-68bb6df982ce req-1e4824c0-90ff-40ef-a71c-eb4c9ec770b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3052d5-94cf-4b8b-9468-a8710b8ed0cb", "name": "network-vif-deleted", "tag": "1e8b6fc6-2b45-4b37-b492-1922814c04b5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:27.527751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-89db3682-bd8d-411d-8f55-68bb6df982ce req-1e4824c0-90ff-40ef-a71c-eb4c9ec770b5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:27.529847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-89db3682-bd8d-411d-8f55-68bb6df982ce req-1e4824c0-90ff-40ef-a71c-eb4c9ec770b5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:27.584509 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-89db3682-bd8d-411d-8f55-68bb6df982ce req-1e4824c0-90ff-40ef-a71c-eb4c9ec770b5 service nova] Creating event network-vif-deleted:1e8b6fc6-2b45-4b37-b492-1922814c04b5 for instance 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb on n-h2-844627-10 Aug 04 14:23:27.603356 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-89db3682-bd8d-411d-8f55-68bb6df982ce req-1e4824c0-90ff-40ef-a71c-eb4c9ec770b5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145104 Aug 04 14:23:27.605017 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2509/5037] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:28.024347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-66e27da1-58a9-4a8a-aff4-af2024ae63f3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:28.034261 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-66e27da1-58a9-4a8a-aff4-af2024ae63f3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1364 microversion: 2.1 time: 0.839331 Aug 04 14:23:28.038353 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2529/5038] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:27 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1364 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:28.201590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:28.202353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] [instance: 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:28.218356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:28.226621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:28.227950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:28.232595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:28.246016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:28.271703 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] HTTP exception thrown: Instance 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb could not be found. Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Request method failure captured: Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb HTTP/1.1 Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69Y_oVk_ACzXrnJfuaGwULAy0BoIU9ufxTgJ6T8oA0Jwkyg9VAOR80vgvsyRH1UsLbWPa48YAri9BG6h5q_yLkOXeLNmX-I0pRm8smFjLOBH1v-JGAvZ12_sXZjxmMoPL5UxuWdnJsfER-Fd-tE-44V9v4BrFdlHFcyaGUsEsc3xKmE Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 0454122f542643889f0b402c246c296c Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-185127128 Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0454122f542643889f0b402c246c296c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0454122f542643889f0b402c246c296c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0454122f542643889f0b402c246c296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0454122f542643889f0b402c246c296c"}]}] Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-185127128 Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 0454122f542643889f0b402c246c296c Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-185127128 Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-InstanceActionsNegativeTestJSON-185127128-project Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 99d92a052e27400a823afcc40d426f51 Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-185127128-project Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb could not be found. Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '1f3052d5-94cf-4b8b-9468-a8710b8ed0cb'} Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb could not be found. Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb could not be found. Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:28.285086 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:28.294736 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:28.294736 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:28.294736 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:28.294736 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:28.294736 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:23:28.294736 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:23:28.294736 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb could not be found. Aug 04 14:23:28.294736 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:28.298198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] Returning 404 to user: Instance 1f3052d5-94cf-4b8b-9468-a8710b8ed0cb could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:23:28.300949 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cfd8b17e-8101-4b11-83e3-100a71a19cfa tempest-InstanceActionsNegativeTestJSON-185127128 tempest-InstanceActionsNegativeTestJSON-185127128-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb" status: 404 len: 111 microversion: 2.1 time: 0.104773 Aug 04 14:23:28.305558 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2510/5039] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:28 2022] GET /compute/v2.1/servers/1f3052d5-94cf-4b8b-9468-a8710b8ed0cb => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:23:28.495227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-614efab7-444e-4c88-9a18-6ffde6f8db88 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:28.500068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-614efab7-444e-4c88-9a18-6ffde6f8db88 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:28.536047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-614efab7-444e-4c88-9a18-6ffde6f8db88 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:28.537451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-614efab7-444e-4c88-9a18-6ffde6f8db88 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:28.539500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-614efab7-444e-4c88-9a18-6ffde6f8db88 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:28.540570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-614efab7-444e-4c88-9a18-6ffde6f8db88 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:29.058984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-60597d46-c23e-4946-acde-423ace040bfd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:29.059743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-60597d46-c23e-4946-acde-423ace040bfd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:29.069566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60597d46-c23e-4946-acde-423ace040bfd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:29.070563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60597d46-c23e-4946-acde-423ace040bfd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:29.071383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60597d46-c23e-4946-acde-423ace040bfd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:29.081737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60597d46-c23e-4946-acde-423ace040bfd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:29.421049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-614efab7-444e-4c88-9a18-6ffde6f8db88 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:29.465599 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-614efab7-444e-4c88-9a18-6ffde6f8db88 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 0.970407 Aug 04 14:23:29.474187 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2530/5040] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:28 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:29.787721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-60597d46-c23e-4946-acde-423ace040bfd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:29.801867 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-60597d46-c23e-4946-acde-423ace040bfd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1364 microversion: 2.1 time: 0.746996 Aug 04 14:23:29.802921 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2511/5041] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:29 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1364 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:30.495133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6a2e08d0-f4aa-40aa-b44a-1bbeedb471c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:30.496633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6a2e08d0-f4aa-40aa-b44a-1bbeedb471c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:30.513217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a2e08d0-f4aa-40aa-b44a-1bbeedb471c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:30.513688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a2e08d0-f4aa-40aa-b44a-1bbeedb471c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:30.514518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a2e08d0-f4aa-40aa-b44a-1bbeedb471c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:30.514968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a2e08d0-f4aa-40aa-b44a-1bbeedb471c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:30.823758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9736b82d-d012-4614-9215-1ef158806caf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:30.824417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9736b82d-d012-4614-9215-1ef158806caf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:30.842826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9736b82d-d012-4614-9215-1ef158806caf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:30.843354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9736b82d-d012-4614-9215-1ef158806caf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:30.852175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9736b82d-d012-4614-9215-1ef158806caf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:30.854623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9736b82d-d012-4614-9215-1ef158806caf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:31.691244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6a2e08d0-f4aa-40aa-b44a-1bbeedb471c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:31.706784 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6a2e08d0-f4aa-40aa-b44a-1bbeedb471c3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 1.216266 Aug 04 14:23:31.708184 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2531/5042] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:30 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:32.161355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b9bb4e31-b2f9-46ae-8cfe-ec384ee6ac54 req-ccfaad61-4bae-49e6-b513-fd3e029d4d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d11d60d0-a4c4-4d98-8a2a-d504dc959fd5", "name": "network-vif-plugged", "status": "completed", "tag": "22c7a006-7d5f-4fe5-8105-96290a57a1be"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:32.200816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b9bb4e31-b2f9-46ae-8cfe-ec384ee6ac54 req-ccfaad61-4bae-49e6-b513-fd3e029d4d2a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:32.201630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b9bb4e31-b2f9-46ae-8cfe-ec384ee6ac54 req-ccfaad61-4bae-49e6-b513-fd3e029d4d2a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:32.246461 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b9bb4e31-b2f9-46ae-8cfe-ec384ee6ac54 req-ccfaad61-4bae-49e6-b513-fd3e029d4d2a service nova] Creating event network-vif-plugged:22c7a006-7d5f-4fe5-8105-96290a57a1be for instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 on n-h1-844627-10 Aug 04 14:23:32.274742 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b9bb4e31-b2f9-46ae-8cfe-ec384ee6ac54 req-ccfaad61-4bae-49e6-b513-fd3e029d4d2a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108326 Aug 04 14:23:32.277975 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2532/5043] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:32.328135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9736b82d-d012-4614-9215-1ef158806caf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:32.342617 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9736b82d-d012-4614-9215-1ef158806caf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1364 microversion: 2.1 time: 1.519644 Aug 04 14:23:32.343656 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2512/5044] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:30 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1364 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:32.753787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e419542e-e374-4d5c-b7ae-b26e8b632db2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:32.755432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e419542e-e374-4d5c-b7ae-b26e8b632db2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:32.776288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e419542e-e374-4d5c-b7ae-b26e8b632db2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:32.778002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e419542e-e374-4d5c-b7ae-b26e8b632db2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:32.780964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e419542e-e374-4d5c-b7ae-b26e8b632db2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:32.781698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e419542e-e374-4d5c-b7ae-b26e8b632db2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:33.370259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d356d6d4-59e6-47d7-8ec5-698f2b913708 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:33.378546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d356d6d4-59e6-47d7-8ec5-698f2b913708 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:33.391511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e419542e-e374-4d5c-b7ae-b26e8b632db2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:33.404942 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e419542e-e374-4d5c-b7ae-b26e8b632db2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 0.657520 Aug 04 14:23:33.419449 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2533/5045] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:32 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:33.421724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d356d6d4-59e6-47d7-8ec5-698f2b913708 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:33.422998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d356d6d4-59e6-47d7-8ec5-698f2b913708 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:33.425302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d356d6d4-59e6-47d7-8ec5-698f2b913708 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:33.429541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d356d6d4-59e6-47d7-8ec5-698f2b913708 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:34.439007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d79795c-782d-4f69-9b53-8e38ef87b0be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:34.440730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2d79795c-782d-4f69-9b53-8e38ef87b0be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:34.461582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d356d6d4-59e6-47d7-8ec5-698f2b913708 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:34.467881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d79795c-782d-4f69-9b53-8e38ef87b0be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:34.473391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d79795c-782d-4f69-9b53-8e38ef87b0be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:34.476140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d79795c-782d-4f69-9b53-8e38ef87b0be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:34.478260 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d356d6d4-59e6-47d7-8ec5-698f2b913708 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1364 microversion: 2.1 time: 1.115767 Aug 04 14:23:34.478648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d79795c-782d-4f69-9b53-8e38ef87b0be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:34.497181 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2513/5046] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:33 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1364 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:34.802590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-583b9a4d-8fad-4dbc-8f01-7f2b88606fec tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:34.806003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-583b9a4d-8fad-4dbc-8f01-7f2b88606fec tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:34.845395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-583b9a4d-8fad-4dbc-8f01-7f2b88606fec tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:34.846309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-583b9a4d-8fad-4dbc-8f01-7f2b88606fec tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:34.848478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-583b9a4d-8fad-4dbc-8f01-7f2b88606fec tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:34.854143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-583b9a4d-8fad-4dbc-8f01-7f2b88606fec tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:34.905467 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-583b9a4d-8fad-4dbc-8f01-7f2b88606fec tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.109103 Aug 04 14:23:34.913842 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2514/5047] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 14:23:34 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:35.043041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-80feb8f7-af97-4cfc-a8f6-20e12a016b36 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:35.043995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-80feb8f7-af97-4cfc-a8f6-20e12a016b36 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:35.052743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80feb8f7-af97-4cfc-a8f6-20e12a016b36 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:35.053526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80feb8f7-af97-4cfc-a8f6-20e12a016b36 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:35.054597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80feb8f7-af97-4cfc-a8f6-20e12a016b36 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:35.055345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80feb8f7-af97-4cfc-a8f6-20e12a016b36 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:35.073865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2d79795c-782d-4f69-9b53-8e38ef87b0be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:35.089237 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2d79795c-782d-4f69-9b53-8e38ef87b0be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 0.660439 Aug 04 14:23:35.092924 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2534/5048] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:34 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:35.112939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-80feb8f7-af97-4cfc-a8f6-20e12a016b36 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:23:35.265324 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-80feb8f7-af97-4cfc-a8f6-20e12a016b36 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 204 len: 0 microversion: 2.20 time: 0.226304 Aug 04 14:23:35.269706 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2515/5049] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:23:35 2022] DELETE /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:23:35.279539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:35.281317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:35.292693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:35.293191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:35.294023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:35.294692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:35.533414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fccf3ed7-cd7c-4a0a-8ff1-0e440f6a1ba2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:35.535089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fccf3ed7-cd7c-4a0a-8ff1-0e440f6a1ba2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:35.560802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fccf3ed7-cd7c-4a0a-8ff1-0e440f6a1ba2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:35.563474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fccf3ed7-cd7c-4a0a-8ff1-0e440f6a1ba2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:35.576182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fccf3ed7-cd7c-4a0a-8ff1-0e440f6a1ba2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:35.578382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fccf3ed7-cd7c-4a0a-8ff1-0e440f6a1ba2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:35.918253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:35.922831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:35.938078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:35.940138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:35.941892 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5e4edbca-ba76-40fa-a231-0b76183f3c87 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 0.671030 Aug 04 14:23:35.945028 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2535/5050] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:35 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:23:36.083865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fccf3ed7-cd7c-4a0a-8ff1-0e440f6a1ba2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:36.106660 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fccf3ed7-cd7c-4a0a-8ff1-0e440f6a1ba2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1551 microversion: 2.1 time: 0.606227 Aug 04 14:23:36.122592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ec4ac516-9b37-4be7-8c82-e1d56a7e41f0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:36.123901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ec4ac516-9b37-4be7-8c82-e1d56a7e41f0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:36.125492 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2516/5051] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:35 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1551 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:36.176660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6aa4b581-ab08-417e-917a-41ce5537e701 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:36.179786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6aa4b581-ab08-417e-917a-41ce5537e701 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:36.191926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec4ac516-9b37-4be7-8c82-e1d56a7e41f0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:36.192825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec4ac516-9b37-4be7-8c82-e1d56a7e41f0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:36.194934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec4ac516-9b37-4be7-8c82-e1d56a7e41f0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:36.198044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ec4ac516-9b37-4be7-8c82-e1d56a7e41f0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:36.202199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6aa4b581-ab08-417e-917a-41ce5537e701 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:36.206154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6aa4b581-ab08-417e-917a-41ce5537e701 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:36.218564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6aa4b581-ab08-417e-917a-41ce5537e701 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:36.219483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6aa4b581-ab08-417e-917a-41ce5537e701 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:36.728988 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6aa4b581-ab08-417e-917a-41ce5537e701 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.573034 Aug 04 14:23:36.731544 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2517/5052] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:23:36 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/os-interface => generated 285 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:36.739760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dd6df490-62ae-4c11-af5e-b087657087a9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:36.747752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dd6df490-62ae-4c11-af5e-b087657087a9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:36.773843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd6df490-62ae-4c11-af5e-b087657087a9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:36.774904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd6df490-62ae-4c11-af5e-b087657087a9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:36.781279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd6df490-62ae-4c11-af5e-b087657087a9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:36.782202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd6df490-62ae-4c11-af5e-b087657087a9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:36.902014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dd6df490-62ae-4c11-af5e-b087657087a9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/ips" status: 200 len: 150 microversion: 2.1 time: 0.168368 Aug 04 14:23:36.914191 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2518/5053] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:23:36 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/ips => generated 150 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:36.992256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:37.002737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:37.033924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:37.035858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:37.038587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:37.039679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:38.336458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ec4ac516-9b37-4be7-8c82-e1d56a7e41f0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:38.354731 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ec4ac516-9b37-4be7-8c82-e1d56a7e41f0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 2.239865 Aug 04 14:23:38.356476 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2536/5054] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:36 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:39.398457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-598805ed-d559-4931-ab8d-f0e485cc5f1a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:39.401306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-598805ed-d559-4931-ab8d-f0e485cc5f1a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:39.442430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-598805ed-d559-4931-ab8d-f0e485cc5f1a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:39.442781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-598805ed-d559-4931-ab8d-f0e485cc5f1a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:39.447789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-598805ed-d559-4931-ab8d-f0e485cc5f1a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:39.449818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-598805ed-d559-4931-ab8d-f0e485cc5f1a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:40.049814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:40.063119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:40.065285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:40.077531 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9f88486f-5577-4516-bdc1-7db0f8cfa887 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 3.090882 Aug 04 14:23:40.078208 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2519/5055] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:36 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 3097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:23:40.323728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-598805ed-d559-4931-ab8d-f0e485cc5f1a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:40.353699 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-598805ed-d559-4931-ab8d-f0e485cc5f1a tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 0.961354 Aug 04 14:23:40.355288 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2537/5056] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:39 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:41.102152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:41.104171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:41.143452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:41.144266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:41.147040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:41.151230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:41.323963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8fab3a30-45cd-48b0-ab18-4151b940eb68 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23beaaa4-87c7-43ac-8afc-963ee589003f"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:41.327994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8fab3a30-45cd-48b0-ab18-4151b940eb68 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:41.337760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fab3a30-45cd-48b0-ab18-4151b940eb68 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:41.338529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fab3a30-45cd-48b0-ab18-4151b940eb68 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:41.339555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fab3a30-45cd-48b0-ab18-4151b940eb68 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:41.341766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fab3a30-45cd-48b0-ab18-4151b940eb68 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:42.004985 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8fab3a30-45cd-48b0-ab18-4151b940eb68 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "POST /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687245 Aug 04 14:23:42.019360 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2538/5057] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:23:41 2022] POST /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:23:42.041621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-127a8283-b16b-44f7-a9f9-0b0665f3d570 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:42.043912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-127a8283-b16b-44f7-a9f9-0b0665f3d570 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:42.067484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-127a8283-b16b-44f7-a9f9-0b0665f3d570 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:42.068280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-127a8283-b16b-44f7-a9f9-0b0665f3d570 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:42.074440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-127a8283-b16b-44f7-a9f9-0b0665f3d570 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:42.076339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-127a8283-b16b-44f7-a9f9-0b0665f3d570 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:43.146058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-127a8283-b16b-44f7-a9f9-0b0665f3d570 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:43.188502 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-127a8283-b16b-44f7-a9f9-0b0665f3d570 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 1.163672 Aug 04 14:23:43.189737 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2539/5058] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:42 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:43.255589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-16685edc-937f-4ad2-b12b-9d846c6e7f38 req-d5b7fd06-e3d5-413b-9c99-040a33628b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d980c4-8034-4898-83d5-bcc0ad62a973", "name": "network-vif-unplugged", "status": "completed", "tag": "10153aad-a7c0-4ba3-ae0d-2844ce1198a3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:43.329590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-16685edc-937f-4ad2-b12b-9d846c6e7f38 req-d5b7fd06-e3d5-413b-9c99-040a33628b67 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:43.337480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-16685edc-937f-4ad2-b12b-9d846c6e7f38 req-d5b7fd06-e3d5-413b-9c99-040a33628b67 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:43.431750 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-16685edc-937f-4ad2-b12b-9d846c6e7f38 req-d5b7fd06-e3d5-413b-9c99-040a33628b67 service nova] Creating event network-vif-unplugged:10153aad-a7c0-4ba3-ae0d-2844ce1198a3 for instance 44d980c4-8034-4898-83d5-bcc0ad62a973 on n-h1-844627-10 Aug 04 14:23:43.470888 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-16685edc-937f-4ad2-b12b-9d846c6e7f38 req-d5b7fd06-e3d5-413b-9c99-040a33628b67 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.278623 Aug 04 14:23:43.472112 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2540/5059] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:44.239962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d3701f9-813f-434c-8ff3-a71f27296872 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:44.246381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2d3701f9-813f-434c-8ff3-a71f27296872 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:44.288861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d3701f9-813f-434c-8ff3-a71f27296872 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:44.294489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d3701f9-813f-434c-8ff3-a71f27296872 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:44.304173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d3701f9-813f-434c-8ff3-a71f27296872 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:44.315874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d3701f9-813f-434c-8ff3-a71f27296872 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:44.833205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:44.866562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:44.870289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:44.873705 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-21f4d88e-ea7d-43cc-827f-0597a88e5611 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1722 microversion: 2.20 time: 3.775988 Aug 04 14:23:44.875946 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2520/5060] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:41 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1722 bytes in 3779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:23:45.849874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2d3701f9-813f-434c-8ff3-a71f27296872 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:45.896229 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2d3701f9-813f-434c-8ff3-a71f27296872 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 1.661170 Aug 04 14:23:45.900197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:45.901831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:45.922678 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2541/5061] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:44 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:45.954087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:45.956600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:45.962537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:45.963288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:46.309017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1086362050", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": "none"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:46.314639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:46.331967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:46.337213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:46.343275 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7873a50a-3020-43f4-88ff-fcdaf8f3ea29 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1655 microversion: 2.20 time: 0.447859 Aug 04 14:23:46.357636 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2521/5062] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:45 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1655 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:23:46.360304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c74e479f-2921-4409-82c1-adbb242720c6 req-42324bde-5c2b-481a-a086-a2076fa12f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d11d60d0-a4c4-4d98-8a2a-d504dc959fd5", "tag": "22c7a006-7d5f-4fe5-8105-96290a57a1be"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:46.401153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c74e479f-2921-4409-82c1-adbb242720c6 req-42324bde-5c2b-481a-a086-a2076fa12f5e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:46.405681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c74e479f-2921-4409-82c1-adbb242720c6 req-42324bde-5c2b-481a-a086-a2076fa12f5e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:46.463212 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c74e479f-2921-4409-82c1-adbb242720c6 req-42324bde-5c2b-481a-a086-a2076fa12f5e service nova] Creating event network-changed:22c7a006-7d5f-4fe5-8105-96290a57a1be for instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 on n-h1-844627-10 Aug 04 14:23:46.485796 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c74e479f-2921-4409-82c1-adbb242720c6 req-42324bde-5c2b-481a-a086-a2076fa12f5e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131541 Aug 04 14:23:46.486675 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2522/5063] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:46.545515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:23:46.546223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:23:46.547105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:23:46.547869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:23:46.548621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:23:46.616806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:46.637352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:46.638703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:46.644757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:46.766754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Getting quotas for project a57015c84b374f9e9668de714fad1505. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:23:46.780531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Getting quotas for user 57bd71bd5d474daea5bd118a85bce8d6 and project a57015c84b374f9e9668de714fad1505. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:23:46.836732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:23:46.843760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: da6a3ece-952b-40da-b633-99ebe095820e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:23:46.958783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b391eb7-103b-4054-8a41-81d3e83df19d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:46.960388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8b391eb7-103b-4054-8a41-81d3e83df19d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:47.013590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b391eb7-103b-4054-8a41-81d3e83df19d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:47.014987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b391eb7-103b-4054-8a41-81d3e83df19d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:47.023235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b391eb7-103b-4054-8a41-81d3e83df19d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:47.027233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b391eb7-103b-4054-8a41-81d3e83df19d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:47.097582 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-040af021-e114-4756-923c-0b967ef2fc5a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.142476 Aug 04 14:23:47.101054 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2542/5064] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:23:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:23:47.130714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-94a113c6-0a7e-4aef-a4f6-7ba37e794158 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:47.132512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-94a113c6-0a7e-4aef-a4f6-7ba37e794158 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: da6a3ece-952b-40da-b633-99ebe095820e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:47.343716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-94a113c6-0a7e-4aef-a4f6-7ba37e794158 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:47.362537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-94a113c6-0a7e-4aef-a4f6-7ba37e794158 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:47.364857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-94a113c6-0a7e-4aef-a4f6-7ba37e794158 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:47.366678 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-94a113c6-0a7e-4aef-a4f6-7ba37e794158 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e" status: 200 len: 1278 microversion: 2.47 time: 0.258205 Aug 04 14:23:47.369000 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2543/5065] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:47 2022] GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e => generated 1278 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:23:47.375702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:47.377627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:47.388341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:47.389746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:47.390925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:47.391638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:47.475960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:47.477229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:47.478360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lazy-loading 'fault' on Instance uuid 44d980c4-8034-4898-83d5-bcc0ad62a973 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:23:47.899889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:47.919266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:47.928507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be1de13158f1415e9fc93ab6fcf28b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3c60073acc4679bbf967680287239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:47.943264 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1d57123a-24e6-491c-bfd6-1787168f775d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 200 len: 1372 microversion: 2.20 time: 0.572038 Aug 04 14:23:47.946888 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2544/5066] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:47 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 1372 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:23:47.952611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1660206180", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": "none"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:48.074581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8b391eb7-103b-4054-8a41-81d3e83df19d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:48.131318 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8b391eb7-103b-4054-8a41-81d3e83df19d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 1.182484 Aug 04 14:23:48.137517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:23:48.138251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:23:48.138663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:23:48.139220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:23:48.139762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:23:48.140939 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2523/5067] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:46 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:48.190275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:48.190916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:48.191904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:48.192465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:48.252044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Getting quotas for project a57015c84b374f9e9668de714fad1505. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:23:48.264786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Getting quotas for user 57bd71bd5d474daea5bd118a85bce8d6 and project a57015c84b374f9e9668de714fad1505. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:23:48.309297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:23:48.315060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:23:48.553510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-aa77d08f-6c24-46b9-aeb6-69719e407183 req-cc72eeba-985a-45a0-8a98-94c3ee557264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d980c4-8034-4898-83d5-bcc0ad62a973", "name": "network-vif-deleted", "tag": "10153aad-a7c0-4ba3-ae0d-2844ce1198a3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:48.605929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-aa77d08f-6c24-46b9-aeb6-69719e407183 req-cc72eeba-985a-45a0-8a98-94c3ee557264 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:48.607508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-aa77d08f-6c24-46b9-aeb6-69719e407183 req-cc72eeba-985a-45a0-8a98-94c3ee557264 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:48.675613 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-aa77d08f-6c24-46b9-aeb6-69719e407183 req-cc72eeba-985a-45a0-8a98-94c3ee557264 service nova] Creating event network-vif-deleted:10153aad-a7c0-4ba3-ae0d-2844ce1198a3 for instance 44d980c4-8034-4898-83d5-bcc0ad62a973 on n-h1-844627-10 Aug 04 14:23:48.774954 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3434c604-4dc5-49af-9b0d-07027dcc5f57 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.826048 Aug 04 14:23:48.775696 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-aa77d08f-6c24-46b9-aeb6-69719e407183 req-cc72eeba-985a-45a0-8a98-94c3ee557264 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254795 Aug 04 14:23:48.776414 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2524/5068] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:23:48.777062 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2545/5069] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:23:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:23:48.795189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55f63f93-18c3-4bea-b066-f9e44c938af2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:48.798768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55f63f93-18c3-4bea-b066-f9e44c938af2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:48.968894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:48.970250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:48.995530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:49.003527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:49.004857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:49.005527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:49.066943 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] HTTP exception thrown: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Request method failure captured: Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 HTTP/1.1 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69QVzKbtet42t3roKnv7vyWEdxN20V0JIyra5zHAEmxljp_nLALM38mPhFYzcbPsWq_bOGl_b7CKP2_04jgzfCQEUsbmYrkAtZJsYggXWmLaAgzwmsdlsraTB6rfeCVD5RDeHucrTElXvsLhbalEHUIvTuw6OAqni-WjLs6Uepwz9e8 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dd3c60073acc4679bbf967680287239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dd3c60073acc4679bbf967680287239e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}] Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: be1de13158f1415e9fc93ab6fcf28b30 Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '44d980c4-8034-4898-83d5-bcc0ad62a973'} Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:49.071354 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:49.076255 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:49.076255 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:49.076255 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:49.076255 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:49.076255 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:23:49.076255 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:23:49.076255 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:49.076255 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:49.082322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Returning 404 to user: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:23:49.088464 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5134c4b3-c76b-4315-8c9b-1e48acc58d24 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 404 len: 111 microversion: 2.20 time: 0.122577 Aug 04 14:23:49.090762 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2546/5070] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:48 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 14:23:49.104092 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55f63f93-18c3-4bea-b066-f9e44c938af2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "PUT /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 992 microversion: 2.47 time: 0.313370 Aug 04 14:23:49.110378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2a1a803-6831-4b44-97ce-972f554d71ee tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '.version_select at 0x7f46f3032040>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:49.115435 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2525/5071] 10.222.0.66 () {62 vars in 1297 bytes} [Thu Aug 4 14:23:48 2022] PUT /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 992 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:23:49.172005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-56435dd7-0439-454d-9b9b-034cbbdccd3d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:49.174748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-56435dd7-0439-454d-9b9b-034cbbdccd3d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:49.191704 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e2a1a803-6831-4b44-97ce-972f554d71ee tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640067023" status: 204 len: 0 microversion: 2.20 time: 0.093229 Aug 04 14:23:49.193460 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2547/5072] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 14:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640067023 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:23:49.200585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-08854f8d-915c-4148-b21a-78d848acebc6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:49.201978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-08854f8d-915c-4148-b21a-78d848acebc6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:49.213988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-08854f8d-915c-4148-b21a-78d848acebc6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:49.214786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-08854f8d-915c-4148-b21a-78d848acebc6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:49.216720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-08854f8d-915c-4148-b21a-78d848acebc6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:49.217450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-08854f8d-915c-4148-b21a-78d848acebc6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:51.056380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-56435dd7-0439-454d-9b9b-034cbbdccd3d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:51.079976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-08854f8d-915c-4148-b21a-78d848acebc6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:51.107811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-56435dd7-0439-454d-9b9b-034cbbdccd3d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:51.117215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-56435dd7-0439-454d-9b9b-034cbbdccd3d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:51.117651 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-08854f8d-915c-4148-b21a-78d848acebc6 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 1.919417 Aug 04 14:23:51.133743 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-56435dd7-0439-454d-9b9b-034cbbdccd3d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1278 microversion: 2.47 time: 1.969622 Aug 04 14:23:51.133743 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2526/5073] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:49 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1278 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:23:51.134126 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2548/5074] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:49 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:52.165600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-820bff1e-0ca2-4645-af0f-b9c5bd4c2b33 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:52.166346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-820bff1e-0ca2-4645-af0f-b9c5bd4c2b33 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:52.176748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:52.177926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:52.189212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:52.190013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:52.191060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:52.191712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:52.203683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820bff1e-0ca2-4645-af0f-b9c5bd4c2b33 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:52.213559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820bff1e-0ca2-4645-af0f-b9c5bd4c2b33 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:52.215532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820bff1e-0ca2-4645-af0f-b9c5bd4c2b33 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:52.216568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820bff1e-0ca2-4645-af0f-b9c5bd4c2b33 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:52.307144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:52.323920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:52.332375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:52.333731 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ac9f290-4c48-4ff2-9d9d-7b2475f2abb0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1330 microversion: 2.47 time: 0.161227 Aug 04 14:23:52.337476 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2549/5075] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:52 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1330 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:23:52.553672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-820bff1e-0ca2-4645-af0f-b9c5bd4c2b33 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:52.573658 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-820bff1e-0ca2-4645-af0f-b9c5bd4c2b33 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1509 microversion: 2.1 time: 0.412313 Aug 04 14:23:52.585302 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2527/5076] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:52 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:53.379877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:53.381935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:53.387625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:53.401800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:53.402856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:53.405371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:53.407674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:53.543724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:53.555603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:53.557780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:53.559935 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6087f9b7-1429-439a-8dd7-14ac9c051c66 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1336 microversion: 2.47 time: 0.188072 Aug 04 14:23:53.560838 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2550/5077] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:53 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1336 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:23:53.626717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3748a91a-cf37-4044-8b91-fd2b9078abb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:53.627802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3748a91a-cf37-4044-8b91-fd2b9078abb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:53.636172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3748a91a-cf37-4044-8b91-fd2b9078abb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:53.636628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3748a91a-cf37-4044-8b91-fd2b9078abb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:53.637767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3748a91a-cf37-4044-8b91-fd2b9078abb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:53.638545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3748a91a-cf37-4044-8b91-fd2b9078abb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:54.013148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3748a91a-cf37-4044-8b91-fd2b9078abb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:54.043079 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3748a91a-cf37-4044-8b91-fd2b9078abb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1506 microversion: 2.1 time: 0.420768 Aug 04 14:23:54.046930 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2528/5078] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:53 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:54.608277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:54.610571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:54.647831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:54.651376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:54.659909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:54.661794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:54.937204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:54.951529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:54.954210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:54.956225 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a978f6a3-57eb-43b9-82e6-0888f727b64f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1336 microversion: 2.47 time: 0.362286 Aug 04 14:23:54.965518 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2551/5079] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:54 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1336 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:23:55.068057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2647d8bc-367a-4dec-872a-10ccebfde0f1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:55.069750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2647d8bc-367a-4dec-872a-10ccebfde0f1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:55.102948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:55.107744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2647d8bc-367a-4dec-872a-10ccebfde0f1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:55.116670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2647d8bc-367a-4dec-872a-10ccebfde0f1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:55.118154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2647d8bc-367a-4dec-872a-10ccebfde0f1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:55.118908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2647d8bc-367a-4dec-872a-10ccebfde0f1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:55.624429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2647d8bc-367a-4dec-872a-10ccebfde0f1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:55.626940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:55.636205 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2647d8bc-367a-4dec-872a-10ccebfde0f1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1506 microversion: 2.1 time: 0.572066 Aug 04 14:23:55.636788 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2529/5080] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:55 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:55.989397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:55.992374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:56.005680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.007569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.008799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.009444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.290295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:56.296664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fe3b2777-c166-404b-8728-acea3ba5bdef req-7f83afd5-c9b6-4276-9d92-4e66f0eba870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b", "name": "network-vif-unplugged", "status": "completed", "tag": "688a69e0-ad1b-4bf0-b7d0-abe23e04c91e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:56.312730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:56.332390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:56.335179 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b2fcfe0e-357a-4948-a4c4-daa3dd5dd562 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1357 microversion: 2.47 time: 0.351903 Aug 04 14:23:56.336314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fe3b2777-c166-404b-8728-acea3ba5bdef req-7f83afd5-c9b6-4276-9d92-4e66f0eba870 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.338597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fe3b2777-c166-404b-8728-acea3ba5bdef req-7f83afd5-c9b6-4276-9d92-4e66f0eba870 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.349093 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2552/5081] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:55 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1357 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:23:56.386818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:56.392210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:56.397178 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fe3b2777-c166-404b-8728-acea3ba5bdef req-7f83afd5-c9b6-4276-9d92-4e66f0eba870 service nova] Creating event network-vif-unplugged:688a69e0-ad1b-4bf0-b7d0-abe23e04c91e for instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b on n-h1-844627-10 Aug 04 14:23:56.409389 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fe3b2777-c166-404b-8728-acea3ba5bdef req-7f83afd5-c9b6-4276-9d92-4e66f0eba870 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124354 Aug 04 14:23:56.409644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.410334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.411181 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2530/5082] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:23:56.411558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.412229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.544345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:23:56.545468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:23:56.547318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:23:56.550833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:23:56.551632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:23:56.688607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2844dd42-9644-49f1-99d3-2e30873e57de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:56.690443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2844dd42-9644-49f1-99d3-2e30873e57de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:56.704901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2844dd42-9644-49f1-99d3-2e30873e57de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.706416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2844dd42-9644-49f1-99d3-2e30873e57de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.708126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2844dd42-9644-49f1-99d3-2e30873e57de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.709212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2844dd42-9644-49f1-99d3-2e30873e57de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.714279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:56.734165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.744044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.745871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.746823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.812769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:56.828779 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-be717fc7-9cf5-4a58-846c-4ffb8c37277d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "POST /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632/action" status: 202 len: 1079 microversion: 2.47 time: 0.450097 Aug 04 14:23:56.830182 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2553/5083] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 14:23:56 2022] POST /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632/action => generated 1079 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 14:23:56.862948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:56.863863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:56.873749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.874499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:56.875564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:56.876311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:57.110448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:57.150602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:57.154295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:57.156949 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4bcb4832-7509-4e74-8591-4a7b2d075a05 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.298476 Aug 04 14:23:57.158882 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2554/5084] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:56 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:23:57.311359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2844dd42-9644-49f1-99d3-2e30873e57de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:57.316577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:57.317720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:57.322873 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2844dd42-9644-49f1-99d3-2e30873e57de tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1506 microversion: 2.1 time: 0.647048 Aug 04 14:23:57.323835 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2531/5085] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:56 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:57.336229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:57.337090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:57.338594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:57.339464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:57.368022 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] HTTP exception thrown: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Request method failure captured: Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 HTTP/1.1 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69QVzKbtet42t3roKnv7vyWEdxN20V0JIyra5zHAEmxljp_nLALM38mPhFYzcbPsWq_bOGl_b7CKP2_04jgzfCQEUsbmYrkAtZJsYggXWmLaAgzwmsdlsraTB6rfeCVD5RDeHucrTElXvsLhbalEHUIvTuw6OAqni-WjLs6Uepwz9e8 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dd3c60073acc4679bbf967680287239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dd3c60073acc4679bbf967680287239e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}] Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: be1de13158f1415e9fc93ab6fcf28b30 Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '44d980c4-8034-4898-83d5-bcc0ad62a973'} Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:23:57.371259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Returning 404 to user: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:23:57.376730 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1fdf252d-4c5a-4d87-9706-bab0a194c290 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 404 len: 111 microversion: 2.20 time: 0.064849 Aug 04 14:23:57.380018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2555/5086] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:23:57 2022] DELETE /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:23:57.387120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:57.388330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 44d980c4-8034-4898-83d5-bcc0ad62a973] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:57.397598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:57.398062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:57.398885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:57.399337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:57.418598 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] HTTP exception thrown: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Request method failure captured: Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 HTTP/1.1 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69QVzKbtet42t3roKnv7vyWEdxN20V0JIyra5zHAEmxljp_nLALM38mPhFYzcbPsWq_bOGl_b7CKP2_04jgzfCQEUsbmYrkAtZJsYggXWmLaAgzwmsdlsraTB6rfeCVD5RDeHucrTElXvsLhbalEHUIvTuw6OAqni-WjLs6Uepwz9e8 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dd3c60073acc4679bbf967680287239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dd3c60073acc4679bbf967680287239e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}] Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: be1de13158f1415e9fc93ab6fcf28b30 Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '44d980c4-8034-4898-83d5-bcc0ad62a973'} Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.423904 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Returning 404 to user: Instance 44d980c4-8034-4898-83d5-bcc0ad62a973 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d8a5496-7b53-453e-9642-d492d4318c2d tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973" status: 404 len: 111 microversion: 2.20 time: 0.045676 Aug 04 14:23:57.432301 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2532/5087] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:57 2022] GET /compute/v2.1/servers/44d980c4-8034-4898-83d5-bcc0ad62a973 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:23:58.189670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:58.190894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:58.221313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:58.226342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:58.227858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:58.228672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:58.234709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:58.302836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=14 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:23:58.351490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f3b61552-a015-42db-a4e8-76ee41cfa6e1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:58.356591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f3b61552-a015-42db-a4e8-76ee41cfa6e1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:58.383695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3b61552-a015-42db-a4e8-76ee41cfa6e1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:58.389271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3b61552-a015-42db-a4e8-76ee41cfa6e1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:58.391209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3b61552-a015-42db-a4e8-76ee41cfa6e1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:58.394010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3b61552-a015-42db-a4e8-76ee41cfa6e1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:58.721769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:58.750963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:58.754093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:58.756078 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ebf2ec52-96d3-46e2-90c6-ca61d8d66150 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.575125 Aug 04 14:23:58.757377 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2556/5088] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:58 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:23:58.763230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8dd0eee1-9912-4114-b716-d683d224489a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:23:58.766977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8dd0eee1-9912-4114-b716-d683d224489a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:58.788344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8dd0eee1-9912-4114-b716-d683d224489a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:58.788594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8dd0eee1-9912-4114-b716-d683d224489a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:58.789458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8dd0eee1-9912-4114-b716-d683d224489a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:58.789901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8dd0eee1-9912-4114-b716-d683d224489a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:58.915836 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8dd0eee1-9912-4114-b716-d683d224489a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "POST /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70/action" status: 200 len: 24555 microversion: 2.1 time: 0.155223 Aug 04 14:23:58.929567 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2557/5089] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:23:58 2022] POST /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70/action => generated 24555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:23:59.015140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f3b61552-a015-42db-a4e8-76ee41cfa6e1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:59.028082 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f3b61552-a015-42db-a4e8-76ee41cfa6e1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 200 len: 1449 microversion: 2.1 time: 0.684975 Aug 04 14:23:59.038046 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2533/5090] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:58 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 1449 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:59.059134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8737343a-a0cb-4ee0-a601-a3b7b8f0177c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:59.060373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8737343a-a0cb-4ee0-a601-a3b7b8f0177c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:59.071132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8737343a-a0cb-4ee0-a601-a3b7b8f0177c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.071592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8737343a-a0cb-4ee0-a601-a3b7b8f0177c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:59.072473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8737343a-a0cb-4ee0-a601-a3b7b8f0177c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.073071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8737343a-a0cb-4ee0-a601-a3b7b8f0177c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:59.401768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8737343a-a0cb-4ee0-a601-a3b7b8f0177c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:59.413990 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8737343a-a0cb-4ee0-a601-a3b7b8f0177c tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.363375 Aug 04 14:23:59.414822 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2558/5091] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:59 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:59.447975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-44a0a1f4-6fa5-451b-90cc-bd66c87fc3fc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:59.449288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-44a0a1f4-6fa5-451b-90cc-bd66c87fc3fc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:59.460786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44a0a1f4-6fa5-451b-90cc-bd66c87fc3fc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.462194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44a0a1f4-6fa5-451b-90cc-bd66c87fc3fc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:59.463503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44a0a1f4-6fa5-451b-90cc-bd66c87fc3fc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.464237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44a0a1f4-6fa5-451b-90cc-bd66c87fc3fc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:59.653445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-44a0a1f4-6fa5-451b-90cc-bd66c87fc3fc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:59.670054 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-44a0a1f4-6fa5-451b-90cc-bd66c87fc3fc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.229466 Aug 04 14:23:59.671341 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2534/5092] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:59 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:23:59.692137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-85f07f1d-1064-4996-91c2-8e60ec8f0774 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:59.692771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-85f07f1d-1064-4996-91c2-8e60ec8f0774 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:59.708445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85f07f1d-1064-4996-91c2-8e60ec8f0774 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.709831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85f07f1d-1064-4996-91c2-8e60ec8f0774 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:59.711843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85f07f1d-1064-4996-91c2-8e60ec8f0774 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.712521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85f07f1d-1064-4996-91c2-8e60ec8f0774 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:59.799646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:59.801663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:59.815373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.817080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:59.819309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.820355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:59.883428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-85f07f1d-1064-4996-91c2-8e60ec8f0774 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:23:59.894782 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-85f07f1d-1064-4996-91c2-8e60ec8f0774 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.206547 Aug 04 14:23:59.911349 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2559/5093] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:59 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:23:59.923350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-73a022b0-bed9-47f9-9039-b457286f0cb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:23:59.924640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-73a022b0-bed9-47f9-9039-b457286f0cb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:23:59.937782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73a022b0-bed9-47f9-9039-b457286f0cb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.939118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73a022b0-bed9-47f9-9039-b457286f0cb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:23:59.941414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73a022b0-bed9-47f9-9039-b457286f0cb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:23:59.942654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73a022b0-bed9-47f9-9039-b457286f0cb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:00.033657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:00.047307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:00.049751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:00.052674 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b78bfb0b-bbda-41df-a801-f7da2099169d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.265166 Aug 04 14:24:00.055061 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2535/5094] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:23:59 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:24:00.201827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-73a022b0-bed9-47f9-9039-b457286f0cb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:00.217937 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-73a022b0-bed9-47f9-9039-b457286f0cb5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.303443 Aug 04 14:24:00.219836 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2560/5095] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:23:59 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:00.241118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f74a093b-1c7e-473a-ba85-1b9a3f563215 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:00.250021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f74a093b-1c7e-473a-ba85-1b9a3f563215 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:00.250822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f74a093b-1c7e-473a-ba85-1b9a3f563215 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:00.288924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f74a093b-1c7e-473a-ba85-1b9a3f563215 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Going to try to stop instance {{(pid=130961) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 14:24:00.386362 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f74a093b-1c7e-473a-ba85-1b9a3f563215 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.149532 Aug 04 14:24:00.386949 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2536/5096] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:24:00 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:24:00.400626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30990a61-cb12-4e02-bbe0-aafa67252fcc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:00.401790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-30990a61-cb12-4e02-bbe0-aafa67252fcc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:00.410331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30990a61-cb12-4e02-bbe0-aafa67252fcc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:00.411314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30990a61-cb12-4e02-bbe0-aafa67252fcc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:00.411596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30990a61-cb12-4e02-bbe0-aafa67252fcc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:00.412045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30990a61-cb12-4e02-bbe0-aafa67252fcc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:00.722424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-30990a61-cb12-4e02-bbe0-aafa67252fcc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:00.731681 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30990a61-cb12-4e02-bbe0-aafa67252fcc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.339821 Aug 04 14:24:00.758484 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2561/5097] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:00 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:24:01.085656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:01.091443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:01.099506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:01.125105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:01.129758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:01.130679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:01.131189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:01.318292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:01.333286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:01.335372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:01.336629 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08437b9b-e23b-4adc-9373-240fa84d5a5f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.258965 Aug 04 14:24:01.337230 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2537/5098] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:01 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:01.760859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-991ea22b-97dc-46d5-97f3-35b25cf359d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:01.762047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-991ea22b-97dc-46d5-97f3-35b25cf359d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:01.777742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-991ea22b-97dc-46d5-97f3-35b25cf359d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:01.779086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-991ea22b-97dc-46d5-97f3-35b25cf359d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:01.780956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-991ea22b-97dc-46d5-97f3-35b25cf359d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:01.782035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-991ea22b-97dc-46d5-97f3-35b25cf359d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:01.984802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-991ea22b-97dc-46d5-97f3-35b25cf359d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:01.994392 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-991ea22b-97dc-46d5-97f3-35b25cf359d1 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.242946 Aug 04 14:24:01.995148 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2562/5099] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:01 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:02.224656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:02.225801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:02.233035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.233504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.234344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.234835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.279274 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] HTTP exception thrown: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Request method failure captured: Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 HTTP/1.1 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69QVzKbtet42t3roKnv7vyWEdxN20V0JIyra5zHAEmxljp_nLALM38mPhFYzcbPsWq_bOGl_b7CKP2_04jgzfCQEUsbmYrkAtZJsYggXWmLaAgzwmsdlsraTB6rfeCVD5RDeHucrTElXvsLhbalEHUIvTuw6OAqni-WjLs6Uepwz9e8 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dd3c60073acc4679bbf967680287239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dd3c60073acc4679bbf967680287239e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}] Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: be1de13158f1415e9fc93ab6fcf28b30 Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '8b9c2731-512a-423b-a54e-32f7e2171623'} Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:02.282713 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Returning 404 to user: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:02.286863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-67c807bf-963b-4b7b-94e9-ea3c9f10e737 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 404 len: 111 microversion: 2.20 time: 0.064851 Aug 04 14:24:02.291736 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2538/5100] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:24:02 2022] DELETE /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:24:02.296926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:02.297735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] [instance: 8b9c2731-512a-423b-a54e-32f7e2171623] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:02.304825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.305283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.305762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.306231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.323894 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] HTTP exception thrown: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Request method failure captured: Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 HTTP/1.1 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69QVzKbtet42t3roKnv7vyWEdxN20V0JIyra5zHAEmxljp_nLALM38mPhFYzcbPsWq_bOGl_b7CKP2_04jgzfCQEUsbmYrkAtZJsYggXWmLaAgzwmsdlsraTB6rfeCVD5RDeHucrTElXvsLhbalEHUIvTuw6OAqni-WjLs6Uepwz9e8 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dd3c60073acc4679bbf967680287239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dd3c60073acc4679bbf967680287239e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dd3c60073acc4679bbf967680287239e"}]}] Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: dd3c60073acc4679bbf967680287239e Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1023069972 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: be1de13158f1415e9fc93ab6fcf28b30 Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1023069972-project Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '8b9c2731-512a-423b-a54e-32f7e2171623'} Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.326246 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:02.331866 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.331866 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:02.331866 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:02.331866 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:02.331866 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:02.331866 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:02.331866 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. Aug 04 14:24:02.331866 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:02.333945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] Returning 404 to user: Instance 8b9c2731-512a-423b-a54e-32f7e2171623 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:02.349150 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-879b964b-7b12-4b1e-a0e0-71c299ec4be1 tempest-AttachVolumeShelveTestJSON-1023069972 tempest-AttachVolumeShelveTestJSON-1023069972-project] 10.222.0.66 "GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623" status: 404 len: 111 microversion: 2.20 time: 0.045561 Aug 04 14:24:02.349150 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2563/5101] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:02 2022] GET /compute/v2.1/servers/8b9c2731-512a-423b-a54e-32f7e2171623 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:24:02.371841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:02.374600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:02.399617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.400819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.402303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.403332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.517101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-663d9ce0-a518-4515-a16d-a7c6ac8e2c5a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:02.518090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-663d9ce0-a518-4515-a16d-a7c6ac8e2c5a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:02.528682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-663d9ce0-a518-4515-a16d-a7c6ac8e2c5a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.529661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-663d9ce0-a518-4515-a16d-a7c6ac8e2c5a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.531116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-663d9ce0-a518-4515-a16d-a7c6ac8e2c5a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.531748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-663d9ce0-a518-4515-a16d-a7c6ac8e2c5a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.612845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:02.632478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:02.636197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:02.654180 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a5083e2-9d41-4ebb-ad52-8a4bbebf478f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.287095 Aug 04 14:24:02.665038 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2539/5102] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:02 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:02.672159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-663d9ce0-a518-4515-a16d-a7c6ac8e2c5a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lazy-loading 'services' on Instance uuid b674f7bb-a83a-4eb5-9f9d-bcca0740b251 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:24:02.783796 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-663d9ce0-a518-4515-a16d-a7c6ac8e2c5a tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments/23beaaa4-87c7-43ac-8afc-963ee589003f" status: 202 len: 0 microversion: 2.1 time: 0.271656 Aug 04 14:24:02.786575 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2564/5103] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:24:02 2022] DELETE /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments/23beaaa4-87c7-43ac-8afc-963ee589003f => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:24:02.796447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-20e664a7-81f4-4801-970f-a7439218295b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:02.799118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-20e664a7-81f4-4801-970f-a7439218295b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:02.806308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e664a7-81f4-4801-970f-a7439218295b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.806968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e664a7-81f4-4801-970f-a7439218295b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.807768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e664a7-81f4-4801-970f-a7439218295b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:02.808227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e664a7-81f4-4801-970f-a7439218295b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:02.879885 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-20e664a7-81f4-4801-970f-a7439218295b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078498 Aug 04 14:24:02.880604 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2540/5104] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:24:02 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:24:03.027002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-699fa0ca-bf20-427f-9667-10d6d21268d5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:03.027802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-699fa0ca-bf20-427f-9667-10d6d21268d5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:03.061098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-699fa0ca-bf20-427f-9667-10d6d21268d5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:03.061841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-699fa0ca-bf20-427f-9667-10d6d21268d5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:03.063222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-699fa0ca-bf20-427f-9667-10d6d21268d5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:03.068102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-699fa0ca-bf20-427f-9667-10d6d21268d5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:03.454686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-699fa0ca-bf20-427f-9667-10d6d21268d5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:03.464189 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-699fa0ca-bf20-427f-9667-10d6d21268d5 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.450318 Aug 04 14:24:03.470441 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2565/5105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:03 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:03.705678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:03.711967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:03.728563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:03.729828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:03.733058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:03.734259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:03.892936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2f7ad117-c7f0-434d-9f73-a18d37dde1e0 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:03.897886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2f7ad117-c7f0-434d-9f73-a18d37dde1e0 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:03.916919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f7ad117-c7f0-434d-9f73-a18d37dde1e0 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:03.918079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f7ad117-c7f0-434d-9f73-a18d37dde1e0 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:03.919627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f7ad117-c7f0-434d-9f73-a18d37dde1e0 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:03.920266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f7ad117-c7f0-434d-9f73-a18d37dde1e0 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:03.969775 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2f7ad117-c7f0-434d-9f73-a18d37dde1e0 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080481 Aug 04 14:24:03.979151 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2566/5106] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:24:03 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:04.322090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:04.332153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:04.335707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:04.337775 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-89031f1f-ab72-41ab-ac47-f4d95e27b795 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.645832 Aug 04 14:24:04.339217 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2541/5107] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:03 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:04.489325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-440a9916-4355-4e66-b722-637f63573e99 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:04.491388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-440a9916-4355-4e66-b722-637f63573e99 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:04.499228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-440a9916-4355-4e66-b722-637f63573e99 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:04.500084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-440a9916-4355-4e66-b722-637f63573e99 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:04.501734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-440a9916-4355-4e66-b722-637f63573e99 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:04.502495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-440a9916-4355-4e66-b722-637f63573e99 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:04.810723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-440a9916-4355-4e66-b722-637f63573e99 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:04.832765 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-440a9916-4355-4e66-b722-637f63573e99 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.349880 Aug 04 14:24:04.839790 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2567/5108] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:04 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:04.994179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-037d6d82-7195-42cb-b836-3b6a5eb59e2c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:05.005795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-037d6d82-7195-42cb-b836-3b6a5eb59e2c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:05.030004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-037d6d82-7195-42cb-b836-3b6a5eb59e2c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:05.030831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-037d6d82-7195-42cb-b836-3b6a5eb59e2c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:05.032274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-037d6d82-7195-42cb-b836-3b6a5eb59e2c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:05.033066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-037d6d82-7195-42cb-b836-3b6a5eb59e2c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:05.155572 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-037d6d82-7195-42cb-b836-3b6a5eb59e2c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171499 Aug 04 14:24:05.156839 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2542/5109] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:24:04 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:05.383998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:05.387702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:05.413933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:05.414749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:05.422761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:05.426000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:05.715672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:05.763127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:05.771215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:05.774378 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b51e0df7-cd48-4d88-bc59-4dd4b5d116a2 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.398228 Aug 04 14:24:05.775546 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2568/5110] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:05 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:05.873117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bfb599d2-e3d9-439b-8b08-f5500b61ae7e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:05.874225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bfb599d2-e3d9-439b-8b08-f5500b61ae7e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:05.888032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfb599d2-e3d9-439b-8b08-f5500b61ae7e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:05.890536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfb599d2-e3d9-439b-8b08-f5500b61ae7e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:05.895927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfb599d2-e3d9-439b-8b08-f5500b61ae7e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:05.896903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfb599d2-e3d9-439b-8b08-f5500b61ae7e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:06.176614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-41bcfa94-c12b-4b26-a1bb-19dd5966b778 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:06.181385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-41bcfa94-c12b-4b26-a1bb-19dd5966b778 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:06.204937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41bcfa94-c12b-4b26-a1bb-19dd5966b778 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:06.205633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41bcfa94-c12b-4b26-a1bb-19dd5966b778 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:06.207211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41bcfa94-c12b-4b26-a1bb-19dd5966b778 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:06.210568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-41bcfa94-c12b-4b26-a1bb-19dd5966b778 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:06.370868 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-41bcfa94-c12b-4b26-a1bb-19dd5966b778 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201715 Aug 04 14:24:06.372582 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2569/5111] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:24:06 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:24:06.383703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bfb599d2-e3d9-439b-8b08-f5500b61ae7e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:06.403741 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bfb599d2-e3d9-439b-8b08-f5500b61ae7e tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.534758 Aug 04 14:24:06.407931 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2543/5112] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:05 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:24:06.828405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:06.830781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:06.859669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:06.861760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:06.862821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:06.864429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:07.022014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:07.040078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:07.042531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:07.044214 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2f737a98-b2af-4dda-be98-5a81929b177c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.222712 Aug 04 14:24:07.045176 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2570/5113] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:06 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:07.387694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cd704a10-b4df-4a02-b75b-447e466c7143 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:07.390952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cd704a10-b4df-4a02-b75b-447e466c7143 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:07.416562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd704a10-b4df-4a02-b75b-447e466c7143 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:07.432567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3419b430-1b9b-4c00-bce7-b8c2bbf3bf0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:07.433686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3419b430-1b9b-4c00-bce7-b8c2bbf3bf0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:07.440963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd704a10-b4df-4a02-b75b-447e466c7143 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:07.442398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd704a10-b4df-4a02-b75b-447e466c7143 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:07.447271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cd704a10-b4df-4a02-b75b-447e466c7143 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:07.456112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3419b430-1b9b-4c00-bce7-b8c2bbf3bf0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:07.457234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3419b430-1b9b-4c00-bce7-b8c2bbf3bf0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:07.462301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3419b430-1b9b-4c00-bce7-b8c2bbf3bf0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:07.463065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3419b430-1b9b-4c00-bce7-b8c2bbf3bf0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:07.496758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:07.589757 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cd704a10-b4df-4a02-b75b-447e466c7143 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206389 Aug 04 14:24:07.595867 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2544/5114] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:24:07 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:07.906628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3419b430-1b9b-4c00-bce7-b8c2bbf3bf0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:07.916838 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3419b430-1b9b-4c00-bce7-b8c2bbf3bf0b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.490235 Aug 04 14:24:07.926387 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2571/5115] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:07 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:08.083763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:08.086631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:08.099444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:08.101316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:08.103773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:08.105602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:08.313127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:08.339827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:08.344373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:08.352781 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-199656de-ef4e-4db0-a78a-4b41a39c5469 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.273857 Aug 04 14:24:08.357764 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2545/5116] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:08 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:08.608695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0e998cb1-3788-4828-b694-3cb09d87ff1c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:08.617530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0e998cb1-3788-4828-b694-3cb09d87ff1c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:08.654138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e998cb1-3788-4828-b694-3cb09d87ff1c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:08.657840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e998cb1-3788-4828-b694-3cb09d87ff1c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:08.660144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e998cb1-3788-4828-b694-3cb09d87ff1c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:08.661462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e998cb1-3788-4828-b694-3cb09d87ff1c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:08.747314 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0e998cb1-3788-4828-b694-3cb09d87ff1c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143359 Aug 04 14:24:08.749621 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2572/5117] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:24:08 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:08.953028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08d5d335-2826-4161-9b0e-2216895b6cb3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:08.955343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-08d5d335-2826-4161-9b0e-2216895b6cb3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:08.984366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08d5d335-2826-4161-9b0e-2216895b6cb3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:08.987575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08d5d335-2826-4161-9b0e-2216895b6cb3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:08.990334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08d5d335-2826-4161-9b0e-2216895b6cb3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:08.995116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08d5d335-2826-4161-9b0e-2216895b6cb3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:09.392272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:09.395294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:09.427260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:09.430655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:09.436251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:09.437668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:09.443749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08d5d335-2826-4161-9b0e-2216895b6cb3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:09.481926 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08d5d335-2826-4161-9b0e-2216895b6cb3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 0.534785 Aug 04 14:24:09.484494 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2546/5118] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:08 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:09.663329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:09.689555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:09.694673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:09.713691 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3593d885-b1f5-486f-8aff-17a789e04ae0 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.328996 Aug 04 14:24:09.715176 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2573/5119] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:09 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:09.769228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-419f9869-2096-467a-912b-c1dbd005e243 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:09.773327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-419f9869-2096-467a-912b-c1dbd005e243 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:09.810970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-419f9869-2096-467a-912b-c1dbd005e243 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:09.811919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-419f9869-2096-467a-912b-c1dbd005e243 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:09.813418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-419f9869-2096-467a-912b-c1dbd005e243 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:09.814178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-419f9869-2096-467a-912b-c1dbd005e243 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:09.847302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:09.915240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-419f9869-2096-467a-912b-c1dbd005e243 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154172 Aug 04 14:24:09.916573 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2547/5120] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:24:09 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:10.524775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5b0a59c2-a81c-4506-a045-d638be47f63f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:10.527946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b0a59c2-a81c-4506-a045-d638be47f63f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:10.569154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b0a59c2-a81c-4506-a045-d638be47f63f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:10.570222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b0a59c2-a81c-4506-a045-d638be47f63f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:10.574679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b0a59c2-a81c-4506-a045-d638be47f63f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:10.578660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b0a59c2-a81c-4506-a045-d638be47f63f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:10.770142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:10.780742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:10.825226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:10.833049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:10.838306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:10.841580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:11.242281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:11.277322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:11.296666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:11.299870 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22fa5f2e-044d-4ba8-9762-b4c3b6c55ab8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.541428 Aug 04 14:24:11.301597 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2548/5121] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:10 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:11.354826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ced7f8a3-de01-48fd-a9fb-11883c32156d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:11.366840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ced7f8a3-de01-48fd-a9fb-11883c32156d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:11.390713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ced7f8a3-de01-48fd-a9fb-11883c32156d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:11.391469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ced7f8a3-de01-48fd-a9fb-11883c32156d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:11.395694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ced7f8a3-de01-48fd-a9fb-11883c32156d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:11.398039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ced7f8a3-de01-48fd-a9fb-11883c32156d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:11.567758 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ced7f8a3-de01-48fd-a9fb-11883c32156d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235232 Aug 04 14:24:11.571393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5b0a59c2-a81c-4506-a045-d638be47f63f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:11.585459 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2549/5122] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:24:11 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:11.615867 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5b0a59c2-a81c-4506-a045-d638be47f63f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1679 microversion: 2.1 time: 1.099381 Aug 04 14:24:11.617308 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2574/5123] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:10 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1679 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:24:12.356147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:12.358317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:12.376790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:12.379197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:12.381459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:12.384131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:12.555468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:12.573073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:12.577673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:12.580427 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-18d82767-ee9e-41b4-af0a-9afbc8401b5d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.235267 Aug 04 14:24:12.598610 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2550/5124] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:12 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:12.607505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b9aca086-b154-446d-aee7-b2f3193c6ef5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:12.627570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b9aca086-b154-446d-aee7-b2f3193c6ef5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:12.645299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9aca086-b154-446d-aee7-b2f3193c6ef5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:12.646591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9aca086-b154-446d-aee7-b2f3193c6ef5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:12.649255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9aca086-b154-446d-aee7-b2f3193c6ef5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:12.650470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9aca086-b154-446d-aee7-b2f3193c6ef5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:12.664566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d991831b-c8cb-40e5-b4c0-814111ea75d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:12.666243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d991831b-c8cb-40e5-b4c0-814111ea75d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:12.702123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d991831b-c8cb-40e5-b4c0-814111ea75d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:12.703296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d991831b-c8cb-40e5-b4c0-814111ea75d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:12.710042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d991831b-c8cb-40e5-b4c0-814111ea75d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:12.711612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d991831b-c8cb-40e5-b4c0-814111ea75d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:12.748979 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b9aca086-b154-446d-aee7-b2f3193c6ef5 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168787 Aug 04 14:24:12.752105 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2575/5125] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:24:12 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:24:12.866301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc5d8ced-9352-47e8-874f-3c0c04b55940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:12.867945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bc5d8ced-9352-47e8-874f-3c0c04b55940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:12.880439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc5d8ced-9352-47e8-874f-3c0c04b55940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:12.882687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc5d8ced-9352-47e8-874f-3c0c04b55940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:12.884588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc5d8ced-9352-47e8-874f-3c0c04b55940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:12.885326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc5d8ced-9352-47e8-874f-3c0c04b55940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:12.915742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bc5d8ced-9352-47e8-874f-3c0c04b55940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:24:13.147479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d991831b-c8cb-40e5-b4c0-814111ea75d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:13.173013 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d991831b-c8cb-40e5-b4c0-814111ea75d7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1656 microversion: 2.1 time: 0.525569 Aug 04 14:24:13.175792 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2551/5126] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:12 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1656 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:24:13.197331 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bc5d8ced-9352-47e8-874f-3c0c04b55940 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 204 len: 0 microversion: 2.1 time: 0.339484 Aug 04 14:24:13.198883 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2576/5127] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:12 2022] DELETE /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:24:13.216411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-589a19f7-fdc1-4468-a1f4-6626712181d4 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:13.218948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-945d8255-a78b-4112-95c4-4dc65437df01 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:13.219981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-589a19f7-fdc1-4468-a1f4-6626712181d4 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:13.232019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-589a19f7-fdc1-4468-a1f4-6626712181d4 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:13.233222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-589a19f7-fdc1-4468-a1f4-6626712181d4 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:13.236370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-589a19f7-fdc1-4468-a1f4-6626712181d4 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:13.237256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-945d8255-a78b-4112-95c4-4dc65437df01 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:13.238034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-945d8255-a78b-4112-95c4-4dc65437df01 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:13.244450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-589a19f7-fdc1-4468-a1f4-6626712181d4 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:13.288767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-945d8255-a78b-4112-95c4-4dc65437df01 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Going to try to start instance {{(pid=130960) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 14:24:13.391329 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-945d8255-a78b-4112-95c4-4dc65437df01 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.177382 Aug 04 14:24:13.392766 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2577/5128] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:24:13 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:24:13.414251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8ca570fc-69c4-4974-b602-f97fe877f82f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:13.416703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8ca570fc-69c4-4974-b602-f97fe877f82f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:13.439537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8ca570fc-69c4-4974-b602-f97fe877f82f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:13.440675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8ca570fc-69c4-4974-b602-f97fe877f82f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:13.442861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8ca570fc-69c4-4974-b602-f97fe877f82f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:13.445140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8ca570fc-69c4-4974-b602-f97fe877f82f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:13.780720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-589a19f7-fdc1-4468-a1f4-6626712181d4 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:13.805091 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-589a19f7-fdc1-4468-a1f4-6626712181d4 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1682 microversion: 2.1 time: 0.599981 Aug 04 14:24:13.807325 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2552/5129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:13 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1682 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:13.825021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:13.831426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:13.848706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:13.849570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:13.851669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:13.852628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:14.004348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8ca570fc-69c4-4974-b602-f97fe877f82f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:14.030925 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8ca570fc-69c4-4974-b602-f97fe877f82f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1665 microversion: 2.1 time: 0.629092 Aug 04 14:24:14.031466 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2578/5130] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:13 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1665 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:14.083402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:14.112102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:14.117718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:14.125271 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b8cd4481-0fc1-45f3-9187-65efc7037c17 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.316018 Aug 04 14:24:14.127269 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2553/5131] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:13 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:14.856674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c609c03-1f96-4ed1-bf97-3b703bc84912 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:14.861282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8c609c03-1f96-4ed1-bf97-3b703bc84912 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:14.883013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c609c03-1f96-4ed1-bf97-3b703bc84912 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:14.884017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c609c03-1f96-4ed1-bf97-3b703bc84912 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:14.887110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c609c03-1f96-4ed1-bf97-3b703bc84912 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:14.887917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c609c03-1f96-4ed1-bf97-3b703bc84912 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:15.077314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a358daf0-1649-41a8-b132-afef104ab9ce tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:15.079398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a358daf0-1649-41a8-b132-afef104ab9ce tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:15.106792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a358daf0-1649-41a8-b132-afef104ab9ce tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:15.114077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a358daf0-1649-41a8-b132-afef104ab9ce tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:15.116235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a358daf0-1649-41a8-b132-afef104ab9ce tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:15.120698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a358daf0-1649-41a8-b132-afef104ab9ce tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:15.693571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a358daf0-1649-41a8-b132-afef104ab9ce tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:15.710733 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a358daf0-1649-41a8-b132-afef104ab9ce tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1665 microversion: 2.1 time: 0.645160 Aug 04 14:24:15.711332 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2554/5132] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:15 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1665 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:15.716594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:15.717584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:15.727163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:15.728266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:15.729915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:15.730935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:15.761547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8c609c03-1f96-4ed1-bf97-3b703bc84912 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:15.782243 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c609c03-1f96-4ed1-bf97-3b703bc84912 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1682 microversion: 2.1 time: 0.937321 Aug 04 14:24:15.783195 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2579/5133] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:14 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1682 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:15.911862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:15.946397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:15.950622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:15.954454 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7cf6fdf2-55c3-4353-8e1c-01dedc2fdd52 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.241290 Aug 04 14:24:15.955602 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2555/5134] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:15 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:16.127697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-af18f8d9-b0ca-48ab-9ae7-8c1397fa2019 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Action: 'create', calling method: .version_select at 0x7f46f3032790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-361307074"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:16.767066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6f94c571-2424-449b-bb79-20db82fca2c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:16.767929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6f94c571-2424-449b-bb79-20db82fca2c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:16.792954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f94c571-2424-449b-bb79-20db82fca2c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:16.797792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f94c571-2424-449b-bb79-20db82fca2c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:16.798647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f94c571-2424-449b-bb79-20db82fca2c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:16.799107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f94c571-2424-449b-bb79-20db82fca2c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:16.901950 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-af18f8d9-b0ca-48ab-9ae7-8c1397fa2019 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.116802 Aug 04 14:24:16.904800 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2580/5135] 10.222.0.66 () {60 vars in 1155 bytes} [Thu Aug 4 14:24:15 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1121 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 14:24:16.920356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c895bcba-a871-4bd9-94e2-72edcc55262d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:16.923016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c895bcba-a871-4bd9-94e2-72edcc55262d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:16.940078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c895bcba-a871-4bd9-94e2-72edcc55262d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:16.941827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c895bcba-a871-4bd9-94e2-72edcc55262d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:16.946547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c895bcba-a871-4bd9-94e2-72edcc55262d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:16.948284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c895bcba-a871-4bd9-94e2-72edcc55262d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:17.109299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c895bcba-a871-4bd9-94e2-72edcc55262d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:17.162070 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c895bcba-a871-4bd9-94e2-72edcc55262d tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1614 microversion: 2.1 time: 0.254349 Aug 04 14:24:17.188997 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2581/5136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:16 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1614 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:17.198950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c0b5b1c-4268-4ecb-ae77-6a4f1f406988 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f2fa6c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:17.326100 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c0b5b1c-4268-4ecb-ae77-6a4f1f406988 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43" status: 200 len: 344 microversion: 2.1 time: 0.135002 Aug 04 14:24:17.327439 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2582/5137] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:24:17 2022] GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:17.333511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:17.334624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:17.345272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:17.345933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:17.346999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:17.347731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:17.584776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:17.591692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f94c571-2424-449b-bb79-20db82fca2c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:17.607473 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6f94c571-2424-449b-bb79-20db82fca2c2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.854965 Aug 04 14:24:17.608144 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2556/5138] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:16 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:24:17.617020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-719359fd-be73-44e6-bee8-be917ecbec66 req-e5785403-6f5a-44e0-a18d-9c8120ef63aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b674f7bb-a83a-4eb5-9f9d-bcca0740b251", "name": "network-vif-deleted", "tag": "8248b82d-db83-41f2-96f5-341d876f60ea"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:17.659166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:17.663353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-719359fd-be73-44e6-bee8-be917ecbec66 req-e5785403-6f5a-44e0-a18d-9c8120ef63aa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:17.666378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:17.668898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-719359fd-be73-44e6-bee8-be917ecbec66 req-e5785403-6f5a-44e0-a18d-9c8120ef63aa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:17.670994 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-29e232cf-23f2-475f-b270-ce7cce7a08a5 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.340972 Aug 04 14:24:17.673036 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2583/5139] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:17 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:17.683749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77941893-7c8d-4a97-9193-75752770d4e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:17.685537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-77941893-7c8d-4a97-9193-75752770d4e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:17.703997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77941893-7c8d-4a97-9193-75752770d4e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:17.704803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77941893-7c8d-4a97-9193-75752770d4e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:17.718923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77941893-7c8d-4a97-9193-75752770d4e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:17.720186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77941893-7c8d-4a97-9193-75752770d4e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:17.732006 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-719359fd-be73-44e6-bee8-be917ecbec66 req-e5785403-6f5a-44e0-a18d-9c8120ef63aa service nova] Creating event network-vif-deleted:8248b82d-db83-41f2-96f5-341d876f60ea for instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 on n-h2-844627-10 Aug 04 14:24:17.753931 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-719359fd-be73-44e6-bee8-be917ecbec66 req-e5785403-6f5a-44e0-a18d-9c8120ef63aa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137735 Aug 04 14:24:17.757230 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2557/5140] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:18.114446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-77941893-7c8d-4a97-9193-75752770d4e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:18.130409 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-77941893-7c8d-4a97-9193-75752770d4e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.453435 Aug 04 14:24:18.171973 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2584/5141] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:17 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:18.172667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-259328b9-3214-4f97-b660-b46cde97b61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:18.173476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-259328b9-3214-4f97-b660-b46cde97b61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:18.217149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-259328b9-3214-4f97-b660-b46cde97b61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:18.217903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-259328b9-3214-4f97-b660-b46cde97b61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:18.218748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:18.219729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:18.222684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-259328b9-3214-4f97-b660-b46cde97b61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:18.223608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-259328b9-3214-4f97-b660-b46cde97b61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:18.234101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:18.237087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:18.238891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:18.239597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:18.289225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:18.289987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:18.291093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lazy-loading 'fault' on Instance uuid b674f7bb-a83a-4eb5-9f9d-bcca0740b251 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:24:18.366366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5b06982b8b43ef98866e495427d381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2b9bbf2acf40e894f49d12ef51e0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:18.375393 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3ee5cad8-5765-4d0c-8576-4d6ca4ef2ce9 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 200 len: 1331 microversion: 2.1 time: 0.165499 Aug 04 14:24:18.376744 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2585/5142] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:18 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:18.383170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-511cfc7d-2d5b-4d5d-9d5b-24f4aab1660c tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f47055483a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:18.478279 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-511cfc7d-2d5b-4d5d-9d5b-24f4aab1660c tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43" status: 200 len: 345 microversion: 2.1 time: 0.099975 Aug 04 14:24:18.478878 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2586/5143] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:24:18 2022] GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:18.495213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dfe13c8a-f22a-4e4e-aadd-fa29b20f5a22 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Action: 'create', calling method: .version_select at 0x7f47055480d0>, body: {"snapshot": {"volume_id": "b4692f87-ae27-4064-a59b-2a760f718a43", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1947280330"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:18.645056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-259328b9-3214-4f97-b660-b46cde97b61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:18.677022 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-259328b9-3214-4f97-b660-b46cde97b61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.509858 Aug 04 14:24:18.678565 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2558/5144] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:18 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:18.711354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:18.713203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:18.756756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:18.758444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:18.760151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:18.761897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:18.904085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:18.917369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:18.918986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:18.919960 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dfe13c8a-f22a-4e4e-aadd-fa29b20f5a22 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.428589 Aug 04 14:24:18.920784 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2587/5145] 10.222.0.66 () {60 vars in 1162 bytes} [Thu Aug 4 14:24:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:24:18.923620 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-613c78b5-e0e9-4ea6-9831-96d2d6971e06 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.226328 Aug 04 14:24:18.933305 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2559/5146] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:18 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:18.934023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0424ccea-d42f-4f5f-a6be-db40f7bfb9fa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:18.934023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0424ccea-d42f-4f5f-a6be-db40f7bfb9fa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:18.946908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-63c581b2-1280-4108-ae21-74bad946a407 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f2fa7e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:18.961315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0424ccea-d42f-4f5f-a6be-db40f7bfb9fa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:18.962132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0424ccea-d42f-4f5f-a6be-db40f7bfb9fa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:18.963260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0424ccea-d42f-4f5f-a6be-db40f7bfb9fa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:18.963888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0424ccea-d42f-4f5f-a6be-db40f7bfb9fa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:19.181259 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-63c581b2-1280-4108-ae21-74bad946a407 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf" status: 200 len: 287 microversion: 2.1 time: 0.242637 Aug 04 14:24:19.185046 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2560/5147] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 14:24:18 2022] GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf => generated 287 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:19.199126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0424ccea-d42f-4f5f-a6be-db40f7bfb9fa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:19.203728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:19.208544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d8a2d52-da96-4f36-8528-788b132f5e0e tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f3a37790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:19.215285 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0424ccea-d42f-4f5f-a6be-db40f7bfb9fa tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.292410 Aug 04 14:24:19.216739 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2588/5148] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:18 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:19.265216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-726c2017-b72b-4af0-bb24-d7a6102f71f3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:19.266482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-726c2017-b72b-4af0-bb24-d7a6102f71f3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:19.282216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-726c2017-b72b-4af0-bb24-d7a6102f71f3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:19.283491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-726c2017-b72b-4af0-bb24-d7a6102f71f3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:19.285188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-726c2017-b72b-4af0-bb24-d7a6102f71f3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:19.286215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-726c2017-b72b-4af0-bb24-d7a6102f71f3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:19.298298 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d8a2d52-da96-4f36-8528-788b132f5e0e tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.102350 Aug 04 14:24:19.300334 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2561/5149] 10.222.0.66 () {58 vars in 1140 bytes} [Thu Aug 4 14:24:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:19.315942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae9f13f1-f476-4001-ae54-d99e84712631 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f2fa78b0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:19.391960 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae9f13f1-f476-4001-ae54-d99e84712631 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf" status: 200 len: 287 microversion: 2.1 time: 0.080029 Aug 04 14:24:19.392679 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2562/5150] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 14:24:19 2022] GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:24:19.408626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:19.411271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:19.428688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:19.429227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:19.430778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:19.431343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:19.457461 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 HTTP/1.1 Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b674f7bb-a83a-4eb5-9f9d-bcca0740b251'} Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:19.467964 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:19.473127 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:19.473127 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:19.473127 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:19.473127 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:19.473127 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:19.473127 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:19.473127 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:19.473127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:19.473938 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf2ed0f2-cdfe-4f4e-ad3a-e6482340a44b tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 404 len: 111 microversion: 2.1 time: 0.069973 Aug 04 14:24:19.475289 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2563/5151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:19 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:24:19.485599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d649c22-f214-4c25-9ef7-03cec7dca420 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '.version_select at 0x7f4700133d30>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:19.531522 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d649c22-f214-4c25-9ef7-03cec7dca420 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082824537" status: 202 len: 0 microversion: 2.1 time: 0.049672 Aug 04 14:24:19.532548 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2564/5152] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082824537 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:24:19.655713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-726c2017-b72b-4af0-bb24-d7a6102f71f3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:19.687877 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-726c2017-b72b-4af0-bb24-d7a6102f71f3 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.433266 Aug 04 14:24:19.694995 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2589/5153] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:19 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:19.727970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-15f812ef-1947-4d59-add7-c58e3b564d55 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:19.728656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-15f812ef-1947-4d59-add7-c58e3b564d55 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:19.740756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15f812ef-1947-4d59-add7-c58e3b564d55 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:19.742530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15f812ef-1947-4d59-add7-c58e3b564d55 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:19.750110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15f812ef-1947-4d59-add7-c58e3b564d55 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:19.750704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15f812ef-1947-4d59-add7-c58e3b564d55 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:19.828469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-15f812ef-1947-4d59-add7-c58e3b564d55 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lazy-loading 'flavor' on Instance uuid 11f82140-ff26-411a-8d4f-eb49f24bc20b {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:24:19.953843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:19.954647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:19.988902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:19.989589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:19.990848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:19.991407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:20.058263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-15f812ef-1947-4d59-add7-c58e3b564d55 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.331823 Aug 04 14:24:20.072244 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2565/5154] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:24:19 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:24:20.131951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bae2c6f5-8b2f-4a88-af3b-a02df6f6cb41 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:20.136704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bae2c6f5-8b2f-4a88-af3b-a02df6f6cb41 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:20.177678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bae2c6f5-8b2f-4a88-af3b-a02df6f6cb41 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:20.178529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bae2c6f5-8b2f-4a88-af3b-a02df6f6cb41 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:20.179724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bae2c6f5-8b2f-4a88-af3b-a02df6f6cb41 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:20.180487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bae2c6f5-8b2f-4a88-af3b-a02df6f6cb41 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:20.281442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:20.305032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:20.307209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:20.309511 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5cfc6307-d393-41ef-b003-b592ee9fa871 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.365394 Aug 04 14:24:20.310162 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2590/5155] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:19 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:24:20.408353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1d2cf52-bd7c-457d-a3a0-1ec74e0bc124 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f47002f1dc0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:20.451849 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1d2cf52-bd7c-457d-a3a0-1ec74e0bc124 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf" status: 200 len: 287 microversion: 2.1 time: 0.047639 Aug 04 14:24:20.452450 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2591/5156] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 14:24:20 2022] GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:24:20.691756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bae2c6f5-8b2f-4a88-af3b-a02df6f6cb41 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:20.702570 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bae2c6f5-8b2f-4a88-af3b-a02df6f6cb41 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1677 microversion: 2.1 time: 0.625730 Aug 04 14:24:20.703328 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2566/5157] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:20 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1677 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:21.395558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:21.399266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:21.408751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:21.408981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:21.409941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:21.410396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:21.470294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22168037-3804-4f55-bf8f-ada7e29bba4f tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f470560fc10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:21.579868 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22168037-3804-4f55-bf8f-ada7e29bba4f tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf" status: 200 len: 287 microversion: 2.1 time: 0.115041 Aug 04 14:24:21.580670 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2567/5158] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 14:24:21 2022] GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:24:21.629486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:21.642677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:21.644967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:21.647047 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc3ea469-b73d-4f36-9fad-20a0ffec91e8 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.278416 Aug 04 14:24:21.648257 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2592/5159] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:21 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:21.738442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b99ba9f8-8b19-49a6-927e-7feb42ddcef2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:21.740375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b99ba9f8-8b19-49a6-927e-7feb42ddcef2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:21.757723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b99ba9f8-8b19-49a6-927e-7feb42ddcef2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:21.761580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b99ba9f8-8b19-49a6-927e-7feb42ddcef2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:21.764071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b99ba9f8-8b19-49a6-927e-7feb42ddcef2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:21.767066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b99ba9f8-8b19-49a6-927e-7feb42ddcef2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:22.105447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b99ba9f8-8b19-49a6-927e-7feb42ddcef2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:22.118728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:22.122245 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b99ba9f8-8b19-49a6-927e-7feb42ddcef2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1660 microversion: 2.1 time: 0.398940 Aug 04 14:24:22.139878 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2568/5160] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:21 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1660 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:22.156350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab6d6d74-f1a9-4f5f-970a-36e28f99943d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:22.162752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ab6d6d74-f1a9-4f5f-970a-36e28f99943d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:22.189776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab6d6d74-f1a9-4f5f-970a-36e28f99943d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:22.193686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab6d6d74-f1a9-4f5f-970a-36e28f99943d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:22.194672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab6d6d74-f1a9-4f5f-970a-36e28f99943d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:22.197150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab6d6d74-f1a9-4f5f-970a-36e28f99943d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:22.374307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab6d6d74-f1a9-4f5f-970a-36e28f99943d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action" status: 202 len: 0 microversion: 2.1 time: 0.231713 Aug 04 14:24:22.375658 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2593/5161] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:24:22 2022] POST /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:24:22.388793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d69b7bc-afd4-4035-93b9-9c2e213ecb44 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:22.390000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3d69b7bc-afd4-4035-93b9-9c2e213ecb44 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:22.408569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d69b7bc-afd4-4035-93b9-9c2e213ecb44 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:22.409633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d69b7bc-afd4-4035-93b9-9c2e213ecb44 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:22.412062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d69b7bc-afd4-4035-93b9-9c2e213ecb44 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:22.413061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d69b7bc-afd4-4035-93b9-9c2e213ecb44 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:22.595685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c3b6333a-1bd7-48e0-b3a7-6af96375efb2 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f47002f1040>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:22.654895 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c3b6333a-1bd7-48e0-b3a7-6af96375efb2 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf" status: 200 len: 288 microversion: 2.1 time: 0.064194 Aug 04 14:24:22.662460 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2594/5162] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 14:24:22 2022] GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:24:22.671636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6a992152-e248-4eef-9bf0-c0aee13f4529 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f39d2f70>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:22.692714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3d69b7bc-afd4-4035-93b9-9c2e213ecb44 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:22.715077 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3d69b7bc-afd4-4035-93b9-9c2e213ecb44 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1666 microversion: 2.1 time: 0.334439 Aug 04 14:24:22.716216 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2569/5163] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:22 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1666 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:22.741438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:22.742851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:22.774108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:22.774968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:22.776010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:22.776903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:22.856833 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6a992152-e248-4eef-9bf0-c0aee13f4529 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf" status: 202 len: 0 microversion: 2.1 time: 0.193122 Aug 04 14:24:22.861109 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2595/5164] 10.222.0.66 () {58 vars in 1254 bytes} [Thu Aug 4 14:24:22 2022] DELETE /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:24:22.872805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aa3cc81c-6391-4f5f-bc25-110131df6b0c tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f2fa6820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:22.899902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:22.912385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:22.914069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:22.915320 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-98daf4a0-9e4a-47d6-9300-3efc7e9fb01e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.197419 Aug 04 14:24:22.916494 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2570/5165] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:22 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:22.970330 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aa3cc81c-6391-4f5f-bc25-110131df6b0c tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf" status: 200 len: 287 microversion: 2.1 time: 0.107147 Aug 04 14:24:22.970627 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2596/5166] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 14:24:22 2022] GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:23.736926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38170bda-bcc2-4e2a-9ff9-75e170936ad7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:23.737915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-38170bda-bcc2-4e2a-9ff9-75e170936ad7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:23.753078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38170bda-bcc2-4e2a-9ff9-75e170936ad7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:23.754243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38170bda-bcc2-4e2a-9ff9-75e170936ad7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:23.754445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38170bda-bcc2-4e2a-9ff9-75e170936ad7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:23.754757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38170bda-bcc2-4e2a-9ff9-75e170936ad7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:23.949096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:23.951650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:23.957603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:23.968996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:23.970220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:23.971784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:23.972496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:24.210912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:24.223832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:24.229017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:24.237191 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c9aef3e2-b3e2-40e1-8f91-c50f6dbd8267 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.294625 Aug 04 14:24:24.239114 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2597/5167] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:23 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:24.261008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0ef6d565-6ae1-4f53-91b2-d21027829042 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f300fd30>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:24.311210 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0ef6d565-6ae1-4f53-91b2-d21027829042 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf" status: 200 len: 287 microversion: 2.1 time: 0.069560 Aug 04 14:24:24.311801 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2598/5168] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 14:24:24 2022] GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:24.405184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-38170bda-bcc2-4e2a-9ff9-75e170936ad7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:24.434755 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-38170bda-bcc2-4e2a-9ff9-75e170936ad7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1666 microversion: 2.1 time: 0.702044 Aug 04 14:24:24.439677 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2571/5169] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:23 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1666 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:25.275208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:25.276003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:25.285111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:25.285611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:25.286530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:25.287450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:25.340268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d4919c0-9760-41c1-892e-fd7756baff3d tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f2ff0430>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:25.427298 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-3d4919c0-9760-41c1-892e-fd7756baff3d tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] HTTP exception thrown: Snapshot a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf could not be found. Aug 04 14:24:25.439837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d4919c0-9760-41c1-892e-fd7756baff3d tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Request method failure captured: Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf HTTP/1.1 Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69aPI-mHSyZEo3hugw3VGrn0M550xyIKW6erQAtzfLltpDoPYCebsdxJ9uXVIf224RlcLYWia37IH3e05iqk3XliTPVo_0wZIb0BaZdAhqn6ynlXzCS-WHwr_2Ll54KCS08yHsN1njDkdWjQ48wW9gz3n2-jC1u_X3x3sEVqBzAROPA Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 30e4862b955c4b84ac547e4b3f8c37e3 Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30e4862b955c4b84ac547e4b3f8c37e3"}]}] Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 30e4862b955c4b84ac547e4b3f8c37e3 Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesSnapshotsTestJSON-709668947-project Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 1f7e69e5a7f1433e8136713134e4e62f Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesSnapshotsTestJSON-709668947-project Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: exception: Snapshot a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf could not be found. Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf'} Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf could not be found. (HTTP 404) (Request-ID: req-59eeb913-99de-439a-868f-69c13eefc2ce) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 14:24:25.440071 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf could not be found. Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf could not be found. Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf could not be found. Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d4919c0-9760-41c1-892e-fd7756baff3d tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Returning 404 to user: Snapshot a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:25.445504 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3d4919c0-9760-41c1-892e-fd7756baff3d tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf" status: 404 len: 111 microversion: 2.1 time: 0.120813 Aug 04 14:24:25.450134 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2572/5170] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 14:24:25 2022] GET /compute/v2.1/os-snapshots/a4b1c3bf-d673-4d02-9a71-e6c56fdfa7cf => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:25.456775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d3e4cb36-b286-4987-a8db-bc35c36e25ac tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f2f8ba60>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:25.464914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:25.469525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:25.471213 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff6415f6-be9b-4cd7-a038-4e64308e34a1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.202675 Aug 04 14:24:25.488982 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2599/5171] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:25 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:25.488982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-254a6d23-6ac4-4175-abd8-3d9ca8cf7906 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:25.488982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-254a6d23-6ac4-4175-abd8-3d9ca8cf7906 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:25.501872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-254a6d23-6ac4-4175-abd8-3d9ca8cf7906 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:25.502858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-254a6d23-6ac4-4175-abd8-3d9ca8cf7906 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:25.504623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-254a6d23-6ac4-4175-abd8-3d9ca8cf7906 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:25.510942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-254a6d23-6ac4-4175-abd8-3d9ca8cf7906 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:25.587737 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d3e4cb36-b286-4987-a8db-bc35c36e25ac tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43" status: 202 len: 0 microversion: 2.1 time: 0.135917 Aug 04 14:24:25.589371 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2573/5172] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:24:25 2022] DELETE /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:24:25.605033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-35d134f7-564d-488a-8c77-bb3d419b706b tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f30143a0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:25.686763 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-35d134f7-564d-488a-8c77-bb3d419b706b tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43" status: 200 len: 344 microversion: 2.1 time: 0.093687 Aug 04 14:24:25.688110 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2574/5173] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:24:25 2022] GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 => generated 344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:25.812100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-254a6d23-6ac4-4175-abd8-3d9ca8cf7906 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:25.825529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-254a6d23-6ac4-4175-abd8-3d9ca8cf7906 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.348002 Aug 04 14:24:25.830056 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2600/5174] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:25 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:25.852349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-122c115d-879f-4a7f-b9fe-aa6e3b10346f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:25.853440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-122c115d-879f-4a7f-b9fe-aa6e3b10346f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:25.861889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:25.863863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-122c115d-879f-4a7f-b9fe-aa6e3b10346f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:25.868909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-122c115d-879f-4a7f-b9fe-aa6e3b10346f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:25.873003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-122c115d-879f-4a7f-b9fe-aa6e3b10346f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:25.873504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-122c115d-879f-4a7f-b9fe-aa6e3b10346f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:26.129591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:26.132347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:26.183835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:26.185231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:26.187045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:26.188218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:26.225482 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 HTTP/1.1 Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b674f7bb-a83a-4eb5-9f9d-bcca0740b251'} Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:26.229550 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.240945 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.247473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:26.250188 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b2a17ac-8fd7-41b4-8e77-84cfeb0d4252 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 404 len: 111 microversion: 2.1 time: 0.130510 Aug 04 14:24:26.251768 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2601/5175] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:26 2022] DELETE /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:24:26.285711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:26.291119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: b674f7bb-a83a-4eb5-9f9d-bcca0740b251] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:26.325073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:26.329921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:26.334670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:26.335465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:26.369789 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 HTTP/1.1 Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b674f7bb-a83a-4eb5-9f9d-bcca0740b251'} Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:26.371441 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance b674f7bb-a83a-4eb5-9f9d-bcca0740b251 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7b80571-b7b1-4c67-9663-81ee3bc38d70 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251" status: 404 len: 111 microversion: 2.1 time: 0.114670 Aug 04 14:24:26.382740 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2602/5176] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:26 2022] GET /compute/v2.1/servers/b674f7bb-a83a-4eb5-9f9d-bcca0740b251 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:26.488771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-122c115d-879f-4a7f-b9fe-aa6e3b10346f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:26.499552 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-122c115d-879f-4a7f-b9fe-aa6e3b10346f tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1669 microversion: 2.1 time: 0.651144 Aug 04 14:24:26.508161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:26.508911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:26.522092 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2575/5177] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:25 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1669 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:26.525748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:26.526203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:26.527062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:26.531309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:26.549764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:26.550285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:26.576109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:26.576610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:26.577576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:26.578026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:26.639881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:24:26.649302 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.api [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Working on deleting snapshot 8a87acd0-1d79-4c47-b622-971e9be39df8 from shelved instance... Aug 04 14:24:26.836831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:26.850343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:26.852039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:26.853373 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6d614767-c8aa-405b-9cad-be8d4334f71c tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.349921 Aug 04 14:24:26.856438 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2603/5178] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:26 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:24:26.863733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c8af81ea-cedf-43f9-b87a-5da5be9563ec tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f39d2160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:26.988532 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c8af81ea-cedf-43f9-b87a-5da5be9563ec tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43" status: 200 len: 344 microversion: 2.1 time: 0.130557 Aug 04 14:24:26.989153 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2604/5179] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:24:26 2022] GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 => generated 344 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:27.884826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:27.885838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:27.930163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:27.930524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:27.933267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:27.933736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:28.075964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Doing local delete in cell bcbf8c79-9a07-4e65-bf7e-ab53299315fa(cell1) {{(pid=130961) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 04 14:24:28.078407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:28.082014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:28.082729 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.api [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 04 14:24:28.090145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] deallocate_for_instance() {{(pid=130961) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 04 14:24:28.207033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:28.223845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:28.229097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:28.233078 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-82291d26-764d-4fb9-b43a-2c0430ea9e74 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1366 microversion: 2.47 time: 0.358876 Aug 04 14:24:28.249760 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2605/5180] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:27 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:28.262329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fdbd365c-095a-4814-a48d-22510ba7df50 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f4700279e50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:28.352275 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fdbd365c-095a-4814-a48d-22510ba7df50 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43" status: 200 len: 344 microversion: 2.1 time: 0.100865 Aug 04 14:24:28.353337 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2606/5181] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:24:28 2022] GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:29.265951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:29.267941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:29.283127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:29.291766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:29.293148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:29.293738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:29.452614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Updating instance_info_cache with network_info: [] {{(pid=130961) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 14:24:29.539105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:29.560458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:29.565600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:29.572916 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe024c06-5abc-4ae3-ba43-4e53d194f78f tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1372 microversion: 2.47 time: 0.312952 Aug 04 14:24:29.598562 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2607/5182] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:29 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:24:29.611857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0020d627-f761-41ab-a359-7a7b9e1f1e51 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f2fa6820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:29.660758 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-0020d627-f761-41ab-a359-7a7b9e1f1e51 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] HTTP exception thrown: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0020d627-f761-41ab-a359-7a7b9e1f1e51 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Request method failure captured: Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 HTTP/1.1 Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69aPI-mHSyZEo3hugw3VGrn0M550xyIKW6erQAtzfLltpDoPYCebsdxJ9uXVIf224RlcLYWia37IH3e05iqk3XliTPVo_0wZIb0BaZdAhqn6ynlXzCS-WHwr_2Ll54KCS08yHsN1njDkdWjQ48wW9gz3n2-jC1u_X3x3sEVqBzAROPA Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 30e4862b955c4b84ac547e4b3f8c37e3 Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30e4862b955c4b84ac547e4b3f8c37e3"}]}] Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 30e4862b955c4b84ac547e4b3f8c37e3 Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-VolumesSnapshotsTestJSON-709668947-project Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 1f7e69e5a7f1433e8136713134e4e62f Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-VolumesSnapshotsTestJSON-709668947-project Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: exception: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b4692f87-ae27-4064-a59b-2a760f718a43'} Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. (HTTP 404) (Request-ID: req-691d993d-683e-4382-ad45-37ba7e9544b3) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 14:24:29.664392 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.668998 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.678432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0020d627-f761-41ab-a359-7a7b9e1f1e51 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Returning 404 to user: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:29.679797 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0020d627-f761-41ab-a359-7a7b9e1f1e51 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43" status: 404 len: 109 microversion: 2.1 time: 0.079772 Aug 04 14:24:29.681491 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2608/5183] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:24:29 2022] GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:29.692230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-03c509ba-82d1-403c-8340-21095ba876aa req-91c78196-2a9d-4c4e-bb9d-cc23c109c65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b", "name": "network-vif-deleted", "tag": "688a69e0-ad1b-4bf0-b7d0-abe23e04c91e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:29.709387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-03c509ba-82d1-403c-8340-21095ba876aa req-91c78196-2a9d-4c4e-bb9d-cc23c109c65b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:29.710391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-03c509ba-82d1-403c-8340-21095ba876aa req-91c78196-2a9d-4c4e-bb9d-cc23c109c65b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:29.750490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.compute.server_external_events [req-03c509ba-82d1-403c-8340-21095ba876aa req-91c78196-2a9d-4c4e-bb9d-cc23c109c65b service nova] Unable to find a host for instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b. Dropping event network-vif-deleted {{(pid=130960) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 14:24:29.752048 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-03c509ba-82d1-403c-8340-21095ba876aa req-91c78196-2a9d-4c4e-bb9d-cc23c109c65b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.069233 Aug 04 14:24:29.753503 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2609/5184] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 14:24:29.760484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-544b0c75-639e-4b91-a6dc-9b63495584b8 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f46f39d2e50>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:29.827812 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-544b0c75-639e-4b91-a6dc-9b63495584b8 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] HTTP exception thrown: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-544b0c75-639e-4b91-a6dc-9b63495584b8 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Request method failure captured: Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 HTTP/1.1 Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69aPI-mHSyZEo3hugw3VGrn0M550xyIKW6erQAtzfLltpDoPYCebsdxJ9uXVIf224RlcLYWia37IH3e05iqk3XliTPVo_0wZIb0BaZdAhqn6ynlXzCS-WHwr_2Ll54KCS08yHsN1njDkdWjQ48wW9gz3n2-jC1u_X3x3sEVqBzAROPA Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 30e4862b955c4b84ac547e4b3f8c37e3 Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30e4862b955c4b84ac547e4b3f8c37e3"}]}] Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 30e4862b955c4b84ac547e4b3f8c37e3 Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-VolumesSnapshotsTestJSON-709668947-project Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 1f7e69e5a7f1433e8136713134e4e62f Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-VolumesSnapshotsTestJSON-709668947-project Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: exception: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b4692f87-ae27-4064-a59b-2a760f718a43'} Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. (HTTP 404) (Request-ID: req-e6976f6d-4470-4b7f-a3f3-226af4c9255c) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 14:24:29.830284 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.834522 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.841357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-544b0c75-639e-4b91-a6dc-9b63495584b8 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Returning 404 to user: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:29.842523 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-544b0c75-639e-4b91-a6dc-9b63495584b8 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43" status: 404 len: 109 microversion: 2.1 time: 0.087720 Aug 04 14:24:29.843352 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2610/5185] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:24:29 2022] DELETE /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:29.854990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc69b0e3-d8ce-4902-9994-9b36a5e39ff9 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Calling method '.version_select at 0x7f47000138b0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:29.892403 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-dc69b0e3-d8ce-4902-9994-9b36a5e39ff9 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] HTTP exception thrown: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc69b0e3-d8ce-4902-9994-9b36a5e39ff9 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Request method failure captured: Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 HTTP/1.1 Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69aPI-mHSyZEo3hugw3VGrn0M550xyIKW6erQAtzfLltpDoPYCebsdxJ9uXVIf224RlcLYWia37IH3e05iqk3XliTPVo_0wZIb0BaZdAhqn6ynlXzCS-WHwr_2Ll54KCS08yHsN1njDkdWjQ48wW9gz3n2-jC1u_X3x3sEVqBzAROPA Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 30e4862b955c4b84ac547e4b3f8c37e3 Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/30e4862b955c4b84ac547e4b3f8c37e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/30e4862b955c4b84ac547e4b3f8c37e3"}]}] Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 30e4862b955c4b84ac547e4b3f8c37e3 Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-709668947 Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-VolumesSnapshotsTestJSON-709668947-project Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 1f7e69e5a7f1433e8136713134e4e62f Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-VolumesSnapshotsTestJSON-709668947-project Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: method: Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: exception: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b4692f87-ae27-4064-a59b-2a760f718a43'} Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. (HTTP 404) (Request-ID: req-ec467140-2d05-4463-b0a5-1101ce5c7c0c) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 14:24:29.894887 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. Aug 04 14:24:29.899236 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:29.905873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc69b0e3-d8ce-4902-9994-9b36a5e39ff9 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] Returning 404 to user: Volume b4692f87-ae27-4064-a59b-2a760f718a43 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:29.907396 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc69b0e3-d8ce-4902-9994-9b36a5e39ff9 tempest-VolumesSnapshotsTestJSON-709668947 tempest-VolumesSnapshotsTestJSON-709668947-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43" status: 404 len: 109 microversion: 2.1 time: 0.057147 Aug 04 14:24:29.909122 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2611/5186] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:24:29 2022] GET /compute/v2.1/os-volumes/b4692f87-ae27-4064-a59b-2a760f718a43 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:30.604545 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8bbe7054-b753-466b-bcd5-42f5f25434be tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 204 len: 0 microversion: 2.1 time: 4.059963 Aug 04 14:24:30.609612 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2576/5187] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:26 2022] DELETE /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 0 bytes in 4066 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:24:30.627644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:30.632703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:30.634383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:30.639980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:30.656069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:30.657318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:30.659026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:30.660081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:30.667722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:30.668188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:30.677815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:30.678289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:30.691647 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] HTTP exception thrown: Instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b could not be found. Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Request method failure captured: Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b HTTP/1.1 Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69PdQ6CdUQxNSy7TkA4fBGjPoslvq7Ft85Pm1SsCCTmFUUA03IvGoXACFxjT0F4hgNK860bOV6Gr03a6EeVgBEsLZ4N2k5i2V30HcZSbG5Ve4RZWPCMWlwkc_zt54N8YIO0cwDQj8IvSMG3SP6RPiuzPKHKqgqT6_uqL9iRVucAGG6I Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}] Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: fab9d445099545e98979afa009678007 Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b could not be found. Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b'} Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b could not be found. Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b could not be found. Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:30.696357 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:30.707512 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:30.707512 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:30.707512 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:30.707512 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:30.707512 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:30.707512 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b could not be found. Aug 04 14:24:30.707512 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:30.707512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Returning 404 to user: Instance 4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:30.710601 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-01858c25-dbb3-4ff7-a29e-f437c80bd7e2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b" status: 404 len: 111 microversion: 2.1 time: 0.095659 Aug 04 14:24:30.712409 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2577/5188] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:30 2022] GET /compute/v2.1/servers/4d3bced1-cf4b-4d03-b9a9-e3c040cd4c1b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:24:30.732489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8932340b-b7bf-4aaa-844b-ea91f5a65e34 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:30.737535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8932340b-b7bf-4aaa-844b-ea91f5a65e34 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:30.761037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8932340b-b7bf-4aaa-844b-ea91f5a65e34 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:30.767307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8932340b-b7bf-4aaa-844b-ea91f5a65e34 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:30.774559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8932340b-b7bf-4aaa-844b-ea91f5a65e34 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:30.775758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8932340b-b7bf-4aaa-844b-ea91f5a65e34 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:30.887687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8932340b-b7bf-4aaa-844b-ea91f5a65e34 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:24:30.920810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:30.935751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:30.937505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:30.943480 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-26571201-55e2-4405-9cb0-0fac305dfb7b tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1372 microversion: 2.47 time: 0.341026 Aug 04 14:24:30.956907 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2612/5189] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:30 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1372 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:31.091419 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8932340b-b7bf-4aaa-844b-ea91f5a65e34 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 204 len: 0 microversion: 2.1 time: 0.372118 Aug 04 14:24:31.094431 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2578/5190] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:30 2022] DELETE /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:24:31.102814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b13e4bbd-4f66-4eea-bc23-fbf4fc27ea07 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:31.103867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b13e4bbd-4f66-4eea-bc23-fbf4fc27ea07 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:31.120792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b13e4bbd-4f66-4eea-bc23-fbf4fc27ea07 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:31.126491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b13e4bbd-4f66-4eea-bc23-fbf4fc27ea07 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:31.130442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b13e4bbd-4f66-4eea-bc23-fbf4fc27ea07 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:31.131169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b13e4bbd-4f66-4eea-bc23-fbf4fc27ea07 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:31.302298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b13e4bbd-4f66-4eea-bc23-fbf4fc27ea07 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:31.336265 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b13e4bbd-4f66-4eea-bc23-fbf4fc27ea07 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1465 microversion: 2.1 time: 0.236176 Aug 04 14:24:31.344093 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2613/5191] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:31 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1465 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:32.003210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:32.006633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:32.022737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:32.023876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:32.025934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:32.027139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:32.194365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:32.217701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:32.241551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:32.245595 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ede750d-acca-4c01-97c2-ddcecd7cd608 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1372 microversion: 2.47 time: 0.271534 Aug 04 14:24:32.247581 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2579/5192] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:31 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:32.393616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1e4f1990-f7bf-4ab5-9eea-c66263787c2b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:32.395093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1e4f1990-f7bf-4ab5-9eea-c66263787c2b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:32.414741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e4f1990-f7bf-4ab5-9eea-c66263787c2b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:32.415881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e4f1990-f7bf-4ab5-9eea-c66263787c2b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:32.419889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e4f1990-f7bf-4ab5-9eea-c66263787c2b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:32.434859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e4f1990-f7bf-4ab5-9eea-c66263787c2b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:32.923134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1e4f1990-f7bf-4ab5-9eea-c66263787c2b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:32.950332 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1e4f1990-f7bf-4ab5-9eea-c66263787c2b tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1465 microversion: 2.1 time: 0.570446 Aug 04 14:24:32.977617 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2614/5193] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:32 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1465 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:33.293188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:33.296017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:33.325368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:33.328668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:33.330808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:33.335519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:33.551517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:33.598695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:33.612802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:33.623044 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d2a743b-67d6-43c2-ae1d-c55b26bf3a50 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1357 microversion: 2.47 time: 0.336299 Aug 04 14:24:33.634933 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2580/5194] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:33 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1357 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:33.699218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:33.701979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:33.703012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:33.736025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:33.737409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:33.739132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:33.740210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:33.740636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:33.743153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Searching by: {'deleted': False, 'project_id': 'a57015c84b374f9e9668de714fad1505'} {{(pid=130960) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 14:24:33.754613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:33.776773 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 HTTP/1.1 Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd99315bc-8884-4e97-87ec-9f88968eb678'} Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:33.780791 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.792115 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.796535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:33.801013 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b74c5a6f-5b04-4f52-a686-22cec6d6f045 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 404 len: 111 microversion: 2.1 time: 0.119258 Aug 04 14:24:33.802924 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2581/5195] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:33 2022] DELETE /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:33.806322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:33.818644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:33.820984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:33.823106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:33.825151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d99315bc-8884-4e97-87ec-9f88968eb678] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:33.826884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:33.870907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:33.872355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:33.874002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:33.879118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:33.914862 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 HTTP/1.1 Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd99315bc-8884-4e97-87ec-9f88968eb678'} Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:33.918463 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.929999 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:33.929999 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:33.929999 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:33.929999 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:33.929999 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:33.929999 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. Aug 04 14:24:33.929999 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:33.929999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance d99315bc-8884-4e97-87ec-9f88968eb678 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:33.929999 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ef02fabe-7fb1-438e-8d2f-980235d17975 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678" status: 404 len: 111 microversion: 2.1 time: 0.116128 Aug 04 14:24:33.936728 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2582/5196] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:33 2022] GET /compute/v2.1/servers/d99315bc-8884-4e97-87ec-9f88968eb678 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:24:33.966469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:33.970631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:33.997766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:33.998813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:34.000104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:34.001722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:34.078477 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 HTTP/1.1 Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4'} Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:34.089502 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:34.098396 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-83188117-9578-4f2b-a4a2-3c3bf9465e3c tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 404 len: 111 microversion: 2.1 time: 0.152611 Aug 04 14:24:34.103110 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2583/5197] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:33 2022] DELETE /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:34.129383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a36539b-f569-4c36-adbc-5bd3787c9f49 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:34.130744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3a36539b-f569-4c36-adbc-5bd3787c9f49 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:34.148276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a36539b-f569-4c36-adbc-5bd3787c9f49 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:34.160384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a36539b-f569-4c36-adbc-5bd3787c9f49 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:34.171723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a36539b-f569-4c36-adbc-5bd3787c9f49 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:34.180545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a36539b-f569-4c36-adbc-5bd3787c9f49 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:34.298876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.multi_cell_list [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130960) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 14:24:34.626347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3a36539b-f569-4c36-adbc-5bd3787c9f49 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:34.667626 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a36539b-f569-4c36-adbc-5bd3787c9f49 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1465 microversion: 2.1 time: 0.562699 Aug 04 14:24:34.670038 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2584/5198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:34 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1465 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:34.686714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:34.690984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:34.716719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:34.733187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:34.734387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:34.735901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:34.736852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:34.761928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:34.771208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:34.790482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:34.839053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:34.843506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:34.845352 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 HTTP/1.1 Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4'} Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:34.854427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-54c06d6d-32d4-49eb-ae08-fcf21243b80e tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4" status: 404 len: 111 microversion: 2.1 time: 0.185577 Aug 04 14:24:34.862048 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2585/5199] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:34 2022] GET /compute/v2.1/servers/d4bd9dd2-429f-4fee-aaa6-8849e0ec3ae4 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:35.009829 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0991daee-c28d-4346-8281-246f9421dbf4 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 1.326414 Aug 04 14:24:35.021745 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2615/5200] 10.222.0.66 () {60 vars in 1187 bytes} [Thu Aug 4 14:24:33 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:35.077343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7829cc9f-a2ed-4732-a8c4-509453093b15 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:35.091370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7829cc9f-a2ed-4732-a8c4-509453093b15 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:35.165518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7829cc9f-a2ed-4732-a8c4-509453093b15 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:35.167115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7829cc9f-a2ed-4732-a8c4-509453093b15 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:35.171105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7829cc9f-a2ed-4732-a8c4-509453093b15 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:35.175876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7829cc9f-a2ed-4732-a8c4-509453093b15 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:35.425899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7829cc9f-a2ed-4732-a8c4-509453093b15 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:24:35.608491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-704a5630-2bf9-4c11-8f6a-57bccbc4fa2b req-43eb9763-31e7-4aec-b4c0-43b46d22882e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4480884a-f303-453b-9b47-6f5b91ef2a14", "name": "network-vif-deleted", "tag": "407ba1bf-3231-4192-88ac-38ce7dbbbc56"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:35.661686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-704a5630-2bf9-4c11-8f6a-57bccbc4fa2b req-43eb9763-31e7-4aec-b4c0-43b46d22882e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:35.669033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-704a5630-2bf9-4c11-8f6a-57bccbc4fa2b req-43eb9763-31e7-4aec-b4c0-43b46d22882e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:35.730866 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-704a5630-2bf9-4c11-8f6a-57bccbc4fa2b req-43eb9763-31e7-4aec-b4c0-43b46d22882e service nova] Creating event network-vif-deleted:407ba1bf-3231-4192-88ac-38ce7dbbbc56 for instance 4480884a-f303-453b-9b47-6f5b91ef2a14 on n-h2-844627-10 Aug 04 14:24:35.748155 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-704a5630-2bf9-4c11-8f6a-57bccbc4fa2b req-43eb9763-31e7-4aec-b4c0-43b46d22882e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.886623 Aug 04 14:24:35.752790 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2586/5201] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:35.769755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:35.775339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:35.794766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:35.798198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:35.800835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:35.802870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:35.879879 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7829cc9f-a2ed-4732-a8c4-509453093b15 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 204 len: 0 microversion: 2.47 time: 0.805496 Aug 04 14:24:35.889389 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2616/5202] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:24:35 2022] DELETE /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:24:35.909744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:35.910993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:35.958234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:35.959060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:35.960522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:35.961309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:35.962608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:35.963639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:35.964510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lazy-loading 'fault' on Instance uuid 4480884a-f303-453b-9b47-6f5b91ef2a14 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:24:36.702635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:36.715014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bfad05ae-1448-4b5f-90b0-49acdbcc3413 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 200 len: 1305 microversion: 2.1 time: 0.957254 Aug 04 14:24:36.716210 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2587/5203] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:35 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 1305 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:36.796951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:36.837574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:36.847046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:36.853698 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-74d29823-d42b-4a31-9ce0-9d881c44752a tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1363 microversion: 2.47 time: 0.955742 Aug 04 14:24:36.858820 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2617/5204] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:35 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1363 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:24:37.742778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:37.743677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 4480884a-f303-453b-9b47-6f5b91ef2a14] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:37.758130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:37.761689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:37.764807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:37.766407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:37.811419 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] HTTP exception thrown: Instance 4480884a-f303-453b-9b47-6f5b91ef2a14 could not be found. Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Request method failure captured: Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 HTTP/1.1 Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69PdQ6CdUQxNSy7TkA4fBGjPoslvq7Ft85Pm1SsCCTmFUUA03IvGoXACFxjT0F4hgNK860bOV6Gr03a6EeVgBEsLZ4N2k5i2V30HcZSbG5Ve4RZWPCMWlwkc_zt54N8YIO0cwDQj8IvSMG3SP6RPiuzPKHKqgqT6_uqL9iRVucAGG6I Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}] Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: fab9d445099545e98979afa009678007 Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4480884a-f303-453b-9b47-6f5b91ef2a14 could not be found. Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4480884a-f303-453b-9b47-6f5b91ef2a14'} Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4480884a-f303-453b-9b47-6f5b91ef2a14 could not be found. Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4480884a-f303-453b-9b47-6f5b91ef2a14 could not be found. Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:37.813985 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:37.820211 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:37.820211 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:37.820211 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:37.820211 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:37.820211 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:37.820211 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4480884a-f303-453b-9b47-6f5b91ef2a14 could not be found. Aug 04 14:24:37.820211 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:37.822312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Returning 404 to user: Instance 4480884a-f303-453b-9b47-6f5b91ef2a14 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:37.825170 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf5ba633-2e40-4035-a549-c19109897654 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14" status: 404 len: 111 microversion: 2.1 time: 0.086709 Aug 04 14:24:37.833680 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2588/5205] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:37 2022] GET /compute/v2.1/servers/4480884a-f303-453b-9b47-6f5b91ef2a14 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:24:37.871645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4871ff3-111d-4236-85a7-9ae51b03c8ec tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:37.872596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e4871ff3-111d-4236-85a7-9ae51b03c8ec tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:37.891177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:37.892392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:37.911885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4871ff3-111d-4236-85a7-9ae51b03c8ec tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:37.914789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:37.915444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:37.916492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4871ff3-111d-4236-85a7-9ae51b03c8ec tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:37.917699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:37.921201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:37.922143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4871ff3-111d-4236-85a7-9ae51b03c8ec tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:37.929040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4871ff3-111d-4236-85a7-9ae51b03c8ec tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:38.095750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e4871ff3-111d-4236-85a7-9ae51b03c8ec tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:24:38.112799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:38.124899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:38.136452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:38.140658 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0e169bde-b1f9-4317-908b-8e68d61ed612 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1363 microversion: 2.47 time: 0.259061 Aug 04 14:24:38.163733 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2589/5206] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:37 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:38.379350 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e4871ff3-111d-4236-85a7-9ae51b03c8ec tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 204 len: 0 microversion: 2.1 time: 0.544197 Aug 04 14:24:38.387369 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2618/5207] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:37 2022] DELETE /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:24:38.392780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c84cdc43-3bc5-4bde-b14c-d67caebd1867 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:38.393426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c84cdc43-3bc5-4bde-b14c-d67caebd1867 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:38.409188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c84cdc43-3bc5-4bde-b14c-d67caebd1867 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:38.409740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c84cdc43-3bc5-4bde-b14c-d67caebd1867 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:38.413845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c84cdc43-3bc5-4bde-b14c-d67caebd1867 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:38.414313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c84cdc43-3bc5-4bde-b14c-d67caebd1867 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:39.179605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:39.181666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:39.202214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:39.216180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:39.219927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:39.220969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:39.300328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:39.301154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:39.307001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lazy-loading 'fault' on Instance uuid dd2a911c-c84e-4c57-8841-dc3de55b6632 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:24:39.355093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c84cdc43-3bc5-4bde-b14c-d67caebd1867 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:39.390705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:39.407486 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c84cdc43-3bc5-4bde-b14c-d67caebd1867 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1507 microversion: 2.1 time: 1.018796 Aug 04 14:24:39.408170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:39.410761 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2590/5208] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:38 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1507 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:39.413218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:39.414817 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6c5175fe-d53a-4e7e-b99b-0e90a0d2bc8d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 200 len: 1368 microversion: 2.47 time: 0.243088 Aug 04 14:24:39.415457 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2619/5209] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:39 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:40.455067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b36c1ac-b0c5-450b-a5e4-0345a4c33f68 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:40.456466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b36c1ac-b0c5-450b-a5e4-0345a4c33f68 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:40.464379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:40.468028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: dd2a911c-c84e-4c57-8841-dc3de55b6632] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:40.476816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b36c1ac-b0c5-450b-a5e4-0345a4c33f68 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:40.477373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b36c1ac-b0c5-450b-a5e4-0345a4c33f68 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:40.482123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b36c1ac-b0c5-450b-a5e4-0345a4c33f68 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:40.482596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b36c1ac-b0c5-450b-a5e4-0345a4c33f68 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:40.501012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:40.502038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:40.508046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:40.517727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:40.569572 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] HTTP exception thrown: Instance dd2a911c-c84e-4c57-8841-dc3de55b6632 could not be found. Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Request method failure captured: Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 HTTP/1.1 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69ZxdLWHMWJFKSJ8A5_ytyXRjVvMC6dcfsbx6_8hx3yvJvv8PQ3mqZyN1uXCYxpS3_zJj8LjJQrUc8wtKFP2GF6ftlaT6NV8KEy8lF6mPe6i-5BZszRMCAwD93PEyOo5fNeVwu3J-bRgxDfMZJSygB5NUzvRj8tTygKZ43YlGpcToSg Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: a57015c84b374f9e9668de714fad1505 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerShowV247Test-507877002 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a57015c84b374f9e9668de714fad1505"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a57015c84b374f9e9668de714fad1505"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a57015c84b374f9e9668de714fad1505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a57015c84b374f9e9668de714fad1505"}]}] Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerShowV247Test-507877002 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: a57015c84b374f9e9668de714fad1505 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerShowV247Test-507877002 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerShowV247Test-507877002-project Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 57bd71bd5d474daea5bd118a85bce8d6 Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerShowV247Test-507877002-project Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance dd2a911c-c84e-4c57-8841-dc3de55b6632 could not be found. Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dd2a911c-c84e-4c57-8841-dc3de55b6632'} Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd2a911c-c84e-4c57-8841-dc3de55b6632 could not be found. Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd2a911c-c84e-4c57-8841-dc3de55b6632 could not be found. Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:40.573901 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:40.580393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:40.580393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:40.580393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:40.580393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:40.580393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:40.580393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd2a911c-c84e-4c57-8841-dc3de55b6632 could not be found. Aug 04 14:24:40.580393 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:40.584264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Returning 404 to user: Instance dd2a911c-c84e-4c57-8841-dc3de55b6632 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:40.586075 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68f11cb8-d480-4cb3-acd7-41d58bbf2097 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632" status: 404 len: 111 microversion: 2.47 time: 0.145435 Aug 04 14:24:40.587274 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2591/5210] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:40 2022] GET /compute/v2.1/servers/dd2a911c-c84e-4c57-8841-dc3de55b6632 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:24:40.623841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d496480e-67a2-4407-b220-1a405a07447e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:40.626330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d496480e-67a2-4407-b220-1a405a07447e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: da6a3ece-952b-40da-b633-99ebe095820e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:40.657417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d496480e-67a2-4407-b220-1a405a07447e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:40.662622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d496480e-67a2-4407-b220-1a405a07447e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:40.667011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d496480e-67a2-4407-b220-1a405a07447e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:40.671029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d496480e-67a2-4407-b220-1a405a07447e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:40.795444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d496480e-67a2-4407-b220-1a405a07447e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: da6a3ece-952b-40da-b633-99ebe095820e] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:24:40.945642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b36c1ac-b0c5-450b-a5e4-0345a4c33f68 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:40.986246 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b36c1ac-b0c5-450b-a5e4-0345a4c33f68 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 200 len: 1465 microversion: 2.1 time: 0.536430 Aug 04 14:24:41.009516 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2620/5211] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:40 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 1465 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:24:41.039341 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d496480e-67a2-4407-b220-1a405a07447e tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "DELETE /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e" status: 204 len: 0 microversion: 2.47 time: 0.436128 Aug 04 14:24:41.044315 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2592/5212] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:24:40 2022] DELETE /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:24:41.092096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c12265cb-d3e1-4492-9af5-efe1f5f213ef req-0e93cca6-33d9-475c-9163-5ed6d51cef0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9", "name": "network-vif-deleted", "tag": "9c9f1515-2d6f-4569-b095-ded0042ee91e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:41.097289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:41.111721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: da6a3ece-952b-40da-b633-99ebe095820e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:41.112634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c12265cb-d3e1-4492-9af5-efe1f5f213ef req-0e93cca6-33d9-475c-9163-5ed6d51cef0f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:41.113437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c12265cb-d3e1-4492-9af5-efe1f5f213ef req-0e93cca6-33d9-475c-9163-5ed6d51cef0f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:41.130817 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c12265cb-d3e1-4492-9af5-efe1f5f213ef req-0e93cca6-33d9-475c-9163-5ed6d51cef0f service nova] Creating event network-vif-deleted:9c9f1515-2d6f-4569-b095-ded0042ee91e for instance 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 on n-h2-844627-10 Aug 04 14:24:41.138554 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c12265cb-d3e1-4492-9af5-efe1f5f213ef req-0e93cca6-33d9-475c-9163-5ed6d51cef0f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051440 Aug 04 14:24:41.139965 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2593/5213] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:41.148590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:41.149340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:41.151763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:41.157167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:41.908016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:41.950519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:41.966842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:41.977993 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-422809b7-d6fe-425d-82a5-e459f6276ee1 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e" status: 200 len: 1363 microversion: 2.47 time: 0.918086 Aug 04 14:24:41.979824 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2621/5214] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:41 2022] GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e => generated 1363 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:42.064142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:42.065694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:42.102347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.103403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:42.108529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.109751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:42.147181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:42.162353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:42.193517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.196255 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] HTTP exception thrown: Instance 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 could not be found. Aug 04 14:24:42.198351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:42.200208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.203183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Request method failure captured: Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 HTTP/1.1 Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69PdQ6CdUQxNSy7TkA4fBGjPoslvq7Ft85Pm1SsCCTmFUUA03IvGoXACFxjT0F4hgNK860bOV6Gr03a6EeVgBEsLZ4N2k5i2V30HcZSbG5Ve4RZWPCMWlwkc_zt54N8YIO0cwDQj8IvSMG3SP6RPiuzPKHKqgqT6_uqL9iRVucAGG6I Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}] Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: fab9d445099545e98979afa009678007 Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 could not be found. Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9'} Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 could not be found. Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 could not be found. Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:42.213230 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 could not be found. Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Returning 404 to user: Instance 7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a3d3741-52f2-4445-bc2a-c1c1a7213acc tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9" status: 404 len: 111 microversion: 2.1 time: 0.164703 Aug 04 14:24:42.221880 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2594/5215] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:42 2022] GET /compute/v2.1/servers/7ac1b723-e3f7-48e4-a134-ed5c6ad89cb9 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:42.238527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a5ca36ff-1b9f-4877-96a0-5c17fc6fb61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:42.239266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a5ca36ff-1b9f-4877-96a0-5c17fc6fb61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:42.272533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5ca36ff-1b9f-4877-96a0-5c17fc6fb61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.273615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5ca36ff-1b9f-4877-96a0-5c17fc6fb61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:42.275095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5ca36ff-1b9f-4877-96a0-5c17fc6fb61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.275881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5ca36ff-1b9f-4877-96a0-5c17fc6fb61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:42.280899 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d HTTP/1.1 Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d'} Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:42.290548 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e81e23c9-c144-4478-9b79-5874a4e4b203 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 404 len: 111 microversion: 2.1 time: 0.159278 Aug 04 14:24:42.309832 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2622/5216] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:42 2022] DELETE /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:24:42.314842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:42.321676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] [instance: df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:42.334365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.335059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:42.336287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.343876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:42.375466 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] HTTP exception thrown: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Request method failure captured: Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d HTTP/1.1 Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69RoA9N8BWkPD99DV_kc2Nkl0fsMIi6kTvtT569-ZYVMJT2wGlBDtI_53xysrOpIEcOuKPxVB-PXV-5BzY_X78hYQeFg0OXg-sM0GZpYqiFZTReq11JZpzmgzZ1J-TmUwrNuuj8w5_oRz83t2UWu0nZyRUbT7cYQ9la-CqjdTPYbMLU Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9a2b9bbf2acf40e894f49d12ef51e0aa"}]}] Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 9a2b9bbf2acf40e894f49d12ef51e0aa Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-544087421 Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 0a5b06982b8b43ef98866e495427d381 Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeNegativeTest-544087421-project Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d'} Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:42.377755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] Returning 404 to user: Instance df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4c00c19b-ce2c-42c8-b851-cef84bd03dc8 tempest-AttachVolumeNegativeTest-544087421 tempest-AttachVolumeNegativeTest-544087421-project] 10.222.0.66 "GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d" status: 404 len: 111 microversion: 2.1 time: 0.076190 Aug 04 14:24:42.393327 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2623/5217] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:42 2022] GET /compute/v2.1/servers/df5aabc6-a59d-47b3-a8ff-9d8e60bcaa8d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:42.400031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a5ca36ff-1b9f-4877-96a0-5c17fc6fb61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:24:42.599745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a5ca36ff-1b9f-4877-96a0-5c17fc6fb61d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "DELETE /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 204 len: 0 microversion: 2.1 time: 0.373591 Aug 04 14:24:42.603404 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2595/5218] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:42 2022] DELETE /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:24:42.615104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1a8e2f21-c4fc-4501-822b-b714dad00547 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:42.616062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1a8e2f21-c4fc-4501-822b-b714dad00547 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:42.636804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a8e2f21-c4fc-4501-822b-b714dad00547 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.637630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a8e2f21-c4fc-4501-822b-b714dad00547 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:42.645855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a8e2f21-c4fc-4501-822b-b714dad00547 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:42.649686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a8e2f21-c4fc-4501-822b-b714dad00547 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:43.035627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:43.037092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: da6a3ece-952b-40da-b633-99ebe095820e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:43.054138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:43.059594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:43.062261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:43.064733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:43.482809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:43.504298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:43.507287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:43.510425 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5917a8c1-22dc-4275-9151-07e978504367 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e" status: 200 len: 1363 microversion: 2.47 time: 0.481466 Aug 04 14:24:43.513656 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2596/5219] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:43 2022] GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e => generated 1363 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:43.683343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1a8e2f21-c4fc-4501-822b-b714dad00547 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:43.722575 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1a8e2f21-c4fc-4501-822b-b714dad00547 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1494 microversion: 2.1 time: 1.112102 Aug 04 14:24:43.763639 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2624/5220] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:42 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1494 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:24:44.483481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7227939a-694b-4189-818d-154f034e119c req-8b064e6f-81a9-483a-b2a8-20733713e67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12417b86-0c3b-4da6-8a39-8749c0d95322", "name": "network-vif-deleted", "tag": "a866cc15-60d9-4d91-b52e-d11a952580ab"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:44.525542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7227939a-694b-4189-818d-154f034e119c req-8b064e6f-81a9-483a-b2a8-20733713e67f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:44.526347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7227939a-694b-4189-818d-154f034e119c req-8b064e6f-81a9-483a-b2a8-20733713e67f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:44.572648 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7227939a-694b-4189-818d-154f034e119c req-8b064e6f-81a9-483a-b2a8-20733713e67f service nova] Creating event network-vif-deleted:a866cc15-60d9-4d91-b52e-d11a952580ab for instance 12417b86-0c3b-4da6-8a39-8749c0d95322 on n-h2-844627-10 Aug 04 14:24:44.574914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:44.576742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: da6a3ece-952b-40da-b633-99ebe095820e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:44.591135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:44.599433 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7227939a-694b-4189-818d-154f034e119c req-8b064e6f-81a9-483a-b2a8-20733713e67f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125874 Aug 04 14:24:44.599659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:44.600499 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2597/5221] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:44.607230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:44.610754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:44.612819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:44.731676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:44.797874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01a491ed-6082-40a4-a4c6-8f614df5487d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:44.807674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-01a491ed-6082-40a4-a4c6-8f614df5487d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:44.820342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:44.823969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:44.825976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lazy-loading 'fault' on Instance uuid da6a3ece-952b-40da-b633-99ebe095820e {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:24:44.838542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01a491ed-6082-40a4-a4c6-8f614df5487d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:44.838999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01a491ed-6082-40a4-a4c6-8f614df5487d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:44.840195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01a491ed-6082-40a4-a4c6-8f614df5487d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:44.840840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01a491ed-6082-40a4-a4c6-8f614df5487d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:44.978266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-01a491ed-6082-40a4-a4c6-8f614df5487d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:44.991344 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-01a491ed-6082-40a4-a4c6-8f614df5487d tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 200 len: 1287 microversion: 2.1 time: 0.207432 Aug 04 14:24:44.992944 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2598/5222] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:44 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 1287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:45.006152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:45.030886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:45.033360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57bd71bd5d474daea5bd118a85bce8d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57015c84b374f9e9668de714fad1505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:45.035111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-32705d95-3db0-4907-ba43-dcb46c1435c6 tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e" status: 200 len: 1368 microversion: 2.47 time: 0.474530 Aug 04 14:24:45.035729 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2625/5223] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:44 2022] GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e => generated 1368 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:24:46.032821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:46.033800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 12417b86-0c3b-4da6-8a39-8749c0d95322] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:46.055010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:46.056997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:46.060423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:46.060977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:46.085120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:46.090912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] [instance: da6a3ece-952b-40da-b633-99ebe095820e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:46.134077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:46.134723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:46.151488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:46.158874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:46.177647 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] HTTP exception thrown: Instance 12417b86-0c3b-4da6-8a39-8749c0d95322 could not be found. Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Request method failure captured: Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 HTTP/1.1 Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69PdQ6CdUQxNSy7TkA4fBGjPoslvq7Ft85Pm1SsCCTmFUUA03IvGoXACFxjT0F4hgNK860bOV6Gr03a6EeVgBEsLZ4N2k5i2V30HcZSbG5Ve4RZWPCMWlwkc_zt54N8YIO0cwDQj8IvSMG3SP6RPiuzPKHKqgqT6_uqL9iRVucAGG6I Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}] Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: fab9d445099545e98979afa009678007 Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 12417b86-0c3b-4da6-8a39-8749c0d95322 could not be found. Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '12417b86-0c3b-4da6-8a39-8749c0d95322'} Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12417b86-0c3b-4da6-8a39-8749c0d95322 could not be found. Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12417b86-0c3b-4da6-8a39-8749c0d95322 could not be found. Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:46.198938 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.209246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:46.209246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:46.209246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:46.209246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:46.209246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:46.209246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12417b86-0c3b-4da6-8a39-8749c0d95322 could not be found. Aug 04 14:24:46.209246 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.217167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Returning 404 to user: Instance 12417b86-0c3b-4da6-8a39-8749c0d95322 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:46.220378 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a4cd8d19-10a2-46ba-a688-cb5330d8a6ac tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322" status: 404 len: 111 microversion: 2.1 time: 0.192558 Aug 04 14:24:46.225296 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2599/5224] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:46 2022] GET /compute/v2.1/servers/12417b86-0c3b-4da6-8a39-8749c0d95322 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:24:46.239208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d25a3c5f-1ee2-45bf-92a5-38d1ae134627 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:46.241002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d25a3c5f-1ee2-45bf-92a5-38d1ae134627 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:46.242704 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] HTTP exception thrown: Instance da6a3ece-952b-40da-b633-99ebe095820e could not be found. Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Request method failure captured: Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e HTTP/1.1 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69ZxdLWHMWJFKSJ8A5_ytyXRjVvMC6dcfsbx6_8hx3yvJvv8PQ3mqZyN1uXCYxpS3_zJj8LjJQrUc8wtKFP2GF6ftlaT6NV8KEy8lF6mPe6i-5BZszRMCAwD93PEyOo5fNeVwu3J-bRgxDfMZJSygB5NUzvRj8tTygKZ43YlGpcToSg Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: a57015c84b374f9e9668de714fad1505 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerShowV247Test-507877002 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a57015c84b374f9e9668de714fad1505"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a57015c84b374f9e9668de714fad1505"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a57015c84b374f9e9668de714fad1505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a57015c84b374f9e9668de714fad1505"}]}] Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerShowV247Test-507877002 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: a57015c84b374f9e9668de714fad1505 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerShowV247Test-507877002 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerShowV247Test-507877002-project Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 57bd71bd5d474daea5bd118a85bce8d6 Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerShowV247Test-507877002-project Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance da6a3ece-952b-40da-b633-99ebe095820e could not be found. Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'da6a3ece-952b-40da-b633-99ebe095820e'} Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da6a3ece-952b-40da-b633-99ebe095820e could not be found. Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da6a3ece-952b-40da-b633-99ebe095820e could not be found. Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:46.244394 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.251481 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:46.251481 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:46.251481 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:46.251481 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:46.251481 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:46.251481 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da6a3ece-952b-40da-b633-99ebe095820e could not be found. Aug 04 14:24:46.251481 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:46.254724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] Returning 404 to user: Instance da6a3ece-952b-40da-b633-99ebe095820e could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:46.256209 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4bd9097f-3486-4438-b91f-c72d4046725d tempest-ServerShowV247Test-507877002 tempest-ServerShowV247Test-507877002-project] 10.222.0.66 "GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e" status: 404 len: 111 microversion: 2.47 time: 0.183860 Aug 04 14:24:46.256363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d25a3c5f-1ee2-45bf-92a5-38d1ae134627 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:46.257704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d25a3c5f-1ee2-45bf-92a5-38d1ae134627 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:46.259521 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2626/5225] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:24:46 2022] GET /compute/v2.1/servers/da6a3ece-952b-40da-b633-99ebe095820e => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:24:46.260722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d25a3c5f-1ee2-45bf-92a5-38d1ae134627 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:46.262067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d25a3c5f-1ee2-45bf-92a5-38d1ae134627 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:46.308492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d25a3c5f-1ee2-45bf-92a5-38d1ae134627 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:24:46.351120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:46.446192 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d25a3c5f-1ee2-45bf-92a5-38d1ae134627 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "DELETE /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 204 len: 0 microversion: 2.1 time: 0.211545 Aug 04 14:24:46.451235 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2600/5226] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:24:46 2022] DELETE /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:24:46.462195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab669c8f-7b68-49fd-af4a-1180b89008d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:46.462834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ab669c8f-7b68-49fd-af4a-1180b89008d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:46.475844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab669c8f-7b68-49fd-af4a-1180b89008d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:46.476649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab669c8f-7b68-49fd-af4a-1180b89008d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:46.477730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab669c8f-7b68-49fd-af4a-1180b89008d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:46.478421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab669c8f-7b68-49fd-af4a-1180b89008d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:46.986891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ab669c8f-7b68-49fd-af4a-1180b89008d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:46.998628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f78a879-e492-4eb6-a867-cd5f88d9a647 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Action: 'create', calling method: .version_select at 0x7f46f2f614c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1332073322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqY4WRw2EsoHf0+KT+oNo8uuB4pTjKogizj57qC1Jz+Ms6XAdQkjXw/V9fAr5ggcPIphvl960YqvXfzYtJfy0U1LAqH7+wW20x6QTGFvishfhES0yhX8qUk+L6eQP2+2w=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:47.009785 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab669c8f-7b68-49fd-af4a-1180b89008d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1675 microversion: 2.1 time: 0.552286 Aug 04 14:24:47.022106 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2627/5227] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:46 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1675 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:47.070801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-1f78a879-e492-4eb6-a867-cd5f88d9a647 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:24:47.097107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-1f78a879-e492-4eb6-a867-cd5f88d9a647 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for user b691f49b0fe64e8a99ca896ddba38334 and project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:24:47.224755 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f78a879-e492-4eb6-a867-cd5f88d9a647 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.230962 Aug 04 14:24:47.236304 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2601/5228] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:24:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:48.071446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-899af30a-2f3e-4ad5-acd1-3786cf008357 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:48.072635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-899af30a-2f3e-4ad5-acd1-3786cf008357 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:48.101081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-899af30a-2f3e-4ad5-acd1-3786cf008357 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:48.102353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-899af30a-2f3e-4ad5-acd1-3786cf008357 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:48.104306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-899af30a-2f3e-4ad5-acd1-3786cf008357 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:48.105454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-899af30a-2f3e-4ad5-acd1-3786cf008357 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:48.990570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-899af30a-2f3e-4ad5-acd1-3786cf008357 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:49.012979 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-899af30a-2f3e-4ad5-acd1-3786cf008357 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1675 microversion: 2.1 time: 0.946098 Aug 04 14:24:49.036236 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2628/5229] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:48 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1675 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:50.048987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7065d592-9ca8-4843-8e2d-5be09471e3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:50.049719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7065d592-9ca8-4843-8e2d-5be09471e3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:50.069823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7065d592-9ca8-4843-8e2d-5be09471e3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:50.070212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7065d592-9ca8-4843-8e2d-5be09471e3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:50.071033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7065d592-9ca8-4843-8e2d-5be09471e3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:50.071480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7065d592-9ca8-4843-8e2d-5be09471e3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:51.774362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7065d592-9ca8-4843-8e2d-5be09471e3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:51.803230 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7065d592-9ca8-4843-8e2d-5be09471e3b7 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1675 microversion: 2.1 time: 1.756284 Aug 04 14:24:51.807079 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2602/5230] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:50 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1675 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:52.832059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d1d461b7-f9a2-459c-87a1-a7faf083b015 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:52.842670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d1d461b7-f9a2-459c-87a1-a7faf083b015 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:52.861600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1d461b7-f9a2-459c-87a1-a7faf083b015 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:52.868492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1d461b7-f9a2-459c-87a1-a7faf083b015 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:52.869508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1d461b7-f9a2-459c-87a1-a7faf083b015 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:52.874369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d1d461b7-f9a2-459c-87a1-a7faf083b015 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:53.320293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d1d461b7-f9a2-459c-87a1-a7faf083b015 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:53.344256 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d1d461b7-f9a2-459c-87a1-a7faf083b015 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1608 microversion: 2.1 time: 0.518756 Aug 04 14:24:53.362843 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2629/5231] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:52 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1608 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:53.985520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-12c61ab8-6424-4cbc-8ab4-aadc57cf1afe req-f4aba6f9-eadb-4bee-af20-765fee667aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f82140-ff26-411a-8d4f-eb49f24bc20b", "name": "network-vif-deleted", "tag": "edc0555d-d42e-4fa7-bff8-c6e3192de55f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:54.000009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:54.041415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-12c61ab8-6424-4cbc-8ab4-aadc57cf1afe req-f4aba6f9-eadb-4bee-af20-765fee667aef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:54.049988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-12c61ab8-6424-4cbc-8ab4-aadc57cf1afe req-f4aba6f9-eadb-4bee-af20-765fee667aef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:54.083977 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-12c61ab8-6424-4cbc-8ab4-aadc57cf1afe req-f4aba6f9-eadb-4bee-af20-765fee667aef service nova] Creating event network-vif-deleted:edc0555d-d42e-4fa7-bff8-c6e3192de55f for instance 11f82140-ff26-411a-8d4f-eb49f24bc20b on n-h1-844627-10 Aug 04 14:24:54.102619 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-12c61ab8-6424-4cbc-8ab4-aadc57cf1afe req-f4aba6f9-eadb-4bee-af20-765fee667aef service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132219 Aug 04 14:24:54.106162 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2603/5232] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:24:54.381534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:54.393510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:54.420138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:54.447359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:54.449719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:54.453071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:54.458412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:54.556458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:54.646889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:54.647767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:54.649454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lazy-loading 'fault' on Instance uuid 11f82140-ff26-411a-8d4f-eb49f24bc20b {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:24:54.895482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab9d445099545e98979afa009678007', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2451f47c5ae54b75aa16479731e5d9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:54.922868 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-05094e76-e1b6-4cf7-9c47-bec082dfc8c0 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 200 len: 1329 microversion: 2.1 time: 0.559092 Aug 04 14:24:54.925935 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2630/5233] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:54 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 1329 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:55.226457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-597033313", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "b9877b61-8c2d-4022-8ae8-281f078fcf22"}], "key_name": "tempest-TestNetworkBasicOps-1332073322", "security_groups": [{"name": "tempest-secgroup-smoke-46031729"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:24:55.739708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] validate_networks() for [('b9877b61-8c2d-4022-8ae8-281f078fcf22', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:24:55.990458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:55.994690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] [instance: 11f82140-ff26-411a-8d4f-eb49f24bc20b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:56.038330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:56.046858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:56.053468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:56.057905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:56.186856 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] HTTP exception thrown: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b could not be found. Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Request method failure captured: Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b HTTP/1.1 Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69PdQ6CdUQxNSy7TkA4fBGjPoslvq7Ft85Pm1SsCCTmFUUA03IvGoXACFxjT0F4hgNK860bOV6Gr03a6EeVgBEsLZ4N2k5i2V30HcZSbG5Ve4RZWPCMWlwkc_zt54N8YIO0cwDQj8IvSMG3SP6RPiuzPKHKqgqT6_uqL9iRVucAGG6I Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2451f47c5ae54b75aa16479731e5d9bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2451f47c5ae54b75aa16479731e5d9bd"}]}] Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2451f47c5ae54b75aa16479731e5d9bd Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-748027196 Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: fab9d445099545e98979afa009678007 Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-748027196-project Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b could not be found. Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '11f82140-ff26-411a-8d4f-eb49f24bc20b'} Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b could not be found. Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b could not be found. Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:24:56.200029 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:56.205155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:24:56.205155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:24:56.205155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:24:56.205155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:24:56.205155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:24:56.205155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b could not be found. Aug 04 14:24:56.205155 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:24:56.205155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Returning 404 to user: Instance 11f82140-ff26-411a-8d4f-eb49f24bc20b could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:24:56.207746 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6aac79be-e838-4760-ad3f-68c4e3fad5b2 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b" status: 404 len: 111 microversion: 2.1 time: 0.245319 Aug 04 14:24:56.214421 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2631/5234] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:55 2022] GET /compute/v2.1/servers/11f82140-ff26-411a-8d4f-eb49f24bc20b => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:24:56.242809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc759af2-bff5-4aab-b5d0-af9e004f47d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] Calling method '.version_select at 0x7f46f3bf6af0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:56.352457 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc759af2-bff5-4aab-b5d0-af9e004f47d9 tempest-ServerActionsTestJSON-748027196 tempest-ServerActionsTestJSON-748027196-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051457093" status: 202 len: 0 microversion: 2.1 time: 0.131867 Aug 04 14:24:56.355204 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2632/5235] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051457093 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:24:57.131302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:24:57.775769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6c06a8df-abc2-4b5f-9b58-2181811f1354 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:57.779096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6c06a8df-abc2-4b5f-9b58-2181811f1354 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:57.805045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c06a8df-abc2-4b5f-9b58-2181811f1354 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:57.805505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c06a8df-abc2-4b5f-9b58-2181811f1354 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:57.808417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c06a8df-abc2-4b5f-9b58-2181811f1354 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:57.822113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c06a8df-abc2-4b5f-9b58-2181811f1354 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:57.900827 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6c06a8df-abc2-4b5f-9b58-2181811f1354 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/ips" status: 200 len: 147 microversion: 2.1 time: 0.150938 Aug 04 14:24:57.908979 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2633/5236] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:24:57 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/ips => generated 147 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:24:57.944546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:24:57.946702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:24:57.948156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:24:57.949420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:24:57.967231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:24:58.040484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:58.043725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:58.053344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:24:58.054751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:24:58.145789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:24:58.172832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for user b691f49b0fe64e8a99ca896ddba38334 and project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:24:58.254270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:24:58.268817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:24:58.581541 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b634ca28-7c5e-45d5-9d21-e025e6ef3e63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.358608 Aug 04 14:24:58.586549 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2604/5237] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:24:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 3377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:24:58.601539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-de493fd2-a5da-4e3d-8d9e-dba146938ef4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:58.602561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-de493fd2-a5da-4e3d-8d9e-dba146938ef4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:24:58.780304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-de493fd2-a5da-4e3d-8d9e-dba146938ef4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:24:58.797657 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-de493fd2-a5da-4e3d-8d9e-dba146938ef4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1248 microversion: 2.1 time: 0.200477 Aug 04 14:24:58.798269 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2634/5238] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:58 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1248 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:24:59.830919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c48d9305-0b95-4506-aa68-7a54e43b0249 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:24:59.832087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c48d9305-0b95-4506-aa68-7a54e43b0249 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:00.179022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c48d9305-0b95-4506-aa68-7a54e43b0249 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:00.216955 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c48d9305-0b95-4506-aa68-7a54e43b0249 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1248 microversion: 2.1 time: 0.400208 Aug 04 14:25:00.225325 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2605/5239] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:24:59 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1248 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:01.250248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-39caec4a-e021-42f7-a88c-e6c937b60f67 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:01.251255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-39caec4a-e021-42f7-a88c-e6c937b60f67 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:01.282955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39caec4a-e021-42f7-a88c-e6c937b60f67 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:01.283423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39caec4a-e021-42f7-a88c-e6c937b60f67 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:01.287418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39caec4a-e021-42f7-a88c-e6c937b60f67 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:01.287882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39caec4a-e021-42f7-a88c-e6c937b60f67 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:01.575957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-39caec4a-e021-42f7-a88c-e6c937b60f67 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:01.593607 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-39caec4a-e021-42f7-a88c-e6c937b60f67 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1244 microversion: 2.1 time: 0.348704 Aug 04 14:25:01.601978 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2635/5240] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:01 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1244 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:02.621339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4ee977d-494a-4f52-ab7d-00ff67b8d336 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:02.622745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e4ee977d-494a-4f52-ab7d-00ff67b8d336 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:02.661482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4ee977d-494a-4f52-ab7d-00ff67b8d336 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:02.665270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4ee977d-494a-4f52-ab7d-00ff67b8d336 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:02.671233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4ee977d-494a-4f52-ab7d-00ff67b8d336 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:02.674963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4ee977d-494a-4f52-ab7d-00ff67b8d336 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:03.173752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f11760c-e064-4d8e-bc87-689e7e7935b9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "037224b1-e341-4a9b-9342-66e1de6bbd33"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:25:03.183593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f11760c-e064-4d8e-bc87-689e7e7935b9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:03.204398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f11760c-e064-4d8e-bc87-689e7e7935b9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:03.206053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f11760c-e064-4d8e-bc87-689e7e7935b9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:03.208806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f11760c-e064-4d8e-bc87-689e7e7935b9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:03.210014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f11760c-e064-4d8e-bc87-689e7e7935b9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:03.967937 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f11760c-e064-4d8e-bc87-689e7e7935b9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830470 Aug 04 14:25:03.968968 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2636/5241] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:25:03 2022] POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:25:04.132446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e4ee977d-494a-4f52-ab7d-00ff67b8d336 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:04.177129 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e4ee977d-494a-4f52-ab7d-00ff67b8d336 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1306 microversion: 2.1 time: 1.565048 Aug 04 14:25:04.177786 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2606/5242] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:02 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1306 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:05.218475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6fd90346-6e07-46ef-a9f5-001b601b4587 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:05.219113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6fd90346-6e07-46ef-a9f5-001b601b4587 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:05.261286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fd90346-6e07-46ef-a9f5-001b601b4587 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:05.263788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fd90346-6e07-46ef-a9f5-001b601b4587 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:05.289421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fd90346-6e07-46ef-a9f5-001b601b4587 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:05.292211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fd90346-6e07-46ef-a9f5-001b601b4587 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:05.810738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6fd90346-6e07-46ef-a9f5-001b601b4587 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:05.833618 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6fd90346-6e07-46ef-a9f5-001b601b4587 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1306 microversion: 2.1 time: 0.621969 Aug 04 14:25:05.852780 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2637/5243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:05 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1306 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:06.862894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e65e76a-eb86-4b7b-a725-45340ed75f76 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:06.863907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e65e76a-eb86-4b7b-a725-45340ed75f76 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:06.888148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e65e76a-eb86-4b7b-a725-45340ed75f76 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:06.888614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e65e76a-eb86-4b7b-a725-45340ed75f76 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:06.894192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e65e76a-eb86-4b7b-a725-45340ed75f76 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:06.894665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e65e76a-eb86-4b7b-a725-45340ed75f76 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:08.122897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:08.243033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5e65e76a-eb86-4b7b-a725-45340ed75f76 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:08.275064 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e65e76a-eb86-4b7b-a725-45340ed75f76 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1306 microversion: 2.1 time: 1.418614 Aug 04 14:25:08.325814 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2607/5244] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:06 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1306 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:09.330202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:09.331073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:09.354098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:09.366292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:09.366990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:09.367865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:09.368320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:09.629697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:09.646621 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1306 microversion: 2.1 time: 0.320787 Aug 04 14:25:09.654379 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2638/5245] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:09 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1306 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:10.677778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:10.700517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a1e9845f-6ee0-4da6-8c6d-d666221b2664 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:10.707912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a1e9845f-6ee0-4da6-8c6d-d666221b2664 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:10.751082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1e9845f-6ee0-4da6-8c6d-d666221b2664 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:10.753099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1e9845f-6ee0-4da6-8c6d-d666221b2664 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:10.757811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1e9845f-6ee0-4da6-8c6d-d666221b2664 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:10.761156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1e9845f-6ee0-4da6-8c6d-d666221b2664 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:11.130989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:11.133798 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e053a64b-172e-43ef-bb44-c71491c7857a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004302 Aug 04 14:25:11.134557 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2639/5246] 10.222.0.66 () {56 vars in 886 bytes} [Thu Aug 4 14:25:11 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 14:25:11.759246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a1e9845f-6ee0-4da6-8c6d-d666221b2664 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:11.776555 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a1e9845f-6ee0-4da6-8c6d-d666221b2664 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1306 microversion: 2.1 time: 1.102662 Aug 04 14:25:11.782379 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2608/5247] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:10 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1306 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:12.829419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f900b272-fb4b-45a7-9daa-0ccbf9e53779 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:12.836404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f900b272-fb4b-45a7-9daa-0ccbf9e53779 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:12.877584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f900b272-fb4b-45a7-9daa-0ccbf9e53779 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:12.878940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f900b272-fb4b-45a7-9daa-0ccbf9e53779 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:12.881711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f900b272-fb4b-45a7-9daa-0ccbf9e53779 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:12.883009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f900b272-fb4b-45a7-9daa-0ccbf9e53779 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:14.366313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f900b272-fb4b-45a7-9daa-0ccbf9e53779 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:14.409497 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f900b272-fb4b-45a7-9daa-0ccbf9e53779 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 1.578284 Aug 04 14:25:14.411602 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2640/5248] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:12 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:15.440782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a87be6d8-6782-46f9-919d-d65793a0b1eb tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:15.445491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a87be6d8-6782-46f9-919d-d65793a0b1eb tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:15.462216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a87be6d8-6782-46f9-919d-d65793a0b1eb tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:15.463720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a87be6d8-6782-46f9-919d-d65793a0b1eb tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:15.466454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a87be6d8-6782-46f9-919d-d65793a0b1eb tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:15.469947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a87be6d8-6782-46f9-919d-d65793a0b1eb tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:17.873216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a87be6d8-6782-46f9-919d-d65793a0b1eb tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:17.889213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:17.895955 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a87be6d8-6782-46f9-919d-d65793a0b1eb tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 2.462870 Aug 04 14:25:17.901178 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2609/5249] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:15 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 2469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:18.944273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-85690254-8e07-415e-a89b-9bc78fe3de11 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:18.949781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-85690254-8e07-415e-a89b-9bc78fe3de11 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:19.013387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85690254-8e07-415e-a89b-9bc78fe3de11 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:19.026116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85690254-8e07-415e-a89b-9bc78fe3de11 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:19.032669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85690254-8e07-415e-a89b-9bc78fe3de11 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:19.043122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-85690254-8e07-415e-a89b-9bc78fe3de11 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:19.049383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ef858ea1-6f94-4465-861e-5b7454cc3fa2 req-cd8c6347-a6c7-4b8f-843f-f25d8abd6aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec4240d-3b2b-4672-af1e-ddf84ae128c1", "tag": "5a0a8401-a537-41ee-b37f-e28d59c29d42"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:25:19.077075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ef858ea1-6f94-4465-861e-5b7454cc3fa2 req-cd8c6347-a6c7-4b8f-843f-f25d8abd6aa0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:19.080241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ef858ea1-6f94-4465-861e-5b7454cc3fa2 req-cd8c6347-a6c7-4b8f-843f-f25d8abd6aa0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:19.110037 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ef858ea1-6f94-4465-861e-5b7454cc3fa2 req-cd8c6347-a6c7-4b8f-843f-f25d8abd6aa0 service nova] Creating event network-changed:5a0a8401-a537-41ee-b37f-e28d59c29d42 for instance fec4240d-3b2b-4672-af1e-ddf84ae128c1 on n-h2-844627-10 Aug 04 14:25:19.130213 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ef858ea1-6f94-4465-861e-5b7454cc3fa2 req-cd8c6347-a6c7-4b8f-843f-f25d8abd6aa0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085127 Aug 04 14:25:19.136138 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2610/5250] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:25:21.309044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-85690254-8e07-415e-a89b-9bc78fe3de11 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:21.320928 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-85690254-8e07-415e-a89b-9bc78fe3de11 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 2.387657 Aug 04 14:25:21.330041 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2641/5251] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:18 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 2398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:22.383401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33170405-7c1a-450a-9de7-30e6b1469099 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:22.389661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-33170405-7c1a-450a-9de7-30e6b1469099 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:22.466716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33170405-7c1a-450a-9de7-30e6b1469099 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:22.496908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33170405-7c1a-450a-9de7-30e6b1469099 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:22.502868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33170405-7c1a-450a-9de7-30e6b1469099 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:22.510281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33170405-7c1a-450a-9de7-30e6b1469099 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:23.513706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-33170405-7c1a-450a-9de7-30e6b1469099 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:23.567427 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-33170405-7c1a-450a-9de7-30e6b1469099 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 1.192917 Aug 04 14:25:23.568530 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2611/5252] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:22 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:24.606112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1f5e01df-6596-458e-99fc-ba7ca51eaa2c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:24.607464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1f5e01df-6596-458e-99fc-ba7ca51eaa2c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:24.621689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:24.656184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f5e01df-6596-458e-99fc-ba7ca51eaa2c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:24.656184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f5e01df-6596-458e-99fc-ba7ca51eaa2c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:24.656558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f5e01df-6596-458e-99fc-ba7ca51eaa2c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:24.656971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f5e01df-6596-458e-99fc-ba7ca51eaa2c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:24.746714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:25.513346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1f5e01df-6596-458e-99fc-ba7ca51eaa2c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:25.528291 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1f5e01df-6596-458e-99fc-ba7ca51eaa2c tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 0.928789 Aug 04 14:25:25.529602 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2642/5253] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:24 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:26.593509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b0376127-a255-4b0d-a5e7-a93e2f4977d8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:26.594212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b0376127-a255-4b0d-a5e7-a93e2f4977d8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:26.598130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:26.642382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0376127-a255-4b0d-a5e7-a93e2f4977d8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:26.647368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0376127-a255-4b0d-a5e7-a93e2f4977d8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:26.650656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0376127-a255-4b0d-a5e7-a93e2f4977d8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:26.658068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0376127-a255-4b0d-a5e7-a93e2f4977d8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:27.707932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b0376127-a255-4b0d-a5e7-a93e2f4977d8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:27.717194 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b0376127-a255-4b0d-a5e7-a93e2f4977d8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 1.127762 Aug 04 14:25:27.717793 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2612/5254] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:26 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:28.598647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a5c6c1c-35f7-4d57-8d0c-c134e3bcea81 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:25:28.615633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a5c6c1c-35f7-4d57-8d0c-c134e3bcea81 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:28.615633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a5c6c1c-35f7-4d57-8d0c-c134e3bcea81 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:28.683565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a5c6c1c-35f7-4d57-8d0c-c134e3bcea81 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Going to try to stop instance {{(pid=130960) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 14:25:28.750149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf20b512-a18c-4f13-ab62-5468f391a2d4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:28.755171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf20b512-a18c-4f13-ab62-5468f391a2d4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:28.779339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf20b512-a18c-4f13-ab62-5468f391a2d4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:28.787089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf20b512-a18c-4f13-ab62-5468f391a2d4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:28.790054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf20b512-a18c-4f13-ab62-5468f391a2d4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:28.791952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf20b512-a18c-4f13-ab62-5468f391a2d4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:28.810070 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a5c6c1c-35f7-4d57-8d0c-c134e3bcea81 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.211368 Aug 04 14:25:28.815810 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2643/5255] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:25:28 2022] POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:25:28.870411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-29202102-09fb-4d2e-9a9a-ed2dffae5a8b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:28.880692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-29202102-09fb-4d2e-9a9a-ed2dffae5a8b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:28.970399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29202102-09fb-4d2e-9a9a-ed2dffae5a8b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:28.975447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29202102-09fb-4d2e-9a9a-ed2dffae5a8b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:28.990832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29202102-09fb-4d2e-9a9a-ed2dffae5a8b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:28.998584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29202102-09fb-4d2e-9a9a-ed2dffae5a8b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:29.718400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cf20b512-a18c-4f13-ab62-5468f391a2d4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:29.753560 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf20b512-a18c-4f13-ab62-5468f391a2d4 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 1.011437 Aug 04 14:25:29.765215 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2613/5256] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:28 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:29.820037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-29202102-09fb-4d2e-9a9a-ed2dffae5a8b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:29.860228 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-29202102-09fb-4d2e-9a9a-ed2dffae5a8b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 1.033868 Aug 04 14:25:29.882121 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2644/5257] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:28 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:30.809149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-21332c5d-20f5-49b8-a3ae-971d13d42fec tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:30.810627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-21332c5d-20f5-49b8-a3ae-971d13d42fec tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:30.831834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21332c5d-20f5-49b8-a3ae-971d13d42fec tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:30.834485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21332c5d-20f5-49b8-a3ae-971d13d42fec tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:30.835678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21332c5d-20f5-49b8-a3ae-971d13d42fec tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:30.838365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21332c5d-20f5-49b8-a3ae-971d13d42fec tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:30.932358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-362a6334-33b1-4f80-8b34-02feb924fd45 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:30.934912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-362a6334-33b1-4f80-8b34-02feb924fd45 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:30.973646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-362a6334-33b1-4f80-8b34-02feb924fd45 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:30.980371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-362a6334-33b1-4f80-8b34-02feb924fd45 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:30.989688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-362a6334-33b1-4f80-8b34-02feb924fd45 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:30.998713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-362a6334-33b1-4f80-8b34-02feb924fd45 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:32.135251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-21332c5d-20f5-49b8-a3ae-971d13d42fec tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:32.143840 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-21332c5d-20f5-49b8-a3ae-971d13d42fec tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 1.339105 Aug 04 14:25:32.144071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-362a6334-33b1-4f80-8b34-02feb924fd45 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:32.148684 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2614/5258] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:30 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:32.200082 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-362a6334-33b1-4f80-8b34-02feb924fd45 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 1.279208 Aug 04 14:25:32.201462 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2645/5259] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:30 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:33.190057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b5151f18-1281-453b-8614-946f9833af68 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:33.191653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b5151f18-1281-453b-8614-946f9833af68 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:33.215335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5151f18-1281-453b-8614-946f9833af68 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:33.216194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5151f18-1281-453b-8614-946f9833af68 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:33.217310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5151f18-1281-453b-8614-946f9833af68 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:33.221671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b5151f18-1281-453b-8614-946f9833af68 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:33.360520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6fb1a9c2-0229-435c-8e9a-cc696941cd49 req-663678aa-724a-4b5c-b173-31d0692ab513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec4240d-3b2b-4672-af1e-ddf84ae128c1", "name": "network-vif-plugged", "status": "completed", "tag": "5a0a8401-a537-41ee-b37f-e28d59c29d42"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:25:33.423883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6fb1a9c2-0229-435c-8e9a-cc696941cd49 req-663678aa-724a-4b5c-b173-31d0692ab513 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:33.429600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6fb1a9c2-0229-435c-8e9a-cc696941cd49 req-663678aa-724a-4b5c-b173-31d0692ab513 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:33.509749 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6fb1a9c2-0229-435c-8e9a-cc696941cd49 req-663678aa-724a-4b5c-b173-31d0692ab513 service nova] Creating event network-vif-plugged:5a0a8401-a537-41ee-b37f-e28d59c29d42 for instance fec4240d-3b2b-4672-af1e-ddf84ae128c1 on n-h2-844627-10 Aug 04 14:25:33.532593 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6fb1a9c2-0229-435c-8e9a-cc696941cd49 req-663678aa-724a-4b5c-b173-31d0692ab513 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.380393 Aug 04 14:25:33.535129 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2615/5260] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:25:33.548755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03bb9254-19ca-4434-827f-4ea0ff82dd21 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:33.550029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-03bb9254-19ca-4434-827f-4ea0ff82dd21 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:33.575241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03bb9254-19ca-4434-827f-4ea0ff82dd21 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:33.575713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03bb9254-19ca-4434-827f-4ea0ff82dd21 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:33.576596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03bb9254-19ca-4434-827f-4ea0ff82dd21 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:33.577079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03bb9254-19ca-4434-827f-4ea0ff82dd21 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:34.068322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b5151f18-1281-453b-8614-946f9833af68 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:34.114131 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b5151f18-1281-453b-8614-946f9833af68 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 0.923699 Aug 04 14:25:34.120302 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2646/5261] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:33 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:34.402907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-03bb9254-19ca-4434-827f-4ea0ff82dd21 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:34.418685 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-03bb9254-19ca-4434-827f-4ea0ff82dd21 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 0.882552 Aug 04 14:25:34.422749 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2616/5262] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:33 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:35.162342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a7d0480a-35f3-49a6-9192-ea95eb815e19 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:35.163489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a7d0480a-35f3-49a6-9192-ea95eb815e19 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:35.202120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7d0480a-35f3-49a6-9192-ea95eb815e19 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:35.202393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7d0480a-35f3-49a6-9192-ea95eb815e19 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:35.207858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7d0480a-35f3-49a6-9192-ea95eb815e19 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:35.211630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7d0480a-35f3-49a6-9192-ea95eb815e19 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:35.474274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e513000-f70e-4ae4-a747-75329a784746 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:35.477084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e513000-f70e-4ae4-a747-75329a784746 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:35.531576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e513000-f70e-4ae4-a747-75329a784746 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:35.539024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e513000-f70e-4ae4-a747-75329a784746 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:35.548314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e513000-f70e-4ae4-a747-75329a784746 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:35.553916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e513000-f70e-4ae4-a747-75329a784746 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:35.836553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a7d0480a-35f3-49a6-9192-ea95eb815e19 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:35.854365 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a7d0480a-35f3-49a6-9192-ea95eb815e19 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1372 microversion: 2.1 time: 0.699731 Aug 04 14:25:35.866513 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2647/5263] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:35 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1372 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:36.188654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6e513000-f70e-4ae4-a747-75329a784746 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:36.211271 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e513000-f70e-4ae4-a747-75329a784746 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 0.745480 Aug 04 14:25:36.214229 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2617/5264] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:35 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:36.903966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-89b9c577-e642-4216-8853-27a07566b2e8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:36.910406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-89b9c577-e642-4216-8853-27a07566b2e8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:36.974941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89b9c577-e642-4216-8853-27a07566b2e8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:36.975821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89b9c577-e642-4216-8853-27a07566b2e8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:36.986316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89b9c577-e642-4216-8853-27a07566b2e8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:36.988735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89b9c577-e642-4216-8853-27a07566b2e8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:37.252464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-99d86621-f3bf-4f2a-bf77-311cc42ae273 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:37.254330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-99d86621-f3bf-4f2a-bf77-311cc42ae273 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:37.272863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99d86621-f3bf-4f2a-bf77-311cc42ae273 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:37.277023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99d86621-f3bf-4f2a-bf77-311cc42ae273 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:37.280863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99d86621-f3bf-4f2a-bf77-311cc42ae273 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:37.286159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99d86621-f3bf-4f2a-bf77-311cc42ae273 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:37.442890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-89b9c577-e642-4216-8853-27a07566b2e8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:37.459180 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-89b9c577-e642-4216-8853-27a07566b2e8 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1545 microversion: 2.1 time: 0.556757 Aug 04 14:25:37.460955 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2648/5265] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:36 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1545 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:37.501371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b25bc06c-febc-4c85-ba7d-75db431bde50 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:37.502294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b25bc06c-febc-4c85-ba7d-75db431bde50 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:37.512259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b25bc06c-febc-4c85-ba7d-75db431bde50 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:37.517786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b25bc06c-febc-4c85-ba7d-75db431bde50 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:37.519532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b25bc06c-febc-4c85-ba7d-75db431bde50 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:37.520185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b25bc06c-febc-4c85-ba7d-75db431bde50 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:38.304309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-99d86621-f3bf-4f2a-bf77-311cc42ae273 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:38.363420 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-99d86621-f3bf-4f2a-bf77-311cc42ae273 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 1.113107 Aug 04 14:25:38.387723 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2618/5266] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:37 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:38.446520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b25bc06c-febc-4c85-ba7d-75db431bde50 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:38.475854 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b25bc06c-febc-4c85-ba7d-75db431bde50 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1545 microversion: 2.1 time: 0.978670 Aug 04 14:25:38.482525 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2649/5267] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:37 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1545 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:39.367796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1776535341", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": "none"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:25:39.412579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-637acc46-b50d-4ccf-9684-8758c33e3b3e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:39.415664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-637acc46-b50d-4ccf-9684-8758c33e3b3e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:39.475997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-637acc46-b50d-4ccf-9684-8758c33e3b3e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:39.482922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-637acc46-b50d-4ccf-9684-8758c33e3b3e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:39.486606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-637acc46-b50d-4ccf-9684-8758c33e3b3e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:39.487391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-637acc46-b50d-4ccf-9684-8758c33e3b3e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:39.679013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:25:39.680290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:25:39.685872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:25:39.689417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:25:39.693172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:25:39.753520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:39.754399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:39.756240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:39.757376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:39.866509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Getting quotas for project b14bfaa87ed84d52ac757e34fdce7bca. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:25:39.894182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Getting quotas for user ce0524d863a340789a8b07cbabbd78be and project b14bfaa87ed84d52ac757e34fdce7bca. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:25:39.944972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:25:39.959513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:25:40.241880 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e648fbd4-9b01-4305-8e39-599c8e999272 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.728902 Aug 04 14:25:40.243124 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2619/5268] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 14:25:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 14:25:40.277732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-210d8f63-7c2b-4abc-8727-18ed19ec51bd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:40.280354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-210d8f63-7c2b-4abc-8727-18ed19ec51bd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:40.744441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-210d8f63-7c2b-4abc-8727-18ed19ec51bd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:40.771496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-210d8f63-7c2b-4abc-8727-18ed19ec51bd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:40.783572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-210d8f63-7c2b-4abc-8727-18ed19ec51bd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:40.788251 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-210d8f63-7c2b-4abc-8727-18ed19ec51bd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 200 len: 1281 microversion: 2.47 time: 0.532406 Aug 04 14:25:40.817449 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2620/5269] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:25:40 2022] GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 1281 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:25:40.839207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4677daf6-f9e0-46ae-8581-bcd49c23395e tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f46f2f118b0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:41.023641 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4677daf6-f9e0-46ae-8581-bcd49c23395e tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c4948c40-13f4-4189-b027-64a50f14b512" status: 200 len: 351 microversion: 2.1 time: 0.203917 Aug 04 14:25:41.038575 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2621/5270] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:25:40 2022] GET /compute/v2.1/os-volumes/c4948c40-13f4-4189-b027-64a50f14b512 => generated 351 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:25:41.845896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:41.851502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:42.016173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:42.026820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:42.028022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:42.028498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:42.225323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-637acc46-b50d-4ccf-9684-8758c33e3b3e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:42.314316 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-637acc46-b50d-4ccf-9684-8758c33e3b3e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 2.909140 Aug 04 14:25:42.326139 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2650/5271] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:39 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 2922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:43.380903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-154e2c6f-dfb7-45a9-acf8-e55510f632f2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:43.386359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-154e2c6f-dfb7-45a9-acf8-e55510f632f2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:43.444220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:43.447939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-154e2c6f-dfb7-45a9-acf8-e55510f632f2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:43.458086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-154e2c6f-dfb7-45a9-acf8-e55510f632f2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:43.461732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-154e2c6f-dfb7-45a9-acf8-e55510f632f2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:43.469438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-154e2c6f-dfb7-45a9-acf8-e55510f632f2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:43.484819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:43.494836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:43.500262 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-95a1427b-ab47-45ac-ad1c-0acf7fa4febc tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 200 len: 1285 microversion: 2.47 time: 1.660576 Aug 04 14:25:43.505093 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2622/5272] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:25:41 2022] GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 1285 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:25:44.556080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:44.557278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:44.615015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:44.619344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:44.623640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-154e2c6f-dfb7-45a9-acf8-e55510f632f2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:44.627478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:44.628935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:44.677650 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-154e2c6f-dfb7-45a9-acf8-e55510f632f2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 1.303351 Aug 04 14:25:44.684311 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2651/5273] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:43 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:45.703437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:45.717853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1c9abb36-acf2-4f44-8562-eb19dcce576d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:45.719358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1c9abb36-acf2-4f44-8562-eb19dcce576d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:45.745992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c9abb36-acf2-4f44-8562-eb19dcce576d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:45.749189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c9abb36-acf2-4f44-8562-eb19dcce576d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:45.751793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c9abb36-acf2-4f44-8562-eb19dcce576d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:45.759576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c9abb36-acf2-4f44-8562-eb19dcce576d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:45.761539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:45.765900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:45.768023 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aec376f9-5ce4-4bd1-8ade-5dc46d60a647 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 200 len: 1339 microversion: 2.47 time: 1.223078 Aug 04 14:25:45.782903 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2623/5274] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:25:44 2022] GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 1339 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 14:25:45.921328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3532ce0-82e4-411a-acab-7768864a9a9f tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f46f2f1e700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:46.122950 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3532ce0-82e4-411a-acab-7768864a9a9f tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/2c55d48d-387b-4bb6-92fd-1c47dc4471ca" status: 200 len: 350 microversion: 2.1 time: 0.206604 Aug 04 14:25:46.130565 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2624/5275] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:25:45 2022] GET /compute/v2.1/os-volumes/2c55d48d-387b-4bb6-92fd-1c47dc4471ca => generated 350 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:25:46.813245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:46.816481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:46.859886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:46.865461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:46.866377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:46.866852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:47.402905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:47.440334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:47.452428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:47.458711 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6b36f954-f703-4fe1-b2e4-0fa5272feeb3 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 200 len: 1360 microversion: 2.47 time: 0.647420 Aug 04 14:25:47.464093 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2625/5276] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:25:46 2022] GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 1360 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:25:47.499932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-adfd17d3-5376-4ab0-a23a-bed797719bb9 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1556732566"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:25:47.508894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-adfd17d3-5376-4ab0-a23a-bed797719bb9 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:47.531171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adfd17d3-5376-4ab0-a23a-bed797719bb9 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:47.532174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adfd17d3-5376-4ab0-a23a-bed797719bb9 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:47.535269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adfd17d3-5376-4ab0-a23a-bed797719bb9 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:47.550154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1c9abb36-acf2-4f44-8562-eb19dcce576d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:47.559362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adfd17d3-5376-4ab0-a23a-bed797719bb9 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:47.594942 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1c9abb36-acf2-4f44-8562-eb19dcce576d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 1.891825 Aug 04 14:25:47.601833 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2652/5277] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:45 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:48.101849 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-adfd17d3-5376-4ab0-a23a-bed797719bb9 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "POST /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9/action" status: 202 len: 52 microversion: 2.47 time: 0.619077 Aug 04 14:25:48.102756 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2626/5278] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 14:25:47 2022] POST /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9/action => generated 52 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 04 14:25:48.115197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-817aa11b-2caf-4e53-8141-e892f1de49dd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:48.116533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-817aa11b-2caf-4e53-8141-e892f1de49dd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:48.129240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-817aa11b-2caf-4e53-8141-e892f1de49dd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:48.129798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-817aa11b-2caf-4e53-8141-e892f1de49dd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:48.136211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-817aa11b-2caf-4e53-8141-e892f1de49dd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:48.137047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-817aa11b-2caf-4e53-8141-e892f1de49dd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:48.343158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-817aa11b-2caf-4e53-8141-e892f1de49dd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:25:48.601529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-817aa11b-2caf-4e53-8141-e892f1de49dd tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 204 len: 0 microversion: 2.47 time: 0.489596 Aug 04 14:25:48.606609 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2653/5279] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 14:25:48 2022] DELETE /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 14:25:48.630938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:48.641109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:48.651762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ab38f09-5b17-4572-898d-18aacf222cf1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:48.653515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ab38f09-5b17-4572-898d-18aacf222cf1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:48.676545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ab38f09-5b17-4572-898d-18aacf222cf1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:48.677118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:48.682313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:48.686033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ab38f09-5b17-4572-898d-18aacf222cf1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:48.687406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:48.687611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ab38f09-5b17-4572-898d-18aacf222cf1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:48.688201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ab38f09-5b17-4572-898d-18aacf222cf1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:48.692660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:49.392847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:49.411432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:49.417988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:49.420941 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-02e4dd98-66e9-42fa-a0cb-31d6699ad8ee tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 200 len: 1366 microversion: 2.47 time: 0.808001 Aug 04 14:25:49.436168 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2627/5280] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:25:48 2022] GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 1366 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:25:50.472839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:50.478266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:50.487080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:50.506269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:50.509018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:50.512217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:50.513568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:50.566535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ab38f09-5b17-4572-898d-18aacf222cf1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:50.635620 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ab38f09-5b17-4572-898d-18aacf222cf1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 2.013423 Aug 04 14:25:50.649946 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2654/5281] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:48 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:50.766462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:50.779795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb467607-e5a0-48c9-8fa1-969d97530f1d tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f47002e7430>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:50.833956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:50.868809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:50.877208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:50.880398 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eeca53c8-6153-4323-98d6-92b4e0e54ec0 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 200 len: 1366 microversion: 2.47 time: 0.419457 Aug 04 14:25:50.885024 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2628/5282] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:25:50 2022] GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:25:50.928048 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb467607-e5a0-48c9-8fa1-969d97530f1d tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/bb6b22e2-8307-405f-86cf-ebb5b1043bbf" status: 200 len: 350 microversion: 2.1 time: 0.151835 Aug 04 14:25:50.930393 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2655/5283] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:25:50 2022] GET /compute/v2.1/os-volumes/bb6b22e2-8307-405f-86cf-ebb5b1043bbf => generated 350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:25:50.951187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c992fcd-ec72-4ac8-8eb4-e0b5cfab21b3 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f46f2f1c310>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:51.154733 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c992fcd-ec72-4ac8-8eb4-e0b5cfab21b3 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.208818 Aug 04 14:25:51.156814 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2629/5284] 10.222.0.66 () {58 vars in 1134 bytes} [Thu Aug 4 14:25:50 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:51.182426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-39424ce5-9dea-4677-bcb7-8909233c80de tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f4700046c10>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:51.511495 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-39424ce5-9dea-4677-bcb7-8909233c80de tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.334602 Aug 04 14:25:51.524908 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2656/5285] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 14:25:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:25:51.539485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cdd91e31-e670-4d53-b119-5aaaf36b9d28 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f46f2f2daf0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:51.696314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b3b91d89-7235-4999-be81-4f5d841ff08a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:51.698385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b3b91d89-7235-4999-be81-4f5d841ff08a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:51.718748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3b91d89-7235-4999-be81-4f5d841ff08a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:51.720238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3b91d89-7235-4999-be81-4f5d841ff08a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:51.724138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3b91d89-7235-4999-be81-4f5d841ff08a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:51.727676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3b91d89-7235-4999-be81-4f5d841ff08a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:51.929342 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cdd91e31-e670-4d53-b119-5aaaf36b9d28 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.396441 Aug 04 14:25:51.930832 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2630/5286] 10.222.0.66 () {58 vars in 1134 bytes} [Thu Aug 4 14:25:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:51.961824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:51.965060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:52.003022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:52.008482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:52.009832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:52.011087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:52.408523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:52.452961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:52.456699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:52.458961 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-67183ddc-90b4-4136-ab7c-3ab67c03d3b2 tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 200 len: 1366 microversion: 2.47 time: 0.526353 Aug 04 14:25:52.459985 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2631/5287] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:25:51 2022] GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:25:52.503488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34be2b0f-d094-4029-89aa-3e6db5037095 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f46f2f1c790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:52.965986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b3b91d89-7235-4999-be81-4f5d841ff08a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:52.994599 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-34be2b0f-d094-4029-89aa-3e6db5037095 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.511847 Aug 04 14:25:52.996750 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2632/5288] 10.222.0.66 () {58 vars in 1167 bytes} [Thu Aug 4 14:25:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:25:53.019624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-91aaa07e-6116-47e0-9214-e6498d1938b2 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f46f2f74b80>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:53.050006 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b3b91d89-7235-4999-be81-4f5d841ff08a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 1.357465 Aug 04 14:25:53.051079 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2657/5289] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:51 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:53.514927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:53.521731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:53.558671 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-91aaa07e-6116-47e0-9214-e6498d1938b2 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.545449 Aug 04 14:25:53.568844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:53.569427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:53.570179 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2633/5290] 10.222.0.66 () {58 vars in 1170 bytes} [Thu Aug 4 14:25:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:25:53.573357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:53.574111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:53.586875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:53.591083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-636fb9b0-04be-458c-b897-7c150fe41800 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f46f2f4fca0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:53.743868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:53.752289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:53.755937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lazy-loading 'fault' on Instance uuid e44f88c9-01c2-4049-b919-229e0476fef9 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:25:53.892108 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-636fb9b0-04be-458c-b897-7c150fe41800 tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.320441 Aug 04 14:25:53.892778 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2634/5291] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 14:25:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:53.912073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-498233da-e427-413d-b1c2-d7f8a87dd6ae tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f46f2f2d160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:54.111799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:54.127374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:54.129364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce0524d863a340789a8b07cbabbd78be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14bfaa87ed84d52ac757e34fdce7bca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:54.130886 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b935a2a4-e937-4f37-81de-66063f56dd3c tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 200 len: 1371 microversion: 2.47 time: 0.625329 Aug 04 14:25:54.133990 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2658/5292] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:25:53 2022] GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 1371 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 14:25:54.139275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1aaba997-5ef1-42a6-8f0a-70c8c514b875 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:54.152441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1aaba997-5ef1-42a6-8f0a-70c8c514b875 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:54.178094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1aaba997-5ef1-42a6-8f0a-70c8c514b875 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:54.181745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1aaba997-5ef1-42a6-8f0a-70c8c514b875 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:54.182921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1aaba997-5ef1-42a6-8f0a-70c8c514b875 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:54.187320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1aaba997-5ef1-42a6-8f0a-70c8c514b875 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:54.281188 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-498233da-e427-413d-b1c2-d7f8a87dd6ae tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.376205 Aug 04 14:25:54.285033 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2635/5293] 10.222.0.66 () {58 vars in 1188 bytes} [Thu Aug 4 14:25:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:25:54.318806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3b6b5330-a0dd-4d87-a593-a2dd11d1a15c tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] Calling method '.version_select at 0x7f46f2f403a0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:54.674370 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3b6b5330-a0dd-4d87-a593-a2dd11d1a15c tempest-VolumesTestJSON-2092450057 tempest-VolumesTestJSON-2092450057-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.376550 Aug 04 14:25:54.676988 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2636/5294] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 14:25:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:25:54.854689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1aaba997-5ef1-42a6-8f0a-70c8c514b875 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:54.867794 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1aaba997-5ef1-42a6-8f0a-70c8c514b875 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1726 microversion: 2.1 time: 0.732450 Aug 04 14:25:54.868464 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2659/5295] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:54 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1726 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:55.179102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:55.179787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] [instance: e44f88c9-01c2-4049-b919-229e0476fef9] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:55.202844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:55.208600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:55.212273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:55.215278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:55.236233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:55.285709 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] HTTP exception thrown: Instance e44f88c9-01c2-4049-b919-229e0476fef9 could not be found. Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Request method failure captured: Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 HTTP/1.1 Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69bhPDpdr4NseqEDbXVrhEvdVcL3NQsHxEhY-Nj4CnyckEQQxTdZKY6yERR3xmlcJ6NW4e5LNiX0t3eyt52brkllwEsY07_xIig9gECiUpZDIKLPGU2KpFyRnvB8jiiWZKCMePgm_F3MhAN8dTZVhBMIv1fL1EaXjgEOswP0curVmCQ Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b14bfaa87ed84d52ac757e34fdce7bca Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersAaction247Test-703986882 Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b14bfaa87ed84d52ac757e34fdce7bca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b14bfaa87ed84d52ac757e34fdce7bca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b14bfaa87ed84d52ac757e34fdce7bca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b14bfaa87ed84d52ac757e34fdce7bca"}]}] Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersAaction247Test-703986882 Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b14bfaa87ed84d52ac757e34fdce7bca Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersAaction247Test-703986882 Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersAaction247Test-703986882-project Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: ce0524d863a340789a8b07cbabbd78be Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersAaction247Test-703986882-project Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e44f88c9-01c2-4049-b919-229e0476fef9 could not be found. Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e44f88c9-01c2-4049-b919-229e0476fef9'} Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e44f88c9-01c2-4049-b919-229e0476fef9 could not be found. Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e44f88c9-01c2-4049-b919-229e0476fef9 could not be found. Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:25:55.289843 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:25:55.297649 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:25:55.297649 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:25:55.297649 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:25:55.297649 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:25:55.297649 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:25:55.297649 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e44f88c9-01c2-4049-b919-229e0476fef9 could not be found. Aug 04 14:25:55.297649 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:25:55.301305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] Returning 404 to user: Instance e44f88c9-01c2-4049-b919-229e0476fef9 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:25:55.302501 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-692a3b7d-953c-4cc3-8d2c-f380d67d4f6d tempest-ServersAaction247Test-703986882 tempest-ServersAaction247Test-703986882-project] 10.222.0.66 "GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9" status: 404 len: 111 microversion: 2.47 time: 0.128543 Aug 04 14:25:55.306160 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2637/5296] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 14:25:55 2022] GET /compute/v2.1/servers/e44f88c9-01c2-4049-b919-229e0476fef9 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 14:25:55.936674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-383ff44d-2f61-44d1-9890-5aadf8df8e9a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:55.946241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-383ff44d-2f61-44d1-9890-5aadf8df8e9a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:55.952801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:55.993670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-383ff44d-2f61-44d1-9890-5aadf8df8e9a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:55.995525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-383ff44d-2f61-44d1-9890-5aadf8df8e9a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:56.007987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-383ff44d-2f61-44d1-9890-5aadf8df8e9a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:56.018174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-383ff44d-2f61-44d1-9890-5aadf8df8e9a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:57.252586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-383ff44d-2f61-44d1-9890-5aadf8df8e9a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:57.278374 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-383ff44d-2f61-44d1-9890-5aadf8df8e9a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1703 microversion: 2.1 time: 1.348139 Aug 04 14:25:57.343177 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2660/5297] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:55 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1703 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:25:57.381973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4c14862f-b176-4ebe-a0f2-61240be085ac tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:25:57.400943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:25:57.500146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c14862f-b176-4ebe-a0f2-61240be085ac tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:57.507674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c14862f-b176-4ebe-a0f2-61240be085ac tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:57.658813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c14862f-b176-4ebe-a0f2-61240be085ac tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Going to try to start instance {{(pid=130961) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 14:25:57.906523 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4c14862f-b176-4ebe-a0f2-61240be085ac tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.581315 Aug 04 14:25:57.907598 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2638/5298] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:25:57 2022] POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:25:57.921019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa378760-61b5-49dd-abc5-1a090853754d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:25:57.922103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fa378760-61b5-49dd-abc5-1a090853754d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:25:57.955120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa378760-61b5-49dd-abc5-1a090853754d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:57.958191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa378760-61b5-49dd-abc5-1a090853754d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:57.981441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa378760-61b5-49dd-abc5-1a090853754d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:25:57.984811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa378760-61b5-49dd-abc5-1a090853754d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:25:59.546108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fa378760-61b5-49dd-abc5-1a090853754d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:25:59.592035 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fa378760-61b5-49dd-abc5-1a090853754d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1712 microversion: 2.1 time: 1.676775 Aug 04 14:25:59.604911 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2661/5299] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:25:57 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1712 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:00.622166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e769767c-d7af-4602-9e9d-dedfea993ea1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:00.626772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e769767c-d7af-4602-9e9d-dedfea993ea1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:00.651617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e769767c-d7af-4602-9e9d-dedfea993ea1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:00.654942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e769767c-d7af-4602-9e9d-dedfea993ea1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:00.656285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e769767c-d7af-4602-9e9d-dedfea993ea1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:00.659163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e769767c-d7af-4602-9e9d-dedfea993ea1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:01.209946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e769767c-d7af-4602-9e9d-dedfea993ea1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:01.219971 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e769767c-d7af-4602-9e9d-dedfea993ea1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1712 microversion: 2.1 time: 0.607345 Aug 04 14:26:01.239642 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2639/5300] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:00 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1712 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:02.249562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8d9b653c-57a0-4f94-8f93-78efd5e18da9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:02.252329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8d9b653c-57a0-4f94-8f93-78efd5e18da9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:02.280320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d9b653c-57a0-4f94-8f93-78efd5e18da9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:02.285221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d9b653c-57a0-4f94-8f93-78efd5e18da9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:02.288142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d9b653c-57a0-4f94-8f93-78efd5e18da9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:02.293281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d9b653c-57a0-4f94-8f93-78efd5e18da9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:02.772803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d9b653c-57a0-4f94-8f93-78efd5e18da9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:02.781850 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8d9b653c-57a0-4f94-8f93-78efd5e18da9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1716 microversion: 2.1 time: 0.538124 Aug 04 14:26:02.789413 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2662/5301] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:02 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1716 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:14.578559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ccdd93ec-a3d0-45c5-b134-f937506f9236 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:14.579768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ccdd93ec-a3d0-45c5-b134-f937506f9236 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:14.619780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:14.630106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:14.636689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccdd93ec-a3d0-45c5-b134-f937506f9236 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:14.637494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccdd93ec-a3d0-45c5-b134-f937506f9236 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:14.638934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccdd93ec-a3d0-45c5-b134-f937506f9236 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:14.641098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccdd93ec-a3d0-45c5-b134-f937506f9236 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:14.776663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ccdd93ec-a3d0-45c5-b134-f937506f9236 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:26:15.058777 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ccdd93ec-a3d0-45c5-b134-f937506f9236 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 204 len: 0 microversion: 2.1 time: 0.503434 Aug 04 14:26:15.060256 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2640/5302] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:26:14 2022] DELETE /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:26:15.070549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd351680-be79-49ff-b2fc-960fd4aa6c41 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:15.072256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bd351680-be79-49ff-b2fc-960fd4aa6c41 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:15.085473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=5 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:15.088931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=31 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:15.098072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd351680-be79-49ff-b2fc-960fd4aa6c41 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:15.099675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd351680-be79-49ff-b2fc-960fd4aa6c41 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:15.104475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd351680-be79-49ff-b2fc-960fd4aa6c41 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:15.105567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd351680-be79-49ff-b2fc-960fd4aa6c41 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:15.585698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd351680-be79-49ff-b2fc-960fd4aa6c41 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:15.629543 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd351680-be79-49ff-b2fc-960fd4aa6c41 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1551 microversion: 2.1 time: 0.562539 Aug 04 14:26:15.632749 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2663/5303] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:15 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1551 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:16.670717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12e85eac-401a-4c21-8872-11fee4c42a3d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:16.672250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12e85eac-401a-4c21-8872-11fee4c42a3d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:16.727769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12e85eac-401a-4c21-8872-11fee4c42a3d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:16.728734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12e85eac-401a-4c21-8872-11fee4c42a3d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:16.768650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12e85eac-401a-4c21-8872-11fee4c42a3d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:16.774060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12e85eac-401a-4c21-8872-11fee4c42a3d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:17.943371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12e85eac-401a-4c21-8872-11fee4c42a3d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:17.961163 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12e85eac-401a-4c21-8872-11fee4c42a3d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1551 microversion: 2.1 time: 1.304672 Aug 04 14:26:17.969524 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2641/5304] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:16 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1551 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:18.999181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be4298d2-95f4-4820-934a-a912fb79ccde tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:19.008075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-be4298d2-95f4-4820-934a-a912fb79ccde tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:19.056057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be4298d2-95f4-4820-934a-a912fb79ccde tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:19.058774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be4298d2-95f4-4820-934a-a912fb79ccde tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:19.066007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be4298d2-95f4-4820-934a-a912fb79ccde tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:19.067313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be4298d2-95f4-4820-934a-a912fb79ccde tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:19.415026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-be4298d2-95f4-4820-934a-a912fb79ccde tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:19.434110 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-be4298d2-95f4-4820-934a-a912fb79ccde tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 200 len: 1485 microversion: 2.1 time: 0.444246 Aug 04 14:26:19.435815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7807a94e-6cab-41a8-be92-c49962f845cb req-b618a3ed-4de6-43fe-b436-90b7b4ec3b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec4240d-3b2b-4672-af1e-ddf84ae128c1", "name": "network-vif-deleted", "tag": "5a0a8401-a537-41ee-b37f-e28d59c29d42"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:26:19.436827 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2664/5305] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:18 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 1485 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:19.473952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7807a94e-6cab-41a8-be92-c49962f845cb req-b618a3ed-4de6-43fe-b436-90b7b4ec3b18 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:19.476038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7807a94e-6cab-41a8-be92-c49962f845cb req-b618a3ed-4de6-43fe-b436-90b7b4ec3b18 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:19.548433 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7807a94e-6cab-41a8-be92-c49962f845cb req-b618a3ed-4de6-43fe-b436-90b7b4ec3b18 service nova] Creating event network-vif-deleted:5a0a8401-a537-41ee-b37f-e28d59c29d42 for instance fec4240d-3b2b-4672-af1e-ddf84ae128c1 on n-h2-844627-10 Aug 04 14:26:19.571356 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7807a94e-6cab-41a8-be92-c49962f845cb req-b618a3ed-4de6-43fe-b436-90b7b4ec3b18 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143074 Aug 04 14:26:19.586383 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2642/5306] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:26:20.482269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:20.484643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: fec4240d-3b2b-4672-af1e-ddf84ae128c1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:20.493730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:20.509187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:20.510286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:20.510963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:20.578767 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] HTTP exception thrown: Instance fec4240d-3b2b-4672-af1e-ddf84ae128c1 could not be found. Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Request method failure captured: Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 HTTP/1.1 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69YLC2297LDBBx2ZFMyVnLCc8UCH2nJznJFQcu2D9dbW1l45sA9LbCL2hZqvbKXZRpgcX6IUgB9ra6kRuoUp69DMEw32_IlzJF6Jyzldj9SeMfbKR_rRRjokp5wQ5rubg_zaqv3Ixky_S8jn6TMYql2a0dgdNnIbTu2NU2iXXh1i0G0 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 5d1deaa23b8c458aa2d180b131da4923 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestNetworkBasicOps-491854832 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d1deaa23b8c458aa2d180b131da4923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5d1deaa23b8c458aa2d180b131da4923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5d1deaa23b8c458aa2d180b131da4923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d1deaa23b8c458aa2d180b131da4923"}]}] Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestNetworkBasicOps-491854832 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 5d1deaa23b8c458aa2d180b131da4923 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestNetworkBasicOps-491854832 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestNetworkBasicOps-491854832-project Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b691f49b0fe64e8a99ca896ddba38334 Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestNetworkBasicOps-491854832-project Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance fec4240d-3b2b-4672-af1e-ddf84ae128c1 could not be found. Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'fec4240d-3b2b-4672-af1e-ddf84ae128c1'} Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec4240d-3b2b-4672-af1e-ddf84ae128c1 could not be found. Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec4240d-3b2b-4672-af1e-ddf84ae128c1 could not be found. Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:26:20.581023 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:20.587305 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:26:20.587305 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:26:20.587305 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:26:20.587305 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:26:20.587305 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:26:20.587305 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec4240d-3b2b-4672-af1e-ddf84ae128c1 could not be found. Aug 04 14:26:20.587305 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:20.589018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Returning 404 to user: Instance fec4240d-3b2b-4672-af1e-ddf84ae128c1 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:26:20.590147 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5dfeead4-f34f-4726-a6dc-ef210ea365f0 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1" status: 404 len: 111 microversion: 2.1 time: 0.112095 Aug 04 14:26:20.592557 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2665/5307] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:20 2022] GET /compute/v2.1/servers/fec4240d-3b2b-4672-af1e-ddf84ae128c1 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:26:20.988440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-371220c8-aac1-4d2b-a009-e01d04b9135a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '.version_select at 0x7f46f2f8b670>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:21.038908 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-371220c8-aac1-4d2b-a009-e01d04b9135a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1332073322" status: 202 len: 0 microversion: 2.1 time: 0.056359 Aug 04 14:26:21.040803 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2643/5308] 10.222.0.66 () {58 vars in 1257 bytes} [Thu Aug 4 14:26:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1332073322 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:26:29.326069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8cb44bc1-978f-4a41-996d-9b1e8a70a5c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:29.329228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8cb44bc1-978f-4a41-996d-9b1e8a70a5c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:29.384383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cb44bc1-978f-4a41-996d-9b1e8a70a5c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:29.398756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cb44bc1-978f-4a41-996d-9b1e8a70a5c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:29.404276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cb44bc1-978f-4a41-996d-9b1e8a70a5c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:29.405109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8cb44bc1-978f-4a41-996d-9b1e8a70a5c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:29.540538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:29.550216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8cb44bc1-978f-4a41-996d-9b1e8a70a5c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:26:29.865178 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8cb44bc1-978f-4a41-996d-9b1e8a70a5c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 204 len: 0 microversion: 2.1 time: 0.556969 Aug 04 14:26:29.874402 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2666/5309] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:26:29 2022] DELETE /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:26:29.890097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6de64fd-6849-4cd0-bc33-cfacc59c9df1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:29.890844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6de64fd-6849-4cd0-bc33-cfacc59c9df1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:29.905313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6de64fd-6849-4cd0-bc33-cfacc59c9df1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:29.909135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6de64fd-6849-4cd0-bc33-cfacc59c9df1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:29.913289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6de64fd-6849-4cd0-bc33-cfacc59c9df1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:29.914880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6de64fd-6849-4cd0-bc33-cfacc59c9df1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:30.266655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-35af7ba5-fa69-4e9e-9f14-224a6de9b17b req-e72ca9d7-175e-4021-910a-60f39525c7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca9cba7f-359b-4431-acc3-5ac483f57d70", "tag": "95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:26:30.352340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-35af7ba5-fa69-4e9e-9f14-224a6de9b17b req-e72ca9d7-175e-4021-910a-60f39525c7e8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:30.353207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-35af7ba5-fa69-4e9e-9f14-224a6de9b17b req-e72ca9d7-175e-4021-910a-60f39525c7e8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:30.421574 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-35af7ba5-fa69-4e9e-9f14-224a6de9b17b req-e72ca9d7-175e-4021-910a-60f39525c7e8 service nova] Creating event network-changed:95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90 for instance ca9cba7f-359b-4431-acc3-5ac483f57d70 on n-h1-844627-10 Aug 04 14:26:30.442746 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-35af7ba5-fa69-4e9e-9f14-224a6de9b17b req-e72ca9d7-175e-4021-910a-60f39525c7e8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.124420 Aug 04 14:26:30.452689 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2644/5310] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:26:30.604409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6de64fd-6849-4cd0-bc33-cfacc59c9df1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:30.617097 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6de64fd-6849-4cd0-bc33-cfacc59c9df1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1673 microversion: 2.1 time: 0.737818 Aug 04 14:26:30.618272 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2667/5311] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:29 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1673 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:31.650346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-459aa561-3d76-4b2a-aeb3-0275e6372803 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:31.651200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-459aa561-3d76-4b2a-aeb3-0275e6372803 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:31.694442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-459aa561-3d76-4b2a-aeb3-0275e6372803 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:31.698739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-459aa561-3d76-4b2a-aeb3-0275e6372803 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:31.699619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-459aa561-3d76-4b2a-aeb3-0275e6372803 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:31.700078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-459aa561-3d76-4b2a-aeb3-0275e6372803 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:33.201998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-459aa561-3d76-4b2a-aeb3-0275e6372803 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:33.231526 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-459aa561-3d76-4b2a-aeb3-0275e6372803 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1673 microversion: 2.1 time: 1.591539 Aug 04 14:26:33.249930 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2645/5312] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:31 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1673 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:26:34.266834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5b12eefc-dddf-408b-b314-76c55ab53462 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:34.267693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b12eefc-dddf-408b-b314-76c55ab53462 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:34.280190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b12eefc-dddf-408b-b314-76c55ab53462 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:34.288253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b12eefc-dddf-408b-b314-76c55ab53462 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:34.292527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b12eefc-dddf-408b-b314-76c55ab53462 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:34.299977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b12eefc-dddf-408b-b314-76c55ab53462 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:34.629513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-59c75665-fa38-4d77-83b3-bfcbc57127af req-6d4c45d8-7a0c-43d6-ab6c-4fa848db485c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9cba7f-359b-4431-acc3-5ac483f57d70", "name": "network-vif-deleted", "tag": "95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:26:34.664564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-59c75665-fa38-4d77-83b3-bfcbc57127af req-6d4c45d8-7a0c-43d6-ab6c-4fa848db485c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:34.664564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-59c75665-fa38-4d77-83b3-bfcbc57127af req-6d4c45d8-7a0c-43d6-ab6c-4fa848db485c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:34.711010 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-59c75665-fa38-4d77-83b3-bfcbc57127af req-6d4c45d8-7a0c-43d6-ab6c-4fa848db485c service nova] Creating event network-vif-deleted:95ed653e-5bd1-4f25-8ed6-0d3ffabe1a90 for instance ca9cba7f-359b-4431-acc3-5ac483f57d70 on n-h1-844627-10 Aug 04 14:26:34.729845 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-59c75665-fa38-4d77-83b3-bfcbc57127af req-6d4c45d8-7a0c-43d6-ab6c-4fa848db485c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105523 Aug 04 14:26:34.730933 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2646/5313] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:26:34.746249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5b12eefc-dddf-408b-b314-76c55ab53462 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:34.760180 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5b12eefc-dddf-408b-b314-76c55ab53462 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 200 len: 1605 microversion: 2.1 time: 0.497630 Aug 04 14:26:34.773429 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2668/5314] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:34 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 1605 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:35.782753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:35.785085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: ca9cba7f-359b-4431-acc3-5ac483f57d70] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:35.810647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:35.812002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:35.816600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:35.817605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:35.871984 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] HTTP exception thrown: Instance ca9cba7f-359b-4431-acc3-5ac483f57d70 could not be found. Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Request method failure captured: Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 HTTP/1.1 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69YLC2297LDBBx2ZFMyVnLCc8UCH2nJznJFQcu2D9dbW1l45sA9LbCL2hZqvbKXZRpgcX6IUgB9ra6kRuoUp69DMEw32_IlzJF6Jyzldj9SeMfbKR_rRRjokp5wQ5rubg_zaqv3Ixky_S8jn6TMYql2a0dgdNnIbTu2NU2iXXh1i0G0 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 5d1deaa23b8c458aa2d180b131da4923 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestNetworkBasicOps-491854832 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d1deaa23b8c458aa2d180b131da4923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5d1deaa23b8c458aa2d180b131da4923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5d1deaa23b8c458aa2d180b131da4923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d1deaa23b8c458aa2d180b131da4923"}]}] Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestNetworkBasicOps-491854832 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 5d1deaa23b8c458aa2d180b131da4923 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestNetworkBasicOps-491854832 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestNetworkBasicOps-491854832-project Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b691f49b0fe64e8a99ca896ddba38334 Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestNetworkBasicOps-491854832-project Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance ca9cba7f-359b-4431-acc3-5ac483f57d70 could not be found. Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'ca9cba7f-359b-4431-acc3-5ac483f57d70'} Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9cba7f-359b-4431-acc3-5ac483f57d70 could not be found. Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9cba7f-359b-4431-acc3-5ac483f57d70 could not be found. Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:26:35.875615 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:35.881485 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:26:35.881485 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:26:35.881485 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:26:35.881485 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:26:35.881485 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:26:35.881485 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9cba7f-359b-4431-acc3-5ac483f57d70 could not be found. Aug 04 14:26:35.881485 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:26:35.881485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Returning 404 to user: Instance ca9cba7f-359b-4431-acc3-5ac483f57d70 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:26:35.881485 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-40cd9bcb-0739-43d4-8beb-d644ef05ec63 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70" status: 404 len: 111 microversion: 2.1 time: 0.098785 Aug 04 14:26:35.886014 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2669/5315] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:35 2022] GET /compute/v2.1/servers/ca9cba7f-359b-4431-acc3-5ac483f57d70 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:26:36.403853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1325988543", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "ad0db2a2-5a99-4500-af65-3e6859967bd3"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:26:36.477210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b93f4e8-f9cc-4b9c-8008-9301428dee66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '.version_select at 0x7f47000ff4c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:36.510218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] validate_networks() for [('ad0db2a2-5a99-4500-af65-3e6859967bd3', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:26:36.540544 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b93f4e8-f9cc-4b9c-8008-9301428dee66 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1960577295" status: 202 len: 0 microversion: 2.1 time: 0.070185 Aug 04 14:26:36.542372 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2670/5316] 10.222.0.66 () {58 vars in 1257 bytes} [Thu Aug 4 14:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1960577295 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:26:38.000500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:26:38.003316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:26:38.004614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:26:38.006076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:26:38.007298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:26:38.030363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:38.031758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:38.034272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:38.035337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:38.080994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Getting quotas for project 43ce286af0e945dca7f6a922538a300e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:26:38.097547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Getting quotas for user a37098eed8f0432ea2e9ae8606d3bb02 and project 43ce286af0e945dca7f6a922538a300e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:26:38.135243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:26:38.142556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:26:38.264117 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b62ba3fb-30b0-4e50-afef-0089e9ef7f0c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.930745 Aug 04 14:26:38.269279 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2647/5317] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:26:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:26:38.276914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3ade618f-182c-4ded-b19c-9649527305c7 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:38.277546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3ade618f-182c-4ded-b19c-9649527305c7 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:38.616130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3ade618f-182c-4ded-b19c-9649527305c7 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:38.641764 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3ade618f-182c-4ded-b19c-9649527305c7 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1216 microversion: 2.1 time: 0.369487 Aug 04 14:26:38.654862 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2671/5318] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:38 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1216 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:39.677869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7522f5c6-6a90-4bea-a874-81b98be5170f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:39.679523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7522f5c6-6a90-4bea-a874-81b98be5170f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:39.714311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7522f5c6-6a90-4bea-a874-81b98be5170f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:39.715106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7522f5c6-6a90-4bea-a874-81b98be5170f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:39.719939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7522f5c6-6a90-4bea-a874-81b98be5170f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:39.720855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7522f5c6-6a90-4bea-a874-81b98be5170f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:40.151176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7522f5c6-6a90-4bea-a874-81b98be5170f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:40.163758 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7522f5c6-6a90-4bea-a874-81b98be5170f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1220 microversion: 2.1 time: 0.491851 Aug 04 14:26:40.234728 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2648/5319] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:39 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1220 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:41.190350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c52a353-6f68-4956-bb3e-6cc6bef5ebb2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:41.192137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8c52a353-6f68-4956-bb3e-6cc6bef5ebb2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:41.209305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c52a353-6f68-4956-bb3e-6cc6bef5ebb2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:41.209868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c52a353-6f68-4956-bb3e-6cc6bef5ebb2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:41.210796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c52a353-6f68-4956-bb3e-6cc6bef5ebb2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:41.211875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c52a353-6f68-4956-bb3e-6cc6bef5ebb2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:41.429881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8c52a353-6f68-4956-bb3e-6cc6bef5ebb2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:41.442036 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c52a353-6f68-4956-bb3e-6cc6bef5ebb2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1212 microversion: 2.1 time: 0.253510 Aug 04 14:26:41.442699 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2672/5320] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:41 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1212 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:26:42.514114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1f45943-5efc-4863-86aa-3a453cce8d5f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:42.515424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f1f45943-5efc-4863-86aa-3a453cce8d5f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:42.571698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1f45943-5efc-4863-86aa-3a453cce8d5f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:42.572852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1f45943-5efc-4863-86aa-3a453cce8d5f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:42.587299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1f45943-5efc-4863-86aa-3a453cce8d5f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:42.594348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1f45943-5efc-4863-86aa-3a453cce8d5f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:42.779973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f1f45943-5efc-4863-86aa-3a453cce8d5f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:42.795166 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f1f45943-5efc-4863-86aa-3a453cce8d5f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1268 microversion: 2.1 time: 0.325540 Aug 04 14:26:42.797287 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2649/5321] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:42 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1268 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:43.702182 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:26:43.702182 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:26:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:26:43.843394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a2f271b1-b0f3-4647-b95c-0f815d155558 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:43.852904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a2f271b1-b0f3-4647-b95c-0f815d155558 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:43.872318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2f271b1-b0f3-4647-b95c-0f815d155558 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:43.872841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2f271b1-b0f3-4647-b95c-0f815d155558 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:43.874004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2f271b1-b0f3-4647-b95c-0f815d155558 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:43.878951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2f271b1-b0f3-4647-b95c-0f815d155558 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:44.129002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a2f271b1-b0f3-4647-b95c-0f815d155558 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:44.145469 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a2f271b1-b0f3-4647-b95c-0f815d155558 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1274 microversion: 2.1 time: 0.307460 Aug 04 14:26:44.166040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2673/5322] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:43 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1274 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:26:45.176767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-08df8816-f15e-4590-b8cb-e9fd4eefc650 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:45.179738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-08df8816-f15e-4590-b8cb-e9fd4eefc650 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:45.203532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:45.207920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08df8816-f15e-4590-b8cb-e9fd4eefc650 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:45.214539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08df8816-f15e-4590-b8cb-e9fd4eefc650 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:45.216062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08df8816-f15e-4590-b8cb-e9fd4eefc650 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:45.219638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-08df8816-f15e-4590-b8cb-e9fd4eefc650 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:45.443739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-08df8816-f15e-4590-b8cb-e9fd4eefc650 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:45.475338 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-08df8816-f15e-4590-b8cb-e9fd4eefc650 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1274 microversion: 2.1 time: 0.306304 Aug 04 14:26:45.479838 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2650/5323] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:45 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1274 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:46.510872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-65ed7cc0-aad5-4cf8-9d0c-9a29f116daa2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:46.511721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-65ed7cc0-aad5-4cf8-9d0c-9a29f116daa2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:46.529521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:46.534673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65ed7cc0-aad5-4cf8-9d0c-9a29f116daa2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:46.539959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65ed7cc0-aad5-4cf8-9d0c-9a29f116daa2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:46.541396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65ed7cc0-aad5-4cf8-9d0c-9a29f116daa2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:46.542305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-65ed7cc0-aad5-4cf8-9d0c-9a29f116daa2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:46.565409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:48.580933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-65ed7cc0-aad5-4cf8-9d0c-9a29f116daa2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:48.623417 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-65ed7cc0-aad5-4cf8-9d0c-9a29f116daa2 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1316 microversion: 2.1 time: 2.116438 Aug 04 14:26:48.632232 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2674/5324] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:46 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1316 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:26:49.645599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:49.647178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:49.656069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbe6187d-b1b0-4ce1-a148-633f04c5da3f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:49.660133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cbe6187d-b1b0-4ce1-a148-633f04c5da3f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:49.700091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbe6187d-b1b0-4ce1-a148-633f04c5da3f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:49.701156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbe6187d-b1b0-4ce1-a148-633f04c5da3f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:49.711335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbe6187d-b1b0-4ce1-a148-633f04c5da3f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:49.714255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbe6187d-b1b0-4ce1-a148-633f04c5da3f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:49.867030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-89b2801e-aa73-4859-9818-9a5bd7c4b2b5 req-5fb16c30-83ea-49bc-b33c-53fd6f66b3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da17a4f-5433-4b5a-a477-e0e36e037db2", "tag": "41168dcc-28fb-42f2-b585-53ddcc668153"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:26:49.913260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:49.955610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-89b2801e-aa73-4859-9818-9a5bd7c4b2b5 req-5fb16c30-83ea-49bc-b33c-53fd6f66b3a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:49.958967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-89b2801e-aa73-4859-9818-9a5bd7c4b2b5 req-5fb16c30-83ea-49bc-b33c-53fd6f66b3a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:50.009152 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-89b2801e-aa73-4859-9818-9a5bd7c4b2b5 req-5fb16c30-83ea-49bc-b33c-53fd6f66b3a4 service nova] Creating event network-changed:41168dcc-28fb-42f2-b585-53ddcc668153 for instance 1da17a4f-5433-4b5a-a477-e0e36e037db2 on n-h2-844627-10 Aug 04 14:26:50.026269 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-89b2801e-aa73-4859-9818-9a5bd7c4b2b5 req-5fb16c30-83ea-49bc-b33c-53fd6f66b3a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164596 Aug 04 14:26:50.030484 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2675/5325] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:26:51.163883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbe6187d-b1b0-4ce1-a148-633f04c5da3f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:51.178296 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbe6187d-b1b0-4ce1-a148-633f04c5da3f tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1316 microversion: 2.1 time: 1.534284 Aug 04 14:26:51.197222 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2651/5326] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:49 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1316 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:52.215614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9ea22fc-b62a-4248-b3b0-46b3bbcae373 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:52.216497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f9ea22fc-b62a-4248-b3b0-46b3bbcae373 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:52.268588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9ea22fc-b62a-4248-b3b0-46b3bbcae373 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:52.269439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9ea22fc-b62a-4248-b3b0-46b3bbcae373 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:52.283906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9ea22fc-b62a-4248-b3b0-46b3bbcae373 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:52.295109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9ea22fc-b62a-4248-b3b0-46b3bbcae373 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:53.060229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f9ea22fc-b62a-4248-b3b0-46b3bbcae373 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:53.113583 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f9ea22fc-b62a-4248-b3b0-46b3bbcae373 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1316 microversion: 2.1 time: 0.908192 Aug 04 14:26:53.118220 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2676/5327] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:52 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1316 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:54.140267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ad898515-127d-442c-9ae8-92731347c19c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:54.147580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ad898515-127d-442c-9ae8-92731347c19c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:54.184548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad898515-127d-442c-9ae8-92731347c19c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:54.187948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad898515-127d-442c-9ae8-92731347c19c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:54.198664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad898515-127d-442c-9ae8-92731347c19c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:54.210822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad898515-127d-442c-9ae8-92731347c19c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:55.669613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ad898515-127d-442c-9ae8-92731347c19c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:55.700377 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ad898515-127d-442c-9ae8-92731347c19c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1316 microversion: 2.1 time: 1.563752 Aug 04 14:26:55.707829 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2652/5328] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:54 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1316 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:56.751738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-73c264cc-af30-4a4d-9954-723c71f55097 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:56.757476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-73c264cc-af30-4a4d-9954-723c71f55097 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:56.780435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73c264cc-af30-4a4d-9954-723c71f55097 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:56.781741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73c264cc-af30-4a4d-9954-723c71f55097 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:56.783677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73c264cc-af30-4a4d-9954-723c71f55097 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:56.784799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73c264cc-af30-4a4d-9954-723c71f55097 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:57.932308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75e3a7b3-4490-42f0-a556-463b46bc0a87 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:57.934679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-75e3a7b3-4490-42f0-a556-463b46bc0a87 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:57.954085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75e3a7b3-4490-42f0-a556-463b46bc0a87 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:57.954985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75e3a7b3-4490-42f0-a556-463b46bc0a87 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:57.956056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75e3a7b3-4490-42f0-a556-463b46bc0a87 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:57.959841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75e3a7b3-4490-42f0-a556-463b46bc0a87 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:57.964479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-73c264cc-af30-4a4d-9954-723c71f55097 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:26:57.995199 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-73c264cc-af30-4a4d-9954-723c71f55097 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1316 microversion: 2.1 time: 1.251715 Aug 04 14:26:57.997110 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2677/5329] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:56 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1316 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:26:58.131837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-75e3a7b3-4490-42f0-a556-463b46bc0a87 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lazy-loading 'services' on Instance uuid d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:26:58.416701 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75e3a7b3-4490-42f0-a556-463b46bc0a87 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/os-volume_attachments/037224b1-e341-4a9b-9342-66e1de6bbd33" status: 202 len: 0 microversion: 2.1 time: 0.488915 Aug 04 14:26:58.452251 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2653/5330] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:26:57 2022] DELETE /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/os-volume_attachments/037224b1-e341-4a9b-9342-66e1de6bbd33 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:26:59.050034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-34169392-08fd-4640-9958-d0b559a75df3 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:26:59.052248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-34169392-08fd-4640-9958-d0b559a75df3 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:26:59.069922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34169392-08fd-4640-9958-d0b559a75df3 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:59.071579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34169392-08fd-4640-9958-d0b559a75df3 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:59.073574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34169392-08fd-4640-9958-d0b559a75df3 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:59.074697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-34169392-08fd-4640-9958-d0b559a75df3 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:59.773594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-52cc4136-0e22-42bf-a0c4-57aaead6f3a1 req-a8d94044-392d-482c-9176-c3a60dedb5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da17a4f-5433-4b5a-a477-e0e36e037db2", "name": "network-vif-plugged", "status": "completed", "tag": "41168dcc-28fb-42f2-b585-53ddcc668153"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:26:59.834750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-52cc4136-0e22-42bf-a0c4-57aaead6f3a1 req-a8d94044-392d-482c-9176-c3a60dedb5ab service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:26:59.835695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-52cc4136-0e22-42bf-a0c4-57aaead6f3a1 req-a8d94044-392d-482c-9176-c3a60dedb5ab service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:26:59.849243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:26:59.898846 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-52cc4136-0e22-42bf-a0c4-57aaead6f3a1 req-a8d94044-392d-482c-9176-c3a60dedb5ab service nova] Creating event network-vif-plugged:41168dcc-28fb-42f2-b585-53ddcc668153 for instance 1da17a4f-5433-4b5a-a477-e0e36e037db2 on n-h2-844627-10 Aug 04 14:26:59.919561 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-52cc4136-0e22-42bf-a0c4-57aaead6f3a1 req-a8d94044-392d-482c-9176-c3a60dedb5ab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165751 Aug 04 14:26:59.920887 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2654/5331] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:26:59.943090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-34169392-08fd-4640-9958-d0b559a75df3 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:00.009277 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-34169392-08fd-4640-9958-d0b559a75df3 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1316 microversion: 2.1 time: 0.966469 Aug 04 14:27:00.016503 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2678/5332] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:26:59 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1316 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:27:01.061688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c6cc3af-3e86-491c-8425-1be1ab68f1de tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:01.086085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c6cc3af-3e86-491c-8425-1be1ab68f1de tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:01.128981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c6cc3af-3e86-491c-8425-1be1ab68f1de tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:01.135035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c6cc3af-3e86-491c-8425-1be1ab68f1de tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:01.143248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c6cc3af-3e86-491c-8425-1be1ab68f1de tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:01.144747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c6cc3af-3e86-491c-8425-1be1ab68f1de tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:03.351964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c6cc3af-3e86-491c-8425-1be1ab68f1de tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:03.382863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c6cc3af-3e86-491c-8425-1be1ab68f1de tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1316 microversion: 2.1 time: 2.328931 Aug 04 14:27:03.388219 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2655/5333] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:01 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1316 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:04.439993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-17b5df7e-1a4a-48d1-8c2c-a60c68b167ac tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:04.442883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-17b5df7e-1a4a-48d1-8c2c-a60c68b167ac tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:04.497586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17b5df7e-1a4a-48d1-8c2c-a60c68b167ac tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:04.500060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17b5df7e-1a4a-48d1-8c2c-a60c68b167ac tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:04.507376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17b5df7e-1a4a-48d1-8c2c-a60c68b167ac tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:04.510255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-17b5df7e-1a4a-48d1-8c2c-a60c68b167ac tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:04.963199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-17b5df7e-1a4a-48d1-8c2c-a60c68b167ac tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:04.973301 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-17b5df7e-1a4a-48d1-8c2c-a60c68b167ac tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1505 microversion: 2.1 time: 0.552612 Aug 04 14:27:04.982034 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2679/5334] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:04 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:05.035949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d66d3ed-b466-4fa7-b77c-9189327bcddd tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:05.037721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8d66d3ed-b466-4fa7-b77c-9189327bcddd tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:05.084844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d66d3ed-b466-4fa7-b77c-9189327bcddd tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:05.091084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d66d3ed-b466-4fa7-b77c-9189327bcddd tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:05.095351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d66d3ed-b466-4fa7-b77c-9189327bcddd tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:05.097276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d66d3ed-b466-4fa7-b77c-9189327bcddd tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:05.386519 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d66d3ed-b466-4fa7-b77c-9189327bcddd tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.356637 Aug 04 14:27:05.396108 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2656/5335] 10.222.0.66 () {58 vars in 1296 bytes} [Thu Aug 4 14:27:05 2022] DELETE /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2/os-server-password => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:27:05.400205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-04af96a6-9b91-4a91-b37b-650ef16b1905 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:05.400746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-04af96a6-9b91-4a91-b37b-650ef16b1905 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:05.422867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04af96a6-9b91-4a91-b37b-650ef16b1905 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:05.423205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04af96a6-9b91-4a91-b37b-650ef16b1905 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:05.424043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04af96a6-9b91-4a91-b37b-650ef16b1905 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:05.424496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-04af96a6-9b91-4a91-b37b-650ef16b1905 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:05.491435 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-04af96a6-9b91-4a91-b37b-650ef16b1905 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.095462 Aug 04 14:27:05.492180 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2680/5336] 10.222.0.66 () {58 vars in 1293 bytes} [Thu Aug 4 14:27:05 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2/os-server-password => generated 16 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:27:05.519445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-036387be-8b9d-4ef9-b38a-4200b664d792 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:05.523916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-036387be-8b9d-4ef9-b38a-4200b664d792 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:05.557337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-036387be-8b9d-4ef9-b38a-4200b664d792 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:05.558582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-036387be-8b9d-4ef9-b38a-4200b664d792 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:05.565477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-036387be-8b9d-4ef9-b38a-4200b664d792 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:05.569309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-036387be-8b9d-4ef9-b38a-4200b664d792 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:05.680700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-036387be-8b9d-4ef9-b38a-4200b664d792 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:27:05.917603 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-036387be-8b9d-4ef9-b38a-4200b664d792 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 204 len: 0 microversion: 2.1 time: 0.412276 Aug 04 14:27:05.927742 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2657/5337] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:27:05 2022] DELETE /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:27:05.936343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea6c9229-99e2-4b37-8524-86d0c02ee8b5 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:05.937831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ea6c9229-99e2-4b37-8524-86d0c02ee8b5 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:05.946395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea6c9229-99e2-4b37-8524-86d0c02ee8b5 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:05.948530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea6c9229-99e2-4b37-8524-86d0c02ee8b5 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:05.949725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea6c9229-99e2-4b37-8524-86d0c02ee8b5 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:05.950412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea6c9229-99e2-4b37-8524-86d0c02ee8b5 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:06.844640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ea6c9229-99e2-4b37-8524-86d0c02ee8b5 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:06.893060 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ea6c9229-99e2-4b37-8524-86d0c02ee8b5 tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1511 microversion: 2.1 time: 0.957257 Aug 04 14:27:06.896825 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2681/5338] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:05 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1511 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:07.943358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-44d809b4-d2b4-4414-9fe8-f288d417c93e tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:07.944101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-44d809b4-d2b4-4414-9fe8-f288d417c93e tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:08.005770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44d809b4-d2b4-4414-9fe8-f288d417c93e tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:08.011095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44d809b4-d2b4-4414-9fe8-f288d417c93e tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:08.022866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44d809b4-d2b4-4414-9fe8-f288d417c93e tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:08.023375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44d809b4-d2b4-4414-9fe8-f288d417c93e tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:08.545733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-44d809b4-d2b4-4414-9fe8-f288d417c93e tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:08.566325 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-44d809b4-d2b4-4414-9fe8-f288d417c93e tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1511 microversion: 2.1 time: 0.632659 Aug 04 14:27:08.583027 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2658/5339] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:07 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:09.601036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8d1ce055-c566-4969-afb2-5708c6641eba tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:09.608800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8d1ce055-c566-4969-afb2-5708c6641eba tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:09.672602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d1ce055-c566-4969-afb2-5708c6641eba tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:09.681735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d1ce055-c566-4969-afb2-5708c6641eba tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:09.716260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d1ce055-c566-4969-afb2-5708c6641eba tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:09.718543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d1ce055-c566-4969-afb2-5708c6641eba tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:10.007067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d1ce055-c566-4969-afb2-5708c6641eba tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37098eed8f0432ea2e9ae8606d3bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ce286af0e945dca7f6a922538a300e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:10.035564 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8d1ce055-c566-4969-afb2-5708c6641eba tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 200 len: 1469 microversion: 2.1 time: 0.443538 Aug 04 14:27:10.036441 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2682/5340] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:09 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 1469 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:10.091679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-9565875f-1dff-421c-90fb-ab24d8f334b8 req-907e32cf-9317-452a-bf93-05d6afc45d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da17a4f-5433-4b5a-a477-e0e36e037db2", "name": "network-vif-deleted", "tag": "41168dcc-28fb-42f2-b585-53ddcc668153"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:27:10.137150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9565875f-1dff-421c-90fb-ab24d8f334b8 req-907e32cf-9317-452a-bf93-05d6afc45d2d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:10.143723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9565875f-1dff-421c-90fb-ab24d8f334b8 req-907e32cf-9317-452a-bf93-05d6afc45d2d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:10.197270 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-9565875f-1dff-421c-90fb-ab24d8f334b8 req-907e32cf-9317-452a-bf93-05d6afc45d2d service nova] Creating event network-vif-deleted:41168dcc-28fb-42f2-b585-53ddcc668153 for instance 1da17a4f-5433-4b5a-a477-e0e36e037db2 on n-h2-844627-10 Aug 04 14:27:10.229393 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-9565875f-1dff-421c-90fb-ab24d8f334b8 req-907e32cf-9317-452a-bf93-05d6afc45d2d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143900 Aug 04 14:27:10.231414 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2659/5341] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:27:11.089123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:11.090616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] [instance: 1da17a4f-5433-4b5a-a477-e0e36e037db2] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:11.123783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:11.125833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:11.132367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:11.133167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:11.188196 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] HTTP exception thrown: Instance 1da17a4f-5433-4b5a-a477-e0e36e037db2 could not be found. Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Request method failure captured: Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 HTTP/1.1 Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69caivEfHIFUePKOP_5o3bZW37aQynklSPnJuosCskM_bWZhq1d_XGc-KQCOhkBo9RtrEFKUc8af3OZ52ce6R3sDBM1hKBR_emiTbqGmzZdnMaHpsqU8TPJ_Ilsn-gLfFrNnJOIWkbewZq8UDBAi1Ekr_ZMgzlcFEgJyEcvBmM7aOOE Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 43ce286af0e945dca7f6a922538a300e Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerPasswordTestJSON-738482348 Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/43ce286af0e945dca7f6a922538a300e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_43ce286af0e945dca7f6a922538a300e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/43ce286af0e945dca7f6a922538a300e"}]}, {"type": "tempest-type-1595801973", "name": "tempest-service-347533416", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/43ce286af0e945dca7f6a922538a300e"}]}, {"type": "tempest-type-1517537062", "name": "tempest-service-2143628398", "endpoints": []}] Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerPasswordTestJSON-738482348 Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 43ce286af0e945dca7f6a922538a300e Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerPasswordTestJSON-738482348 Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerPasswordTestJSON-738482348-project Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: a37098eed8f0432ea2e9ae8606d3bb02 Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerPasswordTestJSON-738482348-project Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 1da17a4f-5433-4b5a-a477-e0e36e037db2 could not be found. Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '1da17a4f-5433-4b5a-a477-e0e36e037db2'} Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da17a4f-5433-4b5a-a477-e0e36e037db2 could not be found. Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da17a4f-5433-4b5a-a477-e0e36e037db2 could not be found. Aug 04 14:27:11.193960 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da17a4f-5433-4b5a-a477-e0e36e037db2 could not be found. Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:27:11.198816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] Returning 404 to user: Instance 1da17a4f-5433-4b5a-a477-e0e36e037db2 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:27:11.214256 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ebb93e0b-b125-4392-8127-f5819abf277c tempest-ServerPasswordTestJSON-738482348 tempest-ServerPasswordTestJSON-738482348-project] 10.222.0.66 "GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2" status: 404 len: 111 microversion: 2.1 time: 0.121306 Aug 04 14:27:11.216794 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2683/5342] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:11 2022] GET /compute/v2.1/servers/1da17a4f-5433-4b5a-a477-e0e36e037db2 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:27:14.830117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90918b3d-90d8-45c7-b15a-c55edaee4526 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:27:14.846683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90918b3d-90d8-45c7-b15a-c55edaee4526 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:14.848676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90918b3d-90d8-45c7-b15a-c55edaee4526 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:14.913429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-90918b3d-90d8-45c7-b15a-c55edaee4526 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Going to try to stop instance {{(pid=130961) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 14:27:15.011825 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90918b3d-90d8-45c7-b15a-c55edaee4526 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.191670 Aug 04 14:27:15.012819 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2660/5343] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:27:14 2022] POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:27:15.035775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ad81a454-0789-46ca-a940-012d6600b40f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:15.038404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ad81a454-0789-46ca-a940-012d6600b40f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:15.071620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad81a454-0789-46ca-a940-012d6600b40f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:15.074283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad81a454-0789-46ca-a940-012d6600b40f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:15.077812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad81a454-0789-46ca-a940-012d6600b40f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:15.080785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad81a454-0789-46ca-a940-012d6600b40f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:15.780260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ad81a454-0789-46ca-a940-012d6600b40f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:15.803741 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ad81a454-0789-46ca-a940-012d6600b40f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1680 microversion: 2.1 time: 0.780535 Aug 04 14:27:15.805589 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2684/5344] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:15 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1680 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:16.858143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-88b8010d-83a8-40dc-b4fc-bdc29566ca12 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:16.861856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-88b8010d-83a8-40dc-b4fc-bdc29566ca12 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:16.883962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:27:16.921374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88b8010d-83a8-40dc-b4fc-bdc29566ca12 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:16.921930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88b8010d-83a8-40dc-b4fc-bdc29566ca12 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:16.931606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88b8010d-83a8-40dc-b4fc-bdc29566ca12 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:16.934709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88b8010d-83a8-40dc-b4fc-bdc29566ca12 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:17.875403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-88b8010d-83a8-40dc-b4fc-bdc29566ca12 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:17.896933 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-88b8010d-83a8-40dc-b4fc-bdc29566ca12 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1680 microversion: 2.1 time: 1.051201 Aug 04 14:27:17.900206 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2661/5345] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:16 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1680 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:18.945972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64290e84-ecb1-4fc6-a50b-dd7fb42eb8d5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:18.947404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64290e84-ecb1-4fc6-a50b-dd7fb42eb8d5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:18.969248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=22 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:27:18.977365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64290e84-ecb1-4fc6-a50b-dd7fb42eb8d5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:18.992737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64290e84-ecb1-4fc6-a50b-dd7fb42eb8d5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:19.003049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64290e84-ecb1-4fc6-a50b-dd7fb42eb8d5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:19.007329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64290e84-ecb1-4fc6-a50b-dd7fb42eb8d5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:19.019591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=56 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:27:20.463034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-64290e84-ecb1-4fc6-a50b-dd7fb42eb8d5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:20.509708 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-64290e84-ecb1-4fc6-a50b-dd7fb42eb8d5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1680 microversion: 2.1 time: 1.558950 Aug 04 14:27:20.550951 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2685/5346] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:18 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1680 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:21.559748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-17660d95-f2b9-4029-88b7-b844698931c8 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:21.560824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-17660d95-f2b9-4029-88b7-b844698931c8 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:21.590882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17660d95-f2b9-4029-88b7-b844698931c8 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:21.591352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17660d95-f2b9-4029-88b7-b844698931c8 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:21.592190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17660d95-f2b9-4029-88b7-b844698931c8 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:21.607269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17660d95-f2b9-4029-88b7-b844698931c8 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:22.963655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-17660d95-f2b9-4029-88b7-b844698931c8 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:23.033019 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-17660d95-f2b9-4029-88b7-b844698931c8 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1680 microversion: 2.1 time: 1.465019 Aug 04 14:27:23.034416 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2662/5347] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:21 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1680 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:24.078632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae6ce8f3-adb2-4868-a755-80eff8d602e3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:24.079800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ae6ce8f3-adb2-4868-a755-80eff8d602e3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:24.146679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae6ce8f3-adb2-4868-a755-80eff8d602e3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:24.183017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae6ce8f3-adb2-4868-a755-80eff8d602e3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:24.199712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae6ce8f3-adb2-4868-a755-80eff8d602e3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:24.222079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae6ce8f3-adb2-4868-a755-80eff8d602e3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:25.073263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbfa0400-fedf-4e6e-800f-8cc17c5aa481 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Action: 'create', calling method: .version_select at 0x7f46f2faf550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1126711325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVxv3CSj7ncZSQf8lnwEMk4KSBlEP/dNbzB6js0jmP6p69jTUnZr8re7nhkAaZMUt6jD3l59LJY2eD410YSq2ivquJd/s4hkTjDlDt4hQITDfeTTPXCM6wYld/W2nZRRg=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:27:25.232309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fbfa0400-fedf-4e6e-800f-8cc17c5aa481 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:27:25.272993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fbfa0400-fedf-4e6e-800f-8cc17c5aa481 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for user b691f49b0fe64e8a99ca896ddba38334 and project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:27:25.286272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ae6ce8f3-adb2-4868-a755-80eff8d602e3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:25.300814 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae6ce8f3-adb2-4868-a755-80eff8d602e3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1680 microversion: 2.1 time: 1.230405 Aug 04 14:27:25.308086 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2686/5348] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:24 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1680 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:25.402690 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fbfa0400-fedf-4e6e-800f-8cc17c5aa481 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.340950 Aug 04 14:27:25.403342 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2663/5349] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:27:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:27:26.357749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ed39d5a8-6dcb-4960-a491-ceb91e5e2421 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:26.361860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ed39d5a8-6dcb-4960-a491-ceb91e5e2421 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:26.396014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed39d5a8-6dcb-4960-a491-ceb91e5e2421 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:26.396474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed39d5a8-6dcb-4960-a491-ceb91e5e2421 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:26.402477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed39d5a8-6dcb-4960-a491-ceb91e5e2421 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:26.403023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed39d5a8-6dcb-4960-a491-ceb91e5e2421 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:26.982972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ed39d5a8-6dcb-4960-a491-ceb91e5e2421 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:26.992619 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ed39d5a8-6dcb-4960-a491-ceb91e5e2421 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1680 microversion: 2.1 time: 0.649683 Aug 04 14:27:27.009937 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2687/5350] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:26 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1680 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:28.027682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4d006cd-39ea-4ece-a9e1-e49b4328e64c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:28.039911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f4d006cd-39ea-4ece-a9e1-e49b4328e64c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:28.074742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4d006cd-39ea-4ece-a9e1-e49b4328e64c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:28.076072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4d006cd-39ea-4ece-a9e1-e49b4328e64c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:28.078000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4d006cd-39ea-4ece-a9e1-e49b4328e64c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:28.079758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4d006cd-39ea-4ece-a9e1-e49b4328e64c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:29.181943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f4d006cd-39ea-4ece-a9e1-e49b4328e64c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:29.248916 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4d006cd-39ea-4ece-a9e1-e49b4328e64c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1680 microversion: 2.1 time: 1.228797 Aug 04 14:27:29.255231 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2664/5351] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:28 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1680 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:30.281210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1da37c70-24d6-4c9d-9c78-360829322213 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:30.282428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1da37c70-24d6-4c9d-9c78-360829322213 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:30.305668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1da37c70-24d6-4c9d-9c78-360829322213 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:30.310020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1da37c70-24d6-4c9d-9c78-360829322213 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:30.327787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1da37c70-24d6-4c9d-9c78-360829322213 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:30.327978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1da37c70-24d6-4c9d-9c78-360829322213 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:30.781329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1da37c70-24d6-4c9d-9c78-360829322213 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:30.791520 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1da37c70-24d6-4c9d-9c78-360829322213 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1680 microversion: 2.1 time: 0.517035 Aug 04 14:27:30.793696 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2688/5352] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:30 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1680 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:31.132566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1691982708", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "d2e24000-4093-4179-8167-4c92a9e1d5fe"}], "key_name": "tempest-TestNetworkBasicOps-1126711325", "security_groups": [{"name": "tempest-secgroup-smoke-133479813"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:27:31.543695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] validate_networks() for [('d2e24000-4093-4179-8167-4c92a9e1d5fe', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:27:31.817613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fc93146c-61f7-4b71-9efa-1dd2184ab9c9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:31.818300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fc93146c-61f7-4b71-9efa-1dd2184ab9c9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:31.840908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc93146c-61f7-4b71-9efa-1dd2184ab9c9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:31.845118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc93146c-61f7-4b71-9efa-1dd2184ab9c9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:31.849185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc93146c-61f7-4b71-9efa-1dd2184ab9c9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:31.854320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc93146c-61f7-4b71-9efa-1dd2184ab9c9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:32.986593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fc93146c-61f7-4b71-9efa-1dd2184ab9c9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:33.049135 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fc93146c-61f7-4b71-9efa-1dd2184ab9c9 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1657 microversion: 2.1 time: 1.234857 Aug 04 14:27:33.050785 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2689/5353] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:31 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1657 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:33.105153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e7741be7-6534-4738-9cd9-f35b6ded1fa1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:27:33.123997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7741be7-6534-4738-9cd9-f35b6ded1fa1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:33.127766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7741be7-6534-4738-9cd9-f35b6ded1fa1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:33.242455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e7741be7-6534-4738-9cd9-f35b6ded1fa1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Going to try to start instance {{(pid=130960) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 14:27:33.427111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e7741be7-6534-4738-9cd9-f35b6ded1fa1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/action" status: 202 len: 0 microversion: 2.1 time: 0.354487 Aug 04 14:27:33.428767 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2690/5354] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:27:33 2022] POST /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:27:33.443704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-157a714d-2ef2-48d0-922d-2c8fdd5678fc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:33.445679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-157a714d-2ef2-48d0-922d-2c8fdd5678fc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:33.477241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-157a714d-2ef2-48d0-922d-2c8fdd5678fc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:33.479581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-157a714d-2ef2-48d0-922d-2c8fdd5678fc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:33.482730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-157a714d-2ef2-48d0-922d-2c8fdd5678fc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:33.485443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-157a714d-2ef2-48d0-922d-2c8fdd5678fc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:34.016660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:27:34.017618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:27:34.017618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:27:34.018053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:27:34.018524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:27:34.037030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:34.037724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:34.038818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:34.039411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:34.077660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:27:34.127545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:27:34.136709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Getting quotas for user b691f49b0fe64e8a99ca896ddba38334 and project 5d1deaa23b8c458aa2d180b131da4923. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:27:34.202144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:27:34.215740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-157a714d-2ef2-48d0-922d-2c8fdd5678fc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:34.222366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:27:34.247382 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-157a714d-2ef2-48d0-922d-2c8fdd5678fc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1666 microversion: 2.1 time: 0.813798 Aug 04 14:27:34.262680 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2691/5355] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:33 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1666 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:34.459993 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70e9744f-0543-493d-b2b0-076ba1ecc6d5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.335410 Aug 04 14:27:34.464624 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2665/5356] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:27:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 3341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:27:34.478584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca12b8dc-3add-44b8-90ec-4f3748ecc72f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:34.479259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ca12b8dc-3add-44b8-90ec-4f3748ecc72f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:34.668786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ca12b8dc-3add-44b8-90ec-4f3748ecc72f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:34.676774 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca12b8dc-3add-44b8-90ec-4f3748ecc72f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1249 microversion: 2.1 time: 0.202106 Aug 04 14:27:34.697807 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2692/5357] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:34 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1249 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:35.276419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f62c3a44-5cc3-4771-97b5-a6a8564cc6c3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:35.277845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f62c3a44-5cc3-4771-97b5-a6a8564cc6c3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:35.300150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f62c3a44-5cc3-4771-97b5-a6a8564cc6c3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:35.301464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f62c3a44-5cc3-4771-97b5-a6a8564cc6c3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:35.303775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f62c3a44-5cc3-4771-97b5-a6a8564cc6c3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:35.308151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f62c3a44-5cc3-4771-97b5-a6a8564cc6c3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:35.642801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca12b8dc-3add-44b8-90ec-4f3748ecc72f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:35.643808 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca12b8dc-3add-44b8-90ec-4f3748ecc72f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001366 Aug 04 14:27:35.644546 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2693/5358] 10.222.0.66 () {56 vars in 886 bytes} [Thu Aug 4 14:27:35 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 04 14:27:35.705292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-604ae4fa-c6d3-4258-8aa9-85f2fb04cf1f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:35.705925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-604ae4fa-c6d3-4258-8aa9-85f2fb04cf1f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:35.752564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f62c3a44-5cc3-4771-97b5-a6a8564cc6c3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:35.769414 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f62c3a44-5cc3-4771-97b5-a6a8564cc6c3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1666 microversion: 2.1 time: 0.497713 Aug 04 14:27:35.772226 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2666/5359] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:35 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1666 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:35.846876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-604ae4fa-c6d3-4258-8aa9-85f2fb04cf1f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:35.856370 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-604ae4fa-c6d3-4258-8aa9-85f2fb04cf1f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1249 microversion: 2.1 time: 0.155755 Aug 04 14:27:35.859056 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2694/5360] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:35 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1249 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:36.798335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2356ad3d-8a4b-4f6d-aca1-3c42b02389ef tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:36.799110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2356ad3d-8a4b-4f6d-aca1-3c42b02389ef tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:36.807891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2356ad3d-8a4b-4f6d-aca1-3c42b02389ef tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:36.808749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2356ad3d-8a4b-4f6d-aca1-3c42b02389ef tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:36.809835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2356ad3d-8a4b-4f6d-aca1-3c42b02389ef tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:36.810516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2356ad3d-8a4b-4f6d-aca1-3c42b02389ef tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:36.882824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0dfcc607-a2ad-46b7-bec3-6b9a27043b1a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:36.883628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0dfcc607-a2ad-46b7-bec3-6b9a27043b1a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:36.913187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dfcc607-a2ad-46b7-bec3-6b9a27043b1a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:36.914344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dfcc607-a2ad-46b7-bec3-6b9a27043b1a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:36.915401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dfcc607-a2ad-46b7-bec3-6b9a27043b1a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:36.920121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dfcc607-a2ad-46b7-bec3-6b9a27043b1a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:37.127103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0dfcc607-a2ad-46b7-bec3-6b9a27043b1a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:37.160305 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0dfcc607-a2ad-46b7-bec3-6b9a27043b1a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1245 microversion: 2.1 time: 0.282883 Aug 04 14:27:37.166432 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2695/5361] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:36 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1245 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:37.442811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2356ad3d-8a4b-4f6d-aca1-3c42b02389ef tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:37.451061 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2356ad3d-8a4b-4f6d-aca1-3c42b02389ef tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1666 microversion: 2.1 time: 0.658168 Aug 04 14:27:37.453424 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2667/5362] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:36 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1666 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:27:38.201688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a161308a-cc5c-4a12-a60a-b3060d77d222 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:38.208301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a161308a-cc5c-4a12-a60a-b3060d77d222 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:38.228662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a161308a-cc5c-4a12-a60a-b3060d77d222 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:38.234051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a161308a-cc5c-4a12-a60a-b3060d77d222 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:38.239236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a161308a-cc5c-4a12-a60a-b3060d77d222 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:38.242601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a161308a-cc5c-4a12-a60a-b3060d77d222 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:38.490932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-657a4e91-e736-47d8-949d-2300202603a4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:38.493083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-657a4e91-e736-47d8-949d-2300202603a4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:38.513559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-657a4e91-e736-47d8-949d-2300202603a4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:38.521302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-657a4e91-e736-47d8-949d-2300202603a4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:38.524066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-657a4e91-e736-47d8-949d-2300202603a4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:38.533534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-657a4e91-e736-47d8-949d-2300202603a4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:38.700504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a161308a-cc5c-4a12-a60a-b3060d77d222 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:38.726192 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a161308a-cc5c-4a12-a60a-b3060d77d222 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1319 microversion: 2.1 time: 0.529615 Aug 04 14:27:38.739819 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2696/5363] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:38 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1319 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:39.765139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e3abd1e9-2652-4389-b130-ed56e01f91c9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:39.766319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e3abd1e9-2652-4389-b130-ed56e01f91c9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:39.801905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3abd1e9-2652-4389-b130-ed56e01f91c9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:39.808456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3abd1e9-2652-4389-b130-ed56e01f91c9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:39.809647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3abd1e9-2652-4389-b130-ed56e01f91c9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:39.821052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e3abd1e9-2652-4389-b130-ed56e01f91c9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:39.855824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-657a4e91-e736-47d8-949d-2300202603a4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:39.905600 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-657a4e91-e736-47d8-949d-2300202603a4 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1666 microversion: 2.1 time: 1.425743 Aug 04 14:27:39.920701 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2668/5364] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:38 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1666 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:40.445336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e3abd1e9-2652-4389-b130-ed56e01f91c9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:40.461107 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e3abd1e9-2652-4389-b130-ed56e01f91c9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1307 microversion: 2.1 time: 0.704074 Aug 04 14:27:40.461706 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2697/5365] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:39 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1307 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:27:40.929790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72679c07-565b-4fcf-997e-6d0f98800c7d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:40.930600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-72679c07-565b-4fcf-997e-6d0f98800c7d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:40.941435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72679c07-565b-4fcf-997e-6d0f98800c7d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:40.941888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72679c07-565b-4fcf-997e-6d0f98800c7d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:40.942687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72679c07-565b-4fcf-997e-6d0f98800c7d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:40.943128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72679c07-565b-4fcf-997e-6d0f98800c7d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:41.506907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30a1b337-d3a9-4a03-86f5-522af2077a10 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:41.507732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-30a1b337-d3a9-4a03-86f5-522af2077a10 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:41.531438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30a1b337-d3a9-4a03-86f5-522af2077a10 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:41.535321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30a1b337-d3a9-4a03-86f5-522af2077a10 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:41.536558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30a1b337-d3a9-4a03-86f5-522af2077a10 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:41.545360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30a1b337-d3a9-4a03-86f5-522af2077a10 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:41.853416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-30a1b337-d3a9-4a03-86f5-522af2077a10 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:41.866145 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30a1b337-d3a9-4a03-86f5-522af2077a10 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1307 microversion: 2.1 time: 0.366368 Aug 04 14:27:41.867140 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2698/5366] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:41 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1307 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:27:42.051892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-72679c07-565b-4fcf-997e-6d0f98800c7d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:42.072536 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-72679c07-565b-4fcf-997e-6d0f98800c7d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1670 microversion: 2.1 time: 1.146824 Aug 04 14:27:42.073530 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2669/5367] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:40 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1670 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:42.902407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d3b1ac67-4bce-483c-a9c0-37da2884d752 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:42.903170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d3b1ac67-4bce-483c-a9c0-37da2884d752 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:42.927610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3b1ac67-4bce-483c-a9c0-37da2884d752 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:42.928063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3b1ac67-4bce-483c-a9c0-37da2884d752 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:42.929810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3b1ac67-4bce-483c-a9c0-37da2884d752 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:42.933419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3b1ac67-4bce-483c-a9c0-37da2884d752 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:43.510540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d3b1ac67-4bce-483c-a9c0-37da2884d752 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:43.550657 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d3b1ac67-4bce-483c-a9c0-37da2884d752 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1374 microversion: 2.1 time: 0.651992 Aug 04 14:27:43.551280 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2699/5368] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:42 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1374 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:27:44.079209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:27:44.177452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=10 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:27:44.220965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0afc0139-211b-44be-959d-fbe411377e67 req-2788ca7e-eb5f-4651-a315-80fff171e896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aca3dba-b155-4204-8a8b-ee33498ff8fe", "tag": "d0b801d2-4404-4420-a482-563ef496122f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:27:44.253564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0afc0139-211b-44be-959d-fbe411377e67 req-2788ca7e-eb5f-4651-a315-80fff171e896 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:44.253876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0afc0139-211b-44be-959d-fbe411377e67 req-2788ca7e-eb5f-4651-a315-80fff171e896 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:44.287983 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0afc0139-211b-44be-959d-fbe411377e67 req-2788ca7e-eb5f-4651-a315-80fff171e896 service nova] Creating event network-changed:d0b801d2-4404-4420-a482-563ef496122f for instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe on n-h2-844627-10 Aug 04 14:27:44.302283 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0afc0139-211b-44be-959d-fbe411377e67 req-2788ca7e-eb5f-4651-a315-80fff171e896 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080824 Aug 04 14:27:44.303250 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2700/5369] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:27:44.409016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-79b6c8ad-6b68-4291-b0cd-679c22a29361 tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] Calling method '.version_select at 0x7f46f2f74b80>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:44.583560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6111a4ab-6704-46e9-990b-989890772877 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:44.592003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6111a4ab-6704-46e9-990b-989890772877 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:44.633552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6111a4ab-6704-46e9-990b-989890772877 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:44.634496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6111a4ab-6704-46e9-990b-989890772877 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:44.636724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6111a4ab-6704-46e9-990b-989890772877 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:44.638006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6111a4ab-6704-46e9-990b-989890772877 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:45.028846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6111a4ab-6704-46e9-990b-989890772877 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:45.057948 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6111a4ab-6704-46e9-990b-989890772877 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1374 microversion: 2.1 time: 0.487653 Aug 04 14:27:45.060394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2701/5370] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:44 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1374 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:45.201855 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-79b6c8ad-6b68-4291-b0cd-679c22a29361 tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d/defaults" status: 200 len: 371 microversion: 2.1 time: 1.666367 Aug 04 14:27:45.217482 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2670/5371] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 14:27:43 2022] GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d/defaults => generated 371 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:27:45.222087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7400cbd8-598d-433c-9799-474ef0f7805f tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] Calling method '.version_select at 0x7f46f3cf48b0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:45.467007 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7400cbd8-598d-433c-9799-474ef0f7805f tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d" status: 200 len: 371 microversion: 2.1 time: 0.249985 Aug 04 14:27:45.468345 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2702/5372] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 14:27:45 2022] GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d => generated 371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:27:45.492335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0a89df9-7c05-48d2-9f9f-e159d84cb74a tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] Calling method '.version_select at 0x7f46f2fa75e0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:46.101751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c8a3c3ec-e186-46d8-b902-e0266b1a6bb9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:46.102391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c8a3c3ec-e186-46d8-b902-e0266b1a6bb9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:46.123264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8a3c3ec-e186-46d8-b902-e0266b1a6bb9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:46.123946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8a3c3ec-e186-46d8-b902-e0266b1a6bb9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:46.125300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8a3c3ec-e186-46d8-b902-e0266b1a6bb9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:46.125928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8a3c3ec-e186-46d8-b902-e0266b1a6bb9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:46.551080 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0a89df9-7c05-48d2-9f9f-e159d84cb74a tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d/defaults" status: 200 len: 371 microversion: 2.1 time: 1.062949 Aug 04 14:27:46.551902 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2671/5373] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 14:27:45 2022] GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d/defaults => generated 371 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:27:46.574679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c8a3c3ec-e186-46d8-b902-e0266b1a6bb9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:46.584757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e82fad0-3c0f-4c27-aea5-330afcd06183 tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] Calling method '.version_select at 0x7f46f2f3c160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:46.600159 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c8a3c3ec-e186-46d8-b902-e0266b1a6bb9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1374 microversion: 2.1 time: 0.507164 Aug 04 14:27:46.602964 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2703/5374] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:46 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1374 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:47.628012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4395a77e-0835-4d89-8151-ba3a329208a3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:47.629111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4395a77e-0835-4d89-8151-ba3a329208a3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:47.648001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4395a77e-0835-4d89-8151-ba3a329208a3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:47.648467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4395a77e-0835-4d89-8151-ba3a329208a3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:47.649316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4395a77e-0835-4d89-8151-ba3a329208a3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:47.649765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4395a77e-0835-4d89-8151-ba3a329208a3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:47.954891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:27:48.050215 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e82fad0-3c0f-4c27-aea5-330afcd06183 tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d" status: 200 len: 371 microversion: 2.1 time: 1.478973 Aug 04 14:27:48.069283 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2672/5375] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 14:27:46 2022] GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d => generated 371 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:27:48.100549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2cadf67f-799f-4468-98f2-658f9b1beeeb tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] Calling method '.version_select at 0x7f46f2ff09d0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:48.266050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4395a77e-0835-4d89-8151-ba3a329208a3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:48.275688 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4395a77e-0835-4d89-8151-ba3a329208a3 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1374 microversion: 2.1 time: 0.652131 Aug 04 14:27:48.282962 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2704/5376] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:47 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1374 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:49.017477 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2cadf67f-799f-4468-98f2-658f9b1beeeb tempest-QuotasTestJSON-996482442 tempest-QuotasTestJSON-996482442-project] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d?user_id=abb365444cfc4c3bbd5067bc9ed12a83" status: 200 len: 371 microversion: 2.1 time: 0.945848 Aug 04 14:27:49.028365 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2673/5377] 10.222.0.66 () {58 vars in 1323 bytes} [Thu Aug 4 14:27:48 2022] GET /compute/v2.1/os-quota-sets/5e64bb36c3ac478294c9bd5ded90af5d?user_id=abb365444cfc4c3bbd5067bc9ed12a83 => generated 371 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:27:49.366061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8eaee6b2-00c1-478f-9831-e9502c76d72a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:49.376730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8eaee6b2-00c1-478f-9831-e9502c76d72a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:49.457707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=44 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:27:49.522427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eaee6b2-00c1-478f-9831-e9502c76d72a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:49.523305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eaee6b2-00c1-478f-9831-e9502c76d72a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:49.540220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eaee6b2-00c1-478f-9831-e9502c76d72a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:49.545648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eaee6b2-00c1-478f-9831-e9502c76d72a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:49.746236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:27:50.303550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8eaee6b2-00c1-478f-9831-e9502c76d72a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:50.326203 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8eaee6b2-00c1-478f-9831-e9502c76d72a tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1374 microversion: 2.1 time: 1.003676 Aug 04 14:27:50.327269 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2705/5378] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:49 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1374 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:50.989588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5529e2f8-5911-46d3-b4b1-f74012936f15 req-b60e4120-475f-49c5-a75f-afc2aeecdd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aca3dba-b155-4204-8a8b-ee33498ff8fe", "name": "network-vif-plugged", "status": "completed", "tag": "d0b801d2-4404-4420-a482-563ef496122f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:27:51.020312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5529e2f8-5911-46d3-b4b1-f74012936f15 req-b60e4120-475f-49c5-a75f-afc2aeecdd26 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:51.021264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5529e2f8-5911-46d3-b4b1-f74012936f15 req-b60e4120-475f-49c5-a75f-afc2aeecdd26 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:51.057625 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5529e2f8-5911-46d3-b4b1-f74012936f15 req-b60e4120-475f-49c5-a75f-afc2aeecdd26 service nova] Creating event network-vif-plugged:d0b801d2-4404-4420-a482-563ef496122f for instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe on n-h2-844627-10 Aug 04 14:27:51.072238 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5529e2f8-5911-46d3-b4b1-f74012936f15 req-b60e4120-475f-49c5-a75f-afc2aeecdd26 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093784 Aug 04 14:27:51.074574 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2674/5379] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:27:51.356496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2df83504-86fc-43a2-a59b-7b4d81c9e90f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:51.360850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2df83504-86fc-43a2-a59b-7b4d81c9e90f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:51.399121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2df83504-86fc-43a2-a59b-7b4d81c9e90f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:51.400412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2df83504-86fc-43a2-a59b-7b4d81c9e90f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:51.402222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2df83504-86fc-43a2-a59b-7b4d81c9e90f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:51.403250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2df83504-86fc-43a2-a59b-7b4d81c9e90f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:51.963027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2df83504-86fc-43a2-a59b-7b4d81c9e90f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:51.991523 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2df83504-86fc-43a2-a59b-7b4d81c9e90f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1374 microversion: 2.1 time: 0.642792 Aug 04 14:27:51.995884 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2706/5380] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:51 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1374 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:27:53.017046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3ddb9226-b69d-41c7-ba7b-7af96273ebd1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:53.025714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3ddb9226-b69d-41c7-ba7b-7af96273ebd1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:53.050208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ddb9226-b69d-41c7-ba7b-7af96273ebd1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:53.050990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ddb9226-b69d-41c7-ba7b-7af96273ebd1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:53.051994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ddb9226-b69d-41c7-ba7b-7af96273ebd1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:53.052621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ddb9226-b69d-41c7-ba7b-7af96273ebd1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:53.631384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3ddb9226-b69d-41c7-ba7b-7af96273ebd1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:53.652179 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3ddb9226-b69d-41c7-ba7b-7af96273ebd1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1546 microversion: 2.1 time: 0.638937 Aug 04 14:27:53.654808 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2675/5381] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:53 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1546 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:27:53.676616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-44713f8c-d5aa-4dc6-a14c-66e5fc858c00 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:53.677975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-44713f8c-d5aa-4dc6-a14c-66e5fc858c00 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:27:53.699166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44713f8c-d5aa-4dc6-a14c-66e5fc858c00 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:53.702187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44713f8c-d5aa-4dc6-a14c-66e5fc858c00 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:53.707482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44713f8c-d5aa-4dc6-a14c-66e5fc858c00 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:53.708927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44713f8c-d5aa-4dc6-a14c-66e5fc858c00 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:54.064732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-44713f8c-d5aa-4dc6-a14c-66e5fc858c00 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:27:54.088465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-44713f8c-d5aa-4dc6-a14c-66e5fc858c00 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1546 microversion: 2.1 time: 0.416180 Aug 04 14:27:54.089661 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2707/5382] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:27:53 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1546 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:27:56.710936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-47a6d3e6-0021-4873-9d00-7cd8de7ac63c tempest-PortsAdminExtendedAttrsTestJSON-1449376144 tempest-PortsAdminExtendedAttrsTestJSON-1449376144-project-admin] Calling method '.version_select at 0x7f46f2ed81f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:27:56.716360 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:27:56.716360 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:27:56.722046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47a6d3e6-0021-4873-9d00-7cd8de7ac63c tempest-PortsAdminExtendedAttrsTestJSON-1449376144 tempest-PortsAdminExtendedAttrsTestJSON-1449376144-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:56.723086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47a6d3e6-0021-4873-9d00-7cd8de7ac63c tempest-PortsAdminExtendedAttrsTestJSON-1449376144 tempest-PortsAdminExtendedAttrsTestJSON-1449376144-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:56.789617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47a6d3e6-0021-4873-9d00-7cd8de7ac63c tempest-PortsAdminExtendedAttrsTestJSON-1449376144 tempest-PortsAdminExtendedAttrsTestJSON-1449376144-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:56.790924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47a6d3e6-0021-4873-9d00-7cd8de7ac63c tempest-PortsAdminExtendedAttrsTestJSON-1449376144 tempest-PortsAdminExtendedAttrsTestJSON-1449376144-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:56.835955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47a6d3e6-0021-4873-9d00-7cd8de7ac63c tempest-PortsAdminExtendedAttrsTestJSON-1449376144 tempest-PortsAdminExtendedAttrsTestJSON-1449376144-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:27:56.840125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47a6d3e6-0021-4873-9d00-7cd8de7ac63c tempest-PortsAdminExtendedAttrsTestJSON-1449376144 tempest-PortsAdminExtendedAttrsTestJSON-1449376144-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:27:56.872119 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-47a6d3e6-0021-4873-9d00-7cd8de7ac63c tempest-PortsAdminExtendedAttrsTestJSON-1449376144 tempest-PortsAdminExtendedAttrsTestJSON-1449376144-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.889921 Aug 04 14:27:56.884664 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2676/5383] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:27:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:28:00.898258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a5918837-22f7-456a-88d6-bf6018937deb req-be8e59c3-7137-46d7-94b1-4bd47d02ac98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aca3dba-b155-4204-8a8b-ee33498ff8fe", "tag": "d0b801d2-4404-4420-a482-563ef496122f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:28:00.907823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:00.924919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a5918837-22f7-456a-88d6-bf6018937deb req-be8e59c3-7137-46d7-94b1-4bd47d02ac98 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:00.925738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a5918837-22f7-456a-88d6-bf6018937deb req-be8e59c3-7137-46d7-94b1-4bd47d02ac98 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:00.955633 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a5918837-22f7-456a-88d6-bf6018937deb req-be8e59c3-7137-46d7-94b1-4bd47d02ac98 service nova] Creating event network-changed:d0b801d2-4404-4420-a482-563ef496122f for instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe on n-h2-844627-10 Aug 04 14:28:00.979245 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a5918837-22f7-456a-88d6-bf6018937deb req-be8e59c3-7137-46d7-94b1-4bd47d02ac98 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086393 Aug 04 14:28:00.980165 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2708/5384] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:28:17.715801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eeb32902-c381-4043-aad5-7cd2bd8deab9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:28:17.718158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eeb32902-c381-4043-aad5-7cd2bd8deab9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:17.739138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:17.740563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=17 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:17.741917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=39 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:17.745665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeb32902-c381-4043-aad5-7cd2bd8deab9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:17.746463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeb32902-c381-4043-aad5-7cd2bd8deab9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:17.747476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeb32902-c381-4043-aad5-7cd2bd8deab9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:17.748095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eeb32902-c381-4043-aad5-7cd2bd8deab9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:17.819547 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eeb32902-c381-4043-aad5-7cd2bd8deab9 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "POST /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe/action" status: 200 len: 24558 microversion: 2.1 time: 0.111583 Aug 04 14:28:17.820724 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2677/5385] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:28:17 2022] POST /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe/action => generated 24558 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:28:29.239598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=7 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:29.242181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=19 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:29.274416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8d2b0080-5268-44aa-8f2c-696b48b759f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:28:29.289097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8d2b0080-5268-44aa-8f2c-696b48b759f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:29.337366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d2b0080-5268-44aa-8f2c-696b48b759f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:29.342129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d2b0080-5268-44aa-8f2c-696b48b759f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:29.344539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d2b0080-5268-44aa-8f2c-696b48b759f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:29.351846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d2b0080-5268-44aa-8f2c-696b48b759f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:29.507296 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8d2b0080-5268-44aa-8f2c-696b48b759f6 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "POST /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe/action" status: 200 len: 32629 microversion: 2.1 time: 0.273580 Aug 04 14:28:29.515415 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2709/5386] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:28:29 2022] POST /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe/action => generated 32629 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:28:31.384258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-79001d88-ae53-4087-9449-51547809c2aa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:31.404309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-79001d88-ae53-4087-9449-51547809c2aa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:31.434125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:31.448438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:31.466712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79001d88-ae53-4087-9449-51547809c2aa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:31.467490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79001d88-ae53-4087-9449-51547809c2aa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:31.468847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79001d88-ae53-4087-9449-51547809c2aa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:31.469347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79001d88-ae53-4087-9449-51547809c2aa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:31.515907 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-79001d88-ae53-4087-9449-51547809c2aa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140728 Aug 04 14:28:31.521685 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2678/5387] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:28:31 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:28:31.713886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f6696f1-0459-4c32-aaa9-1c29b0e17f56 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:31.714720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f6696f1-0459-4c32-aaa9-1c29b0e17f56 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:31.728495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f6696f1-0459-4c32-aaa9-1c29b0e17f56 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:31.731263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f6696f1-0459-4c32-aaa9-1c29b0e17f56 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:31.735378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f6696f1-0459-4c32-aaa9-1c29b0e17f56 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:31.736602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f6696f1-0459-4c32-aaa9-1c29b0e17f56 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:31.806521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f6696f1-0459-4c32-aaa9-1c29b0e17f56 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:28:32.048024 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f6696f1-0459-4c32-aaa9-1c29b0e17f56 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 204 len: 0 microversion: 2.1 time: 0.338217 Aug 04 14:28:32.061222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f4b853f-ca24-4d29-aba8-96731c069eaa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:32.061942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f4b853f-ca24-4d29-aba8-96731c069eaa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:32.064426 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2710/5388] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:28:31 2022] DELETE /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:28:32.078038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f4b853f-ca24-4d29-aba8-96731c069eaa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:32.078540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f4b853f-ca24-4d29-aba8-96731c069eaa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:32.079533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f4b853f-ca24-4d29-aba8-96731c069eaa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:32.079976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f4b853f-ca24-4d29-aba8-96731c069eaa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:33.073807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f4b853f-ca24-4d29-aba8-96731c069eaa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:28:33.109896 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f4b853f-ca24-4d29-aba8-96731c069eaa tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1676 microversion: 2.1 time: 1.051776 Aug 04 14:28:33.112784 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2679/5389] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:32 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1676 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:28:34.155489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1221c4b6-35be-448f-ac07-232503ae17eb tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:34.156733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1221c4b6-35be-448f-ac07-232503ae17eb tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:34.191220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1221c4b6-35be-448f-ac07-232503ae17eb tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:34.191904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1221c4b6-35be-448f-ac07-232503ae17eb tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:34.192768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1221c4b6-35be-448f-ac07-232503ae17eb tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:34.193257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1221c4b6-35be-448f-ac07-232503ae17eb tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:35.587083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1221c4b6-35be-448f-ac07-232503ae17eb tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:28:35.600446 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1221c4b6-35be-448f-ac07-232503ae17eb tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1676 microversion: 2.1 time: 1.453585 Aug 04 14:28:35.601186 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2711/5390] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:34 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1676 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:28:36.279600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fc002f7e-756a-4b70-a197-e7a08c7b40c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:36.281637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fc002f7e-756a-4b70-a197-e7a08c7b40c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:36.300102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc002f7e-756a-4b70-a197-e7a08c7b40c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:36.300812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc002f7e-756a-4b70-a197-e7a08c7b40c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:36.301847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc002f7e-756a-4b70-a197-e7a08c7b40c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:36.302463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc002f7e-756a-4b70-a197-e7a08c7b40c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:36.360478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fc002f7e-756a-4b70-a197-e7a08c7b40c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:28:36.402905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3e1b44a9-27c3-48b7-9c4e-9a0342e3140f req-4e0e6f47-0036-4535-b50f-f4e867585d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aca3dba-b155-4204-8a8b-ee33498ff8fe", "tag": "d0b801d2-4404-4420-a482-563ef496122f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:28:36.423421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3e1b44a9-27c3-48b7-9c4e-9a0342e3140f req-4e0e6f47-0036-4535-b50f-f4e867585d33 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:36.425559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3e1b44a9-27c3-48b7-9c4e-9a0342e3140f req-4e0e6f47-0036-4535-b50f-f4e867585d33 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:36.494781 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3e1b44a9-27c3-48b7-9c4e-9a0342e3140f req-4e0e6f47-0036-4535-b50f-f4e867585d33 service nova] Creating event network-changed:d0b801d2-4404-4420-a482-563ef496122f for instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe on n-h2-844627-10 Aug 04 14:28:36.517380 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3e1b44a9-27c3-48b7-9c4e-9a0342e3140f req-4e0e6f47-0036-4535-b50f-f4e867585d33 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115380 Aug 04 14:28:36.523557 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2712/5391] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:28:36.585364 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fc002f7e-756a-4b70-a197-e7a08c7b40c1 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 204 len: 0 microversion: 2.1 time: 0.308822 Aug 04 14:28:36.586699 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2680/5392] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:28:36 2022] DELETE /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:28:36.596184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b09c06d9-ff1e-4b58-bb2b-5fdade30e89d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:36.597713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b09c06d9-ff1e-4b58-bb2b-5fdade30e89d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:36.609154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09c06d9-ff1e-4b58-bb2b-5fdade30e89d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:36.614295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09c06d9-ff1e-4b58-bb2b-5fdade30e89d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:36.615527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09c06d9-ff1e-4b58-bb2b-5fdade30e89d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:36.629396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-63c60731-b43c-40e9-b911-7865b776f5ab tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:36.630606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-63c60731-b43c-40e9-b911-7865b776f5ab tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:36.634600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b09c06d9-ff1e-4b58-bb2b-5fdade30e89d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:36.651833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63c60731-b43c-40e9-b911-7865b776f5ab tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:36.657848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63c60731-b43c-40e9-b911-7865b776f5ab tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:36.663958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63c60731-b43c-40e9-b911-7865b776f5ab tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:36.666013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-63c60731-b43c-40e9-b911-7865b776f5ab tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:37.782300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-63c60731-b43c-40e9-b911-7865b776f5ab tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:28:37.792713 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-63c60731-b43c-40e9-b911-7865b776f5ab tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1676 microversion: 2.1 time: 1.170855 Aug 04 14:28:37.798863 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2681/5393] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:36 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1676 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:28:38.280780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b09c06d9-ff1e-4b58-bb2b-5fdade30e89d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:28:38.303095 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b09c06d9-ff1e-4b58-bb2b-5fdade30e89d tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1671 microversion: 2.1 time: 1.710907 Aug 04 14:28:38.320926 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2713/5394] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:36 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1671 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:28:38.848410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6ead21c-0577-4a86-95bc-05a658ecd5ad tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:38.853088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a6ead21c-0577-4a86-95bc-05a658ecd5ad tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:38.899889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6ead21c-0577-4a86-95bc-05a658ecd5ad tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:38.901717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6ead21c-0577-4a86-95bc-05a658ecd5ad tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:38.904321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6ead21c-0577-4a86-95bc-05a658ecd5ad tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:38.908531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6ead21c-0577-4a86-95bc-05a658ecd5ad tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:39.283144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a6ead21c-0577-4a86-95bc-05a658ecd5ad tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:28:39.338816 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a6ead21c-0577-4a86-95bc-05a658ecd5ad tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1608 microversion: 2.1 time: 0.502717 Aug 04 14:28:39.340083 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2682/5395] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:38 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1608 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:28:39.391582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-af9737c9-e5a3-4b82-a044-6913190fe52f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:39.396844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-af9737c9-e5a3-4b82-a044-6913190fe52f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:39.437305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af9737c9-e5a3-4b82-a044-6913190fe52f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:39.443351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af9737c9-e5a3-4b82-a044-6913190fe52f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:39.445460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af9737c9-e5a3-4b82-a044-6913190fe52f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:39.446563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af9737c9-e5a3-4b82-a044-6913190fe52f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:39.889128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-af9737c9-e5a3-4b82-a044-6913190fe52f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b691f49b0fe64e8a99ca896ddba38334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1deaa23b8c458aa2d180b131da4923', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:28:39.906201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6881e516-809b-4a0c-bc6d-4f4e7aa9ca7d req-d4f7b7b4-b068-4988-8c31-578d0a17d133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aca3dba-b155-4204-8a8b-ee33498ff8fe", "name": "network-vif-deleted", "tag": "d0b801d2-4404-4420-a482-563ef496122f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:28:39.941554 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-af9737c9-e5a3-4b82-a044-6913190fe52f tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 200 len: 1604 microversion: 2.1 time: 0.579631 Aug 04 14:28:39.955944 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2714/5396] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:39 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 1604 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:28:39.987259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6881e516-809b-4a0c-bc6d-4f4e7aa9ca7d req-d4f7b7b4-b068-4988-8c31-578d0a17d133 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:39.988028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6881e516-809b-4a0c-bc6d-4f4e7aa9ca7d req-d4f7b7b4-b068-4988-8c31-578d0a17d133 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:40.051161 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6881e516-809b-4a0c-bc6d-4f4e7aa9ca7d req-d4f7b7b4-b068-4988-8c31-578d0a17d133 service nova] Creating event network-vif-deleted:d0b801d2-4404-4420-a482-563ef496122f for instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe on n-h2-844627-10 Aug 04 14:28:40.067055 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6881e516-809b-4a0c-bc6d-4f4e7aa9ca7d req-d4f7b7b4-b068-4988-8c31-578d0a17d133 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189007 Aug 04 14:28:40.071236 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2683/5397] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:28:40.373194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2972563f-5cf9-4ac1-b7c1-c7bc0e799a33 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:40.380263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2972563f-5cf9-4ac1-b7c1-c7bc0e799a33 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:40.426501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2972563f-5cf9-4ac1-b7c1-c7bc0e799a33 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:40.431899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2972563f-5cf9-4ac1-b7c1-c7bc0e799a33 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:40.435425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2972563f-5cf9-4ac1-b7c1-c7bc0e799a33 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:40.439423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2972563f-5cf9-4ac1-b7c1-c7bc0e799a33 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:40.988216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:40.989947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] [instance: 8aca3dba-b155-4204-8a8b-ee33498ff8fe] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:41.019167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:41.019962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:41.023507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:41.026961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:41.105785 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] HTTP exception thrown: Instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe could not be found. Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Request method failure captured: Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe HTTP/1.1 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69YLC2297LDBBx2ZFMyVnLCc8UCH2nJznJFQcu2D9dbW1l45sA9LbCL2hZqvbKXZRpgcX6IUgB9ra6kRuoUp69DMEw32_IlzJF6Jyzldj9SeMfbKR_rRRjokp5wQ5rubg_zaqv3Ixky_S8jn6TMYql2a0dgdNnIbTu2NU2iXXh1i0G0 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 5d1deaa23b8c458aa2d180b131da4923 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestNetworkBasicOps-491854832 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d1deaa23b8c458aa2d180b131da4923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5d1deaa23b8c458aa2d180b131da4923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5d1deaa23b8c458aa2d180b131da4923"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d1deaa23b8c458aa2d180b131da4923"}]}] Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestNetworkBasicOps-491854832 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 5d1deaa23b8c458aa2d180b131da4923 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestNetworkBasicOps-491854832 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestNetworkBasicOps-491854832-project Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b691f49b0fe64e8a99ca896ddba38334 Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestNetworkBasicOps-491854832-project Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe could not be found. Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '8aca3dba-b155-4204-8a8b-ee33498ff8fe'} Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe could not be found. Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe could not be found. Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:28:41.129698 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe could not be found. Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Returning 404 to user: Instance 8aca3dba-b155-4204-8a8b-ee33498ff8fe could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f1ac7ca6-c254-4353-b991-88ef81177653 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe" status: 404 len: 111 microversion: 2.1 time: 0.150456 Aug 04 14:28:41.134141 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2684/5398] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:40 2022] GET /compute/v2.1/servers/8aca3dba-b155-4204-8a8b-ee33498ff8fe => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:28:41.389074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ce979e5c-626d-4a20-93a5-8762fffe0cdd req-8727f82e-b1dd-4b91-97ae-d18c7f4a2edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d11d60d0-a4c4-4d98-8a2a-d504dc959fd5", "name": "network-vif-deleted", "tag": "22c7a006-7d5f-4fe5-8105-96290a57a1be"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:28:41.503787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ce979e5c-626d-4a20-93a5-8762fffe0cdd req-8727f82e-b1dd-4b91-97ae-d18c7f4a2edc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:41.509183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ce979e5c-626d-4a20-93a5-8762fffe0cdd req-8727f82e-b1dd-4b91-97ae-d18c7f4a2edc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:41.601761 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ce979e5c-626d-4a20-93a5-8762fffe0cdd req-8727f82e-b1dd-4b91-97ae-d18c7f4a2edc service nova] Creating event network-vif-deleted:22c7a006-7d5f-4fe5-8105-96290a57a1be for instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 on n-h1-844627-10 Aug 04 14:28:41.635753 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ce979e5c-626d-4a20-93a5-8762fffe0cdd req-8727f82e-b1dd-4b91-97ae-d18c7f4a2edc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254988 Aug 04 14:28:41.640425 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2685/5399] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:28:41.791308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2972563f-5cf9-4ac1-b7c1-c7bc0e799a33 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:28:41.827844 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2972563f-5cf9-4ac1-b7c1-c7bc0e799a33 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 200 len: 1608 microversion: 2.1 time: 1.463116 Aug 04 14:28:41.835938 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2715/5400] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:40 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 1608 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:28:42.859957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:42.860779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:42.883662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:42.885630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:42.891104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:42.893155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:42.948412 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] HTTP exception thrown: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Request method failure captured: Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 HTTP/1.1 Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69ZMdz-R8ZFGNszlpGRzrRbe3Sv4GTwCPHVMBYoTMMSBzSCzRruY-nTtcDQhWZfv69n9ZI9YUVJJUy3YrkOIMSMKRBbcfq0Avq6N1Lbm7x4FGZg27xgYnVefSQivD2SNrS3LwCO9rT_y5UyShAyCF_6ED9VCCY9VZDLv7qAgr4ZZokc Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "tempest-type-1681642770", "name": "tempest-service-757042601", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}] Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b231e5922ccb4e119b8254841c0fe86e Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd11d60d0-a4c4-4d98-8a2a-d504dc959fd5'} Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:28:42.951786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Returning 404 to user: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:28:42.955961 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-72622ce1-7ac4-40c5-ac1c-5533ed535e7a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 404 len: 111 microversion: 2.1 time: 0.099652 Aug 04 14:28:42.960795 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2686/5401] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:42 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:28:42.966807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-53341577-d380-49ca-9a99-25ac738efabc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '.version_select at 0x7f46f3cea700>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:43.015607 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-53341577-d380-49ca-9a99-25ac738efabc tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731601807" status: 202 len: 0 microversion: 2.1 time: 0.052768 Aug 04 14:28:43.016843 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2716/5402] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731601807 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:28:43.287587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fc6225ce-c132-425d-bd75-7eccff6990e5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] Calling method '.version_select at 0x7f47001334c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:43.367861 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fc6225ce-c132-425d-bd75-7eccff6990e5 tempest-TestNetworkBasicOps-491854832 tempest-TestNetworkBasicOps-491854832-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1126711325" status: 202 len: 0 microversion: 2.1 time: 0.098913 Aug 04 14:28:43.374714 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2687/5403] 10.222.0.66 () {58 vars in 1257 bytes} [Thu Aug 4 14:28:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1126711325 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:28:47.575931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c5956cb2-6d1f-418b-9685-274dedae0f30 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'create', calling method: .version_select at 0x7f46f3c463a0>, body: {"keypair": {"name": "tempest-keypair-477948563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ8lpSP3VtgbmfbQXmVxxyLIOAz3m/rHLk+EzV8UzD5dFEv6Pw1/T8w/p7ggFn/+4yBbduz9ZKL/6CxmlPAuhwPfXmR3T9v07oArguCkS9lSPwACjXqcrB6JH1mwiMXPQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:28:47.656808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c5956cb2-6d1f-418b-9685-274dedae0f30 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Getting quotas for project f1974046389c4e9ebb504fef09c743e8. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:28:47.690566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c5956cb2-6d1f-418b-9685-274dedae0f30 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Getting quotas for user b231e5922ccb4e119b8254841c0fe86e and project f1974046389c4e9ebb504fef09c743e8. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:28:47.854294 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c5956cb2-6d1f-418b-9685-274dedae0f30 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.278901 Aug 04 14:28:47.861539 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2717/5404] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:28:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:28:55.759089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:55.761092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:55.768055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1493935456", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ecb455b-0802-460a-8a57-2c8e424655e2"}], "security_groups": [{"name": "tempest-securitygroup--1073455316"}], "key_name": "tempest-keypair-477948563", "user_data": "}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:28:56.213752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] validate_networks() for [('8ecb455b-0802-460a-8a57-2c8e424655e2', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:28:57.657781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:28:57.663009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:28:57.665577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:28:57.666864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:28:57.667978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:28:57.747032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:57.748017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:57.750229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:57.751248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:57.800093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Getting quotas for project f1974046389c4e9ebb504fef09c743e8. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:28:57.817106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Getting quotas for user b231e5922ccb4e119b8254841c0fe86e and project f1974046389c4e9ebb504fef09c743e8. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:28:57.846974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:28:57.850081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:28:57.980624 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0fbb3afa-6d89-44ad-aeac-d5b5c25ed3a5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.223512 Aug 04 14:28:57.982678 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2688/5405] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:28:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:28:58.017265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f79253dc-e24c-4bd7-8d74-66f9d733bae5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:58.021678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f79253dc-e24c-4bd7-8d74-66f9d733bae5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:58.047586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:58.050649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:58.056609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:28:58.445808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f79253dc-e24c-4bd7-8d74-66f9d733bae5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:28:58.462135 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f79253dc-e24c-4bd7-8d74-66f9d733bae5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1237 microversion: 2.1 time: 0.468614 Aug 04 14:28:58.463799 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2718/5406] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:57 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1237 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:28:59.503067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64a6df6c-3df6-425a-b760-399210a67b66 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:28:59.504581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-64a6df6c-3df6-425a-b760-399210a67b66 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:28:59.539010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64a6df6c-3df6-425a-b760-399210a67b66 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:59.539968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64a6df6c-3df6-425a-b760-399210a67b66 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:59.541032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64a6df6c-3df6-425a-b760-399210a67b66 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:28:59.541634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64a6df6c-3df6-425a-b760-399210a67b66 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:28:59.819989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-64a6df6c-3df6-425a-b760-399210a67b66 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:28:59.828517 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-64a6df6c-3df6-425a-b760-399210a67b66 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1233 microversion: 2.1 time: 0.330345 Aug 04 14:28:59.837698 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2689/5407] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:28:59 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1233 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:00.867655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c8e67bec-95af-47d2-ad1e-474fd7a1806d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:00.868900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c8e67bec-95af-47d2-ad1e-474fd7a1806d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:00.886806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8e67bec-95af-47d2-ad1e-474fd7a1806d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:00.887763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8e67bec-95af-47d2-ad1e-474fd7a1806d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:00.888798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8e67bec-95af-47d2-ad1e-474fd7a1806d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:00.890063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c8e67bec-95af-47d2-ad1e-474fd7a1806d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:01.669650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c8e67bec-95af-47d2-ad1e-474fd7a1806d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:01.679188 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c8e67bec-95af-47d2-ad1e-474fd7a1806d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1295 microversion: 2.1 time: 0.815613 Aug 04 14:29:01.679950 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2719/5408] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:00 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1295 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:02.707581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-60be7658-7b85-4ecc-9391-f41fe48564e6 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:02.709068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-60be7658-7b85-4ecc-9391-f41fe48564e6 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:02.735032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60be7658-7b85-4ecc-9391-f41fe48564e6 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:02.738556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60be7658-7b85-4ecc-9391-f41fe48564e6 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:02.739906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60be7658-7b85-4ecc-9391-f41fe48564e6 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:02.742225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60be7658-7b85-4ecc-9391-f41fe48564e6 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:03.021458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-60be7658-7b85-4ecc-9391-f41fe48564e6 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:03.032266 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-60be7658-7b85-4ecc-9391-f41fe48564e6 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1295 microversion: 2.1 time: 0.332154 Aug 04 14:29:03.048555 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2690/5409] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:02 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1295 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:04.077253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e35f2965-67cc-478e-9f08-a3b5d3a46ee0 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:04.081950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e35f2965-67cc-478e-9f08-a3b5d3a46ee0 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:04.122162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e35f2965-67cc-478e-9f08-a3b5d3a46ee0 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:04.128356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e35f2965-67cc-478e-9f08-a3b5d3a46ee0 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:04.133302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e35f2965-67cc-478e-9f08-a3b5d3a46ee0 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:04.136012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e35f2965-67cc-478e-9f08-a3b5d3a46ee0 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:04.629900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e35f2965-67cc-478e-9f08-a3b5d3a46ee0 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:04.657257 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e35f2965-67cc-478e-9f08-a3b5d3a46ee0 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1295 microversion: 2.1 time: 0.604156 Aug 04 14:29:04.699742 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2720/5410] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:04 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1295 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:05.705428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-40364a1c-fd6e-4557-a341-e4fa42c18d5f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:05.706345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-40364a1c-fd6e-4557-a341-e4fa42c18d5f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:05.747570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40364a1c-fd6e-4557-a341-e4fa42c18d5f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:05.750849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40364a1c-fd6e-4557-a341-e4fa42c18d5f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:05.752359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40364a1c-fd6e-4557-a341-e4fa42c18d5f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:05.753208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40364a1c-fd6e-4557-a341-e4fa42c18d5f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:07.774870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:29:07.837058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:29:08.184607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-40364a1c-fd6e-4557-a341-e4fa42c18d5f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:08.196001 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-40364a1c-fd6e-4557-a341-e4fa42c18d5f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1363 microversion: 2.1 time: 2.494972 Aug 04 14:29:08.196616 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2691/5411] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:05 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1363 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:09.238634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-048891d9-af28-4ad6-85a1-c12c8a6eed51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:09.243706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-048891d9-af28-4ad6-85a1-c12c8a6eed51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:09.300903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:29:09.317720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-048891d9-af28-4ad6-85a1-c12c8a6eed51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:09.320785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-048891d9-af28-4ad6-85a1-c12c8a6eed51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:09.322371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-048891d9-af28-4ad6-85a1-c12c8a6eed51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:09.323144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-048891d9-af28-4ad6-85a1-c12c8a6eed51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:11.554755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-048891d9-af28-4ad6-85a1-c12c8a6eed51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:11.612032 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-048891d9-af28-4ad6-85a1-c12c8a6eed51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1363 microversion: 2.1 time: 2.390796 Aug 04 14:29:11.627140 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2721/5412] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:09 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1363 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:12.245086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1625994c-9d5a-4e2f-abf4-4c89c6700fb4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662-project-admin] Calling method '.version_select at 0x7f46f2fa7af0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:12.248547 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:29:12.248547 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:29:12.252230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1625994c-9d5a-4e2f-abf4-4c89c6700fb4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:12.253626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1625994c-9d5a-4e2f-abf4-4c89c6700fb4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:12.299563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1625994c-9d5a-4e2f-abf4-4c89c6700fb4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:12.302848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1625994c-9d5a-4e2f-abf4-4c89c6700fb4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:12.330608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1625994c-9d5a-4e2f-abf4-4c89c6700fb4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:12.331666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1625994c-9d5a-4e2f-abf4-4c89c6700fb4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:12.348677 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1625994c-9d5a-4e2f-abf4-4c89c6700fb4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1682340662-project-admin] 10.222.0.66 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.672904 Aug 04 14:29:12.350337 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2692/5413] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:29:11 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:29:12.660925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dbbe1430-60e1-4047-9060-047e94e01557 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:12.661907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dbbe1430-60e1-4047-9060-047e94e01557 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:12.684365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbbe1430-60e1-4047-9060-047e94e01557 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:12.689943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbbe1430-60e1-4047-9060-047e94e01557 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:12.693615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbbe1430-60e1-4047-9060-047e94e01557 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:12.694275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbbe1430-60e1-4047-9060-047e94e01557 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:13.791950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dbbe1430-60e1-4047-9060-047e94e01557 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:13.814966 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dbbe1430-60e1-4047-9060-047e94e01557 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1363 microversion: 2.1 time: 1.151608 Aug 04 14:29:13.816193 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2722/5414] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:12 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1363 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:14.142591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-d2cc471a-f394-49cb-9f50-1418487b2802 req-b616877c-9b71-4dd9-a7e3-d953ad47ee2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "addd5022-8377-4610-9ade-b675ce58fa12", "tag": "cd61268b-6ead-4687-9fd7-d46e46182a42"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:29:14.166089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d2cc471a-f394-49cb-9f50-1418487b2802 req-b616877c-9b71-4dd9-a7e3-d953ad47ee2c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:14.166912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d2cc471a-f394-49cb-9f50-1418487b2802 req-b616877c-9b71-4dd9-a7e3-d953ad47ee2c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:14.186732 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-d2cc471a-f394-49cb-9f50-1418487b2802 req-b616877c-9b71-4dd9-a7e3-d953ad47ee2c service nova] Creating event network-changed:cd61268b-6ead-4687-9fd7-d46e46182a42 for instance addd5022-8377-4610-9ade-b675ce58fa12 on n-h2-844627-10 Aug 04 14:29:14.195820 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-d2cc471a-f394-49cb-9f50-1418487b2802 req-b616877c-9b71-4dd9-a7e3-d953ad47ee2c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055137 Aug 04 14:29:14.198120 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2693/5415] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:29:14.856677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6fe9d328-4e1d-44c2-a18a-a08d0cfa3767 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:14.857854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6fe9d328-4e1d-44c2-a18a-a08d0cfa3767 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:14.877393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe9d328-4e1d-44c2-a18a-a08d0cfa3767 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:14.878256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe9d328-4e1d-44c2-a18a-a08d0cfa3767 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:14.879326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe9d328-4e1d-44c2-a18a-a08d0cfa3767 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:14.880041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6fe9d328-4e1d-44c2-a18a-a08d0cfa3767 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:15.658569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6fe9d328-4e1d-44c2-a18a-a08d0cfa3767 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:15.687175 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6fe9d328-4e1d-44c2-a18a-a08d0cfa3767 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1363 microversion: 2.1 time: 0.836813 Aug 04 14:29:15.689229 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2723/5416] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:14 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1363 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:16.731484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec4a0479-0c61-4a0d-9635-b1c69a310829 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:16.736938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ec4a0479-0c61-4a0d-9635-b1c69a310829 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:16.767978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec4a0479-0c61-4a0d-9635-b1c69a310829 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:16.768751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec4a0479-0c61-4a0d-9635-b1c69a310829 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:16.775656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec4a0479-0c61-4a0d-9635-b1c69a310829 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:16.776431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec4a0479-0c61-4a0d-9635-b1c69a310829 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:18.696795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ec4a0479-0c61-4a0d-9635-b1c69a310829 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:18.726082 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec4a0479-0c61-4a0d-9635-b1c69a310829 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1363 microversion: 2.1 time: 2.003703 Aug 04 14:29:18.728377 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2694/5417] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:16 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1363 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:19.760161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-573e9501-041e-4492-858b-3cac4180b9fd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:19.768901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-573e9501-041e-4492-858b-3cac4180b9fd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:19.808336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-573e9501-041e-4492-858b-3cac4180b9fd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:19.813562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-573e9501-041e-4492-858b-3cac4180b9fd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:19.816928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-573e9501-041e-4492-858b-3cac4180b9fd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:19.819415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-573e9501-041e-4492-858b-3cac4180b9fd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:20.486463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-573e9501-041e-4492-858b-3cac4180b9fd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:20.532510 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-573e9501-041e-4492-858b-3cac4180b9fd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1363 microversion: 2.1 time: 0.782782 Aug 04 14:29:20.536111 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2724/5418] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:19 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1363 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:21.195079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fbabd931-0965-4097-9707-af56a8c4fd3b req-eedb4f0b-45ae-4bd0-b5d6-8d1e4dc47a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "addd5022-8377-4610-9ade-b675ce58fa12", "name": "network-vif-plugged", "status": "completed", "tag": "cd61268b-6ead-4687-9fd7-d46e46182a42"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:29:21.231394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fbabd931-0965-4097-9707-af56a8c4fd3b req-eedb4f0b-45ae-4bd0-b5d6-8d1e4dc47a58 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:21.233298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fbabd931-0965-4097-9707-af56a8c4fd3b req-eedb4f0b-45ae-4bd0-b5d6-8d1e4dc47a58 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:21.264812 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fbabd931-0965-4097-9707-af56a8c4fd3b req-eedb4f0b-45ae-4bd0-b5d6-8d1e4dc47a58 service nova] Creating event network-vif-plugged:cd61268b-6ead-4687-9fd7-d46e46182a42 for instance addd5022-8377-4610-9ade-b675ce58fa12 on n-h2-844627-10 Aug 04 14:29:21.282027 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fbabd931-0965-4097-9707-af56a8c4fd3b req-eedb4f0b-45ae-4bd0-b5d6-8d1e4dc47a58 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097310 Aug 04 14:29:21.284522 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2695/5419] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:29:21.568914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e0399983-74f0-4511-a25b-9f8ab38534a1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:21.572492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e0399983-74f0-4511-a25b-9f8ab38534a1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:21.614679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0399983-74f0-4511-a25b-9f8ab38534a1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:21.617085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0399983-74f0-4511-a25b-9f8ab38534a1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:21.618710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0399983-74f0-4511-a25b-9f8ab38534a1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:21.624285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e0399983-74f0-4511-a25b-9f8ab38534a1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:22.161188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e0399983-74f0-4511-a25b-9f8ab38534a1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:22.180527 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e0399983-74f0-4511-a25b-9f8ab38534a1 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1363 microversion: 2.1 time: 0.625809 Aug 04 14:29:22.182151 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2725/5420] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:21 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1363 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:29:23.242135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0394f602-c4b9-45cd-bb97-67845b2cab06 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:23.245003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0394f602-c4b9-45cd-bb97-67845b2cab06 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:23.282274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0394f602-c4b9-45cd-bb97-67845b2cab06 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:23.287168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0394f602-c4b9-45cd-bb97-67845b2cab06 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:23.291629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0394f602-c4b9-45cd-bb97-67845b2cab06 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:23.295673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0394f602-c4b9-45cd-bb97-67845b2cab06 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:24.429738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0394f602-c4b9-45cd-bb97-67845b2cab06 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:29:24.440818 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0394f602-c4b9-45cd-bb97-67845b2cab06 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1549 microversion: 2.1 time: 1.216723 Aug 04 14:29:24.442088 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2696/5421] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:29:23 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1549 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:29:24.481932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a9fb4e8-a07f-44ae-bbf1-d30f75023679 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:24.484127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3a9fb4e8-a07f-44ae-bbf1-d30f75023679 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:24.497427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a9fb4e8-a07f-44ae-bbf1-d30f75023679 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:24.499269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a9fb4e8-a07f-44ae-bbf1-d30f75023679 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:24.502012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a9fb4e8-a07f-44ae-bbf1-d30f75023679 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:24.503325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a9fb4e8-a07f-44ae-bbf1-d30f75023679 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:24.924351 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a9fb4e8-a07f-44ae-bbf1-d30f75023679 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.451909 Aug 04 14:29:24.925503 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2726/5422] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 14:29:24 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-interface => generated 284 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:29:31.953673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0ddb898f-7f26-488e-b891-d2ba54a8cd9f req-01de7a5c-ce59-4861-b3e2-e87eeb05c92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "addd5022-8377-4610-9ade-b675ce58fa12", "tag": "cd61268b-6ead-4687-9fd7-d46e46182a42"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:29:31.980224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:29:31.992736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0ddb898f-7f26-488e-b891-d2ba54a8cd9f req-01de7a5c-ce59-4861-b3e2-e87eeb05c92c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:31.998806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0ddb898f-7f26-488e-b891-d2ba54a8cd9f req-01de7a5c-ce59-4861-b3e2-e87eeb05c92c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:32.011453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=43 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:29:32.042294 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0ddb898f-7f26-488e-b891-d2ba54a8cd9f req-01de7a5c-ce59-4861-b3e2-e87eeb05c92c service nova] Creating event network-changed:cd61268b-6ead-4687-9fd7-d46e46182a42 for instance addd5022-8377-4610-9ade-b675ce58fa12 on n-h2-844627-10 Aug 04 14:29:32.050655 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0ddb898f-7f26-488e-b891-d2ba54a8cd9f req-01de7a5c-ce59-4861-b3e2-e87eeb05c92c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108054 Aug 04 14:29:32.059210 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2697/5423] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:29:55.987948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=20 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:29:55.990591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=46 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:29:56.710558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-539368321", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "e813b7c4-f0ac-49e5-9e43-e03d1651b392"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:29:56.855647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] validate_networks() for [('e813b7c4-f0ac-49e5-9e43-e03d1651b392', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:29:57.344479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ce9a6ad9-5f26-4f42-95bb-a285b315fdde tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:29:57.345409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ce9a6ad9-5f26-4f42-95bb-a285b315fdde tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:29:57.353760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:29:57.358599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:29:57.397195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce9a6ad9-5f26-4f42-95bb-a285b315fdde tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:57.401096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce9a6ad9-5f26-4f42-95bb-a285b315fdde tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:57.414911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce9a6ad9-5f26-4f42-95bb-a285b315fdde tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:29:57.416282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce9a6ad9-5f26-4f42-95bb-a285b315fdde tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:29:57.571517 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ce9a6ad9-5f26-4f42-95bb-a285b315fdde tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/ips" status: 200 len: 145 microversion: 2.1 time: 0.231821 Aug 04 14:29:57.573711 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2698/5424] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:29:57 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/ips => generated 145 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:30:00.535866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:30:00.536781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:30:00.537924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:30:00.543294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:30:00.544983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:30:00.581503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:00.584623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ab8bf60-3f0a-4e5c-9f88-2bc9e618c61c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4cc6373-8b44-4af3-bdf5-c23c4def67aa"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:30:00.585602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:00.587334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:00.592462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:00.617139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ab8bf60-3f0a-4e5c-9f88-2bc9e618c61c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:00.635460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ab8bf60-3f0a-4e5c-9f88-2bc9e618c61c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:00.636271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ab8bf60-3f0a-4e5c-9f88-2bc9e618c61c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:00.637480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ab8bf60-3f0a-4e5c-9f88-2bc9e618c61c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:00.638189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ab8bf60-3f0a-4e5c-9f88-2bc9e618c61c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:00.674768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Getting quotas for project 157a7e5e12794c0581c9c1afa2c97cd9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:30:00.697662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Getting quotas for user 51aee8297671424495ef3e9bd9a58d42 and project 157a7e5e12794c0581c9c1afa2c97cd9. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:30:00.756106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:30:00.760857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:30:00.979443 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [eae4f481-b9f1-41c5-925b-c9770524eab3] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 14:30:01.351854 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ab8bf60-3f0a-4e5c-9f88-2bc9e618c61c tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785018 Aug 04 14:30:01.361076 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2699/5425] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:30:00 2022] POST /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:30:02.006960 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [eae4f481-b9f1-41c5-925b-c9770524eab3] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42202. Aug 04 14:30:02.025416 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18ad804b-4a1a-48e9-8520-365c62b22cc7 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.053682 Aug 04 14:30:02.026601 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2727/5426] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 6056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:30:02.043654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ac83ad5-a486-4ed2-95f1-db1c71872fde tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:02.044541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ac83ad5-a486-4ed2-95f1-db1c71872fde tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:02.265730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ac83ad5-a486-4ed2-95f1-db1c71872fde tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:02.275947 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ac83ad5-a486-4ed2-95f1-db1c71872fde tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1213 microversion: 2.1 time: 0.237499 Aug 04 14:30:02.281270 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2700/5427] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:02 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1213 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:03.313109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb6b7d94-464e-4768-98ed-09a4cd1a6893 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:03.314753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb6b7d94-464e-4768-98ed-09a4cd1a6893 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:03.857844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bb6b7d94-464e-4768-98ed-09a4cd1a6893 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:03.887234 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb6b7d94-464e-4768-98ed-09a4cd1a6893 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1213 microversion: 2.1 time: 0.577338 Aug 04 14:30:03.898911 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2728/5428] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:03 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1213 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:04.955553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6f455e1f-4015-46fd-817e-8fd9dfc471c3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:04.956764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6f455e1f-4015-46fd-817e-8fd9dfc471c3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:04.978504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f455e1f-4015-46fd-817e-8fd9dfc471c3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:04.981726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f455e1f-4015-46fd-817e-8fd9dfc471c3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:04.985343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f455e1f-4015-46fd-817e-8fd9dfc471c3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:04.989730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f455e1f-4015-46fd-817e-8fd9dfc471c3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:05.327035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f455e1f-4015-46fd-817e-8fd9dfc471c3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:05.344120 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6f455e1f-4015-46fd-817e-8fd9dfc471c3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1217 microversion: 2.1 time: 0.393652 Aug 04 14:30:05.345268 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2701/5429] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:04 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1217 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:06.385880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-747576b6-2a86-480d-8d13-8d2bbbe08a27 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:06.386587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-747576b6-2a86-480d-8d13-8d2bbbe08a27 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:06.402279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-747576b6-2a86-480d-8d13-8d2bbbe08a27 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:06.405749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-747576b6-2a86-480d-8d13-8d2bbbe08a27 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:06.406890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-747576b6-2a86-480d-8d13-8d2bbbe08a27 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:06.410480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-747576b6-2a86-480d-8d13-8d2bbbe08a27 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:07.015240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-747576b6-2a86-480d-8d13-8d2bbbe08a27 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:07.032773 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-747576b6-2a86-480d-8d13-8d2bbbe08a27 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1265 microversion: 2.1 time: 0.650851 Aug 04 14:30:07.038017 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2729/5430] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:06 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1265 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:08.080075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f3275a97-cb3d-4b08-80ec-bbfb0f2df87c tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:08.081541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f3275a97-cb3d-4b08-80ec-bbfb0f2df87c tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:08.109250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3275a97-cb3d-4b08-80ec-bbfb0f2df87c tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:08.109713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3275a97-cb3d-4b08-80ec-bbfb0f2df87c tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:08.110740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3275a97-cb3d-4b08-80ec-bbfb0f2df87c tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:08.115489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3275a97-cb3d-4b08-80ec-bbfb0f2df87c tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:08.447954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f3275a97-cb3d-4b08-80ec-bbfb0f2df87c tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:08.474195 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f3275a97-cb3d-4b08-80ec-bbfb0f2df87c tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1271 microversion: 2.1 time: 0.394183 Aug 04 14:30:08.496838 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2702/5431] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:08 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1271 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:09.517378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-57d5f4cd-bccc-414d-af6c-d268b74951d8 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:09.518635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-57d5f4cd-bccc-414d-af6c-d268b74951d8 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:09.538998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57d5f4cd-bccc-414d-af6c-d268b74951d8 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:09.539502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57d5f4cd-bccc-414d-af6c-d268b74951d8 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:09.540382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57d5f4cd-bccc-414d-af6c-d268b74951d8 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:09.540856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-57d5f4cd-bccc-414d-af6c-d268b74951d8 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:09.813269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-57d5f4cd-bccc-414d-af6c-d268b74951d8 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:09.834287 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-57d5f4cd-bccc-414d-af6c-d268b74951d8 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1271 microversion: 2.1 time: 0.320497 Aug 04 14:30:09.864301 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2730/5432] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:09 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1271 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:10.872841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4f0771a-d398-424f-a198-945ca78432dc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:10.875151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4f0771a-d398-424f-a198-945ca78432dc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:10.900393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f0771a-d398-424f-a198-945ca78432dc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:10.901488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f0771a-d398-424f-a198-945ca78432dc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:10.907680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f0771a-d398-424f-a198-945ca78432dc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:10.909202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f0771a-d398-424f-a198-945ca78432dc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:11.329984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d4f0771a-d398-424f-a198-945ca78432dc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:11.397877 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4f0771a-d398-424f-a198-945ca78432dc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1271 microversion: 2.1 time: 0.526056 Aug 04 14:30:11.414182 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2703/5433] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:10 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1271 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:12.467262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ece3a702-f747-4295-bd01-a6236a945707 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:12.468093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ece3a702-f747-4295-bd01-a6236a945707 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:12.485497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:12.492035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ece3a702-f747-4295-bd01-a6236a945707 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:12.496585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ece3a702-f747-4295-bd01-a6236a945707 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:12.500386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ece3a702-f747-4295-bd01-a6236a945707 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:12.505296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ece3a702-f747-4295-bd01-a6236a945707 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:13.091798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ece3a702-f747-4295-bd01-a6236a945707 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:13.130540 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ece3a702-f747-4295-bd01-a6236a945707 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 0.667555 Aug 04 14:30:13.142546 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2731/5434] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:12 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:14.165713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ce0a904-a506-4e63-9e6b-e5c14e65d534 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:14.167242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ce0a904-a506-4e63-9e6b-e5c14e65d534 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:14.184962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:14.200608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ce0a904-a506-4e63-9e6b-e5c14e65d534 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:14.203871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ce0a904-a506-4e63-9e6b-e5c14e65d534 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:14.208555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ce0a904-a506-4e63-9e6b-e5c14e65d534 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:14.209910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ce0a904-a506-4e63-9e6b-e5c14e65d534 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:15.458776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8ce0a904-a506-4e63-9e6b-e5c14e65d534 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:15.480941 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ce0a904-a506-4e63-9e6b-e5c14e65d534 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 1.318313 Aug 04 14:30:15.483984 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2704/5435] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:14 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:16.123569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:16.518444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f2fae0a-37b7-48c1-9f7b-6e0d0d3ffc43 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:16.519544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9f2fae0a-37b7-48c1-9f7b-6e0d0d3ffc43 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:16.554710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f2fae0a-37b7-48c1-9f7b-6e0d0d3ffc43 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:16.555639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f2fae0a-37b7-48c1-9f7b-6e0d0d3ffc43 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:16.566377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f2fae0a-37b7-48c1-9f7b-6e0d0d3ffc43 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:16.567455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f2fae0a-37b7-48c1-9f7b-6e0d0d3ffc43 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:16.820646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-31b3158c-9f7e-4d50-8f5e-c7e2bb7d3d12 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Action: 'create', calling method: .version_select at 0x7f46f3ba7b80>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2126596764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqKoRurdTLStz9DgCe0LFl5sMQuPK/fFn4p5bVwRVAAdtuk0GO862CYXQHNJtxBgX36t8RPRt+YraOuyDESMmal8B39CSOdoG9qz1j9sDQiweV4VnuRdVw+Vzsmbuor/Q=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:30:16.873867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-31b3158c-9f7e-4d50-8f5e-c7e2bb7d3d12 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Getting quotas for project 3ec527d1fed444fcb4f59a5e64abe3fb. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:30:16.884668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-31b3158c-9f7e-4d50-8f5e-c7e2bb7d3d12 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Getting quotas for user 93551e21ae0940f6868f96c1c3bde18f and project 3ec527d1fed444fcb4f59a5e64abe3fb. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:30:16.968399 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-31b3158c-9f7e-4d50-8f5e-c7e2bb7d3d12 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.852592 Aug 04 14:30:16.971767 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2732/5436] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:30:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:30:18.179081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9f2fae0a-37b7-48c1-9f7b-6e0d0d3ffc43 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:18.208123 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9f2fae0a-37b7-48c1-9f7b-6e0d0d3ffc43 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 1.705395 Aug 04 14:30:18.209601 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2705/5437] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:16 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:18.915530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-96c54775-bee8-4218-84e8-400a8aa949c6 req-3dc8b695-a67b-49cb-a032-c21db1ff18a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6136d2-71fe-4a37-b388-5e115ae76152", "tag": "8601c97f-3597-4212-af24-d7fba498fc85"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:30:18.943061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-96c54775-bee8-4218-84e8-400a8aa949c6 req-3dc8b695-a67b-49cb-a032-c21db1ff18a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:18.943785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-96c54775-bee8-4218-84e8-400a8aa949c6 req-3dc8b695-a67b-49cb-a032-c21db1ff18a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:18.973669 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-96c54775-bee8-4218-84e8-400a8aa949c6 req-3dc8b695-a67b-49cb-a032-c21db1ff18a4 service nova] Creating event network-changed:8601c97f-3597-4212-af24-d7fba498fc85 for instance ec6136d2-71fe-4a37-b388-5e115ae76152 on n-h1-844627-10 Aug 04 14:30:18.985338 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-96c54775-bee8-4218-84e8-400a8aa949c6 req-3dc8b695-a67b-49cb-a032-c21db1ff18a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074195 Aug 04 14:30:18.989401 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2733/5438] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:30:19.240217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf013099-7a67-4530-be95-1ad4508bdbd5 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:19.241425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf013099-7a67-4530-be95-1ad4508bdbd5 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:19.279279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf013099-7a67-4530-be95-1ad4508bdbd5 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:19.285058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf013099-7a67-4530-be95-1ad4508bdbd5 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:19.290765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf013099-7a67-4530-be95-1ad4508bdbd5 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:19.292109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf013099-7a67-4530-be95-1ad4508bdbd5 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:19.755211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bf013099-7a67-4530-be95-1ad4508bdbd5 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:19.801720 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf013099-7a67-4530-be95-1ad4508bdbd5 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 0.568103 Aug 04 14:30:19.804319 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2706/5439] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:19 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:20.867780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7193a68f-99d5-44a2-ba92-2603fd2607fa tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:20.877106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7193a68f-99d5-44a2-ba92-2603fd2607fa tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:20.940528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7193a68f-99d5-44a2-ba92-2603fd2607fa tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:20.941316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7193a68f-99d5-44a2-ba92-2603fd2607fa tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:20.942602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7193a68f-99d5-44a2-ba92-2603fd2607fa tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:20.943253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7193a68f-99d5-44a2-ba92-2603fd2607fa tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:22.369053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d5906fd-c3cb-4282-a03b-133acf483770 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:22.385140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d5906fd-c3cb-4282-a03b-133acf483770 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:22.406988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5906fd-c3cb-4282-a03b-133acf483770 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:22.415054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5906fd-c3cb-4282-a03b-133acf483770 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:22.430445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5906fd-c3cb-4282-a03b-133acf483770 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:22.435001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d5906fd-c3cb-4282-a03b-133acf483770 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:22.455835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7193a68f-99d5-44a2-ba92-2603fd2607fa tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:22.506172 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7193a68f-99d5-44a2-ba92-2603fd2607fa tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 1.683292 Aug 04 14:30:22.521166 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2734/5440] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:20 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:22.586075 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d5906fd-c3cb-4282-a03b-133acf483770 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.224774 Aug 04 14:30:22.586627 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2707/5441] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:30:22 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:30:22.609815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-78b54813-0472-4c92-90c0-25cca6898cb5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:22.610421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-78b54813-0472-4c92-90c0-25cca6898cb5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:22.632643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78b54813-0472-4c92-90c0-25cca6898cb5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:22.632643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78b54813-0472-4c92-90c0-25cca6898cb5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:22.649551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78b54813-0472-4c92-90c0-25cca6898cb5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:22.651206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78b54813-0472-4c92-90c0-25cca6898cb5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:22.766718 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-78b54813-0472-4c92-90c0-25cca6898cb5 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/f4cc6373-8b44-4af3-bdf5-c23c4def67aa" status: 200 len: 194 microversion: 2.1 time: 0.169219 Aug 04 14:30:22.767382 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2735/5442] 10.222.0.66 () {58 vars in 1413 bytes} [Thu Aug 4 14:30:22 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/f4cc6373-8b44-4af3-bdf5-c23c4def67aa => generated 194 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:30:23.548444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-592a85cb-b035-46ed-922f-2472f04baecc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:23.568295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-592a85cb-b035-46ed-922f-2472f04baecc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:23.656305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-592a85cb-b035-46ed-922f-2472f04baecc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:23.664060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-592a85cb-b035-46ed-922f-2472f04baecc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:23.686461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-592a85cb-b035-46ed-922f-2472f04baecc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:23.687409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-592a85cb-b035-46ed-922f-2472f04baecc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:25.728769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-592a85cb-b035-46ed-922f-2472f04baecc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:25.758203 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-592a85cb-b035-46ed-922f-2472f04baecc tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 2.229419 Aug 04 14:30:25.759111 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2708/5443] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:23 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:26.369919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18e9b163-351f-4bd0-9952-a65795ef36db tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14f7f779-c3ce-4856-9245-ebcd9d596e1b"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:30:26.373413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-18e9b163-351f-4bd0-9952-a65795ef36db tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:26.381035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:26.383798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18e9b163-351f-4bd0-9952-a65795ef36db tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:26.384774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18e9b163-351f-4bd0-9952-a65795ef36db tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:26.385893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18e9b163-351f-4bd0-9952-a65795ef36db tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:26.386511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18e9b163-351f-4bd0-9952-a65795ef36db tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:26.416180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=35 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:26.786839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3cd83a8f-7b69-4a9e-9828-1962f4b1248d tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:26.789550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3cd83a8f-7b69-4a9e-9828-1962f4b1248d tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:26.821968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cd83a8f-7b69-4a9e-9828-1962f4b1248d tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:26.824486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cd83a8f-7b69-4a9e-9828-1962f4b1248d tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:26.828955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cd83a8f-7b69-4a9e-9828-1962f4b1248d tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:26.831557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cd83a8f-7b69-4a9e-9828-1962f4b1248d tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:26.929816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:27.097997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18e9b163-351f-4bd0-9952-a65795ef36db tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "POST /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728827 Aug 04 14:30:27.102442 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2736/5444] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:30:26 2022] POST /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:30:27.491023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1199178824", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2126596764", "security_groups": [{"name": "tempest-secgroup-smoke-1415560919"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "9f2268ea-cd37-4cef-8cc5-e42b28390239"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:30:27.495753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3cd83a8f-7b69-4a9e-9828-1962f4b1248d tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:27.504085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:27.527118 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3cd83a8f-7b69-4a9e-9828-1962f4b1248d tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 0.748796 Aug 04 14:30:27.527733 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2709/5445] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:26 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:27.991563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] validate_networks() for [('9f2268ea-cd37-4cef-8cc5-e42b28390239', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:30:28.551318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b541dda8-7382-458e-aec1-1fd0586a69b3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:28.555459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b541dda8-7382-458e-aec1-1fd0586a69b3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:28.565261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=27 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:28.567423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b541dda8-7382-458e-aec1-1fd0586a69b3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:28.568204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b541dda8-7382-458e-aec1-1fd0586a69b3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:28.570956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b541dda8-7382-458e-aec1-1fd0586a69b3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:28.571716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b541dda8-7382-458e-aec1-1fd0586a69b3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:29.498147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b541dda8-7382-458e-aec1-1fd0586a69b3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:29.511578 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b541dda8-7382-458e-aec1-1fd0586a69b3 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 0.965268 Aug 04 14:30:29.513194 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2710/5446] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:28 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:30.016636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Getting quotas for project 3ec527d1fed444fcb4f59a5e64abe3fb. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:30:30.029950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Getting quotas for user 93551e21ae0940f6868f96c1c3bde18f and project 3ec527d1fed444fcb4f59a5e64abe3fb. Resources: dict_keys(['metadata_items']) {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:30:30.087673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:30:30.089674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:30:30.090515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:30:30.094271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:30:30.095218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:30:30.120125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:30.122023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:30.124717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:30.128355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:30.181082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Getting quotas for project 3ec527d1fed444fcb4f59a5e64abe3fb. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:30:30.195660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Getting quotas for user 93551e21ae0940f6868f96c1c3bde18f and project 3ec527d1fed444fcb4f59a5e64abe3fb. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:30:30.233990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:30:30.238831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:30:30.376977 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9e1540c4-928b-4a22-970b-35e8551b4e1e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.894128 Aug 04 14:30:30.393322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7315128f-11c8-497e-97fc-a587b423285c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:30.394905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7315128f-11c8-497e-97fc-a587b423285c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:30.399652 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2737/5447] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:30:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:30:30.547069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02c0e25b-22b6-4a18-87cd-6c159559d30e tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:30.547813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-02c0e25b-22b6-4a18-87cd-6c159559d30e tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:30.562278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02c0e25b-22b6-4a18-87cd-6c159559d30e tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:30.576712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02c0e25b-22b6-4a18-87cd-6c159559d30e tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:30.576712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02c0e25b-22b6-4a18-87cd-6c159559d30e tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:30.576712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-02c0e25b-22b6-4a18-87cd-6c159559d30e tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:30.583085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7315128f-11c8-497e-97fc-a587b423285c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:30.592079 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7315128f-11c8-497e-97fc-a587b423285c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1303 microversion: 2.1 time: 0.202665 Aug 04 14:30:30.618700 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2711/5448] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:30 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:30.766397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6dcd3535-6b8b-47f8-8b69-a7a69faacb7c req-6d0cee0e-5f16-4cb5-b7e6-0dd6955d4fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6136d2-71fe-4a37-b388-5e115ae76152", "name": "network-vif-plugged", "status": "completed", "tag": "8601c97f-3597-4212-af24-d7fba498fc85"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:30:30.880816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6dcd3535-6b8b-47f8-8b69-a7a69faacb7c req-6d0cee0e-5f16-4cb5-b7e6-0dd6955d4fb8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:30.906466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6dcd3535-6b8b-47f8-8b69-a7a69faacb7c req-6d0cee0e-5f16-4cb5-b7e6-0dd6955d4fb8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:30.997858 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6dcd3535-6b8b-47f8-8b69-a7a69faacb7c req-6d0cee0e-5f16-4cb5-b7e6-0dd6955d4fb8 service nova] Creating event network-vif-plugged:8601c97f-3597-4212-af24-d7fba498fc85 for instance ec6136d2-71fe-4a37-b388-5e115ae76152 on n-h1-844627-10 Aug 04 14:30:31.031918 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6dcd3535-6b8b-47f8-8b69-a7a69faacb7c req-6d0cee0e-5f16-4cb5-b7e6-0dd6955d4fb8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276043 Aug 04 14:30:31.044951 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2712/5449] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:30:31.624282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-02c0e25b-22b6-4a18-87cd-6c159559d30e tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:31.656530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a1ef93b-4bc6-49e7-a17b-3de5b7c39287 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:31.675966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a1ef93b-4bc6-49e7-a17b-3de5b7c39287 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:31.703558 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-02c0e25b-22b6-4a18-87cd-6c159559d30e tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 1.160497 Aug 04 14:30:31.717105 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2738/5450] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:30 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:31.725878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a1ef93b-4bc6-49e7-a17b-3de5b7c39287 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:31.727224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a1ef93b-4bc6-49e7-a17b-3de5b7c39287 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:31.731346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a1ef93b-4bc6-49e7-a17b-3de5b7c39287 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:31.743395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a1ef93b-4bc6-49e7-a17b-3de5b7c39287 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:32.193483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a1ef93b-4bc6-49e7-a17b-3de5b7c39287 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:32.230600 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a1ef93b-4bc6-49e7-a17b-3de5b7c39287 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1307 microversion: 2.1 time: 0.595864 Aug 04 14:30:32.247392 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2713/5451] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:31 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1307 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:32.747500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b06afe2-fb23-4aa2-b09a-fe208d9fbfe4 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:32.748644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b06afe2-fb23-4aa2-b09a-fe208d9fbfe4 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:32.803903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b06afe2-fb23-4aa2-b09a-fe208d9fbfe4 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:32.807585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b06afe2-fb23-4aa2-b09a-fe208d9fbfe4 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:32.814677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b06afe2-fb23-4aa2-b09a-fe208d9fbfe4 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:32.822386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b06afe2-fb23-4aa2-b09a-fe208d9fbfe4 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:33.257282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4a70e98c-9804-4e92-838b-9287777d7873 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:33.259645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4a70e98c-9804-4e92-838b-9287777d7873 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:33.286600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a70e98c-9804-4e92-838b-9287777d7873 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:33.294076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a70e98c-9804-4e92-838b-9287777d7873 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:33.296395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a70e98c-9804-4e92-838b-9287777d7873 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:33.298108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a70e98c-9804-4e92-838b-9287777d7873 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:33.777553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4a70e98c-9804-4e92-838b-9287777d7873 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:33.802801 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4a70e98c-9804-4e92-838b-9287777d7873 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1361 microversion: 2.1 time: 0.553820 Aug 04 14:30:33.806108 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2714/5452] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:33 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1361 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:34.041721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b06afe2-fb23-4aa2-b09a-fe208d9fbfe4 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:34.081447 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b06afe2-fb23-4aa2-b09a-fe208d9fbfe4 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1313 microversion: 2.1 time: 1.338477 Aug 04 14:30:34.085127 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2739/5453] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:32 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1313 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:34.848907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-304c3492-2a57-4595-b998-0c0e73ed5a2a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:34.860524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-304c3492-2a57-4595-b998-0c0e73ed5a2a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:34.897269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-304c3492-2a57-4595-b998-0c0e73ed5a2a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:34.901775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-304c3492-2a57-4595-b998-0c0e73ed5a2a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:34.904013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-304c3492-2a57-4595-b998-0c0e73ed5a2a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:34.904810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-304c3492-2a57-4595-b998-0c0e73ed5a2a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:35.116861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0402c586-f62d-4026-9897-5a3c7a098245 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:35.135364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0402c586-f62d-4026-9897-5a3c7a098245 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:35.164519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0402c586-f62d-4026-9897-5a3c7a098245 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:35.166264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0402c586-f62d-4026-9897-5a3c7a098245 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:35.168113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0402c586-f62d-4026-9897-5a3c7a098245 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:35.169315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0402c586-f62d-4026-9897-5a3c7a098245 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:35.536781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-304c3492-2a57-4595-b998-0c0e73ed5a2a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:35.561424 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-304c3492-2a57-4595-b998-0c0e73ed5a2a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1361 microversion: 2.1 time: 0.736506 Aug 04 14:30:35.570136 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2715/5454] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:34 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1361 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:36.548621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0402c586-f62d-4026-9897-5a3c7a098245 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:36.578730 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0402c586-f62d-4026-9897-5a3c7a098245 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1497 microversion: 2.1 time: 1.469553 Aug 04 14:30:36.582260 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2740/5455] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:35 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1497 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:36.592379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-933a997f-fefc-4e4a-96fc-b259efa3d00e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:36.593305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-933a997f-fefc-4e4a-96fc-b259efa3d00e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:36.625404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-933a997f-fefc-4e4a-96fc-b259efa3d00e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:36.626286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-933a997f-fefc-4e4a-96fc-b259efa3d00e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:36.627405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-933a997f-fefc-4e4a-96fc-b259efa3d00e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:36.629409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-933a997f-fefc-4e4a-96fc-b259efa3d00e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:36.989255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-933a997f-fefc-4e4a-96fc-b259efa3d00e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:37.007532 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-933a997f-fefc-4e4a-96fc-b259efa3d00e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1361 microversion: 2.1 time: 0.416690 Aug 04 14:30:37.009064 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2716/5456] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:36 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1361 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:38.037695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f00ef509-1801-4b8b-aee5-595b8c05e168 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:38.038909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f00ef509-1801-4b8b-aee5-595b8c05e168 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:38.074607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f00ef509-1801-4b8b-aee5-595b8c05e168 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:38.075932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f00ef509-1801-4b8b-aee5-595b8c05e168 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:38.099539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f00ef509-1801-4b8b-aee5-595b8c05e168 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:38.100391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f00ef509-1801-4b8b-aee5-595b8c05e168 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:39.242168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f00ef509-1801-4b8b-aee5-595b8c05e168 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:39.280435 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f00ef509-1801-4b8b-aee5-595b8c05e168 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 1.249225 Aug 04 14:30:39.309184 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2741/5457] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:38 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:40.326768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-630c0501-4b12-4380-bf38-ec4b63b6470e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:40.327577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-630c0501-4b12-4380-bf38-ec4b63b6470e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:40.346476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-630c0501-4b12-4380-bf38-ec4b63b6470e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:40.346930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-630c0501-4b12-4380-bf38-ec4b63b6470e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:40.347801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-630c0501-4b12-4380-bf38-ec4b63b6470e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:40.348242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-630c0501-4b12-4380-bf38-ec4b63b6470e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:40.589333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:42.288078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-630c0501-4b12-4380-bf38-ec4b63b6470e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:42.375297 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-630c0501-4b12-4380-bf38-ec4b63b6470e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 2.052454 Aug 04 14:30:42.377661 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2717/5458] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:40 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:42.484121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:42.485139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=10 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:42.710991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cc736a7c-c6a7-4e91-8ad7-09cc4426ae72 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:42.711514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cc736a7c-c6a7-4e91-8ad7-09cc4426ae72 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:42.726436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc736a7c-c6a7-4e91-8ad7-09cc4426ae72 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:42.727055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc736a7c-c6a7-4e91-8ad7-09cc4426ae72 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:42.732859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc736a7c-c6a7-4e91-8ad7-09cc4426ae72 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:42.737219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc736a7c-c6a7-4e91-8ad7-09cc4426ae72 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:42.811167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cc736a7c-c6a7-4e91-8ad7-09cc4426ae72 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:30:43.004307 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cc736a7c-c6a7-4e91-8ad7-09cc4426ae72 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 204 len: 0 microversion: 2.1 time: 0.297012 Aug 04 14:30:43.005389 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2718/5459] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:30:42 2022] DELETE /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:30:43.017396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5bb12be0-8da4-4cb5-9e6a-d68411282396 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:43.018467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5bb12be0-8da4-4cb5-9e6a-d68411282396 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:43.026996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bb12be0-8da4-4cb5-9e6a-d68411282396 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:43.028493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bb12be0-8da4-4cb5-9e6a-d68411282396 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:43.030000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bb12be0-8da4-4cb5-9e6a-d68411282396 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:43.035726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bb12be0-8da4-4cb5-9e6a-d68411282396 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:43.079882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7d6cb27f-35b5-43ad-adf0-24ec08d97b9d req-dd339c4b-7a62-476b-8667-be9c6fcb3cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a410b8cc-2988-4a53-ae6a-37d5e1da020f", "tag": "5f282554-8e5f-498e-9680-c3b06bea6479"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:30:43.108846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7d6cb27f-35b5-43ad-adf0-24ec08d97b9d req-dd339c4b-7a62-476b-8667-be9c6fcb3cf7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:43.109600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7d6cb27f-35b5-43ad-adf0-24ec08d97b9d req-dd339c4b-7a62-476b-8667-be9c6fcb3cf7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:43.181896 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7d6cb27f-35b5-43ad-adf0-24ec08d97b9d req-dd339c4b-7a62-476b-8667-be9c6fcb3cf7 service nova] Creating event network-changed:5f282554-8e5f-498e-9680-c3b06bea6479 for instance a410b8cc-2988-4a53-ae6a-37d5e1da020f on n-h2-844627-10 Aug 04 14:30:43.203944 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7d6cb27f-35b5-43ad-adf0-24ec08d97b9d req-dd339c4b-7a62-476b-8667-be9c6fcb3cf7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.725257 Aug 04 14:30:43.205131 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2742/5460] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:30:43.417742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b871989c-915c-4d2e-af2a-b12e7b77715c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:43.419983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b871989c-915c-4d2e-af2a-b12e7b77715c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:43.470997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b871989c-915c-4d2e-af2a-b12e7b77715c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:43.471235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b871989c-915c-4d2e-af2a-b12e7b77715c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:43.472081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b871989c-915c-4d2e-af2a-b12e7b77715c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:43.472540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b871989c-915c-4d2e-af2a-b12e7b77715c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:43.535860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5bb12be0-8da4-4cb5-9e6a-d68411282396 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:43.545178 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5bb12be0-8da4-4cb5-9e6a-d68411282396 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1503 microversion: 2.1 time: 0.534840 Aug 04 14:30:43.556912 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2719/5461] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:43 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1503 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:43.797551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b871989c-915c-4d2e-af2a-b12e7b77715c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:43.835864 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b871989c-915c-4d2e-af2a-b12e7b77715c tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 0.427677 Aug 04 14:30:43.849294 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2743/5462] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:43 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:44.567601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e6e432b-5e8e-40a0-82c9-e9110b918b62 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:44.569168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e6e432b-5e8e-40a0-82c9-e9110b918b62 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:44.577066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e6e432b-5e8e-40a0-82c9-e9110b918b62 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:44.584316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e6e432b-5e8e-40a0-82c9-e9110b918b62 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:44.585328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e6e432b-5e8e-40a0-82c9-e9110b918b62 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:44.587509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e6e432b-5e8e-40a0-82c9-e9110b918b62 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:44.862542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fc19a7e4-fd8d-4370-b8ff-4fae004022f4 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:44.863867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fc19a7e4-fd8d-4370-b8ff-4fae004022f4 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:44.877802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc19a7e4-fd8d-4370-b8ff-4fae004022f4 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:44.878548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc19a7e4-fd8d-4370-b8ff-4fae004022f4 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:44.881367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc19a7e4-fd8d-4370-b8ff-4fae004022f4 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:44.881832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc19a7e4-fd8d-4370-b8ff-4fae004022f4 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:45.306426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3e6e432b-5e8e-40a0-82c9-e9110b918b62 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aee8297671424495ef3e9bd9a58d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157a7e5e12794c0581c9c1afa2c97cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:45.316860 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e6e432b-5e8e-40a0-82c9-e9110b918b62 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 200 len: 1503 microversion: 2.1 time: 0.753087 Aug 04 14:30:45.319558 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2720/5463] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:44 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 1503 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:45.609827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-af3ae7cd-6d3c-4770-83b4-5b26c4380922 req-b82f692c-36b0-4166-9d2a-6da75620a668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6136d2-71fe-4a37-b388-5e115ae76152", "name": "network-vif-deleted", "tag": "8601c97f-3597-4212-af24-d7fba498fc85"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:30:45.622682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-af3ae7cd-6d3c-4770-83b4-5b26c4380922 req-b82f692c-36b0-4166-9d2a-6da75620a668 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:45.637235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-af3ae7cd-6d3c-4770-83b4-5b26c4380922 req-b82f692c-36b0-4166-9d2a-6da75620a668 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:45.668655 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-af3ae7cd-6d3c-4770-83b4-5b26c4380922 req-b82f692c-36b0-4166-9d2a-6da75620a668 service nova] Creating event network-vif-deleted:8601c97f-3597-4212-af24-d7fba498fc85 for instance ec6136d2-71fe-4a37-b388-5e115ae76152 on n-h1-844627-10 Aug 04 14:30:45.705400 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-af3ae7cd-6d3c-4770-83b4-5b26c4380922 req-b82f692c-36b0-4166-9d2a-6da75620a668 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095809 Aug 04 14:30:45.707333 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2721/5464] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:30:45.758880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fc19a7e4-fd8d-4370-b8ff-4fae004022f4 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:45.841618 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fc19a7e4-fd8d-4370-b8ff-4fae004022f4 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 0.965631 Aug 04 14:30:45.842315 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2744/5465] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:44 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:30:46.342290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:46.343175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] [instance: ec6136d2-71fe-4a37-b388-5e115ae76152] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:46.363988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:46.365113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:46.368461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:46.369330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:46.409517 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] HTTP exception thrown: Instance ec6136d2-71fe-4a37-b388-5e115ae76152 could not be found. Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Request method failure captured: Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 HTTP/1.1 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69fdt-AaUQW37jXSrTFbKLyrj4-FIP_vkZVkyydJ-A5bKRQAeAQnkAm8d7w5rQzEDsFw1KP0b7kkZi_zj2uB2tSiIQbDeKW9hNsMBTEOW7Jw7sgNiP1mQG-4JbaDKmI5NV13D9MTF6hoxsLZOGXmdfu7j1mvhIGc-WR1I_qI3fWwI7A Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 157a7e5e12794c0581c9c1afa2c97cd9 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesActionsTest-798401378 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/157a7e5e12794c0581c9c1afa2c97cd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_157a7e5e12794c0581c9c1afa2c97cd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/157a7e5e12794c0581c9c1afa2c97cd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/157a7e5e12794c0581c9c1afa2c97cd9"}]}] Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesActionsTest-798401378 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 157a7e5e12794c0581c9c1afa2c97cd9 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesActionsTest-798401378 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesActionsTest-798401378-project Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 51aee8297671424495ef3e9bd9a58d42 Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesActionsTest-798401378-project Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance ec6136d2-71fe-4a37-b388-5e115ae76152 could not be found. Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'ec6136d2-71fe-4a37-b388-5e115ae76152'} Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6136d2-71fe-4a37-b388-5e115ae76152 could not be found. Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6136d2-71fe-4a37-b388-5e115ae76152 could not be found. Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:30:46.414534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:30:46.418565 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:30:46.418565 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:30:46.418565 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:30:46.418565 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:30:46.418565 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:30:46.418565 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6136d2-71fe-4a37-b388-5e115ae76152 could not be found. Aug 04 14:30:46.418565 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:30:46.422162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] Returning 404 to user: Instance ec6136d2-71fe-4a37-b388-5e115ae76152 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:30:46.425059 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-758c487b-d8d9-4be0-a3f9-3d0cfeab6cc6 tempest-VolumesActionsTest-798401378 tempest-VolumesActionsTest-798401378-project] 10.222.0.66 "GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152" status: 404 len: 111 microversion: 2.1 time: 0.087898 Aug 04 14:30:46.429592 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2722/5466] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:46 2022] GET /compute/v2.1/servers/ec6136d2-71fe-4a37-b388-5e115ae76152 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:30:46.871603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4cfb45c2-aedb-4c0a-a376-4c99cbfbcd9d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:46.876693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4cfb45c2-aedb-4c0a-a376-4c99cbfbcd9d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:46.931240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4cfb45c2-aedb-4c0a-a376-4c99cbfbcd9d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:46.933538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4cfb45c2-aedb-4c0a-a376-4c99cbfbcd9d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:46.945599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4cfb45c2-aedb-4c0a-a376-4c99cbfbcd9d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:46.955704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4cfb45c2-aedb-4c0a-a376-4c99cbfbcd9d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:47.540803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65faadda-998c-4c6b-a932-5cb7d5250a51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:47.544560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-65faadda-998c-4c6b-a932-5cb7d5250a51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:47.554659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65faadda-998c-4c6b-a932-5cb7d5250a51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:47.555628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65faadda-998c-4c6b-a932-5cb7d5250a51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:47.557523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65faadda-998c-4c6b-a932-5cb7d5250a51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:47.558275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65faadda-998c-4c6b-a932-5cb7d5250a51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:47.601029 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-65faadda-998c-4c6b-a932-5cb7d5250a51 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064522 Aug 04 14:30:47.607730 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2723/5467] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:30:47 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:30:47.759350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9695fb32-e09a-4113-94f3-2b6f58546e6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:47.760155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9695fb32-e09a-4113-94f3-2b6f58546e6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:47.774485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9695fb32-e09a-4113-94f3-2b6f58546e6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:47.783072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9695fb32-e09a-4113-94f3-2b6f58546e6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:47.784117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9695fb32-e09a-4113-94f3-2b6f58546e6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:47.787935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9695fb32-e09a-4113-94f3-2b6f58546e6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:47.900028 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9695fb32-e09a-4113-94f3-2b6f58546e6b tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/f4cc6373-8b44-4af3-bdf5-c23c4def67aa" status: 200 len: 194 microversion: 2.1 time: 0.146716 Aug 04 14:30:47.908259 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2724/5468] 10.222.0.66 () {58 vars in 1413 bytes} [Thu Aug 4 14:30:47 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/f4cc6373-8b44-4af3-bdf5-c23c4def67aa => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:30:47.941325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22aaf475-f1f1-44b8-8feb-8f70be4b672e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:47.942243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22aaf475-f1f1-44b8-8feb-8f70be4b672e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:47.973875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22aaf475-f1f1-44b8-8feb-8f70be4b672e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:47.974523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22aaf475-f1f1-44b8-8feb-8f70be4b672e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:47.975598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22aaf475-f1f1-44b8-8feb-8f70be4b672e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:47.978711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22aaf475-f1f1-44b8-8feb-8f70be4b672e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:48.320902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-22aaf475-f1f1-44b8-8feb-8f70be4b672e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lazy-loading 'services' on Instance uuid addd5022-8377-4610-9ade-b675ce58fa12 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:30:48.630587 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22aaf475-f1f1-44b8-8feb-8f70be4b672e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "DELETE /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/f4cc6373-8b44-4af3-bdf5-c23c4def67aa" status: 202 len: 0 microversion: 2.1 time: 0.700140 Aug 04 14:30:48.631818 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2725/5469] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:30:47 2022] DELETE /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/f4cc6373-8b44-4af3-bdf5-c23c4def67aa => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:30:49.839008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4cfb45c2-aedb-4c0a-a376-4c99cbfbcd9d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:49.852978 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4cfb45c2-aedb-4c0a-a376-4c99cbfbcd9d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 2.991184 Aug 04 14:30:49.853827 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2745/5470] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:46 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 2995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:50.906268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-843ad852-9839-4c8e-8a1c-4cc23eeb2e97 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:50.912856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-843ad852-9839-4c8e-8a1c-4cc23eeb2e97 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:50.957647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-843ad852-9839-4c8e-8a1c-4cc23eeb2e97 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:50.959965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-843ad852-9839-4c8e-8a1c-4cc23eeb2e97 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:50.962326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-843ad852-9839-4c8e-8a1c-4cc23eeb2e97 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:50.963577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-843ad852-9839-4c8e-8a1c-4cc23eeb2e97 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:51.506455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-843ad852-9839-4c8e-8a1c-4cc23eeb2e97 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:51.538547 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-843ad852-9839-4c8e-8a1c-4cc23eeb2e97 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 0.656128 Aug 04 14:30:51.542782 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2726/5471] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:50 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:52.565990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e5052294-bb0a-431f-8548-e5fa11575747 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:52.566974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e5052294-bb0a-431f-8548-e5fa11575747 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:52.618166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5052294-bb0a-431f-8548-e5fa11575747 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:52.620254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5052294-bb0a-431f-8548-e5fa11575747 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:52.622641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5052294-bb0a-431f-8548-e5fa11575747 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:52.624513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e5052294-bb0a-431f-8548-e5fa11575747 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:53.643689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e5052294-bb0a-431f-8548-e5fa11575747 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:53.655486 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e5052294-bb0a-431f-8548-e5fa11575747 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 1.096389 Aug 04 14:30:53.660288 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2746/5472] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:52 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:54.692195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5babf12d-7b4b-42eb-b6af-11c92fd9d0a7 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:54.695375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5babf12d-7b4b-42eb-b6af-11c92fd9d0a7 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:54.734828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5babf12d-7b4b-42eb-b6af-11c92fd9d0a7 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:54.735183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5babf12d-7b4b-42eb-b6af-11c92fd9d0a7 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:54.739007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5babf12d-7b4b-42eb-b6af-11c92fd9d0a7 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:54.740596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5babf12d-7b4b-42eb-b6af-11c92fd9d0a7 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:55.700053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:56.325356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5babf12d-7b4b-42eb-b6af-11c92fd9d0a7 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:30:56.351878 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5babf12d-7b4b-42eb-b6af-11c92fd9d0a7 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 1.670003 Aug 04 14:30:56.385347 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2727/5473] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:54 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:30:57.393605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1635254b-b559-4146-aadd-1211f3aefe2d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:30:57.395445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1635254b-b559-4146-aadd-1211f3aefe2d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:30:57.408269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:57.431331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1635254b-b559-4146-aadd-1211f3aefe2d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:57.432559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1635254b-b559-4146-aadd-1211f3aefe2d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:57.437281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1635254b-b559-4146-aadd-1211f3aefe2d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:57.441491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1635254b-b559-4146-aadd-1211f3aefe2d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:57.463533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:30:58.162991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2a441fbd-5f62-4543-92cf-fb93cac8e3ff req-b7b70d91-4f7e-4b21-9f97-b220905ad88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a410b8cc-2988-4a53-ae6a-37d5e1da020f", "name": "network-vif-plugged", "status": "completed", "tag": "5f282554-8e5f-498e-9680-c3b06bea6479"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:30:58.198955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2a441fbd-5f62-4543-92cf-fb93cac8e3ff req-b7b70d91-4f7e-4b21-9f97-b220905ad88e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:30:58.200230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2a441fbd-5f62-4543-92cf-fb93cac8e3ff req-b7b70d91-4f7e-4b21-9f97-b220905ad88e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:30:58.225870 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2a441fbd-5f62-4543-92cf-fb93cac8e3ff req-b7b70d91-4f7e-4b21-9f97-b220905ad88e service nova] Creating event network-vif-plugged:5f282554-8e5f-498e-9680-c3b06bea6479 for instance a410b8cc-2988-4a53-ae6a-37d5e1da020f on n-h2-844627-10 Aug 04 14:30:58.233305 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2a441fbd-5f62-4543-92cf-fb93cac8e3ff req-b7b70d91-4f7e-4b21-9f97-b220905ad88e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.451092 Aug 04 14:30:58.234700 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2728/5474] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:31:00.082544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1635254b-b559-4146-aadd-1211f3aefe2d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:00.095870 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1635254b-b559-4146-aadd-1211f3aefe2d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 2.707903 Aug 04 14:31:00.114247 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2747/5475] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:30:57 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 2727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:31:01.121364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3b2ad0c2-c376-4c6a-be0f-fcacd7a4d126 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:01.123978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3b2ad0c2-c376-4c6a-be0f-fcacd7a4d126 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:01.129050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:31:01.181516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b2ad0c2-c376-4c6a-be0f-fcacd7a4d126 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:01.182209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b2ad0c2-c376-4c6a-be0f-fcacd7a4d126 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:01.205506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b2ad0c2-c376-4c6a-be0f-fcacd7a4d126 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:01.210204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b2ad0c2-c376-4c6a-be0f-fcacd7a4d126 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:01.759966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-492730e7-1033-4625-a2e2-a25d9f85d655 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:01.761971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-492730e7-1033-4625-a2e2-a25d9f85d655 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:01.776844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-492730e7-1033-4625-a2e2-a25d9f85d655 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:01.776844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-492730e7-1033-4625-a2e2-a25d9f85d655 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:01.783587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-492730e7-1033-4625-a2e2-a25d9f85d655 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:01.786529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-492730e7-1033-4625-a2e2-a25d9f85d655 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:01.874552 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-492730e7-1033-4625-a2e2-a25d9f85d655 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/14f7f779-c3ce-4856-9245-ebcd9d596e1b" status: 200 len: 194 microversion: 2.1 time: 0.117122 Aug 04 14:31:01.876646 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2748/5476] 10.222.0.66 () {58 vars in 1413 bytes} [Thu Aug 4 14:31:01 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/14f7f779-c3ce-4856-9245-ebcd9d596e1b => generated 194 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:31:01.892079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e18a30dc-aeaf-4232-acf6-14a9d439bfcd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:01.893132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e18a30dc-aeaf-4232-acf6-14a9d439bfcd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:01.908245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e18a30dc-aeaf-4232-acf6-14a9d439bfcd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:01.912596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e18a30dc-aeaf-4232-acf6-14a9d439bfcd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:01.913835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e18a30dc-aeaf-4232-acf6-14a9d439bfcd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:01.917267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e18a30dc-aeaf-4232-acf6-14a9d439bfcd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:01.953112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3b2ad0c2-c376-4c6a-be0f-fcacd7a4d126 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:01.968247 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3b2ad0c2-c376-4c6a-be0f-fcacd7a4d126 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1429 microversion: 2.1 time: 0.852913 Aug 04 14:31:01.970279 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2729/5477] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:01 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1429 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:31:02.066994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-e18a30dc-aeaf-4232-acf6-14a9d439bfcd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lazy-loading 'services' on Instance uuid addd5022-8377-4610-9ade-b675ce58fa12 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:31:02.275020 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e18a30dc-aeaf-4232-acf6-14a9d439bfcd tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "DELETE /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/14f7f779-c3ce-4856-9245-ebcd9d596e1b" status: 202 len: 0 microversion: 2.1 time: 0.386638 Aug 04 14:31:02.284405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2749/5478] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:31:01 2022] DELETE /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments/14f7f779-c3ce-4856-9245-ebcd9d596e1b => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:31:02.994306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae84a87b-f0cb-4df4-99c0-e49196b0f559 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:02.995026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ae84a87b-f0cb-4df4-99c0-e49196b0f559 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:03.015284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae84a87b-f0cb-4df4-99c0-e49196b0f559 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:03.015738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae84a87b-f0cb-4df4-99c0-e49196b0f559 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:03.019534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae84a87b-f0cb-4df4-99c0-e49196b0f559 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:03.022571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae84a87b-f0cb-4df4-99c0-e49196b0f559 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:04.280148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae84a87b-f0cb-4df4-99c0-e49196b0f559 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:04.293507 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae84a87b-f0cb-4df4-99c0-e49196b0f559 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1607 microversion: 2.1 time: 1.302698 Aug 04 14:31:04.295703 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2730/5479] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:02 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1607 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:31:04.337764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1b6e68b-fe29-4ff3-a4c1-14e299ceebd2 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:04.354925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1b6e68b-fe29-4ff3-a4c1-14e299ceebd2 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:04.387248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1b6e68b-fe29-4ff3-a4c1-14e299ceebd2 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:04.392796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1b6e68b-fe29-4ff3-a4c1-14e299ceebd2 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:04.398250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1b6e68b-fe29-4ff3-a4c1-14e299ceebd2 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:04.398980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1b6e68b-fe29-4ff3-a4c1-14e299ceebd2 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:05.498026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1b6e68b-fe29-4ff3-a4c1-14e299ceebd2 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:05.533203 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1b6e68b-fe29-4ff3-a4c1-14e299ceebd2 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1607 microversion: 2.1 time: 1.215764 Aug 04 14:31:05.557739 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2750/5480] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:04 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1607 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:31:05.588680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5bd78953-dc60-4475-874f-ca0f4296971f tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:05.591115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5bd78953-dc60-4475-874f-ca0f4296971f tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:05.648262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bd78953-dc60-4475-874f-ca0f4296971f tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:05.648845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bd78953-dc60-4475-874f-ca0f4296971f tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:05.649742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bd78953-dc60-4475-874f-ca0f4296971f tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:05.655995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bd78953-dc60-4475-874f-ca0f4296971f tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:08.226851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5bd78953-dc60-4475-874f-ca0f4296971f tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:08.296638 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5bd78953-dc60-4475-874f-ca0f4296971f tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1607 microversion: 2.1 time: 2.727247 Aug 04 14:31:08.297737 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2731/5481] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:05 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1607 bytes in 2731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:31:17.427049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c36eac10-7dc4-4708-826c-a4a5dc253078 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:17.439024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c36eac10-7dc4-4708-826c-a4a5dc253078 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:17.458474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=7 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:31:17.459963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:31:17.484190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c36eac10-7dc4-4708-826c-a4a5dc253078 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:17.485006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c36eac10-7dc4-4708-826c-a4a5dc253078 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:17.493976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c36eac10-7dc4-4708-826c-a4a5dc253078 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:17.495137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c36eac10-7dc4-4708-826c-a4a5dc253078 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:17.647519 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c36eac10-7dc4-4708-826c-a4a5dc253078 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.227888 Aug 04 14:31:17.653683 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2751/5482] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:31:17 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments => generated 25 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:31:18.385263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-15e775c3-b1cd-4efe-87de-af33af48ad63 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:18.396829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-15e775c3-b1cd-4efe-87de-af33af48ad63 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:18.425771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=5 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:31:18.427266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=25 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:31:18.429227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15e775c3-b1cd-4efe-87de-af33af48ad63 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:18.430113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15e775c3-b1cd-4efe-87de-af33af48ad63 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:18.431182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15e775c3-b1cd-4efe-87de-af33af48ad63 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:18.431826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-15e775c3-b1cd-4efe-87de-af33af48ad63 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:18.575742 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-15e775c3-b1cd-4efe-87de-af33af48ad63 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.212049 Aug 04 14:31:18.576988 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2732/5483] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 14:31:18 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12/os-volume_attachments => generated 25 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 14:31:18.770848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6e4dadb-9e68-49b9-9903-78afdbc84239 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:18.775155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6e4dadb-9e68-49b9-9903-78afdbc84239 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:18.812083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6e4dadb-9e68-49b9-9903-78afdbc84239 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:18.815778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6e4dadb-9e68-49b9-9903-78afdbc84239 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:18.823079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6e4dadb-9e68-49b9-9903-78afdbc84239 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:18.825837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6e4dadb-9e68-49b9-9903-78afdbc84239 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:18.936681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6e4dadb-9e68-49b9-9903-78afdbc84239 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:31:19.486775 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6e4dadb-9e68-49b9-9903-78afdbc84239 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "DELETE /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 204 len: 0 microversion: 2.1 time: 0.725883 Aug 04 14:31:19.496052 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2752/5484] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:31:18 2022] DELETE /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:31:19.501168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf11cb69-3c3d-4f2a-9a7f-c7c3854c0c7e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:19.502462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf11cb69-3c3d-4f2a-9a7f-c7c3854c0c7e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:19.514790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf11cb69-3c3d-4f2a-9a7f-c7c3854c0c7e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:19.522696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf11cb69-3c3d-4f2a-9a7f-c7c3854c0c7e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:19.523866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf11cb69-3c3d-4f2a-9a7f-c7c3854c0c7e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:19.532653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf11cb69-3c3d-4f2a-9a7f-c7c3854c0c7e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:21.205914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cf11cb69-3c3d-4f2a-9a7f-c7c3854c0c7e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:21.222223 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf11cb69-3c3d-4f2a-9a7f-c7c3854c0c7e tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1673 microversion: 2.1 time: 1.724300 Aug 04 14:31:21.242462 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2733/5485] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:19 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1673 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:31:22.275232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8761f0d3-a382-4cb3-b13e-d99bbc8ada4f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:22.283856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8761f0d3-a382-4cb3-b13e-d99bbc8ada4f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:22.322479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8761f0d3-a382-4cb3-b13e-d99bbc8ada4f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:22.326149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8761f0d3-a382-4cb3-b13e-d99bbc8ada4f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:22.330721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8761f0d3-a382-4cb3-b13e-d99bbc8ada4f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:22.335254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8761f0d3-a382-4cb3-b13e-d99bbc8ada4f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:24.438940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8761f0d3-a382-4cb3-b13e-d99bbc8ada4f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:24.488285 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8761f0d3-a382-4cb3-b13e-d99bbc8ada4f tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1673 microversion: 2.1 time: 2.218691 Aug 04 14:31:24.489939 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2753/5486] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:22 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1673 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:31:25.518456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e67c59cd-26bb-4863-838c-dcaa62e36522 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:25.527890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e67c59cd-26bb-4863-838c-dcaa62e36522 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:25.576963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e67c59cd-26bb-4863-838c-dcaa62e36522 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:25.590727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e67c59cd-26bb-4863-838c-dcaa62e36522 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:25.592579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e67c59cd-26bb-4863-838c-dcaa62e36522 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:25.598933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e67c59cd-26bb-4863-838c-dcaa62e36522 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:26.503957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e67c59cd-26bb-4863-838c-dcaa62e36522 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:26.536655 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e67c59cd-26bb-4863-838c-dcaa62e36522 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1605 microversion: 2.1 time: 1.026407 Aug 04 14:31:26.566423 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2734/5487] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:25 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1605 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:31:26.850144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-fe7817ee-9708-4593-8237-776a1104fbb8 req-2271f2fc-1a17-458f-b21d-31bb85a8cfdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a410b8cc-2988-4a53-ae6a-37d5e1da020f", "tag": "5f282554-8e5f-498e-9680-c3b06bea6479"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:31:26.926311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fe7817ee-9708-4593-8237-776a1104fbb8 req-2271f2fc-1a17-458f-b21d-31bb85a8cfdf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:26.927753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fe7817ee-9708-4593-8237-776a1104fbb8 req-2271f2fc-1a17-458f-b21d-31bb85a8cfdf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:26.990098 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fe7817ee-9708-4593-8237-776a1104fbb8 req-2271f2fc-1a17-458f-b21d-31bb85a8cfdf service nova] Creating event network-changed:5f282554-8e5f-498e-9680-c3b06bea6479 for instance a410b8cc-2988-4a53-ae6a-37d5e1da020f on n-h2-844627-10 Aug 04 14:31:27.016661 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-fe7817ee-9708-4593-8237-776a1104fbb8 req-2271f2fc-1a17-458f-b21d-31bb85a8cfdf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177174 Aug 04 14:31:27.030602 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2754/5488] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:31:27.580362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa323316-2da0-4c2f-ac25-972bf8e8b1a3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:27.581727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa323316-2da0-4c2f-ac25-972bf8e8b1a3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:27.600208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa323316-2da0-4c2f-ac25-972bf8e8b1a3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:27.603829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa323316-2da0-4c2f-ac25-972bf8e8b1a3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:27.606337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa323316-2da0-4c2f-ac25-972bf8e8b1a3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:27.611133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fa323316-2da0-4c2f-ac25-972bf8e8b1a3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:28.684040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa323316-2da0-4c2f-ac25-972bf8e8b1a3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:28.693639 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa323316-2da0-4c2f-ac25-972bf8e8b1a3 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1605 microversion: 2.1 time: 1.117523 Aug 04 14:31:28.704897 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2735/5489] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:27 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1605 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:31:29.774246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-58c8e4b6-5ee5-4b1c-8110-ad056e07818a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:29.776907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-58c8e4b6-5ee5-4b1c-8110-ad056e07818a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:29.812638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c8e4b6-5ee5-4b1c-8110-ad056e07818a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:29.819413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c8e4b6-5ee5-4b1c-8110-ad056e07818a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:29.827058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c8e4b6-5ee5-4b1c-8110-ad056e07818a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:29.831041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c8e4b6-5ee5-4b1c-8110-ad056e07818a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:30.476421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-417b3e3b-5759-4cb0-a0ec-e788630aef60 req-26027537-21c5-4299-8d3c-11f1d5e4d072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "addd5022-8377-4610-9ade-b675ce58fa12", "name": "network-vif-deleted", "tag": "cd61268b-6ead-4687-9fd7-d46e46182a42"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:31:30.516667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-417b3e3b-5759-4cb0-a0ec-e788630aef60 req-26027537-21c5-4299-8d3c-11f1d5e4d072 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:30.525913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-417b3e3b-5759-4cb0-a0ec-e788630aef60 req-26027537-21c5-4299-8d3c-11f1d5e4d072 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:30.541396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-58c8e4b6-5ee5-4b1c-8110-ad056e07818a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b231e5922ccb4e119b8254841c0fe86e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1974046389c4e9ebb504fef09c743e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:31:30.558295 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-417b3e3b-5759-4cb0-a0ec-e788630aef60 req-26027537-21c5-4299-8d3c-11f1d5e4d072 service nova] Creating event network-vif-deleted:cd61268b-6ead-4687-9fd7-d46e46182a42 for instance addd5022-8377-4610-9ade-b675ce58fa12 on n-h2-844627-10 Aug 04 14:31:30.560060 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-58c8e4b6-5ee5-4b1c-8110-ad056e07818a tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 200 len: 1605 microversion: 2.1 time: 0.805204 Aug 04 14:31:30.572907 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2755/5490] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:29 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 1605 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:31:30.602352 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-417b3e3b-5759-4cb0-a0ec-e788630aef60 req-26027537-21c5-4299-8d3c-11f1d5e4d072 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127502 Aug 04 14:31:30.604159 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2736/5491] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:31:31.627361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:31.629693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:31.735468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:31.739537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:31.742652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:31.747143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:31.781967 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] HTTP exception thrown: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Request method failure captured: Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 HTTP/1.1 Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69ZMdz-R8ZFGNszlpGRzrRbe3Sv4GTwCPHVMBYoTMMSBzSCzRruY-nTtcDQhWZfv69n9ZI9YUVJJUy3YrkOIMSMKRBbcfq0Avq6N1Lbm7x4FGZg27xgYnVefSQivD2SNrS3LwCO9rT_y5UyShAyCF_6ED9VCCY9VZDLv7qAgr4ZZokc Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "tempest-type-1681642770", "name": "tempest-service-757042601", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}] Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b231e5922ccb4e119b8254841c0fe86e Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'addd5022-8377-4610-9ade-b675ce58fa12'} Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:31.788213 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:31.794106 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:31:31.794106 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:31.794106 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:31:31.794106 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:31:31.794106 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:31:31.794106 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:31:31.794106 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:31:31.794106 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:31.794106 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:31.797884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Returning 404 to user: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:31:31.800248 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d7522979-de2a-436f-9e07-53b07375cbd2 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 404 len: 111 microversion: 2.1 time: 0.198914 Aug 04 14:31:31.803117 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2756/5492] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:31 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:31:31.819075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c7cf17d-95b9-4bf4-9a1a-d79553126e75 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '.version_select at 0x7f46f2f421f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:31.835095 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c7cf17d-95b9-4bf4-9a1a-d79553126e75 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [c3f3337f-5e3e-4dc2-90e4-1955cee99059] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 14:31:32.853897 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c7cf17d-95b9-4bf4-9a1a-d79553126e75 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [c3f3337f-5e3e-4dc2-90e4-1955cee99059] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 43736. Aug 04 14:31:32.927251 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c7cf17d-95b9-4bf4-9a1a-d79553126e75 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-477948563" status: 202 len: 0 microversion: 2.1 time: 1.116113 Aug 04 14:31:32.931255 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2737/5493] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 14:31:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-477948563 => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:31:41.858564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea72ebd5-99bb-4fae-91b7-a18e55f39b30 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:41.859514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ea72ebd5-99bb-4fae-91b7-a18e55f39b30 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:41.862426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:31:41.863341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:31:41.918913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea72ebd5-99bb-4fae-91b7-a18e55f39b30 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:41.920489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea72ebd5-99bb-4fae-91b7-a18e55f39b30 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:41.931070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea72ebd5-99bb-4fae-91b7-a18e55f39b30 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:41.932168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea72ebd5-99bb-4fae-91b7-a18e55f39b30 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:42.068773 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ea72ebd5-99bb-4fae-91b7-a18e55f39b30 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.214491 Aug 04 14:31:42.076548 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2757/5494] 10.222.0.66 () {58 vars in 1293 bytes} [Thu Aug 4 14:31:41 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f/os-server-password => generated 116 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:31:44.024009 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:31:44.024826 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 14:31:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:31:53.399467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:53.404131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:53.427508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=26 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:31:53.432162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:31:53.442566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:53.443426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:53.449671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:53.450530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:53.515571 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] HTTP exception thrown: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Request method failure captured: Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 HTTP/1.1 Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69ZMdz-R8ZFGNszlpGRzrRbe3Sv4GTwCPHVMBYoTMMSBzSCzRruY-nTtcDQhWZfv69n9ZI9YUVJJUy3YrkOIMSMKRBbcfq0Avq6N1Lbm7x4FGZg27xgYnVefSQivD2SNrS3LwCO9rT_y5UyShAyCF_6ED9VCCY9VZDLv7qAgr4ZZokc Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "tempest-type-1681642770", "name": "tempest-service-757042601", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}] Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b231e5922ccb4e119b8254841c0fe86e Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'addd5022-8377-4610-9ade-b675ce58fa12'} Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:31:53.519590 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.528423 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.534324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Returning 404 to user: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:31:53.536734 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-de330ae1-1db4-4de2-9682-a4ccc4667c2d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "DELETE /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 404 len: 111 microversion: 2.1 time: 0.144650 Aug 04 14:31:53.543059 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2738/5495] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:31:53 2022] DELETE /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:31:53.553745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:31:53.554820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: addd5022-8377-4610-9ade-b675ce58fa12] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:31:53.595450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:53.598963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:53.603194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:31:53.610800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:31:53.719841 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] HTTP exception thrown: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Request method failure captured: Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 HTTP/1.1 Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69ZMdz-R8ZFGNszlpGRzrRbe3Sv4GTwCPHVMBYoTMMSBzSCzRruY-nTtcDQhWZfv69n9ZI9YUVJJUy3YrkOIMSMKRBbcfq0Avq6N1Lbm7x4FGZg27xgYnVefSQivD2SNrS3LwCO9rT_y5UyShAyCF_6ED9VCCY9VZDLv7qAgr4ZZokc Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "tempest-type-1681642770", "name": "tempest-service-757042601", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}] Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b231e5922ccb4e119b8254841c0fe86e Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'addd5022-8377-4610-9ade-b675ce58fa12'} Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.738015 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.741848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:31:53.741848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.741848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:31:53.741848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:31:53.741848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:31:53.741848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:31:53.741848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:31:53.741848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. Aug 04 14:31:53.741848 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:31:53.743886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Returning 404 to user: Instance addd5022-8377-4610-9ade-b675ce58fa12 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:31:53.745614 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca772ece-7268-45fd-9b21-d8314070cedf tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12" status: 404 len: 111 microversion: 2.1 time: 0.200594 Aug 04 14:31:53.749496 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2758/5496] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:31:53 2022] GET /compute/v2.1/servers/addd5022-8377-4610-9ade-b675ce58fa12 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:32:02.398569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:02.401965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:32:02.465246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:32:02.467431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:32:02.472568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:32:02.475924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:32:02.555245 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] HTTP exception thrown: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Request method failure captured: Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 HTTP/1.1 Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69ZMdz-R8ZFGNszlpGRzrRbe3Sv4GTwCPHVMBYoTMMSBzSCzRruY-nTtcDQhWZfv69n9ZI9YUVJJUy3YrkOIMSMKRBbcfq0Avq6N1Lbm7x4FGZg27xgYnVefSQivD2SNrS3LwCO9rT_y5UyShAyCF_6ED9VCCY9VZDLv7qAgr4ZZokc Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "tempest-type-1681642770", "name": "tempest-service-757042601", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}] Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: b231e5922ccb4e119b8254841c0fe86e Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd11d60d0-a4c4-4d98-8a2a-d504dc959fd5'} Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:32:02.564182 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.568265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Returning 404 to user: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:32:02.571873 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a30bdf6d-45d4-4773-9743-e3c80765189d tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 404 len: 111 microversion: 2.1 time: 0.187544 Aug 04 14:32:02.576199 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2739/5497] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:32:02 2022] DELETE /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:32:02.583290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:02.584352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] [instance: d11d60d0-a4c4-4d98-8a2a-d504dc959fd5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:32:02.607156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:32:02.609358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:32:02.613609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:32:02.617105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:32:02.693437 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] HTTP exception thrown: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Request method failure captured: Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 HTTP/1.1 Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69ZMdz-R8ZFGNszlpGRzrRbe3Sv4GTwCPHVMBYoTMMSBzSCzRruY-nTtcDQhWZfv69n9ZI9YUVJJUy3YrkOIMSMKRBbcfq0Avq6N1Lbm7x4FGZg27xgYnVefSQivD2SNrS3LwCO9rT_y5UyShAyCF_6ED9VCCY9VZDLv7qAgr4ZZokc Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f1974046389c4e9ebb504fef09c743e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "tempest-type-1681642770", "name": "tempest-service-757042601", "endpoints": []}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f1974046389c4e9ebb504fef09c743e8"}]}] Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: f1974046389c4e9ebb504fef09c743e8 Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1974475919 Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: b231e5922ccb4e119b8254841c0fe86e Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-AttachVolumeTestJSON-1974475919-project Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'd11d60d0-a4c4-4d98-8a2a-d504dc959fd5'} Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.700743 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:32:02.705443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] Returning 404 to user: Instance d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:32:02.706453 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-da936398-56be-4409-aeba-f54dbf5f6865 tempest-AttachVolumeTestJSON-1974475919 tempest-AttachVolumeTestJSON-1974475919-project] 10.222.0.66 "GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5" status: 404 len: 111 microversion: 2.1 time: 0.126229 Aug 04 14:32:02.710519 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2759/5498] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:32:02 2022] GET /compute/v2.1/servers/d11d60d0-a4c4-4d98-8a2a-d504dc959fd5 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:32:24.652795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:32:24.659790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:32:24.984688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7f423480-3d08-4758-a06b-7f94f9460797 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Action: 'create', calling method: .version_select at 0x7f46f36bf5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-737299979", "metadata": {"Type": "work"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:32:25.678686 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7f423480-3d08-4758-a06b-7f94f9460797 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.059426 Aug 04 14:32:25.718486 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2740/5499] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Aug 4 14:32:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1085 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 14:32:25.720202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35d148e6-fa6c-42e9-ab48-5cdb32295860 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f3c469d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:25.764020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:32:25.766977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:32:25.877820 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-35d148e6-fa6c-42e9-ab48-5cdb32295860 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 352 microversion: 2.1 time: 0.166806 Aug 04 14:32:25.879030 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2760/5500] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:25 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:32:26.942135 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-720f9ae1-6078-4b07-8e64-def382532486 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f342c310>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:27.109006 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-720f9ae1-6078-4b07-8e64-def382532486 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 352 microversion: 2.1 time: 0.213463 Aug 04 14:32:27.110821 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2741/5501] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:26 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 352 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:32:28.162576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-112e204c-ab1b-4cd6-9b64-8eaf7eafad68 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f38d5550>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:28.339329 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-112e204c-ab1b-4cd6-9b64-8eaf7eafad68 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 352 microversion: 2.1 time: 0.217141 Aug 04 14:32:28.339978 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2761/5502] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:28 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 352 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:32:29.355150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1b293fa-32fe-442a-a2b7-9ea9222e63e3 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f342c700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:29.469355 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f1b293fa-32fe-442a-a2b7-9ea9222e63e3 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 353 microversion: 2.1 time: 0.118112 Aug 04 14:32:29.470661 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2742/5503] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:29 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:32:29.493733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-496492a7-9ab0-4dfa-bfbc-55a4753e592d tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f3cc4790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:29.589857 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-496492a7-9ab0-4dfa-bfbc-55a4753e592d tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 353 microversion: 2.1 time: 0.101124 Aug 04 14:32:29.590675 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2762/5504] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:29 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:32:29.615895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-92fa475c-25b8-492d-8b7b-7d5095acd57b tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f342c670>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:29.762581 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-92fa475c-25b8-492d-8b7b-7d5095acd57b tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 202 len: 0 microversion: 2.1 time: 0.152830 Aug 04 14:32:29.763502 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2743/5505] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 14:32:29 2022] DELETE /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:32:29.774219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-649c2a0a-6393-4864-a179-7e0b3c913f6d tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f47000ff4c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:29.912929 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-649c2a0a-6393-4864-a179-7e0b3c913f6d tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 352 microversion: 2.1 time: 0.143374 Aug 04 14:32:29.913737 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2763/5506] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:29 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 352 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:32:30.941861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-11ccff85-5f37-473e-8879-8332bb995b1b tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f2eadc10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:31.092315 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-11ccff85-5f37-473e-8879-8332bb995b1b tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 352 microversion: 2.1 time: 0.163658 Aug 04 14:32:31.093199 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2744/5507] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:30 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:32:32.112293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5721b05a-982a-46d9-a648-62c546165b08 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f38d5b80>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:32.232631 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5721b05a-982a-46d9-a648-62c546165b08 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 352 microversion: 2.1 time: 0.124991 Aug 04 14:32:32.236112 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2764/5508] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:32 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:32:33.256845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4f40d6c6-42a4-4a0f-bbfc-492956451e42 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f2ea0040>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:33.541344 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4f40d6c6-42a4-4a0f-bbfc-492956451e42 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 352 microversion: 2.1 time: 0.289864 Aug 04 14:32:33.542606 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2745/5509] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:33 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 352 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:32:34.564118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eeca2c42-664a-4262-8798-e5430087a7e4 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f3b26af0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:34.690785 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eeca2c42-664a-4262-8798-e5430087a7e4 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 200 len: 352 microversion: 2.1 time: 0.133920 Aug 04 14:32:34.691775 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2765/5510] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:34 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:32:35.722872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b9bb677-dffa-490b-8400-5d0e7bf45c53 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Calling method '.version_select at 0x7f46f342c280>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:32:35.817626 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-4b9bb677-dffa-490b-8400-5d0e7bf45c53 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] HTTP exception thrown: Volume c1f93106-6143-4622-b2d5-65298dd31f25 could not be found. Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b9bb677-dffa-490b-8400-5d0e7bf45c53 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Request method failure captured: Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 HTTP/1.1 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69h4ydpp_Z-W6oJrTgC6diL8w5wtLglBLql2dt5wRg_AzI_dUILnJU_bCgtKJG5mtBTZFwrUiMKc0bU153fch3V_hqEl_uyGuBNw09XbwIgZWvr56Y9k-CMfNhp7e0EK9_alqy8yeX94cTsH5rMLwV_7xoCm87a6_kEl9Skx0AyOLxU Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 1a44a14c973d44cc94a07a756df2aed7 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesGetTestJSON-1734107391 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1a44a14c973d44cc94a07a756df2aed7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1a44a14c973d44cc94a07a756df2aed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1a44a14c973d44cc94a07a756df2aed7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1a44a14c973d44cc94a07a756df2aed7"}]}] Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesGetTestJSON-1734107391 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 1a44a14c973d44cc94a07a756df2aed7 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesGetTestJSON-1734107391 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesGetTestJSON-1734107391-project Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 54065012c1ae4e08a1704c7e3383a1f4 Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesGetTestJSON-1734107391-project Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: method: Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: exception: Volume c1f93106-6143-4622-b2d5-65298dd31f25 could not be found. Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'c1f93106-6143-4622-b2d5-65298dd31f25'} Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1f93106-6143-4622-b2d5-65298dd31f25 could not be found. (HTTP 404) (Request-ID: req-ba0b9dbb-486b-4fbd-95ec-590afc600bae) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 14:32:35.821648 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1f93106-6143-4622-b2d5-65298dd31f25 could not be found. Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1f93106-6143-4622-b2d5-65298dd31f25 could not be found. Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1f93106-6143-4622-b2d5-65298dd31f25 could not be found. Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4b9bb677-dffa-490b-8400-5d0e7bf45c53 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] Returning 404 to user: Volume c1f93106-6143-4622-b2d5-65298dd31f25 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:32:35.827840 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4b9bb677-dffa-490b-8400-5d0e7bf45c53 tempest-VolumesGetTestJSON-1734107391 tempest-VolumesGetTestJSON-1734107391-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25" status: 404 len: 109 microversion: 2.1 time: 0.117296 Aug 04 14:32:35.832443 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2746/5511] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 14:32:35 2022] GET /compute/v2.1/os-volumes/c1f93106-6143-4622-b2d5-65298dd31f25 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:33:23.564088 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:33:23.564938 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:33:23.724945 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:33:23.725161 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:33:39.130064 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:33:39.130772 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 14:33:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:33:44.431745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ddbac843-5504-4bfa-bcae-f69427a86e99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'create', calling method: .version_select at 0x7f46f3b268b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1992561853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/NpdSHrCQsC9/YNrFKRBMlhSNHFj3d0v3CIWSgqgbx/qHbOIbG7a/6pVMbnYsDs47onjh2pa4L218mKF+AANXE81AadgVUqW5/oTJ1jRYHguRv0QU3xzWEesSX0tS7uQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:33:44.462200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ddbac843-5504-4bfa-bcae-f69427a86e99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:33:44.470918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ddbac843-5504-4bfa-bcae-f69427a86e99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for user 95e5002f80224b4a804be717d5bd9d2c and project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:33:44.544972 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ddbac843-5504-4bfa-bcae-f69427a86e99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.925761 Aug 04 14:33:44.546799 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2766/5512] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:33:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:33:51.744179 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:33:51.745573 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:33:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:34:23.521503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-650431174", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "fe12bb62-43e9-4944-b364-b04224c96e57"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1992561853", "security_groups": [{"name": "tempest-secgroup-smoke-826777571"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:34:24.671509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] validate_networks() for [('fe12bb62-43e9-4944-b364-b04224c96e57', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:34:25.975098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:34:25.976256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:34:25.976256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:34:25.976670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:34:25.977404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:34:26.012585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:26.013789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:26.015481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:26.016365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:26.074804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:34:26.082464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for user 95e5002f80224b4a804be717d5bd9d2c and project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:34:26.118681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:34:26.121910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:34:26.279288 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-65017890-84b6-43b1-ad45-cc5b3acee62b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.772684 Aug 04 14:34:26.280303 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2747/5513] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:34:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 2775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:34:26.299836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ad98f3dd-8134-4444-b10c-c353feb7bf3c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:26.301532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ad98f3dd-8134-4444-b10c-c353feb7bf3c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:26.327234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:34:26.332765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:34:26.932600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ad98f3dd-8134-4444-b10c-c353feb7bf3c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:26.966541 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ad98f3dd-8134-4444-b10c-c353feb7bf3c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1266 microversion: 2.1 time: 0.676866 Aug 04 14:34:26.970530 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2767/5514] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:26 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1266 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:28.004827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a07b4920-9c1d-4857-adc4-4adf651b67e8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:28.005681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a07b4920-9c1d-4857-adc4-4adf651b67e8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:28.082702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a07b4920-9c1d-4857-adc4-4adf651b67e8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:28.092283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a07b4920-9c1d-4857-adc4-4adf651b67e8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:28.093437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a07b4920-9c1d-4857-adc4-4adf651b67e8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:28.093905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a07b4920-9c1d-4857-adc4-4adf651b67e8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:28.691223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a07b4920-9c1d-4857-adc4-4adf651b67e8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:28.714623 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a07b4920-9c1d-4857-adc4-4adf651b67e8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1270 microversion: 2.1 time: 0.721943 Aug 04 14:34:28.716703 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2748/5515] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:27 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1270 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:29.765431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b055d283-a3c2-4d96-b7fb-9cb982fd551a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:29.766541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b055d283-a3c2-4d96-b7fb-9cb982fd551a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:29.821680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b055d283-a3c2-4d96-b7fb-9cb982fd551a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:29.822496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b055d283-a3c2-4d96-b7fb-9cb982fd551a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:29.823953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b055d283-a3c2-4d96-b7fb-9cb982fd551a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:29.824729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b055d283-a3c2-4d96-b7fb-9cb982fd551a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:30.597533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b055d283-a3c2-4d96-b7fb-9cb982fd551a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:30.638249 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b055d283-a3c2-4d96-b7fb-9cb982fd551a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1318 microversion: 2.1 time: 0.897334 Aug 04 14:34:30.639457 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2768/5516] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:29 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1318 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:31.683032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-60cc9aa8-caf4-4445-99ff-4002fa45b922 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:31.685404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-60cc9aa8-caf4-4445-99ff-4002fa45b922 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:31.699511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60cc9aa8-caf4-4445-99ff-4002fa45b922 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:31.702597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60cc9aa8-caf4-4445-99ff-4002fa45b922 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:31.707556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60cc9aa8-caf4-4445-99ff-4002fa45b922 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:31.708472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60cc9aa8-caf4-4445-99ff-4002fa45b922 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:32.271520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-60cc9aa8-caf4-4445-99ff-4002fa45b922 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:32.283221 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-60cc9aa8-caf4-4445-99ff-4002fa45b922 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1324 microversion: 2.1 time: 0.606659 Aug 04 14:34:32.290514 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2749/5517] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:31 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1324 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:33.333392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca46969e-9833-4d0f-a88f-84e94f8386b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:33.334856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ca46969e-9833-4d0f-a88f-84e94f8386b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:33.347987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca46969e-9833-4d0f-a88f-84e94f8386b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:33.348770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca46969e-9833-4d0f-a88f-84e94f8386b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:33.353227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca46969e-9833-4d0f-a88f-84e94f8386b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:33.353780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca46969e-9833-4d0f-a88f-84e94f8386b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:33.540002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ca46969e-9833-4d0f-a88f-84e94f8386b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:33.559912 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca46969e-9833-4d0f-a88f-84e94f8386b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1324 microversion: 2.1 time: 0.230235 Aug 04 14:34:33.602089 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2769/5518] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:33 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:34:34.603652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1b9b7fed-8a8b-4eae-a1f8-5073fe137a84 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:34.604313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1b9b7fed-8a8b-4eae-a1f8-5073fe137a84 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:34.618827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b9b7fed-8a8b-4eae-a1f8-5073fe137a84 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:34.619504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b9b7fed-8a8b-4eae-a1f8-5073fe137a84 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:34.620679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b9b7fed-8a8b-4eae-a1f8-5073fe137a84 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:34.621394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1b9b7fed-8a8b-4eae-a1f8-5073fe137a84 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:34.792476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1b9b7fed-8a8b-4eae-a1f8-5073fe137a84 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:34.811229 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1b9b7fed-8a8b-4eae-a1f8-5073fe137a84 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1324 microversion: 2.1 time: 0.212049 Aug 04 14:34:34.812435 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2750/5519] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:34 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:35.844745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c3c8bc74-07b7-465b-868d-bfb0ae7e964c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:35.846270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c3c8bc74-07b7-465b-868d-bfb0ae7e964c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:35.875947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3c8bc74-07b7-465b-868d-bfb0ae7e964c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:35.876763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3c8bc74-07b7-465b-868d-bfb0ae7e964c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:35.881904 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3c8bc74-07b7-465b-868d-bfb0ae7e964c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:35.885682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c3c8bc74-07b7-465b-868d-bfb0ae7e964c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:36.961522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:34:37.329839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c3c8bc74-07b7-465b-868d-bfb0ae7e964c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:37.345850 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c3c8bc74-07b7-465b-868d-bfb0ae7e964c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1391 microversion: 2.1 time: 1.515941 Aug 04 14:34:37.348336 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2770/5520] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:35 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1391 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:38.376134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c130ec66-6ebd-4865-a334-4aec6d9e5891 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:38.378303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c130ec66-6ebd-4865-a334-4aec6d9e5891 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:38.384144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:34:38.385449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:34:38.398809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c130ec66-6ebd-4865-a334-4aec6d9e5891 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:38.398809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c130ec66-6ebd-4865-a334-4aec6d9e5891 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:38.398809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c130ec66-6ebd-4865-a334-4aec6d9e5891 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:38.402489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c130ec66-6ebd-4865-a334-4aec6d9e5891 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:38.914788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c130ec66-6ebd-4865-a334-4aec6d9e5891 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:38.938255 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c130ec66-6ebd-4865-a334-4aec6d9e5891 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1391 microversion: 2.1 time: 0.567063 Aug 04 14:34:38.939199 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2751/5521] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:38 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1391 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:39.979750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-99932980-737d-47b5-8fb9-bee4e5dce917 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:39.980827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-99932980-737d-47b5-8fb9-bee4e5dce917 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:40.014555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99932980-737d-47b5-8fb9-bee4e5dce917 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:40.015439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99932980-737d-47b5-8fb9-bee4e5dce917 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:40.021196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99932980-737d-47b5-8fb9-bee4e5dce917 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:40.025493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99932980-737d-47b5-8fb9-bee4e5dce917 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:40.042276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-be80c4fc-34d1-4811-8edc-1d27e66a2fe5 req-820f587c-5811-4b70-810f-bfca0bb58a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e8e313-b31e-4e62-aa90-ebe79c9d780a", "tag": "2aa1d143-33e8-4392-9853-c5ac433d46f0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:34:40.112506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-be80c4fc-34d1-4811-8edc-1d27e66a2fe5 req-820f587c-5811-4b70-810f-bfca0bb58a24 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:40.113595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-be80c4fc-34d1-4811-8edc-1d27e66a2fe5 req-820f587c-5811-4b70-810f-bfca0bb58a24 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:40.204429 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-be80c4fc-34d1-4811-8edc-1d27e66a2fe5 req-820f587c-5811-4b70-810f-bfca0bb58a24 service nova] Creating event network-changed:2aa1d143-33e8-4392-9853-c5ac433d46f0 for instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a on n-h1-844627-10 Aug 04 14:34:40.230258 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-be80c4fc-34d1-4811-8edc-1d27e66a2fe5 req-820f587c-5811-4b70-810f-bfca0bb58a24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.716589 Aug 04 14:34:40.238822 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2771/5522] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:34:41.026407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-99932980-737d-47b5-8fb9-bee4e5dce917 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:41.069084 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-99932980-737d-47b5-8fb9-bee4e5dce917 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1391 microversion: 2.1 time: 1.097754 Aug 04 14:34:41.074115 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2752/5523] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:39 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1391 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:42.096207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ce9e1f5b-19b7-44cd-a641-6a351092bbcc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:42.097984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ce9e1f5b-19b7-44cd-a641-6a351092bbcc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:42.111613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce9e1f5b-19b7-44cd-a641-6a351092bbcc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:42.113915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce9e1f5b-19b7-44cd-a641-6a351092bbcc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:42.114817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce9e1f5b-19b7-44cd-a641-6a351092bbcc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:42.115328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce9e1f5b-19b7-44cd-a641-6a351092bbcc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:43.165047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ce9e1f5b-19b7-44cd-a641-6a351092bbcc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:43.198432 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ce9e1f5b-19b7-44cd-a641-6a351092bbcc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1391 microversion: 2.1 time: 1.106511 Aug 04 14:34:43.213855 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2772/5524] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:42 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1391 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:34:44.248191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0017f58f-65ae-4d1e-b085-1b717ed8e714 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:44.258618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0017f58f-65ae-4d1e-b085-1b717ed8e714 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:44.332078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0017f58f-65ae-4d1e-b085-1b717ed8e714 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:44.332988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0017f58f-65ae-4d1e-b085-1b717ed8e714 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:44.342533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0017f58f-65ae-4d1e-b085-1b717ed8e714 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:44.347299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0017f58f-65ae-4d1e-b085-1b717ed8e714 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:45.914937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0017f58f-65ae-4d1e-b085-1b717ed8e714 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:45.945705 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0017f58f-65ae-4d1e-b085-1b717ed8e714 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1391 microversion: 2.1 time: 1.711253 Aug 04 14:34:45.950630 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2753/5525] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:44 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1391 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:46.989448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18971205-00de-488f-9579-32f076d8576d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:46.991012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-18971205-00de-488f-9579-32f076d8576d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:47.008329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18971205-00de-488f-9579-32f076d8576d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:47.009188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18971205-00de-488f-9579-32f076d8576d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:47.019944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18971205-00de-488f-9579-32f076d8576d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:47.027852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18971205-00de-488f-9579-32f076d8576d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:47.177410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-4537abe0-c3e2-4361-ad1a-3dd10e4ecce3 req-ebbe089e-c292-406d-aa61-39692a324ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e8e313-b31e-4e62-aa90-ebe79c9d780a", "name": "network-vif-plugged", "status": "completed", "tag": "2aa1d143-33e8-4392-9853-c5ac433d46f0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:34:47.213324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4537abe0-c3e2-4361-ad1a-3dd10e4ecce3 req-ebbe089e-c292-406d-aa61-39692a324ff7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:47.214552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4537abe0-c3e2-4361-ad1a-3dd10e4ecce3 req-ebbe089e-c292-406d-aa61-39692a324ff7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:47.263250 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-4537abe0-c3e2-4361-ad1a-3dd10e4ecce3 req-ebbe089e-c292-406d-aa61-39692a324ff7 service nova] Creating event network-vif-plugged:2aa1d143-33e8-4392-9853-c5ac433d46f0 for instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a on n-h1-844627-10 Aug 04 14:34:47.277775 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-4537abe0-c3e2-4361-ad1a-3dd10e4ecce3 req-ebbe089e-c292-406d-aa61-39692a324ff7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104043 Aug 04 14:34:47.281748 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2754/5526] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:34:47.851645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-18971205-00de-488f-9579-32f076d8576d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:47.919172 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18971205-00de-488f-9579-32f076d8576d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1391 microversion: 2.1 time: 0.946844 Aug 04 14:34:47.920990 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2773/5527] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:46 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1391 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:49.003910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42667e24-8389-412d-bd9f-23adf05934d4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:49.006599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-42667e24-8389-412d-bd9f-23adf05934d4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:49.033351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42667e24-8389-412d-bd9f-23adf05934d4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:49.035120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42667e24-8389-412d-bd9f-23adf05934d4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:49.037228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42667e24-8389-412d-bd9f-23adf05934d4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:49.039238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42667e24-8389-412d-bd9f-23adf05934d4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:49.635714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-42667e24-8389-412d-bd9f-23adf05934d4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:49.652598 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-42667e24-8389-412d-bd9f-23adf05934d4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1391 microversion: 2.1 time: 0.703866 Aug 04 14:34:49.654019 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2755/5528] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:48 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1391 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:50.682936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-44aaa216-039b-4f18-adf4-243d4f630594 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:50.689701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-44aaa216-039b-4f18-adf4-243d4f630594 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:50.728025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44aaa216-039b-4f18-adf4-243d4f630594 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:50.731828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44aaa216-039b-4f18-adf4-243d4f630594 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:50.739924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44aaa216-039b-4f18-adf4-243d4f630594 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:50.740919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-44aaa216-039b-4f18-adf4-243d4f630594 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:52.301865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-44aaa216-039b-4f18-adf4-243d4f630594 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:52.344916 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-44aaa216-039b-4f18-adf4-243d4f630594 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1562 microversion: 2.1 time: 1.673131 Aug 04 14:34:52.351752 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2774/5529] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:50 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1562 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:34:52.407879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4860f34c-ec2a-4314-b58a-8ff4b162afb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:34:52.408706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4860f34c-ec2a-4314-b58a-8ff4b162afb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:34:52.477403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4860f34c-ec2a-4314-b58a-8ff4b162afb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:52.477872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4860f34c-ec2a-4314-b58a-8ff4b162afb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:52.478887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4860f34c-ec2a-4314-b58a-8ff4b162afb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:34:52.479412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4860f34c-ec2a-4314-b58a-8ff4b162afb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:34:53.600504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4860f34c-ec2a-4314-b58a-8ff4b162afb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:34:53.613751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=51 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:34:53.624390 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4860f34c-ec2a-4314-b58a-8ff4b162afb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1562 microversion: 2.1 time: 1.223089 Aug 04 14:34:53.627884 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2756/5530] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:34:52 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1562 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:01.871658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1795918209", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "60857f7f-7268-426d-929c-853eb9741a18"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:35:01.910273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=18 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:02.071276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] validate_networks() for [('60857f7f-7268-426d-929c-853eb9741a18', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:35:02.334830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=38 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:03.129329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2bf7748a-34c0-4f21-879f-69593865cbea tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:03.130179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2bf7748a-34c0-4f21-879f-69593865cbea tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:03.140342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:03.160205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bf7748a-34c0-4f21-879f-69593865cbea tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:03.163989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bf7748a-34c0-4f21-879f-69593865cbea tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:03.166770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bf7748a-34c0-4f21-879f-69593865cbea tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:03.169816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bf7748a-34c0-4f21-879f-69593865cbea tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:04.171861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2bf7748a-34c0-4f21-879f-69593865cbea tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:04.210834 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2bf7748a-34c0-4f21-879f-69593865cbea tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1562 microversion: 2.1 time: 1.085914 Aug 04 14:35:04.217334 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2757/5531] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:03 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1562 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:35:04.236777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cc2833e3-0754-42fd-9f6f-55e2d5b8e135 req-2a0ce49b-2973-4142-aa0c-32d78c9c77bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e8e313-b31e-4e62-aa90-ebe79c9d780a", "tag": "2aa1d143-33e8-4392-9853-c5ac433d46f0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:35:04.317843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cc2833e3-0754-42fd-9f6f-55e2d5b8e135 req-2a0ce49b-2973-4142-aa0c-32d78c9c77bd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:04.317843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cc2833e3-0754-42fd-9f6f-55e2d5b8e135 req-2a0ce49b-2973-4142-aa0c-32d78c9c77bd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:04.367441 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cc2833e3-0754-42fd-9f6f-55e2d5b8e135 req-2a0ce49b-2973-4142-aa0c-32d78c9c77bd service nova] Creating event network-changed:2aa1d143-33e8-4392-9853-c5ac433d46f0 for instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a on n-h1-844627-10 Aug 04 14:35:04.418454 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cc2833e3-0754-42fd-9f6f-55e2d5b8e135 req-2a0ce49b-2973-4142-aa0c-32d78c9c77bd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198908 Aug 04 14:35:04.419596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2758/5532] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:35:05.896023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:35:05.896739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:35:05.899958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:35:05.900893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:35:05.902023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:35:05.954022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:05.957136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:05.960333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:05.962248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:06.031405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Getting quotas for project d7a554896e8947b99bf5fc6b0cc5dd4e. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:35:06.054746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Getting quotas for user 68a7da502a2546e1a86028b982766fd0 and project d7a554896e8947b99bf5fc6b0cc5dd4e. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:35:06.102738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:35:06.115022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:35:06.299505 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b9ef5e08-8a0d-43a4-bab4-e27acab3c55c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.435578 Aug 04 14:35:06.301288 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2775/5533] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:35:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:35:06.326952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e94795fa-068f-48fc-b46e-5faed671e838 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:06.329471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e94795fa-068f-48fc-b46e-5faed671e838 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:06.830010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e94795fa-068f-48fc-b46e-5faed671e838 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:06.839658 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e94795fa-068f-48fc-b46e-5faed671e838 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1219 microversion: 2.1 time: 0.522960 Aug 04 14:35:06.858600 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2759/5534] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:06 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1219 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:07.870573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-12d656c6-7b15-42f9-8090-86fd642af4eb tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:07.871422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-12d656c6-7b15-42f9-8090-86fd642af4eb tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:08.325193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-12d656c6-7b15-42f9-8090-86fd642af4eb tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:08.341862 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-12d656c6-7b15-42f9-8090-86fd642af4eb tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1219 microversion: 2.1 time: 0.467207 Aug 04 14:35:08.356913 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2776/5535] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:07 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1219 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:09.387944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae2aafb6-e772-4093-8c43-bfb1b1d256af tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:09.402161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ae2aafb6-e772-4093-8c43-bfb1b1d256af tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:09.442790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae2aafb6-e772-4093-8c43-bfb1b1d256af tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:09.448121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae2aafb6-e772-4093-8c43-bfb1b1d256af tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:09.457105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae2aafb6-e772-4093-8c43-bfb1b1d256af tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:09.457105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae2aafb6-e772-4093-8c43-bfb1b1d256af tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:10.119737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae2aafb6-e772-4093-8c43-bfb1b1d256af tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:10.139618 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae2aafb6-e772-4093-8c43-bfb1b1d256af tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1279 microversion: 2.1 time: 0.764224 Aug 04 14:35:10.140539 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2760/5536] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:09 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1279 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:11.180752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d21d032-0de6-4b90-9f87-e660666e970c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:11.182737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d21d032-0de6-4b90-9f87-e660666e970c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:11.195929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d21d032-0de6-4b90-9f87-e660666e970c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:11.197070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d21d032-0de6-4b90-9f87-e660666e970c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:11.198310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d21d032-0de6-4b90-9f87-e660666e970c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:11.198966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d21d032-0de6-4b90-9f87-e660666e970c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:11.454535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5d21d032-0de6-4b90-9f87-e660666e970c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:11.463984 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d21d032-0de6-4b90-9f87-e660666e970c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1277 microversion: 2.1 time: 0.289539 Aug 04 14:35:11.465534 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2777/5537] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:11 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1277 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:12.510570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6871f09f-25e3-4e98-9d17-8a060d20eaf2 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:12.516454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6871f09f-25e3-4e98-9d17-8a060d20eaf2 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:12.547066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6871f09f-25e3-4e98-9d17-8a060d20eaf2 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:12.548470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6871f09f-25e3-4e98-9d17-8a060d20eaf2 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:12.550820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6871f09f-25e3-4e98-9d17-8a060d20eaf2 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:12.557092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6871f09f-25e3-4e98-9d17-8a060d20eaf2 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:12.814501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6871f09f-25e3-4e98-9d17-8a060d20eaf2 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:12.833020 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6871f09f-25e3-4e98-9d17-8a060d20eaf2 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1277 microversion: 2.1 time: 0.329423 Aug 04 14:35:12.834512 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2761/5538] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:12 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1277 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:13.876163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a95373f4-5618-4d8d-937f-eeed39d624e6 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:13.886344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a95373f4-5618-4d8d-937f-eeed39d624e6 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:13.910185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a95373f4-5618-4d8d-937f-eeed39d624e6 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:13.911131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a95373f4-5618-4d8d-937f-eeed39d624e6 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:13.914469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a95373f4-5618-4d8d-937f-eeed39d624e6 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:13.916353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a95373f4-5618-4d8d-937f-eeed39d624e6 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:14.615402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a95373f4-5618-4d8d-937f-eeed39d624e6 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:14.631653 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a95373f4-5618-4d8d-937f-eeed39d624e6 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1319 microversion: 2.1 time: 0.761598 Aug 04 14:35:14.632993 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2778/5539] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:13 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:15.670131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-056e0693-3b02-4599-baac-6566a5920ac5 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:15.671047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-056e0693-3b02-4599-baac-6566a5920ac5 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:15.696281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-056e0693-3b02-4599-baac-6566a5920ac5 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:15.697182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-056e0693-3b02-4599-baac-6566a5920ac5 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:15.698434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-056e0693-3b02-4599-baac-6566a5920ac5 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:15.699193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-056e0693-3b02-4599-baac-6566a5920ac5 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:16.453065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-056e0693-3b02-4599-baac-6566a5920ac5 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:16.464013 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-056e0693-3b02-4599-baac-6566a5920ac5 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1319 microversion: 2.1 time: 0.797777 Aug 04 14:35:16.468932 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2762/5540] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:15 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1319 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:35:16.486891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-9888ea22-d324-47c3-b571-c91e858edcff req-11a3ab5b-703b-4dab-839b-d00531749759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac", "tag": "db4636cb-121d-4b16-af44-8bb1ca659006"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:35:16.507665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:16.509812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9888ea22-d324-47c3-b571-c91e858edcff req-11a3ab5b-703b-4dab-839b-d00531749759 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:16.510223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9888ea22-d324-47c3-b571-c91e858edcff req-11a3ab5b-703b-4dab-839b-d00531749759 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:16.540550 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9888ea22-d324-47c3-b571-c91e858edcff req-11a3ab5b-703b-4dab-839b-d00531749759 service nova] Creating event network-changed:db4636cb-121d-4b16-af44-8bb1ca659006 for instance 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac on n-h2-844627-10 Aug 04 14:35:16.566686 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-9888ea22-d324-47c3-b571-c91e858edcff req-11a3ab5b-703b-4dab-839b-d00531749759 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081058 Aug 04 14:35:16.567786 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2779/5541] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:35:17.489937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-964d00e9-2018-4074-a6cc-2c0f9d3a61b7 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:17.492050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-964d00e9-2018-4074-a6cc-2c0f9d3a61b7 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:17.499434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:17.523747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-964d00e9-2018-4074-a6cc-2c0f9d3a61b7 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:17.530411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-964d00e9-2018-4074-a6cc-2c0f9d3a61b7 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:17.532293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-964d00e9-2018-4074-a6cc-2c0f9d3a61b7 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:17.535928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-964d00e9-2018-4074-a6cc-2c0f9d3a61b7 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:17.986659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-964d00e9-2018-4074-a6cc-2c0f9d3a61b7 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:17.998646 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-964d00e9-2018-4074-a6cc-2c0f9d3a61b7 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1319 microversion: 2.1 time: 0.513401 Aug 04 14:35:18.002052 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2763/5542] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:17 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:19.023160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:19.031684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c6734b80-3765-4845-9282-75a14cec7e96 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:19.034911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c6734b80-3765-4845-9282-75a14cec7e96 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:19.053803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6734b80-3765-4845-9282-75a14cec7e96 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:19.054550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6734b80-3765-4845-9282-75a14cec7e96 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:19.055872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6734b80-3765-4845-9282-75a14cec7e96 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:19.056548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6734b80-3765-4845-9282-75a14cec7e96 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:19.707762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c6734b80-3765-4845-9282-75a14cec7e96 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:19.722434 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c6734b80-3765-4845-9282-75a14cec7e96 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1319 microversion: 2.1 time: 0.701381 Aug 04 14:35:19.727290 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2780/5543] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:19 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1319 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:20.770132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3c32511-41fd-4790-852b-5a2bdcc0c053 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:20.771482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b3c32511-41fd-4790-852b-5a2bdcc0c053 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:20.802799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3c32511-41fd-4790-852b-5a2bdcc0c053 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:20.803274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3c32511-41fd-4790-852b-5a2bdcc0c053 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:20.807837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3c32511-41fd-4790-852b-5a2bdcc0c053 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:20.808298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3c32511-41fd-4790-852b-5a2bdcc0c053 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:21.601541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b3c32511-41fd-4790-852b-5a2bdcc0c053 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:21.643852 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3c32511-41fd-4790-852b-5a2bdcc0c053 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1319 microversion: 2.1 time: 0.878661 Aug 04 14:35:21.656075 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2764/5544] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:20 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1319 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:22.684359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f2129891-6946-4df7-a333-ed6f9d91f42f tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:22.685470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f2129891-6946-4df7-a333-ed6f9d91f42f tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:22.716053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2129891-6946-4df7-a333-ed6f9d91f42f tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:22.718289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2129891-6946-4df7-a333-ed6f9d91f42f tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:22.721755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2129891-6946-4df7-a333-ed6f9d91f42f tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:22.726465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f2129891-6946-4df7-a333-ed6f9d91f42f tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:23.185900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f2129891-6946-4df7-a333-ed6f9d91f42f tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:23.207796 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f2129891-6946-4df7-a333-ed6f9d91f42f tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1319 microversion: 2.1 time: 0.531156 Aug 04 14:35:23.230978 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2781/5545] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:22 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1319 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:24.257569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f3db31e9-a4f8-438b-a34f-e49ec8870a3c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:24.259156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f3db31e9-a4f8-438b-a34f-e49ec8870a3c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:24.279755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3db31e9-a4f8-438b-a34f-e49ec8870a3c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:24.280766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3db31e9-a4f8-438b-a34f-e49ec8870a3c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:24.282824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3db31e9-a4f8-438b-a34f-e49ec8870a3c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:24.284167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3db31e9-a4f8-438b-a34f-e49ec8870a3c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:25.084169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f6d76339-efec-4207-9125-d368484bd4e7 req-d925db5f-a8be-4497-bbaa-f9ab32ed3f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac", "name": "network-vif-plugged", "status": "completed", "tag": "db4636cb-121d-4b16-af44-8bb1ca659006"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:35:25.135012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f6d76339-efec-4207-9125-d368484bd4e7 req-d925db5f-a8be-4497-bbaa-f9ab32ed3f0b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:25.135794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f6d76339-efec-4207-9125-d368484bd4e7 req-d925db5f-a8be-4497-bbaa-f9ab32ed3f0b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:25.166958 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f6d76339-efec-4207-9125-d368484bd4e7 req-d925db5f-a8be-4497-bbaa-f9ab32ed3f0b service nova] Creating event network-vif-plugged:db4636cb-121d-4b16-af44-8bb1ca659006 for instance 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac on n-h2-844627-10 Aug 04 14:35:25.185818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f3db31e9-a4f8-438b-a34f-e49ec8870a3c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:25.223023 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f6d76339-efec-4207-9125-d368484bd4e7 req-d925db5f-a8be-4497-bbaa-f9ab32ed3f0b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130428 Aug 04 14:35:25.224304 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2782/5546] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:35:25.248100 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f3db31e9-a4f8-438b-a34f-e49ec8870a3c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1319 microversion: 2.1 time: 0.994586 Aug 04 14:35:25.266194 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2765/5547] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:24 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1319 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:25.596318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c7ee1c3c-e65d-4d03-8e0d-7599a2d1ca49 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:35:25.601061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c7ee1c3c-e65d-4d03-8e0d-7599a2d1ca49 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:25.665016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7ee1c3c-e65d-4d03-8e0d-7599a2d1ca49 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:25.665805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7ee1c3c-e65d-4d03-8e0d-7599a2d1ca49 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:25.667405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7ee1c3c-e65d-4d03-8e0d-7599a2d1ca49 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:25.669795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7ee1c3c-e65d-4d03-8e0d-7599a2d1ca49 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:25.904612 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c7ee1c3c-e65d-4d03-8e0d-7599a2d1ca49 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action" status: 200 len: 24568 microversion: 2.1 time: 0.314659 Aug 04 14:35:25.910478 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2783/5548] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:35:25 2022] POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action => generated 24568 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:35:26.301234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-679a658a-4511-4a48-85a7-e4b778395831 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:26.302512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-679a658a-4511-4a48-85a7-e4b778395831 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:26.319587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-679a658a-4511-4a48-85a7-e4b778395831 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:26.320707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-679a658a-4511-4a48-85a7-e4b778395831 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:26.323160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-679a658a-4511-4a48-85a7-e4b778395831 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:26.323858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-679a658a-4511-4a48-85a7-e4b778395831 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:26.676184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-679a658a-4511-4a48-85a7-e4b778395831 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:26.691745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-679a658a-4511-4a48-85a7-e4b778395831 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1319 microversion: 2.1 time: 0.394990 Aug 04 14:35:26.692912 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2766/5549] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:26 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:27.729960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d473c64-3cc0-457e-93ea-5802424e4c22 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:27.732221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d473c64-3cc0-457e-93ea-5802424e4c22 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:27.744809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d473c64-3cc0-457e-93ea-5802424e4c22 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:27.745949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d473c64-3cc0-457e-93ea-5802424e4c22 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:27.747012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d473c64-3cc0-457e-93ea-5802424e4c22 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:27.747686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d473c64-3cc0-457e-93ea-5802424e4c22 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:28.664548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5d473c64-3cc0-457e-93ea-5802424e4c22 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:28.676662 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d473c64-3cc0-457e-93ea-5802424e4c22 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1509 microversion: 2.1 time: 0.952511 Aug 04 14:35:28.679633 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2784/5550] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:27 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1509 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:35:45.558673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=22 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:45.560142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=51 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:46.291916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4c022566-dd58-4609-b61b-a44af79bb0f9 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:46.294083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c022566-dd58-4609-b61b-a44af79bb0f9 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:46.307757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c022566-dd58-4609-b61b-a44af79bb0f9 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:46.308924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c022566-dd58-4609-b61b-a44af79bb0f9 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:46.310709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c022566-dd58-4609-b61b-a44af79bb0f9 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:46.311664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c022566-dd58-4609-b61b-a44af79bb0f9 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:46.423209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c022566-dd58-4609-b61b-a44af79bb0f9 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:35:46.871831 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4c022566-dd58-4609-b61b-a44af79bb0f9 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 204 len: 0 microversion: 2.1 time: 1.321657 Aug 04 14:35:46.875829 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2767/5551] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:35:45 2022] DELETE /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 0 bytes in 1324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:35:46.883595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4e7d4404-b0f1-4fe1-af09-ec7259b8729d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:46.884838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4e7d4404-b0f1-4fe1-af09-ec7259b8729d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:46.887892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:46.892052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=40 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:35:46.920307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e7d4404-b0f1-4fe1-af09-ec7259b8729d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:46.925512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e7d4404-b0f1-4fe1-af09-ec7259b8729d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:46.926619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e7d4404-b0f1-4fe1-af09-ec7259b8729d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:46.927073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e7d4404-b0f1-4fe1-af09-ec7259b8729d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:48.410001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4e7d4404-b0f1-4fe1-af09-ec7259b8729d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:48.428690 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4e7d4404-b0f1-4fe1-af09-ec7259b8729d tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1732 microversion: 2.1 time: 1.550626 Aug 04 14:35:48.447616 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2785/5552] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:46 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1732 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:49.455901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-893e44a1-f428-4532-8016-f5840e228a9e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:49.456716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-893e44a1-f428-4532-8016-f5840e228a9e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:49.474069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-893e44a1-f428-4532-8016-f5840e228a9e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:49.474538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-893e44a1-f428-4532-8016-f5840e228a9e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:49.475973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-893e44a1-f428-4532-8016-f5840e228a9e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:49.476531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-893e44a1-f428-4532-8016-f5840e228a9e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:50.814910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-8038d503-9dab-4f2f-b9d6-ce64ddb946bf req-f7e2b92b-1a3f-45a2-8d22-2cef8b13d0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a410b8cc-2988-4a53-ae6a-37d5e1da020f", "name": "network-vif-unplugged", "status": "completed", "tag": "5f282554-8e5f-498e-9680-c3b06bea6479"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:35:50.863903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8038d503-9dab-4f2f-b9d6-ce64ddb946bf req-f7e2b92b-1a3f-45a2-8d22-2cef8b13d0b6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:50.870159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8038d503-9dab-4f2f-b9d6-ce64ddb946bf req-f7e2b92b-1a3f-45a2-8d22-2cef8b13d0b6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:50.947080 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-8038d503-9dab-4f2f-b9d6-ce64ddb946bf req-f7e2b92b-1a3f-45a2-8d22-2cef8b13d0b6 service nova] Creating event network-vif-unplugged:5f282554-8e5f-498e-9680-c3b06bea6479 for instance a410b8cc-2988-4a53-ae6a-37d5e1da020f on n-h2-844627-10 Aug 04 14:35:50.963418 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-8038d503-9dab-4f2f-b9d6-ce64ddb946bf req-f7e2b92b-1a3f-45a2-8d22-2cef8b13d0b6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160460 Aug 04 14:35:50.971558 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2786/5553] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:35:51.130647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-893e44a1-f428-4532-8016-f5840e228a9e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:51.199797 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-893e44a1-f428-4532-8016-f5840e228a9e tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1732 microversion: 2.1 time: 1.747837 Aug 04 14:35:51.201534 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2768/5554] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:49 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1732 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:35:52.252558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2b22b031-e712-4fc8-b752-fa7f5ae95992 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:52.259302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2b22b031-e712-4fc8-b752-fa7f5ae95992 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:52.287480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b22b031-e712-4fc8-b752-fa7f5ae95992 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:52.299750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b22b031-e712-4fc8-b752-fa7f5ae95992 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:52.301954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b22b031-e712-4fc8-b752-fa7f5ae95992 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:52.303396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b22b031-e712-4fc8-b752-fa7f5ae95992 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:54.612196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2b22b031-e712-4fc8-b752-fa7f5ae95992 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:54.624589 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2b22b031-e712-4fc8-b752-fa7f5ae95992 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1732 microversion: 2.1 time: 2.383691 Aug 04 14:35:54.629707 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2787/5555] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:52 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1732 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:55.698595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2d7b9784-1709-42e8-91ff-09c58827fd31 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:55.709886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2d7b9784-1709-42e8-91ff-09c58827fd31 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:55.789175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d7b9784-1709-42e8-91ff-09c58827fd31 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:55.793927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d7b9784-1709-42e8-91ff-09c58827fd31 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:55.795562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d7b9784-1709-42e8-91ff-09c58827fd31 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:55.813982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d7b9784-1709-42e8-91ff-09c58827fd31 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:56.248436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2d7b9784-1709-42e8-91ff-09c58827fd31 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:56.264575 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2d7b9784-1709-42e8-91ff-09c58827fd31 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1664 microversion: 2.1 time: 0.579210 Aug 04 14:35:56.268397 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2769/5556] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:55 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1664 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:56.343761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-915fb267-c20b-4464-bc95-f9a3456ce33d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:56.344533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-915fb267-c20b-4464-bc95-f9a3456ce33d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:56.360848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-915fb267-c20b-4464-bc95-f9a3456ce33d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:56.361929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-915fb267-c20b-4464-bc95-f9a3456ce33d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:56.362922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-915fb267-c20b-4464-bc95-f9a3456ce33d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:56.364591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-915fb267-c20b-4464-bc95-f9a3456ce33d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:57.036966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-14d35af6-9678-4bf6-9bd4-346669f9ede0 req-a30fdf60-bc1a-4d7c-a9e2-c751774d884c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a410b8cc-2988-4a53-ae6a-37d5e1da020f", "name": "network-vif-deleted", "tag": "5f282554-8e5f-498e-9680-c3b06bea6479"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:35:57.067155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-14d35af6-9678-4bf6-9bd4-346669f9ede0 req-a30fdf60-bc1a-4d7c-a9e2-c751774d884c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:57.076745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-14d35af6-9678-4bf6-9bd4-346669f9ede0 req-a30fdf60-bc1a-4d7c-a9e2-c751774d884c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:57.134822 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-14d35af6-9678-4bf6-9bd4-346669f9ede0 req-a30fdf60-bc1a-4d7c-a9e2-c751774d884c service nova] Creating event network-vif-deleted:5f282554-8e5f-498e-9680-c3b06bea6479 for instance a410b8cc-2988-4a53-ae6a-37d5e1da020f on n-h2-844627-10 Aug 04 14:35:57.175206 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-14d35af6-9678-4bf6-9bd4-346669f9ede0 req-a30fdf60-bc1a-4d7c-a9e2-c751774d884c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.358359 Aug 04 14:35:57.177910 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2770/5557] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:35:57.330851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:57.337950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:57.422781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:57.458557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:57.464306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:57.465693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:57.634994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:57.635472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:57.635961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lazy-loading 'fault' on Instance uuid a410b8cc-2988-4a53-ae6a-37d5e1da020f {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:35:58.367371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93551e21ae0940f6868f96c1c3bde18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec527d1fed444fcb4f59a5e64abe3fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:35:58.384155 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d75aa39-82f4-4ef0-8597-94d4d5a7001a tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 200 len: 1389 microversion: 2.1 time: 1.078408 Aug 04 14:35:58.384658 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2771/5558] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:57 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 1389 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:35:59.429771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:35:59.429771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:35:59.439845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:59.440424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:59.441826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:35:59.442282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:35:59.487243 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] HTTP exception thrown: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Request method failure captured: Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f HTTP/1.1 Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69faTmHtueqqcBL46G409yEHebyq4v-pUjOCX4LAyMtY5y4hbwB09Ek1P3Kbih__OSLfcd4YJV-Gg530wBanwlh8kOxMcModO09mXq26M3ewsb8D1XZOPcIiJ8FQYOWYfVcqGW1fJs8yEuyfqUihv5K-JUmwjot-DnQ1sAUs7GRNsro Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3ec527d1fed444fcb4f59a5e64abe3fb Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestServerBasicOps-1620158671 Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3ec527d1fed444fcb4f59a5e64abe3fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3ec527d1fed444fcb4f59a5e64abe3fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3ec527d1fed444fcb4f59a5e64abe3fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3ec527d1fed444fcb4f59a5e64abe3fb"}]}] Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestServerBasicOps-1620158671 Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3ec527d1fed444fcb4f59a5e64abe3fb Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestServerBasicOps-1620158671 Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestServerBasicOps-1620158671-project Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 93551e21ae0940f6868f96c1c3bde18f Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestServerBasicOps-1620158671-project Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'a410b8cc-2988-4a53-ae6a-37d5e1da020f'} Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:35:59.490521 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:35:59.495515 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:35:59.495515 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:35:59.495515 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:35:59.495515 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:35:59.495515 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:35:59.495515 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:35:59.495515 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:35:59.497257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Returning 404 to user: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:35:59.498382 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-07ca1c15-549c-4411-acf7-8cadca4fe978 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 404 len: 111 microversion: 2.1 time: 0.082687 Aug 04 14:35:59.499539 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2772/5559] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:59 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:36:00.664012 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-915fb267-c20b-4464-bc95-f9a3456ce33d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1834 microversion: 2.1 time: 4.322983 Aug 04 14:36:00.683578 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2788/5560] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:35:56 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1834 bytes in 4344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:00.689615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0a1973c9-2dc4-45ce-a8ab-9479f0079060 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:00.690889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0a1973c9-2dc4-45ce-a8ab-9479f0079060 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:00.709463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a1973c9-2dc4-45ce-a8ab-9479f0079060 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:00.711338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a1973c9-2dc4-45ce-a8ab-9479f0079060 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:00.718520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a1973c9-2dc4-45ce-a8ab-9479f0079060 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:00.719439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a1973c9-2dc4-45ce-a8ab-9479f0079060 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:01.564819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0a1973c9-2dc4-45ce-a8ab-9479f0079060 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:01.581451 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0a1973c9-2dc4-45ce-a8ab-9479f0079060 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1681 microversion: 2.1 time: 0.896274 Aug 04 14:36:01.594417 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2773/5561] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:00 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1681 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:01.973125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b9bbfdd4-f459-455e-8ba5-3cd22c86c443 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:36:01.976801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b9bbfdd4-f459-455e-8ba5-3cd22c86c443 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:02.000137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9bbfdd4-f459-455e-8ba5-3cd22c86c443 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:02.000596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9bbfdd4-f459-455e-8ba5-3cd22c86c443 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:02.001434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9bbfdd4-f459-455e-8ba5-3cd22c86c443 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:02.001879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b9bbfdd4-f459-455e-8ba5-3cd22c86c443 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:02.138010 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b9bbfdd4-f459-455e-8ba5-3cd22c86c443 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action" status: 200 len: 32642 microversion: 2.1 time: 0.169457 Aug 04 14:36:02.138743 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2789/5562] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:36:01 2022] POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action => generated 32642 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:36:02.291697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:36:02.291697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:02.310090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:02.310555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:02.340101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:02.340101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:02.581125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:02.581728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:02.608477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:02.609129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:02.609779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:02.610217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:02.701382 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] HTTP exception thrown: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Request method failure captured: Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f HTTP/1.1 Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69faTmHtueqqcBL46G409yEHebyq4v-pUjOCX4LAyMtY5y4hbwB09Ek1P3Kbih__OSLfcd4YJV-Gg530wBanwlh8kOxMcModO09mXq26M3ewsb8D1XZOPcIiJ8FQYOWYfVcqGW1fJs8yEuyfqUihv5K-JUmwjot-DnQ1sAUs7GRNsro Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3ec527d1fed444fcb4f59a5e64abe3fb Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestServerBasicOps-1620158671 Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3ec527d1fed444fcb4f59a5e64abe3fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3ec527d1fed444fcb4f59a5e64abe3fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3ec527d1fed444fcb4f59a5e64abe3fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3ec527d1fed444fcb4f59a5e64abe3fb"}]}] Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestServerBasicOps-1620158671 Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3ec527d1fed444fcb4f59a5e64abe3fb Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestServerBasicOps-1620158671 Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestServerBasicOps-1620158671-project Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 93551e21ae0940f6868f96c1c3bde18f Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestServerBasicOps-1620158671-project Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'a410b8cc-2988-4a53-ae6a-37d5e1da020f'} Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:36:02.703261 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Returning 404 to user: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:36:02.708473 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-76a5b74f-278f-4596-bfee-26ce9868df27 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 404 len: 111 microversion: 2.1 time: 0.128639 Aug 04 14:36:02.716770 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2790/5563] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:36:02 2022] DELETE /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:36:02.721847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:02.722474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [instance: a410b8cc-2988-4a53-ae6a-37d5e1da020f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:02.749902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a03f830056894c50a2c398d6f875ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca8790adf064848b2be331b8cce2990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:02.750954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] flavor_id is None. Assuming migration. {{(pid=130961) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 14:36:02.751608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130961) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 14:36:02.767897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:02.770135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:02.771906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:02.780476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:02.854784 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] HTTP exception thrown: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Request method failure captured: Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f HTTP/1.1 Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69faTmHtueqqcBL46G409yEHebyq4v-pUjOCX4LAyMtY5y4hbwB09Ek1P3Kbih__OSLfcd4YJV-Gg530wBanwlh8kOxMcModO09mXq26M3ewsb8D1XZOPcIiJ8FQYOWYfVcqGW1fJs8yEuyfqUihv5K-JUmwjot-DnQ1sAUs7GRNsro Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3ec527d1fed444fcb4f59a5e64abe3fb Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestServerBasicOps-1620158671 Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3ec527d1fed444fcb4f59a5e64abe3fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3ec527d1fed444fcb4f59a5e64abe3fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3ec527d1fed444fcb4f59a5e64abe3fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3ec527d1fed444fcb4f59a5e64abe3fb"}]}] Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestServerBasicOps-1620158671 Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3ec527d1fed444fcb4f59a5e64abe3fb Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestServerBasicOps-1620158671 Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestServerBasicOps-1620158671-project Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 93551e21ae0940f6868f96c1c3bde18f Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestServerBasicOps-1620158671-project Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'a410b8cc-2988-4a53-ae6a-37d5e1da020f'} Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:36:02.859889 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.866598 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:36:02.866598 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:36:02.866598 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:36:02.866598 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:36:02.866598 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:36:02.866598 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. Aug 04 14:36:02.866598 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:36:02.866598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Returning 404 to user: Instance a410b8cc-2988-4a53-ae6a-37d5e1da020f could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:36:02.866598 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e883ceb-357f-4f7e-b1d2-39b761f38135 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f" status: 404 len: 111 microversion: 2.1 time: 0.146137 Aug 04 14:36:02.895067 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2791/5564] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:02 2022] GET /compute/v2.1/servers/a410b8cc-2988-4a53-ae6a-37d5e1da020f => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:36:03.802097 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e2d6f598-11a6-4c67-82ae-05554d4da41c tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action" status: 202 len: 0 microversion: 2.1 time: 1.515699 Aug 04 14:36:03.803656 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2774/5565] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:36:02 2022] POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action => generated 0 bytes in 1518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:36:03.817054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7838c9f-fea2-47a0-802f-35c09dbdcbb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:03.817865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7838c9f-fea2-47a0-802f-35c09dbdcbb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:03.838981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7838c9f-fea2-47a0-802f-35c09dbdcbb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:03.839690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7838c9f-fea2-47a0-802f-35c09dbdcbb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:03.840678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7838c9f-fea2-47a0-802f-35c09dbdcbb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:03.841166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7838c9f-fea2-47a0-802f-35c09dbdcbb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:04.340587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-81ae2343-aeed-4b8d-a269-0f758e741601 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] Calling method '.version_select at 0x7f46f2e5d790>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:04.353082 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [None req-81ae2343-aeed-4b8d-a269-0f758e741601 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [c3f3337f-5e3e-4dc2-90e4-1955cee99059] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 14:36:04.541978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f7838c9f-fea2-47a0-802f-35c09dbdcbb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:04.560578 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7838c9f-fea2-47a0-802f-35c09dbdcbb6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1690 microversion: 2.1 time: 0.750170 Aug 04 14:36:04.562789 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2792/5566] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:03 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1690 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:36:05.365470 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [None req-81ae2343-aeed-4b8d-a269-0f758e741601 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] [c3f3337f-5e3e-4dc2-90e4-1955cee99059] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 49738. Aug 04 14:36:05.414486 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-81ae2343-aeed-4b8d-a269-0f758e741601 tempest-TestServerBasicOps-1620158671 tempest-TestServerBasicOps-1620158671-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2126596764" status: 202 len: 0 microversion: 2.1 time: 1.078392 Aug 04 14:36:05.417405 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2775/5567] 10.222.0.66 () {58 vars in 1254 bytes} [Thu Aug 4 14:36:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2126596764 => generated 0 bytes in 1082 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:36:05.611655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6c04d0d8-24ee-4dc5-afe6-48360b8afa6a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:05.613031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6c04d0d8-24ee-4dc5-afe6-48360b8afa6a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:05.673193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c04d0d8-24ee-4dc5-afe6-48360b8afa6a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:05.673666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c04d0d8-24ee-4dc5-afe6-48360b8afa6a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:05.674491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c04d0d8-24ee-4dc5-afe6-48360b8afa6a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:05.674944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c04d0d8-24ee-4dc5-afe6-48360b8afa6a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:06.629302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6c04d0d8-24ee-4dc5-afe6-48360b8afa6a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:06.639740 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6c04d0d8-24ee-4dc5-afe6-48360b8afa6a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1690 microversion: 2.1 time: 1.055349 Aug 04 14:36:06.640993 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2793/5568] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:05 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1690 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:07.684112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e34464b1-f57e-486d-bfb3-e009df4e4050 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:07.689044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e34464b1-f57e-486d-bfb3-e009df4e4050 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:07.727341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e34464b1-f57e-486d-bfb3-e009df4e4050 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:07.728856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e34464b1-f57e-486d-bfb3-e009df4e4050 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:07.740041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e34464b1-f57e-486d-bfb3-e009df4e4050 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:07.744660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e34464b1-f57e-486d-bfb3-e009df4e4050 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:08.736069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e34464b1-f57e-486d-bfb3-e009df4e4050 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:08.768344 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e34464b1-f57e-486d-bfb3-e009df4e4050 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1690 microversion: 2.1 time: 1.095224 Aug 04 14:36:08.773907 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2776/5569] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:07 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1690 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:09.819234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-136d6c3b-5879-431d-b63b-2a7935f07438 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:09.825833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-136d6c3b-5879-431d-b63b-2a7935f07438 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:09.868230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-136d6c3b-5879-431d-b63b-2a7935f07438 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:09.872193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-136d6c3b-5879-431d-b63b-2a7935f07438 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:09.878265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-136d6c3b-5879-431d-b63b-2a7935f07438 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:09.881038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-136d6c3b-5879-431d-b63b-2a7935f07438 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:11.773013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-136d6c3b-5879-431d-b63b-2a7935f07438 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:11.833669 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-136d6c3b-5879-431d-b63b-2a7935f07438 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1690 microversion: 2.1 time: 2.026177 Aug 04 14:36:11.855003 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2794/5570] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:09 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1690 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:12.879763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-382f06bf-515c-401f-ab17-4d5f61af083c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:12.882598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-382f06bf-515c-401f-ab17-4d5f61af083c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:12.965627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382f06bf-515c-401f-ab17-4d5f61af083c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:12.968198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382f06bf-515c-401f-ab17-4d5f61af083c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:12.972773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382f06bf-515c-401f-ab17-4d5f61af083c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:12.976862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-382f06bf-515c-401f-ab17-4d5f61af083c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:14.429971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-382f06bf-515c-401f-ab17-4d5f61af083c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:14.441459 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-382f06bf-515c-401f-ab17-4d5f61af083c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1695 microversion: 2.1 time: 1.569886 Aug 04 14:36:14.446525 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2777/5571] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:12 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1695 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:15.466931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d28b2f0f-b343-47e3-9e54-59be0a1ca58a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:15.468912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d28b2f0f-b343-47e3-9e54-59be0a1ca58a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:15.510782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d28b2f0f-b343-47e3-9e54-59be0a1ca58a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:15.511934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d28b2f0f-b343-47e3-9e54-59be0a1ca58a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:15.516754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d28b2f0f-b343-47e3-9e54-59be0a1ca58a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:15.521045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d28b2f0f-b343-47e3-9e54-59be0a1ca58a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:15.744610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0a75a584-7cfc-45e4-a503-f6ea49a438b9 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbf8db10-8a3d-4cf6-adc8-59b03f7263d2", "device": "/dev/sdb"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:36:15.748925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0a75a584-7cfc-45e4-a503-f6ea49a438b9 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:15.766610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:36:15.769273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a75a584-7cfc-45e4-a503-f6ea49a438b9 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:15.770083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a75a584-7cfc-45e4-a503-f6ea49a438b9 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:15.771195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a75a584-7cfc-45e4-a503-f6ea49a438b9 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:15.775875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a75a584-7cfc-45e4-a503-f6ea49a438b9 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:15.802267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:36:16.434238 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0a75a584-7cfc-45e4-a503-f6ea49a438b9 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "POST /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692438 Aug 04 14:36:16.437607 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2778/5572] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:36:15 2022] POST /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac/os-volume_attachments => generated 194 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:36:16.716680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d28b2f0f-b343-47e3-9e54-59be0a1ca58a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:16.731704 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d28b2f0f-b343-47e3-9e54-59be0a1ca58a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1695 microversion: 2.1 time: 1.268759 Aug 04 14:36:16.732557 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2795/5573] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:15 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1695 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:17.761086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-632ea0ac-94fa-4ccd-a7bb-da53e447c296 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:17.762445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-632ea0ac-94fa-4ccd-a7bb-da53e447c296 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:17.789069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-632ea0ac-94fa-4ccd-a7bb-da53e447c296 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:17.789551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-632ea0ac-94fa-4ccd-a7bb-da53e447c296 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:17.790370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-632ea0ac-94fa-4ccd-a7bb-da53e447c296 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:17.790826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-632ea0ac-94fa-4ccd-a7bb-da53e447c296 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:19.383479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-632ea0ac-94fa-4ccd-a7bb-da53e447c296 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:19.409040 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-632ea0ac-94fa-4ccd-a7bb-da53e447c296 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1695 microversion: 2.1 time: 1.654832 Aug 04 14:36:19.412725 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2779/5574] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:17 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1695 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:20.432504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d985e1d3-c85b-4265-a7f8-7d3cae47b312 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:20.433879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d985e1d3-c85b-4265-a7f8-7d3cae47b312 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:20.445620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=23 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:36:20.451154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d985e1d3-c85b-4265-a7f8-7d3cae47b312 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:20.454912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d985e1d3-c85b-4265-a7f8-7d3cae47b312 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:20.456210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d985e1d3-c85b-4265-a7f8-7d3cae47b312 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:20.457950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d985e1d3-c85b-4265-a7f8-7d3cae47b312 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:20.469588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=53 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:36:20.914757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d985e1d3-c85b-4265-a7f8-7d3cae47b312 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:20.934969 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d985e1d3-c85b-4265-a7f8-7d3cae47b312 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1695 microversion: 2.1 time: 0.506541 Aug 04 14:36:20.945362 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2796/5575] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:20 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1695 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:21.960082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb6bdf96-39b8-46d0-8ee3-8b7697a3dada tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:21.960890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb6bdf96-39b8-46d0-8ee3-8b7697a3dada tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:21.973640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb6bdf96-39b8-46d0-8ee3-8b7697a3dada tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:21.977737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb6bdf96-39b8-46d0-8ee3-8b7697a3dada tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:21.984403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb6bdf96-39b8-46d0-8ee3-8b7697a3dada tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:21.989116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb6bdf96-39b8-46d0-8ee3-8b7697a3dada tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:22.563148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb6bdf96-39b8-46d0-8ee3-8b7697a3dada tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:22.581770 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb6bdf96-39b8-46d0-8ee3-8b7697a3dada tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1695 microversion: 2.1 time: 0.625631 Aug 04 14:36:22.582454 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2780/5576] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:21 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1695 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:36:23.605295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1a8518d-5c3f-4e58-8e6b-0d3acbb47b7d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:23.606236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a1a8518d-5c3f-4e58-8e6b-0d3acbb47b7d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:23.627951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1a8518d-5c3f-4e58-8e6b-0d3acbb47b7d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:23.628695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1a8518d-5c3f-4e58-8e6b-0d3acbb47b7d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:23.629990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1a8518d-5c3f-4e58-8e6b-0d3acbb47b7d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:23.630821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1a8518d-5c3f-4e58-8e6b-0d3acbb47b7d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:25.007807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1a8518d-5c3f-4e58-8e6b-0d3acbb47b7d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:25.052622 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1a8518d-5c3f-4e58-8e6b-0d3acbb47b7d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1695 microversion: 2.1 time: 1.450843 Aug 04 14:36:25.055012 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2797/5577] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:23 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1695 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:36:26.097157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34c2f597-d31f-4303-836d-6235381fed51 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:26.098282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-34c2f597-d31f-4303-836d-6235381fed51 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:26.124022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34c2f597-d31f-4303-836d-6235381fed51 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:26.125131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34c2f597-d31f-4303-836d-6235381fed51 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:26.128890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34c2f597-d31f-4303-836d-6235381fed51 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:26.129969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34c2f597-d31f-4303-836d-6235381fed51 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:26.956781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-34c2f597-d31f-4303-836d-6235381fed51 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:26.990902 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-34c2f597-d31f-4303-836d-6235381fed51 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1695 microversion: 2.1 time: 0.900209 Aug 04 14:36:26.992262 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2781/5578] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:26 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1695 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:28.035039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-caf5649b-ab25-43f3-98c4-eb95269a7abe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:28.036147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-caf5649b-ab25-43f3-98c4-eb95269a7abe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:28.090160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-caf5649b-ab25-43f3-98c4-eb95269a7abe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:28.090865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-caf5649b-ab25-43f3-98c4-eb95269a7abe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:28.108568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-caf5649b-ab25-43f3-98c4-eb95269a7abe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:28.124485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-caf5649b-ab25-43f3-98c4-eb95269a7abe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:29.341918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-caf5649b-ab25-43f3-98c4-eb95269a7abe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:29.363051 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-caf5649b-ab25-43f3-98c4-eb95269a7abe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1694 microversion: 2.1 time: 1.336406 Aug 04 14:36:29.363963 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2798/5579] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:28 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1694 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:36:30.404087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-83b03716-925e-49d9-b571-01e737e6871b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:30.404702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-83b03716-925e-49d9-b571-01e737e6871b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:30.428437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83b03716-925e-49d9-b571-01e737e6871b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:30.429543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83b03716-925e-49d9-b571-01e737e6871b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:30.434928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83b03716-925e-49d9-b571-01e737e6871b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:30.436704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83b03716-925e-49d9-b571-01e737e6871b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:30.644275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-8526194d-3e3c-4a48-a86c-8ce761caa744 req-23dc8071-cb9c-40c6-957c-a0bbd148852b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e8e313-b31e-4e62-aa90-ebe79c9d780a", "name": "network-vif-unplugged", "status": "completed", "tag": "2aa1d143-33e8-4392-9853-c5ac433d46f0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:36:30.670051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8526194d-3e3c-4a48-a86c-8ce761caa744 req-23dc8071-cb9c-40c6-957c-a0bbd148852b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:30.674508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8526194d-3e3c-4a48-a86c-8ce761caa744 req-23dc8071-cb9c-40c6-957c-a0bbd148852b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:30.709621 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-8526194d-3e3c-4a48-a86c-8ce761caa744 req-23dc8071-cb9c-40c6-957c-a0bbd148852b service nova] Creating event network-vif-unplugged:2aa1d143-33e8-4392-9853-c5ac433d46f0 for instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a on n-h2-844627-10 Aug 04 14:36:30.729927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-8526194d-3e3c-4a48-a86c-8ce761caa744 req-23dc8071-cb9c-40c6-957c-a0bbd148852b service nova] Instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:36:30.750247 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-8526194d-3e3c-4a48-a86c-8ce761caa744 req-23dc8071-cb9c-40c6-957c-a0bbd148852b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109727 Aug 04 14:36:30.751062 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2799/5580] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:36:30.857627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-83b03716-925e-49d9-b571-01e737e6871b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:30.866847 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-83b03716-925e-49d9-b571-01e737e6871b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1694 microversion: 2.1 time: 0.468093 Aug 04 14:36:30.874267 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2782/5581] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:30 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1694 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:31.910968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e6aa292a-5472-4dce-9370-c71cdc3b8852 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:31.911932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e6aa292a-5472-4dce-9370-c71cdc3b8852 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:31.933539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6aa292a-5472-4dce-9370-c71cdc3b8852 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:31.934432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6aa292a-5472-4dce-9370-c71cdc3b8852 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:31.935506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6aa292a-5472-4dce-9370-c71cdc3b8852 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:31.936205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6aa292a-5472-4dce-9370-c71cdc3b8852 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:32.603379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e6aa292a-5472-4dce-9370-c71cdc3b8852 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:32.613811 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e6aa292a-5472-4dce-9370-c71cdc3b8852 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1694 microversion: 2.1 time: 0.709977 Aug 04 14:36:32.616994 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2800/5582] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:31 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1694 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:32.870205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-bb4849f0-3cc4-4acc-b94a-82d6ce2cd29e req-51c95e1f-6b63-4b6b-bd4f-a1bc072c9498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e8e313-b31e-4e62-aa90-ebe79c9d780a", "tag": "2aa1d143-33e8-4392-9853-c5ac433d46f0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:36:32.921902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bb4849f0-3cc4-4acc-b94a-82d6ce2cd29e req-51c95e1f-6b63-4b6b-bd4f-a1bc072c9498 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:32.926526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bb4849f0-3cc4-4acc-b94a-82d6ce2cd29e req-51c95e1f-6b63-4b6b-bd4f-a1bc072c9498 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:32.962616 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bb4849f0-3cc4-4acc-b94a-82d6ce2cd29e req-51c95e1f-6b63-4b6b-bd4f-a1bc072c9498 service nova] Creating event network-changed:2aa1d143-33e8-4392-9853-c5ac433d46f0 for instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a on n-h2-844627-10 Aug 04 14:36:32.971914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-bb4849f0-3cc4-4acc-b94a-82d6ce2cd29e req-51c95e1f-6b63-4b6b-bd4f-a1bc072c9498 service nova] Instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:36:32.990976 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-bb4849f0-3cc4-4acc-b94a-82d6ce2cd29e req-51c95e1f-6b63-4b6b-bd4f-a1bc072c9498 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130128 Aug 04 14:36:32.992766 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2783/5583] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:36:33.659968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-451c7a1d-b53c-49c9-a65a-8dad744b0c1c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:33.660666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-451c7a1d-b53c-49c9-a65a-8dad744b0c1c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:33.676728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-451c7a1d-b53c-49c9-a65a-8dad744b0c1c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:33.682141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-451c7a1d-b53c-49c9-a65a-8dad744b0c1c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:33.683307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-451c7a1d-b53c-49c9-a65a-8dad744b0c1c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:33.686052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-451c7a1d-b53c-49c9-a65a-8dad744b0c1c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:34.204132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-451c7a1d-b53c-49c9-a65a-8dad744b0c1c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:34.218204 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-451c7a1d-b53c-49c9-a65a-8dad744b0c1c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1694 microversion: 2.1 time: 0.567505 Aug 04 14:36:34.239571 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2801/5584] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:33 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1694 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:35.251585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d528408-a753-423b-904b-3e6d461e575f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:35.253188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8d528408-a753-423b-904b-3e6d461e575f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:35.267483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d528408-a753-423b-904b-3e6d461e575f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:35.273210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d528408-a753-423b-904b-3e6d461e575f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:35.274411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d528408-a753-423b-904b-3e6d461e575f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:35.275122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d528408-a753-423b-904b-3e6d461e575f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:37.079720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d528408-a753-423b-904b-3e6d461e575f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:37.133855 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d528408-a753-423b-904b-3e6d461e575f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1692 microversion: 2.1 time: 1.889377 Aug 04 14:36:37.140047 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2784/5585] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:35 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1692 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:38.200492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b14bd5a9-73fe-4b69-8e20-ffe141bd2663 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:38.205270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b14bd5a9-73fe-4b69-8e20-ffe141bd2663 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:38.226135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b14bd5a9-73fe-4b69-8e20-ffe141bd2663 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:38.227512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b14bd5a9-73fe-4b69-8e20-ffe141bd2663 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:38.229849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b14bd5a9-73fe-4b69-8e20-ffe141bd2663 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:38.232254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b14bd5a9-73fe-4b69-8e20-ffe141bd2663 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:39.696009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b14bd5a9-73fe-4b69-8e20-ffe141bd2663 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:39.714749 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b14bd5a9-73fe-4b69-8e20-ffe141bd2663 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1689 microversion: 2.1 time: 1.537439 Aug 04 14:36:39.741570 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2802/5586] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:38 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1689 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:39.750022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90f4d774-9171-410b-ae16-918485ea3bf4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:36:39.759595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-90f4d774-9171-410b-ae16-918485ea3bf4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:39.800953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90f4d774-9171-410b-ae16-918485ea3bf4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:39.801700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90f4d774-9171-410b-ae16-918485ea3bf4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:39.803437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90f4d774-9171-410b-ae16-918485ea3bf4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:39.804153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90f4d774-9171-410b-ae16-918485ea3bf4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:40.099892 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90f4d774-9171-410b-ae16-918485ea3bf4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action" status: 204 len: 0 microversion: 2.1 time: 0.357550 Aug 04 14:36:40.111865 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2785/5587] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:36:39 2022] POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:36:40.121123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-55cc7a5c-c420-4161-9909-d29780b04130 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:40.122345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-55cc7a5c-c420-4161-9909-d29780b04130 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:40.136961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55cc7a5c-c420-4161-9909-d29780b04130 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:40.141678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55cc7a5c-c420-4161-9909-d29780b04130 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:40.143423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55cc7a5c-c420-4161-9909-d29780b04130 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:40.144050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55cc7a5c-c420-4161-9909-d29780b04130 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:40.812574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-55cc7a5c-c420-4161-9909-d29780b04130 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:40.849726 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-55cc7a5c-c420-4161-9909-d29780b04130 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1689 microversion: 2.1 time: 0.729776 Aug 04 14:36:40.859381 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2803/5588] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:40 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1689 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:41.883443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-025b01fd-b6db-4fb2-b721-70b6597216c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:41.891152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-025b01fd-b6db-4fb2-b721-70b6597216c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:41.940911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-025b01fd-b6db-4fb2-b721-70b6597216c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:41.949575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-025b01fd-b6db-4fb2-b721-70b6597216c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:41.957542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-025b01fd-b6db-4fb2-b721-70b6597216c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:41.958583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-025b01fd-b6db-4fb2-b721-70b6597216c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:43.392428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-025b01fd-b6db-4fb2-b721-70b6597216c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:43.407932 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-025b01fd-b6db-4fb2-b721-70b6597216c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1689 microversion: 2.1 time: 1.532086 Aug 04 14:36:43.425554 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2786/5589] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:41 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1689 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:43.576591 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:36:43.577270 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:36:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:36:44.457622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f96486c8-4d4a-41b5-89a0-3724b89d8e7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:44.459234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f96486c8-4d4a-41b5-89a0-3724b89d8e7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:44.485737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f96486c8-4d4a-41b5-89a0-3724b89d8e7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:44.486552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f96486c8-4d4a-41b5-89a0-3724b89d8e7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:44.495122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f96486c8-4d4a-41b5-89a0-3724b89d8e7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:44.495989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f96486c8-4d4a-41b5-89a0-3724b89d8e7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:45.186234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f96486c8-4d4a-41b5-89a0-3724b89d8e7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:45.202006 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f96486c8-4d4a-41b5-89a0-3724b89d8e7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1689 microversion: 2.1 time: 0.756317 Aug 04 14:36:45.205809 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2804/5590] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:44 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1689 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:36:46.245380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bbdd252f-4f6b-4599-bdbc-be4076c49aac tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:36:46.246413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bbdd252f-4f6b-4599-bdbc-be4076c49aac tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:36:46.274113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbdd252f-4f6b-4599-bdbc-be4076c49aac tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:46.277373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbdd252f-4f6b-4599-bdbc-be4076c49aac tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:46.296299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbdd252f-4f6b-4599-bdbc-be4076c49aac tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:46.296299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbdd252f-4f6b-4599-bdbc-be4076c49aac tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:46.300840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3db456f6-09cc-4cae-ac67-4c76bce16458 req-36930ccc-c320-46f4-9b19-ad7ac8640269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e8e313-b31e-4e62-aa90-ebe79c9d780a", "name": "network-vif-plugged", "status": "completed", "tag": "2aa1d143-33e8-4392-9853-c5ac433d46f0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:36:46.315536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=18 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:36:46.344137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3db456f6-09cc-4cae-ac67-4c76bce16458 req-36930ccc-c320-46f4-9b19-ad7ac8640269 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:36:46.344589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3db456f6-09cc-4cae-ac67-4c76bce16458 req-36930ccc-c320-46f4-9b19-ad7ac8640269 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:36:46.390789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:36:46.429035 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3db456f6-09cc-4cae-ac67-4c76bce16458 req-36930ccc-c320-46f4-9b19-ad7ac8640269 service nova] Creating event network-vif-plugged:2aa1d143-33e8-4392-9853-c5ac433d46f0 for instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a on n-h2-844627-10 Aug 04 14:36:46.447884 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3db456f6-09cc-4cae-ac67-4c76bce16458 req-36930ccc-c320-46f4-9b19-ad7ac8640269 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.669906 Aug 04 14:36:46.453212 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2787/5591] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:36:47.250762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bbdd252f-4f6b-4599-bdbc-be4076c49aac tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:36:47.270361 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bbdd252f-4f6b-4599-bdbc-be4076c49aac tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1681 microversion: 2.1 time: 1.029075 Aug 04 14:36:47.272701 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2805/5592] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:36:46 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1681 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:03.068476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0cc9488f-3683-4f98-a902-6d122d6ae19c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:03.071232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0cc9488f-3683-4f98-a902-6d122d6ae19c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:03.093405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:03.110682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cc9488f-3683-4f98-a902-6d122d6ae19c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:03.111156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cc9488f-3683-4f98-a902-6d122d6ae19c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:03.112184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cc9488f-3683-4f98-a902-6d122d6ae19c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:03.113016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0cc9488f-3683-4f98-a902-6d122d6ae19c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:03.203890 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0cc9488f-3683-4f98-a902-6d122d6ae19c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action" status: 200 len: 24579 microversion: 2.1 time: 0.140339 Aug 04 14:37:03.207934 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2788/5593] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:37:03 2022] POST /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a/action => generated 24579 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:37:03.235631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=19 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:03.244848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=57 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:03.963300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1312498579", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "34a9940b-5769-4bf2-9fa0-5c41d294937b"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:04.079996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] validate_networks() for [('34a9940b-5769-4bf2-9fa0-5c41d294937b', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:37:05.261185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:37:05.262295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:37:05.262295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:37:05.262628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:37:05.262936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:37:05.279517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:05.286533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:05.287869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:05.288522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:05.333702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Getting quotas for project a884f094e71b4366a1053c99bfd9a801. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:37:05.347858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Getting quotas for user d1ecdbca0acb445393ec27187ef75a1b and project a884f094e71b4366a1053c99bfd9a801. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:37:05.382214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:37:05.387577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:37:05.522945 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f0e5d3ec-a55a-4316-9854-0662cdcb6c18 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.320167 Aug 04 14:37:05.528354 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2806/5594] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:37:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:37:05.544025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-edecf113-0992-498f-a26b-4dadcfb371be tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:05.545379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-edecf113-0992-498f-a26b-4dadcfb371be tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:05.777846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-edecf113-0992-498f-a26b-4dadcfb371be tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:05.791061 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-edecf113-0992-498f-a26b-4dadcfb371be tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1215 microversion: 2.1 time: 0.249627 Aug 04 14:37:05.794594 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2789/5595] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:05 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1215 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:37:06.833820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70b01ccc-419c-4c84-ab57-0abb17cb456e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:06.834680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-70b01ccc-419c-4c84-ab57-0abb17cb456e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:07.091785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-70b01ccc-419c-4c84-ab57-0abb17cb456e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:07.110191 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-70b01ccc-419c-4c84-ab57-0abb17cb456e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1215 microversion: 2.1 time: 0.280698 Aug 04 14:37:07.115350 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2807/5596] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:06 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1215 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:08.166419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-20bd3cf1-c117-4598-92b1-b1a47269c6bf tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:08.172085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-20bd3cf1-c117-4598-92b1-b1a47269c6bf tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:08.237057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20bd3cf1-c117-4598-92b1-b1a47269c6bf tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:08.237867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20bd3cf1-c117-4598-92b1-b1a47269c6bf tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:08.239408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20bd3cf1-c117-4598-92b1-b1a47269c6bf tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:08.240211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20bd3cf1-c117-4598-92b1-b1a47269c6bf tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:08.795297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-20bd3cf1-c117-4598-92b1-b1a47269c6bf tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:08.841098 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-20bd3cf1-c117-4598-92b1-b1a47269c6bf tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1275 microversion: 2.1 time: 0.691287 Aug 04 14:37:08.863931 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2790/5597] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:08 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1275 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:09.114035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8bd4752f-c393-48fb-b8eb-2120c164df52 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:09.119184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8bd4752f-c393-48fb-b8eb-2120c164df52 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:09.135182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bd4752f-c393-48fb-b8eb-2120c164df52 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:09.136414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bd4752f-c393-48fb-b8eb-2120c164df52 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:09.138195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bd4752f-c393-48fb-b8eb-2120c164df52 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:09.139199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bd4752f-c393-48fb-b8eb-2120c164df52 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:09.479204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1ca01338-56a5-4240-a2b1-a18325aba392 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:09.482598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1ca01338-56a5-4240-a2b1-a18325aba392 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:09.490780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-8bd4752f-c393-48fb-b8eb-2120c164df52 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lazy-loading 'services' on Instance uuid 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:37:09.525629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ca01338-56a5-4240-a2b1-a18325aba392 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:09.535802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ca01338-56a5-4240-a2b1-a18325aba392 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:09.547566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ca01338-56a5-4240-a2b1-a18325aba392 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:09.550575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ca01338-56a5-4240-a2b1-a18325aba392 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:09.866110 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8bd4752f-c393-48fb-b8eb-2120c164df52 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac/os-volume_attachments/cbf8db10-8a3d-4cf6-adc8-59b03f7263d2" status: 202 len: 0 microversion: 2.1 time: 0.761276 Aug 04 14:37:09.881681 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2808/5598] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:37:09 2022] DELETE /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac/os-volume_attachments/cbf8db10-8a3d-4cf6-adc8-59b03f7263d2 => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:37:09.891523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4b0e2c0a-4b02-4330-9eda-0f75234ccae4 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:09.905190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4b0e2c0a-4b02-4330-9eda-0f75234ccae4 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:09.940325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b0e2c0a-4b02-4330-9eda-0f75234ccae4 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:09.941424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b0e2c0a-4b02-4330-9eda-0f75234ccae4 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:09.956732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b0e2c0a-4b02-4330-9eda-0f75234ccae4 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:09.979342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b0e2c0a-4b02-4330-9eda-0f75234ccae4 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:10.349781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4b0e2c0a-4b02-4330-9eda-0f75234ccae4 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:10.371093 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4b0e2c0a-4b02-4330-9eda-0f75234ccae4 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1273 microversion: 2.1 time: 0.487175 Aug 04 14:37:10.374614 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2809/5599] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:09 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1273 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:10.492884 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1ca01338-56a5-4240-a2b1-a18325aba392 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1834 microversion: 2.1 time: 1.020844 Aug 04 14:37:10.493731 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2791/5600] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:09 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1834 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:37:11.410756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-93996978-c09c-404b-920a-b9b7c4752fc6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:11.412268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-93996978-c09c-404b-920a-b9b7c4752fc6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:11.435754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93996978-c09c-404b-920a-b9b7c4752fc6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:11.440808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93996978-c09c-404b-920a-b9b7c4752fc6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:11.442966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93996978-c09c-404b-920a-b9b7c4752fc6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:11.444581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93996978-c09c-404b-920a-b9b7c4752fc6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:12.968638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-93996978-c09c-404b-920a-b9b7c4752fc6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:13.030882 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-93996978-c09c-404b-920a-b9b7c4752fc6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1315 microversion: 2.1 time: 1.619012 Aug 04 14:37:13.032430 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2810/5601] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:11 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1315 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:14.079765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c4f60ce4-2d51-4443-9ee6-d46b51500b7c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:14.087302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c4f60ce4-2d51-4443-9ee6-d46b51500b7c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:14.155689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4f60ce4-2d51-4443-9ee6-d46b51500b7c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:14.158403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4f60ce4-2d51-4443-9ee6-d46b51500b7c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:14.165351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4f60ce4-2d51-4443-9ee6-d46b51500b7c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:14.167169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4f60ce4-2d51-4443-9ee6-d46b51500b7c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:15.510301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c4f60ce4-2d51-4443-9ee6-d46b51500b7c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:15.538486 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c4f60ce4-2d51-4443-9ee6-d46b51500b7c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1315 microversion: 2.1 time: 1.468098 Aug 04 14:37:15.553079 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2792/5602] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:14 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1315 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:16.449507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f012badd-862c-4a94-bd9b-d3696fda1c32 req-95d1562a-5eb4-4edd-aa8d-97e8ef101708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d580efc6-c804-4f2c-a70b-8e039f91d4dd", "tag": "bbae24b7-2c18-493b-9926-caee3b1529b3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:16.468351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:16.475456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f012badd-862c-4a94-bd9b-d3696fda1c32 req-95d1562a-5eb4-4edd-aa8d-97e8ef101708 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:16.480137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f012badd-862c-4a94-bd9b-d3696fda1c32 req-95d1562a-5eb4-4edd-aa8d-97e8ef101708 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:16.511394 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f012badd-862c-4a94-bd9b-d3696fda1c32 req-95d1562a-5eb4-4edd-aa8d-97e8ef101708 service nova] Creating event network-changed:bbae24b7-2c18-493b-9926-caee3b1529b3 for instance d580efc6-c804-4f2c-a70b-8e039f91d4dd on n-h2-844627-10 Aug 04 14:37:16.525960 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f012badd-862c-4a94-bd9b-d3696fda1c32 req-95d1562a-5eb4-4edd-aa8d-97e8ef101708 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073053 Aug 04 14:37:16.526673 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2811/5603] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:37:16.582520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c5199dc0-c443-4de5-b361-40adb5b4e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:16.584228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c5199dc0-c443-4de5-b361-40adb5b4e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:16.592339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:16.598119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5199dc0-c443-4de5-b361-40adb5b4e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:16.600188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5199dc0-c443-4de5-b361-40adb5b4e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:16.601362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5199dc0-c443-4de5-b361-40adb5b4e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:16.601911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5199dc0-c443-4de5-b361-40adb5b4e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:17.245889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9aa36274-6c8b-4696-9675-f402ade59dd2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:17.246499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9aa36274-6c8b-4696-9675-f402ade59dd2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:17.263810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:17.272495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9aa36274-6c8b-4696-9675-f402ade59dd2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:17.273315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9aa36274-6c8b-4696-9675-f402ade59dd2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:17.274240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9aa36274-6c8b-4696-9675-f402ade59dd2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:17.274689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9aa36274-6c8b-4696-9675-f402ade59dd2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:17.332084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c5199dc0-c443-4de5-b361-40adb5b4e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:17.347946 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c5199dc0-c443-4de5-b361-40adb5b4e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1315 microversion: 2.1 time: 0.772315 Aug 04 14:37:17.362431 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2793/5604] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:16 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:17.393867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9aa36274-6c8b-4696-9675-f402ade59dd2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:37:17.734512 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9aa36274-6c8b-4696-9675-f402ade59dd2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "DELETE /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 204 len: 0 microversion: 2.1 time: 0.490715 Aug 04 14:37:17.740590 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2812/5605] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:37:17 2022] DELETE /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:37:17.769013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-820f5c24-f2a0-4178-8edf-062de2d53ba6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:17.774142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-820f5c24-f2a0-4178-8edf-062de2d53ba6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:17.797242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820f5c24-f2a0-4178-8edf-062de2d53ba6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:17.797716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820f5c24-f2a0-4178-8edf-062de2d53ba6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:17.798598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820f5c24-f2a0-4178-8edf-062de2d53ba6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:17.799061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-820f5c24-f2a0-4178-8edf-062de2d53ba6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:18.314192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-820f5c24-f2a0-4178-8edf-062de2d53ba6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:18.335532 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-820f5c24-f2a0-4178-8edf-062de2d53ba6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1687 microversion: 2.1 time: 0.581421 Aug 04 14:37:18.340579 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2794/5606] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:17 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1687 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:18.380714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f937ac71-49a2-4f73-97c8-5b3c36d2add7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:18.382130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f937ac71-49a2-4f73-97c8-5b3c36d2add7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:18.402200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f937ac71-49a2-4f73-97c8-5b3c36d2add7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:18.403602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f937ac71-49a2-4f73-97c8-5b3c36d2add7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:18.405355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f937ac71-49a2-4f73-97c8-5b3c36d2add7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:18.406280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f937ac71-49a2-4f73-97c8-5b3c36d2add7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:18.617794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-955cf066-50b3-416a-8320-a90ba161f71e req-e5148346-9b48-4df8-b06f-d0e3c7668196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e8e313-b31e-4e62-aa90-ebe79c9d780a", "tag": "2aa1d143-33e8-4392-9853-c5ac433d46f0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:18.648805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-955cf066-50b3-416a-8320-a90ba161f71e req-e5148346-9b48-4df8-b06f-d0e3c7668196 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:18.662683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-955cf066-50b3-416a-8320-a90ba161f71e req-e5148346-9b48-4df8-b06f-d0e3c7668196 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:18.718250 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-955cf066-50b3-416a-8320-a90ba161f71e req-e5148346-9b48-4df8-b06f-d0e3c7668196 service nova] Creating event network-changed:2aa1d143-33e8-4392-9853-c5ac433d46f0 for instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a on n-h2-844627-10 Aug 04 14:37:18.731111 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-955cf066-50b3-416a-8320-a90ba161f71e req-e5148346-9b48-4df8-b06f-d0e3c7668196 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118741 Aug 04 14:37:18.735260 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2795/5607] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:37:19.087692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f937ac71-49a2-4f73-97c8-5b3c36d2add7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:19.172536 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f937ac71-49a2-4f73-97c8-5b3c36d2add7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1315 microversion: 2.1 time: 0.801485 Aug 04 14:37:19.174583 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2813/5608] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:18 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:19.391456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-89f45dff-1f39-4cc0-a64b-2e07026b4628 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:19.395689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-89f45dff-1f39-4cc0-a64b-2e07026b4628 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:19.438128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89f45dff-1f39-4cc0-a64b-2e07026b4628 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:19.439222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89f45dff-1f39-4cc0-a64b-2e07026b4628 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:19.440903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89f45dff-1f39-4cc0-a64b-2e07026b4628 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:19.441821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-89f45dff-1f39-4cc0-a64b-2e07026b4628 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:20.201805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-89508711-af57-4618-84a9-1ca0be544241 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:20.203608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-89508711-af57-4618-84a9-1ca0be544241 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:20.249953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89508711-af57-4618-84a9-1ca0be544241 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:20.251034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89508711-af57-4618-84a9-1ca0be544241 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:20.254347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89508711-af57-4618-84a9-1ca0be544241 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:20.262018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89508711-af57-4618-84a9-1ca0be544241 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:20.585888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-89f45dff-1f39-4cc0-a64b-2e07026b4628 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:20.638923 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-89f45dff-1f39-4cc0-a64b-2e07026b4628 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1687 microversion: 2.1 time: 1.264286 Aug 04 14:37:20.640478 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2796/5609] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:19 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1687 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:20.900879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-89508711-af57-4618-84a9-1ca0be544241 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:20.942455 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-89508711-af57-4618-84a9-1ca0be544241 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1315 microversion: 2.1 time: 0.746545 Aug 04 14:37:20.967520 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2814/5610] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:20 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:37:21.680326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-43451225-3d90-463b-89b1-03bea3ff355e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:21.681588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-43451225-3d90-463b-89b1-03bea3ff355e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:21.695943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43451225-3d90-463b-89b1-03bea3ff355e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:21.698154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43451225-3d90-463b-89b1-03bea3ff355e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:21.701900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43451225-3d90-463b-89b1-03bea3ff355e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:21.702523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-43451225-3d90-463b-89b1-03bea3ff355e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:21.982263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-74dc5bc4-b256-4c5d-95f3-e74788a398df tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:21.982987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-74dc5bc4-b256-4c5d-95f3-e74788a398df tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:21.999701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74dc5bc4-b256-4c5d-95f3-e74788a398df tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:22.003096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74dc5bc4-b256-4c5d-95f3-e74788a398df tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:22.010565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74dc5bc4-b256-4c5d-95f3-e74788a398df tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:22.011804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74dc5bc4-b256-4c5d-95f3-e74788a398df tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:22.154436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-43451225-3d90-463b-89b1-03bea3ff355e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:22.167902 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-43451225-3d90-463b-89b1-03bea3ff355e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1620 microversion: 2.1 time: 0.491901 Aug 04 14:37:22.171001 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2797/5611] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:21 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1620 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:37:22.182985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68b9743a-d1da-4cf6-8c37-617629d0f121 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:22.185345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68b9743a-d1da-4cf6-8c37-617629d0f121 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:22.206120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68b9743a-d1da-4cf6-8c37-617629d0f121 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:22.207140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68b9743a-d1da-4cf6-8c37-617629d0f121 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:22.208753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68b9743a-d1da-4cf6-8c37-617629d0f121 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:22.209464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68b9743a-d1da-4cf6-8c37-617629d0f121 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:22.269154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68b9743a-d1da-4cf6-8c37-617629d0f121 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:37:22.420559 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68b9743a-d1da-4cf6-8c37-617629d0f121 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 204 len: 0 microversion: 2.1 time: 0.246678 Aug 04 14:37:22.422410 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2798/5612] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:37:22 2022] DELETE /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:37:22.440596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ae7862e1-5527-4b6f-82f9-8870d5b2fb00 req-1ea13703-9120-44b2-a1e1-be8ec9ee5753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e8e313-b31e-4e62-aa90-ebe79c9d780a", "name": "network-vif-deleted", "tag": "2aa1d143-33e8-4392-9853-c5ac433d46f0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:22.469321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ae7862e1-5527-4b6f-82f9-8870d5b2fb00 req-1ea13703-9120-44b2-a1e1-be8ec9ee5753 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:22.470260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ae7862e1-5527-4b6f-82f9-8870d5b2fb00 req-1ea13703-9120-44b2-a1e1-be8ec9ee5753 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:22.501132 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ae7862e1-5527-4b6f-82f9-8870d5b2fb00 req-1ea13703-9120-44b2-a1e1-be8ec9ee5753 service nova] Creating event network-vif-deleted:2aa1d143-33e8-4392-9853-c5ac433d46f0 for instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a on n-h2-844627-10 Aug 04 14:37:22.512941 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ae7862e1-5527-4b6f-82f9-8870d5b2fb00 req-1ea13703-9120-44b2-a1e1-be8ec9ee5753 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087611 Aug 04 14:37:22.513588 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2799/5613] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:37:22.532355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d20eb202-d1b7-4c01-af40-753a61ea1df1 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:22.533943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d20eb202-d1b7-4c01-af40-753a61ea1df1 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:22.552017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d20eb202-d1b7-4c01-af40-753a61ea1df1 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:22.552547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d20eb202-d1b7-4c01-af40-753a61ea1df1 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:22.555538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d20eb202-d1b7-4c01-af40-753a61ea1df1 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:22.556008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d20eb202-d1b7-4c01-af40-753a61ea1df1 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:23.869239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74dc5bc4-b256-4c5d-95f3-e74788a398df tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:23.884243 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-74dc5bc4-b256-4c5d-95f3-e74788a398df tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1315 microversion: 2.1 time: 1.907211 Aug 04 14:37:23.906138 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2815/5614] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:21 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1315 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:23.913105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:23.914278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:23.927253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:23.928439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:23.931230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:23.932375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:24.029541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:24.030442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:24.031183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lazy-loading 'fault' on Instance uuid 15e8e313-b31e-4e62-aa90-ebe79c9d780a {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:37:24.050162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d20eb202-d1b7-4c01-af40-753a61ea1df1 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:24.106561 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d20eb202-d1b7-4c01-af40-753a61ea1df1 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1515 microversion: 2.1 time: 1.578794 Aug 04 14:37:24.107654 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2800/5615] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:22 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1515 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:24.168291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:24.189855 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3e86fd52-347d-4ddd-887c-b7e0c4f8ca62 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 200 len: 1356 microversion: 2.1 time: 0.279871 Aug 04 14:37:24.191807 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2816/5616] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:23 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 1356 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:24.922793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c4be3b88-112d-45e4-83b0-eb5b0990521d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:24.925711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c4be3b88-112d-45e4-83b0-eb5b0990521d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:24.940372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4be3b88-112d-45e4-83b0-eb5b0990521d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:24.940758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4be3b88-112d-45e4-83b0-eb5b0990521d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:24.945418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4be3b88-112d-45e4-83b0-eb5b0990521d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:24.946539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c4be3b88-112d-45e4-83b0-eb5b0990521d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:25.132422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d559636-aeb7-40b4-aba1-83a4f88acffd tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:25.137749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d559636-aeb7-40b4-aba1-83a4f88acffd tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:25.199688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d559636-aeb7-40b4-aba1-83a4f88acffd tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:25.204474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d559636-aeb7-40b4-aba1-83a4f88acffd tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:25.207243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d559636-aeb7-40b4-aba1-83a4f88acffd tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:25.211486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d559636-aeb7-40b4-aba1-83a4f88acffd tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:25.480030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c4be3b88-112d-45e4-83b0-eb5b0990521d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:25.508438 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c4be3b88-112d-45e4-83b0-eb5b0990521d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1315 microversion: 2.1 time: 0.585254 Aug 04 14:37:25.509525 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2801/5617] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:24 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:25.530238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:25.531353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 15e8e313-b31e-4e62-aa90-ebe79c9d780a] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:25.544777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:25.545740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:25.557668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:25.560941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:25.615449 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] HTTP exception thrown: Instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a could not be found. Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Request method failure captured: Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a HTTP/1.1 Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69jFwfUoq1MZ3PkxRE5BkQb7BpiSp69e48CPHsGriFQhxKzUnkiGwYhQQNbePGn0c7hesvf4xJO9DEV2ugJMLpoKcsD8QT28sWC3O_GVBX9cdqtyoLV3WEoG3MH4Vxk5k9ad08hMG6pCpe8VT4Gx9CIcVPTQQppsGB6GyqA9Zs8vudM Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2f1a5cc686e44650a531a8c1026d71e0 Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2f1a5cc686e44650a531a8c1026d71e0"}]}] Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2f1a5cc686e44650a531a8c1026d71e0 Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestNetworkAdvancedServerOps-617904044-project Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 95e5002f80224b4a804be717d5bd9d2c Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestNetworkAdvancedServerOps-617904044-project Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a could not be found. Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '15e8e313-b31e-4e62-aa90-ebe79c9d780a'} Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a could not be found. Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a could not be found. Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:25.626401 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a could not be found. Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Returning 404 to user: Instance 15e8e313-b31e-4e62-aa90-ebe79c9d780a could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:37:25.634893 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-072f6664-229b-4fd9-b530-ec3a3f108d48 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a" status: 404 len: 111 microversion: 2.1 time: 0.121355 Aug 04 14:37:25.636709 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2802/5618] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:25 2022] GET /compute/v2.1/servers/15e8e313-b31e-4e62-aa90-ebe79c9d780a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:37:25.650844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-51b0ead9-a9e5-42b2-b4a0-9f5bba2dd112 req-c047157b-f4fb-4161-8dc3-efca5c3d03c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d580efc6-c804-4f2c-a70b-8e039f91d4dd", "name": "network-vif-plugged", "status": "completed", "tag": "bbae24b7-2c18-493b-9926-caee3b1529b3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:25.688052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-51b0ead9-a9e5-42b2-b4a0-9f5bba2dd112 req-c047157b-f4fb-4161-8dc3-efca5c3d03c1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:25.689354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-51b0ead9-a9e5-42b2-b4a0-9f5bba2dd112 req-c047157b-f4fb-4161-8dc3-efca5c3d03c1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:25.742836 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-51b0ead9-a9e5-42b2-b4a0-9f5bba2dd112 req-c047157b-f4fb-4161-8dc3-efca5c3d03c1 service nova] Creating event network-vif-plugged:bbae24b7-2c18-493b-9926-caee3b1529b3 for instance d580efc6-c804-4f2c-a70b-8e039f91d4dd on n-h2-844627-10 Aug 04 14:37:25.767240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-51b0ead9-a9e5-42b2-b4a0-9f5bba2dd112 req-c047157b-f4fb-4161-8dc3-efca5c3d03c1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123153 Aug 04 14:37:25.770424 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2803/5619] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:37:25.831471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d559636-aeb7-40b4-aba1-83a4f88acffd tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:25.857990 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d559636-aeb7-40b4-aba1-83a4f88acffd tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1515 microversion: 2.1 time: 0.729142 Aug 04 14:37:25.859936 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2817/5620] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:25 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1515 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:26.199671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-faa44836-e0eb-4bfb-bce6-3299f1b461c9 req-0673646a-a2d8-4236-abee-fd5bbab3eb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac", "name": "network-vif-deleted", "tag": "db4636cb-121d-4b16-af44-8bb1ca659006"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:26.248396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-faa44836-e0eb-4bfb-bce6-3299f1b461c9 req-0673646a-a2d8-4236-abee-fd5bbab3eb54 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:26.251989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-faa44836-e0eb-4bfb-bce6-3299f1b461c9 req-0673646a-a2d8-4236-abee-fd5bbab3eb54 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:26.291193 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-faa44836-e0eb-4bfb-bce6-3299f1b461c9 req-0673646a-a2d8-4236-abee-fd5bbab3eb54 service nova] Creating event network-vif-deleted:db4636cb-121d-4b16-af44-8bb1ca659006 for instance 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac on n-h2-844627-10 Aug 04 14:37:26.312900 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-faa44836-e0eb-4bfb-bce6-3299f1b461c9 req-0673646a-a2d8-4236-abee-fd5bbab3eb54 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120709 Aug 04 14:37:26.315592 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2804/5621] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:37:26.555244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8de1ad62-54b3-4608-85c3-b95684ff7dcc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:26.565093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8de1ad62-54b3-4608-85c3-b95684ff7dcc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:26.601339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de1ad62-54b3-4608-85c3-b95684ff7dcc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:26.602825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de1ad62-54b3-4608-85c3-b95684ff7dcc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:26.604080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de1ad62-54b3-4608-85c3-b95684ff7dcc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:26.606500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8de1ad62-54b3-4608-85c3-b95684ff7dcc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:26.881647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:26.882536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:26.915061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:26.915841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:26.916709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:26.917468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:27.050629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:27.051114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:27.051638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lazy-loading 'fault' on Instance uuid 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:37:27.249139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8de1ad62-54b3-4608-85c3-b95684ff7dcc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:27.258127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:27.263454 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8de1ad62-54b3-4608-85c3-b95684ff7dcc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1315 microversion: 2.1 time: 0.712787 Aug 04 14:37:27.267503 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2818/5622] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:26 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:27.295295 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-69980f56-d633-44d2-ac9d-06a198b82890 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 200 len: 1309 microversion: 2.1 time: 0.408183 Aug 04 14:37:27.306798 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2805/5623] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:26 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 1309 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:28.308612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e161f232-b681-48ee-a65c-cfe624d8de3f tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:28.310789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e161f232-b681-48ee-a65c-cfe624d8de3f tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:28.325155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:28.326271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:28.348847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e161f232-b681-48ee-a65c-cfe624d8de3f tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:28.354100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e161f232-b681-48ee-a65c-cfe624d8de3f tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:28.357664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e161f232-b681-48ee-a65c-cfe624d8de3f tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:28.362187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:28.364811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e161f232-b681-48ee-a65c-cfe624d8de3f tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:28.366151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:28.375361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:28.376829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:28.447109 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] HTTP exception thrown: Instance 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac could not be found. Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Request method failure captured: Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac HTTP/1.1 Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69iSXRUoZWYp0-46pCKN3GK-7JUTUND2KbHPxv5IIVnIaY-ZDdwh7a9pCE6ZqZbkE5XTK3JHE90EEpm1oYgwOotCZacBmWvSGswTdHGttgWX0UrkfD69Mz2p0igrxFTyWhyM1BP5xF_D9HQJx_ADN2nygO_ZPllQma4iYvMYgWgOxIo Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d7a554896e8947b99bf5fc6b0cc5dd4e Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesSnapshotTestJSON-971967405 Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d7a554896e8947b99bf5fc6b0cc5dd4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d7a554896e8947b99bf5fc6b0cc5dd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d7a554896e8947b99bf5fc6b0cc5dd4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d7a554896e8947b99bf5fc6b0cc5dd4e"}]}] Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesSnapshotTestJSON-971967405 Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d7a554896e8947b99bf5fc6b0cc5dd4e Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-971967405 Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesSnapshotTestJSON-971967405-project Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 68a7da502a2546e1a86028b982766fd0 Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesSnapshotTestJSON-971967405-project Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac could not be found. Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac'} Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac could not be found. Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac could not be found. Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:37:28.450700 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:28.455560 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:37:28.455560 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:37:28.455560 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:37:28.455560 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:37:28.455560 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:37:28.455560 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac could not be found. Aug 04 14:37:28.455560 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:37:28.461668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Returning 404 to user: Instance 8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:37:28.463354 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1c12081a-2f3f-4fbc-8ec2-a89a5f663da8 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac" status: 404 len: 111 microversion: 2.1 time: 0.146725 Aug 04 14:37:28.477762 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2806/5624] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:28 2022] GET /compute/v2.1/servers/8af0cccf-4613-4d0b-a1fc-7f4c0bed9cac => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:37:29.155370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e161f232-b681-48ee-a65c-cfe624d8de3f tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:29.226603 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e161f232-b681-48ee-a65c-cfe624d8de3f tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1503 microversion: 2.1 time: 0.906073 Aug 04 14:37:29.236367 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2819/5625] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:28 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1503 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:29.273570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c367edc-9aff-479f-ba8c-8327455642c5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:29.274253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c367edc-9aff-479f-ba8c-8327455642c5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:29.298649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c367edc-9aff-479f-ba8c-8327455642c5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:29.299115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c367edc-9aff-479f-ba8c-8327455642c5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:29.309999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c367edc-9aff-479f-ba8c-8327455642c5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:29.318518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c367edc-9aff-479f-ba8c-8327455642c5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:29.920295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3c367edc-9aff-479f-ba8c-8327455642c5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:29.922918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:29.944420 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c367edc-9aff-479f-ba8c-8327455642c5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1503 microversion: 2.1 time: 0.669270 Aug 04 14:37:29.945574 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2807/5626] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:29 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1503 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:29.966977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff87ea12-89d3-4400-993d-169a0d47a98c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:29.968276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff87ea12-89d3-4400-993d-169a0d47a98c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:29.977165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff87ea12-89d3-4400-993d-169a0d47a98c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:29.977938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff87ea12-89d3-4400-993d-169a0d47a98c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:29.979015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff87ea12-89d3-4400-993d-169a0d47a98c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:29.979649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff87ea12-89d3-4400-993d-169a0d47a98c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:30.006818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-ff87ea12-89d3-4400-993d-169a0d47a98c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lazy-loading 'flavor' on Instance uuid d580efc6-c804-4f2c-a70b-8e039f91d4dd {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:37:30.078839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:30.113461 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff87ea12-89d3-4400-993d-169a0d47a98c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "POST /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd/action" status: 202 len: 0 microversion: 2.1 time: 0.150550 Aug 04 14:37:30.127106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-25ab768c-164a-4b6a-bcb7-0db0776d13d5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:30.128377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-25ab768c-164a-4b6a-bcb7-0db0776d13d5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:30.132395 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2820/5627] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:37:29 2022] POST /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:37:30.152737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25ab768c-164a-4b6a-bcb7-0db0776d13d5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:30.153573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25ab768c-164a-4b6a-bcb7-0db0776d13d5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:30.163104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25ab768c-164a-4b6a-bcb7-0db0776d13d5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:30.163949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25ab768c-164a-4b6a-bcb7-0db0776d13d5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:30.933079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-25ab768c-164a-4b6a-bcb7-0db0776d13d5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:30.949517 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-25ab768c-164a-4b6a-bcb7-0db0776d13d5 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1511 microversion: 2.1 time: 0.829406 Aug 04 14:37:30.950710 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2808/5628] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:30 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1511 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:31.984040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f1eee6cb-9588-4de8-9d88-1acaa10e1277 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:31.990815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f1eee6cb-9588-4de8-9d88-1acaa10e1277 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:32.034809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1eee6cb-9588-4de8-9d88-1acaa10e1277 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:32.035285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1eee6cb-9588-4de8-9d88-1acaa10e1277 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:32.044995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1eee6cb-9588-4de8-9d88-1acaa10e1277 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:32.046274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1eee6cb-9588-4de8-9d88-1acaa10e1277 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:33.004033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f1eee6cb-9588-4de8-9d88-1acaa10e1277 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:33.017166 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f1eee6cb-9588-4de8-9d88-1acaa10e1277 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1494 microversion: 2.1 time: 1.046167 Aug 04 14:37:33.021535 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2821/5629] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:31 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1494 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:33.062336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c886c908-ded3-4f5e-b1b1-20d8ccaf96cc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:33.063567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c886c908-ded3-4f5e-b1b1-20d8ccaf96cc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:33.084260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c886c908-ded3-4f5e-b1b1-20d8ccaf96cc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:33.084716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c886c908-ded3-4f5e-b1b1-20d8ccaf96cc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:33.087357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c886c908-ded3-4f5e-b1b1-20d8ccaf96cc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:33.088152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c886c908-ded3-4f5e-b1b1-20d8ccaf96cc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:33.254302 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c886c908-ded3-4f5e-b1b1-20d8ccaf96cc tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "POST /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd/action" status: 202 len: 0 microversion: 2.1 time: 0.197285 Aug 04 14:37:33.256342 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2809/5630] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:37:33 2022] POST /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:37:33.264100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-49a5c675-d853-4209-a3cc-d8c33870474b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:33.264768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-49a5c675-d853-4209-a3cc-d8c33870474b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:33.267966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:33.279512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-49a5c675-d853-4209-a3cc-d8c33870474b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:33.279779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-49a5c675-d853-4209-a3cc-d8c33870474b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:33.287343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-49a5c675-d853-4209-a3cc-d8c33870474b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:33.288098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-49a5c675-d853-4209-a3cc-d8c33870474b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:34.539687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-49a5c675-d853-4209-a3cc-d8c33870474b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:34.554871 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-49a5c675-d853-4209-a3cc-d8c33870474b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1500 microversion: 2.1 time: 1.294608 Aug 04 14:37:34.560627 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2822/5631] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:33 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1500 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:35.588089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1585eca-1346-44ee-ac86-2e7931b5e74c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:35.592180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f1585eca-1346-44ee-ac86-2e7931b5e74c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:35.608961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:35.615507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1585eca-1346-44ee-ac86-2e7931b5e74c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:35.618019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1585eca-1346-44ee-ac86-2e7931b5e74c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:35.623400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1585eca-1346-44ee-ac86-2e7931b5e74c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:35.624701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1585eca-1346-44ee-ac86-2e7931b5e74c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:36.458433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f1585eca-1346-44ee-ac86-2e7931b5e74c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:36.494148 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f1585eca-1346-44ee-ac86-2e7931b5e74c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1500 microversion: 2.1 time: 0.915355 Aug 04 14:37:36.494805 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2810/5632] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:35 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1500 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:37.544899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0358e793-3536-4248-a0c4-fe5d0ba6a4de tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '.version_select at 0x7f46f3ba79d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:37.546440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-66722333-313f-4f61-91d9-3366a493fd2d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:37.547565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-66722333-313f-4f61-91d9-3366a493fd2d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:37.599159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66722333-313f-4f61-91d9-3366a493fd2d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:37.602076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66722333-313f-4f61-91d9-3366a493fd2d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:37.605397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66722333-313f-4f61-91d9-3366a493fd2d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:37.612067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66722333-313f-4f61-91d9-3366a493fd2d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:37.706729 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0358e793-3536-4248-a0c4-fe5d0ba6a4de tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1992561853" status: 202 len: 0 microversion: 2.1 time: 0.170659 Aug 04 14:37:37.718891 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2823/5633] 10.222.0.66 () {58 vars in 1284 bytes} [Thu Aug 4 14:37:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1992561853 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:37:37.768743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-796bbdef-2148-4711-8d6b-1fc484eafedd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'create', calling method: .version_select at 0x7f46f3153f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1846687189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBwPq/nOCzyy5NwRHv30ISmwZjnYSk6PBENCoF5ksiniSwfi9x7EiZLFgPVSxa3JGQBiCziRmJH+OovmsIg9Bjp0lGXrySTyBDUisyZpyytTwi4XvHkiKcR1UumYhj/Dw=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:37.810503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-796bbdef-2148-4711-8d6b-1fc484eafedd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:37:37.822056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-796bbdef-2148-4711-8d6b-1fc484eafedd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for user 95e5002f80224b4a804be717d5bd9d2c and project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:37:37.880058 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-796bbdef-2148-4711-8d6b-1fc484eafedd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.122624 Aug 04 14:37:37.884044 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2824/5634] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:37:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:37:38.336061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-66722333-313f-4f61-91d9-3366a493fd2d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:38.371166 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-66722333-313f-4f61-91d9-3366a493fd2d tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1503 microversion: 2.1 time: 0.837202 Aug 04 14:37:38.409574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-96bcdc47-0c67-4875-be9a-e85eaab9c47e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:38.410249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-96bcdc47-0c67-4875-be9a-e85eaab9c47e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:38.422402 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2811/5635] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:37 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1503 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:38.436416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96bcdc47-0c67-4875-be9a-e85eaab9c47e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:38.439781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96bcdc47-0c67-4875-be9a-e85eaab9c47e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:38.450671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96bcdc47-0c67-4875-be9a-e85eaab9c47e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:38.457641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96bcdc47-0c67-4875-be9a-e85eaab9c47e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:38.560182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-96bcdc47-0c67-4875-be9a-e85eaab9c47e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lazy-loading 'flavor' on Instance uuid d580efc6-c804-4f2c-a70b-8e039f91d4dd {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:37:38.852552 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-96bcdc47-0c67-4875-be9a-e85eaab9c47e tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "POST /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd/action" status: 202 len: 0 microversion: 2.1 time: 0.446831 Aug 04 14:37:38.854800 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2825/5636] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:37:38 2022] POST /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:37:38.876075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c7eb3ebb-4b43-4642-931a-0ea431c9ff0b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:38.877296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c7eb3ebb-4b43-4642-931a-0ea431c9ff0b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:38.903699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7eb3ebb-4b43-4642-931a-0ea431c9ff0b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:38.904499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7eb3ebb-4b43-4642-931a-0ea431c9ff0b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:38.906060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7eb3ebb-4b43-4642-931a-0ea431c9ff0b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:38.906919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7eb3ebb-4b43-4642-931a-0ea431c9ff0b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:39.434611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c7eb3ebb-4b43-4642-931a-0ea431c9ff0b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:39.448751 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c7eb3ebb-4b43-4642-931a-0ea431c9ff0b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1511 microversion: 2.1 time: 0.587356 Aug 04 14:37:39.449455 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2812/5637] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:38 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1511 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:40.486606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3425bb3-9666-41c8-aaf6-439e4217ab27 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:40.489329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3425bb3-9666-41c8-aaf6-439e4217ab27 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:40.538287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3425bb3-9666-41c8-aaf6-439e4217ab27 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:40.539883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3425bb3-9666-41c8-aaf6-439e4217ab27 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:40.542816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3425bb3-9666-41c8-aaf6-439e4217ab27 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:40.544419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3425bb3-9666-41c8-aaf6-439e4217ab27 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:41.242431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f3425bb3-9666-41c8-aaf6-439e4217ab27 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:41.299652 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3425bb3-9666-41c8-aaf6-439e4217ab27 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1494 microversion: 2.1 time: 0.823917 Aug 04 14:37:41.306696 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2826/5638] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:40 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1494 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:41.329398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b10e46e5-6b23-4aa8-9af4-471b4aa5d571 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:41.330314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b10e46e5-6b23-4aa8-9af4-471b4aa5d571 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:41.346238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b10e46e5-6b23-4aa8-9af4-471b4aa5d571 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:41.349222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b10e46e5-6b23-4aa8-9af4-471b4aa5d571 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:41.357857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b10e46e5-6b23-4aa8-9af4-471b4aa5d571 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:41.359361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b10e46e5-6b23-4aa8-9af4-471b4aa5d571 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:41.533792 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b10e46e5-6b23-4aa8-9af4-471b4aa5d571 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "POST /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd/action" status: 202 len: 0 microversion: 2.1 time: 0.207700 Aug 04 14:37:41.551484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-49d7e25b-fb5d-4213-97a5-4feef01ae4db tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:41.554294 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2813/5639] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:37:41 2022] POST /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:37:41.554798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-49d7e25b-fb5d-4213-97a5-4feef01ae4db tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:41.573916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-49d7e25b-fb5d-4213-97a5-4feef01ae4db tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:41.574916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-49d7e25b-fb5d-4213-97a5-4feef01ae4db tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:41.577664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-49d7e25b-fb5d-4213-97a5-4feef01ae4db tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:41.581693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-49d7e25b-fb5d-4213-97a5-4feef01ae4db tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:42.563280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-49d7e25b-fb5d-4213-97a5-4feef01ae4db tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:42.576946 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-49d7e25b-fb5d-4213-97a5-4feef01ae4db tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1500 microversion: 2.1 time: 1.034916 Aug 04 14:37:42.581329 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2827/5640] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:41 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1500 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:43.630269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f5c6ae99-9950-4dbe-9917-aaac1b77ddff tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:43.631678 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f5c6ae99-9950-4dbe-9917-aaac1b77ddff tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:43.648568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5c6ae99-9950-4dbe-9917-aaac1b77ddff tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:43.652817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5c6ae99-9950-4dbe-9917-aaac1b77ddff tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:43.654632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5c6ae99-9950-4dbe-9917-aaac1b77ddff tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:43.656468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f5c6ae99-9950-4dbe-9917-aaac1b77ddff tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:44.530643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f5c6ae99-9950-4dbe-9917-aaac1b77ddff tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:44.546387 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f5c6ae99-9950-4dbe-9917-aaac1b77ddff tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1500 microversion: 2.1 time: 0.919914 Aug 04 14:37:44.548095 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2814/5641] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:43 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1500 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:45.586139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8274b848-e044-40f9-a5fd-fc09ca322bf7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:45.586775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8274b848-e044-40f9-a5fd-fc09ca322bf7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:45.603793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8274b848-e044-40f9-a5fd-fc09ca322bf7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:45.613361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8274b848-e044-40f9-a5fd-fc09ca322bf7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:45.625297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8274b848-e044-40f9-a5fd-fc09ca322bf7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:45.626961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8274b848-e044-40f9-a5fd-fc09ca322bf7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:46.690420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8274b848-e044-40f9-a5fd-fc09ca322bf7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:46.707793 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8274b848-e044-40f9-a5fd-fc09ca322bf7 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1500 microversion: 2.1 time: 1.123864 Aug 04 14:37:46.709497 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2828/5642] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:45 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1500 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:37:46.918606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1034884235", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "60857f7f-7268-426d-929c-853eb9741a18"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:47.151799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] validate_networks() for [('60857f7f-7268-426d-929c-853eb9741a18', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:37:47.752556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d6f1e70-5a78-495f-b69b-bb700c61e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:47.760411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d6f1e70-5a78-495f-b69b-bb700c61e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:47.819136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d6f1e70-5a78-495f-b69b-bb700c61e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:47.819833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d6f1e70-5a78-495f-b69b-bb700c61e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:47.821146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d6f1e70-5a78-495f-b69b-bb700c61e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:47.821825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d6f1e70-5a78-495f-b69b-bb700c61e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:47.839490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:48.791033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d6f1e70-5a78-495f-b69b-bb700c61e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:48.804031 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d6f1e70-5a78-495f-b69b-bb700c61e947 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1503 microversion: 2.1 time: 1.058592 Aug 04 14:37:48.813050 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2829/5643] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:47 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1503 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:48.845533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64277510-9eb9-4e01-91e4-316d479788fe tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:48.846493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64277510-9eb9-4e01-91e4-316d479788fe tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:48.868901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64277510-9eb9-4e01-91e4-316d479788fe tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:48.873287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64277510-9eb9-4e01-91e4-316d479788fe tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:48.874433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64277510-9eb9-4e01-91e4-316d479788fe tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:48.877594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64277510-9eb9-4e01-91e4-316d479788fe tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:48.948404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64277510-9eb9-4e01-91e4-316d479788fe tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:37:49.013912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:37:49.014700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:37:49.014892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:37:49.015331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:37:49.015980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:37:49.039183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:49.041908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:49.044552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:49.046612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:49.132395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Getting quotas for project d7a554896e8947b99bf5fc6b0cc5dd4e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:37:49.165840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Getting quotas for user 68a7da502a2546e1a86028b982766fd0 and project d7a554896e8947b99bf5fc6b0cc5dd4e. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:37:49.207700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-64277510-9eb9-4e01-91e4-316d479788fe tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 204 len: 0 microversion: 2.1 time: 0.365518 Aug 04 14:37:49.208773 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2830/5644] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:37:48 2022] DELETE /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:37:49.221147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fc42b4b3-8bb6-42ae-bfff-7ffaf02e0d4c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:49.222215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fc42b4b3-8bb6-42ae-bfff-7ffaf02e0d4c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:49.229018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:37:49.240178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc42b4b3-8bb6-42ae-bfff-7ffaf02e0d4c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:49.240707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc42b4b3-8bb6-42ae-bfff-7ffaf02e0d4c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:49.241589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc42b4b3-8bb6-42ae-bfff-7ffaf02e0d4c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:49.242245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fc42b4b3-8bb6-42ae-bfff-7ffaf02e0d4c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:49.253790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:37:49.449665 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3105809-6993-48f9-bb00-f4560a00635b tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.540441 Aug 04 14:37:49.452079 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2815/5645] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:37:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:37:49.477688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eb657391-3427-4089-8d22-1b54427c9c6e tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:49.482077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eb657391-3427-4089-8d22-1b54427c9c6e tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:49.671798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eb657391-3427-4089-8d22-1b54427c9c6e tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:49.685930 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eb657391-3427-4089-8d22-1b54427c9c6e tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1219 microversion: 2.1 time: 0.225828 Aug 04 14:37:49.686844 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2816/5646] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:49 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1219 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:49.938625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fc42b4b3-8bb6-42ae-bfff-7ffaf02e0d4c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:49.968080 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fc42b4b3-8bb6-42ae-bfff-7ffaf02e0d4c tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1509 microversion: 2.1 time: 0.739311 Aug 04 14:37:49.971018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2831/5647] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:49 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1509 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:37:50.713246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fa24d5e8-2005-43c4-996c-4cd37e606216 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:50.715357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fa24d5e8-2005-43c4-996c-4cd37e606216 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:50.865342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fa24d5e8-2005-43c4-996c-4cd37e606216 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:50.877135 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fa24d5e8-2005-43c4-996c-4cd37e606216 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1219 microversion: 2.1 time: 0.171864 Aug 04 14:37:50.878355 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2817/5648] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:50 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:51.012708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33cbcb42-c8f0-424f-b99a-37702e80ab82 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:51.014599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-33cbcb42-c8f0-424f-b99a-37702e80ab82 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:51.049591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33cbcb42-c8f0-424f-b99a-37702e80ab82 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:51.054997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33cbcb42-c8f0-424f-b99a-37702e80ab82 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:51.058370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33cbcb42-c8f0-424f-b99a-37702e80ab82 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:51.065015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33cbcb42-c8f0-424f-b99a-37702e80ab82 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:51.708978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-33cbcb42-c8f0-424f-b99a-37702e80ab82 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:51.737821 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-33cbcb42-c8f0-424f-b99a-37702e80ab82 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1509 microversion: 2.1 time: 0.729901 Aug 04 14:37:51.754137 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2832/5649] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:51 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1509 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:52.308656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e552c8a6-1e0f-4239-a8ff-339e1f78e891 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:52.309545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e552c8a6-1e0f-4239-a8ff-339e1f78e891 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:52.326301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e552c8a6-1e0f-4239-a8ff-339e1f78e891 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:52.326959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e552c8a6-1e0f-4239-a8ff-339e1f78e891 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:52.329712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e552c8a6-1e0f-4239-a8ff-339e1f78e891 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:52.330187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e552c8a6-1e0f-4239-a8ff-339e1f78e891 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:52.643247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e552c8a6-1e0f-4239-a8ff-339e1f78e891 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:52.652712 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e552c8a6-1e0f-4239-a8ff-339e1f78e891 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1279 microversion: 2.1 time: 0.758489 Aug 04 14:37:52.657816 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2818/5650] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:51 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1279 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:52.763439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7278c7f9-6612-46fe-bd05-65dd3dbca1b6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:52.771367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7278c7f9-6612-46fe-bd05-65dd3dbca1b6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:52.795660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7278c7f9-6612-46fe-bd05-65dd3dbca1b6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:52.804635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7278c7f9-6612-46fe-bd05-65dd3dbca1b6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:52.806178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7278c7f9-6612-46fe-bd05-65dd3dbca1b6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:52.806974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7278c7f9-6612-46fe-bd05-65dd3dbca1b6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:53.182854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fad1b4a1-0b1e-4dd1-b71a-6238b3f1813d req-197f7e76-ac74-44ab-b4dc-9ce8effed82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d580efc6-c804-4f2c-a70b-8e039f91d4dd", "name": "network-vif-deleted", "tag": "bbae24b7-2c18-493b-9926-caee3b1529b3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:37:53.239159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fad1b4a1-0b1e-4dd1-b71a-6238b3f1813d req-197f7e76-ac74-44ab-b4dc-9ce8effed82f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:53.239968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fad1b4a1-0b1e-4dd1-b71a-6238b3f1813d req-197f7e76-ac74-44ab-b4dc-9ce8effed82f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:53.267484 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fad1b4a1-0b1e-4dd1-b71a-6238b3f1813d req-197f7e76-ac74-44ab-b4dc-9ce8effed82f service nova] Creating event network-vif-deleted:bbae24b7-2c18-493b-9926-caee3b1529b3 for instance d580efc6-c804-4f2c-a70b-8e039f91d4dd on n-h2-844627-10 Aug 04 14:37:53.281523 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fad1b4a1-0b1e-4dd1-b71a-6238b3f1813d req-197f7e76-ac74-44ab-b4dc-9ce8effed82f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106725 Aug 04 14:37:53.284187 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2819/5651] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:37:53.325399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7278c7f9-6612-46fe-bd05-65dd3dbca1b6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1ecdbca0acb445393ec27187ef75a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a884f094e71b4366a1053c99bfd9a801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:53.341935 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7278c7f9-6612-46fe-bd05-65dd3dbca1b6 tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 200 len: 1467 microversion: 2.1 time: 0.582584 Aug 04 14:37:53.344318 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2833/5652] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:52 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 1467 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:53.701067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-742890be-e451-43cf-a466-26476dab2e14 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:53.702343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-742890be-e451-43cf-a466-26476dab2e14 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:53.745753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-742890be-e451-43cf-a466-26476dab2e14 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:53.746448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-742890be-e451-43cf-a466-26476dab2e14 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:53.748042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-742890be-e451-43cf-a466-26476dab2e14 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:53.762716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-742890be-e451-43cf-a466-26476dab2e14 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:54.095714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-742890be-e451-43cf-a466-26476dab2e14 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:54.124015 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-742890be-e451-43cf-a466-26476dab2e14 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1277 microversion: 2.1 time: 0.430763 Aug 04 14:37:54.136497 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2820/5653] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:53 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1277 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:54.385132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:54.387722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] [instance: d580efc6-c804-4f2c-a70b-8e039f91d4dd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:54.415901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:54.420514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:54.422967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:54.423437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:54.468217 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] HTTP exception thrown: Instance d580efc6-c804-4f2c-a70b-8e039f91d4dd could not be found. Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Request method failure captured: Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd HTTP/1.1 Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69mJcKHgqnCKhI00MMwHZmL8ORJbjR6jnRjdPduuvHZACho1rntvG4jtO7tdju7e4k32TTIvK4XBMWb_Lr0_N31-txOgEKAgsjJP_lVxcfl1Imh_TdRRiRhdRf45p76BvyiCJukAYxTHpoO-FuOl4J6iumRo4ToJmn67buhhQ8UrYPE Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: a884f094e71b4366a1053c99bfd9a801 Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestServerAdvancedOps-1517073462 Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a884f094e71b4366a1053c99bfd9a801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a884f094e71b4366a1053c99bfd9a801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a884f094e71b4366a1053c99bfd9a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a884f094e71b4366a1053c99bfd9a801"}]}] Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestServerAdvancedOps-1517073462 Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: a884f094e71b4366a1053c99bfd9a801 Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestServerAdvancedOps-1517073462 Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestServerAdvancedOps-1517073462-project Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: d1ecdbca0acb445393ec27187ef75a1b Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestServerAdvancedOps-1517073462-project Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance d580efc6-c804-4f2c-a70b-8e039f91d4dd could not be found. Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'd580efc6-c804-4f2c-a70b-8e039f91d4dd'} Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d580efc6-c804-4f2c-a70b-8e039f91d4dd could not be found. Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d580efc6-c804-4f2c-a70b-8e039f91d4dd could not be found. Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:37:54.473919 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:37:54.479403 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:37:54.479403 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:37:54.479403 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:37:54.479403 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:37:54.479403 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:37:54.479403 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d580efc6-c804-4f2c-a70b-8e039f91d4dd could not be found. Aug 04 14:37:54.479403 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:37:54.481449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] Returning 404 to user: Instance d580efc6-c804-4f2c-a70b-8e039f91d4dd could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:37:54.482596 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb67fcc4-ef14-4de6-8bcc-3b31855b114b tempest-TestServerAdvancedOps-1517073462 tempest-TestServerAdvancedOps-1517073462-project] 10.222.0.66 "GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd" status: 404 len: 111 microversion: 2.1 time: 0.102556 Aug 04 14:37:54.487928 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2834/5654] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:54 2022] GET /compute/v2.1/servers/d580efc6-c804-4f2c-a70b-8e039f91d4dd => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:37:55.169593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70a255e7-dc31-4300-81cb-969847cd3f37 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:55.174237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70a255e7-dc31-4300-81cb-969847cd3f37 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:55.267547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70a255e7-dc31-4300-81cb-969847cd3f37 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:55.270115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70a255e7-dc31-4300-81cb-969847cd3f37 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:55.276544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70a255e7-dc31-4300-81cb-969847cd3f37 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:55.285703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70a255e7-dc31-4300-81cb-969847cd3f37 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:56.078913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-70a255e7-dc31-4300-81cb-969847cd3f37 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:56.090496 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70a255e7-dc31-4300-81cb-969847cd3f37 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1319 microversion: 2.1 time: 0.932415 Aug 04 14:37:56.098147 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2821/5655] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:55 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1319 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:57.137001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0d2631bd-e36b-4183-afce-2b053514a908 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:57.138066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0d2631bd-e36b-4183-afce-2b053514a908 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:57.180192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d2631bd-e36b-4183-afce-2b053514a908 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:57.188001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d2631bd-e36b-4183-afce-2b053514a908 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:57.190060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d2631bd-e36b-4183-afce-2b053514a908 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:57.192531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d2631bd-e36b-4183-afce-2b053514a908 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:58.436240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0d2631bd-e36b-4183-afce-2b053514a908 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:37:58.466279 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0d2631bd-e36b-4183-afce-2b053514a908 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1319 microversion: 2.1 time: 1.335773 Aug 04 14:37:58.467409 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2835/5656] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:57 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1319 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:37:59.502134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d94a1b6a-7a6a-43e8-bdd2-93d1a7413219 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:37:59.510460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d94a1b6a-7a6a-43e8-bdd2-93d1a7413219 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:37:59.522702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:37:59.552939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d94a1b6a-7a6a-43e8-bdd2-93d1a7413219 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:59.562696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d94a1b6a-7a6a-43e8-bdd2-93d1a7413219 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:37:59.565327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d94a1b6a-7a6a-43e8-bdd2-93d1a7413219 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:37:59.570714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d94a1b6a-7a6a-43e8-bdd2-93d1a7413219 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:00.872764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=10 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:01.943747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d94a1b6a-7a6a-43e8-bdd2-93d1a7413219 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:01.954798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:01.995380 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d94a1b6a-7a6a-43e8-bdd2-93d1a7413219 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1319 microversion: 2.1 time: 2.503127 Aug 04 14:38:02.001268 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2822/5657] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:37:59 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1319 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:02.907531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-9ef8e20b-77df-4887-b890-e60a52257de8 req-fb1fab89-6e94-43a4-bf45-280a12460726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8867b277-2546-4d56-a227-9211b712967d", "tag": "574d4fd5-bce4-433c-b20d-d34555be9e62"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:38:02.965976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9ef8e20b-77df-4887-b890-e60a52257de8 req-fb1fab89-6e94-43a4-bf45-280a12460726 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:02.969761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9ef8e20b-77df-4887-b890-e60a52257de8 req-fb1fab89-6e94-43a4-bf45-280a12460726 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:03.009858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:03.014123 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9ef8e20b-77df-4887-b890-e60a52257de8 req-fb1fab89-6e94-43a4-bf45-280a12460726 service nova] Creating event network-changed:574d4fd5-bce4-433c-b20d-d34555be9e62 for instance 8867b277-2546-4d56-a227-9211b712967d on n-h1-844627-10 Aug 04 14:38:03.025807 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-9ef8e20b-77df-4887-b890-e60a52257de8 req-fb1fab89-6e94-43a4-bf45-280a12460726 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126177 Aug 04 14:38:03.028388 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2836/5658] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:38:03.052490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-17d387f4-9067-4db8-b224-64de1fc35d06 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:03.055283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-17d387f4-9067-4db8-b224-64de1fc35d06 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:03.080340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17d387f4-9067-4db8-b224-64de1fc35d06 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:03.083781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17d387f4-9067-4db8-b224-64de1fc35d06 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:03.085802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17d387f4-9067-4db8-b224-64de1fc35d06 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:03.087274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-17d387f4-9067-4db8-b224-64de1fc35d06 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:03.792690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-17d387f4-9067-4db8-b224-64de1fc35d06 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:03.809520 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-17d387f4-9067-4db8-b224-64de1fc35d06 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1319 microversion: 2.1 time: 0.772049 Aug 04 14:38:03.811737 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2823/5659] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:03 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1319 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:38:04.834297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-edcdce12-f223-49be-bcd6-41d348c10f33 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:04.835078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-edcdce12-f223-49be-bcd6-41d348c10f33 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:04.840285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:04.904247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edcdce12-f223-49be-bcd6-41d348c10f33 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:04.914730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edcdce12-f223-49be-bcd6-41d348c10f33 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:04.917300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edcdce12-f223-49be-bcd6-41d348c10f33 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:04.924048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-edcdce12-f223-49be-bcd6-41d348c10f33 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:05.105791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-965553901", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "166c6ede-5b70-48b7-a03b-538f4182b83b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1846687189", "security_groups": [{"name": "tempest-secgroup-smoke-1567023284"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:38:05.745696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] validate_networks() for [('166c6ede-5b70-48b7-a03b-538f4182b83b', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:38:05.807069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-edcdce12-f223-49be-bcd6-41d348c10f33 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:05.880494 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-edcdce12-f223-49be-bcd6-41d348c10f33 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1319 microversion: 2.1 time: 1.051708 Aug 04 14:38:05.884431 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2837/5660] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:04 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1319 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:06.669583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:06.918467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-af8056f2-f090-4459-b249-650e53c11818 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:06.930282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-af8056f2-f090-4459-b249-650e53c11818 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:06.961415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af8056f2-f090-4459-b249-650e53c11818 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:06.966786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af8056f2-f090-4459-b249-650e53c11818 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:06.972516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af8056f2-f090-4459-b249-650e53c11818 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:06.981419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af8056f2-f090-4459-b249-650e53c11818 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:07.711262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-af8056f2-f090-4459-b249-650e53c11818 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:07.724364 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-af8056f2-f090-4459-b249-650e53c11818 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1319 microversion: 2.1 time: 0.811958 Aug 04 14:38:07.725108 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2838/5661] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:06 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1319 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:07.747815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:38:07.748335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:38:07.749119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:38:07.749914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:38:07.750355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:38:07.774565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:07.776435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:07.777450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:07.777916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:07.845510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:38:07.863979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for user 95e5002f80224b4a804be717d5bd9d2c and project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:38:07.897829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:38:07.909218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:38:08.073437 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b43cbeb8-6a7f-45aa-b965-9a4b49671a85 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.972336 Aug 04 14:38:08.080831 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2824/5662] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:38:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 2981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:38:08.093447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a221c508-a220-43b4-b3bf-41635a436e2d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:08.094285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a221c508-a220-43b4-b3bf-41635a436e2d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:08.290914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a221c508-a220-43b4-b3bf-41635a436e2d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:08.300393 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a221c508-a220-43b4-b3bf-41635a436e2d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1266 microversion: 2.1 time: 0.211656 Aug 04 14:38:08.306089 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2839/5663] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:08 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:08.756482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-764ebe2f-a60d-4166-9d87-890ef4351179 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:08.761840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-764ebe2f-a60d-4166-9d87-890ef4351179 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:08.827467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-764ebe2f-a60d-4166-9d87-890ef4351179 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:08.829022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-764ebe2f-a60d-4166-9d87-890ef4351179 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:08.831800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-764ebe2f-a60d-4166-9d87-890ef4351179 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:08.837967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-764ebe2f-a60d-4166-9d87-890ef4351179 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:09.332698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21821000-1820-44b9-9352-bf496a1a3cd3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:09.342408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-21821000-1820-44b9-9352-bf496a1a3cd3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:09.605031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-764ebe2f-a60d-4166-9d87-890ef4351179 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:09.609320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-21821000-1820-44b9-9352-bf496a1a3cd3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:09.619407 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-764ebe2f-a60d-4166-9d87-890ef4351179 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1319 microversion: 2.1 time: 0.874835 Aug 04 14:38:09.626195 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2825/5664] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:08 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1319 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:09.699291 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-21821000-1820-44b9-9352-bf496a1a3cd3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1266 microversion: 2.1 time: 0.327745 Aug 04 14:38:09.700230 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2840/5665] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:09 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:38:10.665452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4e770550-c984-426e-b504-f26b392b2d36 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:10.666634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4e770550-c984-426e-b504-f26b392b2d36 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:10.716069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e770550-c984-426e-b504-f26b392b2d36 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:10.719929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e770550-c984-426e-b504-f26b392b2d36 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:10.725685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e770550-c984-426e-b504-f26b392b2d36 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:10.728554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4e770550-c984-426e-b504-f26b392b2d36 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:10.738767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0886660b-b8db-4770-a6f7-fc9c7774b307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:10.739739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0886660b-b8db-4770-a6f7-fc9c7774b307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:10.768756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0886660b-b8db-4770-a6f7-fc9c7774b307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:10.770223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0886660b-b8db-4770-a6f7-fc9c7774b307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:10.771369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0886660b-b8db-4770-a6f7-fc9c7774b307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:10.772005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0886660b-b8db-4770-a6f7-fc9c7774b307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:11.268364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0886660b-b8db-4770-a6f7-fc9c7774b307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:11.292630 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0886660b-b8db-4770-a6f7-fc9c7774b307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1318 microversion: 2.1 time: 0.556278 Aug 04 14:38:11.292630 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2841/5666] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:10 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:38:11.853688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4e770550-c984-426e-b504-f26b392b2d36 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:11.898607 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4e770550-c984-426e-b504-f26b392b2d36 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1319 microversion: 2.1 time: 1.244629 Aug 04 14:38:11.899695 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2826/5667] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:10 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1319 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:12.106578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0a8c34eb-37db-475c-8a94-26df89124630 req-368d617f-f57c-4498-b8e7-1457cd48ddea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8867b277-2546-4d56-a227-9211b712967d", "name": "network-vif-plugged", "status": "completed", "tag": "574d4fd5-bce4-433c-b20d-d34555be9e62"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:38:12.177296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0a8c34eb-37db-475c-8a94-26df89124630 req-368d617f-f57c-4498-b8e7-1457cd48ddea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:12.184029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0a8c34eb-37db-475c-8a94-26df89124630 req-368d617f-f57c-4498-b8e7-1457cd48ddea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:12.235945 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0a8c34eb-37db-475c-8a94-26df89124630 req-368d617f-f57c-4498-b8e7-1457cd48ddea service nova] Creating event network-vif-plugged:574d4fd5-bce4-433c-b20d-d34555be9e62 for instance 8867b277-2546-4d56-a227-9211b712967d on n-h1-844627-10 Aug 04 14:38:12.253052 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0a8c34eb-37db-475c-8a94-26df89124630 req-368d617f-f57c-4498-b8e7-1457cd48ddea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149732 Aug 04 14:38:12.254465 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2842/5668] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:38:12.325968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f14bd1e6-2ccd-48da-8081-8bf50219f307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:12.326764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f14bd1e6-2ccd-48da-8081-8bf50219f307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:12.353021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f14bd1e6-2ccd-48da-8081-8bf50219f307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:12.355093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f14bd1e6-2ccd-48da-8081-8bf50219f307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:12.358117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f14bd1e6-2ccd-48da-8081-8bf50219f307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:12.369842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f14bd1e6-2ccd-48da-8081-8bf50219f307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:12.873619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f14bd1e6-2ccd-48da-8081-8bf50219f307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:12.899424 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f14bd1e6-2ccd-48da-8081-8bf50219f307 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1324 microversion: 2.1 time: 0.578037 Aug 04 14:38:12.900047 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2827/5669] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:12 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1324 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:38:12.927426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f2b55da-ffc4-4682-a892-961b1bbec133 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:12.928542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f2b55da-ffc4-4682-a892-961b1bbec133 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:12.958448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f2b55da-ffc4-4682-a892-961b1bbec133 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:12.959852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f2b55da-ffc4-4682-a892-961b1bbec133 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:12.961890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f2b55da-ffc4-4682-a892-961b1bbec133 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:12.962985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f2b55da-ffc4-4682-a892-961b1bbec133 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:13.589486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5f2b55da-ffc4-4682-a892-961b1bbec133 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:13.622326 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f2b55da-ffc4-4682-a892-961b1bbec133 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1319 microversion: 2.1 time: 0.703964 Aug 04 14:38:13.622947 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2843/5670] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:12 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:13.929403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8610833a-fd9d-4419-bb5a-0f208b30863d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:13.930932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8610833a-fd9d-4419-bb5a-0f208b30863d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:13.953292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8610833a-fd9d-4419-bb5a-0f208b30863d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:13.954660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8610833a-fd9d-4419-bb5a-0f208b30863d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:13.955711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8610833a-fd9d-4419-bb5a-0f208b30863d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:13.958721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8610833a-fd9d-4419-bb5a-0f208b30863d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:14.115795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8610833a-fd9d-4419-bb5a-0f208b30863d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:14.133630 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8610833a-fd9d-4419-bb5a-0f208b30863d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1324 microversion: 2.1 time: 0.205739 Aug 04 14:38:14.144919 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2828/5671] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:13 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1324 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:14.665673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9af23083-b780-4aaf-8550-d273a08c45da tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:14.667096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9af23083-b780-4aaf-8550-d273a08c45da tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:14.684829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9af23083-b780-4aaf-8550-d273a08c45da tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:14.687742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9af23083-b780-4aaf-8550-d273a08c45da tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:14.689934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9af23083-b780-4aaf-8550-d273a08c45da tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:14.692383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9af23083-b780-4aaf-8550-d273a08c45da tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:15.040441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9af23083-b780-4aaf-8550-d273a08c45da tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:15.058460 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9af23083-b780-4aaf-8550-d273a08c45da tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1508 microversion: 2.1 time: 0.398484 Aug 04 14:38:15.075229 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2844/5672] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:14 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1508 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:15.085265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f1641b5-4fa8-46fe-a4f5-cb59047ed631 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "705a11ab-d9ee-4bac-8e29-d3c544f15ff0", "device": "/dev/sdb"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:38:15.089305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f1641b5-4fa8-46fe-a4f5-cb59047ed631 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:15.098768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f1641b5-4fa8-46fe-a4f5-cb59047ed631 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:15.099740 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f1641b5-4fa8-46fe-a4f5-cb59047ed631 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:15.100567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f1641b5-4fa8-46fe-a4f5-cb59047ed631 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:15.101069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f1641b5-4fa8-46fe-a4f5-cb59047ed631 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:15.180501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5061ee16-5a9c-401d-9b9b-1523a9a166b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:15.181255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5061ee16-5a9c-401d-9b9b-1523a9a166b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:15.201438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5061ee16-5a9c-401d-9b9b-1523a9a166b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:15.201959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5061ee16-5a9c-401d-9b9b-1523a9a166b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:15.202878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5061ee16-5a9c-401d-9b9b-1523a9a166b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:15.203351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5061ee16-5a9c-401d-9b9b-1523a9a166b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:15.728145 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f1641b5-4fa8-46fe-a4f5-cb59047ed631 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "POST /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647075 Aug 04 14:38:15.734360 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2829/5673] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:38:15 2022] POST /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:38:18.233466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5061ee16-5a9c-401d-9b9b-1523a9a166b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:18.250339 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5061ee16-5a9c-401d-9b9b-1523a9a166b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 3.075117 Aug 04 14:38:18.256468 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2845/5674] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:15 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 3082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:19.278791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5c42e7d7-49c5-4dca-811d-2744c9a2ab77 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:19.279737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5c42e7d7-49c5-4dca-811d-2744c9a2ab77 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:19.282925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:19.299644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:19.307293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c42e7d7-49c5-4dca-811d-2744c9a2ab77 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:19.326939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c42e7d7-49c5-4dca-811d-2744c9a2ab77 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:19.328091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c42e7d7-49c5-4dca-811d-2744c9a2ab77 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:19.332834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c42e7d7-49c5-4dca-811d-2744c9a2ab77 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:19.438998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a99e7524-9f03-49df-bedd-0899ecc32da1 req-6d1a9613-cd21-40bf-962b-cb1253bb5fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:38:19.489501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a99e7524-9f03-49df-bedd-0899ecc32da1 req-6d1a9613-cd21-40bf-962b-cb1253bb5fbf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:19.490637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a99e7524-9f03-49df-bedd-0899ecc32da1 req-6d1a9613-cd21-40bf-962b-cb1253bb5fbf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:19.535597 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a99e7524-9f03-49df-bedd-0899ecc32da1 req-6d1a9613-cd21-40bf-962b-cb1253bb5fbf service nova] Creating event network-changed:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h2-844627-10 Aug 04 14:38:19.546586 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a99e7524-9f03-49df-bedd-0899ecc32da1 req-6d1a9613-cd21-40bf-962b-cb1253bb5fbf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110996 Aug 04 14:38:19.549222 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2846/5675] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:38:20.791028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5c42e7d7-49c5-4dca-811d-2744c9a2ab77 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:20.802477 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5c42e7d7-49c5-4dca-811d-2744c9a2ab77 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 1.528589 Aug 04 14:38:20.804463 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2830/5676] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:19 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:21.853384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-01fb0c9a-5f12-47cd-9eee-d1c7a73daea5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:21.854922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-01fb0c9a-5f12-47cd-9eee-d1c7a73daea5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:21.861314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:21.898481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01fb0c9a-5f12-47cd-9eee-d1c7a73daea5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:21.899440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01fb0c9a-5f12-47cd-9eee-d1c7a73daea5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:21.902634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01fb0c9a-5f12-47cd-9eee-d1c7a73daea5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:21.905085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01fb0c9a-5f12-47cd-9eee-d1c7a73daea5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:22.920096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-01fb0c9a-5f12-47cd-9eee-d1c7a73daea5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:22.940712 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-01fb0c9a-5f12-47cd-9eee-d1c7a73daea5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 1.088899 Aug 04 14:38:22.942072 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2847/5677] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:21 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:23.969146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-131b6548-9378-4ac5-84fe-e246fce0cc10 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:23.973809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-131b6548-9378-4ac5-84fe-e246fce0cc10 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:24.039447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-131b6548-9378-4ac5-84fe-e246fce0cc10 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:24.040261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-131b6548-9378-4ac5-84fe-e246fce0cc10 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:24.053996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-131b6548-9378-4ac5-84fe-e246fce0cc10 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:24.055063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-131b6548-9378-4ac5-84fe-e246fce0cc10 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:27.202941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-131b6548-9378-4ac5-84fe-e246fce0cc10 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:27.270632 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-131b6548-9378-4ac5-84fe-e246fce0cc10 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 3.305567 Aug 04 14:38:27.273527 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2831/5678] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:23 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 3315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:28.311543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-90197c5d-b7a9-4b65-a380-65aea98cb9fe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:28.315402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-90197c5d-b7a9-4b65-a380-65aea98cb9fe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:28.355609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90197c5d-b7a9-4b65-a380-65aea98cb9fe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:28.357466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90197c5d-b7a9-4b65-a380-65aea98cb9fe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:28.360663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90197c5d-b7a9-4b65-a380-65aea98cb9fe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:28.362162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-90197c5d-b7a9-4b65-a380-65aea98cb9fe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:28.990293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-90197c5d-b7a9-4b65-a380-65aea98cb9fe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:29.000718 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-90197c5d-b7a9-4b65-a380-65aea98cb9fe tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 0.705013 Aug 04 14:38:29.021557 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2848/5679] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:28 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:30.045613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df0b7f18-95c3-4f2c-bacb-282a12f441e9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:30.058576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-df0b7f18-95c3-4f2c-bacb-282a12f441e9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:30.165877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df0b7f18-95c3-4f2c-bacb-282a12f441e9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:30.169168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df0b7f18-95c3-4f2c-bacb-282a12f441e9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:30.173427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df0b7f18-95c3-4f2c-bacb-282a12f441e9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:30.174764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df0b7f18-95c3-4f2c-bacb-282a12f441e9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:31.122266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-df0b7f18-95c3-4f2c-bacb-282a12f441e9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:31.137895 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-df0b7f18-95c3-4f2c-bacb-282a12f441e9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 1.107078 Aug 04 14:38:31.150775 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2832/5680] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:30 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:32.176257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca34cbb7-511c-40c9-8f27-76831b82e668 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:32.181559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ca34cbb7-511c-40c9-8f27-76831b82e668 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:32.222822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca34cbb7-511c-40c9-8f27-76831b82e668 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:32.227372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca34cbb7-511c-40c9-8f27-76831b82e668 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:32.230097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca34cbb7-511c-40c9-8f27-76831b82e668 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:32.244014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca34cbb7-511c-40c9-8f27-76831b82e668 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:33.696145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ca34cbb7-511c-40c9-8f27-76831b82e668 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:33.707960 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca34cbb7-511c-40c9-8f27-76831b82e668 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 1.550447 Aug 04 14:38:33.712329 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2849/5681] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:32 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:34.729689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-39198bb8-d6e3-44e8-af8f-9219b399e696 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:34.730866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-39198bb8-d6e3-44e8-af8f-9219b399e696 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:34.753846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39198bb8-d6e3-44e8-af8f-9219b399e696 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:34.754482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39198bb8-d6e3-44e8-af8f-9219b399e696 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:34.755511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39198bb8-d6e3-44e8-af8f-9219b399e696 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:34.756204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-39198bb8-d6e3-44e8-af8f-9219b399e696 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:34.772046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:35.713048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-39198bb8-d6e3-44e8-af8f-9219b399e696 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:35.732647 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-39198bb8-d6e3-44e8-af8f-9219b399e696 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 1.007050 Aug 04 14:38:35.745345 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2833/5682] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:34 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:36.759326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c62530d-613c-4005-bbba-a49f5e8ce08a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:36.760679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0c62530d-613c-4005-bbba-a49f5e8ce08a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:36.777954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-67f44e69-a3dd-4c04-ac06-e738ae094de3 req-6766cf0f-7238-46f7-bb31-2fe9b059c05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "name": "network-vif-plugged", "status": "completed", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:38:36.797830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:36.798867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=30 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:36.811497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c62530d-613c-4005-bbba-a49f5e8ce08a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:36.815283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c62530d-613c-4005-bbba-a49f5e8ce08a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:36.818284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c62530d-613c-4005-bbba-a49f5e8ce08a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:36.834595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c62530d-613c-4005-bbba-a49f5e8ce08a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:36.856278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=60 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:38:36.858266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-67f44e69-a3dd-4c04-ac06-e738ae094de3 req-6766cf0f-7238-46f7-bb31-2fe9b059c05c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:36.858942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-67f44e69-a3dd-4c04-ac06-e738ae094de3 req-6766cf0f-7238-46f7-bb31-2fe9b059c05c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:36.946911 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-67f44e69-a3dd-4c04-ac06-e738ae094de3 req-6766cf0f-7238-46f7-bb31-2fe9b059c05c service nova] Creating event network-vif-plugged:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h2-844627-10 Aug 04 14:38:36.982755 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-67f44e69-a3dd-4c04-ac06-e738ae094de3 req-6766cf0f-7238-46f7-bb31-2fe9b059c05c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209036 Aug 04 14:38:36.985315 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2834/5683] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:38:38.658880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0c62530d-613c-4005-bbba-a49f5e8ce08a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:38.702529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c62530d-613c-4005-bbba-a49f5e8ce08a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 1.947142 Aug 04 14:38:38.718329 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2850/5684] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:36 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:39.741641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8c96a19a-fd08-4693-b16b-880e6b37e367 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:39.743133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8c96a19a-fd08-4693-b16b-880e6b37e367 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:39.771909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c96a19a-fd08-4693-b16b-880e6b37e367 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:39.772375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c96a19a-fd08-4693-b16b-880e6b37e367 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:39.786087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c96a19a-fd08-4693-b16b-880e6b37e367 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:39.786565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8c96a19a-fd08-4693-b16b-880e6b37e367 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:40.374720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8c96a19a-fd08-4693-b16b-880e6b37e367 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:40.391730 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8c96a19a-fd08-4693-b16b-880e6b37e367 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1392 microversion: 2.1 time: 0.656543 Aug 04 14:38:40.403839 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2835/5685] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:39 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1392 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:41.424827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3032c590-ad19-4b38-aecd-8fd81c4e778c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:41.430748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3032c590-ad19-4b38-aecd-8fd81c4e778c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:41.465835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3032c590-ad19-4b38-aecd-8fd81c4e778c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:41.467287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3032c590-ad19-4b38-aecd-8fd81c4e778c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:41.469372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3032c590-ad19-4b38-aecd-8fd81c4e778c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:41.481965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3032c590-ad19-4b38-aecd-8fd81c4e778c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:42.274656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3032c590-ad19-4b38-aecd-8fd81c4e778c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:42.311251 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3032c590-ad19-4b38-aecd-8fd81c4e778c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1563 microversion: 2.1 time: 0.893562 Aug 04 14:38:42.316249 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2851/5686] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:41 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1563 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:38:42.354987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42c0fd0c-e06a-4ad8-af6d-1619c9cdacad tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:38:42.357267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-42c0fd0c-e06a-4ad8-af6d-1619c9cdacad tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:38:42.369825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42c0fd0c-e06a-4ad8-af6d-1619c9cdacad tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:42.375222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42c0fd0c-e06a-4ad8-af6d-1619c9cdacad tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:42.376379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42c0fd0c-e06a-4ad8-af6d-1619c9cdacad tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:38:42.377208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42c0fd0c-e06a-4ad8-af6d-1619c9cdacad tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:38:45.364962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-42c0fd0c-e06a-4ad8-af6d-1619c9cdacad tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:38:45.418784 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-42c0fd0c-e06a-4ad8-af6d-1619c9cdacad tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1563 microversion: 2.1 time: 3.038238 Aug 04 14:38:45.427795 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2836/5687] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:38:42 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1563 bytes in 3075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:04.127195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-35e7aee2-96c0-4fc4-b7ef-462a28492f0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:04.129236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-35e7aee2-96c0-4fc4-b7ef-462a28492f0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:04.141247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:39:04.144015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=11 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:39:04.148022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35e7aee2-96c0-4fc4-b7ef-462a28492f0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:04.149265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35e7aee2-96c0-4fc4-b7ef-462a28492f0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:04.150767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35e7aee2-96c0-4fc4-b7ef-462a28492f0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:04.151939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-35e7aee2-96c0-4fc4-b7ef-462a28492f0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:04.184365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8013952e-7c8f-469b-8429-cb4a6c2591d6 req-faf8a4d9-9115-4a03-bc73-0c48a494edd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:04.213543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=5 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:39:04.222471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=19 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:39:04.284532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8013952e-7c8f-469b-8429-cb4a6c2591d6 req-faf8a4d9-9115-4a03-bc73-0c48a494edd5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:04.285213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8013952e-7c8f-469b-8429-cb4a6c2591d6 req-faf8a4d9-9115-4a03-bc73-0c48a494edd5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:04.334113 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8013952e-7c8f-469b-8429-cb4a6c2591d6 req-faf8a4d9-9115-4a03-bc73-0c48a494edd5 service nova] Creating event network-changed:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h2-844627-10 Aug 04 14:39:04.351052 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8013952e-7c8f-469b-8429-cb4a6c2591d6 req-faf8a4d9-9115-4a03-bc73-0c48a494edd5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172661 Aug 04 14:39:04.365541 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2837/5688] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:39:06.144218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-35e7aee2-96c0-4fc4-b7ef-462a28492f0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:06.158923 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-35e7aee2-96c0-4fc4-b7ef-462a28492f0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1681 microversion: 2.1 time: 2.040355 Aug 04 14:39:06.167810 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2852/5689] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:04 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1681 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:09.389766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70385440-c588-4be0-b482-be7a8b83143c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:09.393927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70385440-c588-4be0-b482-be7a8b83143c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:09.405377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70385440-c588-4be0-b482-be7a8b83143c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:09.406568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70385440-c588-4be0-b482-be7a8b83143c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:09.407994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70385440-c588-4be0-b482-be7a8b83143c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:09.409278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70385440-c588-4be0-b482-be7a8b83143c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:09.481089 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70385440-c588-4be0-b482-be7a8b83143c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action" status: 200 len: 24575 microversion: 2.1 time: 0.100639 Aug 04 14:39:09.490691 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2838/5690] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:39:09 2022] POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action => generated 24575 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:39:10.626639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-39c8656d-bdfd-45a2-81d4-a31499ece00a tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:10.627962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-39c8656d-bdfd-45a2-81d4-a31499ece00a tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:10.656227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39c8656d-bdfd-45a2-81d4-a31499ece00a tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:10.660019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39c8656d-bdfd-45a2-81d4-a31499ece00a tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:10.661239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39c8656d-bdfd-45a2-81d4-a31499ece00a tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:10.662209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-39c8656d-bdfd-45a2-81d4-a31499ece00a tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:10.878337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-39c8656d-bdfd-45a2-81d4-a31499ece00a tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lazy-loading 'services' on Instance uuid 8867b277-2546-4d56-a227-9211b712967d {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:39:11.120929 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-39c8656d-bdfd-45a2-81d4-a31499ece00a tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d/os-volume_attachments/705a11ab-d9ee-4bac-8e29-d3c544f15ff0" status: 202 len: 0 microversion: 2.1 time: 0.494938 Aug 04 14:39:11.123493 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2853/5691] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:39:10 2022] DELETE /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d/os-volume_attachments/705a11ab-d9ee-4bac-8e29-d3c544f15ff0 => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:39:13.571040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4995eb78-4e6e-4d79-879c-c4b7cbefb29a tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:13.572336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4995eb78-4e6e-4d79-879c-c4b7cbefb29a tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:13.602559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4995eb78-4e6e-4d79-879c-c4b7cbefb29a tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:13.603357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4995eb78-4e6e-4d79-879c-c4b7cbefb29a tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:13.605190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4995eb78-4e6e-4d79-879c-c4b7cbefb29a tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:13.606331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4995eb78-4e6e-4d79-879c-c4b7cbefb29a tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:14.458408 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4995eb78-4e6e-4d79-879c-c4b7cbefb29a tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1834 microversion: 2.1 time: 2.049329 Aug 04 14:39:14.481435 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2839/5692] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:12 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1834 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:14.486298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-25259e4a-e02c-4a66-b407-701c7674ca43 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:14.487914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-25259e4a-e02c-4a66-b407-701c7674ca43 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:14.508037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25259e4a-e02c-4a66-b407-701c7674ca43 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:14.508675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25259e4a-e02c-4a66-b407-701c7674ca43 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:14.509417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25259e4a-e02c-4a66-b407-701c7674ca43 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:14.509867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25259e4a-e02c-4a66-b407-701c7674ca43 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:15.196419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-25259e4a-e02c-4a66-b407-701c7674ca43 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:15.211668 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-25259e4a-e02c-4a66-b407-701c7674ca43 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1681 microversion: 2.1 time: 0.731952 Aug 04 14:39:15.225564 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2854/5693] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:14 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1681 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:15.473639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-129a6c5e-d572-441c-85b1-e7e7682aed7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:15.476359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-129a6c5e-d572-441c-85b1-e7e7682aed7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:15.492597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-129a6c5e-d572-441c-85b1-e7e7682aed7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:15.494415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-129a6c5e-d572-441c-85b1-e7e7682aed7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:15.495325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-129a6c5e-d572-441c-85b1-e7e7682aed7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:15.495873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-129a6c5e-d572-441c-85b1-e7e7682aed7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:15.610185 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-129a6c5e-d572-441c-85b1-e7e7682aed7e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action" status: 200 len: 32641 microversion: 2.1 time: 0.140643 Aug 04 14:39:15.623423 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2840/5694] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:39:15 2022] POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action => generated 32641 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:39:15.771085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:15.772535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:15.804306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:15.807058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:15.811410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:15.812419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:16.068637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a03f830056894c50a2c398d6f875ba8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca8790adf064848b2be331b8cce2990', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:16.069330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] flavor_id is None. Assuming migration. {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 14:39:16.069773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 14:39:16.976633 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2c87e1d3-3e61-4aca-b6f4-3370b69e8291 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action" status: 202 len: 0 microversion: 2.1 time: 1.210371 Aug 04 14:39:17.003232 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2855/5695] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:39:15 2022] POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action => generated 0 bytes in 1237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:39:17.013728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b17e6e02-46ec-4805-8813-bf80caf909a5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:17.020981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b17e6e02-46ec-4805-8813-bf80caf909a5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:17.054811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b17e6e02-46ec-4805-8813-bf80caf909a5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:17.056271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b17e6e02-46ec-4805-8813-bf80caf909a5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:17.068058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b17e6e02-46ec-4805-8813-bf80caf909a5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:17.073324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b17e6e02-46ec-4805-8813-bf80caf909a5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:17.754371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b17e6e02-46ec-4805-8813-bf80caf909a5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:17.765813 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b17e6e02-46ec-4805-8813-bf80caf909a5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1690 microversion: 2.1 time: 0.758158 Aug 04 14:39:17.786470 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2841/5696] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:17 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1690 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:18.798843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-29208638-1c53-4712-a035-888120531095 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:18.800615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-29208638-1c53-4712-a035-888120531095 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:18.875253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29208638-1c53-4712-a035-888120531095 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:18.876037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29208638-1c53-4712-a035-888120531095 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:18.898434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29208638-1c53-4712-a035-888120531095 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:18.901977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-29208638-1c53-4712-a035-888120531095 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:19.327887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-29208638-1c53-4712-a035-888120531095 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:19.413354 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-29208638-1c53-4712-a035-888120531095 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1690 microversion: 2.1 time: 0.606879 Aug 04 14:39:19.413354 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2856/5697] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:18 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1690 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:20.429179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ff168699-9b07-471b-8c86-2fd347e0ab13 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:20.433768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ff168699-9b07-471b-8c86-2fd347e0ab13 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:20.498220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff168699-9b07-471b-8c86-2fd347e0ab13 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:20.503990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff168699-9b07-471b-8c86-2fd347e0ab13 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:20.512026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff168699-9b07-471b-8c86-2fd347e0ab13 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:20.514564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff168699-9b07-471b-8c86-2fd347e0ab13 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:20.894456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ff168699-9b07-471b-8c86-2fd347e0ab13 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:20.932053 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ff168699-9b07-471b-8c86-2fd347e0ab13 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1690 microversion: 2.1 time: 0.511103 Aug 04 14:39:20.939924 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2842/5698] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:20 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1690 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:21.966326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c416af9-af2e-4415-82f9-3c4870a18811 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:21.968470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c416af9-af2e-4415-82f9-3c4870a18811 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:21.989543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c416af9-af2e-4415-82f9-3c4870a18811 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:22.023089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c416af9-af2e-4415-82f9-3c4870a18811 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:22.025139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c416af9-af2e-4415-82f9-3c4870a18811 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:22.026361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c416af9-af2e-4415-82f9-3c4870a18811 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:22.847191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c416af9-af2e-4415-82f9-3c4870a18811 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:22.863347 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c416af9-af2e-4415-82f9-3c4870a18811 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1690 microversion: 2.1 time: 0.905595 Aug 04 14:39:22.878185 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2857/5699] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:21 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1690 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:23.903653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a282639e-6c4b-4aad-963d-cefbd43484d0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:23.906072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a282639e-6c4b-4aad-963d-cefbd43484d0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:23.922295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a282639e-6c4b-4aad-963d-cefbd43484d0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:23.923781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a282639e-6c4b-4aad-963d-cefbd43484d0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:23.929539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a282639e-6c4b-4aad-963d-cefbd43484d0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:23.934544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a282639e-6c4b-4aad-963d-cefbd43484d0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:24.481669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a282639e-6c4b-4aad-963d-cefbd43484d0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:24.493502 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a282639e-6c4b-4aad-963d-cefbd43484d0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1695 microversion: 2.1 time: 0.604836 Aug 04 14:39:24.498023 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2843/5700] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:23 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1695 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:25.531589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4767aafd-813a-4aee-8355-e2b5612a4a60 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:25.533790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4767aafd-813a-4aee-8355-e2b5612a4a60 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:25.547993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4767aafd-813a-4aee-8355-e2b5612a4a60 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:25.549165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4767aafd-813a-4aee-8355-e2b5612a4a60 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:25.550964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4767aafd-813a-4aee-8355-e2b5612a4a60 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:25.552031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4767aafd-813a-4aee-8355-e2b5612a4a60 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:25.782101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-093a970f-4c65-4a11-b7d4-c8f5b9fa4075 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:25.787766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-093a970f-4c65-4a11-b7d4-c8f5b9fa4075 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:25.817743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-093a970f-4c65-4a11-b7d4-c8f5b9fa4075 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:25.823818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-093a970f-4c65-4a11-b7d4-c8f5b9fa4075 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:25.827123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-093a970f-4c65-4a11-b7d4-c8f5b9fa4075 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:25.831749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-093a970f-4c65-4a11-b7d4-c8f5b9fa4075 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:25.915849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-093a970f-4c65-4a11-b7d4-c8f5b9fa4075 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:39:25.999658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4767aafd-813a-4aee-8355-e2b5612a4a60 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:26.013230 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4767aafd-813a-4aee-8355-e2b5612a4a60 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1695 microversion: 2.1 time: 0.490986 Aug 04 14:39:26.017962 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2858/5701] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:25 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1695 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:26.228536 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-093a970f-4c65-4a11-b7d4-c8f5b9fa4075 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 204 len: 0 microversion: 2.1 time: 0.454432 Aug 04 14:39:26.230385 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2844/5702] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:39:25 2022] DELETE /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:39:26.240347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5123db7-3229-47c5-955c-cdc65ba9fbec tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:26.242857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d5123db7-3229-47c5-955c-cdc65ba9fbec tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:26.272122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5123db7-3229-47c5-955c-cdc65ba9fbec tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:26.272943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5123db7-3229-47c5-955c-cdc65ba9fbec tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:26.273950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5123db7-3229-47c5-955c-cdc65ba9fbec tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:26.274625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5123db7-3229-47c5-955c-cdc65ba9fbec tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:27.038680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-82b174c0-1543-4a46-b031-ada04e629ce4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:27.039416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-82b174c0-1543-4a46-b031-ada04e629ce4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:27.051800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82b174c0-1543-4a46-b031-ada04e629ce4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:27.052570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82b174c0-1543-4a46-b031-ada04e629ce4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:27.053591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82b174c0-1543-4a46-b031-ada04e629ce4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:27.054224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82b174c0-1543-4a46-b031-ada04e629ce4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:27.261066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d5123db7-3229-47c5-955c-cdc65ba9fbec tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:27.284287 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5123db7-3229-47c5-955c-cdc65ba9fbec tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1514 microversion: 2.1 time: 1.048056 Aug 04 14:39:27.296538 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2859/5703] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:26 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1514 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:39:27.626339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-82b174c0-1543-4a46-b031-ada04e629ce4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:27.637861 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-82b174c0-1543-4a46-b031-ada04e629ce4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1695 microversion: 2.1 time: 0.603918 Aug 04 14:39:27.638466 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2845/5704] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:27 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1695 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:28.329785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4e24cd6-63ca-4f29-be68-e2c8a55b96ba tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:28.330819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e4e24cd6-63ca-4f29-be68-e2c8a55b96ba tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:28.343689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4e24cd6-63ca-4f29-be68-e2c8a55b96ba tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:28.344144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4e24cd6-63ca-4f29-be68-e2c8a55b96ba tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:28.344978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4e24cd6-63ca-4f29-be68-e2c8a55b96ba tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:28.347446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4e24cd6-63ca-4f29-be68-e2c8a55b96ba tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:28.667561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5fd5ed73-81b2-4035-90c8-5519027cb5f2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:28.668549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5fd5ed73-81b2-4035-90c8-5519027cb5f2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:28.696748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fd5ed73-81b2-4035-90c8-5519027cb5f2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:28.698088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fd5ed73-81b2-4035-90c8-5519027cb5f2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:28.701276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fd5ed73-81b2-4035-90c8-5519027cb5f2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:28.702442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fd5ed73-81b2-4035-90c8-5519027cb5f2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:29.184829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e4e24cd6-63ca-4f29-be68-e2c8a55b96ba tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:29.228184 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e4e24cd6-63ca-4f29-be68-e2c8a55b96ba tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1514 microversion: 2.1 time: 0.891330 Aug 04 14:39:29.231179 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2860/5705] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:28 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1514 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:29.486374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5fd5ed73-81b2-4035-90c8-5519027cb5f2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:29.514564 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5fd5ed73-81b2-4035-90c8-5519027cb5f2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1695 microversion: 2.1 time: 0.850686 Aug 04 14:39:29.522619 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2846/5706] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:28 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1695 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:29.578080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2e506047-34e2-4373-9fb1-cabbbc0aa342 req-45f01aba-932d-4a9a-8209-30f58fb2414e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8867b277-2546-4d56-a227-9211b712967d", "name": "network-vif-deleted", "tag": "574d4fd5-bce4-433c-b20d-d34555be9e62"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:29.592267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2e506047-34e2-4373-9fb1-cabbbc0aa342 req-45f01aba-932d-4a9a-8209-30f58fb2414e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:29.593008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2e506047-34e2-4373-9fb1-cabbbc0aa342 req-45f01aba-932d-4a9a-8209-30f58fb2414e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:29.613344 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2e506047-34e2-4373-9fb1-cabbbc0aa342 req-45f01aba-932d-4a9a-8209-30f58fb2414e service nova] Creating event network-vif-deleted:574d4fd5-bce4-433c-b20d-d34555be9e62 for instance 8867b277-2546-4d56-a227-9211b712967d on n-h1-844627-10 Aug 04 14:39:29.640174 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2e506047-34e2-4373-9fb1-cabbbc0aa342 req-45f01aba-932d-4a9a-8209-30f58fb2414e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065828 Aug 04 14:39:29.644669 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2861/5707] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:39:30.264504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:30.269864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:30.300743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:30.312649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:30.314687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:30.315867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:30.430404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:30.437153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:30.438350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lazy-loading 'fault' on Instance uuid 8867b277-2546-4d56-a227-9211b712967d {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:39:30.527147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a7da502a2546e1a86028b982766fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a554896e8947b99bf5fc6b0cc5dd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:30.572055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7644724-465e-4112-a33f-37958090f1b0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:30.573040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7644724-465e-4112-a33f-37958090f1b0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:30.598589 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-de915c6f-1da2-4cee-bd67-901915a06a93 tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 200 len: 1309 microversion: 2.1 time: 0.350414 Aug 04 14:39:30.599207 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2847/5708] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:30 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:30.681854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7644724-465e-4112-a33f-37958090f1b0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:30.683215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7644724-465e-4112-a33f-37958090f1b0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:30.686284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7644724-465e-4112-a33f-37958090f1b0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:30.687121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7644724-465e-4112-a33f-37958090f1b0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:31.395773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f7644724-465e-4112-a33f-37958090f1b0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:31.428740 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7644724-465e-4112-a33f-37958090f1b0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1695 microversion: 2.1 time: 0.885757 Aug 04 14:39:31.433148 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2862/5709] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:30 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1695 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:39:31.643743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:31.652320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] [instance: 8867b277-2546-4d56-a227-9211b712967d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:31.709149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:31.712326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:31.713477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:31.718282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:31.772606 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] HTTP exception thrown: Instance 8867b277-2546-4d56-a227-9211b712967d could not be found. Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Request method failure captured: Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d HTTP/1.1 Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69iSXRUoZWYp0-46pCKN3GK-7JUTUND2KbHPxv5IIVnIaY-ZDdwh7a9pCE6ZqZbkE5XTK3JHE90EEpm1oYgwOotCZacBmWvSGswTdHGttgWX0UrkfD69Mz2p0igrxFTyWhyM1BP5xF_D9HQJx_ADN2nygO_ZPllQma4iYvMYgWgOxIo Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d7a554896e8947b99bf5fc6b0cc5dd4e Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesSnapshotTestJSON-971967405 Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d7a554896e8947b99bf5fc6b0cc5dd4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d7a554896e8947b99bf5fc6b0cc5dd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d7a554896e8947b99bf5fc6b0cc5dd4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d7a554896e8947b99bf5fc6b0cc5dd4e"}]}] Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesSnapshotTestJSON-971967405 Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d7a554896e8947b99bf5fc6b0cc5dd4e Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-971967405 Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesSnapshotTestJSON-971967405-project Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 68a7da502a2546e1a86028b982766fd0 Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesSnapshotTestJSON-971967405-project Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 8867b277-2546-4d56-a227-9211b712967d could not be found. Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '8867b277-2546-4d56-a227-9211b712967d'} Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8867b277-2546-4d56-a227-9211b712967d could not be found. Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8867b277-2546-4d56-a227-9211b712967d could not be found. Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:39:31.785128 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:39:31.788981 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:39:31.788981 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:39:31.788981 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:39:31.788981 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:39:31.788981 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:39:31.788981 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8867b277-2546-4d56-a227-9211b712967d could not be found. Aug 04 14:39:31.788981 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:39:31.791302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] Returning 404 to user: Instance 8867b277-2546-4d56-a227-9211b712967d could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:39:31.795113 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-768fc8e8-b4ee-44f9-a082-8c29d978a20c tempest-VolumesSnapshotTestJSON-971967405 tempest-VolumesSnapshotTestJSON-971967405-project] 10.222.0.66 "GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d" status: 404 len: 111 microversion: 2.1 time: 0.174430 Aug 04 14:39:31.831892 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2848/5710] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:31 2022] GET /compute/v2.1/servers/8867b277-2546-4d56-a227-9211b712967d => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:39:32.461500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dddb80e7-cf35-4e77-9692-49b130c4b961 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:32.471763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dddb80e7-cf35-4e77-9692-49b130c4b961 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:32.503670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dddb80e7-cf35-4e77-9692-49b130c4b961 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:32.510739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dddb80e7-cf35-4e77-9692-49b130c4b961 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:32.518302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dddb80e7-cf35-4e77-9692-49b130c4b961 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:32.520001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dddb80e7-cf35-4e77-9692-49b130c4b961 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:33.200257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dddb80e7-cf35-4e77-9692-49b130c4b961 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:33.230834 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dddb80e7-cf35-4e77-9692-49b130c4b961 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1695 microversion: 2.1 time: 0.779142 Aug 04 14:39:33.240959 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2863/5711] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:32 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1695 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:34.259357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e3bc8d01-2f69-41bb-9535-d60aa50967aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:34.261187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e3bc8d01-2f69-41bb-9535-d60aa50967aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:34.274082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:39:34.300858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3bc8d01-2f69-41bb-9535-d60aa50967aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:34.303849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3bc8d01-2f69-41bb-9535-d60aa50967aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:34.305285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3bc8d01-2f69-41bb-9535-d60aa50967aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:34.309475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e3bc8d01-2f69-41bb-9535-d60aa50967aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:34.366050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:39:34.761377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e3bc8d01-2f69-41bb-9535-d60aa50967aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:34.787752 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e3bc8d01-2f69-41bb-9535-d60aa50967aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1695 microversion: 2.1 time: 0.535124 Aug 04 14:39:34.806992 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2849/5712] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:34 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1695 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:39:35.819306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3a5ea80-e323-4cee-a8f4-f44365f070c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:35.821292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3a5ea80-e323-4cee-a8f4-f44365f070c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:35.834061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=27 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:39:35.840207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3a5ea80-e323-4cee-a8f4-f44365f070c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:35.845192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3a5ea80-e323-4cee-a8f4-f44365f070c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:35.846929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3a5ea80-e323-4cee-a8f4-f44365f070c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:35.848222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3a5ea80-e323-4cee-a8f4-f44365f070c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:35.981185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:39:36.689935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f3a5ea80-e323-4cee-a8f4-f44365f070c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:36.754125 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3a5ea80-e323-4cee-a8f4-f44365f070c1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1695 microversion: 2.1 time: 0.920830 Aug 04 14:39:36.764109 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2864/5713] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:35 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1695 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:39:37.801875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-326bba2b-9e4a-414e-8b7b-8b7a0dfe4d18 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:37.802785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-326bba2b-9e4a-414e-8b7b-8b7a0dfe4d18 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:37.814162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-326bba2b-9e4a-414e-8b7b-8b7a0dfe4d18 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:37.823416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-326bba2b-9e4a-414e-8b7b-8b7a0dfe4d18 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:37.824757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-326bba2b-9e4a-414e-8b7b-8b7a0dfe4d18 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:37.827249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-326bba2b-9e4a-414e-8b7b-8b7a0dfe4d18 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:38.413585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-326bba2b-9e4a-414e-8b7b-8b7a0dfe4d18 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:38.442820 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-326bba2b-9e4a-414e-8b7b-8b7a0dfe4d18 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1694 microversion: 2.1 time: 0.645789 Aug 04 14:39:38.447361 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2850/5714] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:37 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1694 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:39:39.218246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ca590af3-04c8-4f7c-8f2d-ba1b0c6e316e req-cb2665ad-dbea-4c29-83e6-92219ba00edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "name": "network-vif-unplugged", "status": "completed", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:39.255364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ca590af3-04c8-4f7c-8f2d-ba1b0c6e316e req-cb2665ad-dbea-4c29-83e6-92219ba00edc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:39.255833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ca590af3-04c8-4f7c-8f2d-ba1b0c6e316e req-cb2665ad-dbea-4c29-83e6-92219ba00edc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:39.295174 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ca590af3-04c8-4f7c-8f2d-ba1b0c6e316e req-cb2665ad-dbea-4c29-83e6-92219ba00edc service nova] Creating event network-vif-unplugged:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h1-844627-10 Aug 04 14:39:39.309730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-ca590af3-04c8-4f7c-8f2d-ba1b0c6e316e req-cb2665ad-dbea-4c29-83e6-92219ba00edc service nova] Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:39:39.367744 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ca590af3-04c8-4f7c-8f2d-ba1b0c6e316e req-cb2665ad-dbea-4c29-83e6-92219ba00edc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149965 Aug 04 14:39:39.368749 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2865/5715] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:39:39.472144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2bea56d8-a325-4065-af83-3bde2710240d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:39.474373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2bea56d8-a325-4065-af83-3bde2710240d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:39.496347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bea56d8-a325-4065-af83-3bde2710240d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:39.498674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bea56d8-a325-4065-af83-3bde2710240d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:39.505241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bea56d8-a325-4065-af83-3bde2710240d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:39.506549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2bea56d8-a325-4065-af83-3bde2710240d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:41.024858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2bea56d8-a325-4065-af83-3bde2710240d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:41.054482 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2bea56d8-a325-4065-af83-3bde2710240d tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1694 microversion: 2.1 time: 1.585915 Aug 04 14:39:41.055699 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2851/5716] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:39 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1694 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:42.093572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df70a423-ebe0-4ca6-b5e6-f777960c1ba0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:42.095738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df70a423-ebe0-4ca6-b5e6-f777960c1ba0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:42.128242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df70a423-ebe0-4ca6-b5e6-f777960c1ba0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:42.131549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df70a423-ebe0-4ca6-b5e6-f777960c1ba0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:42.136552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df70a423-ebe0-4ca6-b5e6-f777960c1ba0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:42.139782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df70a423-ebe0-4ca6-b5e6-f777960c1ba0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:43.134249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3e1b0095-994e-40f9-acf2-48c72260d438 req-6a0197ad-9056-4189-b237-5232ed177c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:43.203833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3e1b0095-994e-40f9-acf2-48c72260d438 req-6a0197ad-9056-4189-b237-5232ed177c3a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:43.204670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3e1b0095-994e-40f9-acf2-48c72260d438 req-6a0197ad-9056-4189-b237-5232ed177c3a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:43.259053 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3e1b0095-994e-40f9-acf2-48c72260d438 req-6a0197ad-9056-4189-b237-5232ed177c3a service nova] Creating event network-changed:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h1-844627-10 Aug 04 14:39:43.285352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-3e1b0095-994e-40f9-acf2-48c72260d438 req-6a0197ad-9056-4189-b237-5232ed177c3a service nova] Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:39:43.343967 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3e1b0095-994e-40f9-acf2-48c72260d438 req-6a0197ad-9056-4189-b237-5232ed177c3a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.189856 Aug 04 14:39:43.349528 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2852/5717] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:39:44.412673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df70a423-ebe0-4ca6-b5e6-f777960c1ba0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:44.438423 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df70a423-ebe0-4ca6-b5e6-f777960c1ba0 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1694 microversion: 2.1 time: 2.361446 Aug 04 14:39:44.443971 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2866/5718] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:42 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1694 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:45.485815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-273fd746-3ab9-4f88-a1bc-3ed1985237bf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:45.488454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-273fd746-3ab9-4f88-a1bc-3ed1985237bf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:45.505347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-273fd746-3ab9-4f88-a1bc-3ed1985237bf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:45.505920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-273fd746-3ab9-4f88-a1bc-3ed1985237bf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:45.506679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-273fd746-3ab9-4f88-a1bc-3ed1985237bf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:45.509747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-273fd746-3ab9-4f88-a1bc-3ed1985237bf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:46.112332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-273fd746-3ab9-4f88-a1bc-3ed1985237bf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:46.124106 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-273fd746-3ab9-4f88-a1bc-3ed1985237bf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1692 microversion: 2.1 time: 0.645088 Aug 04 14:39:46.129265 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2853/5719] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:45 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1692 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:39:47.171463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae0f0405-36e2-4ff4-84b9-7d4bda559051 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:47.182463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ae0f0405-36e2-4ff4-84b9-7d4bda559051 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:47.192745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae0f0405-36e2-4ff4-84b9-7d4bda559051 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:47.197878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae0f0405-36e2-4ff4-84b9-7d4bda559051 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:47.198982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae0f0405-36e2-4ff4-84b9-7d4bda559051 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:47.201477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae0f0405-36e2-4ff4-84b9-7d4bda559051 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:47.926569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ae0f0405-36e2-4ff4-84b9-7d4bda559051 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:47.943180 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae0f0405-36e2-4ff4-84b9-7d4bda559051 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1692 microversion: 2.1 time: 0.794962 Aug 04 14:39:47.962749 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2867/5720] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:47 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1692 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:48.992676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0e1cfb5b-6216-4c0d-8ef5-f55a13b83ee7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:48.996524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0e1cfb5b-6216-4c0d-8ef5-f55a13b83ee7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:49.032791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e1cfb5b-6216-4c0d-8ef5-f55a13b83ee7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:49.037624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e1cfb5b-6216-4c0d-8ef5-f55a13b83ee7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:49.041033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e1cfb5b-6216-4c0d-8ef5-f55a13b83ee7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:49.047533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e1cfb5b-6216-4c0d-8ef5-f55a13b83ee7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:49.798334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0e1cfb5b-6216-4c0d-8ef5-f55a13b83ee7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:49.825175 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0e1cfb5b-6216-4c0d-8ef5-f55a13b83ee7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1689 microversion: 2.1 time: 0.844643 Aug 04 14:39:49.829834 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2854/5721] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:48 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1689 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:49.853844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-79f173e7-4495-4f26-8ecf-65a533b575d7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:49.854395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-79f173e7-4495-4f26-8ecf-65a533b575d7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:49.869330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79f173e7-4495-4f26-8ecf-65a533b575d7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:49.869789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79f173e7-4495-4f26-8ecf-65a533b575d7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:49.870604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79f173e7-4495-4f26-8ecf-65a533b575d7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:49.871045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-79f173e7-4495-4f26-8ecf-65a533b575d7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:50.198327 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-79f173e7-4495-4f26-8ecf-65a533b575d7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action" status: 202 len: 0 microversion: 2.1 time: 0.348896 Aug 04 14:39:50.209342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c25ed9d0-152f-479e-ba5d-699da0447ab7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:50.210626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c25ed9d0-152f-479e-ba5d-699da0447ab7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:50.214316 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2868/5722] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:39:49 2022] POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:39:50.221729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c25ed9d0-152f-479e-ba5d-699da0447ab7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:50.222288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c25ed9d0-152f-479e-ba5d-699da0447ab7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:50.223435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c25ed9d0-152f-479e-ba5d-699da0447ab7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:50.224128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c25ed9d0-152f-479e-ba5d-699da0447ab7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:50.954712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f7e141be-66eb-4b4a-8564-bc1088d12ce3 req-d1dc05f4-1809-4a82-bb34-9ee495dd0beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "name": "network-vif-plugged", "status": "completed", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:51.014602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f7e141be-66eb-4b4a-8564-bc1088d12ce3 req-d1dc05f4-1809-4a82-bb34-9ee495dd0beb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:51.016786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f7e141be-66eb-4b4a-8564-bc1088d12ce3 req-d1dc05f4-1809-4a82-bb34-9ee495dd0beb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:51.077243 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f7e141be-66eb-4b4a-8564-bc1088d12ce3 req-d1dc05f4-1809-4a82-bb34-9ee495dd0beb service nova] Creating event network-vif-plugged:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h1-844627-10 Aug 04 14:39:51.104747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-f7e141be-66eb-4b4a-8564-bc1088d12ce3 req-d1dc05f4-1809-4a82-bb34-9ee495dd0beb service nova] Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:39:51.142200 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f7e141be-66eb-4b4a-8564-bc1088d12ce3 req-d1dc05f4-1809-4a82-bb34-9ee495dd0beb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189725 Aug 04 14:39:51.146435 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2869/5723] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:39:51.225893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c25ed9d0-152f-479e-ba5d-699da0447ab7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:51.242724 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c25ed9d0-152f-479e-ba5d-699da0447ab7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1688 microversion: 2.1 time: 1.036853 Aug 04 14:39:51.243855 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2855/5724] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:50 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1688 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:52.287918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f7813f6-80b2-4100-a86a-dc05b88e3a50 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:52.288967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f7813f6-80b2-4100-a86a-dc05b88e3a50 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:52.320756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f7813f6-80b2-4100-a86a-dc05b88e3a50 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:52.321289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f7813f6-80b2-4100-a86a-dc05b88e3a50 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:52.322090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f7813f6-80b2-4100-a86a-dc05b88e3a50 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:52.322540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f7813f6-80b2-4100-a86a-dc05b88e3a50 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:52.725034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5f7813f6-80b2-4100-a86a-dc05b88e3a50 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:52.737611 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f7813f6-80b2-4100-a86a-dc05b88e3a50 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1688 microversion: 2.1 time: 0.469895 Aug 04 14:39:52.738240 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2870/5725] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:52 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1688 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:53.762893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d40ed6d-2c1a-4924-985f-81126d9719bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:53.763823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3d40ed6d-2c1a-4924-985f-81126d9719bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:53.782195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d40ed6d-2c1a-4924-985f-81126d9719bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:53.784174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d40ed6d-2c1a-4924-985f-81126d9719bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:53.786097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d40ed6d-2c1a-4924-985f-81126d9719bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:53.789650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d40ed6d-2c1a-4924-985f-81126d9719bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:55.615895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3d40ed6d-2c1a-4924-985f-81126d9719bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:55.663533 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3d40ed6d-2c1a-4924-985f-81126d9719bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1688 microversion: 2.1 time: 1.904238 Aug 04 14:39:55.667773 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2856/5726] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:53 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1688 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:56.717152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d06c4894-b4be-435c-b37c-e1f70a5bbfc7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:56.718987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d06c4894-b4be-435c-b37c-e1f70a5bbfc7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:56.747497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d06c4894-b4be-435c-b37c-e1f70a5bbfc7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:56.748503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d06c4894-b4be-435c-b37c-e1f70a5bbfc7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:56.758378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d06c4894-b4be-435c-b37c-e1f70a5bbfc7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:56.762421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d06c4894-b4be-435c-b37c-e1f70a5bbfc7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:57.761199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d06c4894-b4be-435c-b37c-e1f70a5bbfc7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:57.770615 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d06c4894-b4be-435c-b37c-e1f70a5bbfc7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1688 microversion: 2.1 time: 1.057683 Aug 04 14:39:57.789037 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2871/5727] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:56 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1688 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:39:58.368108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-72f47423-423f-4ff8-b7f5-ea203831ee68 req-bd611040-5b5c-4c94-8f26-5f012d46dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "name": "network-vif-unplugged", "status": "completed", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:39:58.427654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-72f47423-423f-4ff8-b7f5-ea203831ee68 req-bd611040-5b5c-4c94-8f26-5f012d46dfe2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:58.428746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-72f47423-423f-4ff8-b7f5-ea203831ee68 req-bd611040-5b5c-4c94-8f26-5f012d46dfe2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:58.516329 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-72f47423-423f-4ff8-b7f5-ea203831ee68 req-bd611040-5b5c-4c94-8f26-5f012d46dfe2 service nova] Creating event network-vif-unplugged:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h2-844627-10 Aug 04 14:39:58.547357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-72f47423-423f-4ff8-b7f5-ea203831ee68 req-bd611040-5b5c-4c94-8f26-5f012d46dfe2 service nova] Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:39:58.598232 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-72f47423-423f-4ff8-b7f5-ea203831ee68 req-bd611040-5b5c-4c94-8f26-5f012d46dfe2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.234538 Aug 04 14:39:58.603894 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2857/5728] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:39:58.829565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2c6f7c3b-fe40-49fb-9a36-c6bdc3ce24bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:39:58.829565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2c6f7c3b-fe40-49fb-9a36-c6bdc3ce24bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:39:58.860368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c6f7c3b-fe40-49fb-9a36-c6bdc3ce24bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:58.862172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c6f7c3b-fe40-49fb-9a36-c6bdc3ce24bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:58.866160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c6f7c3b-fe40-49fb-9a36-c6bdc3ce24bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:39:58.870311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c6f7c3b-fe40-49fb-9a36-c6bdc3ce24bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:39:59.766755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2c6f7c3b-fe40-49fb-9a36-c6bdc3ce24bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:39:59.827813 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2c6f7c3b-fe40-49fb-9a36-c6bdc3ce24bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1688 microversion: 2.1 time: 1.002275 Aug 04 14:39:59.832573 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2872/5729] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:39:58 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1688 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:00.674828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-755d93e1-8fe4-47cf-82f6-8c419b5327ed req-f9873275-94e0-4ddf-987f-fea4b4c7041d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:40:00.731256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-755d93e1-8fe4-47cf-82f6-8c419b5327ed req-f9873275-94e0-4ddf-987f-fea4b4c7041d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:00.733463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-755d93e1-8fe4-47cf-82f6-8c419b5327ed req-f9873275-94e0-4ddf-987f-fea4b4c7041d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:00.772740 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-755d93e1-8fe4-47cf-82f6-8c419b5327ed req-f9873275-94e0-4ddf-987f-fea4b4c7041d service nova] Creating event network-changed:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h2-844627-10 Aug 04 14:40:00.792041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-755d93e1-8fe4-47cf-82f6-8c419b5327ed req-f9873275-94e0-4ddf-987f-fea4b4c7041d service nova] Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:40:00.828221 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-755d93e1-8fe4-47cf-82f6-8c419b5327ed req-f9873275-94e0-4ddf-987f-fea4b4c7041d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171717 Aug 04 14:40:00.831908 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2858/5730] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:40:00.868331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2fb8a9c5-ce5a-4c1c-97f2-ce3cc2e753f8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:00.869262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2fb8a9c5-ce5a-4c1c-97f2-ce3cc2e753f8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:00.895710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fb8a9c5-ce5a-4c1c-97f2-ce3cc2e753f8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:00.905007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fb8a9c5-ce5a-4c1c-97f2-ce3cc2e753f8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:00.912860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fb8a9c5-ce5a-4c1c-97f2-ce3cc2e753f8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:00.916636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fb8a9c5-ce5a-4c1c-97f2-ce3cc2e753f8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:01.826986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2fb8a9c5-ce5a-4c1c-97f2-ce3cc2e753f8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:01.849995 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2fb8a9c5-ce5a-4c1c-97f2-ce3cc2e753f8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1688 microversion: 2.1 time: 0.986276 Aug 04 14:40:01.865636 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2873/5731] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:00 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1688 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:40:02.883001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13eeedad-42dc-4ea8-85d5-51efb84b0dc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:02.884419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13eeedad-42dc-4ea8-85d5-51efb84b0dc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:02.910853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13eeedad-42dc-4ea8-85d5-51efb84b0dc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:02.914341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13eeedad-42dc-4ea8-85d5-51efb84b0dc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:02.915513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13eeedad-42dc-4ea8-85d5-51efb84b0dc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:02.919122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13eeedad-42dc-4ea8-85d5-51efb84b0dc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:03.589256 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:40:03.590081 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:40:03.806178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-13eeedad-42dc-4ea8-85d5-51efb84b0dc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:03.859826 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13eeedad-42dc-4ea8-85d5-51efb84b0dc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1688 microversion: 2.1 time: 0.981134 Aug 04 14:40:03.886905 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2859/5732] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:02 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1688 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:04.911508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-baa04930-6673-4eab-87c0-6a10b8e6ff4a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:04.915882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-baa04930-6673-4eab-87c0-6a10b8e6ff4a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:04.954584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-baa04930-6673-4eab-87c0-6a10b8e6ff4a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:04.956614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-baa04930-6673-4eab-87c0-6a10b8e6ff4a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:04.958474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-baa04930-6673-4eab-87c0-6a10b8e6ff4a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:04.970218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-baa04930-6673-4eab-87c0-6a10b8e6ff4a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:05.661679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-baa04930-6673-4eab-87c0-6a10b8e6ff4a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:05.713896 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-baa04930-6673-4eab-87c0-6a10b8e6ff4a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1681 microversion: 2.1 time: 0.809374 Aug 04 14:40:05.756589 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2874/5733] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:04 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1681 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:07.451039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c83b902f-6ea0-4688-8a90-8eb0556605dd req-676225fd-389d-4fd3-b7ff-b551d747b81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "name": "network-vif-plugged", "status": "completed", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:40:07.489970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=22 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:07.498893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c83b902f-6ea0-4688-8a90-8eb0556605dd req-676225fd-389d-4fd3-b7ff-b551d747b81d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:07.499352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c83b902f-6ea0-4688-8a90-8eb0556605dd req-676225fd-389d-4fd3-b7ff-b551d747b81d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:07.502866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=60 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:07.559161 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c83b902f-6ea0-4688-8a90-8eb0556605dd req-676225fd-389d-4fd3-b7ff-b551d747b81d service nova] Creating event network-vif-plugged:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h2-844627-10 Aug 04 14:40:07.569587 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c83b902f-6ea0-4688-8a90-8eb0556605dd req-676225fd-389d-4fd3-b7ff-b551d747b81d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128175 Aug 04 14:40:07.584343 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2860/5734] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:40:21.452770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1449799189", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:40:21.501163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=25 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:21.503876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:21.713819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] validate_networks() for None {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:40:22.515866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:40:22.516799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:40:22.518006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:40:22.518827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:40:22.519624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:40:22.567777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:22.575814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:22.579824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:22.605047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:22.698431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Getting quotas for project 051656d0edec48fd8e9c995c90ba5c00. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:40:22.722178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Getting quotas for user 916382f0135c49c292bc0081ddaccba5 and project 051656d0edec48fd8e9c995c90ba5c00. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:40:22.776559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:40:22.789731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:40:22.934828 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-798e77dc-1603-43dc-8ceb-b468c6110e9d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476138 Aug 04 14:40:22.937042 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2875/5735] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:40:22.951878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa71aa3b-5177-4e92-ab44-b7493dca2a25 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:22.952719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa71aa3b-5177-4e92-ab44-b7493dca2a25 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:22.968304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:22.969635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:23.871375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa71aa3b-5177-4e92-ab44-b7493dca2a25 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:23.891230 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa71aa3b-5177-4e92-ab44-b7493dca2a25 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1215 microversion: 2.1 time: 0.944913 Aug 04 14:40:23.919297 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2861/5736] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:22 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1215 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:24.942029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-735b0471-620b-4a31-8e4c-d6aec2e63a06 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:24.942875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-735b0471-620b-4a31-8e4c-d6aec2e63a06 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:24.987465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-735b0471-620b-4a31-8e4c-d6aec2e63a06 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:24.988471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-735b0471-620b-4a31-8e4c-d6aec2e63a06 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:25.001260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-735b0471-620b-4a31-8e4c-d6aec2e63a06 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:25.001260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-735b0471-620b-4a31-8e4c-d6aec2e63a06 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:25.305621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-735b0471-620b-4a31-8e4c-d6aec2e63a06 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:25.323017 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-735b0471-620b-4a31-8e4c-d6aec2e63a06 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1211 microversion: 2.1 time: 0.397534 Aug 04 14:40:25.325446 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2876/5737] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:24 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1211 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:26.367717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c5f1e839-687d-42a7-bbe9-5d43f05de0f5 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:26.374420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c5f1e839-687d-42a7-bbe9-5d43f05de0f5 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:26.422195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5f1e839-687d-42a7-bbe9-5d43f05de0f5 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:26.430052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5f1e839-687d-42a7-bbe9-5d43f05de0f5 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:26.436927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5f1e839-687d-42a7-bbe9-5d43f05de0f5 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:26.438069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5f1e839-687d-42a7-bbe9-5d43f05de0f5 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:26.697046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c5f1e839-687d-42a7-bbe9-5d43f05de0f5 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:26.711548 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c5f1e839-687d-42a7-bbe9-5d43f05de0f5 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1273 microversion: 2.1 time: 0.353335 Aug 04 14:40:26.713966 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2862/5738] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:26 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1273 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:27.770646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9fda206b-275b-4972-9464-7c6800256ddd tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:27.774905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9fda206b-275b-4972-9464-7c6800256ddd tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:27.806594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fda206b-275b-4972-9464-7c6800256ddd tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:27.817970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fda206b-275b-4972-9464-7c6800256ddd tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:27.820353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fda206b-275b-4972-9464-7c6800256ddd tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:27.821511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fda206b-275b-4972-9464-7c6800256ddd tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:28.107604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b7569e8f-337a-43e5-b7d8-52b65aac4a75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:40:28.109981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b7569e8f-337a-43e5-b7d8-52b65aac4a75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:28.139497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7569e8f-337a-43e5-b7d8-52b65aac4a75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:28.152440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7569e8f-337a-43e5-b7d8-52b65aac4a75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:28.154892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7569e8f-337a-43e5-b7d8-52b65aac4a75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:28.156038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7569e8f-337a-43e5-b7d8-52b65aac4a75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:28.186361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9fda206b-275b-4972-9464-7c6800256ddd tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:28.216027 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9fda206b-275b-4972-9464-7c6800256ddd tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1273 microversion: 2.1 time: 0.464559 Aug 04 14:40:28.233021 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2877/5739] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:27 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1273 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:28.346090 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b7569e8f-337a-43e5-b7d8-52b65aac4a75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action" status: 200 len: 63192 microversion: 2.1 time: 0.242693 Aug 04 14:40:28.350757 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2863/5740] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:40:28 2022] POST /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1/action => generated 63192 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:40:29.268183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4fbac4c6-23e2-4ce5-911e-dfd08509b5bc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:29.269675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4fbac4c6-23e2-4ce5-911e-dfd08509b5bc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:29.309289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fbac4c6-23e2-4ce5-911e-dfd08509b5bc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:29.313152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fbac4c6-23e2-4ce5-911e-dfd08509b5bc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:29.316288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fbac4c6-23e2-4ce5-911e-dfd08509b5bc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:29.322042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fbac4c6-23e2-4ce5-911e-dfd08509b5bc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:29.856232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4fbac4c6-23e2-4ce5-911e-dfd08509b5bc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:29.870521 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4fbac4c6-23e2-4ce5-911e-dfd08509b5bc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1315 microversion: 2.1 time: 0.608436 Aug 04 14:40:29.871721 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2878/5741] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:29 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:30.510742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-767a20fa-8668-4f51-a711-9aa84ca13927 req-d6407b99-3696-44ea-9bc7-411db77bb4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c3a7e92-b483-4285-8271-c4ec1b3d926c", "tag": "a0e67cee-07bd-4a52-8b0d-6049290fabb3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:40:30.552994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-767a20fa-8668-4f51-a711-9aa84ca13927 req-d6407b99-3696-44ea-9bc7-411db77bb4c7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:30.557761 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-767a20fa-8668-4f51-a711-9aa84ca13927 req-d6407b99-3696-44ea-9bc7-411db77bb4c7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:30.619179 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-767a20fa-8668-4f51-a711-9aa84ca13927 req-d6407b99-3696-44ea-9bc7-411db77bb4c7 service nova] Creating event network-changed:a0e67cee-07bd-4a52-8b0d-6049290fabb3 for instance 0c3a7e92-b483-4285-8271-c4ec1b3d926c on n-h1-844627-10 Aug 04 14:40:30.643565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-767a20fa-8668-4f51-a711-9aa84ca13927 req-d6407b99-3696-44ea-9bc7-411db77bb4c7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164222 Aug 04 14:40:30.649177 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2864/5742] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:40:30.918298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d27a470-c638-404a-8fba-965f8e698a0a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:30.919539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d27a470-c638-404a-8fba-965f8e698a0a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:30.963312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d27a470-c638-404a-8fba-965f8e698a0a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:30.964113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d27a470-c638-404a-8fba-965f8e698a0a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:30.979041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d27a470-c638-404a-8fba-965f8e698a0a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:30.979878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d27a470-c638-404a-8fba-965f8e698a0a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:31.570450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d27a470-c638-404a-8fba-965f8e698a0a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:31.613511 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d27a470-c638-404a-8fba-965f8e698a0a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1315 microversion: 2.1 time: 0.686918 Aug 04 14:40:31.614680 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2879/5743] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:30 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:32.654295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-418c6b80-511f-43ba-80b4-670da69cdbff tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:32.660850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-418c6b80-511f-43ba-80b4-670da69cdbff tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:32.716255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-418c6b80-511f-43ba-80b4-670da69cdbff tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:32.724337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-418c6b80-511f-43ba-80b4-670da69cdbff tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:32.733063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-418c6b80-511f-43ba-80b4-670da69cdbff tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:32.734288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-418c6b80-511f-43ba-80b4-670da69cdbff tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:33.262016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-418c6b80-511f-43ba-80b4-670da69cdbff tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:33.274362 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-418c6b80-511f-43ba-80b4-670da69cdbff tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1315 microversion: 2.1 time: 0.630972 Aug 04 14:40:33.280341 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2865/5744] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:32 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:34.316736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-055f9aca-3dd3-4067-a577-ea10fa92e8af tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:34.318058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-055f9aca-3dd3-4067-a577-ea10fa92e8af tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:34.335141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:34.336373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:34.394012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-055f9aca-3dd3-4067-a577-ea10fa92e8af tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:34.394790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-055f9aca-3dd3-4067-a577-ea10fa92e8af tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:34.396184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-055f9aca-3dd3-4067-a577-ea10fa92e8af tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:34.409308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-055f9aca-3dd3-4067-a577-ea10fa92e8af tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:34.775317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49c6e066-5048-4b7f-87d4-bdb9fe9f4dfa tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:34.794068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49c6e066-5048-4b7f-87d4-bdb9fe9f4dfa tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:34.840830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:34.854960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49c6e066-5048-4b7f-87d4-bdb9fe9f4dfa tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:34.858014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49c6e066-5048-4b7f-87d4-bdb9fe9f4dfa tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:34.859126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49c6e066-5048-4b7f-87d4-bdb9fe9f4dfa tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:34.859752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49c6e066-5048-4b7f-87d4-bdb9fe9f4dfa tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:35.928122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-055f9aca-3dd3-4067-a577-ea10fa92e8af tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:35.969705 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-055f9aca-3dd3-4067-a577-ea10fa92e8af tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1315 microversion: 2.1 time: 1.664637 Aug 04 14:40:35.971400 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2880/5745] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:34 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1315 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:36.253981 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49c6e066-5048-4b7f-87d4-bdb9fe9f4dfa tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1834 microversion: 2.1 time: 1.493067 Aug 04 14:40:36.272131 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2866/5746] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:34 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1834 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:37.012740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e1f5286c-3d0e-4d91-9d52-85fdc8836dfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:37.020004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e1f5286c-3d0e-4d91-9d52-85fdc8836dfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:37.052312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1f5286c-3d0e-4d91-9d52-85fdc8836dfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:37.066577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1f5286c-3d0e-4d91-9d52-85fdc8836dfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:37.070453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1f5286c-3d0e-4d91-9d52-85fdc8836dfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:37.073101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1f5286c-3d0e-4d91-9d52-85fdc8836dfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:38.493858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e1f5286c-3d0e-4d91-9d52-85fdc8836dfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:38.547038 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e1f5286c-3d0e-4d91-9d52-85fdc8836dfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1315 microversion: 2.1 time: 1.546329 Aug 04 14:40:38.548659 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2881/5747] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:36 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1315 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:39.588994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-75be38ec-38f6-4ba0-a70e-30c28c7e6278 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:39.589822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-75be38ec-38f6-4ba0-a70e-30c28c7e6278 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:39.603271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75be38ec-38f6-4ba0-a70e-30c28c7e6278 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:39.603738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75be38ec-38f6-4ba0-a70e-30c28c7e6278 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:39.604551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75be38ec-38f6-4ba0-a70e-30c28c7e6278 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:39.609581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-75be38ec-38f6-4ba0-a70e-30c28c7e6278 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:40.182783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-75be38ec-38f6-4ba0-a70e-30c28c7e6278 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:40.212253 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-75be38ec-38f6-4ba0-a70e-30c28c7e6278 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1315 microversion: 2.1 time: 0.625849 Aug 04 14:40:40.214032 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2867/5748] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:39 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:41.020971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6d04ffe7-59ad-4539-bf5f-b91e5a667ade req-12ccec7e-3700-4d43-8198-4a9174162606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3a7e92-b483-4285-8271-c4ec1b3d926c", "name": "network-vif-plugged", "status": "completed", "tag": "a0e67cee-07bd-4a52-8b0d-6049290fabb3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:40:41.044138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6d04ffe7-59ad-4539-bf5f-b91e5a667ade req-12ccec7e-3700-4d43-8198-4a9174162606 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:41.045933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6d04ffe7-59ad-4539-bf5f-b91e5a667ade req-12ccec7e-3700-4d43-8198-4a9174162606 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:41.096543 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6d04ffe7-59ad-4539-bf5f-b91e5a667ade req-12ccec7e-3700-4d43-8198-4a9174162606 service nova] Creating event network-vif-plugged:a0e67cee-07bd-4a52-8b0d-6049290fabb3 for instance 0c3a7e92-b483-4285-8271-c4ec1b3d926c on n-h1-844627-10 Aug 04 14:40:41.133774 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6d04ffe7-59ad-4539-bf5f-b91e5a667ade req-12ccec7e-3700-4d43-8198-4a9174162606 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117776 Aug 04 14:40:41.134937 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2882/5749] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:40:41.236689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-90b405b2-76e4-414d-b8e6-b9c30d731f6d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:41.238460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-90b405b2-76e4-414d-b8e6-b9c30d731f6d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:41.279735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90b405b2-76e4-414d-b8e6-b9c30d731f6d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:41.280342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90b405b2-76e4-414d-b8e6-b9c30d731f6d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:41.281273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90b405b2-76e4-414d-b8e6-b9c30d731f6d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:41.281739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-90b405b2-76e4-414d-b8e6-b9c30d731f6d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:41.640333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d70b7a1b-12de-44a4-8a15-4118067a263c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:41.640967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d70b7a1b-12de-44a4-8a15-4118067a263c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:41.652960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d70b7a1b-12de-44a4-8a15-4118067a263c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:41.662315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d70b7a1b-12de-44a4-8a15-4118067a263c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:41.665501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d70b7a1b-12de-44a4-8a15-4118067a263c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:41.665987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d70b7a1b-12de-44a4-8a15-4118067a263c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:41.726947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d70b7a1b-12de-44a4-8a15-4118067a263c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:40:41.759109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-90b405b2-76e4-414d-b8e6-b9c30d731f6d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:41.769405 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-90b405b2-76e4-414d-b8e6-b9c30d731f6d tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1315 microversion: 2.1 time: 0.537661 Aug 04 14:40:41.778596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2868/5750] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:41 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:41.788225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-d14c124d-fdbe-45b0-919d-ca9f72da8325 req-5354a351-7236-49fd-a69a-d935711c48f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:40:41.819806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d14c124d-fdbe-45b0-919d-ca9f72da8325 req-5354a351-7236-49fd-a69a-d935711c48f3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:41.820946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-d14c124d-fdbe-45b0-919d-ca9f72da8325 req-5354a351-7236-49fd-a69a-d935711c48f3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:41.858445 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-d14c124d-fdbe-45b0-919d-ca9f72da8325 req-5354a351-7236-49fd-a69a-d935711c48f3 service nova] Creating event network-changed:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h2-844627-10 Aug 04 14:40:41.879453 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-d14c124d-fdbe-45b0-919d-ca9f72da8325 req-5354a351-7236-49fd-a69a-d935711c48f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095338 Aug 04 14:40:41.880346 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2869/5751] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:40:41.908678 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d70b7a1b-12de-44a4-8a15-4118067a263c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 204 len: 0 microversion: 2.1 time: 0.271707 Aug 04 14:40:41.928796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-810dce35-1d34-496b-8fea-fa6114a71fc6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:41.930000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-810dce35-1d34-496b-8fea-fa6114a71fc6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:41.931803 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2883/5752] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:40:41 2022] DELETE /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:40:41.940023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-810dce35-1d34-496b-8fea-fa6114a71fc6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:41.941010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-810dce35-1d34-496b-8fea-fa6114a71fc6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:41.942293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-810dce35-1d34-496b-8fea-fa6114a71fc6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:41.943374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-810dce35-1d34-496b-8fea-fa6114a71fc6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:42.459652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-810dce35-1d34-496b-8fea-fa6114a71fc6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:42.481366 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-810dce35-1d34-496b-8fea-fa6114a71fc6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1687 microversion: 2.1 time: 0.558958 Aug 04 14:40:42.501104 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2870/5753] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:41 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1687 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:42.812462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b816605e-658a-45d1-bbe4-cd131754dd69 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:42.815748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b816605e-658a-45d1-bbe4-cd131754dd69 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:42.861535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b816605e-658a-45d1-bbe4-cd131754dd69 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:42.869462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b816605e-658a-45d1-bbe4-cd131754dd69 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:42.872900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b816605e-658a-45d1-bbe4-cd131754dd69 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:42.878106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b816605e-658a-45d1-bbe4-cd131754dd69 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:43.514588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-925ec884-a2c6-479c-bf12-f1d692c89b79 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:43.516806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-925ec884-a2c6-479c-bf12-f1d692c89b79 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:43.575711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-925ec884-a2c6-479c-bf12-f1d692c89b79 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:43.577369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-925ec884-a2c6-479c-bf12-f1d692c89b79 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:43.583817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-925ec884-a2c6-479c-bf12-f1d692c89b79 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:43.585052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-925ec884-a2c6-479c-bf12-f1d692c89b79 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:43.665709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b816605e-658a-45d1-bbe4-cd131754dd69 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:43.709911 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b816605e-658a-45d1-bbe4-cd131754dd69 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1315 microversion: 2.1 time: 0.912139 Aug 04 14:40:43.725068 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2884/5754] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:42 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:44.753976 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-71a0c778-7c6f-42c0-8ae7-2ba44481a2be tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:44.761980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-71a0c778-7c6f-42c0-8ae7-2ba44481a2be tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:44.817753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71a0c778-7c6f-42c0-8ae7-2ba44481a2be tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:44.833403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71a0c778-7c6f-42c0-8ae7-2ba44481a2be tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:44.834339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71a0c778-7c6f-42c0-8ae7-2ba44481a2be tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:44.834800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71a0c778-7c6f-42c0-8ae7-2ba44481a2be tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:45.253808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-925ec884-a2c6-479c-bf12-f1d692c89b79 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:45.333753 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-925ec884-a2c6-479c-bf12-f1d692c89b79 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1687 microversion: 2.1 time: 1.811186 Aug 04 14:40:45.336052 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2871/5755] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:43 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1687 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:45.709212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-71a0c778-7c6f-42c0-8ae7-2ba44481a2be tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:45.758870 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-71a0c778-7c6f-42c0-8ae7-2ba44481a2be tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1465 microversion: 2.1 time: 1.016032 Aug 04 14:40:45.765220 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2885/5756] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:44 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1465 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:45.945547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0e1b983-8eee-44f5-924c-b7508bdf5e86 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:45.958844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c0e1b983-8eee-44f5-924c-b7508bdf5e86 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:46.003010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0e1b983-8eee-44f5-924c-b7508bdf5e86 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:46.030057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0e1b983-8eee-44f5-924c-b7508bdf5e86 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:46.032150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0e1b983-8eee-44f5-924c-b7508bdf5e86 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:46.038610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0e1b983-8eee-44f5-924c-b7508bdf5e86 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:46.151131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c0e1b983-8eee-44f5-924c-b7508bdf5e86 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:40:46.348081 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0e1b983-8eee-44f5-924c-b7508bdf5e86 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 204 len: 0 microversion: 2.1 time: 0.411340 Aug 04 14:40:46.349381 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2872/5757] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:40:45 2022] DELETE /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:40:46.364728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8baf68a2-7a52-46e0-8e2c-f7880b404bfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:46.365792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8baf68a2-7a52-46e0-8e2c-f7880b404bfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:46.368014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c4d4f86-da6d-431f-98f5-740da7aed1d6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:46.369557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c4d4f86-da6d-431f-98f5-740da7aed1d6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:46.377912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c4d4f86-da6d-431f-98f5-740da7aed1d6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:46.378693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c4d4f86-da6d-431f-98f5-740da7aed1d6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:46.379836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c4d4f86-da6d-431f-98f5-740da7aed1d6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:46.380529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c4d4f86-da6d-431f-98f5-740da7aed1d6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:46.415910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8baf68a2-7a52-46e0-8e2c-f7880b404bfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:46.416409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8baf68a2-7a52-46e0-8e2c-f7880b404bfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:46.424814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8baf68a2-7a52-46e0-8e2c-f7880b404bfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:46.426863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8baf68a2-7a52-46e0-8e2c-f7880b404bfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:46.953125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2c4d4f86-da6d-431f-98f5-740da7aed1d6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:46.990225 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c4d4f86-da6d-431f-98f5-740da7aed1d6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1569 microversion: 2.1 time: 0.633724 Aug 04 14:40:46.999578 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2873/5758] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:46 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1569 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:47.101147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8baf68a2-7a52-46e0-8e2c-f7880b404bfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:47.199038 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8baf68a2-7a52-46e0-8e2c-f7880b404bfc tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1471 microversion: 2.1 time: 0.842090 Aug 04 14:40:47.203433 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2886/5759] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:46 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1471 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:40:48.057190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0df2d203-204b-41a9-b499-19e69f7e834e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:48.065570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0df2d203-204b-41a9-b499-19e69f7e834e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:48.105031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0df2d203-204b-41a9-b499-19e69f7e834e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:48.105852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0df2d203-204b-41a9-b499-19e69f7e834e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:48.107150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0df2d203-204b-41a9-b499-19e69f7e834e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:48.107802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0df2d203-204b-41a9-b499-19e69f7e834e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:48.240378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-195af8aa-dfc2-4623-bea2-a61bc2a3fc6a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:48.243029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-195af8aa-dfc2-4623-bea2-a61bc2a3fc6a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:48.301091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-195af8aa-dfc2-4623-bea2-a61bc2a3fc6a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:48.304594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-195af8aa-dfc2-4623-bea2-a61bc2a3fc6a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:48.306480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-195af8aa-dfc2-4623-bea2-a61bc2a3fc6a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:48.313516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-195af8aa-dfc2-4623-bea2-a61bc2a3fc6a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:48.353245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0df2d203-204b-41a9-b499-19e69f7e834e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:48.367874 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0df2d203-204b-41a9-b499-19e69f7e834e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 200 len: 1501 microversion: 2.1 time: 0.327162 Aug 04 14:40:48.382330 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2874/5760] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:48 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 1501 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:48.405197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8bae8789-e778-4d81-93c0-24ae2b7ca4e9 req-54166e3a-038a-464e-84cd-8ebcb3bd89a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3abee9b-a25d-46b6-8caa-060515c9c5e1", "name": "network-vif-deleted", "tag": "6fcfd60d-2d24-411c-9f05-107cda69e7c6"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:40:48.445997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8bae8789-e778-4d81-93c0-24ae2b7ca4e9 req-54166e3a-038a-464e-84cd-8ebcb3bd89a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:48.446670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8bae8789-e778-4d81-93c0-24ae2b7ca4e9 req-54166e3a-038a-464e-84cd-8ebcb3bd89a4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:48.495540 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8bae8789-e778-4d81-93c0-24ae2b7ca4e9 req-54166e3a-038a-464e-84cd-8ebcb3bd89a4 service nova] Creating event network-vif-deleted:6fcfd60d-2d24-411c-9f05-107cda69e7c6 for instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 on n-h2-844627-10 Aug 04 14:40:48.521406 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8bae8789-e778-4d81-93c0-24ae2b7ca4e9 req-54166e3a-038a-464e-84cd-8ebcb3bd89a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137201 Aug 04 14:40:48.526285 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2875/5761] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:40:48.983665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-195af8aa-dfc2-4623-bea2-a61bc2a3fc6a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:49.020620 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-195af8aa-dfc2-4623-bea2-a61bc2a3fc6a tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1471 microversion: 2.1 time: 0.792370 Aug 04 14:40:49.022724 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2887/5762] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:48 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1471 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:40:49.400129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:49.402702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: b3abee9b-a25d-46b6-8caa-060515c9c5e1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:49.421975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:49.423964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:49.429693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:49.431045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:49.524645 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] HTTP exception thrown: Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 could not be found. Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Request method failure captured: Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 HTTP/1.1 Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69jFwfUoq1MZ3PkxRE5BkQb7BpiSp69e48CPHsGriFQhxKzUnkiGwYhQQNbePGn0c7hesvf4xJO9DEV2ugJMLpoKcsD8QT28sWC3O_GVBX9cdqtyoLV3WEoG3MH4Vxk5k9ad08hMG6pCpe8VT4Gx9CIcVPTQQppsGB6GyqA9Zs8vudM Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 2f1a5cc686e44650a531a8c1026d71e0 Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2f1a5cc686e44650a531a8c1026d71e0"}]}] Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 2f1a5cc686e44650a531a8c1026d71e0 Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestNetworkAdvancedServerOps-617904044-project Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 95e5002f80224b4a804be717d5bd9d2c Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestNetworkAdvancedServerOps-617904044-project Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 could not be found. Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b3abee9b-a25d-46b6-8caa-060515c9c5e1'} Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 could not be found. Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 could not be found. Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:49.530581 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:40:49.537752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:49.537752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:40:49.537752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:40:49.537752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:40:49.537752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:40:49.537752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:40:49.537752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 could not be found. Aug 04 14:40:49.537752 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:49.545898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Returning 404 to user: Instance b3abee9b-a25d-46b6-8caa-060515c9c5e1 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:40:49.552421 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-765bb225-093a-4f86-8e25-37a468a542ff tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1" status: 404 len: 111 microversion: 2.1 time: 0.156920 Aug 04 14:40:49.558837 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2876/5763] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:49 2022] GET /compute/v2.1/servers/b3abee9b-a25d-46b6-8caa-060515c9c5e1 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:40:50.049822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ecb6e34f-640b-4ca7-bcaa-7c95bff05910 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:50.050653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ecb6e34f-640b-4ca7-bcaa-7c95bff05910 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:50.077626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecb6e34f-640b-4ca7-bcaa-7c95bff05910 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:50.078142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecb6e34f-640b-4ca7-bcaa-7c95bff05910 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:50.079133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecb6e34f-640b-4ca7-bcaa-7c95bff05910 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:50.079629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecb6e34f-640b-4ca7-bcaa-7c95bff05910 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:51.228032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ecb6e34f-640b-4ca7-bcaa-7c95bff05910 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:51.240132 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ecb6e34f-640b-4ca7-bcaa-7c95bff05910 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1471 microversion: 2.1 time: 1.197343 Aug 04 14:40:51.240579 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2888/5764] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:50 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1471 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:40:51.995003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-553c91f9-d8fe-433b-ad8a-47179bee46d0 req-01cc67aa-32d8-440a-9188-5240b60da0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3a7e92-b483-4285-8271-c4ec1b3d926c", "name": "network-vif-deleted", "tag": "a0e67cee-07bd-4a52-8b0d-6049290fabb3"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:40:52.042429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-553c91f9-d8fe-433b-ad8a-47179bee46d0 req-01cc67aa-32d8-440a-9188-5240b60da0ac service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:52.044329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-553c91f9-d8fe-433b-ad8a-47179bee46d0 req-01cc67aa-32d8-440a-9188-5240b60da0ac service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:52.081713 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-553c91f9-d8fe-433b-ad8a-47179bee46d0 req-01cc67aa-32d8-440a-9188-5240b60da0ac service nova] Creating event network-vif-deleted:a0e67cee-07bd-4a52-8b0d-6049290fabb3 for instance 0c3a7e92-b483-4285-8271-c4ec1b3d926c on n-h1-844627-10 Aug 04 14:40:52.137447 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-553c91f9-d8fe-433b-ad8a-47179bee46d0 req-01cc67aa-32d8-440a-9188-5240b60da0ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141304 Aug 04 14:40:52.142719 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2877/5765] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:40:52.262778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:52.263556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:52.280093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:52.288261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:52.295596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:52.296885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:52.303209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:52.332750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:52.521909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:52.523269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:52.524407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lazy-loading 'fault' on Instance uuid 0c3a7e92-b483-4285-8271-c4ec1b3d926c {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:40:52.970813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916382f0135c49c292bc0081ddaccba5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051656d0edec48fd8e9c995c90ba5c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:40:53.000072 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c518eb0-5c0c-4833-b96b-eaf41ef0c672 tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 200 len: 1305 microversion: 2.1 time: 0.741115 Aug 04 14:40:53.019953 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2889/5766] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:52 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 1305 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:40:54.053049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:40:54.055567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] [instance: 0c3a7e92-b483-4285-8271-c4ec1b3d926c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:40:54.085854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:54.113512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:54.114521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:54.116085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:40:54.116920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:40:54.156527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:40:54.252492 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] HTTP exception thrown: Instance 0c3a7e92-b483-4285-8271-c4ec1b3d926c could not be found. Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Request method failure captured: Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c HTTP/1.1 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69pOezjqH_ojocYrjHq7oG2-4w3VBT66fy251rg7klC8dNQ0e_tj9F-DGMgzxd4LPmpVFV8i0VjauMymH-FUtl4G6iQC-CJNxpAPzB87_Eey1x8ZAsfWU7WzzbrrvsO7yl6fOzbN4kzxuGvKokNYGediPH1X61PfGBFfmMVtd0o2JEQ Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 051656d0edec48fd8e9c995c90ba5c00 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesNegativeTest-186703441 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/051656d0edec48fd8e9c995c90ba5c00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_051656d0edec48fd8e9c995c90ba5c00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/051656d0edec48fd8e9c995c90ba5c00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/051656d0edec48fd8e9c995c90ba5c00"}]}] Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesNegativeTest-186703441 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 051656d0edec48fd8e9c995c90ba5c00 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesNegativeTest-186703441 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesNegativeTest-186703441-project Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 916382f0135c49c292bc0081ddaccba5 Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesNegativeTest-186703441-project Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 0c3a7e92-b483-4285-8271-c4ec1b3d926c could not be found. Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '0c3a7e92-b483-4285-8271-c4ec1b3d926c'} Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c3a7e92-b483-4285-8271-c4ec1b3d926c could not be found. Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c3a7e92-b483-4285-8271-c4ec1b3d926c could not be found. Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:40:54.257180 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:54.264456 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:40:54.264456 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:40:54.264456 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:40:54.264456 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:40:54.264456 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:40:54.264456 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c3a7e92-b483-4285-8271-c4ec1b3d926c could not be found. Aug 04 14:40:54.264456 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:40:54.272727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] Returning 404 to user: Instance 0c3a7e92-b483-4285-8271-c4ec1b3d926c could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:40:54.274700 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bd0c8847-36a2-4aca-9b69-b44fdf17030c tempest-VolumesNegativeTest-186703441 tempest-VolumesNegativeTest-186703441-project] 10.222.0.66 "GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c" status: 404 len: 111 microversion: 2.1 time: 0.228518 Aug 04 14:40:54.279098 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2878/5767] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:40:54 2022] GET /compute/v2.1/servers/0c3a7e92-b483-4285-8271-c4ec1b3d926c => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:41:02.875941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9f64d70-e4b1-4631-8d2d-8cb4e4ff2285 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '.version_select at 0x7f46f3b67940>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:02.890004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:02.983771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=7 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:03.018248 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f9f64d70-e4b1-4631-8d2d-8cb4e4ff2285 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1846687189" status: 202 len: 0 microversion: 2.1 time: 0.146240 Aug 04 14:41:03.029037 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2890/5768] 10.222.0.66 () {58 vars in 1284 bytes} [Thu Aug 4 14:41:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1846687189 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:41:03.106524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbe5b06e-f3b5-41cd-993e-6edccee8f5c8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'create', calling method: .version_select at 0x7f46f2f8b280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1611679050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWIF8YxINNprJlkLCeJJ1KVzeioQyobXrRO9Ztw4Sq5f0/qhpAR0mpAh8dhj5jiggoHRKlk/H2IoaPvLkecxGI7tZS7DeJnU65b6VLWbDJYhsRLLq6dy6aolS4f75Ck4Q=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:03.293566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cbe5b06e-f3b5-41cd-993e-6edccee8f5c8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:41:03.341857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cbe5b06e-f3b5-41cd-993e-6edccee8f5c8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for user 95e5002f80224b4a804be717d5bd9d2c and project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:41:03.422612 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbe5b06e-f3b5-41cd-993e-6edccee8f5c8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.352895 Aug 04 14:41:03.423762 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2879/5769] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:41:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:41:13.778072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:13.806894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-766701961", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "1fe80731-cb1c-42ff-84c9-d32f87b6f3d4"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:14.068477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] validate_networks() for [('1fe80731-cb1c-42ff-84c9-d32f87b6f3d4', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:41:19.975063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:41:19.976170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:41:19.976819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:41:19.977448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:41:19.978058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:41:19.998163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:20.002762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:20.004237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:20.004847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:20.058772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Getting quotas for project 7753fb96ba144d26a106d1d334abfe75. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:41:20.078314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Getting quotas for user 5954fbfa723847429c297afb64a1f6a4 and project 7753fb96ba144d26a106d1d334abfe75. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:41:20.130804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:41:20.139084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:41:20.277895 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3b65cb03-d7fc-4235-b6dd-8393696118f1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.506410 Aug 04 14:41:20.280993 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2891/5770] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:41:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 6510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:41:20.293739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:20.294540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:20.295286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:20.301506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b12fcf0e-e73b-435c-8d80-835b782541fd tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:20.302240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b12fcf0e-e73b-435c-8d80-835b782541fd tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:20.951766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b12fcf0e-e73b-435c-8d80-835b782541fd tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:20.973554 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b12fcf0e-e73b-435c-8d80-835b782541fd tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1213 microversion: 2.1 time: 0.670140 Aug 04 14:41:20.974918 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2880/5771] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:20 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1213 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:21.059599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e37c205-6425-427f-910f-d8670998299d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Action: 'create', calling method: .version_select at 0x7f46f3153a60>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1361925526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvw3iB7iDp8ZAEa5ImnpozMGNX9IBE2nh93ievvShdjJdr9PaXJTOnw2RVTjc9bqmyGmvvfFJGEJV0DG1xHMugvGGIaNDvzI1AiuAv1ZbYDSFgX0y/Xfs+HdL+pWWhoyg=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:21.081970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8e37c205-6425-427f-910f-d8670998299d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Getting quotas for project dda0124b567f4c8a82a27e96983efc21. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:41:21.090993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8e37c205-6425-427f-910f-d8670998299d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Getting quotas for user 9208ce179392440099aefee54a0332dc and project dda0124b567f4c8a82a27e96983efc21. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:41:21.132414 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e37c205-6425-427f-910f-d8670998299d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.691361 Aug 04 14:41:21.143127 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2892/5772] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:41:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:41:21.997327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e595c237-aea7-4db9-b259-ca23429493b8 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:21.998065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e595c237-aea7-4db9-b259-ca23429493b8 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:22.019112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e595c237-aea7-4db9-b259-ca23429493b8 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:22.019422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e595c237-aea7-4db9-b259-ca23429493b8 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:22.020239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e595c237-aea7-4db9-b259-ca23429493b8 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:22.037771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e595c237-aea7-4db9-b259-ca23429493b8 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:22.453429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e595c237-aea7-4db9-b259-ca23429493b8 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:22.467924 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e595c237-aea7-4db9-b259-ca23429493b8 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1265 microversion: 2.1 time: 0.475995 Aug 04 14:41:22.469907 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2881/5773] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:21 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1265 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:23.513710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-07a9c0be-81d4-4fbb-a902-79adfb52f735 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:23.514354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-07a9c0be-81d4-4fbb-a902-79adfb52f735 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:23.530379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07a9c0be-81d4-4fbb-a902-79adfb52f735 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:23.535568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07a9c0be-81d4-4fbb-a902-79adfb52f735 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:23.536822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07a9c0be-81d4-4fbb-a902-79adfb52f735 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:23.537481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07a9c0be-81d4-4fbb-a902-79adfb52f735 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:24.129082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-07a9c0be-81d4-4fbb-a902-79adfb52f735 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:24.139627 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-07a9c0be-81d4-4fbb-a902-79adfb52f735 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1271 microversion: 2.1 time: 0.632980 Aug 04 14:41:24.143814 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2893/5774] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:23 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1271 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:25.180075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bbf9cfb4-7728-4f58-93e6-889c98e14275 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:25.180985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bbf9cfb4-7728-4f58-93e6-889c98e14275 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:25.195528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbf9cfb4-7728-4f58-93e6-889c98e14275 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:25.195990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbf9cfb4-7728-4f58-93e6-889c98e14275 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:25.197036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbf9cfb4-7728-4f58-93e6-889c98e14275 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:25.197660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbf9cfb4-7728-4f58-93e6-889c98e14275 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:26.188790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bbf9cfb4-7728-4f58-93e6-889c98e14275 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:26.219933 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bbf9cfb4-7728-4f58-93e6-889c98e14275 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1271 microversion: 2.1 time: 1.043137 Aug 04 14:41:26.221354 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2882/5775] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:25 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1271 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:27.257081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a713f055-95c8-408d-b61f-a5978843a091 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:27.258541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a713f055-95c8-408d-b61f-a5978843a091 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:27.280701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a713f055-95c8-408d-b61f-a5978843a091 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:27.281589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a713f055-95c8-408d-b61f-a5978843a091 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:27.283251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a713f055-95c8-408d-b61f-a5978843a091 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:27.287728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a713f055-95c8-408d-b61f-a5978843a091 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:29.498868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a713f055-95c8-408d-b61f-a5978843a091 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:29.537832 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a713f055-95c8-408d-b61f-a5978843a091 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1313 microversion: 2.1 time: 2.285606 Aug 04 14:41:29.538966 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2894/5776] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:27 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1313 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:30.593284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-002e96ae-7217-46cf-b9ad-a1f3b2797374 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:30.595058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-002e96ae-7217-46cf-b9ad-a1f3b2797374 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:30.662527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-002e96ae-7217-46cf-b9ad-a1f3b2797374 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:30.663364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-002e96ae-7217-46cf-b9ad-a1f3b2797374 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:30.666510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-002e96ae-7217-46cf-b9ad-a1f3b2797374 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:30.676313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-002e96ae-7217-46cf-b9ad-a1f3b2797374 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:30.962289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:31.279552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-002e96ae-7217-46cf-b9ad-a1f3b2797374 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:31.289547 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-002e96ae-7217-46cf-b9ad-a1f3b2797374 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1313 microversion: 2.1 time: 0.710883 Aug 04 14:41:31.298002 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2883/5777] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:30 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:32.327324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-594c6ad4-30ac-48c6-ad1b-435b7d835281 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:32.327870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-594c6ad4-30ac-48c6-ad1b-435b7d835281 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:32.337970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:32.340372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=10 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:32.348318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-594c6ad4-30ac-48c6-ad1b-435b7d835281 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:32.350277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-594c6ad4-30ac-48c6-ad1b-435b7d835281 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:32.353649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-594c6ad4-30ac-48c6-ad1b-435b7d835281 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:32.356337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-594c6ad4-30ac-48c6-ad1b-435b7d835281 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:32.967349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-594c6ad4-30ac-48c6-ad1b-435b7d835281 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:32.979599 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-594c6ad4-30ac-48c6-ad1b-435b7d835281 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1313 microversion: 2.1 time: 0.657737 Aug 04 14:41:32.985991 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2895/5778] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:32 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1313 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:41:34.030082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c5c2e1d3-15ab-4e69-8f6b-3812f46ff8b4 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:34.031180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c5c2e1d3-15ab-4e69-8f6b-3812f46ff8b4 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:34.059282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5c2e1d3-15ab-4e69-8f6b-3812f46ff8b4 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:34.062573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5c2e1d3-15ab-4e69-8f6b-3812f46ff8b4 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:34.065160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5c2e1d3-15ab-4e69-8f6b-3812f46ff8b4 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:34.067630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c5c2e1d3-15ab-4e69-8f6b-3812f46ff8b4 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:34.610658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c5c2e1d3-15ab-4e69-8f6b-3812f46ff8b4 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:34.622351 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c5c2e1d3-15ab-4e69-8f6b-3812f46ff8b4 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1313 microversion: 2.1 time: 0.597376 Aug 04 14:41:34.626159 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2884/5779] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:34 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:41:34.799323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-74469788-f83a-4783-a9ec-2bb18102ba21 req-52cc2265-565a-49a9-b313-52dc09d7b503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7823eb04-8397-466d-9998-e3114abdb542", "tag": "248cea0a-f6e9-45f4-8dad-bd388ec6c0b2"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:34.885825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-74469788-f83a-4783-a9ec-2bb18102ba21 req-52cc2265-565a-49a9-b313-52dc09d7b503 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:34.888351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-74469788-f83a-4783-a9ec-2bb18102ba21 req-52cc2265-565a-49a9-b313-52dc09d7b503 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:34.921503 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-74469788-f83a-4783-a9ec-2bb18102ba21 req-52cc2265-565a-49a9-b313-52dc09d7b503 service nova] Creating event network-changed:248cea0a-f6e9-45f4-8dad-bd388ec6c0b2 for instance 7823eb04-8397-466d-9998-e3114abdb542 on n-h2-844627-10 Aug 04 14:41:34.930544 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-74469788-f83a-4783-a9ec-2bb18102ba21 req-52cc2265-565a-49a9-b313-52dc09d7b503 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135109 Aug 04 14:41:34.931966 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2896/5780] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:41:35.125128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-683015643", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "d54b7b3a-b86a-4131-a48b-85abdcaf0d9a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1611679050", "security_groups": [{"name": "tempest-secgroup-smoke-1217846808"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:35.651652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d84f6894-a8a9-46be-a39d-b357c76136af tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:35.654446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d84f6894-a8a9-46be-a39d-b357c76136af tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:35.682370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d84f6894-a8a9-46be-a39d-b357c76136af tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:35.682835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d84f6894-a8a9-46be-a39d-b357c76136af tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:35.683900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d84f6894-a8a9-46be-a39d-b357c76136af tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:35.684346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d84f6894-a8a9-46be-a39d-b357c76136af tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:36.048475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] validate_networks() for [('d54b7b3a-b86a-4131-a48b-85abdcaf0d9a', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:41:36.776460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d84f6894-a8a9-46be-a39d-b357c76136af tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:36.786828 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d84f6894-a8a9-46be-a39d-b357c76136af tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1313 microversion: 2.1 time: 1.141664 Aug 04 14:41:36.787436 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2897/5781] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:35 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1313 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:37.809960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0f91ea8b-0c3b-45fa-b098-05efe663d49d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:37.810584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0f91ea8b-0c3b-45fa-b098-05efe663d49d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:37.842168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f91ea8b-0c3b-45fa-b098-05efe663d49d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:37.842628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f91ea8b-0c3b-45fa-b098-05efe663d49d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:37.843444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f91ea8b-0c3b-45fa-b098-05efe663d49d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:37.843882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f91ea8b-0c3b-45fa-b098-05efe663d49d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:39.585043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0f91ea8b-0c3b-45fa-b098-05efe663d49d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:39.600155 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0f91ea8b-0c3b-45fa-b098-05efe663d49d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1313 microversion: 2.1 time: 1.794661 Aug 04 14:41:39.602551 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2898/5782] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:37 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1313 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:39.838481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:41:39.841702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:41:39.843315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:41:39.844003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:41:39.844560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:41:39.891152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:39.895358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:39.897400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:39.901756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:39.978324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:41:40.014877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for user 95e5002f80224b4a804be717d5bd9d2c and project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:41:40.105146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:41:40.113362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:41:40.326976 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7056a218-e27c-4529-96ec-de36f5080046 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 5.203973 Aug 04 14:41:40.332745 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2885/5783] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:41:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 5214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:41:40.343962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30c6b28a-6946-42d0-bebb-039993576286 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:40.344532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-30c6b28a-6946-42d0-bebb-039993576286 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:40.646283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a3fbdc8c-4bf5-4baa-96f1-32ca05d11ba3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:40.647344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a3fbdc8c-4bf5-4baa-96f1-32ca05d11ba3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:40.706180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3fbdc8c-4bf5-4baa-96f1-32ca05d11ba3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:40.710969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3fbdc8c-4bf5-4baa-96f1-32ca05d11ba3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:40.716011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3fbdc8c-4bf5-4baa-96f1-32ca05d11ba3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:40.716824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a3fbdc8c-4bf5-4baa-96f1-32ca05d11ba3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:41.473157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-30c6b28a-6946-42d0-bebb-039993576286 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:41.483206 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30c6b28a-6946-42d0-bebb-039993576286 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1266 microversion: 2.1 time: 1.143417 Aug 04 14:41:41.499921 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2899/5784] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:40 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1266 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:42.066862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a3fbdc8c-4bf5-4baa-96f1-32ca05d11ba3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:42.083870 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a3fbdc8c-4bf5-4baa-96f1-32ca05d11ba3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1313 microversion: 2.1 time: 1.446295 Aug 04 14:41:42.085373 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2886/5785] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:40 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1313 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:41:42.509526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-195b8be5-affd-44a7-ae72-4d3500f7d05e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:42.510503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-195b8be5-affd-44a7-ae72-4d3500f7d05e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:42.529488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-195b8be5-affd-44a7-ae72-4d3500f7d05e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:42.549654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-195b8be5-affd-44a7-ae72-4d3500f7d05e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:42.550769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-195b8be5-affd-44a7-ae72-4d3500f7d05e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:42.552240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-195b8be5-affd-44a7-ae72-4d3500f7d05e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:42.794958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-195b8be5-affd-44a7-ae72-4d3500f7d05e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:42.804814 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-195b8be5-affd-44a7-ae72-4d3500f7d05e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1326 microversion: 2.1 time: 0.299613 Aug 04 14:41:42.833183 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2900/5786] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:42 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1326 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:43.148069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fcffa40d-5751-4c53-a1a2-ba0fbd391e1b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:43.150040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fcffa40d-5751-4c53-a1a2-ba0fbd391e1b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:43.192724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcffa40d-5751-4c53-a1a2-ba0fbd391e1b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:43.199139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcffa40d-5751-4c53-a1a2-ba0fbd391e1b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:43.206600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcffa40d-5751-4c53-a1a2-ba0fbd391e1b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:43.209821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcffa40d-5751-4c53-a1a2-ba0fbd391e1b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:43.832850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fcb77490-91f8-4b23-af3c-a79d721839f6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:43.834381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fcb77490-91f8-4b23-af3c-a79d721839f6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:43.845001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcb77490-91f8-4b23-af3c-a79d721839f6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:43.846411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcb77490-91f8-4b23-af3c-a79d721839f6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:43.847628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcb77490-91f8-4b23-af3c-a79d721839f6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:43.848428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcb77490-91f8-4b23-af3c-a79d721839f6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:43.853248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=41 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:44.032274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fcb77490-91f8-4b23-af3c-a79d721839f6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:44.048468 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fcb77490-91f8-4b23-af3c-a79d721839f6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1324 microversion: 2.1 time: 0.218368 Aug 04 14:41:44.069204 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2901/5787] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:43 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:44.345076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fcffa40d-5751-4c53-a1a2-ba0fbd391e1b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:44.373793 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fcffa40d-5751-4c53-a1a2-ba0fbd391e1b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1313 microversion: 2.1 time: 1.245942 Aug 04 14:41:44.374840 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2887/5788] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:43 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1313 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:45.074602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06457a7f-183d-40f9-8570-8417d0e90daf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:45.075128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-06457a7f-183d-40f9-8570-8417d0e90daf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:45.085482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:45.092470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06457a7f-183d-40f9-8570-8417d0e90daf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:45.093246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06457a7f-183d-40f9-8570-8417d0e90daf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:45.097696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06457a7f-183d-40f9-8570-8417d0e90daf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:45.100461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06457a7f-183d-40f9-8570-8417d0e90daf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:45.431657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-107d5901-d7c8-4cb2-83b6-0653a0baeac6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:45.433322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-107d5901-d7c8-4cb2-83b6-0653a0baeac6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:45.444490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-107d5901-d7c8-4cb2-83b6-0653a0baeac6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:45.450886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-107d5901-d7c8-4cb2-83b6-0653a0baeac6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:45.452730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-107d5901-d7c8-4cb2-83b6-0653a0baeac6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:45.458113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-107d5901-d7c8-4cb2-83b6-0653a0baeac6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:46.587727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-06457a7f-183d-40f9-8570-8417d0e90daf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:46.599757 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-06457a7f-183d-40f9-8570-8417d0e90daf tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1392 microversion: 2.1 time: 1.529066 Aug 04 14:41:46.614408 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2902/5789] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:45 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1392 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:46.919905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-23ad5f5c-6e50-49f9-bfe3-8ebdcceb982b req-2c14d086-64b7-4b64-b048-16df86c5b6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7823eb04-8397-466d-9998-e3114abdb542", "name": "network-vif-plugged", "status": "completed", "tag": "248cea0a-f6e9-45f4-8dad-bd388ec6c0b2"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:46.937041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-23ad5f5c-6e50-49f9-bfe3-8ebdcceb982b req-2c14d086-64b7-4b64-b048-16df86c5b6f8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:46.938034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-23ad5f5c-6e50-49f9-bfe3-8ebdcceb982b req-2c14d086-64b7-4b64-b048-16df86c5b6f8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:46.972820 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-23ad5f5c-6e50-49f9-bfe3-8ebdcceb982b req-2c14d086-64b7-4b64-b048-16df86c5b6f8 service nova] Creating event network-vif-plugged:248cea0a-f6e9-45f4-8dad-bd388ec6c0b2 for instance 7823eb04-8397-466d-9998-e3114abdb542 on n-h2-844627-10 Aug 04 14:41:46.988263 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-23ad5f5c-6e50-49f9-bfe3-8ebdcceb982b req-2c14d086-64b7-4b64-b048-16df86c5b6f8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372002 Aug 04 14:41:47.023129 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2903/5790] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:41:47.636435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cf4f4442-9e3d-47f1-8b38-fa4e809500b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:47.675083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cf4f4442-9e3d-47f1-8b38-fa4e809500b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:47.710539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-107d5901-d7c8-4cb2-83b6-0653a0baeac6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:47.722829 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-107d5901-d7c8-4cb2-83b6-0653a0baeac6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1313 microversion: 2.1 time: 2.295099 Aug 04 14:41:47.729349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf4f4442-9e3d-47f1-8b38-fa4e809500b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:47.731627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf4f4442-9e3d-47f1-8b38-fa4e809500b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:47.737438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf4f4442-9e3d-47f1-8b38-fa4e809500b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:47.748003 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2888/5791] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:45 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1313 bytes in 2321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:47.772816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf4f4442-9e3d-47f1-8b38-fa4e809500b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:47.983202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-af1617db-2315-4750-829b-d1f3fa797a57 req-e4dde6de-583a-4ce3-aaeb-31c263dfb2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d67555c-5e06-4723-a973-05045b5b2f4f", "tag": "84a1081f-666b-48cc-ae34-6f4505520106"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:48.018907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-af1617db-2315-4750-829b-d1f3fa797a57 req-e4dde6de-583a-4ce3-aaeb-31c263dfb2a0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:48.022347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-af1617db-2315-4750-829b-d1f3fa797a57 req-e4dde6de-583a-4ce3-aaeb-31c263dfb2a0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:48.085246 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-af1617db-2315-4750-829b-d1f3fa797a57 req-e4dde6de-583a-4ce3-aaeb-31c263dfb2a0 service nova] Creating event network-changed:84a1081f-666b-48cc-ae34-6f4505520106 for instance 2d67555c-5e06-4723-a973-05045b5b2f4f on n-h1-844627-10 Aug 04 14:41:48.099590 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-af1617db-2315-4750-829b-d1f3fa797a57 req-e4dde6de-583a-4ce3-aaeb-31c263dfb2a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120325 Aug 04 14:41:48.110741 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2889/5792] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:41:48.754335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22eaddde-9708-4b06-8061-8f940f36f2d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:48.758876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22eaddde-9708-4b06-8061-8f940f36f2d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:48.774332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cf4f4442-9e3d-47f1-8b38-fa4e809500b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:48.789854 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cf4f4442-9e3d-47f1-8b38-fa4e809500b2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1392 microversion: 2.1 time: 1.163885 Aug 04 14:41:48.792313 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2904/5793] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:47 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1392 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:48.811503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22eaddde-9708-4b06-8061-8f940f36f2d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:48.816478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22eaddde-9708-4b06-8061-8f940f36f2d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:48.820050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22eaddde-9708-4b06-8061-8f940f36f2d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:48.820925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22eaddde-9708-4b06-8061-8f940f36f2d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:49.837124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7bacc51e-7000-4676-bac8-c3ed57023632 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:49.838307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7bacc51e-7000-4676-bac8-c3ed57023632 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:49.857897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bacc51e-7000-4676-bac8-c3ed57023632 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:49.870736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bacc51e-7000-4676-bac8-c3ed57023632 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:49.871771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bacc51e-7000-4676-bac8-c3ed57023632 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:49.872501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bacc51e-7000-4676-bac8-c3ed57023632 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:49.938498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:50.021632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22eaddde-9708-4b06-8061-8f940f36f2d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:50.042493 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22eaddde-9708-4b06-8061-8f940f36f2d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1496 microversion: 2.1 time: 1.295346 Aug 04 14:41:50.044793 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2890/5794] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:48 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1496 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:41:50.507798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7bacc51e-7000-4676-bac8-c3ed57023632 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:50.517851 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7bacc51e-7000-4676-bac8-c3ed57023632 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1392 microversion: 2.1 time: 0.684672 Aug 04 14:41:50.531776 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2905/5795] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:49 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1392 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:41:51.152818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebbe05e2-0773-4238-b23c-f646d3c0ad04 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:51.156277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ebbe05e2-0773-4238-b23c-f646d3c0ad04 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:51.186857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:51.190709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:51.194861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebbe05e2-0773-4238-b23c-f646d3c0ad04 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:51.201602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebbe05e2-0773-4238-b23c-f646d3c0ad04 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:51.203045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebbe05e2-0773-4238-b23c-f646d3c0ad04 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:51.204291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebbe05e2-0773-4238-b23c-f646d3c0ad04 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:51.326637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=53 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:51.350406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ebbe05e2-0773-4238-b23c-f646d3c0ad04 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:41:51.571308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8bce8ac1-bc49-49f5-8015-da7dd6d43e75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:51.572230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8bce8ac1-bc49-49f5-8015-da7dd6d43e75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:51.575366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:41:51.592259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bce8ac1-bc49-49f5-8015-da7dd6d43e75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:51.592776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bce8ac1-bc49-49f5-8015-da7dd6d43e75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:51.593738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bce8ac1-bc49-49f5-8015-da7dd6d43e75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:51.594875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8bce8ac1-bc49-49f5-8015-da7dd6d43e75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:51.648539 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ebbe05e2-0773-4238-b23c-f646d3c0ad04 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 204 len: 0 microversion: 2.1 time: 0.503340 Aug 04 14:41:51.649517 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2891/5796] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:41:51 2022] DELETE /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:41:51.666560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-04dc9d10-f7ff-4237-bdd4-895a7f8d43fe tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:51.668581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-04dc9d10-f7ff-4237-bdd4-895a7f8d43fe tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:51.712711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04dc9d10-f7ff-4237-bdd4-895a7f8d43fe tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:51.713310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04dc9d10-f7ff-4237-bdd4-895a7f8d43fe tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:51.714178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04dc9d10-f7ff-4237-bdd4-895a7f8d43fe tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:51.720599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04dc9d10-f7ff-4237-bdd4-895a7f8d43fe tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:52.758499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8bce8ac1-bc49-49f5-8015-da7dd6d43e75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:52.791499 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8bce8ac1-bc49-49f5-8015-da7dd6d43e75 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1392 microversion: 2.1 time: 1.223908 Aug 04 14:41:52.793730 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2906/5797] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:51 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1392 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:53.501370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-04dc9d10-f7ff-4237-bdd4-895a7f8d43fe tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:53.511185 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-04dc9d10-f7ff-4237-bdd4-895a7f8d43fe tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1502 microversion: 2.1 time: 1.855034 Aug 04 14:41:53.520138 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2892/5798] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:51 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1502 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:53.821401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-425c2abc-2b2a-4123-849e-08966fefecc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:53.823797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-425c2abc-2b2a-4123-849e-08966fefecc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:53.837803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-425c2abc-2b2a-4123-849e-08966fefecc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:53.841272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-425c2abc-2b2a-4123-849e-08966fefecc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:53.845163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-425c2abc-2b2a-4123-849e-08966fefecc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:53.848086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-425c2abc-2b2a-4123-849e-08966fefecc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:54.569926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42e7b64d-2c97-4482-809f-b322da577f74 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:54.571863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-42e7b64d-2c97-4482-809f-b322da577f74 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:54.586886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42e7b64d-2c97-4482-809f-b322da577f74 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:54.587348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42e7b64d-2c97-4482-809f-b322da577f74 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:54.592365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42e7b64d-2c97-4482-809f-b322da577f74 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:54.593756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42e7b64d-2c97-4482-809f-b322da577f74 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:55.107634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-42e7b64d-2c97-4482-809f-b322da577f74 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:55.124750 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-42e7b64d-2c97-4482-809f-b322da577f74 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1460 microversion: 2.1 time: 0.560028 Aug 04 14:41:55.126701 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2893/5799] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:54 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1460 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:41:55.133604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fd7e63a2-3100-4c2b-a929-7ae8bb1fdd84 req-e15dd962-ab49-4c92-b553-1d713769652a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7823eb04-8397-466d-9998-e3114abdb542", "name": "network-vif-deleted", "tag": "248cea0a-f6e9-45f4-8dad-bd388ec6c0b2"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:55.146562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fd7e63a2-3100-4c2b-a929-7ae8bb1fdd84 req-e15dd962-ab49-4c92-b553-1d713769652a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:55.148104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fd7e63a2-3100-4c2b-a929-7ae8bb1fdd84 req-e15dd962-ab49-4c92-b553-1d713769652a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:55.166960 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fd7e63a2-3100-4c2b-a929-7ae8bb1fdd84 req-e15dd962-ab49-4c92-b553-1d713769652a service nova] Creating event network-vif-deleted:248cea0a-f6e9-45f4-8dad-bd388ec6c0b2 for instance 7823eb04-8397-466d-9998-e3114abdb542 on n-h2-844627-10 Aug 04 14:41:55.174210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-425c2abc-2b2a-4123-849e-08966fefecc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:55.176635 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fd7e63a2-3100-4c2b-a929-7ae8bb1fdd84 req-e15dd962-ab49-4c92-b553-1d713769652a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047937 Aug 04 14:41:55.177837 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2894/5800] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:41:55.199258 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-425c2abc-2b2a-4123-849e-08966fefecc3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1392 microversion: 2.1 time: 1.383084 Aug 04 14:41:55.200228 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2907/5801] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:53 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1392 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:56.170195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:56.171073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:56.191530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:56.194407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:56.195626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:56.197929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:56.242692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-71dfb689-7bbe-4ae7-b237-c30a83708e8a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:56.243574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-71dfb689-7bbe-4ae7-b237-c30a83708e8a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:56.261847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71dfb689-7bbe-4ae7-b237-c30a83708e8a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:56.265296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71dfb689-7bbe-4ae7-b237-c30a83708e8a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:56.268889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71dfb689-7bbe-4ae7-b237-c30a83708e8a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:56.270652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71dfb689-7bbe-4ae7-b237-c30a83708e8a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:56.335705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:56.336476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:56.338004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lazy-loading 'fault' on Instance uuid 7823eb04-8397-466d-9998-e3114abdb542 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:41:56.552891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:56.582438 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-44634861-9f58-4425-ac79-439adb8bd67f tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 200 len: 1303 microversion: 2.1 time: 0.418841 Aug 04 14:41:56.587451 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2895/5802] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:56 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 1303 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:57.011233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-71dfb689-7bbe-4ae7-b237-c30a83708e8a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:57.028428 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-71dfb689-7bbe-4ae7-b237-c30a83708e8a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1392 microversion: 2.1 time: 0.788342 Aug 04 14:41:57.031124 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2908/5803] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:56 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1392 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:41:57.624439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:57.625698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 7823eb04-8397-466d-9998-e3114abdb542] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:57.658859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:57.659620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:57.668852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:57.679041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:57.749738 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] HTTP exception thrown: Instance 7823eb04-8397-466d-9998-e3114abdb542 could not be found. Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Request method failure captured: Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 HTTP/1.1 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qDudbRhk2X_v5I3HQCJFUoC-9k-eNCyA9woL_9jmUJcBRkpE5W0HHkH5P_TbvgBdbjNfn7e6C6U5mKFRCKcxaWoFRF6FxHdF9p_4eB4JDUDe3Ko-7XYRBw1IYYe7H-4XKtp7wie4bGPxw1uz102B8EdWGELNx43T-bj52y2CI76eg Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 7753fb96ba144d26a106d1d334abfe75 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-VolumesActionsTest-1257937068 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7753fb96ba144d26a106d1d334abfe75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7753fb96ba144d26a106d1d334abfe75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7753fb96ba144d26a106d1d334abfe75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7753fb96ba144d26a106d1d334abfe75"}]}] Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-VolumesActionsTest-1257937068 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 7753fb96ba144d26a106d1d334abfe75 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-VolumesActionsTest-1257937068 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-VolumesActionsTest-1257937068-project Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 5954fbfa723847429c297afb64a1f6a4 Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-VolumesActionsTest-1257937068-project Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 7823eb04-8397-466d-9998-e3114abdb542 could not be found. Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7823eb04-8397-466d-9998-e3114abdb542'} Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7823eb04-8397-466d-9998-e3114abdb542 could not be found. Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7823eb04-8397-466d-9998-e3114abdb542 could not be found. Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:41:57.754291 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:41:57.763659 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:41:57.763659 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:41:57.763659 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:41:57.763659 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:41:57.763659 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:41:57.763659 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7823eb04-8397-466d-9998-e3114abdb542 could not be found. Aug 04 14:41:57.763659 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:41:57.768798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Returning 404 to user: Instance 7823eb04-8397-466d-9998-e3114abdb542 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:41:57.771027 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-05dd9388-9195-449b-a026-a7bd91aa8b01 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542" status: 404 len: 111 microversion: 2.1 time: 0.154907 Aug 04 14:41:57.772895 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2896/5804] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:57 2022] GET /compute/v2.1/servers/7823eb04-8397-466d-9998-e3114abdb542 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:41:58.042153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1056837467", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "1fe80731-cb1c-42ff-84c9-d32f87b6f3d4"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:58.057943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7d83c88-a1a5-47cc-8983-ed9d25053019 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:41:58.060451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e7d83c88-a1a5-47cc-8983-ed9d25053019 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:41:58.092500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7d83c88-a1a5-47cc-8983-ed9d25053019 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:58.093429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7d83c88-a1a5-47cc-8983-ed9d25053019 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:58.094375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7d83c88-a1a5-47cc-8983-ed9d25053019 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:58.101894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7d83c88-a1a5-47cc-8983-ed9d25053019 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:58.226418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] validate_networks() for [('1fe80731-cb1c-42ff-84c9-d32f87b6f3d4', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:41:59.077501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e7d83c88-a1a5-47cc-8983-ed9d25053019 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:41:59.132904 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e7d83c88-a1a5-47cc-8983-ed9d25053019 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1392 microversion: 2.1 time: 1.083209 Aug 04 14:41:59.140152 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2897/5805] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:41:58 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1392 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:41:59.770890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-577cce45-3260-47cf-b222-010ab7db3a66 req-9d58b762-4a50-455c-9e2c-082f46a67551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d67555c-5e06-4723-a973-05045b5b2f4f", "name": "network-vif-plugged", "status": "completed", "tag": "84a1081f-666b-48cc-ae34-6f4505520106"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:41:59.868349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-577cce45-3260-47cf-b222-010ab7db3a66 req-9d58b762-4a50-455c-9e2c-082f46a67551 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:41:59.871168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-577cce45-3260-47cf-b222-010ab7db3a66 req-9d58b762-4a50-455c-9e2c-082f46a67551 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:41:59.958214 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-577cce45-3260-47cf-b222-010ab7db3a66 req-9d58b762-4a50-455c-9e2c-082f46a67551 service nova] Creating event network-vif-plugged:84a1081f-666b-48cc-ae34-6f4505520106 for instance 2d67555c-5e06-4723-a973-05045b5b2f4f on n-h1-844627-10 Aug 04 14:42:00.008003 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-577cce45-3260-47cf-b222-010ab7db3a66 req-9d58b762-4a50-455c-9e2c-082f46a67551 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245125 Aug 04 14:42:00.008974 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2898/5806] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:42:00.183034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-66b94067-276c-4a22-bda2-5bb56a481ff4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:00.184687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-66b94067-276c-4a22-bda2-5bb56a481ff4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:00.254910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66b94067-276c-4a22-bda2-5bb56a481ff4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:00.256266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66b94067-276c-4a22-bda2-5bb56a481ff4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:00.263329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:42:00.264779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66b94067-276c-4a22-bda2-5bb56a481ff4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:00.265604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:42:00.265892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66b94067-276c-4a22-bda2-5bb56a481ff4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:00.267127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:42:00.268383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:42:00.270376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:42:00.313687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:00.315004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:00.317078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:00.321438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:00.429022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Getting quotas for project 7753fb96ba144d26a106d1d334abfe75. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:42:00.455040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Getting quotas for user 5954fbfa723847429c297afb64a1f6a4 and project 7753fb96ba144d26a106d1d334abfe75. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:42:00.512690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:42:00.516927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:42:00.673733 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d6a34433-eb5e-4d5d-aea7-497402b8f1ec tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.633574 Aug 04 14:42:00.685276 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2909/5807] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:41:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:42:00.685276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-990440752-access_point-1857576274", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "48caae28-13fd-4c9f-a835-4e0df0bf78b5"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1361925526", "security_groups": [{"name": "tempest-secgroup_access--1883874203"}, {"name": "tempest-secgroup_general--164087624"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:02.641881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-66b94067-276c-4a22-bda2-5bb56a481ff4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:02.666862 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-66b94067-276c-4a22-bda2-5bb56a481ff4 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1392 microversion: 2.1 time: 2.495347 Aug 04 14:42:02.668295 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2899/5808] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:00 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1392 bytes in 2502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:02.674856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-66606995-4f96-4418-afc1-04f3844d211e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:02.679078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-66606995-4f96-4418-afc1-04f3844d211e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:02.690723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66606995-4f96-4418-afc1-04f3844d211e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:02.691434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66606995-4f96-4418-afc1-04f3844d211e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:02.692973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66606995-4f96-4418-afc1-04f3844d211e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:02.693644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-66606995-4f96-4418-afc1-04f3844d211e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:03.081223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-66606995-4f96-4418-afc1-04f3844d211e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:03.095500 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-66606995-4f96-4418-afc1-04f3844d211e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1210 microversion: 2.1 time: 0.426317 Aug 04 14:42:03.110835 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2900/5809] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:02 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1210 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:03.157955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] validate_networks() for [('48caae28-13fd-4c9f-a835-4e0df0bf78b5', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:42:03.693340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-473a5011-1dac-49bb-afa8-58b3bcedc041 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:03.700048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-473a5011-1dac-49bb-afa8-58b3bcedc041 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:03.748590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-473a5011-1dac-49bb-afa8-58b3bcedc041 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:03.757126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-473a5011-1dac-49bb-afa8-58b3bcedc041 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:03.759662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-473a5011-1dac-49bb-afa8-58b3bcedc041 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:03.760762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-473a5011-1dac-49bb-afa8-58b3bcedc041 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:04.351241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-473a5011-1dac-49bb-afa8-58b3bcedc041 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:04.368668 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-473a5011-1dac-49bb-afa8-58b3bcedc041 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1563 microversion: 2.1 time: 0.682589 Aug 04 14:42:04.369868 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2901/5810] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:03 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1563 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:04.382078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f35a4ce-86f0-4dd3-8039-e07ce93b44d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:04.384355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f35a4ce-86f0-4dd3-8039-e07ce93b44d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:04.403786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f35a4ce-86f0-4dd3-8039-e07ce93b44d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:04.404399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f35a4ce-86f0-4dd3-8039-e07ce93b44d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:04.408190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f35a4ce-86f0-4dd3-8039-e07ce93b44d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:04.408662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f35a4ce-86f0-4dd3-8039-e07ce93b44d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:04.577862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f35a4ce-86f0-4dd3-8039-e07ce93b44d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:04.596520 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f35a4ce-86f0-4dd3-8039-e07ce93b44d2 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1272 microversion: 2.1 time: 0.224253 Aug 04 14:42:04.604370 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2902/5811] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:04 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:04.624932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e8efb5e3-64d3-408b-86f2-bcb28e15ec04 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:04.625802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e8efb5e3-64d3-408b-86f2-bcb28e15ec04 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:04.642778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8efb5e3-64d3-408b-86f2-bcb28e15ec04 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:04.643653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8efb5e3-64d3-408b-86f2-bcb28e15ec04 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:04.645055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8efb5e3-64d3-408b-86f2-bcb28e15ec04 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:04.645734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e8efb5e3-64d3-408b-86f2-bcb28e15ec04 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:05.289391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e8efb5e3-64d3-408b-86f2-bcb28e15ec04 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:05.293265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:42:05.294023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:42:05.295230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:42:05.296062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:42:05.296789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:42:05.317602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:05.318753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:05.320299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:05.321596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:05.332367 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e8efb5e3-64d3-408b-86f2-bcb28e15ec04 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1563 microversion: 2.1 time: 0.723800 Aug 04 14:42:05.333042 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2903/5812] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:04 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1563 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:05.369130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Getting quotas for project dda0124b567f4c8a82a27e96983efc21. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:42:05.376557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Getting quotas for user 9208ce179392440099aefee54a0332dc and project dda0124b567f4c8a82a27e96983efc21. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:42:05.395176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:42:05.397822 n-d-844627-10 devstack@n-api.service[130960]: WARNING nova.utils [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-990440752-access_point-1857576274 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-990440752-acc Aug 04 14:42:05.398778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:42:05.492814 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6ad9ad40-3d8a-4bb1-a9e1-72b71537a380 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 4.812954 Aug 04 14:42:05.508563 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2910/5813] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:42:00 2022] POST /compute/v2.1/servers => generated 457 bytes in 4822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:42:05.539860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d2c1706-e4c9-494d-ad5c-1f703365e1d4 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:05.547944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3d2c1706-e4c9-494d-ad5c-1f703365e1d4 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:05.649547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b794bac-3278-46a8-9d89-5b0f98e7ebf1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:05.649547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b794bac-3278-46a8-9d89-5b0f98e7ebf1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:05.656858 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b794bac-3278-46a8-9d89-5b0f98e7ebf1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:05.663630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b794bac-3278-46a8-9d89-5b0f98e7ebf1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:05.664963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b794bac-3278-46a8-9d89-5b0f98e7ebf1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:05.665615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b794bac-3278-46a8-9d89-5b0f98e7ebf1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:05.919624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3d2c1706-e4c9-494d-ad5c-1f703365e1d4 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:05.956490 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3d2c1706-e4c9-494d-ad5c-1f703365e1d4 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1294 microversion: 2.1 time: 0.436224 Aug 04 14:42:05.992352 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2904/5814] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:05 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1294 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:06.151444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b794bac-3278-46a8-9d89-5b0f98e7ebf1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:06.193366 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b794bac-3278-46a8-9d89-5b0f98e7ebf1 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1272 microversion: 2.1 time: 0.551944 Aug 04 14:42:06.215433 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2911/5815] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:05 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1272 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:07.004580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5ba39d9f-9275-4c47-a9d9-495e8049bc8d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:07.014394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5ba39d9f-9275-4c47-a9d9-495e8049bc8d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:07.240618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b61e95b-ac79-4c37-82f8-2898a20ef468 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:07.241526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b61e95b-ac79-4c37-82f8-2898a20ef468 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:07.267178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b61e95b-ac79-4c37-82f8-2898a20ef468 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:07.272901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b61e95b-ac79-4c37-82f8-2898a20ef468 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:07.273933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b61e95b-ac79-4c37-82f8-2898a20ef468 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:07.274391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b61e95b-ac79-4c37-82f8-2898a20ef468 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:07.487671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5ba39d9f-9275-4c47-a9d9-495e8049bc8d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:07.514763 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5ba39d9f-9275-4c47-a9d9-495e8049bc8d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1294 microversion: 2.1 time: 0.521304 Aug 04 14:42:07.517222 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2905/5816] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:06 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1294 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:07.917709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b61e95b-ac79-4c37-82f8-2898a20ef468 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:07.940632 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b61e95b-ac79-4c37-82f8-2898a20ef468 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1272 microversion: 2.1 time: 0.706096 Aug 04 14:42:07.943267 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2912/5817] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:07 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1272 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:08.554257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-752a3b2d-314d-413e-b0fb-26f94ea14db5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:08.556246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-752a3b2d-314d-413e-b0fb-26f94ea14db5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:08.619492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-752a3b2d-314d-413e-b0fb-26f94ea14db5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:08.633083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-752a3b2d-314d-413e-b0fb-26f94ea14db5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:08.634655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-752a3b2d-314d-413e-b0fb-26f94ea14db5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:08.635354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-752a3b2d-314d-413e-b0fb-26f94ea14db5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:08.968376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-50c6c39d-24ab-4306-acfc-962e901b641b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:08.969643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-50c6c39d-24ab-4306-acfc-962e901b641b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:08.996930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50c6c39d-24ab-4306-acfc-962e901b641b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:09.009632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50c6c39d-24ab-4306-acfc-962e901b641b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:09.011953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50c6c39d-24ab-4306-acfc-962e901b641b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:09.013468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50c6c39d-24ab-4306-acfc-962e901b641b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:09.079424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-752a3b2d-314d-413e-b0fb-26f94ea14db5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:09.105582 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-752a3b2d-314d-413e-b0fb-26f94ea14db5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1346 microversion: 2.1 time: 0.565541 Aug 04 14:42:09.113121 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2906/5818] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:08 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1346 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:09.442139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-50c6c39d-24ab-4306-acfc-962e901b641b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:09.478344 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-50c6c39d-24ab-4306-acfc-962e901b641b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1272 microversion: 2.1 time: 0.512288 Aug 04 14:42:09.492667 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2913/5819] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:08 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1272 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:10.135462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1e64bb8-0583-476a-a684-0441013bb8c1 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:10.137729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e1e64bb8-0583-476a-a684-0441013bb8c1 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:10.174019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1e64bb8-0583-476a-a684-0441013bb8c1 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:10.174741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1e64bb8-0583-476a-a684-0441013bb8c1 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:10.175760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1e64bb8-0583-476a-a684-0441013bb8c1 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:10.184691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1e64bb8-0583-476a-a684-0441013bb8c1 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:10.414343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e1e64bb8-0583-476a-a684-0441013bb8c1 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:10.442338 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e1e64bb8-0583-476a-a684-0441013bb8c1 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1352 microversion: 2.1 time: 0.314783 Aug 04 14:42:10.460906 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2907/5820] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:10 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1352 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:10.525761 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a711010-3b08-4732-81f3-d25acf8f6ac3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:10.526955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3a711010-3b08-4732-81f3-d25acf8f6ac3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:10.554931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a711010-3b08-4732-81f3-d25acf8f6ac3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:10.556112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a711010-3b08-4732-81f3-d25acf8f6ac3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:10.557883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a711010-3b08-4732-81f3-d25acf8f6ac3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:10.558966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a711010-3b08-4732-81f3-d25acf8f6ac3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:11.487598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa939d38-bd62-4a44-8232-365a25a7cc1d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:11.489640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa939d38-bd62-4a44-8232-365a25a7cc1d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:11.514741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa939d38-bd62-4a44-8232-365a25a7cc1d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:11.516377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa939d38-bd62-4a44-8232-365a25a7cc1d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:11.518140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa939d38-bd62-4a44-8232-365a25a7cc1d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:11.519177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa939d38-bd62-4a44-8232-365a25a7cc1d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:11.818335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aa939d38-bd62-4a44-8232-365a25a7cc1d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:11.846439 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa939d38-bd62-4a44-8232-365a25a7cc1d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1352 microversion: 2.1 time: 0.363544 Aug 04 14:42:11.892897 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2908/5821] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:11 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1352 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:11.997781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3a711010-3b08-4732-81f3-d25acf8f6ac3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:12.029462 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a711010-3b08-4732-81f3-d25acf8f6ac3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1314 microversion: 2.1 time: 1.511267 Aug 04 14:42:12.049625 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2914/5822] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:10 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1314 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:12.900736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-23c0c006-7092-48f8-8358-c0cc3911f2cd tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:12.907147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-23c0c006-7092-48f8-8358-c0cc3911f2cd tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:12.927759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23c0c006-7092-48f8-8358-c0cc3911f2cd tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:12.931165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23c0c006-7092-48f8-8358-c0cc3911f2cd tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:12.934011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23c0c006-7092-48f8-8358-c0cc3911f2cd tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:12.938515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-23c0c006-7092-48f8-8358-c0cc3911f2cd tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:13.080560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c01ca0c9-cfef-4b4f-a52c-7b0324b74db3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:13.085099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c01ca0c9-cfef-4b4f-a52c-7b0324b74db3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:13.138872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c01ca0c9-cfef-4b4f-a52c-7b0324b74db3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:13.140121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c01ca0c9-cfef-4b4f-a52c-7b0324b74db3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:13.170351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c01ca0c9-cfef-4b4f-a52c-7b0324b74db3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:13.170987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c01ca0c9-cfef-4b4f-a52c-7b0324b74db3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:13.240557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-23c0c006-7092-48f8-8358-c0cc3911f2cd tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:13.243547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:13.272763 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-23c0c006-7092-48f8-8358-c0cc3911f2cd tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1352 microversion: 2.1 time: 0.381637 Aug 04 14:42:13.278399 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2909/5823] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:12 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1352 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:13.570881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-928fe071-0d75-42d2-8f48-4fcbe253d08a req-37f73fd0-c7d1-4200-a5bc-7469afe907b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9db4cab1-6979-44d6-b19b-4df400d9c732", "tag": "44ce26d0-02fb-474b-8f8f-4a9a9c53e69b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:13.608463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-928fe071-0d75-42d2-8f48-4fcbe253d08a req-37f73fd0-c7d1-4200-a5bc-7469afe907b2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:13.611186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-928fe071-0d75-42d2-8f48-4fcbe253d08a req-37f73fd0-c7d1-4200-a5bc-7469afe907b2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:13.647628 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-928fe071-0d75-42d2-8f48-4fcbe253d08a req-37f73fd0-c7d1-4200-a5bc-7469afe907b2 service nova] Creating event network-changed:44ce26d0-02fb-474b-8f8f-4a9a9c53e69b for instance 9db4cab1-6979-44d6-b19b-4df400d9c732 on n-h2-844627-10 Aug 04 14:42:13.683063 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-928fe071-0d75-42d2-8f48-4fcbe253d08a req-37f73fd0-c7d1-4200-a5bc-7469afe907b2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116915 Aug 04 14:42:13.686563 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2910/5824] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:42:13.947872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c01ca0c9-cfef-4b4f-a52c-7b0324b74db3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:13.977913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=76 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:13.988294 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c01ca0c9-cfef-4b4f-a52c-7b0324b74db3 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1314 microversion: 2.1 time: 0.914980 Aug 04 14:42:13.988589 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2915/5825] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:13 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:14.317944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f8ba63d-c3ba-430e-95f2-b7068fbf2475 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:14.321709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8f8ba63d-c3ba-430e-95f2-b7068fbf2475 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:14.341106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f8ba63d-c3ba-430e-95f2-b7068fbf2475 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:14.341958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f8ba63d-c3ba-430e-95f2-b7068fbf2475 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:14.343058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f8ba63d-c3ba-430e-95f2-b7068fbf2475 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:14.344361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f8ba63d-c3ba-430e-95f2-b7068fbf2475 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:15.035018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8f8ba63d-c3ba-430e-95f2-b7068fbf2475 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:15.042522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b04d552-76a7-4a6d-ba3d-92031072844d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:15.043583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b04d552-76a7-4a6d-ba3d-92031072844d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:15.066581 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f8ba63d-c3ba-430e-95f2-b7068fbf2475 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1471 microversion: 2.1 time: 0.754082 Aug 04 14:42:15.072444 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2911/5826] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:14 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1471 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:15.115938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b04d552-76a7-4a6d-ba3d-92031072844d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:15.116945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b04d552-76a7-4a6d-ba3d-92031072844d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:15.118574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b04d552-76a7-4a6d-ba3d-92031072844d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:15.119521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b04d552-76a7-4a6d-ba3d-92031072844d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:15.354626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:15.389285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:15.993300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b04d552-76a7-4a6d-ba3d-92031072844d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:16.037196 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b04d552-76a7-4a6d-ba3d-92031072844d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1314 microversion: 2.1 time: 1.009688 Aug 04 14:42:16.040545 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2916/5827] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:15 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1314 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:16.114171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb4b6613-e4bd-403e-b24b-be7d5a9a970b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:16.116443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb4b6613-e4bd-403e-b24b-be7d5a9a970b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:16.192722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb4b6613-e4bd-403e-b24b-be7d5a9a970b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:16.203639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62e297c7-7c16-43cd-bb63-a9222460192b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:16.206153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-62e297c7-7c16-43cd-bb63-a9222460192b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:16.206619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb4b6613-e4bd-403e-b24b-be7d5a9a970b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:16.209165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb4b6613-e4bd-403e-b24b-be7d5a9a970b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:16.213697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb4b6613-e4bd-403e-b24b-be7d5a9a970b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:16.235715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:16.248191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62e297c7-7c16-43cd-bb63-a9222460192b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:16.250969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62e297c7-7c16-43cd-bb63-a9222460192b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:16.255083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62e297c7-7c16-43cd-bb63-a9222460192b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:16.262873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62e297c7-7c16-43cd-bb63-a9222460192b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:17.259333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cb4b6613-e4bd-403e-b24b-be7d5a9a970b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:17.263221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-62e297c7-7c16-43cd-bb63-a9222460192b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:17.283944 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb4b6613-e4bd-403e-b24b-be7d5a9a970b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1471 microversion: 2.1 time: 1.178131 Aug 04 14:42:17.284921 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2912/5828] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:16 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1471 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:17.295248 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62e297c7-7c16-43cd-bb63-a9222460192b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1563 microversion: 2.1 time: 1.099077 Aug 04 14:42:17.304925 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2917/5829] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:16 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1563 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:17.339022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df76d0ae-49c6-4de8-b349-7d34cb4ab8f0 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:17.346374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df76d0ae-49c6-4de8-b349-7d34cb4ab8f0 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:17.380322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df76d0ae-49c6-4de8-b349-7d34cb4ab8f0 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:17.382482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df76d0ae-49c6-4de8-b349-7d34cb4ab8f0 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:17.385832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df76d0ae-49c6-4de8-b349-7d34cb4ab8f0 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:17.397080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df76d0ae-49c6-4de8-b349-7d34cb4ab8f0 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:17.517938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:18.022620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-08aa6a68-4670-442a-bf86-1fed3836cee7 req-e3d7c8f7-3962-4dc2-854e-78183ce63ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d67555c-5e06-4723-a973-05045b5b2f4f", "tag": "84a1081f-666b-48cc-ae34-6f4505520106"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:18.092617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-08aa6a68-4670-442a-bf86-1fed3836cee7 req-e3d7c8f7-3962-4dc2-854e-78183ce63ef2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:18.093689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-08aa6a68-4670-442a-bf86-1fed3836cee7 req-e3d7c8f7-3962-4dc2-854e-78183ce63ef2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:18.176266 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-08aa6a68-4670-442a-bf86-1fed3836cee7 req-e3d7c8f7-3962-4dc2-854e-78183ce63ef2 service nova] Creating event network-changed:84a1081f-666b-48cc-ae34-6f4505520106 for instance 2d67555c-5e06-4723-a973-05045b5b2f4f on n-h1-844627-10 Aug 04 14:42:18.198858 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-08aa6a68-4670-442a-bf86-1fed3836cee7 req-e3d7c8f7-3962-4dc2-854e-78183ce63ef2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.871368 Aug 04 14:42:18.208150 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2913/5830] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:42:18.236322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-913237764", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fec0cf1c-c5b4-452f-bd35-31d4016d5b6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da90baac-d2cd-4bbe-ac2b-56b8aae47252"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:18.517136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] validate_networks() for [('da90baac-d2cd-4bbe-ac2b-56b8aae47252', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:42:19.328714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df76d0ae-49c6-4de8-b349-7d34cb4ab8f0 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:19.344703 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df76d0ae-49c6-4de8-b349-7d34cb4ab8f0 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1314 microversion: 2.1 time: 2.012331 Aug 04 14:42:19.345759 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2918/5831] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:17 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1314 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:19.380597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1742ba56-db94-4433-bbb8-fd430a8b1673 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:19.381710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1742ba56-db94-4433-bbb8-fd430a8b1673 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:19.453683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1742ba56-db94-4433-bbb8-fd430a8b1673 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:19.457852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1742ba56-db94-4433-bbb8-fd430a8b1673 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:19.459195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1742ba56-db94-4433-bbb8-fd430a8b1673 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:19.464270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1742ba56-db94-4433-bbb8-fd430a8b1673 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:20.366540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1742ba56-db94-4433-bbb8-fd430a8b1673 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:20.421497 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1742ba56-db94-4433-bbb8-fd430a8b1673 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1471 microversion: 2.1 time: 1.065788 Aug 04 14:42:20.439104 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2919/5832] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:19 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1471 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:20.469867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1bef58fd-13f3-4592-8159-d21fb7bfe33d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:20.473735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1bef58fd-13f3-4592-8159-d21fb7bfe33d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:20.493759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1bef58fd-13f3-4592-8159-d21fb7bfe33d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:20.494407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1bef58fd-13f3-4592-8159-d21fb7bfe33d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:20.495364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1bef58fd-13f3-4592-8159-d21fb7bfe33d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:20.497640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1bef58fd-13f3-4592-8159-d21fb7bfe33d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:21.208201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:42:21.209014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:42:21.209945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:42:21.212158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:42:21.213514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:42:21.228570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1bef58fd-13f3-4592-8159-d21fb7bfe33d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:21.237829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:21.238284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:21.239210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:21.239776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:21.243525 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1bef58fd-13f3-4592-8159-d21fb7bfe33d tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1314 microversion: 2.1 time: 0.800238 Aug 04 14:42:21.244160 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2920/5833] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:20 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:21.279568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e25d6eb5-fb64-4f55-891f-6066735ff818 req-3a4353ab-c04e-49e5-8d11-00606896ed13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d63ced-7cc2-4a2a-bd61-a15c3976f331", "tag": "8f0bcd44-ee02-4606-ad7d-63123beafcd7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:21.280064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:42:21.299901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for user 374c75516444430ea550446cd477e015 and project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:42:21.301636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e25d6eb5-fb64-4f55-891f-6066735ff818 req-3a4353ab-c04e-49e5-8d11-00606896ed13 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:21.302095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e25d6eb5-fb64-4f55-891f-6066735ff818 req-3a4353ab-c04e-49e5-8d11-00606896ed13 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:21.319768 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e25d6eb5-fb64-4f55-891f-6066735ff818 req-3a4353ab-c04e-49e5-8d11-00606896ed13 service nova] Creating event network-changed:8f0bcd44-ee02-4606-ad7d-63123beafcd7 for instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 on n-h2-844627-10 Aug 04 14:42:21.326543 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e25d6eb5-fb64-4f55-891f-6066735ff818 req-3a4353ab-c04e-49e5-8d11-00606896ed13 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058645 Aug 04 14:42:21.327415 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2921/5834] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:42:21.335232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:21.395864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:42:21.401180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fec0cf1c-c5b4-452f-bd35-31d4016d5b6d',volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:42:21.475112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70a4c5dd-c58d-4fa0-b0a6-c92d1e4e4b12 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:21.476632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-70a4c5dd-c58d-4fa0-b0a6-c92d1e4e4b12 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:21.486874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70a4c5dd-c58d-4fa0-b0a6-c92d1e4e4b12 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:21.489150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70a4c5dd-c58d-4fa0-b0a6-c92d1e4e4b12 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:21.491939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70a4c5dd-c58d-4fa0-b0a6-c92d1e4e4b12 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:21.493065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70a4c5dd-c58d-4fa0-b0a6-c92d1e4e4b12 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:21.689912 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fcde09d3-1601-4b38-a909-134abae421ff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.476277 Aug 04 14:42:21.693185 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2914/5835] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:42:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:42:21.712192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e5a33a78-2fc6-496c-af73-040ab70c7369 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:21.733853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e5a33a78-2fc6-496c-af73-040ab70c7369 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:21.901490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e5a33a78-2fc6-496c-af73-040ab70c7369 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:21.922870 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e5a33a78-2fc6-496c-af73-040ab70c7369 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1056 microversion: 2.1 time: 0.216246 Aug 04 14:42:21.935381 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2915/5836] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:21 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1056 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:22.100376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-70a4c5dd-c58d-4fa0-b0a6-c92d1e4e4b12 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:22.124557 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-70a4c5dd-c58d-4fa0-b0a6-c92d1e4e4b12 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1471 microversion: 2.1 time: 0.653686 Aug 04 14:42:22.126344 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2922/5837] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:21 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1471 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:22.274921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-59afb967-7858-48ee-9d5b-f783a5b7d838 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:22.283057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-59afb967-7858-48ee-9d5b-f783a5b7d838 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:22.312376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59afb967-7858-48ee-9d5b-f783a5b7d838 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:22.315917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59afb967-7858-48ee-9d5b-f783a5b7d838 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:22.324182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59afb967-7858-48ee-9d5b-f783a5b7d838 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:22.325330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-59afb967-7858-48ee-9d5b-f783a5b7d838 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:22.692771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-59afb967-7858-48ee-9d5b-f783a5b7d838 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:22.723384 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-59afb967-7858-48ee-9d5b-f783a5b7d838 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1314 microversion: 2.1 time: 0.453119 Aug 04 14:42:22.728259 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2916/5838] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:22 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:22.965144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf505f29-c132-4766-85e4-cd1232c83f43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:22.967829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf505f29-c132-4766-85e4-cd1232c83f43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:22.983441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf505f29-c132-4766-85e4-cd1232c83f43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:22.984912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf505f29-c132-4766-85e4-cd1232c83f43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:22.986782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf505f29-c132-4766-85e4-cd1232c83f43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:22.988072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf505f29-c132-4766-85e4-cd1232c83f43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:23.106843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bf505f29-c132-4766-85e4-cd1232c83f43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:23.121522 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf505f29-c132-4766-85e4-cd1232c83f43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1154 microversion: 2.1 time: 0.168427 Aug 04 14:42:23.133450 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2923/5839] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:22 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1154 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:23.176261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5565f160-1989-49e4-b0af-6daed419f05c tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:23.179986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5565f160-1989-49e4-b0af-6daed419f05c tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:23.194806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5565f160-1989-49e4-b0af-6daed419f05c tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:23.195564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5565f160-1989-49e4-b0af-6daed419f05c tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:23.197950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5565f160-1989-49e4-b0af-6daed419f05c tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:23.198878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5565f160-1989-49e4-b0af-6daed419f05c tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:23.747026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f9b4e62c-58c7-496d-ae1d-150bc30bc972 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:23.748401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f9b4e62c-58c7-496d-ae1d-150bc30bc972 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:23.772717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9b4e62c-58c7-496d-ae1d-150bc30bc972 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:23.777162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9b4e62c-58c7-496d-ae1d-150bc30bc972 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:23.780689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9b4e62c-58c7-496d-ae1d-150bc30bc972 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:23.788444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f9b4e62c-58c7-496d-ae1d-150bc30bc972 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:23.862995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5565f160-1989-49e4-b0af-6daed419f05c tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:23.876563 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5565f160-1989-49e4-b0af-6daed419f05c tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1471 microversion: 2.1 time: 0.715661 Aug 04 14:42:23.879993 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2917/5840] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:23 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1471 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:24.154454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e6eb790-b5ae-4f76-bcd8-95c45dd03953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:24.163891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e6eb790-b5ae-4f76-bcd8-95c45dd03953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:24.195146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e6eb790-b5ae-4f76-bcd8-95c45dd03953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:24.196078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e6eb790-b5ae-4f76-bcd8-95c45dd03953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:24.209456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e6eb790-b5ae-4f76-bcd8-95c45dd03953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:24.212300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e6eb790-b5ae-4f76-bcd8-95c45dd03953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:24.551657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e6eb790-b5ae-4f76-bcd8-95c45dd03953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:24.577273 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e6eb790-b5ae-4f76-bcd8-95c45dd03953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1172 microversion: 2.1 time: 0.436164 Aug 04 14:42:24.594176 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2918/5841] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:24 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1172 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:24.603695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-837fdebf-6a39-49be-a739-711a2aa016a2 req-538f9ea1-8f6f-4e3a-bc8d-9c2953603bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db4cab1-6979-44d6-b19b-4df400d9c732", "name": "network-vif-plugged", "status": "completed", "tag": "44ce26d0-02fb-474b-8f8f-4a9a9c53e69b"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:24.659094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-837fdebf-6a39-49be-a739-711a2aa016a2 req-538f9ea1-8f6f-4e3a-bc8d-9c2953603bcf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:24.671065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-837fdebf-6a39-49be-a739-711a2aa016a2 req-538f9ea1-8f6f-4e3a-bc8d-9c2953603bcf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:24.674640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f9b4e62c-58c7-496d-ae1d-150bc30bc972 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:24.693515 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-837fdebf-6a39-49be-a739-711a2aa016a2 req-538f9ea1-8f6f-4e3a-bc8d-9c2953603bcf service nova] Creating event network-vif-plugged:44ce26d0-02fb-474b-8f8f-4a9a9c53e69b for instance 9db4cab1-6979-44d6-b19b-4df400d9c732 on n-h2-844627-10 Aug 04 14:42:24.701456 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f9b4e62c-58c7-496d-ae1d-150bc30bc972 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1314 microversion: 2.1 time: 0.958333 Aug 04 14:42:24.710008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-837fdebf-6a39-49be-a739-711a2aa016a2 req-538f9ea1-8f6f-4e3a-bc8d-9c2953603bcf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113524 Aug 04 14:42:24.711908 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2924/5842] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:23 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1314 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:24.716010 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2919/5843] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:42:24.919686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-642806c7-3b97-416e-8f18-5d7a75f60f27 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:24.929766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-642806c7-3b97-416e-8f18-5d7a75f60f27 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:24.967739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-642806c7-3b97-416e-8f18-5d7a75f60f27 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:24.969622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-642806c7-3b97-416e-8f18-5d7a75f60f27 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:24.971486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-642806c7-3b97-416e-8f18-5d7a75f60f27 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:24.972783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-642806c7-3b97-416e-8f18-5d7a75f60f27 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:25.402692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-642806c7-3b97-416e-8f18-5d7a75f60f27 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:25.449866 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-642806c7-3b97-416e-8f18-5d7a75f60f27 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1471 microversion: 2.1 time: 0.539597 Aug 04 14:42:25.465618 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2925/5844] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:24 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1471 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:25.605195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-91385478-f94e-4a48-8679-e3b6b0f4ed29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:25.607474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-91385478-f94e-4a48-8679-e3b6b0f4ed29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:25.621128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91385478-f94e-4a48-8679-e3b6b0f4ed29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:25.621941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91385478-f94e-4a48-8679-e3b6b0f4ed29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:25.623616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91385478-f94e-4a48-8679-e3b6b0f4ed29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:25.625221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91385478-f94e-4a48-8679-e3b6b0f4ed29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:25.733589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ce8031b0-c320-4700-bcd3-1634f71660e6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:25.734369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ce8031b0-c320-4700-bcd3-1634f71660e6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:25.746238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce8031b0-c320-4700-bcd3-1634f71660e6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:25.746695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce8031b0-c320-4700-bcd3-1634f71660e6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:25.749133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce8031b0-c320-4700-bcd3-1634f71660e6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:25.749596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ce8031b0-c320-4700-bcd3-1634f71660e6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:25.761750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-91385478-f94e-4a48-8679-e3b6b0f4ed29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:25.773346 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-91385478-f94e-4a48-8679-e3b6b0f4ed29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1172 microversion: 2.1 time: 0.176175 Aug 04 14:42:25.787310 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2920/5845] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:25 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1172 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:26.066489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ce8031b0-c320-4700-bcd3-1634f71660e6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:26.084449 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ce8031b0-c320-4700-bcd3-1634f71660e6 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1314 microversion: 2.1 time: 0.354782 Aug 04 14:42:26.086647 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2926/5846] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:25 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:26.497885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cdfbb4e4-a404-4c57-a1e0-6a7fa4f1ea4e tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:26.499046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cdfbb4e4-a404-4c57-a1e0-6a7fa4f1ea4e tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:26.520909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cdfbb4e4-a404-4c57-a1e0-6a7fa4f1ea4e tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:26.544179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cdfbb4e4-a404-4c57-a1e0-6a7fa4f1ea4e tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:26.545817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cdfbb4e4-a404-4c57-a1e0-6a7fa4f1ea4e tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:26.547472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cdfbb4e4-a404-4c57-a1e0-6a7fa4f1ea4e tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:26.833310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-672282be-5e86-422b-9109-6f4e306e690d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:26.834592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-672282be-5e86-422b-9109-6f4e306e690d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:26.867057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-672282be-5e86-422b-9109-6f4e306e690d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:26.870269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-672282be-5e86-422b-9109-6f4e306e690d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:26.873175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-672282be-5e86-422b-9109-6f4e306e690d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:26.874084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-672282be-5e86-422b-9109-6f4e306e690d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:28.153707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cdfbb4e4-a404-4c57-a1e0-6a7fa4f1ea4e tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:28.179745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cdfbb4e4-a404-4c57-a1e0-6a7fa4f1ea4e tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1471 microversion: 2.1 time: 1.689058 Aug 04 14:42:28.197565 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2921/5847] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:26 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1471 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:28.227803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1a5c25be-c1a5-4dc4-b497-00e807dca08e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:28.233525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1a5c25be-c1a5-4dc4-b497-00e807dca08e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:28.245624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a5c25be-c1a5-4dc4-b497-00e807dca08e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:28.253896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a5c25be-c1a5-4dc4-b497-00e807dca08e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:28.254744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a5c25be-c1a5-4dc4-b497-00e807dca08e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:28.255753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1a5c25be-c1a5-4dc4-b497-00e807dca08e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:28.301558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-672282be-5e86-422b-9109-6f4e306e690d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:28.320246 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-672282be-5e86-422b-9109-6f4e306e690d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1214 microversion: 2.1 time: 1.511229 Aug 04 14:42:28.331944 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2927/5848] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:26 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1214 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:28.341056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e146d4b4-192d-45f1-b187-ce2f12420ed0 req-0ed55ade-6bd4-45ad-af84-6284ddf6f747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d63ced-7cc2-4a2a-bd61-a15c3976f331", "name": "network-vif-plugged", "status": "completed", "tag": "8f0bcd44-ee02-4606-ad7d-63123beafcd7"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:28.360326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e146d4b4-192d-45f1-b187-ce2f12420ed0 req-0ed55ade-6bd4-45ad-af84-6284ddf6f747 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:28.361608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e146d4b4-192d-45f1-b187-ce2f12420ed0 req-0ed55ade-6bd4-45ad-af84-6284ddf6f747 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:28.393432 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e146d4b4-192d-45f1-b187-ce2f12420ed0 req-0ed55ade-6bd4-45ad-af84-6284ddf6f747 service nova] Creating event network-vif-plugged:8f0bcd44-ee02-4606-ad7d-63123beafcd7 for instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 on n-h2-844627-10 Aug 04 14:42:28.405450 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e146d4b4-192d-45f1-b187-ce2f12420ed0 req-0ed55ade-6bd4-45ad-af84-6284ddf6f747 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070697 Aug 04 14:42:28.407210 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2928/5849] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:42:28.420490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e8a37379-a49e-493f-8b93-9b97987fbd77 req-0222aecb-96f6-4b20-b9ab-70f047ff1075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae1ef48-6bd6-48c0-961d-e53d55082311", "tag": "a2f4cffd-12d7-478e-8dce-533443e502da"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:28.440977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e8a37379-a49e-493f-8b93-9b97987fbd77 req-0222aecb-96f6-4b20-b9ab-70f047ff1075 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:28.442134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e8a37379-a49e-493f-8b93-9b97987fbd77 req-0222aecb-96f6-4b20-b9ab-70f047ff1075 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:28.466140 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e8a37379-a49e-493f-8b93-9b97987fbd77 req-0222aecb-96f6-4b20-b9ab-70f047ff1075 service nova] Creating event network-changed:a2f4cffd-12d7-478e-8dce-533443e502da for instance 6ae1ef48-6bd6-48c0-961d-e53d55082311 on n-h1-844627-10 Aug 04 14:42:28.480026 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e8a37379-a49e-493f-8b93-9b97987fbd77 req-0222aecb-96f6-4b20-b9ab-70f047ff1075 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069185 Aug 04 14:42:28.481507 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2929/5850] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:42:28.635528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1a5c25be-c1a5-4dc4-b497-00e807dca08e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:28.659649 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1a5c25be-c1a5-4dc4-b497-00e807dca08e tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1497 microversion: 2.1 time: 0.460367 Aug 04 14:42:28.672914 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2922/5851] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:28 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1497 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:29.255041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-de14d854-a3da-44ef-ac79-7f15bb675228 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:29.258898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-de14d854-a3da-44ef-ac79-7f15bb675228 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:29.294984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de14d854-a3da-44ef-ac79-7f15bb675228 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:29.300186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de14d854-a3da-44ef-ac79-7f15bb675228 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:29.303667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de14d854-a3da-44ef-ac79-7f15bb675228 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:29.305680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de14d854-a3da-44ef-ac79-7f15bb675228 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:29.364186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0bb7a527-16d8-4665-9cd2-ccd286e27e81 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:29.374970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0bb7a527-16d8-4665-9cd2-ccd286e27e81 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:29.417418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0bb7a527-16d8-4665-9cd2-ccd286e27e81 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:29.425658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0bb7a527-16d8-4665-9cd2-ccd286e27e81 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:29.440527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0bb7a527-16d8-4665-9cd2-ccd286e27e81 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:29.442068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0bb7a527-16d8-4665-9cd2-ccd286e27e81 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:30.224743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-de14d854-a3da-44ef-ac79-7f15bb675228 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:30.236641 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-de14d854-a3da-44ef-ac79-7f15bb675228 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1471 microversion: 2.1 time: 1.015343 Aug 04 14:42:30.240297 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2930/5852] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:29 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1471 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:30.246799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e9343e4-6808-4eab-a2cc-d19c9fea636b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:30.247582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2e9343e4-6808-4eab-a2cc-d19c9fea636b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:30.259172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e9343e4-6808-4eab-a2cc-d19c9fea636b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:30.260698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e9343e4-6808-4eab-a2cc-d19c9fea636b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:30.262022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e9343e4-6808-4eab-a2cc-d19c9fea636b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:30.262895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e9343e4-6808-4eab-a2cc-d19c9fea636b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:30.343922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2e9343e4-6808-4eab-a2cc-d19c9fea636b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:42:30.364101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0bb7a527-16d8-4665-9cd2-ccd286e27e81 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:30.397378 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0bb7a527-16d8-4665-9cd2-ccd286e27e81 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1214 microversion: 2.1 time: 1.040377 Aug 04 14:42:30.400125 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2923/5853] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:29 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1214 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:30.572693 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e9343e4-6808-4eab-a2cc-d19c9fea636b tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 204 len: 0 microversion: 2.1 time: 0.330141 Aug 04 14:42:30.578996 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2931/5854] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:42:30 2022] DELETE /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:42:30.590300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4da4112-9c1f-49d4-945a-ab92a29f72ed tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:30.592861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4da4112-9c1f-49d4-945a-ab92a29f72ed tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:30.608091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4da4112-9c1f-49d4-945a-ab92a29f72ed tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:30.609794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4da4112-9c1f-49d4-945a-ab92a29f72ed tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:30.611472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4da4112-9c1f-49d4-945a-ab92a29f72ed tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:30.612492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4da4112-9c1f-49d4-945a-ab92a29f72ed tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:31.243023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d4da4112-9c1f-49d4-945a-ab92a29f72ed tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:31.262675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:31.278075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b0161ccb-1c57-4c82-9da1-5dd13dd533a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:31.282036 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4da4112-9c1f-49d4-945a-ab92a29f72ed tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1503 microversion: 2.1 time: 0.700563 Aug 04 14:42:31.289250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b0161ccb-1c57-4c82-9da1-5dd13dd533a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:31.308908 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2924/5855] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:30 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1503 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:31.311572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0161ccb-1c57-4c82-9da1-5dd13dd533a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:31.312026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0161ccb-1c57-4c82-9da1-5dd13dd533a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:31.317875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0161ccb-1c57-4c82-9da1-5dd13dd533a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:31.318566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b0161ccb-1c57-4c82-9da1-5dd13dd533a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:31.420963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a3c0ce4-0023-42fd-95c1-c9da98246197 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:31.423971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a3c0ce4-0023-42fd-95c1-c9da98246197 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:31.432278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a3c0ce4-0023-42fd-95c1-c9da98246197 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:31.433061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a3c0ce4-0023-42fd-95c1-c9da98246197 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:31.434037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a3c0ce4-0023-42fd-95c1-c9da98246197 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:31.435047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a3c0ce4-0023-42fd-95c1-c9da98246197 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:31.916167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:31.965379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2a3c0ce4-0023-42fd-95c1-c9da98246197 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:31.978537 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a3c0ce4-0023-42fd-95c1-c9da98246197 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1214 microversion: 2.1 time: 0.560968 Aug 04 14:42:31.994327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b0161ccb-1c57-4c82-9da1-5dd13dd533a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:31.997192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:32.001820 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2925/5856] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:31 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1214 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:32.032700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b0161ccb-1c57-4c82-9da1-5dd13dd533a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1643 microversion: 2.1 time: 0.762578 Aug 04 14:42:32.033694 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2932/5857] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:31 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1643 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:32.061924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2d36ff19-fb81-4d90-993d-cf71a451716d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:32.063124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2d36ff19-fb81-4d90-993d-cf71a451716d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:32.084782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d36ff19-fb81-4d90-993d-cf71a451716d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:32.088937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d36ff19-fb81-4d90-993d-cf71a451716d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:32.090079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d36ff19-fb81-4d90-993d-cf71a451716d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:32.090545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d36ff19-fb81-4d90-993d-cf71a451716d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:32.331990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9ffdec06-115b-4336-a7cb-ef37bdd01926 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:32.333433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9ffdec06-115b-4336-a7cb-ef37bdd01926 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:32.347055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ffdec06-115b-4336-a7cb-ef37bdd01926 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:32.347911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ffdec06-115b-4336-a7cb-ef37bdd01926 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:32.349736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ffdec06-115b-4336-a7cb-ef37bdd01926 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:32.352771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9ffdec06-115b-4336-a7cb-ef37bdd01926 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:32.854901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2d36ff19-fb81-4d90-993d-cf71a451716d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:32.868561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9ffdec06-115b-4336-a7cb-ef37bdd01926 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5954fbfa723847429c297afb64a1f6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7753fb96ba144d26a106d1d334abfe75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:32.902596 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2d36ff19-fb81-4d90-993d-cf71a451716d tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1643 microversion: 2.1 time: 0.844527 Aug 04 14:42:32.908773 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2926/5858] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:32 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1643 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:32.912738 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9ffdec06-115b-4336-a7cb-ef37bdd01926 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 200 len: 1503 microversion: 2.1 time: 0.587898 Aug 04 14:42:32.918843 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2933/5859] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:32 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 1503 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:32.978010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c810f626-411f-4929-8067-e6ad8af6cf0e tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:32.981717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c810f626-411f-4929-8067-e6ad8af6cf0e tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:32.994375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-19938140-a048-48d4-a5f9-b7f46b7758e7 req-f1524647-6f78-482f-afb3-ae4959ab490a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9db4cab1-6979-44d6-b19b-4df400d9c732", "name": "network-vif-deleted", "tag": "44ce26d0-02fb-474b-8f8f-4a9a9c53e69b"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:33.002505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c810f626-411f-4929-8067-e6ad8af6cf0e tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:33.004307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c810f626-411f-4929-8067-e6ad8af6cf0e tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:33.006995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c810f626-411f-4929-8067-e6ad8af6cf0e tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:33.008703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c810f626-411f-4929-8067-e6ad8af6cf0e tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:33.010953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-19938140-a048-48d4-a5f9-b7f46b7758e7 req-f1524647-6f78-482f-afb3-ae4959ab490a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:33.011748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-19938140-a048-48d4-a5f9-b7f46b7758e7 req-f1524647-6f78-482f-afb3-ae4959ab490a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:33.045447 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-19938140-a048-48d4-a5f9-b7f46b7758e7 req-f1524647-6f78-482f-afb3-ae4959ab490a service nova] Creating event network-vif-deleted:44ce26d0-02fb-474b-8f8f-4a9a9c53e69b for instance 9db4cab1-6979-44d6-b19b-4df400d9c732 on n-h2-844627-10 Aug 04 14:42:33.060785 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-19938140-a048-48d4-a5f9-b7f46b7758e7 req-f1524647-6f78-482f-afb3-ae4959ab490a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119736 Aug 04 14:42:33.063664 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2934/5860] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:42:33.078294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df2f0efc-0c51-485e-8257-38006b8bb57b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:33.080060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df2f0efc-0c51-485e-8257-38006b8bb57b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:33.093030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df2f0efc-0c51-485e-8257-38006b8bb57b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:33.094692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df2f0efc-0c51-485e-8257-38006b8bb57b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:33.096447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df2f0efc-0c51-485e-8257-38006b8bb57b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:33.097758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df2f0efc-0c51-485e-8257-38006b8bb57b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:33.393259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df2f0efc-0c51-485e-8257-38006b8bb57b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:33.408314 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df2f0efc-0c51-485e-8257-38006b8bb57b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1214 microversion: 2.1 time: 0.338150 Aug 04 14:42:33.420895 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2935/5861] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:33 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1214 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:33.868806 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c810f626-411f-4929-8067-e6ad8af6cf0e tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1796 microversion: 2.1 time: 0.932964 Aug 04 14:42:33.871173 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2927/5862] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:32 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1796 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:33.964255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:33.966996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] [instance: 9db4cab1-6979-44d6-b19b-4df400d9c732] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:33.982732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:33.983828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:33.985918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:33.986922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:34.018728 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] HTTP exception thrown: Instance 9db4cab1-6979-44d6-b19b-4df400d9c732 could not be found. Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Request method failure captured: Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 HTTP/1.1 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qDudbRhk2X_v5I3HQCJFUoC-9k-eNCyA9woL_9jmUJcBRkpE5W0HHkH5P_TbvgBdbjNfn7e6C6U5mKFRCKcxaWoFRF6FxHdF9p_4eB4JDUDe3Ko-7XYRBw1IYYe7H-4XKtp7wie4bGPxw1uz102B8EdWGELNx43T-bj52y2CI76eg Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 7753fb96ba144d26a106d1d334abfe75 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-VolumesActionsTest-1257937068 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7753fb96ba144d26a106d1d334abfe75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7753fb96ba144d26a106d1d334abfe75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7753fb96ba144d26a106d1d334abfe75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7753fb96ba144d26a106d1d334abfe75"}]}] Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-VolumesActionsTest-1257937068 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 7753fb96ba144d26a106d1d334abfe75 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-VolumesActionsTest-1257937068 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-VolumesActionsTest-1257937068-project Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 5954fbfa723847429c297afb64a1f6a4 Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-VolumesActionsTest-1257937068-project Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 9db4cab1-6979-44d6-b19b-4df400d9c732 could not be found. Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9db4cab1-6979-44d6-b19b-4df400d9c732'} Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9db4cab1-6979-44d6-b19b-4df400d9c732 could not be found. Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9db4cab1-6979-44d6-b19b-4df400d9c732 could not be found. Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:42:34.021989 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:42:34.030572 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:42:34.030572 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:42:34.030572 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:42:34.030572 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:42:34.030572 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:42:34.030572 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9db4cab1-6979-44d6-b19b-4df400d9c732 could not be found. Aug 04 14:42:34.030572 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:42:34.030572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] Returning 404 to user: Instance 9db4cab1-6979-44d6-b19b-4df400d9c732 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:42:34.030572 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-510ccc86-c30d-4e35-a192-a12212006f59 tempest-VolumesActionsTest-1257937068 tempest-VolumesActionsTest-1257937068-project] 10.222.0.66 "GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732" status: 404 len: 111 microversion: 2.1 time: 0.071994 Aug 04 14:42:34.038848 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2936/5863] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:33 2022] GET /compute/v2.1/servers/9db4cab1-6979-44d6-b19b-4df400d9c732 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:42:34.430285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-725fc64b-80a1-49d8-bbf5-c1c1c8e814ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:34.431303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-725fc64b-80a1-49d8-bbf5-c1c1c8e814ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:34.442167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-725fc64b-80a1-49d8-bbf5-c1c1c8e814ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:34.446772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-725fc64b-80a1-49d8-bbf5-c1c1c8e814ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:34.448303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-725fc64b-80a1-49d8-bbf5-c1c1c8e814ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:34.449257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-725fc64b-80a1-49d8-bbf5-c1c1c8e814ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:34.760957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-725fc64b-80a1-49d8-bbf5-c1c1c8e814ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:34.792147 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-725fc64b-80a1-49d8-bbf5-c1c1c8e814ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.362721 Aug 04 14:42:34.795810 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2928/5864] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:34 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:35.840795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d85ea961-f3f1-40a8-9999-1842fef837cb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:35.845608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d85ea961-f3f1-40a8-9999-1842fef837cb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:35.874192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d85ea961-f3f1-40a8-9999-1842fef837cb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:35.875657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d85ea961-f3f1-40a8-9999-1842fef837cb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:35.877015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d85ea961-f3f1-40a8-9999-1842fef837cb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:35.878889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d85ea961-f3f1-40a8-9999-1842fef837cb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:36.231871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d85ea961-f3f1-40a8-9999-1842fef837cb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:36.247989 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d85ea961-f3f1-40a8-9999-1842fef837cb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.424799 Aug 04 14:42:36.249402 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2937/5865] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:35 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:37.163724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-621925ad-6b8b-4b2f-a52c-4ec060313a0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:37.167923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-621925ad-6b8b-4b2f-a52c-4ec060313a0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:37.192544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-621925ad-6b8b-4b2f-a52c-4ec060313a0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:37.193808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-621925ad-6b8b-4b2f-a52c-4ec060313a0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:37.194577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-621925ad-6b8b-4b2f-a52c-4ec060313a0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:37.197634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-621925ad-6b8b-4b2f-a52c-4ec060313a0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:37.279279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2776a4d8-6398-4ba5-bf25-7dba2dd79a2a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:37.282805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2776a4d8-6398-4ba5-bf25-7dba2dd79a2a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:37.299016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2776a4d8-6398-4ba5-bf25-7dba2dd79a2a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:37.301156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2776a4d8-6398-4ba5-bf25-7dba2dd79a2a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:37.302922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2776a4d8-6398-4ba5-bf25-7dba2dd79a2a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:37.304028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2776a4d8-6398-4ba5-bf25-7dba2dd79a2a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:37.330828 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-621925ad-6b8b-4b2f-a52c-4ec060313a0b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f/action" status: 200 len: 24571 microversion: 2.1 time: 0.183761 Aug 04 14:42:37.350902 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2929/5866] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:42:37 2022] POST /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f/action => generated 24571 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:42:37.764723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2776a4d8-6398-4ba5-bf25-7dba2dd79a2a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:37.779915 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2776a4d8-6398-4ba5-bf25-7dba2dd79a2a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.511639 Aug 04 14:42:37.798116 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2938/5867] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:37 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:38.399393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0fd14498-abc7-41b1-8c80-dd9cbeda6e6a req-9ab57fb2-1799-4946-a67f-94ab25b70817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d63ced-7cc2-4a2a-bd61-a15c3976f331", "tag": "8f0bcd44-ee02-4606-ad7d-63123beafcd7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:38.422589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0fd14498-abc7-41b1-8c80-dd9cbeda6e6a req-9ab57fb2-1799-4946-a67f-94ab25b70817 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:38.423041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0fd14498-abc7-41b1-8c80-dd9cbeda6e6a req-9ab57fb2-1799-4946-a67f-94ab25b70817 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:38.471550 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0fd14498-abc7-41b1-8c80-dd9cbeda6e6a req-9ab57fb2-1799-4946-a67f-94ab25b70817 service nova] Creating event network-changed:8f0bcd44-ee02-4606-ad7d-63123beafcd7 for instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 on n-h2-844627-10 Aug 04 14:42:38.496998 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0fd14498-abc7-41b1-8c80-dd9cbeda6e6a req-9ab57fb2-1799-4946-a67f-94ab25b70817 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102376 Aug 04 14:42:38.502005 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2930/5868] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:42:38.807291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6bec30e4-7faf-4979-b073-2010f53aa159 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:38.808173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6bec30e4-7faf-4979-b073-2010f53aa159 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:38.826269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bec30e4-7faf-4979-b073-2010f53aa159 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:38.829838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bec30e4-7faf-4979-b073-2010f53aa159 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:38.843860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bec30e4-7faf-4979-b073-2010f53aa159 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:38.844818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6bec30e4-7faf-4979-b073-2010f53aa159 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:39.195155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6bec30e4-7faf-4979-b073-2010f53aa159 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:39.210538 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6bec30e4-7faf-4979-b073-2010f53aa159 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.408432 Aug 04 14:42:39.212859 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2939/5869] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:38 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:40.247151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-273296fe-aeab-4d1f-b943-4fd72eca44e8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:40.247941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-273296fe-aeab-4d1f-b943-4fd72eca44e8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:40.271842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-273296fe-aeab-4d1f-b943-4fd72eca44e8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:40.272415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-273296fe-aeab-4d1f-b943-4fd72eca44e8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:40.273559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-273296fe-aeab-4d1f-b943-4fd72eca44e8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:40.278578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-273296fe-aeab-4d1f-b943-4fd72eca44e8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:40.283119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:40.678999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-273296fe-aeab-4d1f-b943-4fd72eca44e8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:40.703938 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-273296fe-aeab-4d1f-b943-4fd72eca44e8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.454742 Aug 04 14:42:40.705202 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2931/5870] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:40 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:41.727293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e523524b-2564-48b2-a8c2-e07d92dbfe6b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:41.728078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e523524b-2564-48b2-a8c2-e07d92dbfe6b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:41.749625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e523524b-2564-48b2-a8c2-e07d92dbfe6b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:41.751373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e523524b-2564-48b2-a8c2-e07d92dbfe6b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:41.756774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e523524b-2564-48b2-a8c2-e07d92dbfe6b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:41.757948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e523524b-2564-48b2-a8c2-e07d92dbfe6b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:42.255226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e523524b-2564-48b2-a8c2-e07d92dbfe6b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:42.271768 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e523524b-2564-48b2-a8c2-e07d92dbfe6b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.549351 Aug 04 14:42:42.279085 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2940/5871] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:41 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:43.302619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e8d72da-52f7-4b95-8d1a-17a77cc3fc59 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:43.303576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e8d72da-52f7-4b95-8d1a-17a77cc3fc59 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:43.331537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e8d72da-52f7-4b95-8d1a-17a77cc3fc59 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:43.331928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e8d72da-52f7-4b95-8d1a-17a77cc3fc59 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:43.339152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e8d72da-52f7-4b95-8d1a-17a77cc3fc59 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:43.339627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e8d72da-52f7-4b95-8d1a-17a77cc3fc59 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:43.913520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5e8d72da-52f7-4b95-8d1a-17a77cc3fc59 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:44.030378 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e8d72da-52f7-4b95-8d1a-17a77cc3fc59 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.725956 Aug 04 14:42:44.032102 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2932/5872] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:43 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:45.065053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-59ad2874-b6cb-4956-b316-5cd2382f9877 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:45.068915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-59ad2874-b6cb-4956-b316-5cd2382f9877 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:45.094959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59ad2874-b6cb-4956-b316-5cd2382f9877 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:45.096238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59ad2874-b6cb-4956-b316-5cd2382f9877 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:45.098263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59ad2874-b6cb-4956-b316-5cd2382f9877 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:45.099650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59ad2874-b6cb-4956-b316-5cd2382f9877 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:45.699108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-59ad2874-b6cb-4956-b316-5cd2382f9877 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:45.735762 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-59ad2874-b6cb-4956-b316-5cd2382f9877 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.682849 Aug 04 14:42:45.749047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2941/5873] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:45 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:42:46.766999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be9fde2f-444d-44a7-b37c-7b88c31319b5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:46.772466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be9fde2f-444d-44a7-b37c-7b88c31319b5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:46.781926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be9fde2f-444d-44a7-b37c-7b88c31319b5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:46.782841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be9fde2f-444d-44a7-b37c-7b88c31319b5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:46.784154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be9fde2f-444d-44a7-b37c-7b88c31319b5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:46.785736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be9fde2f-444d-44a7-b37c-7b88c31319b5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:47.079904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-be9fde2f-444d-44a7-b37c-7b88c31319b5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:47.096323 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be9fde2f-444d-44a7-b37c-7b88c31319b5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.332648 Aug 04 14:42:47.097783 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2933/5874] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:46 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:48.147419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-671e496b-8f87-47ba-a742-f4e4a7c85d4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:48.149748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-671e496b-8f87-47ba-a742-f4e4a7c85d4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:48.170477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:48.177622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-671e496b-8f87-47ba-a742-f4e4a7c85d4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:48.181642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-671e496b-8f87-47ba-a742-f4e4a7c85d4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:48.183000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-671e496b-8f87-47ba-a742-f4e4a7c85d4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:48.183713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-671e496b-8f87-47ba-a742-f4e4a7c85d4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:48.555492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-671e496b-8f87-47ba-a742-f4e4a7c85d4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:48.566361 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-671e496b-8f87-47ba-a742-f4e4a7c85d4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.429284 Aug 04 14:42:48.574454 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2942/5875] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:48 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:49.588788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-636e6739-431f-48e4-96b1-c340beafb02f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:49.589482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-636e6739-431f-48e4-96b1-c340beafb02f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:49.613293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-636e6739-431f-48e4-96b1-c340beafb02f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:49.613293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-636e6739-431f-48e4-96b1-c340beafb02f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:49.613293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-636e6739-431f-48e4-96b1-c340beafb02f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:49.613293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-636e6739-431f-48e4-96b1-c340beafb02f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:50.024790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-636e6739-431f-48e4-96b1-c340beafb02f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:50.035768 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-636e6739-431f-48e4-96b1-c340beafb02f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.451717 Aug 04 14:42:50.037285 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2934/5876] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:49 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:50.578483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-41048898-8b02-469b-9f5f-8aa251bcded0 req-35ac5ebf-85be-4d34-87be-e747f3f485ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae1ef48-6bd6-48c0-961d-e53d55082311", "name": "network-vif-plugged", "status": "completed", "tag": "a2f4cffd-12d7-478e-8dce-533443e502da"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:42:50.603819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-41048898-8b02-469b-9f5f-8aa251bcded0 req-35ac5ebf-85be-4d34-87be-e747f3f485ad service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:50.604303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-41048898-8b02-469b-9f5f-8aa251bcded0 req-35ac5ebf-85be-4d34-87be-e747f3f485ad service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:50.630094 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-41048898-8b02-469b-9f5f-8aa251bcded0 req-35ac5ebf-85be-4d34-87be-e747f3f485ad service nova] Creating event network-vif-plugged:a2f4cffd-12d7-478e-8dce-533443e502da for instance 6ae1ef48-6bd6-48c0-961d-e53d55082311 on n-h1-844627-10 Aug 04 14:42:50.644186 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-41048898-8b02-469b-9f5f-8aa251bcded0 req-35ac5ebf-85be-4d34-87be-e747f3f485ad service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068350 Aug 04 14:42:50.647041 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2943/5877] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:42:51.061634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a804260-2d58-420a-8046-9c647d43f11b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:51.063466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a804260-2d58-420a-8046-9c647d43f11b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:51.078491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a804260-2d58-420a-8046-9c647d43f11b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:51.085284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a804260-2d58-420a-8046-9c647d43f11b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:51.086624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a804260-2d58-420a-8046-9c647d43f11b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:51.087289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a804260-2d58-420a-8046-9c647d43f11b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:51.475800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7a804260-2d58-420a-8046-9c647d43f11b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:51.491277 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a804260-2d58-420a-8046-9c647d43f11b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.434930 Aug 04 14:42:51.504895 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2935/5878] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:51 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:52.521877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8eaeb1ad-cf5d-4ef9-8f70-1d416e6e11fc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:52.523313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8eaeb1ad-cf5d-4ef9-8f70-1d416e6e11fc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:52.547553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eaeb1ad-cf5d-4ef9-8f70-1d416e6e11fc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:52.548330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eaeb1ad-cf5d-4ef9-8f70-1d416e6e11fc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:52.549688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eaeb1ad-cf5d-4ef9-8f70-1d416e6e11fc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:52.550537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eaeb1ad-cf5d-4ef9-8f70-1d416e6e11fc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:52.994543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8eaeb1ad-cf5d-4ef9-8f70-1d416e6e11fc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:53.010532 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8eaeb1ad-cf5d-4ef9-8f70-1d416e6e11fc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1202 microversion: 2.1 time: 0.497535 Aug 04 14:42:53.012506 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2944/5879] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:52 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1202 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:54.041803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d6e96aa-263a-4ba4-afd6-91de43edb07d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:54.042731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3d6e96aa-263a-4ba4-afd6-91de43edb07d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:54.053442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:42:54.066827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d6e96aa-263a-4ba4-afd6-91de43edb07d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:54.067291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d6e96aa-263a-4ba4-afd6-91de43edb07d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:54.089955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d6e96aa-263a-4ba4-afd6-91de43edb07d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:54.090615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d6e96aa-263a-4ba4-afd6-91de43edb07d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:55.116377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3d6e96aa-263a-4ba4-afd6-91de43edb07d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:55.126675 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3d6e96aa-263a-4ba4-afd6-91de43edb07d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1387 microversion: 2.1 time: 1.088847 Aug 04 14:42:55.127818 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2936/5880] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:54 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1387 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:55.148080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-121bba2c-2035-4a77-830a-5570843b8b5a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:55.149360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-121bba2c-2035-4a77-830a-5570843b8b5a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:55.160813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-121bba2c-2035-4a77-830a-5570843b8b5a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:55.166420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-121bba2c-2035-4a77-830a-5570843b8b5a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:55.171137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-121bba2c-2035-4a77-830a-5570843b8b5a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:55.172307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-121bba2c-2035-4a77-830a-5570843b8b5a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:55.417204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-121bba2c-2035-4a77-830a-5570843b8b5a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:55.433193 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-121bba2c-2035-4a77-830a-5570843b8b5a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1387 microversion: 2.1 time: 0.288799 Aug 04 14:42:55.437467 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2945/5881] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:55 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1387 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:55.454921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ed2aacf-89f9-4339-866d-5edd1b9b8ca1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:55.456943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ed2aacf-89f9-4339-866d-5edd1b9b8ca1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:55.476608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ed2aacf-89f9-4339-866d-5edd1b9b8ca1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:55.478697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ed2aacf-89f9-4339-866d-5edd1b9b8ca1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:55.479869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ed2aacf-89f9-4339-866d-5edd1b9b8ca1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:55.480385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ed2aacf-89f9-4339-866d-5edd1b9b8ca1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:55.969957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ed2aacf-89f9-4339-866d-5edd1b9b8ca1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:55.988275 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ed2aacf-89f9-4339-866d-5edd1b9b8ca1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1387 microversion: 2.1 time: 0.535679 Aug 04 14:42:55.992167 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2937/5882] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:55 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1387 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:56.033828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c19a949f-d50e-4d56-8d7e-688dd783d1f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:56.034844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c19a949f-d50e-4d56-8d7e-688dd783d1f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:56.046321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c19a949f-d50e-4d56-8d7e-688dd783d1f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:56.047108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c19a949f-d50e-4d56-8d7e-688dd783d1f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:56.048191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c19a949f-d50e-4d56-8d7e-688dd783d1f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:56.048902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c19a949f-d50e-4d56-8d7e-688dd783d1f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:56.093781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c19a949f-d50e-4d56-8d7e-688dd783d1f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:42:56.391663 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c19a949f-d50e-4d56-8d7e-688dd783d1f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 204 len: 0 microversion: 2.1 time: 0.359548 Aug 04 14:42:56.397301 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2946/5883] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:42:56 2022] DELETE /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:42:56.413441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c0ffb02-18b3-4900-b099-f9dc0b769868 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:56.415062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c0ffb02-18b3-4900-b099-f9dc0b769868 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:56.471038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c0ffb02-18b3-4900-b099-f9dc0b769868 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:56.477951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c0ffb02-18b3-4900-b099-f9dc0b769868 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:56.483522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c0ffb02-18b3-4900-b099-f9dc0b769868 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:56.486566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c0ffb02-18b3-4900-b099-f9dc0b769868 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:57.798454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c0ffb02-18b3-4900-b099-f9dc0b769868 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:42:57.844067 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c0ffb02-18b3-4900-b099-f9dc0b769868 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1393 microversion: 2.1 time: 1.431873 Aug 04 14:42:57.845858 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2938/5884] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:56 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1393 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:42:58.877341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33705f96-3087-4e8a-849d-55bc5c07db49 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:42:58.890500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-33705f96-3087-4e8a-849d-55bc5c07db49 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:42:58.932678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33705f96-3087-4e8a-849d-55bc5c07db49 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:58.936375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33705f96-3087-4e8a-849d-55bc5c07db49 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:42:58.945234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33705f96-3087-4e8a-849d-55bc5c07db49 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:42:58.949856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33705f96-3087-4e8a-849d-55bc5c07db49 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:00.239432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-33705f96-3087-4e8a-849d-55bc5c07db49 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:00.252590 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-33705f96-3087-4e8a-849d-55bc5c07db49 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1393 microversion: 2.1 time: 1.389073 Aug 04 14:43:00.272397 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2947/5885] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:42:58 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1393 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:00.747227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-80c33ef0-4751-4904-8c41-9cae6c8151e1 req-5d77a5ed-758b-4664-9c06-586822c3d97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae1ef48-6bd6-48c0-961d-e53d55082311", "name": "network-vif-deleted", "tag": "a2f4cffd-12d7-478e-8dce-533443e502da"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:00.823842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-80c33ef0-4751-4904-8c41-9cae6c8151e1 req-5d77a5ed-758b-4664-9c06-586822c3d97f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:00.851183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-80c33ef0-4751-4904-8c41-9cae6c8151e1 req-5d77a5ed-758b-4664-9c06-586822c3d97f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:00.957260 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-80c33ef0-4751-4904-8c41-9cae6c8151e1 req-5d77a5ed-758b-4664-9c06-586822c3d97f service nova] Creating event network-vif-deleted:a2f4cffd-12d7-478e-8dce-533443e502da for instance 6ae1ef48-6bd6-48c0-961d-e53d55082311 on n-h1-844627-10 Aug 04 14:43:00.975359 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-80c33ef0-4751-4904-8c41-9cae6c8151e1 req-5d77a5ed-758b-4664-9c06-586822c3d97f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234038 Aug 04 14:43:00.976031 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2939/5886] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:43:01.279777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c7be7015-b994-4880-a0ea-16c823b9fd77 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:01.280488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c7be7015-b994-4880-a0ea-16c823b9fd77 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:01.301321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7be7015-b994-4880-a0ea-16c823b9fd77 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:01.308834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7be7015-b994-4880-a0ea-16c823b9fd77 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:01.310154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7be7015-b994-4880-a0ea-16c823b9fd77 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:01.314396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7be7015-b994-4880-a0ea-16c823b9fd77 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:01.697006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c7be7015-b994-4880-a0ea-16c823b9fd77 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:01.711007 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c7be7015-b994-4880-a0ea-16c823b9fd77 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1187 microversion: 2.1 time: 0.435090 Aug 04 14:43:01.739096 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2948/5887] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:01 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1187 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:02.733973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-960a95c0-23eb-4bfa-bfeb-fea55d52b850 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:02.734832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-960a95c0-23eb-4bfa-bfeb-fea55d52b850 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:02.753670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-960a95c0-23eb-4bfa-bfeb-fea55d52b850 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:02.754151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-960a95c0-23eb-4bfa-bfeb-fea55d52b850 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:02.755056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-960a95c0-23eb-4bfa-bfeb-fea55d52b850 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:02.759285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-960a95c0-23eb-4bfa-bfeb-fea55d52b850 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:03.134409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-960a95c0-23eb-4bfa-bfeb-fea55d52b850 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:03.148265 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-960a95c0-23eb-4bfa-bfeb-fea55d52b850 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1187 microversion: 2.1 time: 0.420160 Aug 04 14:43:03.152318 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2940/5888] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:02 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1187 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:04.184044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8453c6c7-43b1-4ba9-b522-74f08a69a7af tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:04.186266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8453c6c7-43b1-4ba9-b522-74f08a69a7af tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:04.201548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8453c6c7-43b1-4ba9-b522-74f08a69a7af tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:04.204961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8453c6c7-43b1-4ba9-b522-74f08a69a7af tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:04.207152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8453c6c7-43b1-4ba9-b522-74f08a69a7af tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:04.207988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8453c6c7-43b1-4ba9-b522-74f08a69a7af tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:04.212054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:04.419176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8453c6c7-43b1-4ba9-b522-74f08a69a7af tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:04.437184 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8453c6c7-43b1-4ba9-b522-74f08a69a7af tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1187 microversion: 2.1 time: 0.257957 Aug 04 14:43:04.447091 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2949/5889] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:04 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1187 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:05.474940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-945d9ec7-06da-4d39-9651-8d92b426756f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:05.476267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-945d9ec7-06da-4d39-9651-8d92b426756f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:05.495152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-945d9ec7-06da-4d39-9651-8d92b426756f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:05.495733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-945d9ec7-06da-4d39-9651-8d92b426756f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:05.496789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-945d9ec7-06da-4d39-9651-8d92b426756f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:05.498685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-945d9ec7-06da-4d39-9651-8d92b426756f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:05.652566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-945d9ec7-06da-4d39-9651-8d92b426756f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:05.731655 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-945d9ec7-06da-4d39-9651-8d92b426756f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1187 microversion: 2.1 time: 0.256649 Aug 04 14:43:05.742227 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2941/5890] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:05 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1187 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:06.785538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-84a35459-0a03-4c7f-aeef-da2cd034847b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:06.786766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-84a35459-0a03-4c7f-aeef-da2cd034847b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:06.829522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84a35459-0a03-4c7f-aeef-da2cd034847b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:06.830329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84a35459-0a03-4c7f-aeef-da2cd034847b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:06.831817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84a35459-0a03-4c7f-aeef-da2cd034847b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:06.832626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84a35459-0a03-4c7f-aeef-da2cd034847b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:07.071340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-84a35459-0a03-4c7f-aeef-da2cd034847b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:07.084490 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-84a35459-0a03-4c7f-aeef-da2cd034847b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1187 microversion: 2.1 time: 0.307181 Aug 04 14:43:07.099970 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2950/5891] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:06 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1187 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:07.798863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-85343bb0-d8c2-40f4-91cc-900a267331aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:07.800977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-85343bb0-d8c2-40f4-91cc-900a267331aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:07.815141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85343bb0-d8c2-40f4-91cc-900a267331aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:07.816820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85343bb0-d8c2-40f4-91cc-900a267331aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:07.818446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85343bb0-d8c2-40f4-91cc-900a267331aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:07.819844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85343bb0-d8c2-40f4-91cc-900a267331aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:08.127913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1f11a569-a90e-43d8-820e-42313f3ee174 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:08.129267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1f11a569-a90e-43d8-820e-42313f3ee174 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:08.152579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f11a569-a90e-43d8-820e-42313f3ee174 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:08.156333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f11a569-a90e-43d8-820e-42313f3ee174 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:08.177898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f11a569-a90e-43d8-820e-42313f3ee174 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:08.179392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f11a569-a90e-43d8-820e-42313f3ee174 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:08.609067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1f11a569-a90e-43d8-820e-42313f3ee174 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:08.611294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-85343bb0-d8c2-40f4-91cc-900a267331aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:08.625791 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-85343bb0-d8c2-40f4-91cc-900a267331aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1682 microversion: 2.1 time: 0.831379 Aug 04 14:43:08.627581 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2942/5892] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:07 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1682 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:08.670441 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1f11a569-a90e-43d8-820e-42313f3ee174 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1187 microversion: 2.1 time: 0.546777 Aug 04 14:43:08.674690 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2951/5893] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:08 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1187 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:08.837216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a55f48c8-1179-451e-abc9-bae4d083afa9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:08.852230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a55f48c8-1179-451e-abc9-bae4d083afa9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:08.884186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a55f48c8-1179-451e-abc9-bae4d083afa9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:08.888842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a55f48c8-1179-451e-abc9-bae4d083afa9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:08.891285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a55f48c8-1179-451e-abc9-bae4d083afa9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:08.893972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a55f48c8-1179-451e-abc9-bae4d083afa9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:09.013005 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a55f48c8-1179-451e-abc9-bae4d083afa9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f/action" status: 200 len: 32645 microversion: 2.1 time: 0.200035 Aug 04 14:43:09.026958 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2943/5894] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:43:08 2022] POST /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f/action => generated 32645 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:43:09.183763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-76236973-6b77-417f-9dad-c7ff32380b56 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:09.189416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-76236973-6b77-417f-9dad-c7ff32380b56 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:09.206876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76236973-6b77-417f-9dad-c7ff32380b56 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:09.209464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76236973-6b77-417f-9dad-c7ff32380b56 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:09.210669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76236973-6b77-417f-9dad-c7ff32380b56 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:09.213458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-76236973-6b77-417f-9dad-c7ff32380b56 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:09.692182 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-76236973-6b77-417f-9dad-c7ff32380b56 tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1835 microversion: 2.1 time: 0.512587 Aug 04 14:43:09.693636 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2952/5895] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:09 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1835 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:09.716948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbf701ad-4c23-406f-bc40-e6bcb9147e04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:09.723434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cbf701ad-4c23-406f-bc40-e6bcb9147e04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:09.749455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ef716ba3-e972-40fa-b41b-90f2ec78c22d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:09.751417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbf701ad-4c23-406f-bc40-e6bcb9147e04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:09.753523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ef716ba3-e972-40fa-b41b-90f2ec78c22d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:09.759016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbf701ad-4c23-406f-bc40-e6bcb9147e04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:09.774254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbf701ad-4c23-406f-bc40-e6bcb9147e04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:09.774254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cbf701ad-4c23-406f-bc40-e6bcb9147e04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:09.799022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef716ba3-e972-40fa-b41b-90f2ec78c22d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:09.799523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef716ba3-e972-40fa-b41b-90f2ec78c22d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:09.800495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef716ba3-e972-40fa-b41b-90f2ec78c22d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:09.800991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ef716ba3-e972-40fa-b41b-90f2ec78c22d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:09.850180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-ef716ba3-e972-40fa-b41b-90f2ec78c22d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lazy-loading 'flavor' on Instance uuid 2d67555c-5e06-4723-a973-05045b5b2f4f {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:43:09.889347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ef716ba3-e972-40fa-b41b-90f2ec78c22d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Going to try to live migrate instance to another host {{(pid=130960) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 14:43:09.911680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cbf701ad-4c23-406f-bc40-e6bcb9147e04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:09.922937 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbf701ad-4c23-406f-bc40-e6bcb9147e04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1187 microversion: 2.1 time: 0.226686 Aug 04 14:43:09.930991 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2944/5896] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:09 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1187 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:10.949441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7bfb257b-b19d-4f98-89c2-ec2b1c7f30f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:10.950426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7bfb257b-b19d-4f98-89c2-ec2b1c7f30f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:10.962452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7bfb257b-b19d-4f98-89c2-ec2b1c7f30f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:10.969133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7bfb257b-b19d-4f98-89c2-ec2b1c7f30f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:10.971509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7bfb257b-b19d-4f98-89c2-ec2b1c7f30f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:10.978219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7bfb257b-b19d-4f98-89c2-ec2b1c7f30f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:11.047838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=78 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:11.181920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7bfb257b-b19d-4f98-89c2-ec2b1c7f30f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:11.221393 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7bfb257b-b19d-4f98-89c2-ec2b1c7f30f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1187 microversion: 2.1 time: 0.265412 Aug 04 14:43:11.224696 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2945/5897] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:10 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1187 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:12.245133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:12.247183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:12.262452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:12.266639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:12.268439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:12.270099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:12.366096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:12.373207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:12.374569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lazy-loading 'fault' on Instance uuid 6ae1ef48-6bd6-48c0-961d-e53d55082311 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:43:12.744897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:12.769374 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76cabffb-4a4d-4791-b780-d418962fd63d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 200 len: 1146 microversion: 2.1 time: 0.527940 Aug 04 14:43:12.775052 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2946/5898] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:12 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 1146 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:13.799814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:13.801515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 6ae1ef48-6bd6-48c0-961d-e53d55082311] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:13.831689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:13.843479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:13.845009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:13.854816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:13.945359 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance 6ae1ef48-6bd6-48c0-961d-e53d55082311 could not be found. Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 HTTP/1.1 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 6ae1ef48-6bd6-48c0-961d-e53d55082311 could not be found. Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '6ae1ef48-6bd6-48c0-961d-e53d55082311'} Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ae1ef48-6bd6-48c0-961d-e53d55082311 could not be found. Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ae1ef48-6bd6-48c0-961d-e53d55082311 could not be found. Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:43:13.947176 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:13.951229 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:43:13.951229 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:43:13.951229 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:43:13.951229 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:43:13.951229 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:43:13.951229 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ae1ef48-6bd6-48c0-961d-e53d55082311 could not be found. Aug 04 14:43:13.951229 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:13.967571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance 6ae1ef48-6bd6-48c0-961d-e53d55082311 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:43:13.976623 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d7523542-897e-4bd7-9e88-edf67a67e9c1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311" status: 404 len: 111 microversion: 2.1 time: 0.178151 Aug 04 14:43:13.977623 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2947/5899] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:13 2022] GET /compute/v2.1/servers/6ae1ef48-6bd6-48c0-961d-e53d55082311 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:43:15.023331 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ef716ba3-e972-40fa-b41b-90f2ec78c22d tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f/action" status: 202 len: 0 microversion: 2.1 time: 5.277970 Aug 04 14:43:15.024575 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2953/5900] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:43:09 2022] POST /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f/action => generated 0 bytes in 5280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:43:15.038099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8aaded49-aa86-46ca-a907-07c5d5556399 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:15.040144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8aaded49-aa86-46ca-a907-07c5d5556399 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:15.082861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8aaded49-aa86-46ca-a907-07c5d5556399 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:15.084217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8aaded49-aa86-46ca-a907-07c5d5556399 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:15.085309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8aaded49-aa86-46ca-a907-07c5d5556399 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:15.085963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8aaded49-aa86-46ca-a907-07c5d5556399 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:15.564446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8aaded49-aa86-46ca-a907-07c5d5556399 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:15.602740 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8aaded49-aa86-46ca-a907-07c5d5556399 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 0.572956 Aug 04 14:43:15.607962 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2948/5901] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:15 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:16.676524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b7e31ce-8237-430e-bd6f-0b379eec49fb tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:16.677569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1b7e31ce-8237-430e-bd6f-0b379eec49fb tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:16.693389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b7e31ce-8237-430e-bd6f-0b379eec49fb tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:16.694256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b7e31ce-8237-430e-bd6f-0b379eec49fb tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:16.695230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b7e31ce-8237-430e-bd6f-0b379eec49fb tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:16.695835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b7e31ce-8237-430e-bd6f-0b379eec49fb tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:17.006404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1b7e31ce-8237-430e-bd6f-0b379eec49fb tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:17.024927 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1b7e31ce-8237-430e-bd6f-0b379eec49fb tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 0.356952 Aug 04 14:43:17.027860 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2954/5902] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:16 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:18.055637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f92f747d-2e5e-48c4-9d56-d2059a82f69c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:18.057713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f92f747d-2e5e-48c4-9d56-d2059a82f69c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:18.083431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f92f747d-2e5e-48c4-9d56-d2059a82f69c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:18.088317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f92f747d-2e5e-48c4-9d56-d2059a82f69c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:18.089601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f92f747d-2e5e-48c4-9d56-d2059a82f69c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:18.090258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f92f747d-2e5e-48c4-9d56-d2059a82f69c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:18.644538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f92f747d-2e5e-48c4-9d56-d2059a82f69c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:18.675837 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f92f747d-2e5e-48c4-9d56-d2059a82f69c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 0.626768 Aug 04 14:43:18.689606 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2949/5903] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:18 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:19.729116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3ff1e9e9-d03a-45e4-9c4f-fcc293ef7e5a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:19.730530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3ff1e9e9-d03a-45e4-9c4f-fcc293ef7e5a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:19.766977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:19.794798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ff1e9e9-d03a-45e4-9c4f-fcc293ef7e5a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:19.795320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ff1e9e9-d03a-45e4-9c4f-fcc293ef7e5a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:19.801861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ff1e9e9-d03a-45e4-9c4f-fcc293ef7e5a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:19.802475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3ff1e9e9-d03a-45e4-9c4f-fcc293ef7e5a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:21.046985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3ff1e9e9-d03a-45e4-9c4f-fcc293ef7e5a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:21.055720 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3ff1e9e9-d03a-45e4-9c4f-fcc293ef7e5a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 1.343856 Aug 04 14:43:21.061959 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2955/5904] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:19 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:22.102704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76ef1293-8de4-4afb-9a2a-b03db0f07c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:22.112125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76ef1293-8de4-4afb-9a2a-b03db0f07c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:22.167602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ef1293-8de4-4afb-9a2a-b03db0f07c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:22.168732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ef1293-8de4-4afb-9a2a-b03db0f07c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:22.178691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ef1293-8de4-4afb-9a2a-b03db0f07c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:22.180102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76ef1293-8de4-4afb-9a2a-b03db0f07c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:22.250106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d2184557-d2d2-45e4-9c2e-39eff887dca2 req-5e93ce87-fa9b-47aa-abd8-c2ae0639000c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d67555c-5e06-4723-a973-05045b5b2f4f", "name": "network-vif-unplugged", "status": "completed", "tag": "84a1081f-666b-48cc-ae34-6f4505520106"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:22.306939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d2184557-d2d2-45e4-9c2e-39eff887dca2 req-5e93ce87-fa9b-47aa-abd8-c2ae0639000c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:22.308112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d2184557-d2d2-45e4-9c2e-39eff887dca2 req-5e93ce87-fa9b-47aa-abd8-c2ae0639000c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:22.371634 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d2184557-d2d2-45e4-9c2e-39eff887dca2 req-5e93ce87-fa9b-47aa-abd8-c2ae0639000c service nova] Creating event network-vif-unplugged:84a1081f-666b-48cc-ae34-6f4505520106 for instance 2d67555c-5e06-4723-a973-05045b5b2f4f on n-h1-844627-10 Aug 04 14:43:22.404021 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d2184557-d2d2-45e4-9c2e-39eff887dca2 req-5e93ce87-fa9b-47aa-abd8-c2ae0639000c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157873 Aug 04 14:43:22.404720 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2956/5905] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:43:23.899308 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:43:23.900121 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 14:43:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f (ip 10.222.0.66) !!! Aug 04 14:43:24.236507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76ef1293-8de4-4afb-9a2a-b03db0f07c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:24.286066 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76ef1293-8de4-4afb-9a2a-b03db0f07c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 2.190948 Aug 04 14:43:24.293490 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2950/5906] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:22 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:24.549987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3e193a7c-6fe7-4bbf-aa46-da653730460e req-b8c7b345-686a-4e89-91b5-540ee10709c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d67555c-5e06-4723-a973-05045b5b2f4f", "tag": "84a1081f-666b-48cc-ae34-6f4505520106"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:24.623218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3e193a7c-6fe7-4bbf-aa46-da653730460e req-b8c7b345-686a-4e89-91b5-540ee10709c3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:24.623679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3e193a7c-6fe7-4bbf-aa46-da653730460e req-b8c7b345-686a-4e89-91b5-540ee10709c3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:24.684140 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3e193a7c-6fe7-4bbf-aa46-da653730460e req-b8c7b345-686a-4e89-91b5-540ee10709c3 service nova] Creating event network-changed:84a1081f-666b-48cc-ae34-6f4505520106 for instance 2d67555c-5e06-4723-a973-05045b5b2f4f on n-h1-844627-10 Aug 04 14:43:24.703382 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3e193a7c-6fe7-4bbf-aa46-da653730460e req-b8c7b345-686a-4e89-91b5-540ee10709c3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160674 Aug 04 14:43:24.705017 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2957/5907] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:43:25.353392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13cef8d2-89e3-4f58-b34c-103135c9799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:25.354482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13cef8d2-89e3-4f58-b34c-103135c9799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:25.398650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=32 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:25.439173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13cef8d2-89e3-4f58-b34c-103135c9799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:25.443560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13cef8d2-89e3-4f58-b34c-103135c9799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:25.445414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13cef8d2-89e3-4f58-b34c-103135c9799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:25.449599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13cef8d2-89e3-4f58-b34c-103135c9799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:26.328539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-13cef8d2-89e3-4f58-b34c-103135c9799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:26.362117 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13cef8d2-89e3-4f58-b34c-103135c9799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 1.030817 Aug 04 14:43:26.371971 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2951/5908] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:25 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:27.416600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d6c262f-1104-4589-8b2e-a0c64fa89b11 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:27.418304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d6c262f-1104-4589-8b2e-a0c64fa89b11 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:27.435166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d6c262f-1104-4589-8b2e-a0c64fa89b11 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:27.436466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d6c262f-1104-4589-8b2e-a0c64fa89b11 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:27.442475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d6c262f-1104-4589-8b2e-a0c64fa89b11 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:27.443504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d6c262f-1104-4589-8b2e-a0c64fa89b11 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:28.180163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d6c262f-1104-4589-8b2e-a0c64fa89b11 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:28.211809 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d6c262f-1104-4589-8b2e-a0c64fa89b11 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 0.800150 Aug 04 14:43:28.215581 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2958/5909] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:27 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:29.265688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-94bd7896-9dc5-4bc6-a3d9-da904c00e8a3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:29.268097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-94bd7896-9dc5-4bc6-a3d9-da904c00e8a3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:29.327814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94bd7896-9dc5-4bc6-a3d9-da904c00e8a3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:29.332414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94bd7896-9dc5-4bc6-a3d9-da904c00e8a3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:29.336231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94bd7896-9dc5-4bc6-a3d9-da904c00e8a3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:29.340413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-94bd7896-9dc5-4bc6-a3d9-da904c00e8a3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:29.926005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-94bd7896-9dc5-4bc6-a3d9-da904c00e8a3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:29.948349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1895842393", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "314e6897-ed8b-405b-8389-b18aa0b1bf3d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1361925526", "security_groups": []}, "os:scheduler_hints": {"different_host": ["35d63ced-7cc2-4a2a-bd61-a15c3976f331"]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:29.962121 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-94bd7896-9dc5-4bc6-a3d9-da904c00e8a3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 0.710859 Aug 04 14:43:29.962739 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2952/5910] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:29 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:30.088807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] validate_networks() for [('314e6897-ed8b-405b-8389-b18aa0b1bf3d', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:43:30.993680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a53f6ba9-84d8-4d6f-978f-56a9b457b0ae tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:30.997173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a53f6ba9-84d8-4d6f-978f-56a9b457b0ae tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:31.030093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a53f6ba9-84d8-4d6f-978f-56a9b457b0ae tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:31.031583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a53f6ba9-84d8-4d6f-978f-56a9b457b0ae tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:31.039377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a53f6ba9-84d8-4d6f-978f-56a9b457b0ae tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:31.040603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a53f6ba9-84d8-4d6f-978f-56a9b457b0ae tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:31.656541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:43:31.658477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:43:31.659169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:43:31.660636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:43:31.661261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:43:31.666869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a53f6ba9-84d8-4d6f-978f-56a9b457b0ae tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:31.677010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:31.677667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:31.677997 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a53f6ba9-84d8-4d6f-978f-56a9b457b0ae tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 0.697299 Aug 04 14:43:31.678596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2953/5911] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:30 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:31.695250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1481528034", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "139bdc63-4ab4-45f4-817c-8fbcf1b37ab7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da90baac-d2cd-4bbe-ac2b-56b8aae47252"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:31.697243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:31.697994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:31.726130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Getting quotas for project dda0124b567f4c8a82a27e96983efc21. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:43:31.735389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Getting quotas for user 9208ce179392440099aefee54a0332dc and project dda0124b567f4c8a82a27e96983efc21. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:43:31.765244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:43:31.773975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:43:31.996911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] validate_networks() for [('da90baac-d2cd-4bbe-ac2b-56b8aae47252', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:43:32.001918 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f4cedf94-71f8-4a3f-9af6-06483ace5f18 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.057708 Aug 04 14:43:32.004511 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2959/5912] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:43:29 2022] POST /compute/v2.1/servers => generated 361 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:43:32.044713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-49e6a04a-2b27-4213-b108-f9f5a1cf74dc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:32.044713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-49e6a04a-2b27-4213-b108-f9f5a1cf74dc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:32.206845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-49e6a04a-2b27-4213-b108-f9f5a1cf74dc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:32.257388 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-49e6a04a-2b27-4213-b108-f9f5a1cf74dc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1242 microversion: 2.1 time: 0.222788 Aug 04 14:43:32.258453 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2960/5913] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:32 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1242 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:32.703711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-abe186e6-3e95-4047-853f-52778282817c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:32.705642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-abe186e6-3e95-4047-853f-52778282817c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:32.720614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe186e6-3e95-4047-853f-52778282817c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:32.721557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe186e6-3e95-4047-853f-52778282817c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:32.722668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe186e6-3e95-4047-853f-52778282817c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:32.725617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-abe186e6-3e95-4047-853f-52778282817c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:33.469715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:43:33.471102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:43:33.471808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:43:33.472408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:43:33.473167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:43:33.498904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:33.500003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:33.502031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:33.505603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:33.509320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-abe186e6-3e95-4047-853f-52778282817c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:33.523619 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-abe186e6-3e95-4047-853f-52778282817c tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1692 microversion: 2.1 time: 0.823986 Aug 04 14:43:33.529741 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2961/5914] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:32 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1692 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:33.536918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-40ce70ce-4b10-47d3-9f9d-7ba272babfa5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:33.537772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-40ce70ce-4b10-47d3-9f9d-7ba272babfa5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:33.543171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:43:33.550358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for user 374c75516444430ea550446cd477e015 and project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:43:33.569485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40ce70ce-4b10-47d3-9f9d-7ba272babfa5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:33.570685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40ce70ce-4b10-47d3-9f9d-7ba272babfa5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:33.575043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40ce70ce-4b10-47d3-9f9d-7ba272babfa5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:33.577535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40ce70ce-4b10-47d3-9f9d-7ba272babfa5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:33.660306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:43:33.662556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='139bdc63-4ab4-45f4-817c-8fbcf1b37ab7',volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:43:33.877525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-40ce70ce-4b10-47d3-9f9d-7ba272babfa5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:33.881668 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bb84098c-dfa6-40da-8987-e3a1591f5cbb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.201368 Aug 04 14:43:33.888657 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2954/5915] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:43:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:43:33.891633 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-40ce70ce-4b10-47d3-9f9d-7ba272babfa5 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1294 microversion: 2.1 time: 0.359966 Aug 04 14:43:33.894536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b122063-2ecd-4b82-8c07-48b6f84553be tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:33.895443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8b122063-2ecd-4b82-8c07-48b6f84553be tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:33.897217 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2962/5916] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:33 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1294 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:34.069502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8b122063-2ecd-4b82-8c07-48b6f84553be tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:34.121208 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8b122063-2ecd-4b82-8c07-48b6f84553be tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1057 microversion: 2.1 time: 0.230765 Aug 04 14:43:34.130754 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2955/5917] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:33 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1057 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:34.555166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6264ea43-ced3-417e-8832-2ae269bf6a4b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:34.559273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6264ea43-ced3-417e-8832-2ae269bf6a4b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:34.584490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6264ea43-ced3-417e-8832-2ae269bf6a4b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:34.585489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6264ea43-ced3-417e-8832-2ae269bf6a4b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:34.586517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6264ea43-ced3-417e-8832-2ae269bf6a4b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:34.588634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6264ea43-ced3-417e-8832-2ae269bf6a4b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:34.596351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:34.951637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e2f0c61-8177-4ca3-986b-36f63cc79680 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:34.957852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e2f0c61-8177-4ca3-986b-36f63cc79680 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:35.070085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e2f0c61-8177-4ca3-986b-36f63cc79680 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:35.071387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e2f0c61-8177-4ca3-986b-36f63cc79680 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:35.072776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e2f0c61-8177-4ca3-986b-36f63cc79680 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:35.073655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e2f0c61-8177-4ca3-986b-36f63cc79680 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:35.219238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6264ea43-ced3-417e-8832-2ae269bf6a4b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:35.228404 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6264ea43-ced3-417e-8832-2ae269bf6a4b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1682 microversion: 2.1 time: 0.683588 Aug 04 14:43:35.244544 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2963/5918] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:34 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1682 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:35.244544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f4f74743-76ae-421e-ac7e-90eb382a5b2d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:35.244544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f4f74743-76ae-421e-ac7e-90eb382a5b2d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:35.247919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4f74743-76ae-421e-ac7e-90eb382a5b2d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:35.249289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4f74743-76ae-421e-ac7e-90eb382a5b2d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:35.250309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4f74743-76ae-421e-ac7e-90eb382a5b2d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:35.250922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4f74743-76ae-421e-ac7e-90eb382a5b2d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:35.411414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f4f74743-76ae-421e-ac7e-90eb382a5b2d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:35.427943 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f4f74743-76ae-421e-ac7e-90eb382a5b2d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1099 microversion: 2.1 time: 0.192777 Aug 04 14:43:35.429286 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2964/5919] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:35 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1099 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:35.434881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7e2f0c61-8177-4ca3-986b-36f63cc79680 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:35.453182 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e2f0c61-8177-4ca3-986b-36f63cc79680 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.513879 Aug 04 14:43:35.455905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-38a6aaa1-e7ba-45fe-8a1f-500758f30cef tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:35.456856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-38a6aaa1-e7ba-45fe-8a1f-500758f30cef tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:35.460673 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2956/5920] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:34 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:35.466827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38a6aaa1-e7ba-45fe-8a1f-500758f30cef tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:35.468071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38a6aaa1-e7ba-45fe-8a1f-500758f30cef tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:35.469339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38a6aaa1-e7ba-45fe-8a1f-500758f30cef tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:35.469979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38a6aaa1-e7ba-45fe-8a1f-500758f30cef tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:35.937803 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-38a6aaa1-e7ba-45fe-8a1f-500758f30cef tempest-TestNetworkAdvancedServerOps-209859763 tempest-TestNetworkAdvancedServerOps-209859763-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1835 microversion: 2.1 time: 0.506999 Aug 04 14:43:35.941690 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2965/5921] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:35 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1835 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:35.964500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e151287c-f63a-4ede-bf6c-a7131e0a9c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:35.966250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e151287c-f63a-4ede-bf6c-a7131e0a9c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:35.995857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e151287c-f63a-4ede-bf6c-a7131e0a9c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:36.002207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e151287c-f63a-4ede-bf6c-a7131e0a9c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:36.003733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e151287c-f63a-4ede-bf6c-a7131e0a9c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:36.005305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e151287c-f63a-4ede-bf6c-a7131e0a9c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:36.458920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7fe3259e-43ea-4e65-8f87-c4464a43be4d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:36.463129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7fe3259e-43ea-4e65-8f87-c4464a43be4d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:36.488001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7fe3259e-43ea-4e65-8f87-c4464a43be4d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:36.488476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7fe3259e-43ea-4e65-8f87-c4464a43be4d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:36.491182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7fe3259e-43ea-4e65-8f87-c4464a43be4d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:36.491639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7fe3259e-43ea-4e65-8f87-c4464a43be4d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:36.796916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7fe3259e-43ea-4e65-8f87-c4464a43be4d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:36.810232 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7fe3259e-43ea-4e65-8f87-c4464a43be4d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1173 microversion: 2.1 time: 0.361174 Aug 04 14:43:36.812180 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2966/5922] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:36 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1173 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:36.818561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e151287c-f63a-4ede-bf6c-a7131e0a9c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:36.832540 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e151287c-f63a-4ede-bf6c-a7131e0a9c66 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1682 microversion: 2.1 time: 0.868983 Aug 04 14:43:36.834895 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2957/5923] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:35 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1682 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:36.835115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4e22828c-bf99-49f2-ac1a-f4dc2980bbbc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:36.835830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4e22828c-bf99-49f2-ac1a-f4dc2980bbbc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:36.856075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e22828c-bf99-49f2-ac1a-f4dc2980bbbc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:36.857307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e22828c-bf99-49f2-ac1a-f4dc2980bbbc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:36.861227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e22828c-bf99-49f2-ac1a-f4dc2980bbbc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:36.861897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e22828c-bf99-49f2-ac1a-f4dc2980bbbc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:37.015134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4e22828c-bf99-49f2-ac1a-f4dc2980bbbc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:37.024657 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4e22828c-bf99-49f2-ac1a-f4dc2980bbbc tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.211235 Aug 04 14:43:37.031382 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2967/5924] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:36 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:37.078513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4e46bad-fe5f-491c-a6b7-7de5b485113f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:37.081827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4e46bad-fe5f-491c-a6b7-7de5b485113f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:37.091622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e46bad-fe5f-491c-a6b7-7de5b485113f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:37.092534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e46bad-fe5f-491c-a6b7-7de5b485113f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:37.093805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e46bad-fe5f-491c-a6b7-7de5b485113f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:37.094509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e46bad-fe5f-491c-a6b7-7de5b485113f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:37.156332 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4e46bad-fe5f-491c-a6b7-7de5b485113f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f/action" status: 200 len: 38619 microversion: 2.1 time: 0.082170 Aug 04 14:43:37.157268 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2958/5925] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:43:37 2022] POST /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f/action => generated 38619 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 14:43:37.834204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a84457ae-6af5-4306-8b5c-0270be937f03 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:37.836323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a84457ae-6af5-4306-8b5c-0270be937f03 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:37.854882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a84457ae-6af5-4306-8b5c-0270be937f03 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:37.855338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a84457ae-6af5-4306-8b5c-0270be937f03 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:37.859653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a84457ae-6af5-4306-8b5c-0270be937f03 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:37.860104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a84457ae-6af5-4306-8b5c-0270be937f03 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:38.022638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a84457ae-6af5-4306-8b5c-0270be937f03 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:38.040416 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a84457ae-6af5-4306-8b5c-0270be937f03 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1173 microversion: 2.1 time: 0.211263 Aug 04 14:43:38.041144 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2968/5926] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:37 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1173 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:38.077973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b6ed9a8a-5f47-4a16-b3ed-545d09a9b542 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:38.083243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b6ed9a8a-5f47-4a16-b3ed-545d09a9b542 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:38.104315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6ed9a8a-5f47-4a16-b3ed-545d09a9b542 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:38.104982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6ed9a8a-5f47-4a16-b3ed-545d09a9b542 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:38.106161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6ed9a8a-5f47-4a16-b3ed-545d09a9b542 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:38.106776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6ed9a8a-5f47-4a16-b3ed-545d09a9b542 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:38.542155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b6ed9a8a-5f47-4a16-b3ed-545d09a9b542 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:38.552059 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b6ed9a8a-5f47-4a16-b3ed-545d09a9b542 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.481122 Aug 04 14:43:38.552674 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2959/5927] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:38 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:39.064061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-042ddf8c-32be-4551-867c-85f15d9825a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:39.065385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-042ddf8c-32be-4551-867c-85f15d9825a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:39.085287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-042ddf8c-32be-4551-867c-85f15d9825a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:39.085922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-042ddf8c-32be-4551-867c-85f15d9825a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:39.087115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-042ddf8c-32be-4551-867c-85f15d9825a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:39.094340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-042ddf8c-32be-4551-867c-85f15d9825a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:39.580381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5dfaf7e7-7d5a-4c07-9fcf-333984bd9d6b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:39.582502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5dfaf7e7-7d5a-4c07-9fcf-333984bd9d6b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:39.594527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dfaf7e7-7d5a-4c07-9fcf-333984bd9d6b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:39.598810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dfaf7e7-7d5a-4c07-9fcf-333984bd9d6b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:39.600913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dfaf7e7-7d5a-4c07-9fcf-333984bd9d6b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:39.602112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dfaf7e7-7d5a-4c07-9fcf-333984bd9d6b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:39.971687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5dfaf7e7-7d5a-4c07-9fcf-333984bd9d6b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:39.980501 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5dfaf7e7-7d5a-4c07-9fcf-333984bd9d6b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.405499 Aug 04 14:43:39.986831 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2960/5928] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:39 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:40.105640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1459958414", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:40.179287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-042ddf8c-32be-4551-867c-85f15d9825a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:40.204802 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-042ddf8c-32be-4551-867c-85f15d9825a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1215 microversion: 2.1 time: 1.145161 Aug 04 14:43:40.206652 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2969/5929] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:39 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1215 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:40.290365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:43:40.592017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5e2bc1a4-e83a-4ed9-b8a7-8512bb9de617 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:40.592017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5e2bc1a4-e83a-4ed9-b8a7-8512bb9de617 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:40.612627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e2bc1a4-e83a-4ed9-b8a7-8512bb9de617 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:40.613464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e2bc1a4-e83a-4ed9-b8a7-8512bb9de617 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:40.614593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e2bc1a4-e83a-4ed9-b8a7-8512bb9de617 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:40.615392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5e2bc1a4-e83a-4ed9-b8a7-8512bb9de617 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:40.678975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5e2bc1a4-e83a-4ed9-b8a7-8512bb9de617 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:43:40.826249 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5e2bc1a4-e83a-4ed9-b8a7-8512bb9de617 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 204 len: 0 microversion: 2.1 time: 0.242400 Aug 04 14:43:40.832248 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2970/5930] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:43:40 2022] DELETE /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:43:40.853949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-26af1733-d255-4b9e-8f9e-4cdcfb22dcaa req-764a883b-84ee-4211-a3d0-467a15ee44c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d67555c-5e06-4723-a973-05045b5b2f4f", "tag": "84a1081f-666b-48cc-ae34-6f4505520106"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:40.871093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-26af1733-d255-4b9e-8f9e-4cdcfb22dcaa req-764a883b-84ee-4211-a3d0-467a15ee44c1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:40.871901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-26af1733-d255-4b9e-8f9e-4cdcfb22dcaa req-764a883b-84ee-4211-a3d0-467a15ee44c1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:40.900316 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-26af1733-d255-4b9e-8f9e-4cdcfb22dcaa req-764a883b-84ee-4211-a3d0-467a15ee44c1 service nova] Creating event network-changed:84a1081f-666b-48cc-ae34-6f4505520106 for instance 2d67555c-5e06-4723-a973-05045b5b2f4f on n-h2-844627-10 Aug 04 14:43:40.916286 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-26af1733-d255-4b9e-8f9e-4cdcfb22dcaa req-764a883b-84ee-4211-a3d0-467a15ee44c1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074929 Aug 04 14:43:40.917682 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2971/5931] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:43:40.924089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-af11e8c2-6c77-4231-a562-42c97282c789 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:40.929292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-af11e8c2-6c77-4231-a562-42c97282c789 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:40.947004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af11e8c2-6c77-4231-a562-42c97282c789 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:40.949323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af11e8c2-6c77-4231-a562-42c97282c789 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:40.950372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af11e8c2-6c77-4231-a562-42c97282c789 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:40.950830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af11e8c2-6c77-4231-a562-42c97282c789 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:41.006159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:43:41.006757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:43:41.006952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:43:41.007535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:43:41.008119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:43:41.031971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:41.032795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:41.033868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:41.034553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:41.075816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Getting quotas for project b5e229f9e02546159ecd063ede351ac6. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:43:41.088900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Getting quotas for user e267e72ab5834ca8bc3486da219c89c2 and project b5e229f9e02546159ecd063ede351ac6. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:43:41.116277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:43:41.118750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:43:41.226141 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9fb6384b-ce15-4aac-be65-0575552f5b99 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.124938 Aug 04 14:43:41.227395 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2961/5932] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:43:41.241445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-744f6e93-a005-49a3-9762-a942ac11b5bb tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:41.242345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-744f6e93-a005-49a3-9762-a942ac11b5bb tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:41.256961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-744f6e93-a005-49a3-9762-a942ac11b5bb tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:41.257608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-744f6e93-a005-49a3-9762-a942ac11b5bb tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:41.258586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-744f6e93-a005-49a3-9762-a942ac11b5bb tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:41.259196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-744f6e93-a005-49a3-9762-a942ac11b5bb tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:41.282096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=84 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:41.713662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:42.244515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:42.266656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-744f6e93-a005-49a3-9762-a942ac11b5bb tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:42.275716 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-744f6e93-a005-49a3-9762-a942ac11b5bb tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 1.046995 Aug 04 14:43:42.281568 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2962/5933] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:41 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:42.288299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-574f3573-2d0c-4404-bfb5-ce09afe28740 req-e058106c-fc74-47e7-bb20-c5ec963f71ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d860a159-d15c-43ff-a9e4-3786e17f556b", "tag": "67dfe162-f469-47b4-bad1-a770b736ae29"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:42.320679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-574f3573-2d0c-4404-bfb5-ce09afe28740 req-e058106c-fc74-47e7-bb20-c5ec963f71ed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:42.321448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-574f3573-2d0c-4404-bfb5-ce09afe28740 req-e058106c-fc74-47e7-bb20-c5ec963f71ed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:42.347138 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-574f3573-2d0c-4404-bfb5-ce09afe28740 req-e058106c-fc74-47e7-bb20-c5ec963f71ed service nova] Creating event network-changed:67dfe162-f469-47b4-bad1-a770b736ae29 for instance d860a159-d15c-43ff-a9e4-3786e17f556b on n-h1-844627-10 Aug 04 14:43:42.364307 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-574f3573-2d0c-4404-bfb5-ce09afe28740 req-e058106c-fc74-47e7-bb20-c5ec963f71ed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080737 Aug 04 14:43:42.366902 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2963/5934] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:43:42.374351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-784ba373-535e-4528-b802-027b4b8a3c4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:42.375578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-784ba373-535e-4528-b802-027b4b8a3c4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:42.386061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-784ba373-535e-4528-b802-027b4b8a3c4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:42.386867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-784ba373-535e-4528-b802-027b4b8a3c4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:42.389687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-784ba373-535e-4528-b802-027b4b8a3c4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:42.390499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-784ba373-535e-4528-b802-027b4b8a3c4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:42.601244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-af11e8c2-6c77-4231-a562-42c97282c789 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:42.609845 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-af11e8c2-6c77-4231-a562-42c97282c789 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 200 len: 1688 microversion: 2.1 time: 1.690731 Aug 04 14:43:42.625642 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2972/5935] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:40 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 1688 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:42.640595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-48d7f87e-1928-4b74-b4b8-8ba2a847fc69 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:42.644648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-48d7f87e-1928-4b74-b4b8-8ba2a847fc69 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:42.657989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48d7f87e-1928-4b74-b4b8-8ba2a847fc69 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:42.664201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48d7f87e-1928-4b74-b4b8-8ba2a847fc69 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:42.665325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48d7f87e-1928-4b74-b4b8-8ba2a847fc69 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:42.666030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-48d7f87e-1928-4b74-b4b8-8ba2a847fc69 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:42.880629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-48d7f87e-1928-4b74-b4b8-8ba2a847fc69 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:42.890275 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-48d7f87e-1928-4b74-b4b8-8ba2a847fc69 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1266 microversion: 2.1 time: 0.262671 Aug 04 14:43:42.902939 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2973/5936] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:42 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:43.087694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-784ba373-535e-4528-b802-027b4b8a3c4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:43.101343 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-784ba373-535e-4528-b802-027b4b8a3c4e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1215 microversion: 2.1 time: 0.732338 Aug 04 14:43:43.104046 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2964/5937] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:42 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1215 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:43.296843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3c040d9c-3ed4-48b9-a372-402b7083634f req-90d68940-1f62-4607-b385-4f2db27b9a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d67555c-5e06-4723-a973-05045b5b2f4f", "name": "network-vif-deleted", "tag": "84a1081f-666b-48cc-ae34-6f4505520106"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:43.307696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ce6a42c-86dc-4188-8497-9ccdcf0dbee7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:43.308834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ce6a42c-86dc-4188-8497-9ccdcf0dbee7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:43.314265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3c040d9c-3ed4-48b9-a372-402b7083634f req-90d68940-1f62-4607-b385-4f2db27b9a31 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:43.316245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3c040d9c-3ed4-48b9-a372-402b7083634f req-90d68940-1f62-4607-b385-4f2db27b9a31 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:43.330457 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3c040d9c-3ed4-48b9-a372-402b7083634f req-90d68940-1f62-4607-b385-4f2db27b9a31 service nova] Creating event network-vif-deleted:84a1081f-666b-48cc-ae34-6f4505520106 for instance 2d67555c-5e06-4723-a973-05045b5b2f4f on n-h2-844627-10 Aug 04 14:43:43.338014 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3c040d9c-3ed4-48b9-a372-402b7083634f req-90d68940-1f62-4607-b385-4f2db27b9a31 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047560 Aug 04 14:43:43.339934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce6a42c-86dc-4188-8497-9ccdcf0dbee7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:43.341953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce6a42c-86dc-4188-8497-9ccdcf0dbee7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:43.342202 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2974/5938] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:43:43.343674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce6a42c-86dc-4188-8497-9ccdcf0dbee7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:43.345159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ce6a42c-86dc-4188-8497-9ccdcf0dbee7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:43.513932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ce6a42c-86dc-4188-8497-9ccdcf0dbee7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:43.523416 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ce6a42c-86dc-4188-8497-9ccdcf0dbee7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.223298 Aug 04 14:43:43.524343 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2965/5939] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:43 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:43.646505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:43.647561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 2d67555c-5e06-4723-a973-05045b5b2f4f] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:43.663623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:43.664539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:43.665752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:43.666672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:43.692557 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] HTTP exception thrown: Instance 2d67555c-5e06-4723-a973-05045b5b2f4f could not be found. Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Request method failure captured: Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f HTTP/1.1 Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69jFwfUoq1MZ3PkxRE5BkQb7BpiSp69e48CPHsGriFQhxKzUnkiGwYhQQNbePGn0c7hesvf4xJO9DEV2ugJMLpoKcsD8QT28sWC3O_GVBX9cdqtyoLV3WEoG3MH4Vxk5k9ad08hMG6pCpe8VT4Gx9CIcVPTQQppsGB6GyqA9Zs8vudM Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2f1a5cc686e44650a531a8c1026d71e0 Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2f1a5cc686e44650a531a8c1026d71e0"}]}] Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2f1a5cc686e44650a531a8c1026d71e0 Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestNetworkAdvancedServerOps-617904044-project Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 95e5002f80224b4a804be717d5bd9d2c Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestNetworkAdvancedServerOps-617904044-project Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 2d67555c-5e06-4723-a973-05045b5b2f4f could not be found. Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '2d67555c-5e06-4723-a973-05045b5b2f4f'} Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d67555c-5e06-4723-a973-05045b5b2f4f could not be found. Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d67555c-5e06-4723-a973-05045b5b2f4f could not be found. Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:43:43.695825 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:43:43.704355 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:43:43.704355 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:43:43.704355 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:43:43.704355 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:43:43.704355 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:43:43.704355 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:43:43.704355 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d67555c-5e06-4723-a973-05045b5b2f4f could not be found. Aug 04 14:43:43.704355 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:43:43.708803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Returning 404 to user: Instance 2d67555c-5e06-4723-a973-05045b5b2f4f could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:43:43.710070 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba236bd6-ddfa-475b-93c8-888d06553865 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f" status: 404 len: 111 microversion: 2.1 time: 0.073074 Aug 04 14:43:43.711338 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2975/5940] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:43 2022] GET /compute/v2.1/servers/2d67555c-5e06-4723-a973-05045b5b2f4f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:43:43.931065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae8e6016-6a01-4a5b-afb7-bb7cd10ae5b4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:43.932207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ae8e6016-6a01-4a5b-afb7-bb7cd10ae5b4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:43.942100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae8e6016-6a01-4a5b-afb7-bb7cd10ae5b4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:43.943172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae8e6016-6a01-4a5b-afb7-bb7cd10ae5b4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:43.944375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae8e6016-6a01-4a5b-afb7-bb7cd10ae5b4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:43.945111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae8e6016-6a01-4a5b-afb7-bb7cd10ae5b4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:44.064503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae8e6016-6a01-4a5b-afb7-bb7cd10ae5b4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:44.083303 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae8e6016-6a01-4a5b-afb7-bb7cd10ae5b4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1266 microversion: 2.1 time: 0.156278 Aug 04 14:43:44.085697 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2966/5941] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:43 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:44.125552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff3fa521-015a-4958-b0f7-718ec78f6840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:44.126991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff3fa521-015a-4958-b0f7-718ec78f6840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:44.134680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3fa521-015a-4958-b0f7-718ec78f6840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:44.135525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3fa521-015a-4958-b0f7-718ec78f6840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:44.136655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3fa521-015a-4958-b0f7-718ec78f6840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:44.137402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3fa521-015a-4958-b0f7-718ec78f6840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:44.440086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7122306f-d52d-407d-b166-d4e03216fecb req-c3700add-604a-47ba-844d-51160cb32261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa", "tag": "f6216600-3c12-44d2-976b-a6abf7901cfc"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:44.478892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7122306f-d52d-407d-b166-d4e03216fecb req-c3700add-604a-47ba-844d-51160cb32261 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:44.480204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7122306f-d52d-407d-b166-d4e03216fecb req-c3700add-604a-47ba-844d-51160cb32261 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:44.517023 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7122306f-d52d-407d-b166-d4e03216fecb req-c3700add-604a-47ba-844d-51160cb32261 service nova] Creating event network-changed:f6216600-3c12-44d2-976b-a6abf7901cfc for instance 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa on n-h2-844627-10 Aug 04 14:43:44.526884 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7122306f-d52d-407d-b166-d4e03216fecb req-c3700add-604a-47ba-844d-51160cb32261 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096415 Aug 04 14:43:44.527677 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2967/5942] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:43:44.548673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02f5bb2c-2913-4a61-ae07-c0efd4d107ae tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:44.549503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-02f5bb2c-2913-4a61-ae07-c0efd4d107ae tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:44.557044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02f5bb2c-2913-4a61-ae07-c0efd4d107ae tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:44.557759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02f5bb2c-2913-4a61-ae07-c0efd4d107ae tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:44.558903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02f5bb2c-2913-4a61-ae07-c0efd4d107ae tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:44.559665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02f5bb2c-2913-4a61-ae07-c0efd4d107ae tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:44.572701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff3fa521-015a-4958-b0f7-718ec78f6840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:44.585897 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff3fa521-015a-4958-b0f7-718ec78f6840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1215 microversion: 2.1 time: 0.464935 Aug 04 14:43:44.587102 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2976/5943] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:44 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1215 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:44.882197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-02f5bb2c-2913-4a61-ae07-c0efd4d107ae tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:44.891460 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-02f5bb2c-2913-4a61-ae07-c0efd4d107ae tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.349363 Aug 04 14:43:44.892672 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2968/5944] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:44 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:45.108184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d9e6a2f9-9a29-4abc-acf1-7015efa49db6 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:45.108817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d9e6a2f9-9a29-4abc-acf1-7015efa49db6 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:45.120836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9e6a2f9-9a29-4abc-acf1-7015efa49db6 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:45.121822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9e6a2f9-9a29-4abc-acf1-7015efa49db6 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:45.122808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9e6a2f9-9a29-4abc-acf1-7015efa49db6 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:45.123263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d9e6a2f9-9a29-4abc-acf1-7015efa49db6 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:45.311683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d9e6a2f9-9a29-4abc-acf1-7015efa49db6 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:45.327496 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d9e6a2f9-9a29-4abc-acf1-7015efa49db6 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1284 microversion: 2.1 time: 0.222903 Aug 04 14:43:45.328790 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2977/5945] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:45 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:45.625700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-82a01b7d-12db-4c18-b492-f4ace58c182c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:45.627020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-82a01b7d-12db-4c18-b492-f4ace58c182c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:45.636226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82a01b7d-12db-4c18-b492-f4ace58c182c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:45.637057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82a01b7d-12db-4c18-b492-f4ace58c182c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:45.638041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82a01b7d-12db-4c18-b492-f4ace58c182c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:45.639803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-82a01b7d-12db-4c18-b492-f4ace58c182c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:45.935510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-545fe9e5-a575-4585-a769-95498c7b9a49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:45.939999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-545fe9e5-a575-4585-a769-95498c7b9a49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:45.958188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-545fe9e5-a575-4585-a769-95498c7b9a49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:45.959588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-545fe9e5-a575-4585-a769-95498c7b9a49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:45.961595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-545fe9e5-a575-4585-a769-95498c7b9a49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:45.962632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-545fe9e5-a575-4585-a769-95498c7b9a49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:46.177031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-82a01b7d-12db-4c18-b492-f4ace58c182c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:46.208583 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-82a01b7d-12db-4c18-b492-f4ace58c182c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1215 microversion: 2.1 time: 0.588468 Aug 04 14:43:46.210795 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2969/5946] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:45 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1215 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:46.376682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1da29371-c8a9-4e61-b9b1-accf41068e10 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:46.382650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1da29371-c8a9-4e61-b9b1-accf41068e10 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:46.411088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1da29371-c8a9-4e61-b9b1-accf41068e10 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:46.413179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1da29371-c8a9-4e61-b9b1-accf41068e10 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:46.414842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1da29371-c8a9-4e61-b9b1-accf41068e10 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:46.416066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1da29371-c8a9-4e61-b9b1-accf41068e10 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:46.504818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-545fe9e5-a575-4585-a769-95498c7b9a49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:46.548195 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-545fe9e5-a575-4585-a769-95498c7b9a49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.618541 Aug 04 14:43:46.572008 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2978/5947] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:45 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:46.691071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1da29371-c8a9-4e61-b9b1-accf41068e10 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:46.705115 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1da29371-c8a9-4e61-b9b1-accf41068e10 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1272 microversion: 2.1 time: 0.337152 Aug 04 14:43:46.707021 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2970/5948] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:46 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:47.243344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4bcc839-1c20-4adb-b901-b3cfbdaea2bc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:47.246222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b4bcc839-1c20-4adb-b901-b3cfbdaea2bc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:47.260517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4bcc839-1c20-4adb-b901-b3cfbdaea2bc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:47.263341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4bcc839-1c20-4adb-b901-b3cfbdaea2bc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:47.265154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4bcc839-1c20-4adb-b901-b3cfbdaea2bc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:47.265965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4bcc839-1c20-4adb-b901-b3cfbdaea2bc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:47.589314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a528342-1e57-4641-b6b2-89dbc98a3ef0 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:47.590024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a528342-1e57-4641-b6b2-89dbc98a3ef0 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:47.599543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a528342-1e57-4641-b6b2-89dbc98a3ef0 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:47.600010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a528342-1e57-4641-b6b2-89dbc98a3ef0 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:47.600833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a528342-1e57-4641-b6b2-89dbc98a3ef0 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:47.601322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a528342-1e57-4641-b6b2-89dbc98a3ef0 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:48.263801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b4bcc839-1c20-4adb-b901-b3cfbdaea2bc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:48.284568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7a528342-1e57-4641-b6b2-89dbc98a3ef0 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:48.300247 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a528342-1e57-4641-b6b2-89dbc98a3ef0 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.715148 Aug 04 14:43:48.301781 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2971/5949] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:47 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:48.315479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-953ff921-3542-4f34-84d1-a556ffd42cdb tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:48.316614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-953ff921-3542-4f34-84d1-a556ffd42cdb tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:48.331605 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b4bcc839-1c20-4adb-b901-b3cfbdaea2bc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1215 microversion: 2.1 time: 1.086842 Aug 04 14:43:48.332640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-953ff921-3542-4f34-84d1-a556ffd42cdb tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:48.333155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-953ff921-3542-4f34-84d1-a556ffd42cdb tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:48.333983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-953ff921-3542-4f34-84d1-a556ffd42cdb tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:48.334432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-953ff921-3542-4f34-84d1-a556ffd42cdb tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:48.336039 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2979/5950] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:47 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1215 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:48.690017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-100291ab-6c8d-446d-a592-1eae88acfbda req-63857b96-f9f1-4591-8de7-0281badd9a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d860a159-d15c-43ff-a9e4-3786e17f556b", "name": "network-vif-plugged", "status": "completed", "tag": "67dfe162-f469-47b4-bad1-a770b736ae29"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:48.727155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-100291ab-6c8d-446d-a592-1eae88acfbda req-63857b96-f9f1-4591-8de7-0281badd9a5b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:48.739458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-100291ab-6c8d-446d-a592-1eae88acfbda req-63857b96-f9f1-4591-8de7-0281badd9a5b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:48.767136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:48.820409 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-100291ab-6c8d-446d-a592-1eae88acfbda req-63857b96-f9f1-4591-8de7-0281badd9a5b service nova] Creating event network-vif-plugged:67dfe162-f469-47b4-bad1-a770b736ae29 for instance d860a159-d15c-43ff-a9e4-3786e17f556b on n-h1-844627-10 Aug 04 14:43:48.848571 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-100291ab-6c8d-446d-a592-1eae88acfbda req-63857b96-f9f1-4591-8de7-0281badd9a5b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162514 Aug 04 14:43:48.849806 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2980/5951] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:43:49.128680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-953ff921-3542-4f34-84d1-a556ffd42cdb tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:49.141123 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-953ff921-3542-4f34-84d1-a556ffd42cdb tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1314 microversion: 2.1 time: 0.837889 Aug 04 14:43:49.145505 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2972/5952] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:48 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:49.354123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-009e3ded-9268-4a73-b9de-b6a0cb4f683a tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:49.358595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-92ce1245-ab9b-4107-8fa2-e3a0cb2fa11d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:49.359246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-009e3ded-9268-4a73-b9de-b6a0cb4f683a tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:49.360364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-92ce1245-ab9b-4107-8fa2-e3a0cb2fa11d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:49.376058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92ce1245-ab9b-4107-8fa2-e3a0cb2fa11d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:49.376750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92ce1245-ab9b-4107-8fa2-e3a0cb2fa11d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:49.377962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92ce1245-ab9b-4107-8fa2-e3a0cb2fa11d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:49.378680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-92ce1245-ab9b-4107-8fa2-e3a0cb2fa11d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:49.401172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-009e3ded-9268-4a73-b9de-b6a0cb4f683a tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:49.409012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-009e3ded-9268-4a73-b9de-b6a0cb4f683a tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:49.410121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-009e3ded-9268-4a73-b9de-b6a0cb4f683a tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:49.410774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-009e3ded-9268-4a73-b9de-b6a0cb4f683a tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:49.938082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-009e3ded-9268-4a73-b9de-b6a0cb4f683a tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:49.938082 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-009e3ded-9268-4a73-b9de-b6a0cb4f683a tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.453721 Aug 04 14:43:50.072978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-92ce1245-ab9b-4107-8fa2-e3a0cb2fa11d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:50.076075 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2981/5953] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:49 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:50.078237 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-92ce1245-ab9b-4107-8fa2-e3a0cb2fa11d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1215 microversion: 2.1 time: 0.472460 Aug 04 14:43:50.078237 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2973/5954] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:49 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1215 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:50.167345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-47d2a64d-3211-4038-a9cd-f57d10cd77b5 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:50.167968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-47d2a64d-3211-4038-a9cd-f57d10cd77b5 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:50.170957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:50.202906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47d2a64d-3211-4038-a9cd-f57d10cd77b5 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:50.203564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47d2a64d-3211-4038-a9cd-f57d10cd77b5 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:50.204434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47d2a64d-3211-4038-a9cd-f57d10cd77b5 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:50.205065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47d2a64d-3211-4038-a9cd-f57d10cd77b5 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:50.812831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a16b3e87-78fe-4493-8e6f-70d828c25d49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:50.813673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a16b3e87-78fe-4493-8e6f-70d828c25d49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:50.841907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a16b3e87-78fe-4493-8e6f-70d828c25d49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:50.845359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a16b3e87-78fe-4493-8e6f-70d828c25d49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:50.851956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a16b3e87-78fe-4493-8e6f-70d828c25d49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:50.854133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a16b3e87-78fe-4493-8e6f-70d828c25d49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:51.001823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-47d2a64d-3211-4038-a9cd-f57d10cd77b5 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:51.012123 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-47d2a64d-3211-4038-a9cd-f57d10cd77b5 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1314 microversion: 2.1 time: 0.849216 Aug 04 14:43:51.012898 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2982/5955] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:50 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:51.020567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-99f54fdb-6e12-4f64-8d4a-112d5b2bacb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:51.021656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-99f54fdb-6e12-4f64-8d4a-112d5b2bacb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:51.032464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99f54fdb-6e12-4f64-8d4a-112d5b2bacb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:51.033328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99f54fdb-6e12-4f64-8d4a-112d5b2bacb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:51.035498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99f54fdb-6e12-4f64-8d4a-112d5b2bacb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:51.036186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-99f54fdb-6e12-4f64-8d4a-112d5b2bacb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:51.043152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:51.104344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=14 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:51.263600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a16b3e87-78fe-4493-8e6f-70d828c25d49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:51.281083 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a16b3e87-78fe-4493-8e6f-70d828c25d49 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1300 microversion: 2.1 time: 0.469079 Aug 04 14:43:51.282500 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2974/5956] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:50 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1300 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:51.522478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-99f54fdb-6e12-4f64-8d4a-112d5b2bacb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:51.534153 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-99f54fdb-6e12-4f64-8d4a-112d5b2bacb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 0.518371 Aug 04 14:43:51.536093 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2983/5957] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:51 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:51.579011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-28bf1346-0cb2-4827-ae2d-b725140abdfa req-dbbdfe6f-176f-424b-9051-2683fd691070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50dad654-a078-43d3-a48e-bfcebc3dfc8c", "tag": "d8d1fadc-cf68-4c58-9baf-762fb2a85842"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:51.608922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-28bf1346-0cb2-4827-ae2d-b725140abdfa req-dbbdfe6f-176f-424b-9051-2683fd691070 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:51.609584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-28bf1346-0cb2-4827-ae2d-b725140abdfa req-dbbdfe6f-176f-424b-9051-2683fd691070 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:51.636883 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-28bf1346-0cb2-4827-ae2d-b725140abdfa req-dbbdfe6f-176f-424b-9051-2683fd691070 service nova] Creating event network-changed:d8d1fadc-cf68-4c58-9baf-762fb2a85842 for instance 50dad654-a078-43d3-a48e-bfcebc3dfc8c on n-h1-844627-10 Aug 04 14:43:51.642605 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-28bf1346-0cb2-4827-ae2d-b725140abdfa req-dbbdfe6f-176f-424b-9051-2683fd691070 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068134 Aug 04 14:43:51.644111 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2975/5958] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:43:52.056489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21ac3d6d-690c-498a-a6cf-d9fa9d1ace2a tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:52.057564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-21ac3d6d-690c-498a-a6cf-d9fa9d1ace2a tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:52.068859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21ac3d6d-690c-498a-a6cf-d9fa9d1ace2a tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:52.073879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21ac3d6d-690c-498a-a6cf-d9fa9d1ace2a tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:52.075095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21ac3d6d-690c-498a-a6cf-d9fa9d1ace2a tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:52.077322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21ac3d6d-690c-498a-a6cf-d9fa9d1ace2a tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:52.304142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e6d2afe8-c712-47db-8300-8243321fdf15 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:52.306376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e6d2afe8-c712-47db-8300-8243321fdf15 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:52.349479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6d2afe8-c712-47db-8300-8243321fdf15 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:52.351148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6d2afe8-c712-47db-8300-8243321fdf15 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:52.355620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6d2afe8-c712-47db-8300-8243321fdf15 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:52.359075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e6d2afe8-c712-47db-8300-8243321fdf15 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:52.554571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-21ac3d6d-690c-498a-a6cf-d9fa9d1ace2a tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:52.564280 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-21ac3d6d-690c-498a-a6cf-d9fa9d1ace2a tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1314 microversion: 2.1 time: 0.516244 Aug 04 14:43:52.573429 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2984/5959] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:52 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:52.580996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ef8538e4-82c4-4ccb-9497-4250a83f3474 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '.version_select at 0x7f46f2e121f0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:52.627600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e6d2afe8-c712-47db-8300-8243321fdf15 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:52.635460 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ef8538e4-82c4-4ccb-9497-4250a83f3474 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1611679050" status: 202 len: 0 microversion: 2.1 time: 0.059543 Aug 04 14:43:52.636405 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2985/5960] 10.222.0.66 () {58 vars in 1284 bytes} [Thu Aug 4 14:43:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1611679050 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:43:52.644781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a979d4ba-927b-4f99-9ff2-6a1acdb2917b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:52.645886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a979d4ba-927b-4f99-9ff2-6a1acdb2917b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:52.655338 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e6d2afe8-c712-47db-8300-8243321fdf15 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1472 microversion: 2.1 time: 0.342124 Aug 04 14:43:52.658322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a979d4ba-927b-4f99-9ff2-6a1acdb2917b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:52.660002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a979d4ba-927b-4f99-9ff2-6a1acdb2917b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:52.661824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a979d4ba-927b-4f99-9ff2-6a1acdb2917b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:52.662836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a979d4ba-927b-4f99-9ff2-6a1acdb2917b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:52.665306 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2976/5961] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:52 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1472 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:52.695529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c4e0aca-f0b3-46ad-a066-4106c256ebb7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'create', calling method: .version_select at 0x7f47001cf9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1716534236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKl6noCAEjG6FkXdCqSH05HPtAX82FV4+GSCh2eTKW8B4zM4uRQgTKtdAPyd5upV6TB3cE9WFGOnfBzjdXRNZD1Z/0cItNxX5+wLHA4woi2HZ9P09r0m+18zRKA5+iM9mg=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:52.779247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-2c4e0aca-f0b3-46ad-a066-4106c256ebb7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:43:52.797105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-2c4e0aca-f0b3-46ad-a066-4106c256ebb7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for user 95e5002f80224b4a804be717d5bd9d2c and project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:43:52.852792 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c4e0aca-f0b3-46ad-a066-4106c256ebb7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.167424 Aug 04 14:43:52.856141 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2977/5962] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:43:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:43:52.886308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dd4e4035-e173-4dfd-a9a3-b98eb2b3feff tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:52.887829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dd4e4035-e173-4dfd-a9a3-b98eb2b3feff tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:52.901087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd4e4035-e173-4dfd-a9a3-b98eb2b3feff tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:52.902360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd4e4035-e173-4dfd-a9a3-b98eb2b3feff tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:52.903771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd4e4035-e173-4dfd-a9a3-b98eb2b3feff tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:52.904480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd4e4035-e173-4dfd-a9a3-b98eb2b3feff tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:52.940265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a979d4ba-927b-4f99-9ff2-6a1acdb2917b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:52.955213 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a979d4ba-927b-4f99-9ff2-6a1acdb2917b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 0.316677 Aug 04 14:43:52.958260 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2986/5963] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:52 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:53.087160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd4e4035-e173-4dfd-a9a3-b98eb2b3feff tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:53.103827 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dd4e4035-e173-4dfd-a9a3-b98eb2b3feff tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1472 microversion: 2.1 time: 0.244904 Aug 04 14:43:53.117296 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2978/5964] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:52 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1472 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:53.131801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7c88240-1710-42ba-bdfa-c3b96cda5e25 tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:53.133082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7c88240-1710-42ba-bdfa-c3b96cda5e25 tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:53.143633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7c88240-1710-42ba-bdfa-c3b96cda5e25 tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.144464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7c88240-1710-42ba-bdfa-c3b96cda5e25 tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:53.145602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7c88240-1710-42ba-bdfa-c3b96cda5e25 tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.146494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7c88240-1710-42ba-bdfa-c3b96cda5e25 tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:53.324685 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7c88240-1710-42ba-bdfa-c3b96cda5e25 tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1625 microversion: 2.1 time: 0.199010 Aug 04 14:43:53.341367 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2987/5965] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:53 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1625 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:53.355103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a0569e06-1bdd-409d-a0a5-09d875460f3b tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:53.355958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a0569e06-1bdd-409d-a0a5-09d875460f3b tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:53.369087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0569e06-1bdd-409d-a0a5-09d875460f3b tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.369823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0569e06-1bdd-409d-a0a5-09d875460f3b tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:53.370638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0569e06-1bdd-409d-a0a5-09d875460f3b tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.371106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0569e06-1bdd-409d-a0a5-09d875460f3b tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:53.589781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a71331ab-69ea-428a-bd7b-dcd7ffa5ad43 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:53.590705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a71331ab-69ea-428a-bd7b-dcd7ffa5ad43 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:53.610099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a71331ab-69ea-428a-bd7b-dcd7ffa5ad43 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.611186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a71331ab-69ea-428a-bd7b-dcd7ffa5ad43 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:53.634088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a71331ab-69ea-428a-bd7b-dcd7ffa5ad43 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.634555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a71331ab-69ea-428a-bd7b-dcd7ffa5ad43 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:53.643516 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a0569e06-1bdd-409d-a0a5-09d875460f3b tempest-TestSecurityGroupsBasicOps-253986927 tempest-TestSecurityGroupsBasicOps-253986927-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1914 microversion: 2.1 time: 0.292169 Aug 04 14:43:53.644139 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2979/5966] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:53 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1914 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:53.753699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-413f5112-313a-4d35-91e4-0b01a02543f8 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:53.754233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-413f5112-313a-4d35-91e4-0b01a02543f8 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:53.765381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-413f5112-313a-4d35-91e4-0b01a02543f8 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.765381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-413f5112-313a-4d35-91e4-0b01a02543f8 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:53.765886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-413f5112-313a-4d35-91e4-0b01a02543f8 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.768379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-413f5112-313a-4d35-91e4-0b01a02543f8 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:53.808171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-413f5112-313a-4d35-91e4-0b01a02543f8 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:43:53.855232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:53.920915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:43:53.945365 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-413f5112-313a-4d35-91e4-0b01a02543f8 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 204 len: 0 microversion: 2.1 time: 0.196369 Aug 04 14:43:53.950450 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2980/5967] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:43:53 2022] DELETE /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:43:53.957595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-239f0104-0337-4374-8469-78348f7c2e32 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:53.958736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-239f0104-0337-4374-8469-78348f7c2e32 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:53.967642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-239f0104-0337-4374-8469-78348f7c2e32 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.968742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-239f0104-0337-4374-8469-78348f7c2e32 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:53.970401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-239f0104-0337-4374-8469-78348f7c2e32 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:53.971420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-239f0104-0337-4374-8469-78348f7c2e32 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:54.013863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a71331ab-69ea-428a-bd7b-dcd7ffa5ad43 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:54.032278 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a71331ab-69ea-428a-bd7b-dcd7ffa5ad43 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1314 microversion: 2.1 time: 0.448894 Aug 04 14:43:54.046137 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2988/5968] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:53 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:54.054229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe243600-2959-4500-9149-9e0854738443 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:54.055666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe243600-2959-4500-9149-9e0854738443 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:54.065894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe243600-2959-4500-9149-9e0854738443 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:54.066351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe243600-2959-4500-9149-9e0854738443 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:54.067306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe243600-2959-4500-9149-9e0854738443 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:54.067654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe243600-2959-4500-9149-9e0854738443 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:54.156395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-239f0104-0337-4374-8469-78348f7c2e32 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:54.186711 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-239f0104-0337-4374-8469-78348f7c2e32 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1478 microversion: 2.1 time: 0.233631 Aug 04 14:43:54.204112 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2981/5969] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:53 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1478 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:54.461679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe243600-2959-4500-9149-9e0854738443 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:54.480923 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe243600-2959-4500-9149-9e0854738443 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 0.432927 Aug 04 14:43:54.496716 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2989/5970] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:54 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:55.058915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b8cabac9-fb6f-4d1e-bf91-84cac9848076 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:55.067015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b8cabac9-fb6f-4d1e-bf91-84cac9848076 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:55.085385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8cabac9-fb6f-4d1e-bf91-84cac9848076 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:55.086194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8cabac9-fb6f-4d1e-bf91-84cac9848076 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:55.087696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8cabac9-fb6f-4d1e-bf91-84cac9848076 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:55.088452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8cabac9-fb6f-4d1e-bf91-84cac9848076 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:55.222679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-89a49798-934b-40ca-bee8-a4fe93b584a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:55.223736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-89a49798-934b-40ca-bee8-a4fe93b584a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:55.235321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89a49798-934b-40ca-bee8-a4fe93b584a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:55.237587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89a49798-934b-40ca-bee8-a4fe93b584a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:55.239102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89a49798-934b-40ca-bee8-a4fe93b584a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:55.239667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-89a49798-934b-40ca-bee8-a4fe93b584a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:55.414026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-89a49798-934b-40ca-bee8-a4fe93b584a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:55.422358 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-89a49798-934b-40ca-bee8-a4fe93b584a9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1478 microversion: 2.1 time: 0.209663 Aug 04 14:43:55.422954 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2990/5971] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:55 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1478 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:55.471123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8cabac9-fb6f-4d1e-bf91-84cac9848076 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:55.484358 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b8cabac9-fb6f-4d1e-bf91-84cac9848076 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1314 microversion: 2.1 time: 0.430067 Aug 04 14:43:55.485796 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2982/5972] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:55 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:55.517745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-63cd6649-7f67-4c47-bee6-cc10e686d3a5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:55.525165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-63cd6649-7f67-4c47-bee6-cc10e686d3a5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:55.538488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63cd6649-7f67-4c47-bee6-cc10e686d3a5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:55.539006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63cd6649-7f67-4c47-bee6-cc10e686d3a5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:55.542763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63cd6649-7f67-4c47-bee6-cc10e686d3a5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:55.543060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-63cd6649-7f67-4c47-bee6-cc10e686d3a5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:55.985289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-63cd6649-7f67-4c47-bee6-cc10e686d3a5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:56.024463 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-63cd6649-7f67-4c47-bee6-cc10e686d3a5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 0.509668 Aug 04 14:43:56.026867 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2991/5973] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:55 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:56.446731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d506c93-b1a8-4e22-85c0-ff4a47780bb7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:56.447501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6d506c93-b1a8-4e22-85c0-ff4a47780bb7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:56.462653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d506c93-b1a8-4e22-85c0-ff4a47780bb7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:56.463314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d506c93-b1a8-4e22-85c0-ff4a47780bb7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:56.464280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d506c93-b1a8-4e22-85c0-ff4a47780bb7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:56.467838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d506c93-b1a8-4e22-85c0-ff4a47780bb7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:56.527452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4f3c9bd5-d72c-4c55-8894-d094778bfae8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:56.530100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4f3c9bd5-d72c-4c55-8894-d094778bfae8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:56.546520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f3c9bd5-d72c-4c55-8894-d094778bfae8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:56.547507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f3c9bd5-d72c-4c55-8894-d094778bfae8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:56.548611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f3c9bd5-d72c-4c55-8894-d094778bfae8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:56.549339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4f3c9bd5-d72c-4c55-8894-d094778bfae8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:56.854890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d506c93-b1a8-4e22-85c0-ff4a47780bb7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:56.877460 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d506c93-b1a8-4e22-85c0-ff4a47780bb7 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1478 microversion: 2.1 time: 0.434591 Aug 04 14:43:56.878095 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2983/5974] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:56 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1478 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:57.053515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f034a77b-5e97-4fc2-8f15-62f27d7e4ff7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:57.055936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f034a77b-5e97-4fc2-8f15-62f27d7e4ff7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:57.071138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f034a77b-5e97-4fc2-8f15-62f27d7e4ff7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:57.074906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f034a77b-5e97-4fc2-8f15-62f27d7e4ff7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:57.077081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f034a77b-5e97-4fc2-8f15-62f27d7e4ff7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:57.078163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f034a77b-5e97-4fc2-8f15-62f27d7e4ff7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:57.088197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4f3c9bd5-d72c-4c55-8894-d094778bfae8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:57.114709 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4f3c9bd5-d72c-4c55-8894-d094778bfae8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1314 microversion: 2.1 time: 0.591671 Aug 04 14:43:57.119822 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2992/5975] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:56 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:57.435620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f034a77b-5e97-4fc2-8f15-62f27d7e4ff7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:57.452150 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f034a77b-5e97-4fc2-8f15-62f27d7e4ff7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 0.406380 Aug 04 14:43:57.464157 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2984/5976] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:57 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:43:57.809077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e5cb092d-1858-47f0-8224-6ef4591c6369 req-e3f73fed-2707-4fac-97f4-85bdfae3b937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d860a159-d15c-43ff-a9e4-3786e17f556b", "name": "network-vif-deleted", "tag": "67dfe162-f469-47b4-bad1-a770b736ae29"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:57.832381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e5cb092d-1858-47f0-8224-6ef4591c6369 req-e3f73fed-2707-4fac-97f4-85bdfae3b937 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:57.836262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e5cb092d-1858-47f0-8224-6ef4591c6369 req-e3f73fed-2707-4fac-97f4-85bdfae3b937 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:57.861920 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e5cb092d-1858-47f0-8224-6ef4591c6369 req-e3f73fed-2707-4fac-97f4-85bdfae3b937 service nova] Creating event network-vif-deleted:67dfe162-f469-47b4-bad1-a770b736ae29 for instance d860a159-d15c-43ff-a9e4-3786e17f556b on n-h1-844627-10 Aug 04 14:43:57.882929 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e5cb092d-1858-47f0-8224-6ef4591c6369 req-e3f73fed-2707-4fac-97f4-85bdfae3b937 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085318 Aug 04 14:43:57.884927 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2993/5977] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:43:57.899876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19e3cb5d-d2bf-4bcc-a0d8-bdb2d7f44e2b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:57.900808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19e3cb5d-d2bf-4bcc-a0d8-bdb2d7f44e2b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:57.917185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19e3cb5d-d2bf-4bcc-a0d8-bdb2d7f44e2b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:57.918006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19e3cb5d-d2bf-4bcc-a0d8-bdb2d7f44e2b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:57.922056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19e3cb5d-d2bf-4bcc-a0d8-bdb2d7f44e2b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:57.922541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19e3cb5d-d2bf-4bcc-a0d8-bdb2d7f44e2b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:58.078191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-19e3cb5d-d2bf-4bcc-a0d8-bdb2d7f44e2b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:58.091014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19e3cb5d-d2bf-4bcc-a0d8-bdb2d7f44e2b tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 200 len: 1327 microversion: 2.1 time: 0.194882 Aug 04 14:43:58.107160 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2985/5978] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:57 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 1327 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:58.158270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8786fd61-bb6c-4d3b-b79a-26660281061c tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:58.159955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8786fd61-bb6c-4d3b-b79a-26660281061c tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:58.190886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8786fd61-bb6c-4d3b-b79a-26660281061c tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:58.193180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8786fd61-bb6c-4d3b-b79a-26660281061c tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:58.196733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8786fd61-bb6c-4d3b-b79a-26660281061c tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:58.198137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8786fd61-bb6c-4d3b-b79a-26660281061c tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:58.499725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1d66f7bd-4621-4ecd-b15c-682b44a130e1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:58.507551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1d66f7bd-4621-4ecd-b15c-682b44a130e1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:58.526672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d66f7bd-4621-4ecd-b15c-682b44a130e1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:58.528423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d66f7bd-4621-4ecd-b15c-682b44a130e1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:58.530137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d66f7bd-4621-4ecd-b15c-682b44a130e1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:58.530810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1d66f7bd-4621-4ecd-b15c-682b44a130e1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:58.597989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8786fd61-bb6c-4d3b-b79a-26660281061c tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:58.618520 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8786fd61-bb6c-4d3b-b79a-26660281061c tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1314 microversion: 2.1 time: 0.468274 Aug 04 14:43:58.619865 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2994/5979] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:58 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:58.830602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-20250098-c86a-4333-b580-92dcbba8af9d req-bf2b5896-0303-4daa-aab5-86d0beb7dbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50dad654-a078-43d3-a48e-bfcebc3dfc8c", "name": "network-vif-plugged", "status": "completed", "tag": "d8d1fadc-cf68-4c58-9baf-762fb2a85842"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:43:58.868593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1d66f7bd-4621-4ecd-b15c-682b44a130e1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:43:58.886240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-20250098-c86a-4333-b580-92dcbba8af9d req-bf2b5896-0303-4daa-aab5-86d0beb7dbaf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:58.887354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-20250098-c86a-4333-b580-92dcbba8af9d req-bf2b5896-0303-4daa-aab5-86d0beb7dbaf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:58.907018 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1d66f7bd-4621-4ecd-b15c-682b44a130e1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 0.423220 Aug 04 14:43:58.908298 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2986/5980] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:58 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:43:58.949797 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-20250098-c86a-4333-b580-92dcbba8af9d req-bf2b5896-0303-4daa-aab5-86d0beb7dbaf service nova] Creating event network-vif-plugged:d8d1fadc-cf68-4c58-9baf-762fb2a85842 for instance 50dad654-a078-43d3-a48e-bfcebc3dfc8c on n-h1-844627-10 Aug 04 14:43:58.960733 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-20250098-c86a-4333-b580-92dcbba8af9d req-bf2b5896-0303-4daa-aab5-86d0beb7dbaf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140448 Aug 04 14:43:58.962383 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2995/5981] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:43:59.118599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:59.119756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: d860a159-d15c-43ff-a9e4-3786e17f556b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:59.128330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:59.129375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:59.130591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:59.131321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:59.149162 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] HTTP exception thrown: Instance d860a159-d15c-43ff-a9e4-3786e17f556b could not be found. Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Request method failure captured: Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b HTTP/1.1 Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qMBLuKaE78Ogg6bvzRe0KnBTVPPz4oosjujtc6DJEmiwyQXKkBnEsWpOK3mHOEIVeTCHPdYCbyDocU1b7L_fvAD3G_14y31j8IIkJ6ZlIW6i5TiN9gkaVfEy3BHsE4LDCxfuCPo7-gXkdBU5k3D-6rDAnnVTwjD3FoLg5CMzloAYY Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: dda0124b567f4c8a82a27e96983efc21 Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-990440752 Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dda0124b567f4c8a82a27e96983efc21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dda0124b567f4c8a82a27e96983efc21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dda0124b567f4c8a82a27e96983efc21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dda0124b567f4c8a82a27e96983efc21"}]}] Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestSecurityGroupsBasicOps-990440752 Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: dda0124b567f4c8a82a27e96983efc21 Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-990440752 Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestSecurityGroupsBasicOps-990440752-project Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 9208ce179392440099aefee54a0332dc Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestSecurityGroupsBasicOps-990440752-project Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d860a159-d15c-43ff-a9e4-3786e17f556b could not be found. Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd860a159-d15c-43ff-a9e4-3786e17f556b'} Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d860a159-d15c-43ff-a9e4-3786e17f556b could not be found. Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d860a159-d15c-43ff-a9e4-3786e17f556b could not be found. Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:43:59.153352 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:59.158754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:43:59.158754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:43:59.158754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:43:59.158754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:43:59.158754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:43:59.158754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d860a159-d15c-43ff-a9e4-3786e17f556b could not be found. Aug 04 14:43:59.158754 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:43:59.160139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Returning 404 to user: Instance d860a159-d15c-43ff-a9e4-3786e17f556b could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:43:59.161245 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0b0096d3-384e-49a8-9cea-eee1f5894ffe tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b" status: 404 len: 111 microversion: 2.1 time: 0.049050 Aug 04 14:43:59.162891 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2987/5982] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:59 2022] GET /compute/v2.1/servers/d860a159-d15c-43ff-a9e4-3786e17f556b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:43:59.647615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-51a4515a-66c8-4f40-bb93-fc92e95f75f4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:59.648623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-51a4515a-66c8-4f40-bb93-fc92e95f75f4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:59.660255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51a4515a-66c8-4f40-bb93-fc92e95f75f4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:59.663378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51a4515a-66c8-4f40-bb93-fc92e95f75f4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:59.664404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51a4515a-66c8-4f40-bb93-fc92e95f75f4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:59.666704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51a4515a-66c8-4f40-bb93-fc92e95f75f4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:59.951361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0342f76-8e72-4594-877b-de6846f29210 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:43:59.952847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0342f76-8e72-4594-877b-de6846f29210 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:43:59.965741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0342f76-8e72-4594-877b-de6846f29210 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:59.969847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0342f76-8e72-4594-877b-de6846f29210 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:43:59.974049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0342f76-8e72-4594-877b-de6846f29210 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:43:59.974573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0342f76-8e72-4594-877b-de6846f29210 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:00.992342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f0342f76-8e72-4594-877b-de6846f29210 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:01.009434 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0342f76-8e72-4594-877b-de6846f29210 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 1.061507 Aug 04 14:44:01.010814 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2988/5983] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:59 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:01.620192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-51a4515a-66c8-4f40-bb93-fc92e95f75f4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:01.644114 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-51a4515a-66c8-4f40-bb93-fc92e95f75f4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1314 microversion: 2.1 time: 2.001979 Aug 04 14:44:01.658778 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2996/5984] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:43:59 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1314 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:02.035359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b795ecf2-5189-4eff-af44-46fe4b0dc75d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:02.037293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b795ecf2-5189-4eff-af44-46fe4b0dc75d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:02.082368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b795ecf2-5189-4eff-af44-46fe4b0dc75d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:02.083848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b795ecf2-5189-4eff-af44-46fe4b0dc75d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:02.093545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b795ecf2-5189-4eff-af44-46fe4b0dc75d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:02.098837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b795ecf2-5189-4eff-af44-46fe4b0dc75d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:02.680021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b449d49-a591-4d91-be30-fb153be682f9 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:02.681265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b449d49-a591-4d91-be30-fb153be682f9 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:02.704053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b449d49-a591-4d91-be30-fb153be682f9 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:02.704718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b449d49-a591-4d91-be30-fb153be682f9 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:02.715384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b449d49-a591-4d91-be30-fb153be682f9 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:02.716541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b449d49-a591-4d91-be30-fb153be682f9 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:02.806296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:02.989796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b795ecf2-5189-4eff-af44-46fe4b0dc75d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:03.024609 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b795ecf2-5189-4eff-af44-46fe4b0dc75d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 0.996807 Aug 04 14:44:03.029710 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2989/5985] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:02 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:03.191559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b449d49-a591-4d91-be30-fb153be682f9 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:03.218069 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b449d49-a591-4d91-be30-fb153be682f9 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1463 microversion: 2.1 time: 0.549388 Aug 04 14:44:03.220029 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2997/5986] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:02 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1463 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:03.266185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-74f9a358-750c-4b2c-a161-a2c16fa1ce40 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5decbccb-f198-48ed-80c7-0ae5a155679d", "device": "/dev/sdb"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:03.280444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-74f9a358-750c-4b2c-a161-a2c16fa1ce40 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:03.301647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74f9a358-750c-4b2c-a161-a2c16fa1ce40 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:03.302669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74f9a358-750c-4b2c-a161-a2c16fa1ce40 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:03.304412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74f9a358-750c-4b2c-a161-a2c16fa1ce40 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:03.305579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-74f9a358-750c-4b2c-a161-a2c16fa1ce40 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:04.060202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2c90be10-294c-492d-b920-720432b4d59e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:04.065288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2c90be10-294c-492d-b920-720432b4d59e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:04.120081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c90be10-294c-492d-b920-720432b4d59e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:04.178177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c90be10-294c-492d-b920-720432b4d59e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:04.179522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c90be10-294c-492d-b920-720432b4d59e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:04.180132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c90be10-294c-492d-b920-720432b4d59e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:04.225213 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-74f9a358-750c-4b2c-a161-a2c16fa1ce40 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "POST /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.987259 Aug 04 14:44:04.227704 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2990/5987] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 14:44:03 2022] POST /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c/os-volume_attachments => generated 194 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:44:04.485909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a91d021c-9df9-4731-a2c9-96735f38b1ea req-7451b4d7-8018-4f07-819e-6ddaab40c9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa", "name": "network-vif-plugged", "status": "completed", "tag": "f6216600-3c12-44d2-976b-a6abf7901cfc"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:04.531576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a91d021c-9df9-4731-a2c9-96735f38b1ea req-7451b4d7-8018-4f07-819e-6ddaab40c9fe service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:04.532088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a91d021c-9df9-4731-a2c9-96735f38b1ea req-7451b4d7-8018-4f07-819e-6ddaab40c9fe service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:04.584811 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a91d021c-9df9-4731-a2c9-96735f38b1ea req-7451b4d7-8018-4f07-819e-6ddaab40c9fe service nova] Creating event network-vif-plugged:f6216600-3c12-44d2-976b-a6abf7901cfc for instance 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa on n-h2-844627-10 Aug 04 14:44:04.641985 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a91d021c-9df9-4731-a2c9-96735f38b1ea req-7451b4d7-8018-4f07-819e-6ddaab40c9fe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174986 Aug 04 14:44:04.644242 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2991/5988] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:44:05.181240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2c90be10-294c-492d-b920-720432b4d59e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:05.192472 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2c90be10-294c-492d-b920-720432b4d59e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 1.141674 Aug 04 14:44:05.212036 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2998/5989] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:04 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:06.234411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b0a08c9f-5449-4390-bea8-e1adad76d64b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:06.235119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b0a08c9f-5449-4390-bea8-e1adad76d64b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:06.252537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0a08c9f-5449-4390-bea8-e1adad76d64b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:06.253024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0a08c9f-5449-4390-bea8-e1adad76d64b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:06.253827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0a08c9f-5449-4390-bea8-e1adad76d64b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:06.254269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0a08c9f-5449-4390-bea8-e1adad76d64b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:06.893323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b0a08c9f-5449-4390-bea8-e1adad76d64b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:06.905536 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b0a08c9f-5449-4390-bea8-e1adad76d64b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1203 microversion: 2.1 time: 0.674737 Aug 04 14:44:06.907003 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2992/5990] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:06 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1203 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:07.929216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-135ad496-a444-4417-9958-82211306d96c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:07.930720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-135ad496-a444-4417-9958-82211306d96c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:07.941312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-135ad496-a444-4417-9958-82211306d96c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:07.945797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-135ad496-a444-4417-9958-82211306d96c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:07.947228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-135ad496-a444-4417-9958-82211306d96c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:07.956129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-135ad496-a444-4417-9958-82211306d96c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:08.341321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-135ad496-a444-4417-9958-82211306d96c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:08.344723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:08.361976 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-135ad496-a444-4417-9958-82211306d96c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1388 microversion: 2.1 time: 0.435504 Aug 04 14:44:08.365048 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 2999/5991] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:07 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1388 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:08.389907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e9b479d4-19da-48ad-903d-d1ca3cf22a56 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:08.390536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e9b479d4-19da-48ad-903d-d1ca3cf22a56 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:08.410129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9b479d4-19da-48ad-903d-d1ca3cf22a56 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:08.410925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9b479d4-19da-48ad-903d-d1ca3cf22a56 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:08.412419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9b479d4-19da-48ad-903d-d1ca3cf22a56 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:08.413281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9b479d4-19da-48ad-903d-d1ca3cf22a56 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:08.802961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e9b479d4-19da-48ad-903d-d1ca3cf22a56 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:08.826010 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e9b479d4-19da-48ad-903d-d1ca3cf22a56 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1388 microversion: 2.1 time: 0.436012 Aug 04 14:44:08.827538 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2993/5992] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:08 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1388 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:08.862433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-42097d05-21c0-48be-a597-1686431a7a3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:08.865924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-42097d05-21c0-48be-a597-1686431a7a3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:08.885668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42097d05-21c0-48be-a597-1686431a7a3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:08.886220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42097d05-21c0-48be-a597-1686431a7a3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:08.893390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42097d05-21c0-48be-a597-1686431a7a3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:08.893937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42097d05-21c0-48be-a597-1686431a7a3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:09.486786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-42097d05-21c0-48be-a597-1686431a7a3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:09.546153 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-42097d05-21c0-48be-a597-1686431a7a3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1388 microversion: 2.1 time: 0.690968 Aug 04 14:44:09.547716 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3000/5993] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:08 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1388 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:09.571290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9160ba20-4c22-4155-8e7f-05c4d78bd3ab tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:09.572220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9160ba20-4c22-4155-8e7f-05c4d78bd3ab tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:09.590192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9160ba20-4c22-4155-8e7f-05c4d78bd3ab tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:09.598352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9160ba20-4c22-4155-8e7f-05c4d78bd3ab tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:09.599791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9160ba20-4c22-4155-8e7f-05c4d78bd3ab tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:09.600515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9160ba20-4c22-4155-8e7f-05c4d78bd3ab tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:09.699926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9160ba20-4c22-4155-8e7f-05c4d78bd3ab tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:44:09.920895 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9160ba20-4c22-4155-8e7f-05c4d78bd3ab tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 204 len: 0 microversion: 2.1 time: 0.349342 Aug 04 14:44:09.922382 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2994/5994] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:44:09 2022] DELETE /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:44:09.953527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dde4630d-6558-42f7-a7a6-96386b28a946 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:09.966032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dde4630d-6558-42f7-a7a6-96386b28a946 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:09.983164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dde4630d-6558-42f7-a7a6-96386b28a946 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:09.984257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dde4630d-6558-42f7-a7a6-96386b28a946 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:09.985310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dde4630d-6558-42f7-a7a6-96386b28a946 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:09.985695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dde4630d-6558-42f7-a7a6-96386b28a946 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:10.369850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dde4630d-6558-42f7-a7a6-96386b28a946 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:10.385527 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dde4630d-6558-42f7-a7a6-96386b28a946 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1394 microversion: 2.1 time: 0.450575 Aug 04 14:44:10.387699 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3001/5995] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:09 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1394 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:11.427506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aeeae731-067f-4607-b385-efa22a684c1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:11.428483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aeeae731-067f-4607-b385-efa22a684c1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:11.443830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aeeae731-067f-4607-b385-efa22a684c1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:11.451969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aeeae731-067f-4607-b385-efa22a684c1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:11.453338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aeeae731-067f-4607-b385-efa22a684c1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:11.454024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aeeae731-067f-4607-b385-efa22a684c1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:11.529427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:11.676115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1851684407", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "1e5b8c9b-6ae7-46bd-833d-1b70cc16e31c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1716534236", "security_groups": [{"name": "tempest-secgroup-smoke-104452079"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:12.387844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] validate_networks() for [('1e5b8c9b-6ae7-46bd-833d-1b70cc16e31c', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:44:12.720853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aeeae731-067f-4607-b385-efa22a684c1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:12.720853 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aeeae731-067f-4607-b385-efa22a684c1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1394 microversion: 2.1 time: 1.307092 Aug 04 14:44:12.720853 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2995/5996] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:11 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1394 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:13.427286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:44:13.427876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:44:13.428167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:44:13.428593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:44:13.429306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:44:13.449174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:13.451207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:13.453710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:13.455220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:13.510233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:44:13.528853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Getting quotas for user 95e5002f80224b4a804be717d5bd9d2c and project 2f1a5cc686e44650a531a8c1026d71e0. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:44:13.588221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:44:13.594341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:44:13.708703 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ed5de907-a5cf-4653-86e4-8cd6518681c7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.046380 Aug 04 14:44:13.710616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-770586dc-ed97-48c6-88ca-abd07f69856f req-fa00a596-d4cd-4658-a17f-a0320aad89b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa", "name": "network-vif-deleted", "tag": "f6216600-3c12-44d2-976b-a6abf7901cfc"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:13.718166 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3002/5997] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:44:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:44:13.742046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1db6e45-d05b-4026-9fd1-8b32ecee28cd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:13.747166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a1db6e45-d05b-4026-9fd1-8b32ecee28cd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:13.767800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-770586dc-ed97-48c6-88ca-abd07f69856f req-fa00a596-d4cd-4658-a17f-a0320aad89b4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:13.768511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-770586dc-ed97-48c6-88ca-abd07f69856f req-fa00a596-d4cd-4658-a17f-a0320aad89b4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:13.816704 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-770586dc-ed97-48c6-88ca-abd07f69856f req-fa00a596-d4cd-4658-a17f-a0320aad89b4 service nova] Creating event network-vif-deleted:f6216600-3c12-44d2-976b-a6abf7901cfc for instance 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa on n-h2-844627-10 Aug 04 14:44:13.852603 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-770586dc-ed97-48c6-88ca-abd07f69856f req-fa00a596-d4cd-4658-a17f-a0320aad89b4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146111 Aug 04 14:44:13.861204 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2996/5998] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:44:13.876392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f2d32d4f-2c5b-4208-874a-c73de2094977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:13.877245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f2d32d4f-2c5b-4208-874a-c73de2094977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:13.897966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2d32d4f-2c5b-4208-874a-c73de2094977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:13.898439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2d32d4f-2c5b-4208-874a-c73de2094977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:13.899275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2d32d4f-2c5b-4208-874a-c73de2094977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:13.899726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2d32d4f-2c5b-4208-874a-c73de2094977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:13.948281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a1db6e45-d05b-4026-9fd1-8b32ecee28cd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:13.960258 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1db6e45-d05b-4026-9fd1-8b32ecee28cd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1267 microversion: 2.1 time: 0.230677 Aug 04 14:44:13.963262 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3003/5999] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:13 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:14.058010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f2d32d4f-2c5b-4208-874a-c73de2094977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:14.070984 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f2d32d4f-2c5b-4208-874a-c73de2094977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1188 microversion: 2.1 time: 0.206874 Aug 04 14:44:14.072691 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2997/6000] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:13 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1188 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:14.989743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75054d25-4cba-439e-a46e-605db6374265 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:14.991050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75054d25-4cba-439e-a46e-605db6374265 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:15.012832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75054d25-4cba-439e-a46e-605db6374265 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:15.013701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75054d25-4cba-439e-a46e-605db6374265 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:15.015269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75054d25-4cba-439e-a46e-605db6374265 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:15.015986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75054d25-4cba-439e-a46e-605db6374265 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:15.107780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8b3a833a-3c78-4008-961d-018972af48fb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:15.108546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8b3a833a-3c78-4008-961d-018972af48fb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:15.150423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b3a833a-3c78-4008-961d-018972af48fb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:15.151546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b3a833a-3c78-4008-961d-018972af48fb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:15.155120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b3a833a-3c78-4008-961d-018972af48fb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:15.158526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8b3a833a-3c78-4008-961d-018972af48fb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:15.175591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-75054d25-4cba-439e-a46e-605db6374265 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:15.189876 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75054d25-4cba-439e-a46e-605db6374265 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1271 microversion: 2.1 time: 0.202361 Aug 04 14:44:15.195883 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3004/6001] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:14 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:15.372200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8b3a833a-3c78-4008-961d-018972af48fb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:15.398920 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8b3a833a-3c78-4008-961d-018972af48fb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1188 microversion: 2.1 time: 0.296604 Aug 04 14:44:15.421024 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2998/6002] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:15 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:15.958981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8ce2cb00-68ba-4b2d-b742-a04b47955837 req-809f8a89-830c-42a8-9a90-fb2f3b5aa05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d63ced-7cc2-4a2a-bd61-a15c3976f331", "tag": "8f0bcd44-ee02-4606-ad7d-63123beafcd7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:15.960587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fadb97fe-3664-471b-ab38-a732bc479bb3 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:15.961368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fadb97fe-3664-471b-ab38-a732bc479bb3 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:15.976512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fadb97fe-3664-471b-ab38-a732bc479bb3 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:15.980325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fadb97fe-3664-471b-ab38-a732bc479bb3 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:15.983816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fadb97fe-3664-471b-ab38-a732bc479bb3 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:15.984044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8ce2cb00-68ba-4b2d-b742-a04b47955837 req-809f8a89-830c-42a8-9a90-fb2f3b5aa05b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:15.984318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8ce2cb00-68ba-4b2d-b742-a04b47955837 req-809f8a89-830c-42a8-9a90-fb2f3b5aa05b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:15.986405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fadb97fe-3664-471b-ab38-a732bc479bb3 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:16.006528 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8ce2cb00-68ba-4b2d-b742-a04b47955837 req-809f8a89-830c-42a8-9a90-fb2f3b5aa05b service nova] Creating event network-changed:8f0bcd44-ee02-4606-ad7d-63123beafcd7 for instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 on n-h2-844627-10 Aug 04 14:44:16.036696 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8ce2cb00-68ba-4b2d-b742-a04b47955837 req-809f8a89-830c-42a8-9a90-fb2f3b5aa05b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077520 Aug 04 14:44:16.055881 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 2999/6003] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:44:16.100049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fadb97fe-3664-471b-ab38-a732bc479bb3 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:44:16.237068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03285c79-81fb-4800-9dcf-61b3140178b8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:16.253146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-03285c79-81fb-4800-9dcf-61b3140178b8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:16.293951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03285c79-81fb-4800-9dcf-61b3140178b8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:16.306694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03285c79-81fb-4800-9dcf-61b3140178b8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:16.308027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03285c79-81fb-4800-9dcf-61b3140178b8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:16.308620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03285c79-81fb-4800-9dcf-61b3140178b8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:16.349066 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fadb97fe-3664-471b-ab38-a732bc479bb3 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "DELETE /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 204 len: 0 microversion: 2.1 time: 0.396876 Aug 04 14:44:16.360395 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3005/6004] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:44:15 2022] DELETE /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:44:16.371170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-95e111de-5ee6-43c5-926d-d921dcca88e6 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:16.375553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-95e111de-5ee6-43c5-926d-d921dcca88e6 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:16.390332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95e111de-5ee6-43c5-926d-d921dcca88e6 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:16.396218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95e111de-5ee6-43c5-926d-d921dcca88e6 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:16.398454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95e111de-5ee6-43c5-926d-d921dcca88e6 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:16.402392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-95e111de-5ee6-43c5-926d-d921dcca88e6 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:16.725647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-03285c79-81fb-4800-9dcf-61b3140178b8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:16.758240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-03285c79-81fb-4800-9dcf-61b3140178b8 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1337 microversion: 2.1 time: 0.536434 Aug 04 14:44:16.758240 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3000/6005] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:16 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1337 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:16.765872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6bd494c0-025f-4806-b038-5fc8f6ee5779 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:16.766618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6bd494c0-025f-4806-b038-5fc8f6ee5779 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:16.775910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-95e111de-5ee6-43c5-926d-d921dcca88e6 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:16.787823 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-95e111de-5ee6-43c5-926d-d921dcca88e6 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1767 microversion: 2.1 time: 0.421200 Aug 04 14:44:16.799116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bd494c0-025f-4806-b038-5fc8f6ee5779 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:16.801011 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3006/6006] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:16 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1767 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:16.803888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bd494c0-025f-4806-b038-5fc8f6ee5779 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:16.805632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bd494c0-025f-4806-b038-5fc8f6ee5779 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:16.810890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bd494c0-025f-4806-b038-5fc8f6ee5779 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:16.968267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6bd494c0-025f-4806-b038-5fc8f6ee5779 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:16.981217 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6bd494c0-025f-4806-b038-5fc8f6ee5779 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1188 microversion: 2.1 time: 0.233025 Aug 04 14:44:16.986765 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3001/6007] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:16 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1188 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:17.770876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ffecb262-72ff-443d-a684-04f0ee8e4608 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:17.772711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ffecb262-72ff-443d-a684-04f0ee8e4608 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:17.791868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffecb262-72ff-443d-a684-04f0ee8e4608 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:17.792350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffecb262-72ff-443d-a684-04f0ee8e4608 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:17.793574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffecb262-72ff-443d-a684-04f0ee8e4608 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:17.796175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ffecb262-72ff-443d-a684-04f0ee8e4608 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:17.821535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d9adfc9b-5fef-4381-a324-3ce38d7ef1ad tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:17.822270 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d9adfc9b-5fef-4381-a324-3ce38d7ef1ad tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:17.841264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9adfc9b-5fef-4381-a324-3ce38d7ef1ad tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:17.841913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9adfc9b-5fef-4381-a324-3ce38d7ef1ad tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:17.842764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9adfc9b-5fef-4381-a324-3ce38d7ef1ad tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:17.849908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d9adfc9b-5fef-4381-a324-3ce38d7ef1ad tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:18.095229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ffecb262-72ff-443d-a684-04f0ee8e4608 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:18.109120 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ffecb262-72ff-443d-a684-04f0ee8e4608 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1325 microversion: 2.1 time: 0.344182 Aug 04 14:44:18.136961 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3007/6008] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:17 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:18.137980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c778908e-81b6-436e-be86-e999ec842580 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:18.142422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c778908e-81b6-436e-be86-e999ec842580 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:18.162042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c778908e-81b6-436e-be86-e999ec842580 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:18.165815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c778908e-81b6-436e-be86-e999ec842580 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:18.183636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c778908e-81b6-436e-be86-e999ec842580 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:18.186222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c778908e-81b6-436e-be86-e999ec842580 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:18.448548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c778908e-81b6-436e-be86-e999ec842580 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:18.490102 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c778908e-81b6-436e-be86-e999ec842580 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1188 microversion: 2.1 time: 0.360165 Aug 04 14:44:18.504670 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3008/6009] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:18 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1188 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:19.005410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d9adfc9b-5fef-4381-a324-3ce38d7ef1ad tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9208ce179392440099aefee54a0332dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda0124b567f4c8a82a27e96983efc21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:19.018231 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d9adfc9b-5fef-4381-a324-3ce38d7ef1ad tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 200 len: 1767 microversion: 2.1 time: 1.199613 Aug 04 14:44:19.033169 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3002/6010] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:17 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 1767 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:19.150638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-14e42dc8-1eab-45d3-8e4b-4f02ad00626a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:19.151266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-14e42dc8-1eab-45d3-8e4b-4f02ad00626a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:19.173236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14e42dc8-1eab-45d3-8e4b-4f02ad00626a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:19.173744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14e42dc8-1eab-45d3-8e4b-4f02ad00626a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:19.174714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14e42dc8-1eab-45d3-8e4b-4f02ad00626a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:19.175172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14e42dc8-1eab-45d3-8e4b-4f02ad00626a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:19.385782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6aeabe6a-56cf-4281-9bf7-4fea548528ac req-f67f3d8f-ae9c-489e-be73-60936e07ae98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d63ced-7cc2-4a2a-bd61-a15c3976f331", "name": "network-vif-deleted", "tag": "8f0bcd44-ee02-4606-ad7d-63123beafcd7"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:19.406035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6aeabe6a-56cf-4281-9bf7-4fea548528ac req-f67f3d8f-ae9c-489e-be73-60936e07ae98 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:19.410042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6aeabe6a-56cf-4281-9bf7-4fea548528ac req-f67f3d8f-ae9c-489e-be73-60936e07ae98 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:19.446719 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6aeabe6a-56cf-4281-9bf7-4fea548528ac req-f67f3d8f-ae9c-489e-be73-60936e07ae98 service nova] Creating event network-vif-deleted:8f0bcd44-ee02-4606-ad7d-63123beafcd7 for instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 on n-h2-844627-10 Aug 04 14:44:19.461423 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6aeabe6a-56cf-4281-9bf7-4fea548528ac req-f67f3d8f-ae9c-489e-be73-60936e07ae98 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079479 Aug 04 14:44:19.467050 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3003/6011] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:44:19.514558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-428985c6-fcb5-4c73-8d07-481d7a7a1c29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:19.515636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-428985c6-fcb5-4c73-8d07-481d7a7a1c29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:19.529038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-428985c6-fcb5-4c73-8d07-481d7a7a1c29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:19.532446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-428985c6-fcb5-4c73-8d07-481d7a7a1c29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:19.536529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-428985c6-fcb5-4c73-8d07-481d7a7a1c29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:19.537355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-428985c6-fcb5-4c73-8d07-481d7a7a1c29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:19.751536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-14e42dc8-1eab-45d3-8e4b-4f02ad00626a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:19.766002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-428985c6-fcb5-4c73-8d07-481d7a7a1c29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:19.774043 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-14e42dc8-1eab-45d3-8e4b-4f02ad00626a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1392 microversion: 2.1 time: 0.626831 Aug 04 14:44:19.780831 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3009/6012] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:19 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1392 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:19.784288 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-428985c6-fcb5-4c73-8d07-481d7a7a1c29 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1188 microversion: 2.1 time: 0.274735 Aug 04 14:44:19.801967 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3004/6013] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:19 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:20.046599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:20.047387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] [instance: 35d63ced-7cc2-4a2a-bd61-a15c3976f331] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:20.074704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:20.078225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:20.080925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:20.082472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:20.117455 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] HTTP exception thrown: Instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 could not be found. Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Request method failure captured: Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 HTTP/1.1 Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qMBLuKaE78Ogg6bvzRe0KnBTVPPz4oosjujtc6DJEmiwyQXKkBnEsWpOK3mHOEIVeTCHPdYCbyDocU1b7L_fvAD3G_14y31j8IIkJ6ZlIW6i5TiN9gkaVfEy3BHsE4LDCxfuCPo7-gXkdBU5k3D-6rDAnnVTwjD3FoLg5CMzloAYY Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: dda0124b567f4c8a82a27e96983efc21 Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-990440752 Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dda0124b567f4c8a82a27e96983efc21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_dda0124b567f4c8a82a27e96983efc21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/dda0124b567f4c8a82a27e96983efc21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/dda0124b567f4c8a82a27e96983efc21"}]}] Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestSecurityGroupsBasicOps-990440752 Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: dda0124b567f4c8a82a27e96983efc21 Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-990440752 Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestSecurityGroupsBasicOps-990440752-project Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 9208ce179392440099aefee54a0332dc Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestSecurityGroupsBasicOps-990440752-project Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 could not be found. Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '35d63ced-7cc2-4a2a-bd61-a15c3976f331'} Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 could not be found. Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 could not be found. Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:44:20.122063 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:44:20.135002 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:44:20.135002 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:44:20.135002 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:44:20.135002 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:44:20.135002 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:44:20.135002 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 could not be found. Aug 04 14:44:20.135002 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:44:20.137909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Returning 404 to user: Instance 35d63ced-7cc2-4a2a-bd61-a15c3976f331 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:44:20.141288 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1f9145e9-d10b-47ed-afbb-e93c0ff5d653 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331" status: 404 len: 111 microversion: 2.1 time: 0.103317 Aug 04 14:44:20.149636 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3010/6014] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:20 2022] GET /compute/v2.1/servers/35d63ced-7cc2-4a2a-bd61-a15c3976f331 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:44:20.741642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8f10cb32-3b1e-44af-bb4f-5f1b1c985f68 req-9a213614-8c93-4aed-aa14-6db5dae29fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70847cad-0a82-488c-8584-38c9519a3c88", "tag": "9a0df737-065d-424c-8c29-ca3561bb278f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:20.769756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8f10cb32-3b1e-44af-bb4f-5f1b1c985f68 req-9a213614-8c93-4aed-aa14-6db5dae29fe6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:20.773136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8f10cb32-3b1e-44af-bb4f-5f1b1c985f68 req-9a213614-8c93-4aed-aa14-6db5dae29fe6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:20.813913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1e1fa41d-47cd-4f72-b844-c11dcf629857 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:20.815121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1e1fa41d-47cd-4f72-b844-c11dcf629857 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:20.834837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:20.841413 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8f10cb32-3b1e-44af-bb4f-5f1b1c985f68 req-9a213614-8c93-4aed-aa14-6db5dae29fe6 service nova] Creating event network-changed:9a0df737-065d-424c-8c29-ca3561bb278f for instance 70847cad-0a82-488c-8584-38c9519a3c88 on n-h1-844627-10 Aug 04 14:44:20.849656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e1fa41d-47cd-4f72-b844-c11dcf629857 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:20.850484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e1fa41d-47cd-4f72-b844-c11dcf629857 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:20.851917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e1fa41d-47cd-4f72-b844-c11dcf629857 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:20.864815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e1fa41d-47cd-4f72-b844-c11dcf629857 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:20.871092 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8f10cb32-3b1e-44af-bb4f-5f1b1c985f68 req-9a213614-8c93-4aed-aa14-6db5dae29fe6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130068 Aug 04 14:44:20.872065 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3005/6015] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:44:20.900079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4852859-0f8b-44ba-92f7-ff16f0dc82b1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:20.903776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f4852859-0f8b-44ba-92f7-ff16f0dc82b1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:20.928239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4852859-0f8b-44ba-92f7-ff16f0dc82b1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:20.928708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4852859-0f8b-44ba-92f7-ff16f0dc82b1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:20.929558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4852859-0f8b-44ba-92f7-ff16f0dc82b1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:20.930010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4852859-0f8b-44ba-92f7-ff16f0dc82b1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:21.219586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f4852859-0f8b-44ba-92f7-ff16f0dc82b1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:21.235935 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4852859-0f8b-44ba-92f7-ff16f0dc82b1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1188 microversion: 2.1 time: 0.359156 Aug 04 14:44:21.241434 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3006/6016] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:20 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1188 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:21.423301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1e1fa41d-47cd-4f72-b844-c11dcf629857 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:21.458737 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1e1fa41d-47cd-4f72-b844-c11dcf629857 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1392 microversion: 2.1 time: 0.657835 Aug 04 14:44:21.460243 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3011/6017] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:20 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1392 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:22.264694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b8f34983-b344-4d26-a471-6ad7c0ef0aa3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:22.265727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b8f34983-b344-4d26-a471-6ad7c0ef0aa3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:22.277122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8f34983-b344-4d26-a471-6ad7c0ef0aa3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:22.277762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8f34983-b344-4d26-a471-6ad7c0ef0aa3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:22.278756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8f34983-b344-4d26-a471-6ad7c0ef0aa3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:22.289732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b8f34983-b344-4d26-a471-6ad7c0ef0aa3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:22.488728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0c35c412-1d82-45d0-8a93-fc92f6f030bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:22.489945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0c35c412-1d82-45d0-8a93-fc92f6f030bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:22.504036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c35c412-1d82-45d0-8a93-fc92f6f030bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:22.504988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c35c412-1d82-45d0-8a93-fc92f6f030bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:22.517333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c35c412-1d82-45d0-8a93-fc92f6f030bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:22.518708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0c35c412-1d82-45d0-8a93-fc92f6f030bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:22.956181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b8f34983-b344-4d26-a471-6ad7c0ef0aa3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:22.973540 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b8f34983-b344-4d26-a471-6ad7c0ef0aa3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1188 microversion: 2.1 time: 0.713409 Aug 04 14:44:22.975723 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3007/6018] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:22 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1188 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:23.297249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0c35c412-1d82-45d0-8a93-fc92f6f030bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:23.318128 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0c35c412-1d82-45d0-8a93-fc92f6f030bc tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1392 microversion: 2.1 time: 0.837257 Aug 04 14:44:23.320067 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3012/6019] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:22 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1392 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:24.036706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a5a01953-6fc5-4b8d-9aed-e9496873aa87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:24.037929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a5a01953-6fc5-4b8d-9aed-e9496873aa87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:24.050320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:24.069865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5a01953-6fc5-4b8d-9aed-e9496873aa87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:24.071044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5a01953-6fc5-4b8d-9aed-e9496873aa87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:24.072743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5a01953-6fc5-4b8d-9aed-e9496873aa87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:24.073508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5a01953-6fc5-4b8d-9aed-e9496873aa87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:24.292835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a5a01953-6fc5-4b8d-9aed-e9496873aa87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:24.369003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81a2308c-b284-45d0-9a4c-3b9729f5669b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:24.375612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81a2308c-b284-45d0-9a4c-3b9729f5669b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:24.379050 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a5a01953-6fc5-4b8d-9aed-e9496873aa87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 200 len: 1188 microversion: 2.1 time: 0.334115 Aug 04 14:44:24.383551 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3008/6020] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:24 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 1188 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:24.404406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:24.412502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:24.424711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81a2308c-b284-45d0-9a4c-3b9729f5669b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:24.426228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81a2308c-b284-45d0-9a4c-3b9729f5669b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:24.430547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81a2308c-b284-45d0-9a4c-3b9729f5669b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:24.431742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81a2308c-b284-45d0-9a4c-3b9729f5669b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:25.201603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-81a2308c-b284-45d0-9a4c-3b9729f5669b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:25.216338 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81a2308c-b284-45d0-9a4c-3b9729f5669b tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1392 microversion: 2.1 time: 0.861337 Aug 04 14:44:25.217246 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3013/6021] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:24 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1392 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:25.407752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:25.410636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:25.471692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:25.476116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:25.479065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:25.480797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:25.537951 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa could not be found. Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa HTTP/1.1 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa could not be found. Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa'} Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa could not be found. Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa could not be found. Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:44:25.548001 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:44:25.556360 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:44:25.556360 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:44:25.556360 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:44:25.556360 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:44:25.556360 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:44:25.556360 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa could not be found. Aug 04 14:44:25.556360 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:44:25.568892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance 21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:44:25.570783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f783bc9-2091-4850-bf97-8782f88d3ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa" status: 404 len: 111 microversion: 2.1 time: 0.171580 Aug 04 14:44:25.572025 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3009/6022] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:25 2022] GET /compute/v2.1/servers/21cfb5fd-0c57-4a78-87de-8be6c5dfa8fa => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:44:26.271979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6356143d-2a95-403a-8996-8ed0213cd00a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:26.271979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6356143d-2a95-403a-8996-8ed0213cd00a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:26.289049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6356143d-2a95-403a-8996-8ed0213cd00a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:26.289426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6356143d-2a95-403a-8996-8ed0213cd00a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:26.290243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6356143d-2a95-403a-8996-8ed0213cd00a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:26.290695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6356143d-2a95-403a-8996-8ed0213cd00a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:27.317176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6356143d-2a95-403a-8996-8ed0213cd00a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:27.337996 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6356143d-2a95-403a-8996-8ed0213cd00a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1392 microversion: 2.1 time: 1.085637 Aug 04 14:44:27.339183 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3014/6023] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:26 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1392 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:28.366968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb32976e-1b03-4c82-8edf-7c095d4e799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:28.372071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb32976e-1b03-4c82-8edf-7c095d4e799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:28.396480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb32976e-1b03-4c82-8edf-7c095d4e799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:28.397354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb32976e-1b03-4c82-8edf-7c095d4e799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:28.398823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb32976e-1b03-4c82-8edf-7c095d4e799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:28.409951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb32976e-1b03-4c82-8edf-7c095d4e799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:28.955676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-968ab38f-2451-4ebc-a105-201ecf57160b req-9c4a4960-a21e-4bf4-a4c3-08af00d1e1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70847cad-0a82-488c-8584-38c9519a3c88", "name": "network-vif-plugged", "status": "completed", "tag": "9a0df737-065d-424c-8c29-ca3561bb278f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:29.009804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-968ab38f-2451-4ebc-a105-201ecf57160b req-9c4a4960-a21e-4bf4-a4c3-08af00d1e1e3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:29.015784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-968ab38f-2451-4ebc-a105-201ecf57160b req-9c4a4960-a21e-4bf4-a4c3-08af00d1e1e3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:29.066164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb32976e-1b03-4c82-8edf-7c095d4e799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:29.103609 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb32976e-1b03-4c82-8edf-7c095d4e799f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1392 microversion: 2.1 time: 0.746050 Aug 04 14:44:29.110718 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3010/6024] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:28 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1392 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:29.138259 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-968ab38f-2451-4ebc-a105-201ecf57160b req-9c4a4960-a21e-4bf4-a4c3-08af00d1e1e3 service nova] Creating event network-vif-plugged:9a0df737-065d-424c-8c29-ca3561bb278f for instance 70847cad-0a82-488c-8584-38c9519a3c88 on n-h1-844627-10 Aug 04 14:44:29.147760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d15f0ea0-37f9-4c70-87a1-aa0c138d8aa9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] Calling method '.version_select at 0x7f4700264e50>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:29.192298 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-968ab38f-2451-4ebc-a105-201ecf57160b req-9c4a4960-a21e-4bf4-a4c3-08af00d1e1e3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240146 Aug 04 14:44:29.195510 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3015/6025] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:44:29.206439 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d15f0ea0-37f9-4c70-87a1-aa0c138d8aa9 tempest-TestSecurityGroupsBasicOps-990440752 tempest-TestSecurityGroupsBasicOps-990440752-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1361925526" status: 202 len: 0 microversion: 2.1 time: 0.088747 Aug 04 14:44:29.231237 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3011/6026] 10.222.0.66 () {58 vars in 1278 bytes} [Thu Aug 4 14:44:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1361925526 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:44:30.179253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86ba3e7e-6f37-4be2-9521-9d951d2fc897 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:30.180009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-86ba3e7e-6f37-4be2-9521-9d951d2fc897 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:30.194645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86ba3e7e-6f37-4be2-9521-9d951d2fc897 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:30.197409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86ba3e7e-6f37-4be2-9521-9d951d2fc897 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:30.198673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86ba3e7e-6f37-4be2-9521-9d951d2fc897 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:30.199337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86ba3e7e-6f37-4be2-9521-9d951d2fc897 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:30.661920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-86ba3e7e-6f37-4be2-9521-9d951d2fc897 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:30.673881 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86ba3e7e-6f37-4be2-9521-9d951d2fc897 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1392 microversion: 2.1 time: 0.523083 Aug 04 14:44:30.674484 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3016/6027] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:30 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1392 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:31.701741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7eea8d45-65f2-4e10-bb95-3ce028c2c15e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:31.712477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7eea8d45-65f2-4e10-bb95-3ce028c2c15e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:31.742725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7eea8d45-65f2-4e10-bb95-3ce028c2c15e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:31.747151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7eea8d45-65f2-4e10-bb95-3ce028c2c15e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:31.751044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7eea8d45-65f2-4e10-bb95-3ce028c2c15e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:31.753460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7eea8d45-65f2-4e10-bb95-3ce028c2c15e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:32.195945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7eea8d45-65f2-4e10-bb95-3ce028c2c15e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:32.217901 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7eea8d45-65f2-4e10-bb95-3ce028c2c15e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1563 microversion: 2.1 time: 0.525053 Aug 04 14:44:32.221175 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3012/6028] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:31 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1563 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:32.250729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-66317a63-ecde-4929-814b-e85d2bb757bd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:32.254628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-66317a63-ecde-4929-814b-e85d2bb757bd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:32.293818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66317a63-ecde-4929-814b-e85d2bb757bd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:32.295146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66317a63-ecde-4929-814b-e85d2bb757bd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:32.296646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66317a63-ecde-4929-814b-e85d2bb757bd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:32.297494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-66317a63-ecde-4929-814b-e85d2bb757bd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:32.878738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-66317a63-ecde-4929-814b-e85d2bb757bd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:32.883354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:32.929975 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-66317a63-ecde-4929-814b-e85d2bb757bd tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1563 microversion: 2.1 time: 0.661599 Aug 04 14:44:32.934571 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3017/6029] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:32 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1563 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:38.825036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0ba5c42d-747c-4330-a3d0-1e99ff2f1fa6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:38.828860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-46611a43-d21c-4a24-9bda-8747cf894fc2 req-a4170c8d-dfaa-4734-aabb-d3c706d2bf4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70847cad-0a82-488c-8584-38c9519a3c88", "tag": "9a0df737-065d-424c-8c29-ca3561bb278f"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:38.831078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0ba5c42d-747c-4330-a3d0-1e99ff2f1fa6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:38.851772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0ba5c42d-747c-4330-a3d0-1e99ff2f1fa6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:38.858198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0ba5c42d-747c-4330-a3d0-1e99ff2f1fa6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:38.859943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0ba5c42d-747c-4330-a3d0-1e99ff2f1fa6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:38.867870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0ba5c42d-747c-4330-a3d0-1e99ff2f1fa6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:38.872138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-46611a43-d21c-4a24-9bda-8747cf894fc2 req-a4170c8d-dfaa-4734-aabb-d3c706d2bf4f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:38.873566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-46611a43-d21c-4a24-9bda-8747cf894fc2 req-a4170c8d-dfaa-4734-aabb-d3c706d2bf4f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:38.913116 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-46611a43-d21c-4a24-9bda-8747cf894fc2 req-a4170c8d-dfaa-4734-aabb-d3c706d2bf4f service nova] Creating event network-changed:9a0df737-065d-424c-8c29-ca3561bb278f for instance 70847cad-0a82-488c-8584-38c9519a3c88 on n-h1-844627-10 Aug 04 14:44:38.927683 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-46611a43-d21c-4a24-9bda-8747cf894fc2 req-a4170c8d-dfaa-4734-aabb-d3c706d2bf4f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119316 Aug 04 14:44:38.931555 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3013/6030] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:44:38.943604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f114e28c-b65f-4e84-bf42-fde9b4d79ac4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Action: 'create', calling method: .version_select at 0x7f4700316c10>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-110859714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoLBTetaNyEbKuVMcpPEi60we44/Zm7ZeUfgCcyaom9O+/ZNroETIRSrG7CjZRWc8rOz0sIdDPbCDAIqiQubsi0oStUO739GtlE7i7li8nuk2319jKeHi/G3PvseY6mgg=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:39.023500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-f114e28c-b65f-4e84-bf42-fde9b4d79ac4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Getting quotas for project 4793cd274ed9493b862d097e3659465c. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:44:39.050494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-f114e28c-b65f-4e84-bf42-fde9b4d79ac4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Getting quotas for user 3118db37e9dd47788713b7db31d6dfdf and project 4793cd274ed9493b862d097e3659465c. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:44:39.182931 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f114e28c-b65f-4e84-bf42-fde9b4d79ac4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.249724 Aug 04 14:44:39.184011 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3014/6031] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:44:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:44:39.211627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0ba5c42d-747c-4330-a3d0-1e99ff2f1fa6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:39.220096 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0ba5c42d-747c-4330-a3d0-1e99ff2f1fa6 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1563 microversion: 2.1 time: 0.408588 Aug 04 14:44:39.236631 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3018/6032] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:38 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1563 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:43.320560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1789287770", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6cd41f1e-692b-4dac-ae43-f5630ea5ea2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-110859714", "security_groups": [{"name": "tempest-secgroup-smoke-1314012921"}], "networks": [{"uuid": "4a034990-a0f0-45c7-a006-1c9c19b02bcd"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:43.680328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] validate_networks() for [('4a034990-a0f0-45c7-a006-1c9c19b02bcd', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:44:45.099834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:44:45.101009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:44:45.101751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:44:45.102404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:44:45.103661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:44:45.130245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:45.130758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:45.132297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:45.134183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:45.166881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=84 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:45.195766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Getting quotas for project 4793cd274ed9493b862d097e3659465c. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:44:45.212250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Getting quotas for user 3118db37e9dd47788713b7db31d6dfdf and project 4793cd274ed9493b862d097e3659465c. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:44:45.445027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:44:45.447792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6cd41f1e-692b-4dac-ae43-f5630ea5ea2a',volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:44:45.802152 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c57f0de5-bb52-4a7a-a07c-d1adfe0bf26f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.487410 Aug 04 14:44:45.809666 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3015/6033] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:44:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:44:45.828688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a12c24b-5f26-4f03-a397-6a3cdba8e2f9 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:45.829500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3a12c24b-5f26-4f03-a397-6a3cdba8e2f9 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:46.063788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3a12c24b-5f26-4f03-a397-6a3cdba8e2f9 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:46.079672 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a12c24b-5f26-4f03-a397-6a3cdba8e2f9 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1098 microversion: 2.1 time: 0.250333 Aug 04 14:44:46.080111 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3019/6034] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:45 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1098 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:47.127988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a3968b2-b5aa-4806-b530-f8258556213a tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:47.132723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3a3968b2-b5aa-4806-b530-f8258556213a tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:47.175332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a3968b2-b5aa-4806-b530-f8258556213a tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:47.179447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a3968b2-b5aa-4806-b530-f8258556213a tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:47.186073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a3968b2-b5aa-4806-b530-f8258556213a tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:47.189382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a3968b2-b5aa-4806-b530-f8258556213a tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:47.534705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3a3968b2-b5aa-4806-b530-f8258556213a tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:47.573062 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a3968b2-b5aa-4806-b530-f8258556213a tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1148 microversion: 2.1 time: 0.461765 Aug 04 14:44:47.575067 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3016/6035] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:47 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1148 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:48.609040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c9e5949d-993c-494c-8e03-fdf5d0d82f08 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:48.609787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c9e5949d-993c-494c-8e03-fdf5d0d82f08 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:48.647834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9e5949d-993c-494c-8e03-fdf5d0d82f08 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:48.650007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9e5949d-993c-494c-8e03-fdf5d0d82f08 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:48.652457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9e5949d-993c-494c-8e03-fdf5d0d82f08 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:48.657438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c9e5949d-993c-494c-8e03-fdf5d0d82f08 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:48.926990 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c9e5949d-993c-494c-8e03-fdf5d0d82f08 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:48.940286 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c9e5949d-993c-494c-8e03-fdf5d0d82f08 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1214 microversion: 2.1 time: 0.337778 Aug 04 14:44:48.953374 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3020/6036] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:48 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1214 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:49.967584 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a426946-3882-4753-b7aa-765f1cfdb8d0 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:49.969095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a426946-3882-4753-b7aa-765f1cfdb8d0 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:49.997103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a426946-3882-4753-b7aa-765f1cfdb8d0 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:49.998606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a426946-3882-4753-b7aa-765f1cfdb8d0 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:50.002203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a426946-3882-4753-b7aa-765f1cfdb8d0 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:50.003389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a426946-3882-4753-b7aa-765f1cfdb8d0 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:50.272503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a426946-3882-4753-b7aa-765f1cfdb8d0 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:50.289197 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a426946-3882-4753-b7aa-765f1cfdb8d0 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1214 microversion: 2.1 time: 0.323074 Aug 04 14:44:50.304921 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3017/6037] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:49 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:51.312638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0ad87fdf-535d-4b16-9dd0-51f4a1945fa1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:51.314397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0ad87fdf-535d-4b16-9dd0-51f4a1945fa1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:51.322241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=22 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:51.341353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0ad87fdf-535d-4b16-9dd0-51f4a1945fa1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:51.352987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0ad87fdf-535d-4b16-9dd0-51f4a1945fa1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:51.360207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0ad87fdf-535d-4b16-9dd0-51f4a1945fa1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:51.364456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0ad87fdf-535d-4b16-9dd0-51f4a1945fa1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:52.012265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0ad87fdf-535d-4b16-9dd0-51f4a1945fa1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:52.096252 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0ad87fdf-535d-4b16-9dd0-51f4a1945fa1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 0.778756 Aug 04 14:44:52.101925 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3021/6038] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:51 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:53.027960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ab21983c-95a1-43fb-8985-bf803ecd1b66 req-db07e13a-645a-4990-b57b-7ea1f34a341b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6217b413-f999-4dd0-b691-db71aef68afd", "tag": "8aaf8e0a-bf64-4bd7-8271-5451061f19a4"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:44:53.052444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ab21983c-95a1-43fb-8985-bf803ecd1b66 req-db07e13a-645a-4990-b57b-7ea1f34a341b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:53.056294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ab21983c-95a1-43fb-8985-bf803ecd1b66 req-db07e13a-645a-4990-b57b-7ea1f34a341b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:53.094442 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ab21983c-95a1-43fb-8985-bf803ecd1b66 req-db07e13a-645a-4990-b57b-7ea1f34a341b service nova] Creating event network-changed:8aaf8e0a-bf64-4bd7-8271-5451061f19a4 for instance 6217b413-f999-4dd0-b691-db71aef68afd on n-h2-844627-10 Aug 04 14:44:53.113085 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ab21983c-95a1-43fb-8985-bf803ecd1b66 req-db07e13a-645a-4990-b57b-7ea1f34a341b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091609 Aug 04 14:44:53.118805 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3018/6039] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:44:53.145154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7103dc7f-ae5a-4f0e-b870-5f7263195416 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:53.147066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7103dc7f-ae5a-4f0e-b870-5f7263195416 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:53.188112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7103dc7f-ae5a-4f0e-b870-5f7263195416 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:53.190076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7103dc7f-ae5a-4f0e-b870-5f7263195416 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:53.192316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7103dc7f-ae5a-4f0e-b870-5f7263195416 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:53.196897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7103dc7f-ae5a-4f0e-b870-5f7263195416 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:54.183176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7103dc7f-ae5a-4f0e-b870-5f7263195416 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:54.199820 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7103dc7f-ae5a-4f0e-b870-5f7263195416 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 1.059247 Aug 04 14:44:54.200448 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3022/6040] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:53 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:55.225070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1ff3684-6b29-4220-a062-9fea939b25a4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:55.226579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e1ff3684-6b29-4220-a062-9fea939b25a4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:55.230044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:55.235993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:55.248593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=10 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:55.267219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1ff3684-6b29-4220-a062-9fea939b25a4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:55.269332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1ff3684-6b29-4220-a062-9fea939b25a4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:55.271790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1ff3684-6b29-4220-a062-9fea939b25a4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:55.275242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1ff3684-6b29-4220-a062-9fea939b25a4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:55.989603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e1ff3684-6b29-4220-a062-9fea939b25a4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:56.065025 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e1ff3684-6b29-4220-a062-9fea939b25a4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 0.839042 Aug 04 14:44:56.066753 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3019/6041] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:55 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:44:57.110288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f086986a-9880-44b7-ade9-a6b6a155a544 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:57.116846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f086986a-9880-44b7-ade9-a6b6a155a544 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:57.140030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:44:57.182200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f086986a-9880-44b7-ade9-a6b6a155a544 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:57.183261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f086986a-9880-44b7-ade9-a6b6a155a544 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:57.187523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f086986a-9880-44b7-ade9-a6b6a155a544 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:57.188988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f086986a-9880-44b7-ade9-a6b6a155a544 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:57.623956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f086986a-9880-44b7-ade9-a6b6a155a544 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:57.664002 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f086986a-9880-44b7-ade9-a6b6a155a544 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 0.558510 Aug 04 14:44:57.670055 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3023/6042] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:57 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:44:58.716017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-87b8db86-b7f1-412a-be9a-335e4392eaeb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:44:58.721895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-87b8db86-b7f1-412a-be9a-335e4392eaeb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:44:58.745970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87b8db86-b7f1-412a-be9a-335e4392eaeb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:58.747318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87b8db86-b7f1-412a-be9a-335e4392eaeb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:58.751066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87b8db86-b7f1-412a-be9a-335e4392eaeb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:44:58.756242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87b8db86-b7f1-412a-be9a-335e4392eaeb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:44:59.014928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-87b8db86-b7f1-412a-be9a-335e4392eaeb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:44:59.046260 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-87b8db86-b7f1-412a-be9a-335e4392eaeb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 0.342952 Aug 04 14:44:59.060372 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3020/6043] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:44:58 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:00.084549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b1d95bc-315b-4154-87d5-97e4c05edba1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:00.087864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b1d95bc-315b-4154-87d5-97e4c05edba1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:00.137752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b1d95bc-315b-4154-87d5-97e4c05edba1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:00.138886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b1d95bc-315b-4154-87d5-97e4c05edba1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:00.139710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b1d95bc-315b-4154-87d5-97e4c05edba1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:00.140159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b1d95bc-315b-4154-87d5-97e4c05edba1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:01.429815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b1d95bc-315b-4154-87d5-97e4c05edba1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:01.449339 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b1d95bc-315b-4154-87d5-97e4c05edba1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 1.381917 Aug 04 14:45:01.465267 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3024/6044] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:00 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:02.476308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fe794415-08dd-4c9d-aea6-3b33e87c061b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:02.479444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fe794415-08dd-4c9d-aea6-3b33e87c061b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:02.526890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fe794415-08dd-4c9d-aea6-3b33e87c061b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:02.532078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fe794415-08dd-4c9d-aea6-3b33e87c061b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:02.535656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fe794415-08dd-4c9d-aea6-3b33e87c061b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:02.541680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fe794415-08dd-4c9d-aea6-3b33e87c061b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:03.025715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fe794415-08dd-4c9d-aea6-3b33e87c061b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:03.050267 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fe794415-08dd-4c9d-aea6-3b33e87c061b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 0.582103 Aug 04 14:45:03.052173 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3021/6045] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:02 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:04.088465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-002e5110-5de1-470a-ae5a-613c126cadf4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:04.089239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-002e5110-5de1-470a-ae5a-613c126cadf4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:04.102653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-002e5110-5de1-470a-ae5a-613c126cadf4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:04.103074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-002e5110-5de1-470a-ae5a-613c126cadf4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:04.105124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-002e5110-5de1-470a-ae5a-613c126cadf4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:04.113128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-002e5110-5de1-470a-ae5a-613c126cadf4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:04.436219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-002e5110-5de1-470a-ae5a-613c126cadf4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:04.470926 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-002e5110-5de1-470a-ae5a-613c126cadf4 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 0.383839 Aug 04 14:45:04.473274 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3025/6046] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:04 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:05.517965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ea306d0a-d722-4ba1-b2bb-cdbe82d29ab3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:05.523430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ea306d0a-d722-4ba1-b2bb-cdbe82d29ab3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:05.535659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea306d0a-d722-4ba1-b2bb-cdbe82d29ab3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:05.536639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea306d0a-d722-4ba1-b2bb-cdbe82d29ab3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:05.538171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea306d0a-d722-4ba1-b2bb-cdbe82d29ab3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:05.539302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ea306d0a-d722-4ba1-b2bb-cdbe82d29ab3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:05.940197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ea306d0a-d722-4ba1-b2bb-cdbe82d29ab3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:05.962205 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ea306d0a-d722-4ba1-b2bb-cdbe82d29ab3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 0.449849 Aug 04 14:45:05.963440 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3022/6047] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:05 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:06.999656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2c76332c-61f9-4122-be5a-5174cb90eadf tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:07.000491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2c76332c-61f9-4122-be5a-5174cb90eadf tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:07.015808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c76332c-61f9-4122-be5a-5174cb90eadf tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:07.016338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c76332c-61f9-4122-be5a-5174cb90eadf tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:07.017500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c76332c-61f9-4122-be5a-5174cb90eadf tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:07.021748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2c76332c-61f9-4122-be5a-5174cb90eadf tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:07.402256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2c76332c-61f9-4122-be5a-5174cb90eadf tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:07.422745 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2c76332c-61f9-4122-be5a-5174cb90eadf tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1282 microversion: 2.1 time: 0.427905 Aug 04 14:45:07.433857 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3026/6048] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:06 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1282 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:07.559794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aa82ebcc-8a9c-4571-8fc7-e29036d07b99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:45:07.565803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aa82ebcc-8a9c-4571-8fc7-e29036d07b99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:07.590359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa82ebcc-8a9c-4571-8fc7-e29036d07b99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:07.593152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa82ebcc-8a9c-4571-8fc7-e29036d07b99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:07.598638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa82ebcc-8a9c-4571-8fc7-e29036d07b99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:07.616382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aa82ebcc-8a9c-4571-8fc7-e29036d07b99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:07.718599 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aa82ebcc-8a9c-4571-8fc7-e29036d07b99 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88/action" status: 200 len: 24572 microversion: 2.1 time: 0.176852 Aug 04 14:45:07.719868 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3023/6049] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:45:07 2022] POST /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88/action => generated 24572 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:45:08.474062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-171c086b-4d58-4c59-b7d3-819a0f14dc14 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:08.478071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-171c086b-4d58-4c59-b7d3-819a0f14dc14 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:08.488690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-171c086b-4d58-4c59-b7d3-819a0f14dc14 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:08.489177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-171c086b-4d58-4c59-b7d3-819a0f14dc14 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:08.489970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-171c086b-4d58-4c59-b7d3-819a0f14dc14 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:08.490412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-171c086b-4d58-4c59-b7d3-819a0f14dc14 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:08.708890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-171c086b-4d58-4c59-b7d3-819a0f14dc14 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:08.728643 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-171c086b-4d58-4c59-b7d3-819a0f14dc14 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1270 microversion: 2.1 time: 0.261621 Aug 04 14:45:08.730187 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3027/6050] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:08 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1270 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:09.764145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1b3c789-0dee-4415-a315-f5b6bf9df3ed tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:09.765103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f1b3c789-0dee-4415-a315-f5b6bf9df3ed tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:09.782442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1b3c789-0dee-4415-a315-f5b6bf9df3ed tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:09.783325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1b3c789-0dee-4415-a315-f5b6bf9df3ed tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:09.784547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1b3c789-0dee-4415-a315-f5b6bf9df3ed tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:09.787700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1b3c789-0dee-4415-a315-f5b6bf9df3ed tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:10.004010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f1b3c789-0dee-4415-a315-f5b6bf9df3ed tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:10.013755 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f1b3c789-0dee-4415-a315-f5b6bf9df3ed tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1270 microversion: 2.1 time: 0.253875 Aug 04 14:45:10.014370 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3024/6051] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:09 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1270 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:11.036297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4499b1e-63f1-421c-baf3-139a12a5d744 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:11.037640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e4499b1e-63f1-421c-baf3-139a12a5d744 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:11.056963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4499b1e-63f1-421c-baf3-139a12a5d744 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:11.057309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4499b1e-63f1-421c-baf3-139a12a5d744 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:11.058139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4499b1e-63f1-421c-baf3-139a12a5d744 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:11.058610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4499b1e-63f1-421c-baf3-139a12a5d744 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:11.093020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=56 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:11.307374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e4499b1e-63f1-421c-baf3-139a12a5d744 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:11.315971 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e4499b1e-63f1-421c-baf3-139a12a5d744 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1270 microversion: 2.1 time: 0.283609 Aug 04 14:45:11.329422 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3028/6052] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:11 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1270 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:12.342733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e9b3dd9a-2970-4c22-b3c5-d33e98538ce1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:12.344834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e9b3dd9a-2970-4c22-b3c5-d33e98538ce1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:12.357826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9b3dd9a-2970-4c22-b3c5-d33e98538ce1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:12.363809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9b3dd9a-2970-4c22-b3c5-d33e98538ce1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:12.365669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9b3dd9a-2970-4c22-b3c5-d33e98538ce1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:12.367043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e9b3dd9a-2970-4c22-b3c5-d33e98538ce1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:12.670952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e9b3dd9a-2970-4c22-b3c5-d33e98538ce1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:12.690916 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e9b3dd9a-2970-4c22-b3c5-d33e98538ce1 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1270 microversion: 2.1 time: 0.356241 Aug 04 14:45:12.692595 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3025/6053] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:12 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1270 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:13.733144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a4ebc304-0d7b-4002-a1a8-22e60528f0cb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:13.735180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a4ebc304-0d7b-4002-a1a8-22e60528f0cb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:13.751486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4ebc304-0d7b-4002-a1a8-22e60528f0cb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:13.752236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4ebc304-0d7b-4002-a1a8-22e60528f0cb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:13.753720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4ebc304-0d7b-4002-a1a8-22e60528f0cb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:13.754520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4ebc304-0d7b-4002-a1a8-22e60528f0cb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:13.980108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a4ebc304-0d7b-4002-a1a8-22e60528f0cb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:13.994799 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a4ebc304-0d7b-4002-a1a8-22e60528f0cb tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1270 microversion: 2.1 time: 0.269419 Aug 04 14:45:13.996093 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3029/6054] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:13 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1270 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:15.019430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef61ca20-a876-41fd-bda9-693d7cc9e507 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:15.020063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ef61ca20-a876-41fd-bda9-693d7cc9e507 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:15.034595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef61ca20-a876-41fd-bda9-693d7cc9e507 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:15.035520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef61ca20-a876-41fd-bda9-693d7cc9e507 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:15.037090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef61ca20-a876-41fd-bda9-693d7cc9e507 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:15.037729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef61ca20-a876-41fd-bda9-693d7cc9e507 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:15.360223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ef61ca20-a876-41fd-bda9-693d7cc9e507 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:15.364607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=60 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:15.378955 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ef61ca20-a876-41fd-bda9-693d7cc9e507 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1270 microversion: 2.1 time: 0.363119 Aug 04 14:45:15.389368 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3026/6055] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:15 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1270 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:16.417180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1fc12eb-b5db-4602-91fb-af9d68ddd343 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:16.419722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1fc12eb-b5db-4602-91fb-af9d68ddd343 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:16.444897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1fc12eb-b5db-4602-91fb-af9d68ddd343 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:16.465528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1fc12eb-b5db-4602-91fb-af9d68ddd343 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:16.467741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1fc12eb-b5db-4602-91fb-af9d68ddd343 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:16.474268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1fc12eb-b5db-4602-91fb-af9d68ddd343 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:16.924913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b1fc12eb-b5db-4602-91fb-af9d68ddd343 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:16.944766 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1fc12eb-b5db-4602-91fb-af9d68ddd343 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1270 microversion: 2.1 time: 0.535736 Aug 04 14:45:16.967533 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3030/6056] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:16 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1270 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:17.971735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d208e876-7d70-44ae-ae55-bf94e827f000 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:17.972755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d208e876-7d70-44ae-ae55-bf94e827f000 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:18.014078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-267510505", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6dae7058-00cd-45c4-b3bb-544ea11ed459", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "da90baac-d2cd-4bbe-ac2b-56b8aae47252"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:45:18.021894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d208e876-7d70-44ae-ae55-bf94e827f000 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:18.022644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d208e876-7d70-44ae-ae55-bf94e827f000 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:18.030856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d208e876-7d70-44ae-ae55-bf94e827f000 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:18.031774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d208e876-7d70-44ae-ae55-bf94e827f000 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:18.277157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] validate_networks() for [('da90baac-d2cd-4bbe-ac2b-56b8aae47252', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:45:18.395479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d208e876-7d70-44ae-ae55-bf94e827f000 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:18.417451 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d208e876-7d70-44ae-ae55-bf94e827f000 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1270 microversion: 2.1 time: 0.452350 Aug 04 14:45:18.432155 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3027/6057] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:17 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1270 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:18.473373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ab644e74-10a0-4383-ab8c-ae21ee316949 req-13ff1db5-37b1-43e4-a8c6-60bbacfbedb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6217b413-f999-4dd0-b691-db71aef68afd", "name": "network-vif-plugged", "status": "completed", "tag": "8aaf8e0a-bf64-4bd7-8271-5451061f19a4"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:45:18.505028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ab644e74-10a0-4383-ab8c-ae21ee316949 req-13ff1db5-37b1-43e4-a8c6-60bbacfbedb8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:18.506017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ab644e74-10a0-4383-ab8c-ae21ee316949 req-13ff1db5-37b1-43e4-a8c6-60bbacfbedb8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:18.536724 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ab644e74-10a0-4383-ab8c-ae21ee316949 req-13ff1db5-37b1-43e4-a8c6-60bbacfbedb8 service nova] Creating event network-vif-plugged:8aaf8e0a-bf64-4bd7-8271-5451061f19a4 for instance 6217b413-f999-4dd0-b691-db71aef68afd on n-h2-844627-10 Aug 04 14:45:18.549675 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ab644e74-10a0-4383-ab8c-ae21ee316949 req-13ff1db5-37b1-43e4-a8c6-60bbacfbedb8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082601 Aug 04 14:45:18.551319 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3028/6058] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:45:19.174921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:45:19.175722 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:45:19.175912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:45:19.176274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:45:19.176987 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:45:19.192788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:19.193552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:19.195033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:19.195743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:19.228909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:45:19.238044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for user 374c75516444430ea550446cd477e015 and project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:45:19.262107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:45:19.267322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6dae7058-00cd-45c4-b3bb-544ea11ed459',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:45:19.401516 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aab7961d-0dd5-4ebd-b7f5-d61fba6a62c5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391889 Aug 04 14:45:19.402851 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3031/6059] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:45:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:45:19.425243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5902c551-b7f4-425f-9821-c6f3f74c423d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:19.428475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5902c551-b7f4-425f-9821-c6f3f74c423d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:19.462873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bac8b319-527e-4450-8579-724c60e9df16 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:19.463964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bac8b319-527e-4450-8579-724c60e9df16 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:19.478198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bac8b319-527e-4450-8579-724c60e9df16 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:19.478712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bac8b319-527e-4450-8579-724c60e9df16 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:19.480365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bac8b319-527e-4450-8579-724c60e9df16 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:19.480917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bac8b319-527e-4450-8579-724c60e9df16 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:19.632663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5902c551-b7f4-425f-9821-c6f3f74c423d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:19.648455 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5902c551-b7f4-425f-9821-c6f3f74c423d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1056 microversion: 2.1 time: 0.232196 Aug 04 14:45:19.649912 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3029/6060] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:19 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1056 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:19.880162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bac8b319-527e-4450-8579-724c60e9df16 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:19.891719 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bac8b319-527e-4450-8579-724c60e9df16 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1270 microversion: 2.1 time: 0.439171 Aug 04 14:45:19.907221 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3032/6061] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:19 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1270 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:20.686287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-80c5d232-b1df-4a2b-9077-f32168188299 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:20.688030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-80c5d232-b1df-4a2b-9077-f32168188299 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:20.706481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80c5d232-b1df-4a2b-9077-f32168188299 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:20.707369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80c5d232-b1df-4a2b-9077-f32168188299 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:20.708697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80c5d232-b1df-4a2b-9077-f32168188299 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:20.709733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-80c5d232-b1df-4a2b-9077-f32168188299 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:20.858190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-80c5d232-b1df-4a2b-9077-f32168188299 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:20.866276 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-80c5d232-b1df-4a2b-9077-f32168188299 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1108 microversion: 2.1 time: 0.188308 Aug 04 14:45:20.884976 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3030/6062] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:20 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1108 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:20.914924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19bfe39f-8e10-45c9-9c99-0030ec39186b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:20.915770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-19bfe39f-8e10-45c9-9c99-0030ec39186b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:20.924982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19bfe39f-8e10-45c9-9c99-0030ec39186b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:20.927014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19bfe39f-8e10-45c9-9c99-0030ec39186b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:20.928122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19bfe39f-8e10-45c9-9c99-0030ec39186b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:20.928758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19bfe39f-8e10-45c9-9c99-0030ec39186b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:21.238005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-19bfe39f-8e10-45c9-9c99-0030ec39186b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:21.260104 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-19bfe39f-8e10-45c9-9c99-0030ec39186b tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1459 microversion: 2.1 time: 0.349050 Aug 04 14:45:21.263178 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3033/6063] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:20 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1459 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:21.305866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-71dd8279-bc37-4035-986c-f3480377cb65 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:21.310336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-71dd8279-bc37-4035-986c-f3480377cb65 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:21.335336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71dd8279-bc37-4035-986c-f3480377cb65 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:21.336711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71dd8279-bc37-4035-986c-f3480377cb65 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:21.339402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71dd8279-bc37-4035-986c-f3480377cb65 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:21.340389 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-71dd8279-bc37-4035-986c-f3480377cb65 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:21.640192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-71dd8279-bc37-4035-986c-f3480377cb65 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:21.651699 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-71dd8279-bc37-4035-986c-f3480377cb65 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1459 microversion: 2.1 time: 0.362532 Aug 04 14:45:21.652959 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3031/6064] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:21 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1459 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:21.890516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e0af5af-3171-4f77-9ccb-fe43b410b49a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:21.891041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e0af5af-3171-4f77-9ccb-fe43b410b49a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:21.893751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:21.906463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e0af5af-3171-4f77-9ccb-fe43b410b49a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:21.910954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e0af5af-3171-4f77-9ccb-fe43b410b49a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:21.911826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e0af5af-3171-4f77-9ccb-fe43b410b49a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:21.912279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e0af5af-3171-4f77-9ccb-fe43b410b49a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:22.174095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8e0af5af-3171-4f77-9ccb-fe43b410b49a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:22.182786 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e0af5af-3171-4f77-9ccb-fe43b410b49a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1126 microversion: 2.1 time: 0.296896 Aug 04 14:45:22.194675 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3034/6065] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:21 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1126 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:23.210733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e72a1c3-3421-4bca-95c6-02a052acdaba tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:23.211924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e72a1c3-3421-4bca-95c6-02a052acdaba tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:23.254496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e72a1c3-3421-4bca-95c6-02a052acdaba tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:23.260030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e72a1c3-3421-4bca-95c6-02a052acdaba tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:23.266557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e72a1c3-3421-4bca-95c6-02a052acdaba tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:23.277664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e72a1c3-3421-4bca-95c6-02a052acdaba tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:23.745320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6e72a1c3-3421-4bca-95c6-02a052acdaba tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:23.758537 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e72a1c3-3421-4bca-95c6-02a052acdaba tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.555041 Aug 04 14:45:23.779082 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3032/6066] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:23 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:24.793423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab8a8cb8-8c03-4759-a316-bfa4a50b950f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:24.796707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ab8a8cb8-8c03-4759-a316-bfa4a50b950f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:24.836638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab8a8cb8-8c03-4759-a316-bfa4a50b950f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:24.839883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab8a8cb8-8c03-4759-a316-bfa4a50b950f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:24.843338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab8a8cb8-8c03-4759-a316-bfa4a50b950f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:24.844647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab8a8cb8-8c03-4759-a316-bfa4a50b950f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:25.281049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ab8a8cb8-8c03-4759-a316-bfa4a50b950f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:25.314192 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab8a8cb8-8c03-4759-a316-bfa4a50b950f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.529576 Aug 04 14:45:25.315594 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3035/6067] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:24 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:26.095317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7d8fcece-ed53-4740-913d-3e1bf9978bdb req-cc186fe8-be99-44d1-a08b-49cbed94a3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e62838ec-0236-48f5-8a08-b84d70f001ba", "tag": "cbfc7cc4-44b9-4534-83c2-ae30e93dec28"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:45:26.123711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=30 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:26.133795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7d8fcece-ed53-4740-913d-3e1bf9978bdb req-cc186fe8-be99-44d1-a08b-49cbed94a3c1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:26.137070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7d8fcece-ed53-4740-913d-3e1bf9978bdb req-cc186fe8-be99-44d1-a08b-49cbed94a3c1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:26.186813 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7d8fcece-ed53-4740-913d-3e1bf9978bdb req-cc186fe8-be99-44d1-a08b-49cbed94a3c1 service nova] Creating event network-changed:cbfc7cc4-44b9-4534-83c2-ae30e93dec28 for instance e62838ec-0236-48f5-8a08-b84d70f001ba on n-h1-844627-10 Aug 04 14:45:26.199691 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7d8fcece-ed53-4740-913d-3e1bf9978bdb req-cc186fe8-be99-44d1-a08b-49cbed94a3c1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.514412 Aug 04 14:45:26.201883 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3033/6068] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:45:26.358248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15bd77a1-35d5-4d0d-8360-4e98597167a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:26.360975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-15bd77a1-35d5-4d0d-8360-4e98597167a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:26.396498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15bd77a1-35d5-4d0d-8360-4e98597167a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:26.397168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15bd77a1-35d5-4d0d-8360-4e98597167a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:26.398328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15bd77a1-35d5-4d0d-8360-4e98597167a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:26.398883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15bd77a1-35d5-4d0d-8360-4e98597167a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:26.758288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-15bd77a1-35d5-4d0d-8360-4e98597167a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:26.801952 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-15bd77a1-35d5-4d0d-8360-4e98597167a3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.457247 Aug 04 14:45:26.803746 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3036/6069] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:26 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:27.847008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1affdcfa-8d5c-4f8f-af90-88b14d08c0d5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:27.857005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1affdcfa-8d5c-4f8f-af90-88b14d08c0d5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:27.900066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1affdcfa-8d5c-4f8f-af90-88b14d08c0d5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:27.903147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1affdcfa-8d5c-4f8f-af90-88b14d08c0d5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:27.908798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1affdcfa-8d5c-4f8f-af90-88b14d08c0d5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:27.912091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1affdcfa-8d5c-4f8f-af90-88b14d08c0d5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:28.281681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1affdcfa-8d5c-4f8f-af90-88b14d08c0d5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:28.306384 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1affdcfa-8d5c-4f8f-af90-88b14d08c0d5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.470552 Aug 04 14:45:28.307314 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3034/6070] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:27 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:29.296566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-64045b49-add5-444d-8b7c-b9594c3b0d8f req-4c9c7982-38a1-4aeb-ab6e-4cec85d4e854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6217b413-f999-4dd0-b691-db71aef68afd", "tag": "8aaf8e0a-bf64-4bd7-8271-5451061f19a4"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:45:29.332314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:29.335265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:29.352144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-64045b49-add5-444d-8b7c-b9594c3b0d8f req-4c9c7982-38a1-4aeb-ab6e-4cec85d4e854 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:29.353256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-64045b49-add5-444d-8b7c-b9594c3b0d8f req-4c9c7982-38a1-4aeb-ab6e-4cec85d4e854 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:29.367112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b3eb0cef-0f1b-4266-99d2-c908a86d9a60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:29.374699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b3eb0cef-0f1b-4266-99d2-c908a86d9a60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:29.377303 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-64045b49-add5-444d-8b7c-b9594c3b0d8f req-4c9c7982-38a1-4aeb-ab6e-4cec85d4e854 service nova] Creating event network-changed:8aaf8e0a-bf64-4bd7-8271-5451061f19a4 for instance 6217b413-f999-4dd0-b691-db71aef68afd on n-h2-844627-10 Aug 04 14:45:29.392801 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-64045b49-add5-444d-8b7c-b9594c3b0d8f req-4c9c7982-38a1-4aeb-ab6e-4cec85d4e854 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111216 Aug 04 14:45:29.394161 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3037/6071] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:45:29.443554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3eb0cef-0f1b-4266-99d2-c908a86d9a60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:29.444681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3eb0cef-0f1b-4266-99d2-c908a86d9a60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:29.445708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3eb0cef-0f1b-4266-99d2-c908a86d9a60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:29.448438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b3eb0cef-0f1b-4266-99d2-c908a86d9a60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:29.647095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:29.849100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b3eb0cef-0f1b-4266-99d2-c908a86d9a60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:29.867762 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b3eb0cef-0f1b-4266-99d2-c908a86d9a60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.531600 Aug 04 14:45:29.881725 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3035/6072] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:29 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:30.893520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-795fc331-d9b4-428f-81b8-f012d776f056 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:30.895736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-795fc331-d9b4-428f-81b8-f012d776f056 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:30.924993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-795fc331-d9b4-428f-81b8-f012d776f056 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:30.930413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-795fc331-d9b4-428f-81b8-f012d776f056 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:30.931679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-795fc331-d9b4-428f-81b8-f012d776f056 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:30.933424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-795fc331-d9b4-428f-81b8-f012d776f056 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:31.929288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-795fc331-d9b4-428f-81b8-f012d776f056 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:31.968087 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-795fc331-d9b4-428f-81b8-f012d776f056 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 1.080197 Aug 04 14:45:31.995240 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3038/6073] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:30 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:33.011996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-745003e3-ee51-4bac-a796-8545c3115d46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:33.021464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-745003e3-ee51-4bac-a796-8545c3115d46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:33.089520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-745003e3-ee51-4bac-a796-8545c3115d46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:33.090581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-745003e3-ee51-4bac-a796-8545c3115d46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:33.108310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-745003e3-ee51-4bac-a796-8545c3115d46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:33.109333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-745003e3-ee51-4bac-a796-8545c3115d46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:33.542844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0f48e084-4ece-4e8f-8812-15dcb8a1afc8 req-6e0e789f-bbde-41c9-a16d-5ef12ae98372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6217b413-f999-4dd0-b691-db71aef68afd", "tag": "8aaf8e0a-bf64-4bd7-8271-5451061f19a4"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:45:33.590131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0f48e084-4ece-4e8f-8812-15dcb8a1afc8 req-6e0e789f-bbde-41c9-a16d-5ef12ae98372 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:33.611278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0f48e084-4ece-4e8f-8812-15dcb8a1afc8 req-6e0e789f-bbde-41c9-a16d-5ef12ae98372 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:33.705739 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0f48e084-4ece-4e8f-8812-15dcb8a1afc8 req-6e0e789f-bbde-41c9-a16d-5ef12ae98372 service nova] Creating event network-changed:8aaf8e0a-bf64-4bd7-8271-5451061f19a4 for instance 6217b413-f999-4dd0-b691-db71aef68afd on n-h2-844627-10 Aug 04 14:45:33.734035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-745003e3-ee51-4bac-a796-8545c3115d46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:33.777900 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0f48e084-4ece-4e8f-8812-15dcb8a1afc8 req-6e0e789f-bbde-41c9-a16d-5ef12ae98372 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243980 Aug 04 14:45:33.791773 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-745003e3-ee51-4bac-a796-8545c3115d46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.786717 Aug 04 14:45:33.800002 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3039/6074] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:45:33.813966 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3036/6075] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:33 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:34.843029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3602112c-01e2-4058-8698-12009630a4ef tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:34.848571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3602112c-01e2-4058-8698-12009630a4ef tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:34.879359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3602112c-01e2-4058-8698-12009630a4ef tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:34.886081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3602112c-01e2-4058-8698-12009630a4ef tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:34.888410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3602112c-01e2-4058-8698-12009630a4ef tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:34.893913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3602112c-01e2-4058-8698-12009630a4ef tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:35.646720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3602112c-01e2-4058-8698-12009630a4ef tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:35.667916 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3602112c-01e2-4058-8698-12009630a4ef tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.846210 Aug 04 14:45:35.669732 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3040/6076] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:34 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:35.801772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fd260817-1e2f-402b-84ed-1ffa780a6be6 req-920a36ed-1f6c-456f-bf1f-9229959a8294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6217b413-f999-4dd0-b691-db71aef68afd", "tag": "8aaf8e0a-bf64-4bd7-8271-5451061f19a4"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:45:35.817617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fd260817-1e2f-402b-84ed-1ffa780a6be6 req-920a36ed-1f6c-456f-bf1f-9229959a8294 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:35.818704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fd260817-1e2f-402b-84ed-1ffa780a6be6 req-920a36ed-1f6c-456f-bf1f-9229959a8294 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:35.851696 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fd260817-1e2f-402b-84ed-1ffa780a6be6 req-920a36ed-1f6c-456f-bf1f-9229959a8294 service nova] Creating event network-changed:8aaf8e0a-bf64-4bd7-8271-5451061f19a4 for instance 6217b413-f999-4dd0-b691-db71aef68afd on n-h2-844627-10 Aug 04 14:45:35.860891 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fd260817-1e2f-402b-84ed-1ffa780a6be6 req-920a36ed-1f6c-456f-bf1f-9229959a8294 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063594 Aug 04 14:45:35.865532 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3037/6077] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:45:36.710582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-09d82eea-fb83-48f8-a80c-2e9d3712b659 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:36.723048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-09d82eea-fb83-48f8-a80c-2e9d3712b659 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:36.738937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09d82eea-fb83-48f8-a80c-2e9d3712b659 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:36.743081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09d82eea-fb83-48f8-a80c-2e9d3712b659 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:36.744073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09d82eea-fb83-48f8-a80c-2e9d3712b659 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:36.744782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09d82eea-fb83-48f8-a80c-2e9d3712b659 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:37.235256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-09d82eea-fb83-48f8-a80c-2e9d3712b659 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:37.269620 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-09d82eea-fb83-48f8-a80c-2e9d3712b659 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.570817 Aug 04 14:45:37.275451 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3041/6078] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:36 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:38.140649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:45:38.151789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:38.183235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:38.183939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:38.190213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:38.190709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:38.296060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1882935b-0c46-4380-ba1e-2ef7e14616c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:38.296882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1882935b-0c46-4380-ba1e-2ef7e14616c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:38.319173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1882935b-0c46-4380-ba1e-2ef7e14616c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:38.319631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1882935b-0c46-4380-ba1e-2ef7e14616c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:38.320408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1882935b-0c46-4380-ba1e-2ef7e14616c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:38.320849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1882935b-0c46-4380-ba1e-2ef7e14616c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:38.405638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:45:38.406456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:45:38.410664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:45:38.411723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:45:38.415581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:45:38.644601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1882935b-0c46-4380-ba1e-2ef7e14616c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:38.653588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:38.654244 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1882935b-0c46-4380-ba1e-2ef7e14616c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.362196 Aug 04 14:45:38.655478 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3042/6079] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:38 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:38.665343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:38.666222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:38.667409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:38.668042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:38.711056 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f0ce3374-210b-40d0-b41b-129f494f52b1 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88/action" status: 202 len: 1137 microversion: 2.1 time: 0.586235 Aug 04 14:45:38.713152 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3038/6080] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:45:38 2022] POST /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88/action => generated 1137 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 14:45:38.738277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e8bf923-cad5-4a39-b918-fa466c7e8613 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:38.739658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2e8bf923-cad5-4a39-b918-fa466c7e8613 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:38.754924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e8bf923-cad5-4a39-b918-fa466c7e8613 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:38.756019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e8bf923-cad5-4a39-b918-fa466c7e8613 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:38.758229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e8bf923-cad5-4a39-b918-fa466c7e8613 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:38.760463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e8bf923-cad5-4a39-b918-fa466c7e8613 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:39.053205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e8bf923-cad5-4a39-b918-fa466c7e8613 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:39.068974 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e8bf923-cad5-4a39-b918-fa466c7e8613 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.331309 Aug 04 14:45:39.070482 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3043/6081] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:38 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:39.695203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-908c89da-2cd0-4fdb-8eff-48131e93b1e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:39.695849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-908c89da-2cd0-4fdb-8eff-48131e93b1e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:39.704299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-908c89da-2cd0-4fdb-8eff-48131e93b1e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:39.704763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-908c89da-2cd0-4fdb-8eff-48131e93b1e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:39.705599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-908c89da-2cd0-4fdb-8eff-48131e93b1e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:39.706054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-908c89da-2cd0-4fdb-8eff-48131e93b1e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:39.863528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-908c89da-2cd0-4fdb-8eff-48131e93b1e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:39.872167 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-908c89da-2cd0-4fdb-8eff-48131e93b1e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.184952 Aug 04 14:45:39.873158 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3039/6082] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:39 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:40.114063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e26e4596-60f5-47ed-bae3-e538a406ccf7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:40.114781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e26e4596-60f5-47ed-bae3-e538a406ccf7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:40.123034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e26e4596-60f5-47ed-bae3-e538a406ccf7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:40.124067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e26e4596-60f5-47ed-bae3-e538a406ccf7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:40.125164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e26e4596-60f5-47ed-bae3-e538a406ccf7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:40.125626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e26e4596-60f5-47ed-bae3-e538a406ccf7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:40.347193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e26e4596-60f5-47ed-bae3-e538a406ccf7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:40.358249 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e26e4596-60f5-47ed-bae3-e538a406ccf7 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.248018 Aug 04 14:45:40.359511 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3044/6083] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:40 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:40.893974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be2ae374-94ff-4fd3-8095-d9c8a465c962 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:40.894774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be2ae374-94ff-4fd3-8095-d9c8a465c962 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:40.902388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be2ae374-94ff-4fd3-8095-d9c8a465c962 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:40.903205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be2ae374-94ff-4fd3-8095-d9c8a465c962 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:40.905148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be2ae374-94ff-4fd3-8095-d9c8a465c962 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:40.907424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be2ae374-94ff-4fd3-8095-d9c8a465c962 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:41.081530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-be2ae374-94ff-4fd3-8095-d9c8a465c962 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:41.091189 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be2ae374-94ff-4fd3-8095-d9c8a465c962 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.201160 Aug 04 14:45:41.091791 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3040/6084] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:40 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:41.383972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-075d80b3-bce7-40af-8dac-d81c50713681 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:41.385671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-075d80b3-bce7-40af-8dac-d81c50713681 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:41.430199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-075d80b3-bce7-40af-8dac-d81c50713681 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:41.430951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-075d80b3-bce7-40af-8dac-d81c50713681 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:41.432240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-075d80b3-bce7-40af-8dac-d81c50713681 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:41.433008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-075d80b3-bce7-40af-8dac-d81c50713681 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:41.447060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=90 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:41.717678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-075d80b3-bce7-40af-8dac-d81c50713681 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:41.726725 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-075d80b3-bce7-40af-8dac-d81c50713681 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.348274 Aug 04 14:45:41.727337 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3045/6085] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:41 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:42.117833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5bce345d-cfe2-4027-8d66-8e883054b91e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:42.118806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5bce345d-cfe2-4027-8d66-8e883054b91e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:42.128106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bce345d-cfe2-4027-8d66-8e883054b91e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:42.128890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bce345d-cfe2-4027-8d66-8e883054b91e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:42.129732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bce345d-cfe2-4027-8d66-8e883054b91e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:42.130183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bce345d-cfe2-4027-8d66-8e883054b91e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:42.286078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5bce345d-cfe2-4027-8d66-8e883054b91e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:42.295239 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5bce345d-cfe2-4027-8d66-8e883054b91e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.181335 Aug 04 14:45:42.295951 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3041/6086] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:42 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:42.767941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ee13dc85-bf36-4bbb-9d23-9edf4ec1d700 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:42.768683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ee13dc85-bf36-4bbb-9d23-9edf4ec1d700 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:42.783486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee13dc85-bf36-4bbb-9d23-9edf4ec1d700 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:42.784483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee13dc85-bf36-4bbb-9d23-9edf4ec1d700 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:42.786398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee13dc85-bf36-4bbb-9d23-9edf4ec1d700 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:42.787527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ee13dc85-bf36-4bbb-9d23-9edf4ec1d700 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:43.068851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ee13dc85-bf36-4bbb-9d23-9edf4ec1d700 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:43.083923 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ee13dc85-bf36-4bbb-9d23-9edf4ec1d700 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.327692 Aug 04 14:45:43.085669 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3046/6087] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:42 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:43.318303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-27e1f6b2-980e-47bb-a230-ee256fd36250 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:43.328955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-27e1f6b2-980e-47bb-a230-ee256fd36250 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:43.337483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27e1f6b2-980e-47bb-a230-ee256fd36250 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:43.338048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27e1f6b2-980e-47bb-a230-ee256fd36250 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:43.338984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27e1f6b2-980e-47bb-a230-ee256fd36250 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:43.339531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27e1f6b2-980e-47bb-a230-ee256fd36250 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:43.586372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-27e1f6b2-980e-47bb-a230-ee256fd36250 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:43.600799 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-27e1f6b2-980e-47bb-a230-ee256fd36250 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.286453 Aug 04 14:45:43.602227 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3042/6088] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:43 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:44.130546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d0853d3b-d0a8-48e6-a6bc-ef0e61af3895 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:44.132259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d0853d3b-d0a8-48e6-a6bc-ef0e61af3895 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:44.176316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0853d3b-d0a8-48e6-a6bc-ef0e61af3895 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:44.178207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0853d3b-d0a8-48e6-a6bc-ef0e61af3895 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:44.185707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0853d3b-d0a8-48e6-a6bc-ef0e61af3895 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:44.188115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0853d3b-d0a8-48e6-a6bc-ef0e61af3895 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:44.404930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d0853d3b-d0a8-48e6-a6bc-ef0e61af3895 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:44.413906 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d0853d3b-d0a8-48e6-a6bc-ef0e61af3895 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.295199 Aug 04 14:45:44.415232 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3047/6089] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:44 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:44.641200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f48d0f4a-c588-4d2f-9e10-7eae2eb857d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:44.644297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f48d0f4a-c588-4d2f-9e10-7eae2eb857d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:44.672171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f48d0f4a-c588-4d2f-9e10-7eae2eb857d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:44.673561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f48d0f4a-c588-4d2f-9e10-7eae2eb857d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:44.675420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f48d0f4a-c588-4d2f-9e10-7eae2eb857d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:44.676774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f48d0f4a-c588-4d2f-9e10-7eae2eb857d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:44.965864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f48d0f4a-c588-4d2f-9e10-7eae2eb857d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:44.974127 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f48d0f4a-c588-4d2f-9e10-7eae2eb857d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.341096 Aug 04 14:45:44.974711 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3043/6090] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:44 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:45.437549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-36eded7e-8758-40ff-a7ff-6e0ff0d9967a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:45.439445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-36eded7e-8758-40ff-a7ff-6e0ff0d9967a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:45.449203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36eded7e-8758-40ff-a7ff-6e0ff0d9967a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:45.450547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36eded7e-8758-40ff-a7ff-6e0ff0d9967a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:45.451644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36eded7e-8758-40ff-a7ff-6e0ff0d9967a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:45.452352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36eded7e-8758-40ff-a7ff-6e0ff0d9967a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:45.659651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-36eded7e-8758-40ff-a7ff-6e0ff0d9967a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:45.674752 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-36eded7e-8758-40ff-a7ff-6e0ff0d9967a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.241258 Aug 04 14:45:45.683292 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3048/6091] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:45 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:45:46.010624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c83649f-2f29-4105-b6e2-60609c083c6f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:46.011158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c83649f-2f29-4105-b6e2-60609c083c6f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:46.028578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c83649f-2f29-4105-b6e2-60609c083c6f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:46.029152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c83649f-2f29-4105-b6e2-60609c083c6f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:46.030137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c83649f-2f29-4105-b6e2-60609c083c6f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:46.030654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c83649f-2f29-4105-b6e2-60609c083c6f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:46.034577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:46.240422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c83649f-2f29-4105-b6e2-60609c083c6f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:46.250046 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c83649f-2f29-4105-b6e2-60609c083c6f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.243622 Aug 04 14:45:46.265738 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3044/6092] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:46 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:46.701132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fa86a6e8-9b27-4a02-b89d-ebd9610b66aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:46.702654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fa86a6e8-9b27-4a02-b89d-ebd9610b66aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:46.710975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa86a6e8-9b27-4a02-b89d-ebd9610b66aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:46.711701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa86a6e8-9b27-4a02-b89d-ebd9610b66aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:46.712968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa86a6e8-9b27-4a02-b89d-ebd9610b66aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:46.713622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fa86a6e8-9b27-4a02-b89d-ebd9610b66aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:46.937922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fa86a6e8-9b27-4a02-b89d-ebd9610b66aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:46.958664 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fa86a6e8-9b27-4a02-b89d-ebd9610b66aa tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.261642 Aug 04 14:45:46.960198 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3049/6093] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:46 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:47.275892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4fa9c4e5-9b87-43fa-9241-03c23caa851e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:47.276763 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4fa9c4e5-9b87-43fa-9241-03c23caa851e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:47.287178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fa9c4e5-9b87-43fa-9241-03c23caa851e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:47.287910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fa9c4e5-9b87-43fa-9241-03c23caa851e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:47.289861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fa9c4e5-9b87-43fa-9241-03c23caa851e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:47.290710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fa9c4e5-9b87-43fa-9241-03c23caa851e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:47.517220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4fa9c4e5-9b87-43fa-9241-03c23caa851e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:47.526775 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4fa9c4e5-9b87-43fa-9241-03c23caa851e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1168 microversion: 2.1 time: 0.257964 Aug 04 14:45:47.527817 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3045/6094] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:47 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1168 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:47.988248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b41ea5f0-9b1b-466a-a4ed-fcd42b358ef3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:47.989501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b41ea5f0-9b1b-466a-a4ed-fcd42b358ef3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:48.002093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b41ea5f0-9b1b-466a-a4ed-fcd42b358ef3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:48.005679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b41ea5f0-9b1b-466a-a4ed-fcd42b358ef3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:48.021129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b41ea5f0-9b1b-466a-a4ed-fcd42b358ef3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:48.022584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b41ea5f0-9b1b-466a-a4ed-fcd42b358ef3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:48.366943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b41ea5f0-9b1b-466a-a4ed-fcd42b358ef3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:48.387135 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b41ea5f0-9b1b-466a-a4ed-fcd42b358ef3 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.405704 Aug 04 14:45:48.397002 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3050/6095] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:47 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:48.552232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-10829367-7e08-4f65-81b1-4fc78f7b4cd7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:48.553461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-10829367-7e08-4f65-81b1-4fc78f7b4cd7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:48.582403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-10829367-7e08-4f65-81b1-4fc78f7b4cd7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:48.583217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-10829367-7e08-4f65-81b1-4fc78f7b4cd7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:48.584673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-10829367-7e08-4f65-81b1-4fc78f7b4cd7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:48.585476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-10829367-7e08-4f65-81b1-4fc78f7b4cd7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:48.882343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-10829367-7e08-4f65-81b1-4fc78f7b4cd7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:48.894944 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-10829367-7e08-4f65-81b1-4fc78f7b4cd7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1214 microversion: 2.1 time: 0.349907 Aug 04 14:45:48.895822 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3046/6096] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:48 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:49.448718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d72753da-bff2-4f05-b6ef-314f8a504b09 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:49.449884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d72753da-bff2-4f05-b6ef-314f8a504b09 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:49.464548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d72753da-bff2-4f05-b6ef-314f8a504b09 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:49.465951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d72753da-bff2-4f05-b6ef-314f8a504b09 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:49.467456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d72753da-bff2-4f05-b6ef-314f8a504b09 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:49.468383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d72753da-bff2-4f05-b6ef-314f8a504b09 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:49.679408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d72753da-bff2-4f05-b6ef-314f8a504b09 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:49.689338 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d72753da-bff2-4f05-b6ef-314f8a504b09 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.262435 Aug 04 14:45:49.690244 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3051/6097] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:49 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:49.922322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f203bdf-d8b5-40a6-9811-bd310f275773 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:49.923458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f203bdf-d8b5-40a6-9811-bd310f275773 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:49.938190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f203bdf-d8b5-40a6-9811-bd310f275773 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:49.939007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f203bdf-d8b5-40a6-9811-bd310f275773 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:49.940724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f203bdf-d8b5-40a6-9811-bd310f275773 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:49.941573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f203bdf-d8b5-40a6-9811-bd310f275773 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:50.196200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f203bdf-d8b5-40a6-9811-bd310f275773 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:50.211569 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f203bdf-d8b5-40a6-9811-bd310f275773 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 0.294475 Aug 04 14:45:50.213143 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3047/6098] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:49 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:50.716016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-063fe0c7-3b00-4520-9bc7-0102c6a6717a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:50.717457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-063fe0c7-3b00-4520-9bc7-0102c6a6717a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:50.726542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-063fe0c7-3b00-4520-9bc7-0102c6a6717a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:50.727613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-063fe0c7-3b00-4520-9bc7-0102c6a6717a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:50.731185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-063fe0c7-3b00-4520-9bc7-0102c6a6717a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:50.731832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-063fe0c7-3b00-4520-9bc7-0102c6a6717a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:50.981783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-063fe0c7-3b00-4520-9bc7-0102c6a6717a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:50.994081 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-063fe0c7-3b00-4520-9bc7-0102c6a6717a tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1691 microversion: 2.1 time: 0.282952 Aug 04 14:45:50.994965 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3052/6099] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:50 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1691 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:51.244239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-afe80fc0-ed13-4c90-b054-5fe3c4c91705 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:51.245107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-afe80fc0-ed13-4c90-b054-5fe3c4c91705 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:51.253709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afe80fc0-ed13-4c90-b054-5fe3c4c91705 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:51.254172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afe80fc0-ed13-4c90-b054-5fe3c4c91705 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:51.255137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afe80fc0-ed13-4c90-b054-5fe3c4c91705 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:51.255591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afe80fc0-ed13-4c90-b054-5fe3c4c91705 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:51.485372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-afe80fc0-ed13-4c90-b054-5fe3c4c91705 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:51.499918 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-afe80fc0-ed13-4c90-b054-5fe3c4c91705 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 0.258974 Aug 04 14:45:51.501088 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3048/6100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:51 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:52.033949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7912c784-3e30-4b1c-aaae-285644e04971 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:52.034889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7912c784-3e30-4b1c-aaae-285644e04971 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:52.038274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=38 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:52.047035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7912c784-3e30-4b1c-aaae-285644e04971 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:52.047500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7912c784-3e30-4b1c-aaae-285644e04971 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:52.048386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7912c784-3e30-4b1c-aaae-285644e04971 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:52.049382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7912c784-3e30-4b1c-aaae-285644e04971 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:52.271547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7912c784-3e30-4b1c-aaae-285644e04971 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:52.286406 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7912c784-3e30-4b1c-aaae-285644e04971 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1697 microversion: 2.1 time: 0.258129 Aug 04 14:45:52.287514 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3053/6101] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:52 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1697 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:52.535121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dd7bb36c-2feb-4373-9623-8413f48dd380 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:52.536116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dd7bb36c-2feb-4373-9623-8413f48dd380 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:52.545109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd7bb36c-2feb-4373-9623-8413f48dd380 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:52.553792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd7bb36c-2feb-4373-9623-8413f48dd380 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:52.556131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd7bb36c-2feb-4373-9623-8413f48dd380 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:52.556989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd7bb36c-2feb-4373-9623-8413f48dd380 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:52.761756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd7bb36c-2feb-4373-9623-8413f48dd380 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:52.771282 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dd7bb36c-2feb-4373-9623-8413f48dd380 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 0.240365 Aug 04 14:45:52.772049 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3049/6102] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:52 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:53.314740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2186e2a3-889a-4dc4-b537-02f4f7c76672 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:53.316244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2186e2a3-889a-4dc4-b537-02f4f7c76672 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:53.329041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2186e2a3-889a-4dc4-b537-02f4f7c76672 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:53.330021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2186e2a3-889a-4dc4-b537-02f4f7c76672 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:53.331589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2186e2a3-889a-4dc4-b537-02f4f7c76672 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:53.332509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2186e2a3-889a-4dc4-b537-02f4f7c76672 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:53.596296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2186e2a3-889a-4dc4-b537-02f4f7c76672 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:53.605663 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2186e2a3-889a-4dc4-b537-02f4f7c76672 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1697 microversion: 2.1 time: 0.298660 Aug 04 14:45:53.606911 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3054/6103] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:53 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1697 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:53.796943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-77ec3ba6-5030-44b2-b72b-fb296322111d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:53.798590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-77ec3ba6-5030-44b2-b72b-fb296322111d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:53.807314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77ec3ba6-5030-44b2-b72b-fb296322111d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:53.807950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77ec3ba6-5030-44b2-b72b-fb296322111d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:53.809439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77ec3ba6-5030-44b2-b72b-fb296322111d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:53.810080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77ec3ba6-5030-44b2-b72b-fb296322111d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:54.087987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-77ec3ba6-5030-44b2-b72b-fb296322111d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:54.097766 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-77ec3ba6-5030-44b2-b72b-fb296322111d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 0.308177 Aug 04 14:45:54.098729 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3050/6104] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:53 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:54.639448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1dea9a5e-8741-4086-99b6-b9901afd8ae5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:54.640510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1dea9a5e-8741-4086-99b6-b9901afd8ae5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:54.650891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1dea9a5e-8741-4086-99b6-b9901afd8ae5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:54.651691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1dea9a5e-8741-4086-99b6-b9901afd8ae5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:54.652714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1dea9a5e-8741-4086-99b6-b9901afd8ae5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:54.653989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1dea9a5e-8741-4086-99b6-b9901afd8ae5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:54.845753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1dea9a5e-8741-4086-99b6-b9901afd8ae5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:54.854950 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1dea9a5e-8741-4086-99b6-b9901afd8ae5 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1697 microversion: 2.1 time: 0.220282 Aug 04 14:45:54.856831 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3055/6105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:54 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1697 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:55.126082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f41eb1a1-be93-4dcd-afc7-dc825e7d2d96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:55.128246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f41eb1a1-be93-4dcd-afc7-dc825e7d2d96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:55.178803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f41eb1a1-be93-4dcd-afc7-dc825e7d2d96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:55.179483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f41eb1a1-be93-4dcd-afc7-dc825e7d2d96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:55.181022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f41eb1a1-be93-4dcd-afc7-dc825e7d2d96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:55.181835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f41eb1a1-be93-4dcd-afc7-dc825e7d2d96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:55.387587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f41eb1a1-be93-4dcd-afc7-dc825e7d2d96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:55.396680 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f41eb1a1-be93-4dcd-afc7-dc825e7d2d96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 0.277236 Aug 04 14:45:55.398814 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3051/6106] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:55 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:55.898008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4929a11a-415a-4bba-bcd1-c49326017ca2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:55.900939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4929a11a-415a-4bba-bcd1-c49326017ca2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:55.917995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4929a11a-415a-4bba-bcd1-c49326017ca2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:55.920460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4929a11a-415a-4bba-bcd1-c49326017ca2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:55.922466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4929a11a-415a-4bba-bcd1-c49326017ca2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:55.923629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4929a11a-415a-4bba-bcd1-c49326017ca2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:56.174277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4929a11a-415a-4bba-bcd1-c49326017ca2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:56.183148 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4929a11a-415a-4bba-bcd1-c49326017ca2 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1682 microversion: 2.1 time: 0.295295 Aug 04 14:45:56.184142 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3056/6107] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:55 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1682 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:56.457174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b6c3df63-517a-463c-a177-108641ff4fb3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:56.460601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b6c3df63-517a-463c-a177-108641ff4fb3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:56.479642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=42 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:45:56.482961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6c3df63-517a-463c-a177-108641ff4fb3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:56.495963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6c3df63-517a-463c-a177-108641ff4fb3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:56.495963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6c3df63-517a-463c-a177-108641ff4fb3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:56.495963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6c3df63-517a-463c-a177-108641ff4fb3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:56.723619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b6c3df63-517a-463c-a177-108641ff4fb3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:56.735687 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b6c3df63-517a-463c-a177-108641ff4fb3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 0.292849 Aug 04 14:45:56.737104 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3052/6108] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:56 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:56.960696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d1296e84-e93b-42b1-b8d4-e8d2c2c1444c req-02cb38fe-cfd5-4767-8c39-56cabf9a09d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70847cad-0a82-488c-8584-38c9519a3c88", "name": "network-vif-plugged", "status": "completed", "tag": "9a0df737-065d-424c-8c29-ca3561bb278f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:45:56.989334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d1296e84-e93b-42b1-b8d4-e8d2c2c1444c req-02cb38fe-cfd5-4767-8c39-56cabf9a09d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:56.989809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d1296e84-e93b-42b1-b8d4-e8d2c2c1444c req-02cb38fe-cfd5-4767-8c39-56cabf9a09d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:57.008221 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d1296e84-e93b-42b1-b8d4-e8d2c2c1444c req-02cb38fe-cfd5-4767-8c39-56cabf9a09d1 service nova] Creating event network-vif-plugged:9a0df737-065d-424c-8c29-ca3561bb278f for instance 70847cad-0a82-488c-8584-38c9519a3c88 on n-h1-844627-10 Aug 04 14:45:57.019444 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d1296e84-e93b-42b1-b8d4-e8d2c2c1444c req-02cb38fe-cfd5-4767-8c39-56cabf9a09d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062054 Aug 04 14:45:57.020671 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3057/6109] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:45:57.766000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3aebe4d2-6031-4329-8866-04b6fe3f19f6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:57.768214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3aebe4d2-6031-4329-8866-04b6fe3f19f6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:57.782134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3aebe4d2-6031-4329-8866-04b6fe3f19f6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:57.783187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3aebe4d2-6031-4329-8866-04b6fe3f19f6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:57.784894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3aebe4d2-6031-4329-8866-04b6fe3f19f6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:57.785780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3aebe4d2-6031-4329-8866-04b6fe3f19f6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:58.074314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3aebe4d2-6031-4329-8866-04b6fe3f19f6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:45:58.087644 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3aebe4d2-6031-4329-8866-04b6fe3f19f6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 0.330960 Aug 04 14:45:58.088357 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3053/6110] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:57 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:45:59.136776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a4df667a-9bce-4f52-8f9b-71b03294f7d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:45:59.149577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a4df667a-9bce-4f52-8f9b-71b03294f7d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:45:59.192893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4df667a-9bce-4f52-8f9b-71b03294f7d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:59.193576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4df667a-9bce-4f52-8f9b-71b03294f7d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:45:59.199041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4df667a-9bce-4f52-8f9b-71b03294f7d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:45:59.201376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4df667a-9bce-4f52-8f9b-71b03294f7d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:00.103283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a4df667a-9bce-4f52-8f9b-71b03294f7d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:00.132040 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a4df667a-9bce-4f52-8f9b-71b03294f7d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 1.002836 Aug 04 14:46:00.132040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3058/6111] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:45:59 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:01.065560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-535c084d-9d2c-4a52-aaf1-e8c0e288f15e tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:01.067802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-535c084d-9d2c-4a52-aaf1-e8c0e288f15e tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:01.072796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-20afd825-b01d-4b31-84e6-d02a83c5f436 req-9b8ccd7b-9aa5-4bdd-a754-4b9eb907a585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6217b413-f999-4dd0-b691-db71aef68afd", "tag": "8aaf8e0a-bf64-4bd7-8271-5451061f19a4"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:01.083929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-535c084d-9d2c-4a52-aaf1-e8c0e288f15e tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:01.084995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-535c084d-9d2c-4a52-aaf1-e8c0e288f15e tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:01.086529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-535c084d-9d2c-4a52-aaf1-e8c0e288f15e tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:01.087574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-535c084d-9d2c-4a52-aaf1-e8c0e288f15e tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:01.093747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-20afd825-b01d-4b31-84e6-d02a83c5f436 req-9b8ccd7b-9aa5-4bdd-a754-4b9eb907a585 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:01.095217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-20afd825-b01d-4b31-84e6-d02a83c5f436 req-9b8ccd7b-9aa5-4bdd-a754-4b9eb907a585 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:01.135474 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-20afd825-b01d-4b31-84e6-d02a83c5f436 req-9b8ccd7b-9aa5-4bdd-a754-4b9eb907a585 service nova] Creating event network-changed:8aaf8e0a-bf64-4bd7-8271-5451061f19a4 for instance 6217b413-f999-4dd0-b691-db71aef68afd on n-h2-844627-10 Aug 04 14:46:01.152192 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-20afd825-b01d-4b31-84e6-d02a83c5f436 req-9b8ccd7b-9aa5-4bdd-a754-4b9eb907a585 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087153 Aug 04 14:46:01.155982 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3059/6112] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:46:01.170465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-535c084d-9d2c-4a52-aaf1-e8c0e288f15e tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:46:01.180950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0da0b876-8d5b-47e6-b6b1-796872cd0b09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:01.181757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0da0b876-8d5b-47e6-b6b1-796872cd0b09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:01.200139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0da0b876-8d5b-47e6-b6b1-796872cd0b09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:01.205019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0da0b876-8d5b-47e6-b6b1-796872cd0b09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:01.209502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0da0b876-8d5b-47e6-b6b1-796872cd0b09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:01.212576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0da0b876-8d5b-47e6-b6b1-796872cd0b09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:01.452166 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-535c084d-9d2c-4a52-aaf1-e8c0e288f15e tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "DELETE /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 204 len: 0 microversion: 2.1 time: 0.391260 Aug 04 14:46:01.453440 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3054/6113] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:46:01 2022] DELETE /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:46:01.467027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aba33cd0-3be9-4dbb-9798-14c29d4e7dd3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:01.467792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aba33cd0-3be9-4dbb-9798-14c29d4e7dd3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:01.476047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aba33cd0-3be9-4dbb-9798-14c29d4e7dd3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:01.476635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aba33cd0-3be9-4dbb-9798-14c29d4e7dd3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:01.477479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aba33cd0-3be9-4dbb-9798-14c29d4e7dd3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:01.477935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aba33cd0-3be9-4dbb-9798-14c29d4e7dd3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:01.886750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0da0b876-8d5b-47e6-b6b1-796872cd0b09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:01.893781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aba33cd0-3be9-4dbb-9798-14c29d4e7dd3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:01.912497 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aba33cd0-3be9-4dbb-9798-14c29d4e7dd3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1584 microversion: 2.1 time: 0.451469 Aug 04 14:46:01.913659 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3055/6114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:01 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1584 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:01.966257 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0da0b876-8d5b-47e6-b6b1-796872cd0b09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 0.779143 Aug 04 14:46:01.968022 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3060/6115] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:01 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:46:02.093455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ac1f044d-8225-4549-a889-73d3c7e2623e req-308e4e6b-f570-493b-9661-5cbb69069ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62838ec-0236-48f5-8a08-b84d70f001ba", "name": "network-vif-plugged", "status": "completed", "tag": "cbfc7cc4-44b9-4534-83c2-ae30e93dec28"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:02.142362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ac1f044d-8225-4549-a889-73d3c7e2623e req-308e4e6b-f570-493b-9661-5cbb69069ae6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:02.143230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ac1f044d-8225-4549-a889-73d3c7e2623e req-308e4e6b-f570-493b-9661-5cbb69069ae6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:02.186978 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ac1f044d-8225-4549-a889-73d3c7e2623e req-308e4e6b-f570-493b-9661-5cbb69069ae6 service nova] Creating event network-vif-plugged:cbfc7cc4-44b9-4534-83c2-ae30e93dec28 for instance e62838ec-0236-48f5-8a08-b84d70f001ba on n-h1-844627-10 Aug 04 14:46:02.202214 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ac1f044d-8225-4549-a889-73d3c7e2623e req-308e4e6b-f570-493b-9661-5cbb69069ae6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115367 Aug 04 14:46:02.204306 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3056/6116] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:02.955945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-22f87102-3530-4f05-a961-9fb86436ddb3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:02.956512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-22f87102-3530-4f05-a961-9fb86436ddb3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:02.976181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22f87102-3530-4f05-a961-9fb86436ddb3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:02.976783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22f87102-3530-4f05-a961-9fb86436ddb3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:02.977503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22f87102-3530-4f05-a961-9fb86436ddb3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:02.978115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-22f87102-3530-4f05-a961-9fb86436ddb3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:03.032467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61575840-eb4e-4f73-8805-5412556253f1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:03.033151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61575840-eb4e-4f73-8805-5412556253f1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:03.069954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61575840-eb4e-4f73-8805-5412556253f1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:03.080805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61575840-eb4e-4f73-8805-5412556253f1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:03.082470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61575840-eb4e-4f73-8805-5412556253f1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:03.083545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61575840-eb4e-4f73-8805-5412556253f1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:03.912479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-22f87102-3530-4f05-a961-9fb86436ddb3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:03.927760 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-22f87102-3530-4f05-a961-9fb86436ddb3 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1584 microversion: 2.1 time: 0.975623 Aug 04 14:46:03.933667 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3061/6117] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:02 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1584 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:04.137637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61575840-eb4e-4f73-8805-5412556253f1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:04.206813 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61575840-eb4e-4f73-8805-5412556253f1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1202 microversion: 2.1 time: 1.199936 Aug 04 14:46:04.222725 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3057/6118] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:03 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1202 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:04.975236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b92b1e3-d9e9-404e-b7ee-3e0b19116c40 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:04.979505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b92b1e3-d9e9-404e-b7ee-3e0b19116c40 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:04.999365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b92b1e3-d9e9-404e-b7ee-3e0b19116c40 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:05.001066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b92b1e3-d9e9-404e-b7ee-3e0b19116c40 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:05.002764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b92b1e3-d9e9-404e-b7ee-3e0b19116c40 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:05.004349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b92b1e3-d9e9-404e-b7ee-3e0b19116c40 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:05.274116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0a8148b5-219e-4817-945c-840db7aea759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:05.300501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0a8148b5-219e-4817-945c-840db7aea759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:05.322728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a8148b5-219e-4817-945c-840db7aea759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:05.332340 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a8148b5-219e-4817-945c-840db7aea759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:05.335350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a8148b5-219e-4817-945c-840db7aea759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:05.338910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a8148b5-219e-4817-945c-840db7aea759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:05.364943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b92b1e3-d9e9-404e-b7ee-3e0b19116c40 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:05.408189 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b92b1e3-d9e9-404e-b7ee-3e0b19116c40 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1397 microversion: 2.1 time: 0.442876 Aug 04 14:46:05.427495 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3062/6119] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:04 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1397 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:05.536324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-69f73ca7-a447-4aff-8b09-dcc01edb7021 req-0b35f523-8334-4eda-af01-f5bebeb5c5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6217b413-f999-4dd0-b691-db71aef68afd", "name": "network-vif-deleted", "tag": "8aaf8e0a-bf64-4bd7-8271-5451061f19a4"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:05.581790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-69f73ca7-a447-4aff-8b09-dcc01edb7021 req-0b35f523-8334-4eda-af01-f5bebeb5c5e6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:05.586256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-69f73ca7-a447-4aff-8b09-dcc01edb7021 req-0b35f523-8334-4eda-af01-f5bebeb5c5e6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:05.603163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:46:05.652349 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-69f73ca7-a447-4aff-8b09-dcc01edb7021 req-0b35f523-8334-4eda-af01-f5bebeb5c5e6 service nova] Creating event network-vif-deleted:8aaf8e0a-bf64-4bd7-8271-5451061f19a4 for instance 6217b413-f999-4dd0-b691-db71aef68afd on n-h2-844627-10 Aug 04 14:46:05.666486 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-69f73ca7-a447-4aff-8b09-dcc01edb7021 req-0b35f523-8334-4eda-af01-f5bebeb5c5e6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138187 Aug 04 14:46:05.677886 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3063/6120] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:46:05.797513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0a8148b5-219e-4817-945c-840db7aea759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:05.817716 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0a8148b5-219e-4817-945c-840db7aea759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1388 microversion: 2.1 time: 0.564364 Aug 04 14:46:05.819314 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3058/6121] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:05 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1388 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:05.863001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4091977f-3b7d-428a-8acd-6e8770304eaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:05.865831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4091977f-3b7d-428a-8acd-6e8770304eaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:05.881233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4091977f-3b7d-428a-8acd-6e8770304eaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:05.881686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4091977f-3b7d-428a-8acd-6e8770304eaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:05.882766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4091977f-3b7d-428a-8acd-6e8770304eaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:05.883541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4091977f-3b7d-428a-8acd-6e8770304eaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:06.223690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4091977f-3b7d-428a-8acd-6e8770304eaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:06.255450 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4091977f-3b7d-428a-8acd-6e8770304eaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1388 microversion: 2.1 time: 0.390832 Aug 04 14:46:06.255450 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3064/6122] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:05 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1388 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:06.298834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dd59845f-c326-4b81-8571-39426941726a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:06.299587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dd59845f-c326-4b81-8571-39426941726a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:06.307695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd59845f-c326-4b81-8571-39426941726a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:06.308132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd59845f-c326-4b81-8571-39426941726a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:06.309032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd59845f-c326-4b81-8571-39426941726a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:06.309489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dd59845f-c326-4b81-8571-39426941726a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:06.464673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b266a36-e52d-4b25-8af3-4a90142c29a5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:06.466173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b266a36-e52d-4b25-8af3-4a90142c29a5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:06.480395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b266a36-e52d-4b25-8af3-4a90142c29a5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:06.481710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b266a36-e52d-4b25-8af3-4a90142c29a5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:06.490533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b266a36-e52d-4b25-8af3-4a90142c29a5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:06.491316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b266a36-e52d-4b25-8af3-4a90142c29a5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:06.759972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b266a36-e52d-4b25-8af3-4a90142c29a5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:06.782205 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b266a36-e52d-4b25-8af3-4a90142c29a5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1229 microversion: 2.1 time: 0.310008 Aug 04 14:46:06.782878 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3065/6123] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:06 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1229 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:46:06.909895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dd59845f-c326-4b81-8571-39426941726a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:06.914663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:46:06.951390 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dd59845f-c326-4b81-8571-39426941726a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1388 microversion: 2.1 time: 0.670908 Aug 04 14:46:06.959174 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3059/6124] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:06 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1388 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:46:07.163813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bbffd7a6-2f08-4c9b-bbe4-b0488c1ce996 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:07.164400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bbffd7a6-2f08-4c9b-bbe4-b0488c1ce996 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:07.175208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbffd7a6-2f08-4c9b-bbe4-b0488c1ce996 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:07.176037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbffd7a6-2f08-4c9b-bbe4-b0488c1ce996 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:07.177859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbffd7a6-2f08-4c9b-bbe4-b0488c1ce996 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:07.178626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bbffd7a6-2f08-4c9b-bbe4-b0488c1ce996 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:07.243706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bbffd7a6-2f08-4c9b-bbe4-b0488c1ce996 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:46:07.470480 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bbffd7a6-2f08-4c9b-bbe4-b0488c1ce996 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 204 len: 0 microversion: 2.1 time: 0.310126 Aug 04 14:46:07.477699 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3066/6125] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:46:07 2022] DELETE /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:46:07.481773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-645c5cad-a05c-4fd5-b181-d0d773101399 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:07.485823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-645c5cad-a05c-4fd5-b181-d0d773101399 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:07.514151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0edc7060-a06a-4ab4-8b12-81699ed33c12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:07.517648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0edc7060-a06a-4ab4-8b12-81699ed33c12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:07.529550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0edc7060-a06a-4ab4-8b12-81699ed33c12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:07.530395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-645c5cad-a05c-4fd5-b181-d0d773101399 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:07.531306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0edc7060-a06a-4ab4-8b12-81699ed33c12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:07.531515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-645c5cad-a05c-4fd5-b181-d0d773101399 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:07.533286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0edc7060-a06a-4ab4-8b12-81699ed33c12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:07.534359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0edc7060-a06a-4ab4-8b12-81699ed33c12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:07.537559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-645c5cad-a05c-4fd5-b181-d0d773101399 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:07.539183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-645c5cad-a05c-4fd5-b181-d0d773101399 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:07.742010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-645c5cad-a05c-4fd5-b181-d0d773101399 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lazy-loading 'services' on Instance uuid 50dad654-a078-43d3-a48e-bfcebc3dfc8c {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:46:07.890281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0edc7060-a06a-4ab4-8b12-81699ed33c12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:07.907507 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0edc7060-a06a-4ab4-8b12-81699ed33c12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1394 microversion: 2.1 time: 0.427229 Aug 04 14:46:07.908900 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3067/6126] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:07 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1394 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:07.921421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6063b1a3-95ec-4f14-9d8d-b45c94d79ce5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:07.927373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6063b1a3-95ec-4f14-9d8d-b45c94d79ce5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:07.947100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6063b1a3-95ec-4f14-9d8d-b45c94d79ce5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:07.948156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6063b1a3-95ec-4f14-9d8d-b45c94d79ce5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:07.953954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6063b1a3-95ec-4f14-9d8d-b45c94d79ce5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:07.955002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6063b1a3-95ec-4f14-9d8d-b45c94d79ce5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:08.022417 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-645c5cad-a05c-4fd5-b181-d0d773101399 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "DELETE /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c/os-volume_attachments/5decbccb-f198-48ed-80c7-0ae5a155679d" status: 202 len: 0 microversion: 2.1 time: 0.560443 Aug 04 14:46:08.028571 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3060/6127] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 14:46:07 2022] DELETE /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c/os-volume_attachments/5decbccb-f198-48ed-80c7-0ae5a155679d => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:46:08.089960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6063b1a3-95ec-4f14-9d8d-b45c94d79ce5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:08.105027 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6063b1a3-95ec-4f14-9d8d-b45c94d79ce5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1229 microversion: 2.1 time: 0.192066 Aug 04 14:46:08.106027 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3068/6128] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:07 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1229 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:08.939994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f5d8307-3cc9-41f0-9347-b27dc68bdcbe tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:08.941122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8f5d8307-3cc9-41f0-9347-b27dc68bdcbe tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:08.952563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f5d8307-3cc9-41f0-9347-b27dc68bdcbe tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:08.953196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f5d8307-3cc9-41f0-9347-b27dc68bdcbe tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:08.954551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f5d8307-3cc9-41f0-9347-b27dc68bdcbe tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:08.955097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f5d8307-3cc9-41f0-9347-b27dc68bdcbe tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:09.145546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8f5d8307-3cc9-41f0-9347-b27dc68bdcbe tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:09.149478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-438b4677-0cb0-4b1e-9858-32783e5029f5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:09.151821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-438b4677-0cb0-4b1e-9858-32783e5029f5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:09.175674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-438b4677-0cb0-4b1e-9858-32783e5029f5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:09.175951 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f5d8307-3cc9-41f0-9347-b27dc68bdcbe tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1394 microversion: 2.1 time: 0.243085 Aug 04 14:46:09.176801 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3061/6129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:08 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1394 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:09.185730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-438b4677-0cb0-4b1e-9858-32783e5029f5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:09.187279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-438b4677-0cb0-4b1e-9858-32783e5029f5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:09.188105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-438b4677-0cb0-4b1e-9858-32783e5029f5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:09.301733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-438b4677-0cb0-4b1e-9858-32783e5029f5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:09.311154 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-438b4677-0cb0-4b1e-9858-32783e5029f5 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1229 microversion: 2.1 time: 0.170512 Aug 04 14:46:09.312473 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3069/6130] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:09 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1229 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:10.230173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d88ee73e-5b45-406f-a6a4-dd89a6e2bdf3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:10.232519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d88ee73e-5b45-406f-a6a4-dd89a6e2bdf3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:10.256699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88ee73e-5b45-406f-a6a4-dd89a6e2bdf3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:10.258033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88ee73e-5b45-406f-a6a4-dd89a6e2bdf3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:10.259682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88ee73e-5b45-406f-a6a4-dd89a6e2bdf3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:10.260746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88ee73e-5b45-406f-a6a4-dd89a6e2bdf3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:10.337322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a43eb03d-c5ba-4c79-b1d3-a8cb5cc0f253 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:10.339940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a43eb03d-c5ba-4c79-b1d3-a8cb5cc0f253 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:10.359245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a43eb03d-c5ba-4c79-b1d3-a8cb5cc0f253 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:10.360604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a43eb03d-c5ba-4c79-b1d3-a8cb5cc0f253 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:10.362638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a43eb03d-c5ba-4c79-b1d3-a8cb5cc0f253 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:10.363893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a43eb03d-c5ba-4c79-b1d3-a8cb5cc0f253 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:10.532667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a43eb03d-c5ba-4c79-b1d3-a8cb5cc0f253 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:10.544144 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a43eb03d-c5ba-4c79-b1d3-a8cb5cc0f253 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1229 microversion: 2.1 time: 0.214030 Aug 04 14:46:10.545466 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3070/6131] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:10 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1229 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:10.640396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d88ee73e-5b45-406f-a6a4-dd89a6e2bdf3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:10.661033 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d88ee73e-5b45-406f-a6a4-dd89a6e2bdf3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1394 microversion: 2.1 time: 0.448732 Aug 04 14:46:10.677893 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3062/6132] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:10 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1394 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:10.782481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-06208195-2f8c-4bd5-a794-be27e0ae6b5b req-7a97cc18-80c8-4266-9f8c-e7c09f344cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e62838ec-0236-48f5-8a08-b84d70f001ba", "name": "network-vif-deleted", "tag": "cbfc7cc4-44b9-4534-83c2-ae30e93dec28"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:10.802953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-06208195-2f8c-4bd5-a794-be27e0ae6b5b req-7a97cc18-80c8-4266-9f8c-e7c09f344cde service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:10.803412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-06208195-2f8c-4bd5-a794-be27e0ae6b5b req-7a97cc18-80c8-4266-9f8c-e7c09f344cde service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:10.820320 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-06208195-2f8c-4bd5-a794-be27e0ae6b5b req-7a97cc18-80c8-4266-9f8c-e7c09f344cde service nova] Creating event network-vif-deleted:cbfc7cc4-44b9-4534-83c2-ae30e93dec28 for instance e62838ec-0236-48f5-8a08-b84d70f001ba on n-h1-844627-10 Aug 04 14:46:10.836963 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-06208195-2f8c-4bd5-a794-be27e0ae6b5b req-7a97cc18-80c8-4266-9f8c-e7c09f344cde service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058133 Aug 04 14:46:10.844262 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3071/6133] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:11.580497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f48fe898-53a7-4420-b317-4062bfa39151 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:11.581881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f48fe898-53a7-4420-b317-4062bfa39151 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:11.593506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f48fe898-53a7-4420-b317-4062bfa39151 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:11.594362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f48fe898-53a7-4420-b317-4062bfa39151 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:11.595424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f48fe898-53a7-4420-b317-4062bfa39151 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:11.596058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f48fe898-53a7-4420-b317-4062bfa39151 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:11.684105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f48fe898-53a7-4420-b317-4062bfa39151 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:11.693374 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f48fe898-53a7-4420-b317-4062bfa39151 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1229 microversion: 2.1 time: 0.118756 Aug 04 14:46:11.693968 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3063/6134] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:11 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:46:11.723034 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b2e72eb-75b8-4816-a0e2-919424f59398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:11.723807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b2e72eb-75b8-4816-a0e2-919424f59398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:11.731741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b2e72eb-75b8-4816-a0e2-919424f59398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:11.732204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b2e72eb-75b8-4816-a0e2-919424f59398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:11.733270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b2e72eb-75b8-4816-a0e2-919424f59398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:11.733770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b2e72eb-75b8-4816-a0e2-919424f59398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:11.805909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b2e72eb-75b8-4816-a0e2-919424f59398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:11.814496 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b2e72eb-75b8-4816-a0e2-919424f59398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.097350 Aug 04 14:46:11.815355 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3072/6135] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:11 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:46:12.718225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:12.719332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:12.729498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:12.730139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:12.731762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:12.732478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:12.797324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:12.798433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:12.799986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lazy-loading 'fault' on Instance uuid 6217b413-f999-4dd0-b691-db71aef68afd {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:46:12.845547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a7fa3c5c-e2e1-4195-ab53-e4528580768e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:12.847568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a7fa3c5c-e2e1-4195-ab53-e4528580768e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:12.867669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7fa3c5c-e2e1-4195-ab53-e4528580768e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:12.868476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7fa3c5c-e2e1-4195-ab53-e4528580768e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:12.869953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7fa3c5c-e2e1-4195-ab53-e4528580768e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:12.870996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a7fa3c5c-e2e1-4195-ab53-e4528580768e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:12.912230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3118db37e9dd47788713b7db31d6dfdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793cd274ed9493b862d097e3659465c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:12.939941 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0a5f5e84-2249-4e09-9c48-5530c0c1fe1c tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 200 len: 1234 microversion: 2.1 time: 0.225592 Aug 04 14:46:12.956963 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3064/6136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:12 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 1234 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:13.057356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a7fa3c5c-e2e1-4195-ab53-e4528580768e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:13.067503 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a7fa3c5c-e2e1-4195-ab53-e4528580768e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.234295 Aug 04 14:46:13.068127 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3073/6137] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:12 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:46:13.984750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:13.985597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] [instance: 6217b413-f999-4dd0-b691-db71aef68afd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:13.993297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:13.993765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:13.994566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:13.995015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:14.012398 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] HTTP exception thrown: Instance 6217b413-f999-4dd0-b691-db71aef68afd could not be found. Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Request method failure captured: Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd HTTP/1.1 Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69nrinxdZNNEmoHWk8ECvDxM3VfwwwMqV1q9BZ8GUS5sm9Z1e85V4QGzhjcbOvWawpYyYHCWO82IA62ca9A9X6euqwhbFa-sGFxDXCf_C-knPzQwcM6zr_mesOlCzW0GzXRD87akVa_Ob-jz8jNJm8CLUNKfYdpzhJDoKQrqJuf3BsA Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 4793cd274ed9493b862d097e3659465c Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestVolumeBackupRestore-1646357258 Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4793cd274ed9493b862d097e3659465c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4793cd274ed9493b862d097e3659465c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4793cd274ed9493b862d097e3659465c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4793cd274ed9493b862d097e3659465c"}]}] Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestVolumeBackupRestore-1646357258 Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 4793cd274ed9493b862d097e3659465c Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1646357258 Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestVolumeBackupRestore-1646357258-project Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 3118db37e9dd47788713b7db31d6dfdf Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestVolumeBackupRestore-1646357258-project Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 6217b413-f999-4dd0-b691-db71aef68afd could not be found. Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '6217b413-f999-4dd0-b691-db71aef68afd'} Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6217b413-f999-4dd0-b691-db71aef68afd could not be found. Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6217b413-f999-4dd0-b691-db71aef68afd could not be found. Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:14.014705 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6217b413-f999-4dd0-b691-db71aef68afd could not be found. Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Returning 404 to user: Instance 6217b413-f999-4dd0-b691-db71aef68afd could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ec70000-0cab-4346-adf3-c12b470823b7 tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd" status: 404 len: 111 microversion: 2.1 time: 0.036355 Aug 04 14:46:14.024666 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3065/6138] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:13 2022] GET /compute/v2.1/servers/6217b413-f999-4dd0-b691-db71aef68afd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:46:14.104519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4061f3a2-0122-4a0b-be18-b527143798f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:14.106796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4061f3a2-0122-4a0b-be18-b527143798f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:14.130745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4061f3a2-0122-4a0b-be18-b527143798f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:14.131937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4061f3a2-0122-4a0b-be18-b527143798f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:14.135498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4061f3a2-0122-4a0b-be18-b527143798f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:14.136726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4061f3a2-0122-4a0b-be18-b527143798f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:14.301988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4061f3a2-0122-4a0b-be18-b527143798f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:14.319486 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4061f3a2-0122-4a0b-be18-b527143798f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.218430 Aug 04 14:46:14.325610 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3074/6139] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:14 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:46:14.361684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f1df83b-5752-4ca2-a5e9-5f29d9c6e38f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] Calling method '.version_select at 0x7f47054741f0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:14.396636 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f1df83b-5752-4ca2-a5e9-5f29d9c6e38f tempest-TestVolumeBackupRestore-1646357258 tempest-TestVolumeBackupRestore-1646357258-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-110859714" status: 202 len: 0 microversion: 2.1 time: 0.036120 Aug 04 14:46:14.399760 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3066/6140] 10.222.0.66 () {58 vars in 1266 bytes} [Thu Aug 4 14:46:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-110859714 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:46:15.343425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-03aa27a3-39fc-4e4e-bf4a-f65288698d43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:15.344551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03aa27a3-39fc-4e4e-bf4a-f65288698d43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:15.357966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03aa27a3-39fc-4e4e-bf4a-f65288698d43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:15.358731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03aa27a3-39fc-4e4e-bf4a-f65288698d43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:15.360189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03aa27a3-39fc-4e4e-bf4a-f65288698d43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:15.361018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03aa27a3-39fc-4e4e-bf4a-f65288698d43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:15.481432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-03aa27a3-39fc-4e4e-bf4a-f65288698d43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:15.494882 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-03aa27a3-39fc-4e4e-bf4a-f65288698d43 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.155854 Aug 04 14:46:15.495937 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3075/6141] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:15 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:16.535079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-650fbb3a-bd2f-4f19-851f-31c6cf36b76d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:16.537519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-650fbb3a-bd2f-4f19-851f-31c6cf36b76d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:16.552471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-650fbb3a-bd2f-4f19-851f-31c6cf36b76d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:16.553654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-650fbb3a-bd2f-4f19-851f-31c6cf36b76d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:16.555718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-650fbb3a-bd2f-4f19-851f-31c6cf36b76d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:16.558268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-650fbb3a-bd2f-4f19-851f-31c6cf36b76d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:16.786954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-650fbb3a-bd2f-4f19-851f-31c6cf36b76d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:16.811334 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-650fbb3a-bd2f-4f19-851f-31c6cf36b76d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.284323 Aug 04 14:46:16.827493 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3067/6142] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:16 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:17.854614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5b9d23d8-2a02-47f9-9bf7-e1b9aa8dc68f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:17.855806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b9d23d8-2a02-47f9-9bf7-e1b9aa8dc68f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:17.868239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b9d23d8-2a02-47f9-9bf7-e1b9aa8dc68f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:17.869422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b9d23d8-2a02-47f9-9bf7-e1b9aa8dc68f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:17.870680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b9d23d8-2a02-47f9-9bf7-e1b9aa8dc68f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:17.871497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b9d23d8-2a02-47f9-9bf7-e1b9aa8dc68f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:18.032176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5b9d23d8-2a02-47f9-9bf7-e1b9aa8dc68f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:18.049157 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5b9d23d8-2a02-47f9-9bf7-e1b9aa8dc68f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.198285 Aug 04 14:46:18.051027 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3076/6143] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:17 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:46:18.214300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e6acd9e-7b28-4786-9d3f-57630a93a9c8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:18.215149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e6acd9e-7b28-4786-9d3f-57630a93a9c8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:18.242160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e6acd9e-7b28-4786-9d3f-57630a93a9c8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:18.245091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e6acd9e-7b28-4786-9d3f-57630a93a9c8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:18.250485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e6acd9e-7b28-4786-9d3f-57630a93a9c8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:18.253901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e6acd9e-7b28-4786-9d3f-57630a93a9c8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:18.332681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e6acd9e-7b28-4786-9d3f-57630a93a9c8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:46:18.478193 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e6acd9e-7b28-4786-9d3f-57630a93a9c8 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "DELETE /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 204 len: 0 microversion: 2.1 time: 0.267417 Aug 04 14:46:18.484242 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3068/6144] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:46:18 2022] DELETE /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:46:18.495279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9312cba0-eb20-462d-891c-f1d8d11bd5e7 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:18.497649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9312cba0-eb20-462d-891c-f1d8d11bd5e7 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:18.529080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9312cba0-eb20-462d-891c-f1d8d11bd5e7 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:18.530513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9312cba0-eb20-462d-891c-f1d8d11bd5e7 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:18.532634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9312cba0-eb20-462d-891c-f1d8d11bd5e7 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:18.535626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9312cba0-eb20-462d-891c-f1d8d11bd5e7 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:19.091569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c57493d-69c6-44f9-97aa-07e304f76482 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:19.106290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c57493d-69c6-44f9-97aa-07e304f76482 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:19.188806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c57493d-69c6-44f9-97aa-07e304f76482 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:19.189712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c57493d-69c6-44f9-97aa-07e304f76482 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:19.191264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c57493d-69c6-44f9-97aa-07e304f76482 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:19.194751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c57493d-69c6-44f9-97aa-07e304f76482 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:19.226627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9312cba0-eb20-462d-891c-f1d8d11bd5e7 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:19.291867 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9312cba0-eb20-462d-891c-f1d8d11bd5e7 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1469 microversion: 2.1 time: 0.804703 Aug 04 14:46:19.292705 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3077/6145] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:18 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1469 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:19.453162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2c57493d-69c6-44f9-97aa-07e304f76482 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:19.494847 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c57493d-69c6-44f9-97aa-07e304f76482 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.414832 Aug 04 14:46:19.501146 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3069/6146] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:19 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:20.344246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-93068178-55c3-42a3-afd6-617da4af51c4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:20.348037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-93068178-55c3-42a3-afd6-617da4af51c4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:20.372535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93068178-55c3-42a3-afd6-617da4af51c4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:20.373565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93068178-55c3-42a3-afd6-617da4af51c4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:20.381475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93068178-55c3-42a3-afd6-617da4af51c4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:20.382876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93068178-55c3-42a3-afd6-617da4af51c4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:20.553618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a9406bf2-a22f-41bf-a7ec-596fc0927472 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:20.557667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a9406bf2-a22f-41bf-a7ec-596fc0927472 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:20.594384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9406bf2-a22f-41bf-a7ec-596fc0927472 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:20.596022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9406bf2-a22f-41bf-a7ec-596fc0927472 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:20.598246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9406bf2-a22f-41bf-a7ec-596fc0927472 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:20.599295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9406bf2-a22f-41bf-a7ec-596fc0927472 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:20.938133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a9406bf2-a22f-41bf-a7ec-596fc0927472 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:20.973043 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a9406bf2-a22f-41bf-a7ec-596fc0927472 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.442929 Aug 04 14:46:20.974098 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3070/6147] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:20 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:21.166005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-93068178-55c3-42a3-afd6-617da4af51c4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:21.190533 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-93068178-55c3-42a3-afd6-617da4af51c4 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1469 microversion: 2.1 time: 0.853398 Aug 04 14:46:21.192860 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3078/6148] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:20 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1469 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:22.011237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-14414ceb-6cb4-4e86-be03-327a3a92e832 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:22.012774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-14414ceb-6cb4-4e86-be03-327a3a92e832 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:22.033891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14414ceb-6cb4-4e86-be03-327a3a92e832 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:22.034574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14414ceb-6cb4-4e86-be03-327a3a92e832 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:22.035552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14414ceb-6cb4-4e86-be03-327a3a92e832 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:22.041498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14414ceb-6cb4-4e86-be03-327a3a92e832 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:22.134132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-1dc4e69b-8db5-42ad-8986-62182804d2c5 req-20319e57-6872-4366-9969-b6ac3840a04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50dad654-a078-43d3-a48e-bfcebc3dfc8c", "name": "network-vif-deleted", "tag": "d8d1fadc-cf68-4c58-9baf-762fb2a85842"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:22.176346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:46:22.191932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1dc4e69b-8db5-42ad-8986-62182804d2c5 req-20319e57-6872-4366-9969-b6ac3840a04c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:22.198129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-1dc4e69b-8db5-42ad-8986-62182804d2c5 req-20319e57-6872-4366-9969-b6ac3840a04c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:22.285643 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-1dc4e69b-8db5-42ad-8986-62182804d2c5 req-20319e57-6872-4366-9969-b6ac3840a04c service nova] Creating event network-vif-deleted:d8d1fadc-cf68-4c58-9baf-762fb2a85842 for instance 50dad654-a078-43d3-a48e-bfcebc3dfc8c on n-h1-844627-10 Aug 04 14:46:22.303200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-14414ceb-6cb4-4e86-be03-327a3a92e832 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:22.313386 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-1dc4e69b-8db5-42ad-8986-62182804d2c5 req-20319e57-6872-4366-9969-b6ac3840a04c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194416 Aug 04 14:46:22.323719 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3079/6149] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:46:22.340785 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-14414ceb-6cb4-4e86-be03-327a3a92e832 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.333910 Aug 04 14:46:22.347166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:22.348856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:22.358973 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3071/6150] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:22 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:22.376685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:22.377760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:22.387669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:22.389219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:22.413767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:46:22.568560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:22.572918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:22.593041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lazy-loading 'fault' on Instance uuid 50dad654-a078-43d3-a48e-bfcebc3dfc8c {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:46:22.733718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e267e72ab5834ca8bc3486da219c89c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e229f9e02546159ecd063ede351ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:22.764115 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0eed4b13-a0d2-41f2-a5ec-41060ee56d93 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 200 len: 1304 microversion: 2.1 time: 0.432230 Aug 04 14:46:22.765452 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3080/6151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:22 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 1304 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:23.367488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-24111891-a5c4-4b08-82d1-d5a2ea46ccb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:23.368673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-24111891-a5c4-4b08-82d1-d5a2ea46ccb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:23.427737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24111891-a5c4-4b08-82d1-d5a2ea46ccb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:23.428831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24111891-a5c4-4b08-82d1-d5a2ea46ccb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:23.430147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24111891-a5c4-4b08-82d1-d5a2ea46ccb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:23.430940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24111891-a5c4-4b08-82d1-d5a2ea46ccb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:23.709636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-24111891-a5c4-4b08-82d1-d5a2ea46ccb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:23.741414 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-24111891-a5c4-4b08-82d1-d5a2ea46ccb7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.380811 Aug 04 14:46:23.744332 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3072/6152] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:23 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:23.813062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:23.813695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] [instance: 50dad654-a078-43d3-a48e-bfcebc3dfc8c] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:23.836343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:23.842222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:23.843473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:23.844707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:23.912604 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] HTTP exception thrown: Instance 50dad654-a078-43d3-a48e-bfcebc3dfc8c could not be found. Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Request method failure captured: Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c HTTP/1.1 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69sY6_S-_cW2BJcXaQ065_n5butS-gtDVXl6tEN1YIu-oJN3F6E4C9UbAjYjTl3an_IKsZGN34ook1geWjGfVf_5gijKGnXep76e3sxMUq4nHnzekooUKENusLqDZVcHfiJ9npfANTkcJ79ir2vvqZNTZBELUIz4cDSsMcY4ID92ypg Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: b5e229f9e02546159ecd063ede351ac6 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-VolumesBackupsTest-1860946076 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b5e229f9e02546159ecd063ede351ac6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b5e229f9e02546159ecd063ede351ac6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b5e229f9e02546159ecd063ede351ac6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b5e229f9e02546159ecd063ede351ac6"}]}] Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-VolumesBackupsTest-1860946076 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: b5e229f9e02546159ecd063ede351ac6 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-VolumesBackupsTest-1860946076 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-VolumesBackupsTest-1860946076-project Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: e267e72ab5834ca8bc3486da219c89c2 Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-VolumesBackupsTest-1860946076-project Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 50dad654-a078-43d3-a48e-bfcebc3dfc8c could not be found. Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '50dad654-a078-43d3-a48e-bfcebc3dfc8c'} Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50dad654-a078-43d3-a48e-bfcebc3dfc8c could not be found. Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50dad654-a078-43d3-a48e-bfcebc3dfc8c could not be found. Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:23.919272 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:23.930521 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:23.930521 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:23.930521 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:23.930521 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:46:23.930521 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:46:23.930521 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50dad654-a078-43d3-a48e-bfcebc3dfc8c could not be found. Aug 04 14:46:23.930521 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:23.936782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] Returning 404 to user: Instance 50dad654-a078-43d3-a48e-bfcebc3dfc8c could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:46:23.938073 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cf94388c-86ae-4968-bfa9-75cb91ec5b25 tempest-VolumesBackupsTest-1860946076 tempest-VolumesBackupsTest-1860946076-project] 10.222.0.66 "GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c" status: 404 len: 111 microversion: 2.1 time: 0.131574 Aug 04 14:46:23.939386 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3081/6153] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:23 2022] GET /compute/v2.1/servers/50dad654-a078-43d3-a48e-bfcebc3dfc8c => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:46:24.781458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-25829689-a983-4160-a0d1-091c1a7d88ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:24.782709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-25829689-a983-4160-a0d1-091c1a7d88ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:24.810051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25829689-a983-4160-a0d1-091c1a7d88ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:24.819055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25829689-a983-4160-a0d1-091c1a7d88ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:24.820450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25829689-a983-4160-a0d1-091c1a7d88ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:24.820915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25829689-a983-4160-a0d1-091c1a7d88ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:25.021554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-25829689-a983-4160-a0d1-091c1a7d88ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:25.037636 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-25829689-a983-4160-a0d1-091c1a7d88ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.260417 Aug 04 14:46:25.049549 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3073/6154] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:24 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:46:26.077794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-872268d6-eed4-4a27-949b-1cf0d38b2df8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:26.078790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-872268d6-eed4-4a27-949b-1cf0d38b2df8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:26.092893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-872268d6-eed4-4a27-949b-1cf0d38b2df8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:26.093373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-872268d6-eed4-4a27-949b-1cf0d38b2df8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:26.094227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-872268d6-eed4-4a27-949b-1cf0d38b2df8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:26.094640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-872268d6-eed4-4a27-949b-1cf0d38b2df8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:26.196222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-872268d6-eed4-4a27-949b-1cf0d38b2df8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:26.211954 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-872268d6-eed4-4a27-949b-1cf0d38b2df8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1187 microversion: 2.1 time: 0.138542 Aug 04 14:46:26.213357 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3082/6155] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:26 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:27.235635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:27.236283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:27.247437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:46:27.270398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:27.270915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:27.271849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:27.272324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:27.417720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:27.425527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:27.426407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lazy-loading 'fault' on Instance uuid e62838ec-0236-48f5-8a08-b84d70f001ba {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:46:27.564039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:46:27.591293 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68355cae-3834-460d-aa45-44d3c71b607d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 200 len: 1192 microversion: 2.1 time: 0.359244 Aug 04 14:46:27.598627 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3074/6156] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:27 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 1192 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:46:28.636698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:28.638338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:28.655882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:28.658198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:28.659163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:28.661267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:28.722640 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba HTTP/1.1 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'e62838ec-0236-48f5-8a08-b84d70f001ba'} Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:28.724527 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:28.729602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:28.729602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:28.729602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:28.729602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:46:28.729602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:46:28.729602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:28.729602 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:28.732737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:46:28.738925 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e23e87f-eb74-44f2-8867-e0ffc5901a32 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 404 len: 111 microversion: 2.1 time: 0.105716 Aug 04 14:46:28.739876 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3083/6157] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:28 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:46:30.571404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-301942b6-0416-475f-aa7c-0fa9eb40f3b9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:30.595019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-301942b6-0416-475f-aa7c-0fa9eb40f3b9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:30.627459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-301942b6-0416-475f-aa7c-0fa9eb40f3b9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:30.631691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-301942b6-0416-475f-aa7c-0fa9eb40f3b9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:30.634405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-301942b6-0416-475f-aa7c-0fa9eb40f3b9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:30.636300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-301942b6-0416-475f-aa7c-0fa9eb40f3b9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:30.645533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:46:30.730191 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-301942b6-0416-475f-aa7c-0fa9eb40f3b9 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "POST /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88/action" status: 200 len: 24573 microversion: 2.1 time: 0.168373 Aug 04 14:46:30.740932 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3075/6158] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:46:30 2022] POST /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88/action => generated 24573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 14:46:37.351477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-44322cc0-bf35-46ef-8370-4b4152790d59 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-987709869", "availability_zone": "foo_zone"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:37.445075 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:37.445075 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:46:37.449107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.aggregate [None req-44322cc0-bf35-46ef-8370-4b4152790d59 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Generated uuid 033efdb8-d427-450a-bfb1-2dc30e6e3fdd for aggregate {{(pid=130960) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 14:46:37.452255 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [None req-44322cc0-bf35-46ef-8370-4b4152790d59 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] [56252bae-3b8a-4580-ad11-11abb94e1f99] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 14:46:38.462259 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [None req-44322cc0-bf35-46ef-8370-4b4152790d59 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] [56252bae-3b8a-4580-ad11-11abb94e1f99] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 33650. Aug 04 14:46:38.526568 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-44322cc0-bf35-46ef-8370-4b4152790d59 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.937618 Aug 04 14:46:38.530552 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3084/6159] 10.222.0.66 () {60 vars in 1164 bytes} [Thu Aug 4 14:46:36 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:38.551838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03de98e5-d52e-4c76-b57a-c86f71a17859 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:38.555608 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:38.555608 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:46:38.617200 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-03de98e5-d52e-4c76-b57a-c86f71a17859 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.067136 Aug 04 14:46:38.623337 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3076/6160] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 14:46:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:38.637444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-690f0229-c6c3-4b61-bf03-41c90fe46fde tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:38.640827 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:38.640827 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:46:38.642750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-690f0229-c6c3-4b61-bf03-41c90fe46fde tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:38.645908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-690f0229-c6c3-4b61-bf03-41c90fe46fde tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:38.648609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-690f0229-c6c3-4b61-bf03-41c90fe46fde tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:38.653804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-690f0229-c6c3-4b61-bf03-41c90fe46fde tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:38.717798 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-690f0229-c6c3-4b61-bf03-41c90fe46fde tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.084995 Aug 04 14:46:38.720804 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3085/6161] 10.222.0.66 () {58 vars in 1176 bytes} [Thu Aug 4 14:46:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:38.730139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ace90514-b055-455d-8055-d82f970e635e tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:38.731652 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:38.731652 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:46:38.745785 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ace90514-b055-455d-8055-d82f970e635e tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.019731 Aug 04 14:46:38.753398 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3077/6162] 10.222.0.66 () {58 vars in 1143 bytes} [Thu Aug 4 14:46:38 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:38.765322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4d4a035-40bb-404e-b8f6-52f9e771c6c3 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844627-10"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:38.768265 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:38.768265 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:46:38.789623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4d4a035-40bb-404e-b8f6-52f9e771c6c3 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:38.790147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4d4a035-40bb-404e-b8f6-52f9e771c6c3 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:39.423671 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4d4a035-40bb-404e-b8f6-52f9e771c6c3 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.662705 Aug 04 14:46:39.436409 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3086/6163] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 14:46:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:39.447468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a22a1665-ae1f-42ab-8689-9500f9ad0105 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:39.448393 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:39.448393 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:46:39.469541 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a22a1665-ae1f-42ab-8689-9500f9ad0105 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.027573 Aug 04 14:46:39.481981 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3078/6164] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 14:46:39 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:39.491045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-12f3fdd6-fa89-4f46-a938-256bd27e35f8 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-472007967", "availability_zone": "foo_zone"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:39.661433 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:39.661433 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:46:39.766951 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-12f3fdd6-fa89-4f46-a938-256bd27e35f8 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.277396 Aug 04 14:46:39.768828 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3087/6165] 10.222.0.66 () {60 vars in 1173 bytes} [Thu Aug 4 14:46:39 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:39.785508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e5c57498-ee03-4674-a29f-621be61bfdda tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:39.794349 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:39.794349 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:46:39.859433 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e5c57498-ee03-4674-a29f-621be61bfdda tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.081146 Aug 04 14:46:39.861373 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3079/6166] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 14:46:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:39.874403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b549c20d-ad77-4bef-93f7-837137686c03 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:39.875268 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:39.875268 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:46:39.901823 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b549c20d-ad77-4bef-93f7-837137686c03 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.032376 Aug 04 14:46:39.902887 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3088/6167] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Aug 4 14:46:39 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:39.919474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6ddf1754-6591-48de-8f21-c4a33f3f3399 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844627-10"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:46:39.923975 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:39.923975 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:46:39.936035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ddf1754-6591-48de-8f21-c4a33f3f3399 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:39.936760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ddf1754-6591-48de-8f21-c4a33f3f3399 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:40.262851 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6ddf1754-6591-48de-8f21-c4a33f3f3399 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.348469 Aug 04 14:46:40.264629 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3080/6168] 10.222.0.66 () {60 vars in 1194 bytes} [Thu Aug 4 14:46:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:46:40.280581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-45b5c615-002f-4e07-bab2-03c52310ece8 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:40.281577 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:46:40.281577 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:46:40.332417 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-45b5c615-002f-4e07-bab2-03c52310ece8 tempest-TestAggregatesBasicOps-515102700 tempest-TestAggregatesBasicOps-515102700-project-admin] 10.222.0.66 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.059753 Aug 04 14:46:40.333731 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3089/6169] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 14:46:40 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 14:46:40.636732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:40.637710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:40.671163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:40.671876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:40.673900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:40.674551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:40.693877 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba HTTP/1.1 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'e62838ec-0236-48f5-8a08-b84d70f001ba'} Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:46:40.696427 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.701040 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.702843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:46:40.704337 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bc52aff9-d869-4445-90de-30149ea65015 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 404 len: 111 microversion: 2.1 time: 0.073061 Aug 04 14:46:40.705485 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3081/6170] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:46:40 2022] DELETE /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:46:40.714597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:46:40.716992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: e62838ec-0236-48f5-8a08-b84d70f001ba] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:46:40.729472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:40.730400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:40.744317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:46:40.745689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:46:40.765421 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba HTTP/1.1 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'e62838ec-0236-48f5-8a08-b84d70f001ba'} Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:46:40.767803 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.773555 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:46:40.773555 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:46:40.773555 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:46:40.773555 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:46:40.773555 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:46:40.773555 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. Aug 04 14:46:40.773555 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:46:40.777924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance e62838ec-0236-48f5-8a08-b84d70f001ba could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:46:40.779815 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1e6ef826-9079-41c8-b867-244ece398658 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba" status: 404 len: 111 microversion: 2.1 time: 0.070102 Aug 04 14:46:40.784343 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3090/6171] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:46:40 2022] GET /compute/v2.1/servers/e62838ec-0236-48f5-8a08-b84d70f001ba => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:47:02.842001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-47491149-9e6d-4481-935c-f13836a70a07 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:02.845121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-47491149-9e6d-4481-935c-f13836a70a07 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:02.851227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:02.852457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=9 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:02.852607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:02.854688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:02.855791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=25 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:02.860087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6265e4b9-4598-47a6-a7b9-51526f65de03 req-73c24191-0211-426b-b408-99676fe49127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70847cad-0a82-488c-8584-38c9519a3c88", "tag": "9a0df737-065d-424c-8c29-ca3561bb278f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:47:02.873022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47491149-9e6d-4481-935c-f13836a70a07 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:02.873676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6265e4b9-4598-47a6-a7b9-51526f65de03 req-73c24191-0211-426b-b408-99676fe49127 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:02.873868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47491149-9e6d-4481-935c-f13836a70a07 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:02.874181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6265e4b9-4598-47a6-a7b9-51526f65de03 req-73c24191-0211-426b-b408-99676fe49127 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:02.875669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47491149-9e6d-4481-935c-f13836a70a07 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:02.876604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-47491149-9e6d-4481-935c-f13836a70a07 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:02.893223 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6265e4b9-4598-47a6-a7b9-51526f65de03 req-73c24191-0211-426b-b408-99676fe49127 service nova] Creating event network-changed:9a0df737-065d-424c-8c29-ca3561bb278f for instance 70847cad-0a82-488c-8584-38c9519a3c88 on n-h1-844627-10 Aug 04 14:47:02.899721 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6265e4b9-4598-47a6-a7b9-51526f65de03 req-73c24191-0211-426b-b408-99676fe49127 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048631 Aug 04 14:47:02.900752 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3091/6172] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:47:02.935501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-47491149-9e6d-4481-935c-f13836a70a07 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:47:03.180320 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-47491149-9e6d-4481-935c-f13836a70a07 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "DELETE /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 204 len: 0 microversion: 2.1 time: 0.344841 Aug 04 14:47:03.182386 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3082/6173] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:47:02 2022] DELETE /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:47:03.193440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18d58778-a03c-4474-977c-982397718e6f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:03.194246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-18d58778-a03c-4474-977c-982397718e6f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:03.214133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18d58778-a03c-4474-977c-982397718e6f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:03.214952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18d58778-a03c-4474-977c-982397718e6f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:03.215978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18d58778-a03c-4474-977c-982397718e6f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:03.216583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18d58778-a03c-4474-977c-982397718e6f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:03.498321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-18d58778-a03c-4474-977c-982397718e6f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:03.515399 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18d58778-a03c-4474-977c-982397718e6f tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1688 microversion: 2.1 time: 0.327358 Aug 04 14:47:03.518702 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3092/6174] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:03 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1688 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:04.561564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e92b0625-79ac-4091-b805-be0ab7b06c9e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:04.562618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e92b0625-79ac-4091-b805-be0ab7b06c9e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:04.576092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e92b0625-79ac-4091-b805-be0ab7b06c9e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:04.577158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e92b0625-79ac-4091-b805-be0ab7b06c9e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:04.578629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e92b0625-79ac-4091-b805-be0ab7b06c9e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:04.579497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e92b0625-79ac-4091-b805-be0ab7b06c9e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:04.966447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e92b0625-79ac-4091-b805-be0ab7b06c9e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:04.988720 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e92b0625-79ac-4091-b805-be0ab7b06c9e tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1688 microversion: 2.1 time: 0.435421 Aug 04 14:47:04.991661 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3083/6175] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:04 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1688 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:05.706975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-351a8e9b-9540-422b-9f6a-8520b0bfe4a7 req-bf4368b5-81d8-426c-ae84-23f27e360ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70847cad-0a82-488c-8584-38c9519a3c88", "name": "network-vif-deleted", "tag": "9a0df737-065d-424c-8c29-ca3561bb278f"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:47:05.734817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-351a8e9b-9540-422b-9f6a-8520b0bfe4a7 req-bf4368b5-81d8-426c-ae84-23f27e360ad5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:05.735625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-351a8e9b-9540-422b-9f6a-8520b0bfe4a7 req-bf4368b5-81d8-426c-ae84-23f27e360ad5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:05.759569 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-351a8e9b-9540-422b-9f6a-8520b0bfe4a7 req-bf4368b5-81d8-426c-ae84-23f27e360ad5 service nova] Creating event network-vif-deleted:9a0df737-065d-424c-8c29-ca3561bb278f for instance 70847cad-0a82-488c-8584-38c9519a3c88 on n-h1-844627-10 Aug 04 14:47:05.768695 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-351a8e9b-9540-422b-9f6a-8520b0bfe4a7 req-bf4368b5-81d8-426c-ae84-23f27e360ad5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067752 Aug 04 14:47:05.773912 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3093/6176] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:47:06.021672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:06.022844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:06.063086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:06.064241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:06.066467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:06.067774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:06.148198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:06.149353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:06.150433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lazy-loading 'fault' on Instance uuid 70847cad-0a82-488c-8584-38c9519a3c88 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:47:06.255708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e5002f80224b4a804be717d5bd9d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1a5cc686e44650a531a8c1026d71e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:06.284748 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f353966a-a539-4f4e-b7c4-1f15c7ddaf91 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 200 len: 1357 microversion: 2.1 time: 0.274782 Aug 04 14:47:06.302009 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3084/6177] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:06 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 1357 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:07.330760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:07.333396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] [instance: 70847cad-0a82-488c-8584-38c9519a3c88] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:07.350345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:07.351688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:07.353528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:07.354870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:07.379819 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] HTTP exception thrown: Instance 70847cad-0a82-488c-8584-38c9519a3c88 could not be found. Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Request method failure captured: Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 HTTP/1.1 Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69jFwfUoq1MZ3PkxRE5BkQb7BpiSp69e48CPHsGriFQhxKzUnkiGwYhQQNbePGn0c7hesvf4xJO9DEV2ugJMLpoKcsD8QT28sWC3O_GVBX9cdqtyoLV3WEoG3MH4Vxk5k9ad08hMG6pCpe8VT4Gx9CIcVPTQQppsGB6GyqA9Zs8vudM Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 2f1a5cc686e44650a531a8c1026d71e0 Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2f1a5cc686e44650a531a8c1026d71e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2f1a5cc686e44650a531a8c1026d71e0"}]}] Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 2f1a5cc686e44650a531a8c1026d71e0 Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-617904044 Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestNetworkAdvancedServerOps-617904044-project Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 95e5002f80224b4a804be717d5bd9d2c Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestNetworkAdvancedServerOps-617904044-project Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 70847cad-0a82-488c-8584-38c9519a3c88 could not be found. Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '70847cad-0a82-488c-8584-38c9519a3c88'} Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70847cad-0a82-488c-8584-38c9519a3c88 could not be found. Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70847cad-0a82-488c-8584-38c9519a3c88 could not be found. Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:47:07.382270 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:47:07.386984 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:47:07.386984 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:47:07.386984 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:47:07.386984 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:47:07.386984 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:47:07.386984 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:47:07.386984 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70847cad-0a82-488c-8584-38c9519a3c88 could not be found. Aug 04 14:47:07.386984 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:47:07.389120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Returning 404 to user: Instance 70847cad-0a82-488c-8584-38c9519a3c88 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:47:07.390398 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f480670b-8db6-4387-99c2-01988775f541 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88" status: 404 len: 111 microversion: 2.1 time: 0.070381 Aug 04 14:47:07.397422 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3094/6178] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:07 2022] GET /compute/v2.1/servers/70847cad-0a82-488c-8584-38c9519a3c88 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:47:13.036579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-16284c77-dd4c-4164-bd05-1ffece1af436 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] Calling method '.version_select at 0x7f47054744c0>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:13.079795 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-16284c77-dd4c-4164-bd05-1ffece1af436 tempest-TestNetworkAdvancedServerOps-617904044 tempest-TestNetworkAdvancedServerOps-617904044-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1716534236" status: 202 len: 0 microversion: 2.1 time: 0.049309 Aug 04 14:47:13.082450 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3085/6179] 10.222.0.66 () {58 vars in 1284 bytes} [Thu Aug 4 14:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1716534236 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:47:21.000626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-9468486", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "73d75216-6d19-4dda-b241-d9221121482f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "da90baac-d2cd-4bbe-ac2b-56b8aae47252"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:47:21.013481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=8 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:21.014410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:21.079513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] validate_networks() for [('da90baac-d2cd-4bbe-ac2b-56b8aae47252', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:47:22.220155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:47:22.221231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:47:22.222222 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:47:22.223069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:47:22.223967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:47:22.241257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:22.242202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:22.243795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:22.244662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:22.283139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:47:22.295525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for user 374c75516444430ea550446cd477e015 and project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:47:22.393510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:47:22.395661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73d75216-6d19-4dda-b241-d9221121482f',volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:47:22.578719 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-88229f0a-9184-4435-83fb-d3de5acf35bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582452 Aug 04 14:47:22.579849 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3095/6180] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:47:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:47:22.595939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b32dfd16-2d11-4af2-ac60-0eb88ec346c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:22.596683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b32dfd16-2d11-4af2-ac60-0eb88ec346c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:22.602790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:22.680101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b32dfd16-2d11-4af2-ac60-0eb88ec346c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:22.694883 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b32dfd16-2d11-4af2-ac60-0eb88ec346c7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1068 microversion: 2.1 time: 0.102711 Aug 04 14:47:22.696408 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3086/6181] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:22 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1068 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:23.724765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2024bdf7-f792-4fc3-8238-34fbfeedd8db tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:23.725832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2024bdf7-f792-4fc3-8238-34fbfeedd8db tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:23.737698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2024bdf7-f792-4fc3-8238-34fbfeedd8db tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:23.738545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2024bdf7-f792-4fc3-8238-34fbfeedd8db tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:23.740000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2024bdf7-f792-4fc3-8238-34fbfeedd8db tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:23.740793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2024bdf7-f792-4fc3-8238-34fbfeedd8db tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:23.862693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2024bdf7-f792-4fc3-8238-34fbfeedd8db tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:23.876658 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2024bdf7-f792-4fc3-8238-34fbfeedd8db tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1166 microversion: 2.1 time: 0.162244 Aug 04 14:47:23.890058 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3096/6182] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:23 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1166 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:24.915308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-585e9b1f-6635-45d3-8170-b954f071d0ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:24.916702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-585e9b1f-6635-45d3-8170-b954f071d0ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:24.944662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-585e9b1f-6635-45d3-8170-b954f071d0ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:24.945354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-585e9b1f-6635-45d3-8170-b954f071d0ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:24.946464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-585e9b1f-6635-45d3-8170-b954f071d0ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:24.947048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-585e9b1f-6635-45d3-8170-b954f071d0ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:25.279812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-585e9b1f-6635-45d3-8170-b954f071d0ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:25.303239 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-585e9b1f-6635-45d3-8170-b954f071d0ca tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1226 microversion: 2.1 time: 0.389910 Aug 04 14:47:25.317887 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3087/6183] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:24 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1226 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:26.347456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d34bd3a1-743f-4128-9052-252ec6aad52e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:26.348491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d34bd3a1-743f-4128-9052-252ec6aad52e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:26.353573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7330a59a-ae66-43a9-a39f-a76f6172b79b req-9745292c-a8ef-4d7b-9971-af848b3860c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b01214c-c5a8-4b4e-a146-5b15cb60c9ac", "tag": "84355ab4-58f6-4b51-987d-a36fcfe4714e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:47:26.361632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d34bd3a1-743f-4128-9052-252ec6aad52e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:26.367859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7330a59a-ae66-43a9-a39f-a76f6172b79b req-9745292c-a8ef-4d7b-9971-af848b3860c2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:26.368388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7330a59a-ae66-43a9-a39f-a76f6172b79b req-9745292c-a8ef-4d7b-9971-af848b3860c2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:26.375368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d34bd3a1-743f-4128-9052-252ec6aad52e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:26.379164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d34bd3a1-743f-4128-9052-252ec6aad52e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:26.381765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d34bd3a1-743f-4128-9052-252ec6aad52e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:26.392392 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7330a59a-ae66-43a9-a39f-a76f6172b79b req-9745292c-a8ef-4d7b-9971-af848b3860c2 service nova] Creating event network-changed:84355ab4-58f6-4b51-987d-a36fcfe4714e for instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac on n-h2-844627-10 Aug 04 14:47:26.411827 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7330a59a-ae66-43a9-a39f-a76f6172b79b req-9745292c-a8ef-4d7b-9971-af848b3860c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291092 Aug 04 14:47:26.412603 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3097/6184] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:47:26.693497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d34bd3a1-743f-4128-9052-252ec6aad52e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:26.711336 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d34bd3a1-743f-4128-9052-252ec6aad52e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1226 microversion: 2.1 time: 0.368947 Aug 04 14:47:26.717106 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3088/6185] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:26 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1226 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:47:27.753603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b7196a08-2777-4638-9242-02f4b4d30598 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:27.754726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b7196a08-2777-4638-9242-02f4b4d30598 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:27.763174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7196a08-2777-4638-9242-02f4b4d30598 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:27.763919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7196a08-2777-4638-9242-02f4b4d30598 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:27.765193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7196a08-2777-4638-9242-02f4b4d30598 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:27.765799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b7196a08-2777-4638-9242-02f4b4d30598 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:28.023184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b7196a08-2777-4638-9242-02f4b4d30598 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:28.039447 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b7196a08-2777-4638-9242-02f4b4d30598 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1226 microversion: 2.1 time: 0.294153 Aug 04 14:47:28.040618 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3098/6186] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:27 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1226 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:29.063915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-88e70daf-5910-4b9f-9dc5-8f405fb349ad tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:29.065313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-88e70daf-5910-4b9f-9dc5-8f405fb349ad tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:29.076801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88e70daf-5910-4b9f-9dc5-8f405fb349ad tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:29.077572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88e70daf-5910-4b9f-9dc5-8f405fb349ad tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:29.078645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88e70daf-5910-4b9f-9dc5-8f405fb349ad tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:29.079373 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-88e70daf-5910-4b9f-9dc5-8f405fb349ad tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:29.280557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-88e70daf-5910-4b9f-9dc5-8f405fb349ad tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:29.291515 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-88e70daf-5910-4b9f-9dc5-8f405fb349ad tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1226 microversion: 2.1 time: 0.233303 Aug 04 14:47:29.292191 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3089/6187] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:29 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1226 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:30.318823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d49254ab-a860-4bd9-8c3b-827203d64a1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:30.319860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d49254ab-a860-4bd9-8c3b-827203d64a1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:30.329819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d49254ab-a860-4bd9-8c3b-827203d64a1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:30.330510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d49254ab-a860-4bd9-8c3b-827203d64a1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:30.332265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d49254ab-a860-4bd9-8c3b-827203d64a1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:30.333123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d49254ab-a860-4bd9-8c3b-827203d64a1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:30.511471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d49254ab-a860-4bd9-8c3b-827203d64a1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:30.525532 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d49254ab-a860-4bd9-8c3b-827203d64a1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1226 microversion: 2.1 time: 0.211340 Aug 04 14:47:30.527656 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3099/6188] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:30 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1226 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:47:31.564928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-042aff58-99ec-49b6-bc2b-6a81a169ae8a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:31.566144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-042aff58-99ec-49b6-bc2b-6a81a169ae8a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:31.578336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-042aff58-99ec-49b6-bc2b-6a81a169ae8a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:31.579081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-042aff58-99ec-49b6-bc2b-6a81a169ae8a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:31.580485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-042aff58-99ec-49b6-bc2b-6a81a169ae8a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:31.581166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-042aff58-99ec-49b6-bc2b-6a81a169ae8a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:31.768278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-042aff58-99ec-49b6-bc2b-6a81a169ae8a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:31.780015 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-042aff58-99ec-49b6-bc2b-6a81a169ae8a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1214 microversion: 2.1 time: 0.222726 Aug 04 14:47:31.780746 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3090/6189] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:31 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:47:32.812227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-268cc342-2169-4166-8c4e-f4f69a170266 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:32.813001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-268cc342-2169-4166-8c4e-f4f69a170266 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:32.821153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:32.822128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:32.830613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-268cc342-2169-4166-8c4e-f4f69a170266 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:32.831429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-268cc342-2169-4166-8c4e-f4f69a170266 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:32.833339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-268cc342-2169-4166-8c4e-f4f69a170266 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:32.834467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-268cc342-2169-4166-8c4e-f4f69a170266 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:33.042578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-268cc342-2169-4166-8c4e-f4f69a170266 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:33.051974 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-268cc342-2169-4166-8c4e-f4f69a170266 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1214 microversion: 2.1 time: 0.248405 Aug 04 14:47:33.053391 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3100/6190] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:32 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1214 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:34.076792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b21a009b-715c-427a-b449-bbf1ed29041c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:34.077702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b21a009b-715c-427a-b449-bbf1ed29041c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:34.082161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:34.083565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:34.092694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b21a009b-715c-427a-b449-bbf1ed29041c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:34.093851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b21a009b-715c-427a-b449-bbf1ed29041c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:34.094866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b21a009b-715c-427a-b449-bbf1ed29041c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:34.095456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b21a009b-715c-427a-b449-bbf1ed29041c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:34.297908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b21a009b-715c-427a-b449-bbf1ed29041c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:34.313760 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b21a009b-715c-427a-b449-bbf1ed29041c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1214 microversion: 2.1 time: 0.241583 Aug 04 14:47:34.314713 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3091/6191] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:34 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:47:35.343071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5a11a8de-796d-4060-8cb2-056396be90cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:35.343729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5a11a8de-796d-4060-8cb2-056396be90cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:35.352308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a11a8de-796d-4060-8cb2-056396be90cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:35.352767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a11a8de-796d-4060-8cb2-056396be90cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:35.353624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a11a8de-796d-4060-8cb2-056396be90cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:35.354072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a11a8de-796d-4060-8cb2-056396be90cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:35.520457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5a11a8de-796d-4060-8cb2-056396be90cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:35.535175 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5a11a8de-796d-4060-8cb2-056396be90cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1214 microversion: 2.1 time: 0.196259 Aug 04 14:47:35.536307 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3101/6192] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:35 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:47:36.571898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76d6d985-7300-49cc-b9f1-da842f10030c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:36.572823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76d6d985-7300-49cc-b9f1-da842f10030c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:36.582594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76d6d985-7300-49cc-b9f1-da842f10030c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:36.583179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76d6d985-7300-49cc-b9f1-da842f10030c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:36.584143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76d6d985-7300-49cc-b9f1-da842f10030c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:36.584689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76d6d985-7300-49cc-b9f1-da842f10030c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:36.802831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76d6d985-7300-49cc-b9f1-da842f10030c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:36.824626 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76d6d985-7300-49cc-b9f1-da842f10030c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1214 microversion: 2.1 time: 0.257619 Aug 04 14:47:36.825195 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3092/6193] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:36 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1214 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:47:37.856954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3904e960-bf75-4548-9c3e-cb8bb0beb0e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:37.858096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3904e960-bf75-4548-9c3e-cb8bb0beb0e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:37.866341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3904e960-bf75-4548-9c3e-cb8bb0beb0e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:37.866877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3904e960-bf75-4548-9c3e-cb8bb0beb0e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:37.867766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3904e960-bf75-4548-9c3e-cb8bb0beb0e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:37.868701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3904e960-bf75-4548-9c3e-cb8bb0beb0e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:38.020551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3904e960-bf75-4548-9c3e-cb8bb0beb0e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:38.029390 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3904e960-bf75-4548-9c3e-cb8bb0beb0e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1214 microversion: 2.1 time: 0.177605 Aug 04 14:47:38.029994 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3102/6194] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:37 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:47:39.052445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4f1b9ae3-0cf2-4508-baba-d97bda25e24c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:39.053803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4f1b9ae3-0cf2-4508-baba-d97bda25e24c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:39.062497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f1b9ae3-0cf2-4508-baba-d97bda25e24c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:39.063222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f1b9ae3-0cf2-4508-baba-d97bda25e24c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:39.064073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f1b9ae3-0cf2-4508-baba-d97bda25e24c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:39.064532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f1b9ae3-0cf2-4508-baba-d97bda25e24c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:39.240226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4f1b9ae3-0cf2-4508-baba-d97bda25e24c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:39.253043 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4f1b9ae3-0cf2-4508-baba-d97bda25e24c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1214 microversion: 2.1 time: 0.204781 Aug 04 14:47:39.254079 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3093/6195] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:39 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:40.285818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bfd5e340-ee0b-4576-9f42-d0c7bef76173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:40.287163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bfd5e340-ee0b-4576-9f42-d0c7bef76173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:40.300591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfd5e340-ee0b-4576-9f42-d0c7bef76173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:40.301430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfd5e340-ee0b-4576-9f42-d0c7bef76173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:40.302818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfd5e340-ee0b-4576-9f42-d0c7bef76173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:40.303629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bfd5e340-ee0b-4576-9f42-d0c7bef76173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:40.493113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bfd5e340-ee0b-4576-9f42-d0c7bef76173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:40.502571 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bfd5e340-ee0b-4576-9f42-d0c7bef76173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1214 microversion: 2.1 time: 0.224973 Aug 04 14:47:40.503547 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3103/6196] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:40 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1214 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:41.087767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a17df0ff-83d9-4adc-945c-20be275de3ab req-ef7e2cc1-a178-48e0-8174-f89ef571518b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b01214c-c5a8-4b4e-a146-5b15cb60c9ac", "name": "network-vif-plugged", "status": "completed", "tag": "84355ab4-58f6-4b51-987d-a36fcfe4714e"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:47:41.100073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a17df0ff-83d9-4adc-945c-20be275de3ab req-ef7e2cc1-a178-48e0-8174-f89ef571518b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:41.100672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a17df0ff-83d9-4adc-945c-20be275de3ab req-ef7e2cc1-a178-48e0-8174-f89ef571518b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:41.113882 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a17df0ff-83d9-4adc-945c-20be275de3ab req-ef7e2cc1-a178-48e0-8174-f89ef571518b service nova] Creating event network-vif-plugged:84355ab4-58f6-4b51-987d-a36fcfe4714e for instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac on n-h2-844627-10 Aug 04 14:47:41.120543 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a17df0ff-83d9-4adc-945c-20be275de3ab req-ef7e2cc1-a178-48e0-8174-f89ef571518b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163105 Aug 04 14:47:41.121456 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3094/6197] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:47:41.534014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4fdc4cd5-7c8b-4c1f-855b-27f509a2c9d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:41.534920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4fdc4cd5-7c8b-4c1f-855b-27f509a2c9d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:41.544428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fdc4cd5-7c8b-4c1f-855b-27f509a2c9d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:41.545016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fdc4cd5-7c8b-4c1f-855b-27f509a2c9d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:41.545876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fdc4cd5-7c8b-4c1f-855b-27f509a2c9d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:41.546442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fdc4cd5-7c8b-4c1f-855b-27f509a2c9d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:41.733135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4fdc4cd5-7c8b-4c1f-855b-27f509a2c9d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:41.744790 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4fdc4cd5-7c8b-4c1f-855b-27f509a2c9d2 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1214 microversion: 2.1 time: 0.215947 Aug 04 14:47:41.746287 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3104/6198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:41 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:42.772652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c47074b0-5c1c-4c29-ac1a-73f1680619f8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:42.773502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c47074b0-5c1c-4c29-ac1a-73f1680619f8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:42.782531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c47074b0-5c1c-4c29-ac1a-73f1680619f8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:42.783103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c47074b0-5c1c-4c29-ac1a-73f1680619f8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:42.783999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c47074b0-5c1c-4c29-ac1a-73f1680619f8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:42.784586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c47074b0-5c1c-4c29-ac1a-73f1680619f8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:42.994889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c47074b0-5c1c-4c29-ac1a-73f1680619f8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:43.004252 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c47074b0-5c1c-4c29-ac1a-73f1680619f8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1400 microversion: 2.1 time: 0.237534 Aug 04 14:47:43.005118 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3095/6199] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:42 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1400 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:43.028422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-68076513-9f60-49f9-aec8-8430ee641dda tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:43.029318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-68076513-9f60-49f9-aec8-8430ee641dda tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:43.038605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68076513-9f60-49f9-aec8-8430ee641dda tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:43.039270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68076513-9f60-49f9-aec8-8430ee641dda tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:43.040328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68076513-9f60-49f9-aec8-8430ee641dda tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:43.041029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68076513-9f60-49f9-aec8-8430ee641dda tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:43.238814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-68076513-9f60-49f9-aec8-8430ee641dda tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:43.252844 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-68076513-9f60-49f9-aec8-8430ee641dda tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1400 microversion: 2.1 time: 0.229737 Aug 04 14:47:43.253947 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3105/6200] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:43 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1400 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:47:43.278257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1329658986"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:47:43.281209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:43.288489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:43.289248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:43.290155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:43.290724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:43.420021 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.api [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Attempting to quiesce instance before volume snapshot. Aug 04 14:47:43.479964 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.api [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 04 14:47:43.575008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Creating snapshot from volume 73d75216-6d19-4dda-b241-d9221121482f. {{(pid=130961) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 04 14:47:44.890366 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a6312ae-43ff-4fa0-91c3-12c04282b738 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac/action" status: 202 len: 0 microversion: 2.1 time: 1.617181 Aug 04 14:47:44.907368 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3096/6201] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:47:43 2022] POST /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac/action => generated 0 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 14:47:46.378384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-220821666", "imageRef": "c392c59d-80b6-4bd6-9b74-17374ce4049c", "flavorRef": "452", "networks": [{"uuid": "da90baac-d2cd-4bbe-ac2b-56b8aae47252"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:47:46.454567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] validate_networks() for [('da90baac-d2cd-4bbe-ac2b-56b8aae47252', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:47:46.958923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:47:46.959678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:47:46.960525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:47:46.961313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:47:46.962080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:47:46.978989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:46.980336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:46.981869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:46.982692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:47.023826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:47:47.035431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for user 374c75516444430ea550446cd477e015 and project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:47:47.062716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:47:47.068206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='71259fe1-5d4e-4ff8-95a6-43098cf9f33e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:47:47.190345 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c7a7ca23-001d-4be2-9516-2f839fdcbb58 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816598 Aug 04 14:47:47.191226 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3106/6202] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:47:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:47:47.212346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-417faed6-8204-41f1-affa-5abc68df054a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:47.215262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-417faed6-8204-41f1-affa-5abc68df054a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:47.330746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-417faed6-8204-41f1-affa-5abc68df054a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:47.349064 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-417faed6-8204-41f1-affa-5abc68df054a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1229 microversion: 2.1 time: 0.145647 Aug 04 14:47:47.350588 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3097/6203] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:47 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1229 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:48.389226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6c0805a9-5b4b-4a5a-bc03-f9dea4e3f33f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:48.390616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6c0805a9-5b4b-4a5a-bc03-f9dea4e3f33f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:48.405026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c0805a9-5b4b-4a5a-bc03-f9dea4e3f33f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:48.406412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c0805a9-5b4b-4a5a-bc03-f9dea4e3f33f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:48.408385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c0805a9-5b4b-4a5a-bc03-f9dea4e3f33f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:48.409651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c0805a9-5b4b-4a5a-bc03-f9dea4e3f33f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:48.511706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6c0805a9-5b4b-4a5a-bc03-f9dea4e3f33f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:48.521240 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6c0805a9-5b4b-4a5a-bc03-f9dea4e3f33f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1281 microversion: 2.1 time: 0.140868 Aug 04 14:47:48.522215 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3107/6204] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:48 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1281 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:49.550833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0baf359c-29f4-4a32-822a-baff37604953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:49.561522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0baf359c-29f4-4a32-822a-baff37604953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:49.593519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0baf359c-29f4-4a32-822a-baff37604953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:49.594391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0baf359c-29f4-4a32-822a-baff37604953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:49.595748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0baf359c-29f4-4a32-822a-baff37604953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:49.596292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0baf359c-29f4-4a32-822a-baff37604953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:49.798827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0baf359c-29f4-4a32-822a-baff37604953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:49.812722 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0baf359c-29f4-4a32-822a-baff37604953 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1299 microversion: 2.1 time: 0.271087 Aug 04 14:47:49.813663 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3098/6205] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:49 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1299 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:50.836040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-239e527e-1020-4f1f-92da-549a267b4d4b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:50.837989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-239e527e-1020-4f1f-92da-549a267b4d4b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:50.851120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-239e527e-1020-4f1f-92da-549a267b4d4b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:50.852122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-239e527e-1020-4f1f-92da-549a267b4d4b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:50.861521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-239e527e-1020-4f1f-92da-549a267b4d4b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:50.870000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-239e527e-1020-4f1f-92da-549a267b4d4b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:51.086382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-239e527e-1020-4f1f-92da-549a267b4d4b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:51.090075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=71 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:51.101828 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-239e527e-1020-4f1f-92da-549a267b4d4b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.270143 Aug 04 14:47:51.111113 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3108/6206] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:50 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:51.616345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2340b6b0-dee8-4554-80cb-9a3b9d4815fc req-8f3bbbb5-4211-4c5c-9c6c-556880d091ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1", "tag": "9d53a7e8-0fb9-4565-a637-ade18c139025"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:47:51.632218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2340b6b0-dee8-4554-80cb-9a3b9d4815fc req-8f3bbbb5-4211-4c5c-9c6c-556880d091ac service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:51.633111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2340b6b0-dee8-4554-80cb-9a3b9d4815fc req-8f3bbbb5-4211-4c5c-9c6c-556880d091ac service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:51.651102 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2340b6b0-dee8-4554-80cb-9a3b9d4815fc req-8f3bbbb5-4211-4c5c-9c6c-556880d091ac service nova] Creating event network-changed:9d53a7e8-0fb9-4565-a637-ade18c139025 for instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 on n-h1-844627-10 Aug 04 14:47:51.659940 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2340b6b0-dee8-4554-80cb-9a3b9d4815fc req-8f3bbbb5-4211-4c5c-9c6c-556880d091ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047554 Aug 04 14:47:51.662313 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3099/6207] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:47:52.127545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cbc8842d-8ab7-4056-b015-1f9b9be0ff3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:52.129564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cbc8842d-8ab7-4056-b015-1f9b9be0ff3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:52.136499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:52.145636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc8842d-8ab7-4056-b015-1f9b9be0ff3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:52.146656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc8842d-8ab7-4056-b015-1f9b9be0ff3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:52.148119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc8842d-8ab7-4056-b015-1f9b9be0ff3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:52.149098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbc8842d-8ab7-4056-b015-1f9b9be0ff3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:52.371552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cbc8842d-8ab7-4056-b015-1f9b9be0ff3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:52.380659 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cbc8842d-8ab7-4056-b015-1f9b9be0ff3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.259896 Aug 04 14:47:52.381944 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3109/6208] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:52 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:53.420312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-99d16acb-5533-410d-bf23-9a489a7fbde5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:53.422705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-99d16acb-5533-410d-bf23-9a489a7fbde5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:53.435801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99d16acb-5533-410d-bf23-9a489a7fbde5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:53.437110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99d16acb-5533-410d-bf23-9a489a7fbde5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:53.438577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99d16acb-5533-410d-bf23-9a489a7fbde5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:53.439711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99d16acb-5533-410d-bf23-9a489a7fbde5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:53.448509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:53.686163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-99d16acb-5533-410d-bf23-9a489a7fbde5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:53.703738 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-99d16acb-5533-410d-bf23-9a489a7fbde5 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.298804 Aug 04 14:47:53.708692 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3100/6209] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:53 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:54.737745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-06c14399-de82-4b10-afc8-3e2d9be5ec26 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:54.739218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-06c14399-de82-4b10-afc8-3e2d9be5ec26 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:54.756332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06c14399-de82-4b10-afc8-3e2d9be5ec26 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:54.757172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06c14399-de82-4b10-afc8-3e2d9be5ec26 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:54.758598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06c14399-de82-4b10-afc8-3e2d9be5ec26 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:54.759382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-06c14399-de82-4b10-afc8-3e2d9be5ec26 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:55.043516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-06c14399-de82-4b10-afc8-3e2d9be5ec26 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:55.068349 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-06c14399-de82-4b10-afc8-3e2d9be5ec26 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.340282 Aug 04 14:47:55.093158 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3110/6210] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:54 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:56.110069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5ca0eac3-af67-4a2c-9119-82575f7cbfaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:56.112411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5ca0eac3-af67-4a2c-9119-82575f7cbfaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:56.126120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ca0eac3-af67-4a2c-9119-82575f7cbfaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:56.127473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ca0eac3-af67-4a2c-9119-82575f7cbfaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:56.129369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ca0eac3-af67-4a2c-9119-82575f7cbfaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:56.130527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5ca0eac3-af67-4a2c-9119-82575f7cbfaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:56.462072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5ca0eac3-af67-4a2c-9119-82575f7cbfaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:56.482384 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5ca0eac3-af67-4a2c-9119-82575f7cbfaa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.378236 Aug 04 14:47:56.485379 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3101/6211] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:56 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:57.512294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd60a654-72e4-4027-96e8-f1006be5ec60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:57.514583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bd60a654-72e4-4027-96e8-f1006be5ec60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:57.519082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:57.521176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:57.526993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd60a654-72e4-4027-96e8-f1006be5ec60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:57.527647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd60a654-72e4-4027-96e8-f1006be5ec60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:57.528320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd60a654-72e4-4027-96e8-f1006be5ec60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:57.528777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd60a654-72e4-4027-96e8-f1006be5ec60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:57.716436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd60a654-72e4-4027-96e8-f1006be5ec60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:57.726430 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd60a654-72e4-4027-96e8-f1006be5ec60 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.218828 Aug 04 14:47:57.727605 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3111/6212] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:57 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:47:58.763324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a77cf75e-ff11-4e7c-94b3-cb81dac3c803 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:47:58.764923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a77cf75e-ff11-4e7c-94b3-cb81dac3c803 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:47:58.769039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:47:58.773977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a77cf75e-ff11-4e7c-94b3-cb81dac3c803 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:58.774677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a77cf75e-ff11-4e7c-94b3-cb81dac3c803 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:58.775356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a77cf75e-ff11-4e7c-94b3-cb81dac3c803 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:47:58.776575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a77cf75e-ff11-4e7c-94b3-cb81dac3c803 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:47:59.051121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a77cf75e-ff11-4e7c-94b3-cb81dac3c803 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:47:59.069768 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a77cf75e-ff11-4e7c-94b3-cb81dac3c803 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.310441 Aug 04 14:47:59.093072 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3102/6213] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:47:58 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:00.116702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bce922e4-b61b-4acd-83fb-c3aad3b7e173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:00.118173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bce922e4-b61b-4acd-83fb-c3aad3b7e173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:00.135054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bce922e4-b61b-4acd-83fb-c3aad3b7e173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:00.136508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bce922e4-b61b-4acd-83fb-c3aad3b7e173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:00.139338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bce922e4-b61b-4acd-83fb-c3aad3b7e173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:00.145758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bce922e4-b61b-4acd-83fb-c3aad3b7e173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:00.375272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bce922e4-b61b-4acd-83fb-c3aad3b7e173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:00.391292 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bce922e4-b61b-4acd-83fb-c3aad3b7e173 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.285616 Aug 04 14:48:00.392389 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3112/6214] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:00 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:48:01.414669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5c71de76-a1ad-4bdc-b7f5-0e3893b4de3f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:01.415606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5c71de76-a1ad-4bdc-b7f5-0e3893b4de3f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:01.425102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c71de76-a1ad-4bdc-b7f5-0e3893b4de3f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:01.425723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c71de76-a1ad-4bdc-b7f5-0e3893b4de3f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:01.426639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c71de76-a1ad-4bdc-b7f5-0e3893b4de3f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:01.427194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5c71de76-a1ad-4bdc-b7f5-0e3893b4de3f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:01.648769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5c71de76-a1ad-4bdc-b7f5-0e3893b4de3f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:01.658908 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5c71de76-a1ad-4bdc-b7f5-0e3893b4de3f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.249011 Aug 04 14:48:01.659782 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3103/6215] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:01 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:48:02.695791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a89ba061-82dd-43b1-a968-5f5dd001d556 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:02.697029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a89ba061-82dd-43b1-a968-5f5dd001d556 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:02.706658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a89ba061-82dd-43b1-a968-5f5dd001d556 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:02.707205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a89ba061-82dd-43b1-a968-5f5dd001d556 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:02.708064 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a89ba061-82dd-43b1-a968-5f5dd001d556 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:02.708513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a89ba061-82dd-43b1-a968-5f5dd001d556 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:02.915813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a89ba061-82dd-43b1-a968-5f5dd001d556 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:02.926188 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a89ba061-82dd-43b1-a968-5f5dd001d556 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.235420 Aug 04 14:48:02.927247 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3113/6216] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:02 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:48:03.951917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8a7e5186-fa21-4d17-b5a2-2e1dca2bc683 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:03.953854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8a7e5186-fa21-4d17-b5a2-2e1dca2bc683 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:03.967110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a7e5186-fa21-4d17-b5a2-2e1dca2bc683 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:03.967908 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a7e5186-fa21-4d17-b5a2-2e1dca2bc683 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:03.969431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a7e5186-fa21-4d17-b5a2-2e1dca2bc683 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:03.970258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8a7e5186-fa21-4d17-b5a2-2e1dca2bc683 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:04.247171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8a7e5186-fa21-4d17-b5a2-2e1dca2bc683 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:04.258489 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8a7e5186-fa21-4d17-b5a2-2e1dca2bc683 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.314214 Aug 04 14:48:04.260100 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3104/6217] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:03 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:48:05.299732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7435fc85-0d1f-4aad-9c76-3f0c4a2c25dd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:05.301892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7435fc85-0d1f-4aad-9c76-3f0c4a2c25dd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:05.316910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7435fc85-0d1f-4aad-9c76-3f0c4a2c25dd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:05.317964 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7435fc85-0d1f-4aad-9c76-3f0c4a2c25dd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:05.319872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7435fc85-0d1f-4aad-9c76-3f0c4a2c25dd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:05.320923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7435fc85-0d1f-4aad-9c76-3f0c4a2c25dd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:05.753927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7435fc85-0d1f-4aad-9c76-3f0c4a2c25dd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:05.776844 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7435fc85-0d1f-4aad-9c76-3f0c4a2c25dd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.485367 Aug 04 14:48:05.778759 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3114/6218] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:05 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:06.812332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-56fbc42f-75b8-411f-9d4d-672066713342 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:06.813546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-56fbc42f-75b8-411f-9d4d-672066713342 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:06.818314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=30 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:48:06.833165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56fbc42f-75b8-411f-9d4d-672066713342 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:06.833932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56fbc42f-75b8-411f-9d4d-672066713342 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:06.835060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56fbc42f-75b8-411f-9d4d-672066713342 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:06.835732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56fbc42f-75b8-411f-9d4d-672066713342 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:07.104499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-56fbc42f-75b8-411f-9d4d-672066713342 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:07.125158 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-56fbc42f-75b8-411f-9d4d-672066713342 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.317408 Aug 04 14:48:07.127984 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3105/6219] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:06 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:08.178352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2cf6c18-c954-423d-b187-801ce1188b06 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:08.182122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d2cf6c18-c954-423d-b187-801ce1188b06 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:08.196369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2cf6c18-c954-423d-b187-801ce1188b06 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:08.197426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2cf6c18-c954-423d-b187-801ce1188b06 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:08.199771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2cf6c18-c954-423d-b187-801ce1188b06 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:08.200627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2cf6c18-c954-423d-b187-801ce1188b06 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:08.428519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d2cf6c18-c954-423d-b187-801ce1188b06 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:08.442958 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2cf6c18-c954-423d-b187-801ce1188b06 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1341 microversion: 2.1 time: 0.290721 Aug 04 14:48:08.452208 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3115/6220] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:08 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1341 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:09.476223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-353fdf6e-9d8a-4421-9405-4da30157beec tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:09.477127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-353fdf6e-9d8a-4421-9405-4da30157beec tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:09.484973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-353fdf6e-9d8a-4421-9405-4da30157beec tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:09.485439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-353fdf6e-9d8a-4421-9405-4da30157beec tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:09.486246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-353fdf6e-9d8a-4421-9405-4da30157beec tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:09.486699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-353fdf6e-9d8a-4421-9405-4da30157beec tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:09.664550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-353fdf6e-9d8a-4421-9405-4da30157beec tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:09.673749 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-353fdf6e-9d8a-4421-9405-4da30157beec tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1387 microversion: 2.1 time: 0.201896 Aug 04 14:48:09.674357 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3106/6221] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:09 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1387 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:10.698197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1da776b-1fbe-4a7f-b08b-7290b9213298 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:10.699368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1da776b-1fbe-4a7f-b08b-7290b9213298 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:10.708732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1da776b-1fbe-4a7f-b08b-7290b9213298 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:10.709373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1da776b-1fbe-4a7f-b08b-7290b9213298 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:10.710385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1da776b-1fbe-4a7f-b08b-7290b9213298 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:10.710933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1da776b-1fbe-4a7f-b08b-7290b9213298 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:10.900579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c1da776b-1fbe-4a7f-b08b-7290b9213298 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:10.909669 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1da776b-1fbe-4a7f-b08b-7290b9213298 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1375 microversion: 2.1 time: 0.216776 Aug 04 14:48:10.910287 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3116/6222] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:10 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1375 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:11.942628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f8f82d04-2cda-406f-b365-e9bb954ce42b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:11.943910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f8f82d04-2cda-406f-b365-e9bb954ce42b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:11.959780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f8f82d04-2cda-406f-b365-e9bb954ce42b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:11.960792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f8f82d04-2cda-406f-b365-e9bb954ce42b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:11.962636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f8f82d04-2cda-406f-b365-e9bb954ce42b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:11.963664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f8f82d04-2cda-406f-b365-e9bb954ce42b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:12.647226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f8f82d04-2cda-406f-b365-e9bb954ce42b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:12.664621 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f8f82d04-2cda-406f-b365-e9bb954ce42b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1375 microversion: 2.1 time: 0.729685 Aug 04 14:48:12.666016 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3107/6223] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:11 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1375 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:13.688057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e343483b-d805-4740-8b47-c6c63016fb04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:13.688758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e343483b-d805-4740-8b47-c6c63016fb04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:13.696742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e343483b-d805-4740-8b47-c6c63016fb04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:13.697335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e343483b-d805-4740-8b47-c6c63016fb04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:13.698841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e343483b-d805-4740-8b47-c6c63016fb04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:13.699295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e343483b-d805-4740-8b47-c6c63016fb04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:13.904508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e343483b-d805-4740-8b47-c6c63016fb04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:13.915843 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e343483b-d805-4740-8b47-c6c63016fb04 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1375 microversion: 2.1 time: 0.231983 Aug 04 14:48:13.917345 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3117/6224] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:13 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1375 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:14.946215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d62a3a1b-8926-453b-9e85-fdb53b3b1e64 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:14.947261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d62a3a1b-8926-453b-9e85-fdb53b3b1e64 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:14.958269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d62a3a1b-8926-453b-9e85-fdb53b3b1e64 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:14.959198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d62a3a1b-8926-453b-9e85-fdb53b3b1e64 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:14.960381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d62a3a1b-8926-453b-9e85-fdb53b3b1e64 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:14.961502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d62a3a1b-8926-453b-9e85-fdb53b3b1e64 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:15.178314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d62a3a1b-8926-453b-9e85-fdb53b3b1e64 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:15.195122 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d62a3a1b-8926-453b-9e85-fdb53b3b1e64 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1375 microversion: 2.1 time: 0.255022 Aug 04 14:48:15.196114 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3108/6225] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:14 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:16.225237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cdf83107-8c66-40fd-9994-9194cd265fce tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:16.226190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cdf83107-8c66-40fd-9994-9194cd265fce tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:16.235622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cdf83107-8c66-40fd-9994-9194cd265fce tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:16.236170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cdf83107-8c66-40fd-9994-9194cd265fce tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:16.237262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cdf83107-8c66-40fd-9994-9194cd265fce tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:16.237825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cdf83107-8c66-40fd-9994-9194cd265fce tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:16.461435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cdf83107-8c66-40fd-9994-9194cd265fce tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:16.474638 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cdf83107-8c66-40fd-9994-9194cd265fce tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1375 microversion: 2.1 time: 0.254275 Aug 04 14:48:16.475833 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3118/6226] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:16 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1375 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:17.511649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7741d75b-f65e-4841-b69f-a154957a5488 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:17.512839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7741d75b-f65e-4841-b69f-a154957a5488 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:17.526844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7741d75b-f65e-4841-b69f-a154957a5488 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:17.528191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7741d75b-f65e-4841-b69f-a154957a5488 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:17.529885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7741d75b-f65e-4841-b69f-a154957a5488 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:17.530684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7741d75b-f65e-4841-b69f-a154957a5488 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:17.767459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7741d75b-f65e-4841-b69f-a154957a5488 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:17.785269 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7741d75b-f65e-4841-b69f-a154957a5488 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1375 microversion: 2.1 time: 0.281929 Aug 04 14:48:17.787227 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3109/6227] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:17 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1375 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:18.810305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc182cc9-7e6d-4774-84e9-50b93ed960a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:18.811139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dc182cc9-7e6d-4774-84e9-50b93ed960a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:18.820914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc182cc9-7e6d-4774-84e9-50b93ed960a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:18.821465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc182cc9-7e6d-4774-84e9-50b93ed960a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:18.822432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc182cc9-7e6d-4774-84e9-50b93ed960a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:18.822938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc182cc9-7e6d-4774-84e9-50b93ed960a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:19.050863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dc182cc9-7e6d-4774-84e9-50b93ed960a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:19.060069 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc182cc9-7e6d-4774-84e9-50b93ed960a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1375 microversion: 2.1 time: 0.254764 Aug 04 14:48:19.060688 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3119/6228] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:18 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1375 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:19.577238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-53249265-4348-46bc-8953-c292987b997e req-ac7f9684-1a07-4d03-93a7-8bb80df020c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1", "name": "network-vif-plugged", "status": "completed", "tag": "9d53a7e8-0fb9-4565-a637-ade18c139025"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:48:19.589709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-53249265-4348-46bc-8953-c292987b997e req-ac7f9684-1a07-4d03-93a7-8bb80df020c0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:19.590847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-53249265-4348-46bc-8953-c292987b997e req-ac7f9684-1a07-4d03-93a7-8bb80df020c0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:19.608080 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-53249265-4348-46bc-8953-c292987b997e req-ac7f9684-1a07-4d03-93a7-8bb80df020c0 service nova] Creating event network-vif-plugged:9d53a7e8-0fb9-4565-a637-ade18c139025 for instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 on n-h1-844627-10 Aug 04 14:48:19.613586 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-53249265-4348-46bc-8953-c292987b997e req-ac7f9684-1a07-4d03-93a7-8bb80df020c0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041112 Aug 04 14:48:19.614211 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3110/6229] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:48:20.088578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0dae92fa-6933-4b22-820b-e0f9b393261a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:20.089880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0dae92fa-6933-4b22-820b-e0f9b393261a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:20.101899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dae92fa-6933-4b22-820b-e0f9b393261a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:20.102591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dae92fa-6933-4b22-820b-e0f9b393261a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:20.104477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dae92fa-6933-4b22-820b-e0f9b393261a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:20.105186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0dae92fa-6933-4b22-820b-e0f9b393261a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:20.298139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0dae92fa-6933-4b22-820b-e0f9b393261a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:20.313692 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0dae92fa-6933-4b22-820b-e0f9b393261a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1375 microversion: 2.1 time: 0.231966 Aug 04 14:48:20.315178 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3120/6230] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:20 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1375 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:21.350580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8cb824ae-db34-4167-8c19-db5a6e121f66 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:21.351877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8cb824ae-db34-4167-8c19-db5a6e121f66 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:21.360267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cb824ae-db34-4167-8c19-db5a6e121f66 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:21.360905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cb824ae-db34-4167-8c19-db5a6e121f66 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:21.362315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cb824ae-db34-4167-8c19-db5a6e121f66 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:21.362965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8cb824ae-db34-4167-8c19-db5a6e121f66 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:21.596425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8cb824ae-db34-4167-8c19-db5a6e121f66 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:21.608169 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8cb824ae-db34-4167-8c19-db5a6e121f66 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1375 microversion: 2.1 time: 0.262653 Aug 04 14:48:21.609382 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3111/6231] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:21 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1375 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:22.636412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7a1212f0-6771-4569-8df8-2fa6ef437b46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:22.638068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a1212f0-6771-4569-8df8-2fa6ef437b46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:22.641058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=24 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:48:22.648037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a1212f0-6771-4569-8df8-2fa6ef437b46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:22.648488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a1212f0-6771-4569-8df8-2fa6ef437b46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:22.649328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a1212f0-6771-4569-8df8-2fa6ef437b46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:22.650025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a1212f0-6771-4569-8df8-2fa6ef437b46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:22.655847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=74 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:48:22.857729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7a1212f0-6771-4569-8df8-2fa6ef437b46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:22.871062 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7a1212f0-6771-4569-8df8-2fa6ef437b46 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1560 microversion: 2.1 time: 0.240103 Aug 04 14:48:22.871995 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3121/6232] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:22 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:22.902169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dc6c8fbd-fe9f-4288-8c7c-b524c91bdfcc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:22.903124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dc6c8fbd-fe9f-4288-8c7c-b524c91bdfcc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:22.914498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc6c8fbd-fe9f-4288-8c7c-b524c91bdfcc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:22.915179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc6c8fbd-fe9f-4288-8c7c-b524c91bdfcc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:22.916356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc6c8fbd-fe9f-4288-8c7c-b524c91bdfcc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:22.917068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dc6c8fbd-fe9f-4288-8c7c-b524c91bdfcc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:23.131061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dc6c8fbd-fe9f-4288-8c7c-b524c91bdfcc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:23.150181 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dc6c8fbd-fe9f-4288-8c7c-b524c91bdfcc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1560 microversion: 2.1 time: 0.254257 Aug 04 14:48:23.162168 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3112/6233] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:22 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1560 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:23.286701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-36a4702c-e397-4a5d-990e-db1fd9c5f661 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:23.287330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-36a4702c-e397-4a5d-990e-db1fd9c5f661 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:23.295809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36a4702c-e397-4a5d-990e-db1fd9c5f661 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:23.296272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36a4702c-e397-4a5d-990e-db1fd9c5f661 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:23.297139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36a4702c-e397-4a5d-990e-db1fd9c5f661 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:23.297588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-36a4702c-e397-4a5d-990e-db1fd9c5f661 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:23.351965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-36a4702c-e397-4a5d-990e-db1fd9c5f661 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:48:23.497140 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-36a4702c-e397-4a5d-990e-db1fd9c5f661 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 204 len: 0 microversion: 2.1 time: 0.214646 Aug 04 14:48:23.498810 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3122/6234] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:48:23 2022] DELETE /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:48:23.508085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33595869-d586-4138-8c04-6a1b78184650 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:23.508774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-33595869-d586-4138-8c04-6a1b78184650 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:23.518566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33595869-d586-4138-8c04-6a1b78184650 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:23.519287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33595869-d586-4138-8c04-6a1b78184650 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:23.520646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33595869-d586-4138-8c04-6a1b78184650 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:23.521440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33595869-d586-4138-8c04-6a1b78184650 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:23.526735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=74 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:48:23.716040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-33595869-d586-4138-8c04-6a1b78184650 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:23.727749 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-33595869-d586-4138-8c04-6a1b78184650 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1566 microversion: 2.1 time: 0.223700 Aug 04 14:48:23.728608 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3113/6235] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:23 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:48:24.758898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e3ab68c-106d-42b3-99e8-390b9fe02ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:24.759848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2e3ab68c-106d-42b3-99e8-390b9fe02ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:24.770111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e3ab68c-106d-42b3-99e8-390b9fe02ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:24.770550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e3ab68c-106d-42b3-99e8-390b9fe02ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:24.771548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e3ab68c-106d-42b3-99e8-390b9fe02ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:24.772157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e3ab68c-106d-42b3-99e8-390b9fe02ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:24.983235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e3ab68c-106d-42b3-99e8-390b9fe02ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:24.995260 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e3ab68c-106d-42b3-99e8-390b9fe02ddc tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1566 microversion: 2.1 time: 0.241118 Aug 04 14:48:24.996176 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3123/6236] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:24 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:48:25.993811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-98bf5e74-5393-4d13-bbff-6b3ef649f59e req-6c35c8f5-feae-4b57-8145-52e70a6b6cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1", "name": "network-vif-deleted", "tag": "9d53a7e8-0fb9-4565-a637-ade18c139025"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:48:26.007670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-98bf5e74-5393-4d13-bbff-6b3ef649f59e req-6c35c8f5-feae-4b57-8145-52e70a6b6cd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:26.008229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-98bf5e74-5393-4d13-bbff-6b3ef649f59e req-6c35c8f5-feae-4b57-8145-52e70a6b6cd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:26.023891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aaf984be-71a0-4f93-8750-0004ef68a87f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:26.025587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aaf984be-71a0-4f93-8750-0004ef68a87f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:26.035894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aaf984be-71a0-4f93-8750-0004ef68a87f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:26.037104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aaf984be-71a0-4f93-8750-0004ef68a87f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:26.038514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aaf984be-71a0-4f93-8750-0004ef68a87f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:26.039243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aaf984be-71a0-4f93-8750-0004ef68a87f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:26.055836 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-98bf5e74-5393-4d13-bbff-6b3ef649f59e req-6c35c8f5-feae-4b57-8145-52e70a6b6cd4 service nova] Creating event network-vif-deleted:9d53a7e8-0fb9-4565-a637-ade18c139025 for instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 on n-h1-844627-10 Aug 04 14:48:26.116447 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-98bf5e74-5393-4d13-bbff-6b3ef649f59e req-6c35c8f5-feae-4b57-8145-52e70a6b6cd4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127173 Aug 04 14:48:26.118036 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3114/6237] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:48:26.153968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aaf984be-71a0-4f93-8750-0004ef68a87f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:26.183025 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aaf984be-71a0-4f93-8750-0004ef68a87f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1524 microversion: 2.1 time: 0.163739 Aug 04 14:48:26.196902 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3124/6238] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:26 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:27.226758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-da4f1843-ea73-4b98-be2d-72fd18db9c87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:27.228936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-da4f1843-ea73-4b98-be2d-72fd18db9c87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:27.247529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da4f1843-ea73-4b98-be2d-72fd18db9c87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:27.249658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da4f1843-ea73-4b98-be2d-72fd18db9c87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:27.251773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da4f1843-ea73-4b98-be2d-72fd18db9c87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:27.253431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-da4f1843-ea73-4b98-be2d-72fd18db9c87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:27.461996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-da4f1843-ea73-4b98-be2d-72fd18db9c87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:27.475234 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-da4f1843-ea73-4b98-be2d-72fd18db9c87 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1360 microversion: 2.1 time: 0.259333 Aug 04 14:48:27.491331 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3115/6239] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:27 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1360 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:48:28.504659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-20a2ac62-5249-42f4-86b9-349a3d021db9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:28.505916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-20a2ac62-5249-42f4-86b9-349a3d021db9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:28.519728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20a2ac62-5249-42f4-86b9-349a3d021db9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:28.520454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20a2ac62-5249-42f4-86b9-349a3d021db9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:28.521944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20a2ac62-5249-42f4-86b9-349a3d021db9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:28.522757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-20a2ac62-5249-42f4-86b9-349a3d021db9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:28.652405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-20a2ac62-5249-42f4-86b9-349a3d021db9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:28.669656 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-20a2ac62-5249-42f4-86b9-349a3d021db9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1360 microversion: 2.1 time: 0.171842 Aug 04 14:48:28.671652 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3125/6240] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:28 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:29.703300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68d5f758-dc23-4f33-a709-9df9a7385af3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:29.704594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68d5f758-dc23-4f33-a709-9df9a7385af3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:29.714381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68d5f758-dc23-4f33-a709-9df9a7385af3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:29.715921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68d5f758-dc23-4f33-a709-9df9a7385af3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:29.717081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68d5f758-dc23-4f33-a709-9df9a7385af3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:29.717759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68d5f758-dc23-4f33-a709-9df9a7385af3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:29.813869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-68d5f758-dc23-4f33-a709-9df9a7385af3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:29.827439 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68d5f758-dc23-4f33-a709-9df9a7385af3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1360 microversion: 2.1 time: 0.128044 Aug 04 14:48:29.828374 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3116/6241] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:29 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1360 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:48:30.865082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d705f38-a07d-4916-b4a1-89e14d384759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:30.866430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6d705f38-a07d-4916-b4a1-89e14d384759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:30.882421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d705f38-a07d-4916-b4a1-89e14d384759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:30.883432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d705f38-a07d-4916-b4a1-89e14d384759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:30.885497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d705f38-a07d-4916-b4a1-89e14d384759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:30.886422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d705f38-a07d-4916-b4a1-89e14d384759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:31.003002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d705f38-a07d-4916-b4a1-89e14d384759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:31.019015 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6d705f38-a07d-4916-b4a1-89e14d384759 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1360 microversion: 2.1 time: 0.161579 Aug 04 14:48:31.020291 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3126/6242] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:30 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:32.044710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:32.045903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:32.055520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:32.056197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:32.058018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:32.058640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:32.104828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:32.105180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:32.105860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lazy-loading 'fault' on Instance uuid eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:48:32.163853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:32.175195 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd053fba-916f-42a7-9611-e602503e7f0d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 200 len: 1365 microversion: 2.1 time: 0.135272 Aug 04 14:48:32.181461 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3117/6243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:32 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:33.202869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:33.205147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:33.219610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:33.220525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:33.222538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:33.223318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:33.251675 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 HTTP/1.1 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1'} Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:33.255948 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:33.266689 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:33.266689 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:33.266689 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:33.266689 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:48:33.266689 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:48:33.266689 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:33.266689 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:33.266689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:48:33.268607 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3a212046-e701-44ee-b970-335db5bda721 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 404 len: 111 microversion: 2.1 time: 0.073544 Aug 04 14:48:33.269815 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3127/6244] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:33 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:48:37.819320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c2fe0ea8-b8ec-47f4-ae26-f7f601a5e747 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:37.820098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c2fe0ea8-b8ec-47f4-ae26-f7f601a5e747 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:37.824010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=28 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:48:37.830497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2fe0ea8-b8ec-47f4-ae26-f7f601a5e747 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:37.831134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2fe0ea8-b8ec-47f4-ae26-f7f601a5e747 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:37.831958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2fe0ea8-b8ec-47f4-ae26-f7f601a5e747 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:37.832634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c2fe0ea8-b8ec-47f4-ae26-f7f601a5e747 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:37.866530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c2fe0ea8-b8ec-47f4-ae26-f7f601a5e747 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:48:37.983790 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c2fe0ea8-b8ec-47f4-ae26-f7f601a5e747 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 204 len: 0 microversion: 2.1 time: 0.170421 Aug 04 14:48:37.985151 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3118/6245] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:48:37 2022] DELETE /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:48:37.996339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8955691e-fac5-4e40-b90b-88c16e6eedff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:37.997234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8955691e-fac5-4e40-b90b-88c16e6eedff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:38.007532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8955691e-fac5-4e40-b90b-88c16e6eedff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:38.008090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8955691e-fac5-4e40-b90b-88c16e6eedff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:38.009100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8955691e-fac5-4e40-b90b-88c16e6eedff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:38.009728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8955691e-fac5-4e40-b90b-88c16e6eedff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:38.242299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8955691e-fac5-4e40-b90b-88c16e6eedff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:38.252689 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8955691e-fac5-4e40-b90b-88c16e6eedff tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1406 microversion: 2.1 time: 0.261128 Aug 04 14:48:38.253344 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3128/6246] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:37 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:39.290826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8db59a7a-b3a0-4be6-afb8-4c49d58ba6f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:39.292771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8db59a7a-b3a0-4be6-afb8-4c49d58ba6f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:39.309576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8db59a7a-b3a0-4be6-afb8-4c49d58ba6f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:39.316625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8db59a7a-b3a0-4be6-afb8-4c49d58ba6f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:39.318465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8db59a7a-b3a0-4be6-afb8-4c49d58ba6f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:39.319652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8db59a7a-b3a0-4be6-afb8-4c49d58ba6f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:39.603436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8db59a7a-b3a0-4be6-afb8-4c49d58ba6f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:39.613119 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8db59a7a-b3a0-4be6-afb8-4c49d58ba6f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1406 microversion: 2.1 time: 0.330310 Aug 04 14:48:39.614203 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3119/6247] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:39 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:40.104678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-98d9a68a-9b12-47a5-bfe5-8e9a413c6abc req-c2e2cd8d-c041-431c-adfe-b21ca5a30467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b01214c-c5a8-4b4e-a146-5b15cb60c9ac", "name": "network-vif-deleted", "tag": "84355ab4-58f6-4b51-987d-a36fcfe4714e"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:48:40.117167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-98d9a68a-9b12-47a5-bfe5-8e9a413c6abc req-c2e2cd8d-c041-431c-adfe-b21ca5a30467 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:40.117647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-98d9a68a-9b12-47a5-bfe5-8e9a413c6abc req-c2e2cd8d-c041-431c-adfe-b21ca5a30467 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:40.135172 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-98d9a68a-9b12-47a5-bfe5-8e9a413c6abc req-c2e2cd8d-c041-431c-adfe-b21ca5a30467 service nova] Creating event network-vif-deleted:84355ab4-58f6-4b51-987d-a36fcfe4714e for instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac on n-h2-844627-10 Aug 04 14:48:40.141876 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-98d9a68a-9b12-47a5-bfe5-8e9a413c6abc req-c2e2cd8d-c041-431c-adfe-b21ca5a30467 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041366 Aug 04 14:48:40.142917 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3129/6248] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:48:40.640600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-26b1a97e-397e-41ff-9e6d-94f415ad1c1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:40.641828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-26b1a97e-397e-41ff-9e6d-94f415ad1c1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:40.657028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26b1a97e-397e-41ff-9e6d-94f415ad1c1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:40.657899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26b1a97e-397e-41ff-9e6d-94f415ad1c1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:40.659431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26b1a97e-397e-41ff-9e6d-94f415ad1c1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:40.660535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26b1a97e-397e-41ff-9e6d-94f415ad1c1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:40.792188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-26b1a97e-397e-41ff-9e6d-94f415ad1c1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:40.805949 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-26b1a97e-397e-41ff-9e6d-94f415ad1c1e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1199 microversion: 2.1 time: 0.172864 Aug 04 14:48:40.816960 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3120/6249] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:40 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1199 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:41.836785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e41d9b4d-197a-43b0-a621-d99f48542e71 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:41.838047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e41d9b4d-197a-43b0-a621-d99f48542e71 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:41.847185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e41d9b4d-197a-43b0-a621-d99f48542e71 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:41.847838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e41d9b4d-197a-43b0-a621-d99f48542e71 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:41.848726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e41d9b4d-197a-43b0-a621-d99f48542e71 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:41.849281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e41d9b4d-197a-43b0-a621-d99f48542e71 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:41.928992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e41d9b4d-197a-43b0-a621-d99f48542e71 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:41.937353 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e41d9b4d-197a-43b0-a621-d99f48542e71 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1199 microversion: 2.1 time: 0.110118 Aug 04 14:48:41.937962 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3130/6250] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:41 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1199 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:42.964225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-102fa921-8296-4468-b708-193cd9d04f1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:42.965353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-102fa921-8296-4468-b708-193cd9d04f1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:42.978370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-102fa921-8296-4468-b708-193cd9d04f1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:42.979313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-102fa921-8296-4468-b708-193cd9d04f1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:42.980661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-102fa921-8296-4468-b708-193cd9d04f1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:42.981488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-102fa921-8296-4468-b708-193cd9d04f1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:43.067233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-102fa921-8296-4468-b708-193cd9d04f1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:43.076563 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-102fa921-8296-4468-b708-193cd9d04f1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1199 microversion: 2.1 time: 0.120116 Aug 04 14:48:43.077192 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3121/6251] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:42 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:44.097984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c23b560-4cdb-4e18-8435-ba70b2e5eac6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:44.098808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c23b560-4cdb-4e18-8435-ba70b2e5eac6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:44.107579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c23b560-4cdb-4e18-8435-ba70b2e5eac6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:44.108192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c23b560-4cdb-4e18-8435-ba70b2e5eac6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:44.109036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c23b560-4cdb-4e18-8435-ba70b2e5eac6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:44.109636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c23b560-4cdb-4e18-8435-ba70b2e5eac6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:44.184489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c23b560-4cdb-4e18-8435-ba70b2e5eac6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:44.193856 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c23b560-4cdb-4e18-8435-ba70b2e5eac6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1199 microversion: 2.1 time: 0.099983 Aug 04 14:48:44.194461 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3131/6252] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:44 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:45.219403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bbb9b1aa-c104-4d10-8f81-f6bb4c23c350 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:45.220502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bbb9b1aa-c104-4d10-8f81-f6bb4c23c350 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:45.233295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbb9b1aa-c104-4d10-8f81-f6bb4c23c350 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:45.233973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbb9b1aa-c104-4d10-8f81-f6bb4c23c350 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:45.235260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbb9b1aa-c104-4d10-8f81-f6bb4c23c350 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:45.235851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bbb9b1aa-c104-4d10-8f81-f6bb4c23c350 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:45.362339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bbb9b1aa-c104-4d10-8f81-f6bb4c23c350 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:48:45.381495 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bbb9b1aa-c104-4d10-8f81-f6bb4c23c350 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 200 len: 1199 microversion: 2.1 time: 0.169047 Aug 04 14:48:45.384152 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3122/6253] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:45 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 1199 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:48:46.415650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:46.416479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:46.424917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:46.425581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:46.427084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:46.427697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:46.445188 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac HTTP/1.1 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '4b01214c-c5a8-4b4e-a146-5b15cb60c9ac'} Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:46.447053 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b017a679-c148-4dc6-a93f-d34f5b414737 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 404 len: 111 microversion: 2.1 time: 0.038901 Aug 04 14:48:46.459788 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3132/6254] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:46 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:48:51.930041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:51.930955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:51.943080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:51.944147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:51.945586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:51.946390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:51.970757 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 HTTP/1.1 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1'} Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:48:51.973954 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ef6cd53-e96d-49eb-8b1a-70bbac5be73e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 404 len: 111 microversion: 2.1 time: 0.053618 Aug 04 14:48:51.982315 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3123/6255] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:48:51 2022] DELETE /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:48:51.989963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:51.991137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:52.000299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:52.001030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:52.001994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:52.002589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:52.022873 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 HTTP/1.1 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1'} Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:52.025923 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9fbcadef-aae4-4b59-a840-7712df202d42 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1" status: 404 len: 111 microversion: 2.1 time: 0.043223 Aug 04 14:48:52.032433 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3133/6256] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:51 2022] GET /compute/v2.1/servers/eb25694e-5c6c-4ff8-9ac3-a7f8e3d8dff1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:48:52.673577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:52.675002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:52.686772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:52.687946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:52.689827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:52.690877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:52.721977 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac HTTP/1.1 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4b01214c-c5a8-4b4e-a146-5b15cb60c9ac'} Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:48:52.726617 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.735102 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.737750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:48:52.739253 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-32807b64-03cd-45ab-9e6b-8be8a2c61475 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 404 len: 111 microversion: 2.1 time: 0.073441 Aug 04 14:48:52.754817 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3124/6257] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:48:52 2022] DELETE /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:48:52.760472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:48:52.762389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:48:52.766331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:48:52.778473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:52.779423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:52.781825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:48:52.782993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:48:52.794640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:48:52.819006 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac HTTP/1.1 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '4b01214c-c5a8-4b4e-a146-5b15cb60c9ac'} Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:48:52.823065 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance 4b01214c-c5a8-4b4e-a146-5b15cb60c9ac could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-59a122d1-5c2a-46a6-a946-e499d61c66d0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac" status: 404 len: 111 microversion: 2.1 time: 0.076447 Aug 04 14:48:52.835641 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3134/6258] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:48:52 2022] GET /compute/v2.1/servers/4b01214c-c5a8-4b4e-a146-5b15cb60c9ac => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:48:52.966675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-85b32555-68fd-4605-a7f8-92f54b46ae88 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'create', calling method: .version_select at 0x7f46f2f1c820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1854217966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2yoT6wzIyGVMrhmlib2bKrBkC5PUCrDmmHgUw8sPw74T6EitMN3aIMRJwyMtTypyTTKzKORXDiz/+XiVFDAHysHk52x9YmKAiR/SS6ErTmhkETmzXg8INf5uLzgQOC4w=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:48:52.998480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-85b32555-68fd-4605-a7f8-92f54b46ae88 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:48:53.011911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-85b32555-68fd-4605-a7f8-92f54b46ae88 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for user 374c75516444430ea550446cd477e015 and project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:48:53.202101 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-85b32555-68fd-4605-a7f8-92f54b46ae88 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.103425 Aug 04 14:48:53.202101 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3125/6259] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:48:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:49:16.464758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1402511191", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1854217966", "security_groups": [{"name": "tempest-secgroup-smoke-1281426606"}], "block_device_mapping_v2": [{"uuid": "1dea48ec-bca0-4f03-9af8-a178d74b6d66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da90baac-d2cd-4bbe-ac2b-56b8aae47252"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:49:16.476939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:49:16.602189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] validate_networks() for [('da90baac-d2cd-4bbe-ac2b-56b8aae47252', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:49:17.093607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:49:17.094171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:49:17.094791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:49:17.095351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:49:17.095870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:49:17.107892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:17.108494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:17.109622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:17.110181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:17.132055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:49:17.139719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for user 374c75516444430ea550446cd477e015 and project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:49:17.222681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:49:17.225372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1dea48ec-bca0-4f03-9af8-a178d74b6d66',volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:49:17.411219 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8eb1526e-1b56-49db-a0b2-b7df077401d1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.950482 Aug 04 14:49:17.411971 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3135/6260] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:49:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:49:17.422252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:49:17.424011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:49:17.425278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:49:17.440000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2f8d2360-48ef-4afb-adc1-6cd0367908a1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:17.446610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f8d2360-48ef-4afb-adc1-6cd0367908a1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:17.518375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2f8d2360-48ef-4afb-adc1-6cd0367908a1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:17.526921 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2f8d2360-48ef-4afb-adc1-6cd0367908a1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1095 microversion: 2.1 time: 0.105949 Aug 04 14:49:17.527671 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3126/6261] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:17 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1095 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:18.555798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d32d3709-9a46-45fc-8820-a4c288691977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:18.557653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d32d3709-9a46-45fc-8820-a4c288691977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:18.567612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d32d3709-9a46-45fc-8820-a4c288691977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:18.568265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d32d3709-9a46-45fc-8820-a4c288691977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:18.570147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d32d3709-9a46-45fc-8820-a4c288691977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:18.570930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d32d3709-9a46-45fc-8820-a4c288691977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:18.664313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d32d3709-9a46-45fc-8820-a4c288691977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:18.673750 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d32d3709-9a46-45fc-8820-a4c288691977 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1193 microversion: 2.1 time: 0.127033 Aug 04 14:49:18.674368 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3136/6262] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:18 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1193 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:19.708502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-79c305a2-11bd-4943-9ff5-e1195e965de1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:19.709460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-79c305a2-11bd-4943-9ff5-e1195e965de1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:19.729116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79c305a2-11bd-4943-9ff5-e1195e965de1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:19.729706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79c305a2-11bd-4943-9ff5-e1195e965de1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:19.730645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79c305a2-11bd-4943-9ff5-e1195e965de1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:19.731233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79c305a2-11bd-4943-9ff5-e1195e965de1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:19.917121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-79c305a2-11bd-4943-9ff5-e1195e965de1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:19.934560 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-79c305a2-11bd-4943-9ff5-e1195e965de1 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1211 microversion: 2.1 time: 0.230317 Aug 04 14:49:19.935309 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3127/6263] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:19 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1211 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:20.972308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fe2a0a29-0de5-4996-80a9-e4567ecd352b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:20.974410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fe2a0a29-0de5-4996-80a9-e4567ecd352b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:20.987616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe2a0a29-0de5-4996-80a9-e4567ecd352b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:20.995504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe2a0a29-0de5-4996-80a9-e4567ecd352b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:20.997705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe2a0a29-0de5-4996-80a9-e4567ecd352b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:20.999386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fe2a0a29-0de5-4996-80a9-e4567ecd352b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:21.441634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-30a1fa95-68e2-4184-87cd-e72a55cec6d2 req-acb9ea70-0cac-4db7-9632-ceee4d140d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd820c65-e562-4bac-8fe5-dd80fc25d312", "tag": "512a499d-9fcd-4bb3-b3b1-33c19f964c7c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:49:21.471497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-30a1fa95-68e2-4184-87cd-e72a55cec6d2 req-acb9ea70-0cac-4db7-9632-ceee4d140d31 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:21.473238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-30a1fa95-68e2-4184-87cd-e72a55cec6d2 req-acb9ea70-0cac-4db7-9632-ceee4d140d31 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:21.500902 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-30a1fa95-68e2-4184-87cd-e72a55cec6d2 req-acb9ea70-0cac-4db7-9632-ceee4d140d31 service nova] Creating event network-changed:512a499d-9fcd-4bb3-b3b1-33c19f964c7c for instance fd820c65-e562-4bac-8fe5-dd80fc25d312 on n-h2-844627-10 Aug 04 14:49:21.511726 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-30a1fa95-68e2-4184-87cd-e72a55cec6d2 req-acb9ea70-0cac-4db7-9632-ceee4d140d31 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076834 Aug 04 14:49:21.513635 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3128/6264] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:49:21.614344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fe2a0a29-0de5-4996-80a9-e4567ecd352b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:21.646179 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fe2a0a29-0de5-4996-80a9-e4567ecd352b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1279 microversion: 2.1 time: 0.678191 Aug 04 14:49:21.648432 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3137/6265] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:20 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1279 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:22.686610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bea33dad-8450-415c-b098-c676ba42fb1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:22.687363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bea33dad-8450-415c-b098-c676ba42fb1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:22.696920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bea33dad-8450-415c-b098-c676ba42fb1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:22.697498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bea33dad-8450-415c-b098-c676ba42fb1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:22.698344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bea33dad-8450-415c-b098-c676ba42fb1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:22.698807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bea33dad-8450-415c-b098-c676ba42fb1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:23.058784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bea33dad-8450-415c-b098-c676ba42fb1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:23.079204 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bea33dad-8450-415c-b098-c676ba42fb1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1279 microversion: 2.1 time: 0.396741 Aug 04 14:49:23.081254 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3129/6266] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:22 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1279 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:24.116338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3013486-1f8b-40b3-a292-b125d75227c4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:24.118342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3013486-1f8b-40b3-a292-b125d75227c4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:24.128614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3013486-1f8b-40b3-a292-b125d75227c4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:24.129494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3013486-1f8b-40b3-a292-b125d75227c4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:24.130972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3013486-1f8b-40b3-a292-b125d75227c4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:24.131607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3013486-1f8b-40b3-a292-b125d75227c4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:24.354993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f3013486-1f8b-40b3-a292-b125d75227c4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:24.368357 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3013486-1f8b-40b3-a292-b125d75227c4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1279 microversion: 2.1 time: 0.262595 Aug 04 14:49:24.370757 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3138/6267] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:24 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:25.402460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-98b7e546-ddef-4c44-8ea5-ede3f5f788c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:25.403602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-98b7e546-ddef-4c44-8ea5-ede3f5f788c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:25.417981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98b7e546-ddef-4c44-8ea5-ede3f5f788c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:25.418681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98b7e546-ddef-4c44-8ea5-ede3f5f788c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:25.419814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98b7e546-ddef-4c44-8ea5-ede3f5f788c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:25.420499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98b7e546-ddef-4c44-8ea5-ede3f5f788c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:25.663562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-98b7e546-ddef-4c44-8ea5-ede3f5f788c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:25.673548 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-98b7e546-ddef-4c44-8ea5-ede3f5f788c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1279 microversion: 2.1 time: 0.278640 Aug 04 14:49:25.685949 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3130/6268] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:25 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1279 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:26.696412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8c2780e9-8e60-4cbc-bd10-599ba8dde886 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:26.697189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8c2780e9-8e60-4cbc-bd10-599ba8dde886 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:26.705331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c2780e9-8e60-4cbc-bd10-599ba8dde886 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:26.705796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c2780e9-8e60-4cbc-bd10-599ba8dde886 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:26.706613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c2780e9-8e60-4cbc-bd10-599ba8dde886 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:26.707068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8c2780e9-8e60-4cbc-bd10-599ba8dde886 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:26.911538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8c2780e9-8e60-4cbc-bd10-599ba8dde886 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:26.922099 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8c2780e9-8e60-4cbc-bd10-599ba8dde886 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1267 microversion: 2.1 time: 0.230025 Aug 04 14:49:26.923579 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3139/6269] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:26 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:49:27.951546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ee0ff296-e817-4af7-8a12-a94dbe311777 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:27.952406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ee0ff296-e817-4af7-8a12-a94dbe311777 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:27.955470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:49:27.962764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee0ff296-e817-4af7-8a12-a94dbe311777 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:27.963248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee0ff296-e817-4af7-8a12-a94dbe311777 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:27.964137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee0ff296-e817-4af7-8a12-a94dbe311777 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:27.964599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee0ff296-e817-4af7-8a12-a94dbe311777 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:28.311902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ee0ff296-e817-4af7-8a12-a94dbe311777 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:28.325115 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ee0ff296-e817-4af7-8a12-a94dbe311777 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1267 microversion: 2.1 time: 0.376997 Aug 04 14:49:28.326223 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3131/6270] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:27 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1267 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:29.360636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d33be2c-e4f9-4261-abd6-83ae4f234901 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:29.361868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3d33be2c-e4f9-4261-abd6-83ae4f234901 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:29.364341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:49:29.365331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:49:29.375958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d33be2c-e4f9-4261-abd6-83ae4f234901 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:29.376449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d33be2c-e4f9-4261-abd6-83ae4f234901 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:29.377292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d33be2c-e4f9-4261-abd6-83ae4f234901 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:29.377745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d33be2c-e4f9-4261-abd6-83ae4f234901 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:29.639843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3d33be2c-e4f9-4261-abd6-83ae4f234901 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:29.649258 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3d33be2c-e4f9-4261-abd6-83ae4f234901 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1267 microversion: 2.1 time: 0.292969 Aug 04 14:49:29.650654 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3140/6271] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:29 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:49:30.687278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f6132127-da12-42fb-87f0-33660db829ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:30.688102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f6132127-da12-42fb-87f0-33660db829ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:30.695955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6132127-da12-42fb-87f0-33660db829ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:30.696438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6132127-da12-42fb-87f0-33660db829ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:30.697307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6132127-da12-42fb-87f0-33660db829ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:30.697923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6132127-da12-42fb-87f0-33660db829ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:30.898774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f6132127-da12-42fb-87f0-33660db829ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:30.914340 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f6132127-da12-42fb-87f0-33660db829ea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1267 microversion: 2.1 time: 0.232327 Aug 04 14:49:30.915260 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3132/6272] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:30 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:31.940731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4d7f656e-8f05-4204-bbb3-8809d2b936a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:31.941827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4d7f656e-8f05-4204-bbb3-8809d2b936a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:31.952069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d7f656e-8f05-4204-bbb3-8809d2b936a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:31.952712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d7f656e-8f05-4204-bbb3-8809d2b936a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:31.953671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d7f656e-8f05-4204-bbb3-8809d2b936a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:31.958606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d7f656e-8f05-4204-bbb3-8809d2b936a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:32.147865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4d7f656e-8f05-4204-bbb3-8809d2b936a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:32.160798 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4d7f656e-8f05-4204-bbb3-8809d2b936a8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1267 microversion: 2.1 time: 0.226444 Aug 04 14:49:32.161525 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3141/6273] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:31 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:33.195592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-05f1cf44-8186-49e8-9347-2a0fb8ed4ae6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:33.196230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-05f1cf44-8186-49e8-9347-2a0fb8ed4ae6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:33.203695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05f1cf44-8186-49e8-9347-2a0fb8ed4ae6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:33.204167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05f1cf44-8186-49e8-9347-2a0fb8ed4ae6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:33.205006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05f1cf44-8186-49e8-9347-2a0fb8ed4ae6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:33.205467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05f1cf44-8186-49e8-9347-2a0fb8ed4ae6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:33.366745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-05f1cf44-8186-49e8-9347-2a0fb8ed4ae6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:33.375546 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-05f1cf44-8186-49e8-9347-2a0fb8ed4ae6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1267 microversion: 2.1 time: 0.184104 Aug 04 14:49:33.376355 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3133/6274] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:33 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:34.396812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-418d198e-8b2d-4702-ae02-dae6de9b1f12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:34.397633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-418d198e-8b2d-4702-ae02-dae6de9b1f12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:34.406255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-418d198e-8b2d-4702-ae02-dae6de9b1f12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:34.406729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-418d198e-8b2d-4702-ae02-dae6de9b1f12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:34.407543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-418d198e-8b2d-4702-ae02-dae6de9b1f12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:34.407991 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-418d198e-8b2d-4702-ae02-dae6de9b1f12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:34.579669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-418d198e-8b2d-4702-ae02-dae6de9b1f12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:34.593731 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-418d198e-8b2d-4702-ae02-dae6de9b1f12 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1267 microversion: 2.1 time: 0.200402 Aug 04 14:49:34.594863 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3142/6275] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:34 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:35.609969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3b9a5f18-f3c5-4401-9e04-ae30a330fbe1 req-8d9fa241-7919-4b68-9095-222611591a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd820c65-e562-4bac-8fe5-dd80fc25d312", "name": "network-vif-plugged", "status": "completed", "tag": "512a499d-9fcd-4bb3-b3b1-33c19f964c7c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:49:35.627030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-27f193d1-6949-4841-885c-9200ee5e18aa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:35.630081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-27f193d1-6949-4841-885c-9200ee5e18aa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:35.651241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3b9a5f18-f3c5-4401-9e04-ae30a330fbe1 req-8d9fa241-7919-4b68-9095-222611591a14 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:35.652473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3b9a5f18-f3c5-4401-9e04-ae30a330fbe1 req-8d9fa241-7919-4b68-9095-222611591a14 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:35.653515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27f193d1-6949-4841-885c-9200ee5e18aa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:35.654477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27f193d1-6949-4841-885c-9200ee5e18aa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:35.656009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27f193d1-6949-4841-885c-9200ee5e18aa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:35.656841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-27f193d1-6949-4841-885c-9200ee5e18aa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:35.678431 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3b9a5f18-f3c5-4401-9e04-ae30a330fbe1 req-8d9fa241-7919-4b68-9095-222611591a14 service nova] Creating event network-vif-plugged:512a499d-9fcd-4bb3-b3b1-33c19f964c7c for instance fd820c65-e562-4bac-8fe5-dd80fc25d312 on n-h2-844627-10 Aug 04 14:49:35.689493 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3b9a5f18-f3c5-4401-9e04-ae30a330fbe1 req-8d9fa241-7919-4b68-9095-222611591a14 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086355 Aug 04 14:49:35.691592 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3134/6276] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:49:35.917692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-27f193d1-6949-4841-885c-9200ee5e18aa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:35.939132 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-27f193d1-6949-4841-885c-9200ee5e18aa tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1267 microversion: 2.1 time: 0.321048 Aug 04 14:49:35.940076 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3143/6277] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:35 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1267 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:36.972827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6f2e3c54-da12-4cb3-98bd-509d1fd215ee tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:36.974379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6f2e3c54-da12-4cb3-98bd-509d1fd215ee tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:36.986898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f2e3c54-da12-4cb3-98bd-509d1fd215ee tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:36.987518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f2e3c54-da12-4cb3-98bd-509d1fd215ee tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:36.988737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f2e3c54-da12-4cb3-98bd-509d1fd215ee tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:36.989435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f2e3c54-da12-4cb3-98bd-509d1fd215ee tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:37.199725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f2e3c54-da12-4cb3-98bd-509d1fd215ee tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:37.209208 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6f2e3c54-da12-4cb3-98bd-509d1fd215ee tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1452 microversion: 2.1 time: 0.243980 Aug 04 14:49:37.209805 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3135/6278] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:36 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1452 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:49:37.246587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d116125b-65d2-4e9a-9470-5373d3a3e4e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:49:37.247712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d116125b-65d2-4e9a-9470-5373d3a3e4e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:49:37.265248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d116125b-65d2-4e9a-9470-5373d3a3e4e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:37.265248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d116125b-65d2-4e9a-9470-5373d3a3e4e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:37.265816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d116125b-65d2-4e9a-9470-5373d3a3e4e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:37.266983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d116125b-65d2-4e9a-9470-5373d3a3e4e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:37.469823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d116125b-65d2-4e9a-9470-5373d3a3e4e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:49:37.478813 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d116125b-65d2-4e9a-9470-5373d3a3e4e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1452 microversion: 2.1 time: 0.240691 Aug 04 14:49:37.479426 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3144/6279] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:49:37 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:49:40.329912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2e3878ea-4430-4632-99e0-bfc3db9b5407 req-2bdcdbaa-9f31-4a2a-ae6b-717a4e865e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd820c65-e562-4bac-8fe5-dd80fc25d312", "tag": "512a499d-9fcd-4bb3-b3b1-33c19f964c7c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:49:40.351577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2e3878ea-4430-4632-99e0-bfc3db9b5407 req-2bdcdbaa-9f31-4a2a-ae6b-717a4e865e22 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:49:40.352363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2e3878ea-4430-4632-99e0-bfc3db9b5407 req-2bdcdbaa-9f31-4a2a-ae6b-717a4e865e22 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:49:40.366224 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2e3878ea-4430-4632-99e0-bfc3db9b5407 req-2bdcdbaa-9f31-4a2a-ae6b-717a4e865e22 service nova] Creating event network-changed:512a499d-9fcd-4bb3-b3b1-33c19f964c7c for instance fd820c65-e562-4bac-8fe5-dd80fc25d312 on n-h2-844627-10 Aug 04 14:49:40.382874 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2e3878ea-4430-4632-99e0-bfc3db9b5407 req-2bdcdbaa-9f31-4a2a-ae6b-717a4e865e22 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059641 Aug 04 14:49:40.383507 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3136/6280] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:51:35.988263 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04939028-e350-49aa-b822-266ad76b8ee3] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 14:51:35.990484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:51:35.991674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=57 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:51:35.999827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9369c9c8-6593-46de-97db-3cdbffae4ea6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:36.000648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9369c9c8-6593-46de-97db-3cdbffae4ea6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:36.015417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9369c9c8-6593-46de-97db-3cdbffae4ea6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:36.016124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9369c9c8-6593-46de-97db-3cdbffae4ea6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:36.017394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9369c9c8-6593-46de-97db-3cdbffae4ea6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:36.018055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9369c9c8-6593-46de-97db-3cdbffae4ea6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:36.068813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9369c9c8-6593-46de-97db-3cdbffae4ea6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:51:36.210645 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9369c9c8-6593-46de-97db-3cdbffae4ea6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 204 len: 0 microversion: 2.1 time: 0.225100 Aug 04 14:51:36.211360 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3145/6281] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:51:35 2022] DELETE /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:51:36.218762 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 14:51:36.219977 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 14:51:36.220688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=24 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:51:36.221647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=48 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:51:36.227783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e5fd3df5-f6f7-4c48-9b82-f29a28b0cb09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:36.228554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e5fd3df5-f6f7-4c48-9b82-f29a28b0cb09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:36.236983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5fd3df5-f6f7-4c48-9b82-f29a28b0cb09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:36.237455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5fd3df5-f6f7-4c48-9b82-f29a28b0cb09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:36.238606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5fd3df5-f6f7-4c48-9b82-f29a28b0cb09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:36.238996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e5fd3df5-f6f7-4c48-9b82-f29a28b0cb09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:36.827702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e5fd3df5-f6f7-4c48-9b82-f29a28b0cb09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:36.842067 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e5fd3df5-f6f7-4c48-9b82-f29a28b0cb09 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1577 microversion: 2.1 time: 0.625231 Aug 04 14:51:36.843104 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3137/6282] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:36 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1577 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:37.881851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6add82e0-d375-40eb-9b16-83e7491bfbb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:37.884144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6add82e0-d375-40eb-9b16-83e7491bfbb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:37.895833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6add82e0-d375-40eb-9b16-83e7491bfbb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:37.896658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6add82e0-d375-40eb-9b16-83e7491bfbb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:37.898856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6add82e0-d375-40eb-9b16-83e7491bfbb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:37.899718 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6add82e0-d375-40eb-9b16-83e7491bfbb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:37.908814 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] [04939028-e350-49aa-b822-266ad76b8ee3] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 37828. Aug 04 14:51:38.484368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6add82e0-d375-40eb-9b16-83e7491bfbb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:38.494900 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6add82e0-d375-40eb-9b16-83e7491bfbb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1577 microversion: 2.1 time: 0.619924 Aug 04 14:51:38.495502 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3146/6283] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:37 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1577 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:39.178523 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 37844. Aug 04 14:51:39.179619 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 37846. Aug 04 14:51:39.233747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-48b41b04-a7fa-44f7-970c-4d005be12d57 req-b9b92b84-e732-4852-806f-5f80ac6ffe83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd820c65-e562-4bac-8fe5-dd80fc25d312", "name": "network-vif-deleted", "tag": "512a499d-9fcd-4bb3-b3b1-33c19f964c7c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:51:39.251194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-48b41b04-a7fa-44f7-970c-4d005be12d57 req-b9b92b84-e732-4852-806f-5f80ac6ffe83 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:39.252339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-48b41b04-a7fa-44f7-970c-4d005be12d57 req-b9b92b84-e732-4852-806f-5f80ac6ffe83 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:39.270694 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-48b41b04-a7fa-44f7-970c-4d005be12d57 req-b9b92b84-e732-4852-806f-5f80ac6ffe83 service nova] Creating event network-vif-deleted:512a499d-9fcd-4bb3-b3b1-33c19f964c7c for instance fd820c65-e562-4bac-8fe5-dd80fc25d312 on n-h2-844627-10 Aug 04 14:51:39.278276 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-48b41b04-a7fa-44f7-970c-4d005be12d57 req-b9b92b84-e732-4852-806f-5f80ac6ffe83 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142953 Aug 04 14:51:39.284294 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3138/6284] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:51:39.533846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15b83fb0-2e3a-415d-9115-76c6d8f3c398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:39.541574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-15b83fb0-2e3a-415d-9115-76c6d8f3c398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:39.552180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15b83fb0-2e3a-415d-9115-76c6d8f3c398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:39.559133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15b83fb0-2e3a-415d-9115-76c6d8f3c398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:39.561180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15b83fb0-2e3a-415d-9115-76c6d8f3c398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:39.562229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15b83fb0-2e3a-415d-9115-76c6d8f3c398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:39.680570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-15b83fb0-2e3a-415d-9115-76c6d8f3c398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:39.689968 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-15b83fb0-2e3a-415d-9115-76c6d8f3c398 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1226 microversion: 2.1 time: 0.166636 Aug 04 14:51:39.690872 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3147/6285] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:39 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1226 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:40.715339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d0d5b8f-6a62-4201-b870-c992438513d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:40.716745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8d0d5b8f-6a62-4201-b870-c992438513d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:40.723976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d0d5b8f-6a62-4201-b870-c992438513d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:40.724734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d0d5b8f-6a62-4201-b870-c992438513d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:40.725754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d0d5b8f-6a62-4201-b870-c992438513d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:40.726489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d0d5b8f-6a62-4201-b870-c992438513d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:40.807906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d0d5b8f-6a62-4201-b870-c992438513d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:40.825393 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d0d5b8f-6a62-4201-b870-c992438513d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1226 microversion: 2.1 time: 0.114930 Aug 04 14:51:40.827594 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3139/6286] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:40 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:41.857396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f830deac-cd2f-4a31-87e1-d4c6f76c297b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:41.858245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f830deac-cd2f-4a31-87e1-d4c6f76c297b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:41.865716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f830deac-cd2f-4a31-87e1-d4c6f76c297b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:41.866183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f830deac-cd2f-4a31-87e1-d4c6f76c297b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:41.867014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f830deac-cd2f-4a31-87e1-d4c6f76c297b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:41.867464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f830deac-cd2f-4a31-87e1-d4c6f76c297b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:41.951108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f830deac-cd2f-4a31-87e1-d4c6f76c297b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:41.959937 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f830deac-cd2f-4a31-87e1-d4c6f76c297b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1226 microversion: 2.1 time: 0.106420 Aug 04 14:51:41.960654 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3148/6287] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:41 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:42.989617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec58307f-e31a-4b88-8535-e29cba86cd37 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:42.990834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ec58307f-e31a-4b88-8535-e29cba86cd37 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:43.003758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec58307f-e31a-4b88-8535-e29cba86cd37 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:43.004563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec58307f-e31a-4b88-8535-e29cba86cd37 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:43.005614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec58307f-e31a-4b88-8535-e29cba86cd37 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:43.006186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec58307f-e31a-4b88-8535-e29cba86cd37 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:43.085841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ec58307f-e31a-4b88-8535-e29cba86cd37 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:43.102044 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec58307f-e31a-4b88-8535-e29cba86cd37 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1226 microversion: 2.1 time: 0.118616 Aug 04 14:51:43.103599 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3140/6288] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:42 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1226 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:43.610787 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:51:43.611600 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:51:43.760270 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:51:43.760500 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:51:43.919566 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:51:43.919566 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 14:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:51:44.074309 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:51:44.074981 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 14:51:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:51:44.141325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d44c99f6-179a-4c4a-8239-eb087dab03f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:44.143024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d44c99f6-179a-4c4a-8239-eb087dab03f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:44.158517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d44c99f6-179a-4c4a-8239-eb087dab03f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:44.159963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d44c99f6-179a-4c4a-8239-eb087dab03f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:44.162135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d44c99f6-179a-4c4a-8239-eb087dab03f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:44.163435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d44c99f6-179a-4c4a-8239-eb087dab03f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:44.627178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d44c99f6-179a-4c4a-8239-eb087dab03f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:44.636498 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d44c99f6-179a-4c4a-8239-eb087dab03f0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 200 len: 1226 microversion: 2.1 time: 0.504164 Aug 04 14:51:44.637485 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3149/6289] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:44 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 1226 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:45.659704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:45.660387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:45.668248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:45.668720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:45.669751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:45.670209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:45.693038 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 HTTP/1.1 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'fd820c65-e562-4bac-8fe5-dd80fc25d312'} Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:51:45.694756 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2df15ba7-70fb-4a5b-9263-a605e59f8c69 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 404 len: 111 microversion: 2.1 time: 0.041612 Aug 04 14:51:45.701837 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3141/6290] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:45 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:51:45.842480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-587723273", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1854217966", "security_groups": [{"name": "tempest-secgroup-smoke-1281426606"}], "block_device_mapping_v2": [{"uuid": "1dea48ec-bca0-4f03-9af8-a178d74b6d66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da90baac-d2cd-4bbe-ac2b-56b8aae47252"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:51:45.996002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] validate_networks() for [('da90baac-d2cd-4bbe-ac2b-56b8aae47252', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:51:46.603950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:51:46.604451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:51:46.605082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:51:46.605568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:51:46.606084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:51:46.615594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:46.616047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:46.616862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:46.617337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:46.634765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:51:46.640459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for user 374c75516444430ea550446cd477e015 and project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:51:46.703220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:51:46.705375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1dea48ec-bca0-4f03-9af8-a178d74b6d66',volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:51:46.874306 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a1db3c3f-1895-4e62-b70d-49b0074d3c9a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.035706 Aug 04 14:51:46.879550 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3150/6291] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:51:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:51:46.887845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-787b2920-3f46-49a6-8bc3-7bfd8ae9bfb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:46.888628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-787b2920-3f46-49a6-8bc3-7bfd8ae9bfb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:46.948192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-787b2920-3f46-49a6-8bc3-7bfd8ae9bfb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:46.957296 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-787b2920-3f46-49a6-8bc3-7bfd8ae9bfb0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1094 microversion: 2.1 time: 0.074838 Aug 04 14:51:46.957963 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3142/6292] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:46 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:47.980805 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6c9c6e5b-54d6-46a9-ba37-a94774a06280 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:47.982273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6c9c6e5b-54d6-46a9-ba37-a94774a06280 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:47.990775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c9c6e5b-54d6-46a9-ba37-a94774a06280 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:47.991550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c9c6e5b-54d6-46a9-ba37-a94774a06280 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:47.992614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c9c6e5b-54d6-46a9-ba37-a94774a06280 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:47.993084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c9c6e5b-54d6-46a9-ba37-a94774a06280 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:48.113099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6c9c6e5b-54d6-46a9-ba37-a94774a06280 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:48.128443 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6c9c6e5b-54d6-46a9-ba37-a94774a06280 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1200 microversion: 2.1 time: 0.152177 Aug 04 14:51:48.130693 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3151/6293] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:47 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1200 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:49.150535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3312ff86-578a-4f3c-89f0-bdeb78d557df tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:49.151821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3312ff86-578a-4f3c-89f0-bdeb78d557df tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:49.165633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3312ff86-578a-4f3c-89f0-bdeb78d557df tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:49.169806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3312ff86-578a-4f3c-89f0-bdeb78d557df tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:49.178505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3312ff86-578a-4f3c-89f0-bdeb78d557df tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:49.178505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3312ff86-578a-4f3c-89f0-bdeb78d557df tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:49.464085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3312ff86-578a-4f3c-89f0-bdeb78d557df tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:49.480083 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3312ff86-578a-4f3c-89f0-bdeb78d557df tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1278 microversion: 2.1 time: 0.331139 Aug 04 14:51:49.481771 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3143/6294] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:49 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1278 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:50.261559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-50bd968c-1226-41f2-b0e5-68b229611ec3 req-acab3050-2f9b-4676-89e6-7b8d528abfbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158b5fc8-b117-49e4-8e51-048f21012c10", "tag": "b36e88b7-2c24-499f-a193-e5bc510b6cf0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:51:50.279425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-50bd968c-1226-41f2-b0e5-68b229611ec3 req-acab3050-2f9b-4676-89e6-7b8d528abfbe service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:50.281011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-50bd968c-1226-41f2-b0e5-68b229611ec3 req-acab3050-2f9b-4676-89e6-7b8d528abfbe service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:50.297169 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-50bd968c-1226-41f2-b0e5-68b229611ec3 req-acab3050-2f9b-4676-89e6-7b8d528abfbe service nova] Creating event network-changed:b36e88b7-2c24-499f-a193-e5bc510b6cf0 for instance 158b5fc8-b117-49e4-8e51-048f21012c10 on n-h1-844627-10 Aug 04 14:51:50.310175 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-50bd968c-1226-41f2-b0e5-68b229611ec3 req-acab3050-2f9b-4676-89e6-7b8d528abfbe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187810 Aug 04 14:51:50.311640 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3152/6295] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:51:50.503536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c923c47f-f17d-4707-908b-594301e83354 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:50.504825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c923c47f-f17d-4707-908b-594301e83354 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:50.513640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c923c47f-f17d-4707-908b-594301e83354 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:50.514435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c923c47f-f17d-4707-908b-594301e83354 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:50.515665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c923c47f-f17d-4707-908b-594301e83354 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:50.516326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c923c47f-f17d-4707-908b-594301e83354 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:50.719576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c923c47f-f17d-4707-908b-594301e83354 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:50.729128 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c923c47f-f17d-4707-908b-594301e83354 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1278 microversion: 2.1 time: 0.229517 Aug 04 14:51:50.730751 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3144/6296] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:50 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:51.754557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f704e746-2234-4463-b57b-e7b96f6e80c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:51.760226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f704e746-2234-4463-b57b-e7b96f6e80c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:51.766296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f704e746-2234-4463-b57b-e7b96f6e80c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:51.766684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f704e746-2234-4463-b57b-e7b96f6e80c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:51.767614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f704e746-2234-4463-b57b-e7b96f6e80c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:51.768161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f704e746-2234-4463-b57b-e7b96f6e80c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:51.957596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f704e746-2234-4463-b57b-e7b96f6e80c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:51.968310 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f704e746-2234-4463-b57b-e7b96f6e80c0 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1278 microversion: 2.1 time: 0.218921 Aug 04 14:51:51.969501 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3153/6297] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:51 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:52.999336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb671b5b-2159-485d-b8f7-8ce3a0908872 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:53.000009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb671b5b-2159-485d-b8f7-8ce3a0908872 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:53.007960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb671b5b-2159-485d-b8f7-8ce3a0908872 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:53.008433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb671b5b-2159-485d-b8f7-8ce3a0908872 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:53.009274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb671b5b-2159-485d-b8f7-8ce3a0908872 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:53.009728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb671b5b-2159-485d-b8f7-8ce3a0908872 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:53.170525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cb671b5b-2159-485d-b8f7-8ce3a0908872 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:53.178582 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb671b5b-2159-485d-b8f7-8ce3a0908872 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1278 microversion: 2.1 time: 0.184420 Aug 04 14:51:53.179564 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3145/6298] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:52 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:51:54.202488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3691e0a1-9156-4e69-b3cb-f4e916ae9461 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:54.203163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3691e0a1-9156-4e69-b3cb-f4e916ae9461 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:54.210210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3691e0a1-9156-4e69-b3cb-f4e916ae9461 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:54.211242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3691e0a1-9156-4e69-b3cb-f4e916ae9461 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:54.212134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3691e0a1-9156-4e69-b3cb-f4e916ae9461 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:54.212619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3691e0a1-9156-4e69-b3cb-f4e916ae9461 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:54.389423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3691e0a1-9156-4e69-b3cb-f4e916ae9461 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:54.401912 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3691e0a1-9156-4e69-b3cb-f4e916ae9461 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1278 microversion: 2.1 time: 0.204647 Aug 04 14:51:54.402855 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3154/6299] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:54 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:55.426471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a1bb690d-3ed7-442d-af7f-3e4efce0ac36 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:55.427560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a1bb690d-3ed7-442d-af7f-3e4efce0ac36 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:55.435751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1bb690d-3ed7-442d-af7f-3e4efce0ac36 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:55.436486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1bb690d-3ed7-442d-af7f-3e4efce0ac36 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:55.437319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1bb690d-3ed7-442d-af7f-3e4efce0ac36 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:55.437771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1bb690d-3ed7-442d-af7f-3e4efce0ac36 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:55.586701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a1bb690d-3ed7-442d-af7f-3e4efce0ac36 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:55.594676 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a1bb690d-3ed7-442d-af7f-3e4efce0ac36 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.174785 Aug 04 14:51:55.595261 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3146/6300] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:55 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:56.615874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4be0fd0d-395a-4736-aed2-843003aadfcd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:56.616589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4be0fd0d-395a-4736-aed2-843003aadfcd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:56.624045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4be0fd0d-395a-4736-aed2-843003aadfcd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:56.624650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4be0fd0d-395a-4736-aed2-843003aadfcd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:56.625633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4be0fd0d-395a-4736-aed2-843003aadfcd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:56.626149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4be0fd0d-395a-4736-aed2-843003aadfcd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:56.626813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:51:56.648486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:51:56.798093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4be0fd0d-395a-4736-aed2-843003aadfcd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:56.814242 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4be0fd0d-395a-4736-aed2-843003aadfcd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.201359 Aug 04 14:51:56.817394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3155/6301] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:56 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:57.836227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9b4a5383-87fc-4e63-b73d-5c0262e2c3ae tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:57.837099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9b4a5383-87fc-4e63-b73d-5c0262e2c3ae tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:57.840672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:51:57.844918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b4a5383-87fc-4e63-b73d-5c0262e2c3ae tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:57.845676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b4a5383-87fc-4e63-b73d-5c0262e2c3ae tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:57.846488 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b4a5383-87fc-4e63-b73d-5c0262e2c3ae tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:57.846945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b4a5383-87fc-4e63-b73d-5c0262e2c3ae tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:58.034105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9b4a5383-87fc-4e63-b73d-5c0262e2c3ae tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:58.043016 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9b4a5383-87fc-4e63-b73d-5c0262e2c3ae tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.211198 Aug 04 14:51:58.048977 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3147/6302] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:57 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:51:59.070600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c16ef19e-d775-4ad2-8121-2100114cb841 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:51:59.073921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c16ef19e-d775-4ad2-8121-2100114cb841 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:51:59.091931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c16ef19e-d775-4ad2-8121-2100114cb841 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:59.093296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c16ef19e-d775-4ad2-8121-2100114cb841 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:59.095361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c16ef19e-d775-4ad2-8121-2100114cb841 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:51:59.096437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c16ef19e-d775-4ad2-8121-2100114cb841 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:51:59.403511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c16ef19e-d775-4ad2-8121-2100114cb841 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:51:59.411668 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c16ef19e-d775-4ad2-8121-2100114cb841 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.350395 Aug 04 14:51:59.425750 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3156/6303] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:51:59 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:00.436533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c325716-db38-4b0f-baa7-d8ae5eecbaea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:00.437676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c325716-db38-4b0f-baa7-d8ae5eecbaea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:00.450216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c325716-db38-4b0f-baa7-d8ae5eecbaea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:00.450696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c325716-db38-4b0f-baa7-d8ae5eecbaea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:00.451497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c325716-db38-4b0f-baa7-d8ae5eecbaea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:00.451955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c325716-db38-4b0f-baa7-d8ae5eecbaea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:00.792066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2c325716-db38-4b0f-baa7-d8ae5eecbaea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:00.807255 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c325716-db38-4b0f-baa7-d8ae5eecbaea tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.373979 Aug 04 14:52:00.815638 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3148/6304] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:00 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:01.835868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0f4b3402-c3f9-4592-9cc4-cd2b3158f3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:01.837769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0f4b3402-c3f9-4592-9cc4-cd2b3158f3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:01.847499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f4b3402-c3f9-4592-9cc4-cd2b3158f3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:01.849248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f4b3402-c3f9-4592-9cc4-cd2b3158f3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:01.850347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f4b3402-c3f9-4592-9cc4-cd2b3158f3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:01.851188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0f4b3402-c3f9-4592-9cc4-cd2b3158f3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:02.048930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0f4b3402-c3f9-4592-9cc4-cd2b3158f3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:02.057612 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0f4b3402-c3f9-4592-9cc4-cd2b3158f3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.230403 Aug 04 14:52:02.058223 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3157/6305] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:01 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:03.093261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b7889873-7f4d-4771-92c4-da81cd2f83e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:03.094837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b7889873-7f4d-4771-92c4-da81cd2f83e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:03.109882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7889873-7f4d-4771-92c4-da81cd2f83e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:03.110861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7889873-7f4d-4771-92c4-da81cd2f83e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:03.112441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7889873-7f4d-4771-92c4-da81cd2f83e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:03.114008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7889873-7f4d-4771-92c4-da81cd2f83e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:03.435323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7889873-7f4d-4771-92c4-da81cd2f83e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:03.452154 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b7889873-7f4d-4771-92c4-da81cd2f83e9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.366943 Aug 04 14:52:03.453678 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3149/6306] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:03 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:04.490555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cbf921b6-d4b7-41a5-98cd-ef3b7415b3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:04.491354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cbf921b6-d4b7-41a5-98cd-ef3b7415b3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:04.501060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbf921b6-d4b7-41a5-98cd-ef3b7415b3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:04.501814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbf921b6-d4b7-41a5-98cd-ef3b7415b3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:04.502849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbf921b6-d4b7-41a5-98cd-ef3b7415b3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:04.503306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbf921b6-d4b7-41a5-98cd-ef3b7415b3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:05.245659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cbf921b6-d4b7-41a5-98cd-ef3b7415b3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:05.271061 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cbf921b6-d4b7-41a5-98cd-ef3b7415b3f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.784634 Aug 04 14:52:05.284921 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3158/6307] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:04 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:06.310791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e0f4596d-64a3-47c8-8674-cdbc7a84ca80 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:06.311921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e0f4596d-64a3-47c8-8674-cdbc7a84ca80 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:06.328769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=29 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:06.342951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0f4596d-64a3-47c8-8674-cdbc7a84ca80 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:06.344173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0f4596d-64a3-47c8-8674-cdbc7a84ca80 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:06.347664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0f4596d-64a3-47c8-8674-cdbc7a84ca80 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:06.350220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e0f4596d-64a3-47c8-8674-cdbc7a84ca80 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:06.385369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=65 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:06.818209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e0f4596d-64a3-47c8-8674-cdbc7a84ca80 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:06.853157 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e0f4596d-64a3-47c8-8674-cdbc7a84ca80 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.540988 Aug 04 14:52:06.856089 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3150/6308] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:06 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:07.909612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b157db1-ebc9-47cc-993d-2920c5c57a7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:07.914657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b157db1-ebc9-47cc-993d-2920c5c57a7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:07.935185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:07.950319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b157db1-ebc9-47cc-993d-2920c5c57a7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:07.952540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b157db1-ebc9-47cc-993d-2920c5c57a7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:07.954006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b157db1-ebc9-47cc-993d-2920c5c57a7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:07.956496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b157db1-ebc9-47cc-993d-2920c5c57a7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:07.965822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:08.472673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b157db1-ebc9-47cc-993d-2920c5c57a7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:08.488026 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b157db1-ebc9-47cc-993d-2920c5c57a7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.597545 Aug 04 14:52:08.488648 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3159/6309] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:07 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:09.059891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2ee1fa83-ab7c-4d06-bdf7-4d4bf1695fc4 req-d3b9229f-7a02-402c-8baa-07dfa92e75c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158b5fc8-b117-49e4-8e51-048f21012c10", "name": "network-vif-plugged", "status": "completed", "tag": "b36e88b7-2c24-499f-a193-e5bc510b6cf0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:09.082166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2ee1fa83-ab7c-4d06-bdf7-4d4bf1695fc4 req-d3b9229f-7a02-402c-8baa-07dfa92e75c7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:09.082917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2ee1fa83-ab7c-4d06-bdf7-4d4bf1695fc4 req-d3b9229f-7a02-402c-8baa-07dfa92e75c7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:09.099917 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2ee1fa83-ab7c-4d06-bdf7-4d4bf1695fc4 req-d3b9229f-7a02-402c-8baa-07dfa92e75c7 service nova] Creating event network-vif-plugged:b36e88b7-2c24-499f-a193-e5bc510b6cf0 for instance 158b5fc8-b117-49e4-8e51-048f21012c10 on n-h1-844627-10 Aug 04 14:52:09.106335 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2ee1fa83-ab7c-4d06-bdf7-4d4bf1695fc4 req-d3b9229f-7a02-402c-8baa-07dfa92e75c7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170831 Aug 04 14:52:09.107216 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3151/6310] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:52:09.525524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2f444161-42d9-4943-bdfb-08e460f7d58f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:09.526145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2f444161-42d9-4943-bdfb-08e460f7d58f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:09.538884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f444161-42d9-4943-bdfb-08e460f7d58f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:09.539423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f444161-42d9-4943-bdfb-08e460f7d58f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:09.540343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f444161-42d9-4943-bdfb-08e460f7d58f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:09.540796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f444161-42d9-4943-bdfb-08e460f7d58f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:09.839787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2f444161-42d9-4943-bdfb-08e460f7d58f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:09.854421 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2f444161-42d9-4943-bdfb-08e460f7d58f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.333488 Aug 04 14:52:09.857728 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3160/6311] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:09 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:52:09.979351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6cb405d3-6362-4d8c-b622-d280a41c0ebf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:09.980208 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:52:09.980208 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:52:09.981505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cb405d3-6362-4d8c-b622-d280a41c0ebf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:09.981976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cb405d3-6362-4d8c-b622-d280a41c0ebf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:09.982804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cb405d3-6362-4d8c-b622-d280a41c0ebf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:09.983257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6cb405d3-6362-4d8c-b622-d280a41c0ebf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:10.011321 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6cb405d3-6362-4d8c-b622-d280a41c0ebf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.095189 Aug 04 14:52:10.011938 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3152/6312] 10.222.0.66 () {58 vars in 1185 bytes} [Thu Aug 4 14:52:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:52:10.131083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-801766490", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "availability_zone": "nova:n-h1-844627-10", "networks": [{"uuid": "12044542-cd9b-4149-abee-957130b88480"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:10.207107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] validate_networks() for [('12044542-cd9b-4149-abee-957130b88480', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:52:10.703420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:52:10.704164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:52:10.705204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:52:10.705958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:52:10.706703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:52:10.724519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:10.725367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:10.727688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:10.728496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:10.761677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Getting quotas for project 257ffbae794f4fc5ba5c86c417aee4ec. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:52:10.769667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Getting quotas for user 275f33debe9048dea915478c95b6ddb1 and project 257ffbae794f4fc5ba5c86c417aee4ec. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:52:10.786560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:52:10.790581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:52:10.845183 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac677f1d-be2d-4e87-929c-669847a12e7d tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718335 Aug 04 14:52:10.852031 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3161/6313] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:52:10.862132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-43d8f5d9-31da-4eda-8e87-4f34dd8b0522 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:10.863512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-43d8f5d9-31da-4eda-8e87-4f34dd8b0522 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:10.888284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d8b6f9f0-18c2-4d3a-a2fe-6a36e25cac22 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:10.889016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d8b6f9f0-18c2-4d3a-a2fe-6a36e25cac22 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:10.899103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8b6f9f0-18c2-4d3a-a2fe-6a36e25cac22 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:10.899651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8b6f9f0-18c2-4d3a-a2fe-6a36e25cac22 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:10.900373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8b6f9f0-18c2-4d3a-a2fe-6a36e25cac22 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:10.901122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8b6f9f0-18c2-4d3a-a2fe-6a36e25cac22 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:10.992122 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-43d8f5d9-31da-4eda-8e87-4f34dd8b0522 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1328 microversion: 2.1 time: 0.137777 Aug 04 14:52:10.992657 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3153/6314] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:10 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1328 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:52:11.210900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d8b6f9f0-18c2-4d3a-a2fe-6a36e25cac22 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:11.220247 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d8b6f9f0-18c2-4d3a-a2fe-6a36e25cac22 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1266 microversion: 2.1 time: 0.337816 Aug 04 14:52:11.221587 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3162/6315] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:10 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:12.013756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0d51c85b-09c1-4513-ada9-a4ebc05428f9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:12.014744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0d51c85b-09c1-4513-ada9-a4ebc05428f9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:12.023515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d51c85b-09c1-4513-ada9-a4ebc05428f9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:12.024064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d51c85b-09c1-4513-ada9-a4ebc05428f9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:12.024781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d51c85b-09c1-4513-ada9-a4ebc05428f9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:12.025272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d51c85b-09c1-4513-ada9-a4ebc05428f9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:12.138361 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0d51c85b-09c1-4513-ada9-a4ebc05428f9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1417 microversion: 2.1 time: 0.128402 Aug 04 14:52:12.139292 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3154/6316] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:12 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1417 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:52:12.255824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6cc090fe-02ec-48bb-9fc7-2a7af2c32d35 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:12.256584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6cc090fe-02ec-48bb-9fc7-2a7af2c32d35 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:12.264943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cc090fe-02ec-48bb-9fc7-2a7af2c32d35 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:12.265706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cc090fe-02ec-48bb-9fc7-2a7af2c32d35 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:12.266783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cc090fe-02ec-48bb-9fc7-2a7af2c32d35 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:12.267290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6cc090fe-02ec-48bb-9fc7-2a7af2c32d35 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:12.503649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6cc090fe-02ec-48bb-9fc7-2a7af2c32d35 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:12.539584 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6cc090fe-02ec-48bb-9fc7-2a7af2c32d35 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1451 microversion: 2.1 time: 0.286766 Aug 04 14:52:12.541376 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3163/6317] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:12 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1451 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:12.573405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3df23d67-1c57-452e-9f55-1bac8bf3f60c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:12.574878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3df23d67-1c57-452e-9f55-1bac8bf3f60c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:12.589766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3df23d67-1c57-452e-9f55-1bac8bf3f60c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:12.591233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3df23d67-1c57-452e-9f55-1bac8bf3f60c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:12.593105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3df23d67-1c57-452e-9f55-1bac8bf3f60c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:12.594398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3df23d67-1c57-452e-9f55-1bac8bf3f60c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:13.075548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3df23d67-1c57-452e-9f55-1bac8bf3f60c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:52:13.090806 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3df23d67-1c57-452e-9f55-1bac8bf3f60c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1451 microversion: 2.1 time: 0.524738 Aug 04 14:52:13.091751 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3155/6318] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:12 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1451 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:13.173536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-587b7bfd-b32e-45cc-84f6-ba0ab1c83ea2 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:13.174323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-587b7bfd-b32e-45cc-84f6-ba0ab1c83ea2 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:13.189714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-587b7bfd-b32e-45cc-84f6-ba0ab1c83ea2 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:13.190459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-587b7bfd-b32e-45cc-84f6-ba0ab1c83ea2 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:13.191907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-587b7bfd-b32e-45cc-84f6-ba0ab1c83ea2 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:13.192595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-587b7bfd-b32e-45cc-84f6-ba0ab1c83ea2 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:13.296202 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-587b7bfd-b32e-45cc-84f6-ba0ab1c83ea2 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1423 microversion: 2.1 time: 0.127300 Aug 04 14:52:13.298635 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3164/6319] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:13 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1423 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:14.326044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84d3e882-fa80-44b4-b23c-e16ee7b406d6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:14.328088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84d3e882-fa80-44b4-b23c-e16ee7b406d6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:14.343755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d3e882-fa80-44b4-b23c-e16ee7b406d6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:14.345083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d3e882-fa80-44b4-b23c-e16ee7b406d6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:14.347433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d3e882-fa80-44b4-b23c-e16ee7b406d6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:14.348613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84d3e882-fa80-44b4-b23c-e16ee7b406d6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:14.586724 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84d3e882-fa80-44b4-b23c-e16ee7b406d6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1465 microversion: 2.1 time: 0.269971 Aug 04 14:52:14.587937 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3156/6320] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:14 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1465 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:15.427110 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-019b8e0d-adde-4770-8566-0d6612140f0c req-dbe61ba4-7b77-4b4b-aa47-3a13538831a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db2cfae-d080-4862-a736-0f33e0257a64", "tag": "26ab2ce3-2624-43e2-a7c1-7d24b8e002d3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:15.439130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-019b8e0d-adde-4770-8566-0d6612140f0c req-dbe61ba4-7b77-4b4b-aa47-3a13538831a0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:15.439491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-019b8e0d-adde-4770-8566-0d6612140f0c req-dbe61ba4-7b77-4b4b-aa47-3a13538831a0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:15.452520 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-019b8e0d-adde-4770-8566-0d6612140f0c req-dbe61ba4-7b77-4b4b-aa47-3a13538831a0 service nova] Creating event network-changed:26ab2ce3-2624-43e2-a7c1-7d24b8e002d3 for instance 2db2cfae-d080-4862-a736-0f33e0257a64 on n-h1-844627-10 Aug 04 14:52:15.458465 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-019b8e0d-adde-4770-8566-0d6612140f0c req-dbe61ba4-7b77-4b4b-aa47-3a13538831a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096720 Aug 04 14:52:15.459380 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3165/6321] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:52:15.610240 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5517d1c-01cf-4368-9742-9ed2967a2093 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:15.611020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d5517d1c-01cf-4368-9742-9ed2967a2093 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:15.622679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5517d1c-01cf-4368-9742-9ed2967a2093 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:15.623458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5517d1c-01cf-4368-9742-9ed2967a2093 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:15.626338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5517d1c-01cf-4368-9742-9ed2967a2093 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:15.627939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5517d1c-01cf-4368-9742-9ed2967a2093 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:15.893986 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d5517d1c-01cf-4368-9742-9ed2967a2093 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1465 microversion: 2.1 time: 0.288728 Aug 04 14:52:15.894816 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3157/6322] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:15 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1465 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:16.923280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9793a807-0d5e-45fa-9e90-2c2113279ebe tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:16.924232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9793a807-0d5e-45fa-9e90-2c2113279ebe tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:16.930869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9793a807-0d5e-45fa-9e90-2c2113279ebe tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:16.931315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9793a807-0d5e-45fa-9e90-2c2113279ebe tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:16.932140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9793a807-0d5e-45fa-9e90-2c2113279ebe tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:16.932536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9793a807-0d5e-45fa-9e90-2c2113279ebe tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:17.127284 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9793a807-0d5e-45fa-9e90-2c2113279ebe tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1465 microversion: 2.1 time: 0.208821 Aug 04 14:52:17.128377 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3166/6323] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:16 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1465 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:17.479884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-9eaef897-415e-4ffe-af28-b710e2911074 req-f51e62da-937d-407e-8fdf-cc4687a281a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158b5fc8-b117-49e4-8e51-048f21012c10", "tag": "b36e88b7-2c24-499f-a193-e5bc510b6cf0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:17.495718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9eaef897-415e-4ffe-af28-b710e2911074 req-f51e62da-937d-407e-8fdf-cc4687a281a2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:17.496187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-9eaef897-415e-4ffe-af28-b710e2911074 req-f51e62da-937d-407e-8fdf-cc4687a281a2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:17.511806 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-9eaef897-415e-4ffe-af28-b710e2911074 req-f51e62da-937d-407e-8fdf-cc4687a281a2 service nova] Creating event network-changed:b36e88b7-2c24-499f-a193-e5bc510b6cf0 for instance 158b5fc8-b117-49e4-8e51-048f21012c10 on n-h1-844627-10 Aug 04 14:52:17.518225 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-9eaef897-415e-4ffe-af28-b710e2911074 req-f51e62da-937d-407e-8fdf-cc4687a281a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042110 Aug 04 14:52:17.519268 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3158/6324] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:52:18.160645 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1dd5081d-8b01-4ede-8d1b-825d41392012 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:18.161717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1dd5081d-8b01-4ede-8d1b-825d41392012 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:18.168900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1dd5081d-8b01-4ede-8d1b-825d41392012 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:18.169370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1dd5081d-8b01-4ede-8d1b-825d41392012 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:18.170164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1dd5081d-8b01-4ede-8d1b-825d41392012 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:18.170599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1dd5081d-8b01-4ede-8d1b-825d41392012 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:18.379357 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1dd5081d-8b01-4ede-8d1b-825d41392012 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1465 microversion: 2.1 time: 0.222273 Aug 04 14:52:18.380201 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3167/6325] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:18 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:19.409854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be6b5be1-bfdf-4d97-8718-f97d4d14d139 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:19.410587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be6b5be1-bfdf-4d97-8718-f97d4d14d139 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:19.418207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be6b5be1-bfdf-4d97-8718-f97d4d14d139 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:19.418667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be6b5be1-bfdf-4d97-8718-f97d4d14d139 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:19.419502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be6b5be1-bfdf-4d97-8718-f97d4d14d139 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:19.420253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be6b5be1-bfdf-4d97-8718-f97d4d14d139 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:19.666896 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be6b5be1-bfdf-4d97-8718-f97d4d14d139 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1465 microversion: 2.1 time: 0.261786 Aug 04 14:52:19.668378 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3159/6326] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:19 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1465 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:20.708905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d187605e-bf70-41d7-ab5c-701fcee0b5a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:20.710162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d187605e-bf70-41d7-ab5c-701fcee0b5a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:20.723196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d187605e-bf70-41d7-ab5c-701fcee0b5a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:20.724022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d187605e-bf70-41d7-ab5c-701fcee0b5a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:20.725459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d187605e-bf70-41d7-ab5c-701fcee0b5a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:20.726726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d187605e-bf70-41d7-ab5c-701fcee0b5a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:20.761301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:20.790334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:20.951792 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d187605e-bf70-41d7-ab5c-701fcee0b5a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1465 microversion: 2.1 time: 0.250246 Aug 04 14:52:20.952414 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3168/6327] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:20 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1465 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:21.974430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0a52e3b4-463a-4e73-99a9-d4383f5e19e6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:21.975338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0a52e3b4-463a-4e73-99a9-d4383f5e19e6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:21.978556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:21.980690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:21.989513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a52e3b4-463a-4e73-99a9-d4383f5e19e6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:21.990253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a52e3b4-463a-4e73-99a9-d4383f5e19e6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:21.991336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a52e3b4-463a-4e73-99a9-d4383f5e19e6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:21.992333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a52e3b4-463a-4e73-99a9-d4383f5e19e6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:22.158734 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0a52e3b4-463a-4e73-99a9-d4383f5e19e6 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1465 microversion: 2.1 time: 0.188426 Aug 04 14:52:22.159696 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3160/6328] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:21 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1465 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:22.649081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-36f42de6-cea5-45c2-b5ea-28e958976159 req-c20bc743-958a-4a2b-a4ac-48661639d1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db2cfae-d080-4862-a736-0f33e0257a64", "name": "network-vif-plugged", "status": "completed", "tag": "26ab2ce3-2624-43e2-a7c1-7d24b8e002d3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:22.663319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-36f42de6-cea5-45c2-b5ea-28e958976159 req-c20bc743-958a-4a2b-a4ac-48661639d1e7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:22.663968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-36f42de6-cea5-45c2-b5ea-28e958976159 req-c20bc743-958a-4a2b-a4ac-48661639d1e7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:22.678376 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-36f42de6-cea5-45c2-b5ea-28e958976159 req-c20bc743-958a-4a2b-a4ac-48661639d1e7 service nova] Creating event network-vif-plugged:26ab2ce3-2624-43e2-a7c1-7d24b8e002d3 for instance 2db2cfae-d080-4862-a736-0f33e0257a64 on n-h1-844627-10 Aug 04 14:52:22.684212 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-36f42de6-cea5-45c2-b5ea-28e958976159 req-c20bc743-958a-4a2b-a4ac-48661639d1e7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040175 Aug 04 14:52:22.685306 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3169/6329] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:52:23.187349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3a48e0b8-699c-44e7-bc58-54c1bfc874fb tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:23.188025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3a48e0b8-699c-44e7-bc58-54c1bfc874fb tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:23.198551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a48e0b8-699c-44e7-bc58-54c1bfc874fb tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:23.199171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a48e0b8-699c-44e7-bc58-54c1bfc874fb tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:23.200052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a48e0b8-699c-44e7-bc58-54c1bfc874fb tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:23.200542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3a48e0b8-699c-44e7-bc58-54c1bfc874fb tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:23.364205 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3a48e0b8-699c-44e7-bc58-54c1bfc874fb tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1465 microversion: 2.1 time: 0.181700 Aug 04 14:52:23.364912 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3161/6330] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:23 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1465 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:24.388691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a33d3506-d8b0-4375-b1e8-310ba7bcc245 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:24.389788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a33d3506-d8b0-4375-b1e8-310ba7bcc245 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:24.396719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a33d3506-d8b0-4375-b1e8-310ba7bcc245 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:24.397248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a33d3506-d8b0-4375-b1e8-310ba7bcc245 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:24.398011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a33d3506-d8b0-4375-b1e8-310ba7bcc245 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:24.398455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a33d3506-d8b0-4375-b1e8-310ba7bcc245 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:24.600101 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a33d3506-d8b0-4375-b1e8-310ba7bcc245 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1649 microversion: 2.1 time: 0.216502 Aug 04 14:52:24.601656 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3170/6331] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:24 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1649 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:24.629511 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ccd8744a-9c2c-4dda-8655-076df46f70f7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:24.630699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ccd8744a-9c2c-4dda-8655-076df46f70f7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:24.643213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccd8744a-9c2c-4dda-8655-076df46f70f7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:24.644021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccd8744a-9c2c-4dda-8655-076df46f70f7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:24.645490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccd8744a-9c2c-4dda-8655-076df46f70f7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:24.646573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccd8744a-9c2c-4dda-8655-076df46f70f7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:24.803553 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ccd8744a-9c2c-4dda-8655-076df46f70f7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1649 microversion: 2.1 time: 0.181791 Aug 04 14:52:24.804837 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3162/6332] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:24 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1649 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:24.829531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-55b24c3e-d0f0-42af-a302-45059b8ceaa0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:24.830721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-55b24c3e-d0f0-42af-a302-45059b8ceaa0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:24.842357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b24c3e-d0f0-42af-a302-45059b8ceaa0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:24.843182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b24c3e-d0f0-42af-a302-45059b8ceaa0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:24.844524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b24c3e-d0f0-42af-a302-45059b8ceaa0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:24.845392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-55b24c3e-d0f0-42af-a302-45059b8ceaa0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:25.027236 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-55b24c3e-d0f0-42af-a302-45059b8ceaa0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1649 microversion: 2.1 time: 0.205123 Aug 04 14:52:25.028335 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3171/6333] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:24 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1649 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:25.094715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-45303867", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "availability_zone": "nova:n-h2-844627-10", "networks": [{"uuid": "12044542-cd9b-4149-abee-957130b88480"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:25.170361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] validate_networks() for [('12044542-cd9b-4149-abee-957130b88480', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:52:25.684379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:52:25.685141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:52:25.685433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:52:25.685862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:52:25.686287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:52:25.697207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:25.697659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:25.698767 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:25.699257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:25.720660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Getting quotas for project 257ffbae794f4fc5ba5c86c417aee4ec. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:52:25.726897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Getting quotas for user 275f33debe9048dea915478c95b6ddb1 and project 257ffbae794f4fc5ba5c86c417aee4ec. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:52:25.742397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:52:25.745149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:52:25.797176 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8778382a-fd60-4fea-b339-910fb6b1004c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706863 Aug 04 14:52:25.797849 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3163/6334] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:52:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:52:25.809709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fd1a6b97-b6ee-4944-8406-c5c92076b8b9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:25.810462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fd1a6b97-b6ee-4944-8406-c5c92076b8b9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:25.893832 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fd1a6b97-b6ee-4944-8406-c5c92076b8b9 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1327 microversion: 2.1 time: 0.087507 Aug 04 14:52:25.894716 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3172/6335] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:25 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1327 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:26.936174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4321a188-3fc6-485f-bb37-f0b7df64049f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:26.937306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4321a188-3fc6-485f-bb37-f0b7df64049f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:26.953386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4321a188-3fc6-485f-bb37-f0b7df64049f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:26.954576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4321a188-3fc6-485f-bb37-f0b7df64049f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:26.956663 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4321a188-3fc6-485f-bb37-f0b7df64049f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:26.957585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4321a188-3fc6-485f-bb37-f0b7df64049f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:27.123403 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4321a188-3fc6-485f-bb37-f0b7df64049f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1434 microversion: 2.1 time: 0.196828 Aug 04 14:52:27.124756 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3164/6336] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:26 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1434 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:28.151457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-785c484d-8736-4139-8b0a-8ac9f2b24bab tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:28.152679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-785c484d-8736-4139-8b0a-8ac9f2b24bab tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:28.167880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-785c484d-8736-4139-8b0a-8ac9f2b24bab tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:28.168703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-785c484d-8736-4139-8b0a-8ac9f2b24bab tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:28.170219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-785c484d-8736-4139-8b0a-8ac9f2b24bab tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:28.171019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-785c484d-8736-4139-8b0a-8ac9f2b24bab tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:28.471338 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-785c484d-8736-4139-8b0a-8ac9f2b24bab tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1464 microversion: 2.1 time: 0.327608 Aug 04 14:52:28.471998 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3173/6337] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:28 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:28.631827 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b08ba64e-9fa2-4bbe-b85b-e8eea84c5216 req-b3fc2424-f3cc-4363-95c4-9f1721a84e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41d5580-659f-4162-a3e7-84f21737adf0", "tag": "3f075c33-9f1b-47a3-b645-fbe402eaeaa9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:28.646371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b08ba64e-9fa2-4bbe-b85b-e8eea84c5216 req-b3fc2424-f3cc-4363-95c4-9f1721a84e79 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:28.646826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b08ba64e-9fa2-4bbe-b85b-e8eea84c5216 req-b3fc2424-f3cc-4363-95c4-9f1721a84e79 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:28.660920 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b08ba64e-9fa2-4bbe-b85b-e8eea84c5216 req-b3fc2424-f3cc-4363-95c4-9f1721a84e79 service nova] Creating event network-changed:3f075c33-9f1b-47a3-b645-fbe402eaeaa9 for instance b41d5580-659f-4162-a3e7-84f21737adf0 on n-h2-844627-10 Aug 04 14:52:28.667322 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b08ba64e-9fa2-4bbe-b85b-e8eea84c5216 req-b3fc2424-f3cc-4363-95c4-9f1721a84e79 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040936 Aug 04 14:52:28.667961 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3165/6338] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:52:29.501320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-db528760-1d4e-4c55-aa75-4a5e1b4a1c0f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:29.502357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-db528760-1d4e-4c55-aa75-4a5e1b4a1c0f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:29.510687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db528760-1d4e-4c55-aa75-4a5e1b4a1c0f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:29.511137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db528760-1d4e-4c55-aa75-4a5e1b4a1c0f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:29.511944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db528760-1d4e-4c55-aa75-4a5e1b4a1c0f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:29.512392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db528760-1d4e-4c55-aa75-4a5e1b4a1c0f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:29.671289 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-db528760-1d4e-4c55-aa75-4a5e1b4a1c0f tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1464 microversion: 2.1 time: 0.174737 Aug 04 14:52:29.671896 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3174/6339] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:29 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:30.695808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-00d71449-8b6e-49dc-abbd-4b9952e49edf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:30.696526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-00d71449-8b6e-49dc-abbd-4b9952e49edf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:30.703855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00d71449-8b6e-49dc-abbd-4b9952e49edf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:30.704328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00d71449-8b6e-49dc-abbd-4b9952e49edf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:30.705175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00d71449-8b6e-49dc-abbd-4b9952e49edf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:30.705640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-00d71449-8b6e-49dc-abbd-4b9952e49edf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:30.858641 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-00d71449-8b6e-49dc-abbd-4b9952e49edf tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1464 microversion: 2.1 time: 0.168896 Aug 04 14:52:30.859254 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3166/6340] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:30 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:31.891886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f004a636-7d22-43a5-9883-10a1ea241b47 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:31.892550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f004a636-7d22-43a5-9883-10a1ea241b47 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:31.900481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f004a636-7d22-43a5-9883-10a1ea241b47 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:31.900967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f004a636-7d22-43a5-9883-10a1ea241b47 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:31.901763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f004a636-7d22-43a5-9883-10a1ea241b47 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:31.902215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f004a636-7d22-43a5-9883-10a1ea241b47 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:32.047549 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f004a636-7d22-43a5-9883-10a1ea241b47 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1464 microversion: 2.1 time: 0.159523 Aug 04 14:52:32.048165 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3175/6341] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:31 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:33.068073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a0006f9f-5fdd-4df2-ac9e-4282ec884713 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:33.068701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a0006f9f-5fdd-4df2-ac9e-4282ec884713 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:33.078274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0006f9f-5fdd-4df2-ac9e-4282ec884713 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:33.080100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0006f9f-5fdd-4df2-ac9e-4282ec884713 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:33.081186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0006f9f-5fdd-4df2-ac9e-4282ec884713 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:33.081658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a0006f9f-5fdd-4df2-ac9e-4282ec884713 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:33.225218 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a0006f9f-5fdd-4df2-ac9e-4282ec884713 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1464 microversion: 2.1 time: 0.160805 Aug 04 14:52:33.226088 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3167/6342] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:33 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:52:34.251315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b21d79e8-091e-4a69-b100-d3f9c38172a0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:34.252046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b21d79e8-091e-4a69-b100-d3f9c38172a0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:34.260244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b21d79e8-091e-4a69-b100-d3f9c38172a0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:34.261365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b21d79e8-091e-4a69-b100-d3f9c38172a0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:34.262295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b21d79e8-091e-4a69-b100-d3f9c38172a0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:34.262755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b21d79e8-091e-4a69-b100-d3f9c38172a0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:34.436079 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b21d79e8-091e-4a69-b100-d3f9c38172a0 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1464 microversion: 2.1 time: 0.188587 Aug 04 14:52:34.436793 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3176/6343] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:34 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1464 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:34.457642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-13f87b4f-a77e-4b6a-9744-62100e60510f req-daba84d1-c19e-4cad-98b5-547e855d4b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41d5580-659f-4162-a3e7-84f21737adf0", "name": "network-vif-plugged", "status": "completed", "tag": "3f075c33-9f1b-47a3-b645-fbe402eaeaa9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:34.469253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-13f87b4f-a77e-4b6a-9744-62100e60510f req-daba84d1-c19e-4cad-98b5-547e855d4b17 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:34.470055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-13f87b4f-a77e-4b6a-9744-62100e60510f req-daba84d1-c19e-4cad-98b5-547e855d4b17 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:34.484254 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-13f87b4f-a77e-4b6a-9744-62100e60510f req-daba84d1-c19e-4cad-98b5-547e855d4b17 service nova] Creating event network-vif-plugged:3f075c33-9f1b-47a3-b645-fbe402eaeaa9 for instance b41d5580-659f-4162-a3e7-84f21737adf0 on n-h2-844627-10 Aug 04 14:52:34.490137 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-13f87b4f-a77e-4b6a-9744-62100e60510f req-daba84d1-c19e-4cad-98b5-547e855d4b17 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052529 Aug 04 14:52:34.490787 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3168/6344] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:52:35.463496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-056ab00d-8a85-45ec-8298-a7e14b023de1 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:35.464300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-056ab00d-8a85-45ec-8298-a7e14b023de1 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:35.471936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-056ab00d-8a85-45ec-8298-a7e14b023de1 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:35.472423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-056ab00d-8a85-45ec-8298-a7e14b023de1 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:35.473308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-056ab00d-8a85-45ec-8298-a7e14b023de1 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:35.473780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-056ab00d-8a85-45ec-8298-a7e14b023de1 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:35.645604 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-056ab00d-8a85-45ec-8298-a7e14b023de1 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1464 microversion: 2.1 time: 0.185387 Aug 04 14:52:35.647323 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3177/6345] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:35 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1464 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:36.666836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:36.668028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:36.673060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c408dd8-56b2-4021-9d1f-0c816d659881 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:36.673884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c408dd8-56b2-4021-9d1f-0c816d659881 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:36.676496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:36.685033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c408dd8-56b2-4021-9d1f-0c816d659881 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:36.685660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c408dd8-56b2-4021-9d1f-0c816d659881 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:36.686581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c408dd8-56b2-4021-9d1f-0c816d659881 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:36.687308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c408dd8-56b2-4021-9d1f-0c816d659881 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:36.691553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=84 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:36.855635 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c408dd8-56b2-4021-9d1f-0c816d659881 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1648 microversion: 2.1 time: 0.190903 Aug 04 14:52:36.856231 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3169/6346] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:36 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1648 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:36.878415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd061b1b-e25a-400b-b74b-fbead463ba0b tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:36.879283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd061b1b-e25a-400b-b74b-fbead463ba0b tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:36.884318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:36.893521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd061b1b-e25a-400b-b74b-fbead463ba0b tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:36.894072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd061b1b-e25a-400b-b74b-fbead463ba0b tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:36.895128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd061b1b-e25a-400b-b74b-fbead463ba0b tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:36.895862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd061b1b-e25a-400b-b74b-fbead463ba0b tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:37.052489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=100 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:37.060910 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd061b1b-e25a-400b-b74b-fbead463ba0b tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1648 microversion: 2.1 time: 0.187583 Aug 04 14:52:37.061561 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3178/6347] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:36 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1648 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:37.082378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-835f9fd8-f3e5-4498-9a30-5947548bc8b7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:37.083061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-835f9fd8-f3e5-4498-9a30-5947548bc8b7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:37.090374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-835f9fd8-f3e5-4498-9a30-5947548bc8b7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:37.091062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-835f9fd8-f3e5-4498-9a30-5947548bc8b7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:37.092033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-835f9fd8-f3e5-4498-9a30-5947548bc8b7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:37.092650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-835f9fd8-f3e5-4498-9a30-5947548bc8b7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:37.258213 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-835f9fd8-f3e5-4498-9a30-5947548bc8b7 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1648 microversion: 2.1 time: 0.179598 Aug 04 14:52:37.259349 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3170/6348] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:37 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1648 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:52:37.284934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6de934f8-e1cc-4817-96c4-fdf8f2afbf19 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:37.285456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6de934f8-e1cc-4817-96c4-fdf8f2afbf19 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:37.296251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6de934f8-e1cc-4817-96c4-fdf8f2afbf19 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:37.296764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6de934f8-e1cc-4817-96c4-fdf8f2afbf19 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:37.298050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6de934f8-e1cc-4817-96c4-fdf8f2afbf19 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:37.298562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6de934f8-e1cc-4817-96c4-fdf8f2afbf19 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:37.335345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6de934f8-e1cc-4817-96c4-fdf8f2afbf19 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:52:37.444795 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6de934f8-e1cc-4817-96c4-fdf8f2afbf19 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "DELETE /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 204 len: 0 microversion: 2.1 time: 0.163425 Aug 04 14:52:37.445490 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3179/6349] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:52:37 2022] DELETE /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:52:37.454192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3922233d-5fc8-4261-90a7-cc6d2337e637 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:37.454824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3922233d-5fc8-4261-90a7-cc6d2337e637 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:37.464473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3922233d-5fc8-4261-90a7-cc6d2337e637 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:37.464960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3922233d-5fc8-4261-90a7-cc6d2337e637 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:37.465771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3922233d-5fc8-4261-90a7-cc6d2337e637 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:37.466224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3922233d-5fc8-4261-90a7-cc6d2337e637 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:37.634429 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3922233d-5fc8-4261-90a7-cc6d2337e637 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1654 microversion: 2.1 time: 0.184002 Aug 04 14:52:37.635062 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3171/6350] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:37 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1654 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:52:38.656619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5ea45448-da2d-44cd-a33d-75a095504cb3 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:38.657415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5ea45448-da2d-44cd-a33d-75a095504cb3 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:38.660199 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:52:38.666810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ea45448-da2d-44cd-a33d-75a095504cb3 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:38.667276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ea45448-da2d-44cd-a33d-75a095504cb3 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:38.668112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ea45448-da2d-44cd-a33d-75a095504cb3 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:38.668565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5ea45448-da2d-44cd-a33d-75a095504cb3 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:39.052538 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5ea45448-da2d-44cd-a33d-75a095504cb3 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 200 len: 1654 microversion: 2.1 time: 0.400277 Aug 04 14:52:39.053178 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3180/6351] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:38 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 1654 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:39.453024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-adf06918-9b23-4552-9654-0d06821ecffe req-e7e803be-bafc-4211-8d79-72bae92914ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41d5580-659f-4162-a3e7-84f21737adf0", "name": "network-vif-deleted", "tag": "3f075c33-9f1b-47a3-b645-fbe402eaeaa9"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:39.482836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-adf06918-9b23-4552-9654-0d06821ecffe req-e7e803be-bafc-4211-8d79-72bae92914ed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:39.484360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-adf06918-9b23-4552-9654-0d06821ecffe req-e7e803be-bafc-4211-8d79-72bae92914ed service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:39.520791 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-adf06918-9b23-4552-9654-0d06821ecffe req-e7e803be-bafc-4211-8d79-72bae92914ed service nova] Creating event network-vif-deleted:3f075c33-9f1b-47a3-b645-fbe402eaeaa9 for instance b41d5580-659f-4162-a3e7-84f21737adf0 on n-h2-844627-10 Aug 04 14:52:39.530913 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-adf06918-9b23-4552-9654-0d06821ecffe req-e7e803be-bafc-4211-8d79-72bae92914ed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087677 Aug 04 14:52:39.534046 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3172/6352] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:52:40.077928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:40.078973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: b41d5580-659f-4162-a3e7-84f21737adf0] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:40.088158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:40.088687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:40.089732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:40.090384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:40.110029 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] HTTP exception thrown: Instance b41d5580-659f-4162-a3e7-84f21737adf0 could not be found. Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Request method failure captured: Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 HTTP/1.1 Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi690ZNO6CCA3JcL-v0LmUHUH1PHrbx--8dwHaryot-BwJHqQOP0LUxUiX7PqSJcscZ2Y5xwWCPS_EPWWOkh7ocGt7d_nhdsYqGIGIgj5nHDO5jaKedha2v6Eazkw-QZ_bbLtvqx0AvXX4Z5qvaDqnpfRT2pVa4LabPmM2_VLyLN3O_GY Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 257ffbae794f4fc5ba5c86c417aee4ec Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestServerMultinode-1126217108 Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/257ffbae794f4fc5ba5c86c417aee4ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_257ffbae794f4fc5ba5c86c417aee4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/257ffbae794f4fc5ba5c86c417aee4ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/257ffbae794f4fc5ba5c86c417aee4ec"}]}] Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestServerMultinode-1126217108 Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 257ffbae794f4fc5ba5c86c417aee4ec Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestServerMultinode-1126217108 Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestServerMultinode-1126217108-project-admin Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 275f33debe9048dea915478c95b6ddb1 Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestServerMultinode-1126217108-project-admin Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance b41d5580-659f-4162-a3e7-84f21737adf0 could not be found. Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b41d5580-659f-4162-a3e7-84f21737adf0'} Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41d5580-659f-4162-a3e7-84f21737adf0 could not be found. Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41d5580-659f-4162-a3e7-84f21737adf0 could not be found. Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:52:40.113228 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41d5580-659f-4162-a3e7-84f21737adf0 could not be found. Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Returning 404 to user: Instance b41d5580-659f-4162-a3e7-84f21737adf0 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f83bf88-aeb2-497c-86fa-e640c46f617a tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0" status: 404 len: 111 microversion: 2.1 time: 0.042964 Aug 04 14:52:40.125315 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3181/6353] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:40 2022] GET /compute/v2.1/servers/b41d5580-659f-4162-a3e7-84f21737adf0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:52:40.133588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0316f7e1-1034-4343-9f26-9b3533bf6407 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:40.134716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0316f7e1-1034-4343-9f26-9b3533bf6407 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:40.146783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0316f7e1-1034-4343-9f26-9b3533bf6407 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:40.147933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0316f7e1-1034-4343-9f26-9b3533bf6407 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:40.149562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0316f7e1-1034-4343-9f26-9b3533bf6407 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:40.150380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0316f7e1-1034-4343-9f26-9b3533bf6407 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:40.188195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0316f7e1-1034-4343-9f26-9b3533bf6407 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:52:40.308304 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0316f7e1-1034-4343-9f26-9b3533bf6407 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "DELETE /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 204 len: 0 microversion: 2.1 time: 0.183448 Aug 04 14:52:40.309405 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3173/6354] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:52:40 2022] DELETE /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 14:52:40.319358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7974a52f-a685-4e10-a73c-ce6a5ec7d425 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:40.320338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7974a52f-a685-4e10-a73c-ce6a5ec7d425 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:40.327639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7974a52f-a685-4e10-a73c-ce6a5ec7d425 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:40.328215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7974a52f-a685-4e10-a73c-ce6a5ec7d425 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:40.329003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7974a52f-a685-4e10-a73c-ce6a5ec7d425 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:40.329461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7974a52f-a685-4e10-a73c-ce6a5ec7d425 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:40.496009 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7974a52f-a685-4e10-a73c-ce6a5ec7d425 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1655 microversion: 2.1 time: 0.181695 Aug 04 14:52:40.496617 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3182/6355] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:40 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1655 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:41.518450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-14b01020-e3b5-4186-9288-5bb385871403 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:41.519333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-14b01020-e3b5-4186-9288-5bb385871403 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:41.527954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14b01020-e3b5-4186-9288-5bb385871403 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:41.528413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14b01020-e3b5-4186-9288-5bb385871403 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:41.529251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14b01020-e3b5-4186-9288-5bb385871403 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:41.529698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14b01020-e3b5-4186-9288-5bb385871403 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:41.720694 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-14b01020-e3b5-4186-9288-5bb385871403 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1655 microversion: 2.1 time: 0.206499 Aug 04 14:52:41.721321 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3174/6356] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:41 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1655 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:42.461773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5f025cb1-cfba-4ef1-8c5d-1652570376dd req-de35c88d-249b-42f7-93bd-b5e00609518d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db2cfae-d080-4862-a736-0f33e0257a64", "name": "network-vif-deleted", "tag": "26ab2ce3-2624-43e2-a7c1-7d24b8e002d3"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:52:42.476940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5f025cb1-cfba-4ef1-8c5d-1652570376dd req-de35c88d-249b-42f7-93bd-b5e00609518d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:42.477395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5f025cb1-cfba-4ef1-8c5d-1652570376dd req-de35c88d-249b-42f7-93bd-b5e00609518d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:42.491636 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5f025cb1-cfba-4ef1-8c5d-1652570376dd req-de35c88d-249b-42f7-93bd-b5e00609518d service nova] Creating event network-vif-deleted:26ab2ce3-2624-43e2-a7c1-7d24b8e002d3 for instance 2db2cfae-d080-4862-a736-0f33e0257a64 on n-h1-844627-10 Aug 04 14:52:42.498435 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5f025cb1-cfba-4ef1-8c5d-1652570376dd req-de35c88d-249b-42f7-93bd-b5e00609518d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040667 Aug 04 14:52:42.499845 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3183/6357] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:52:42.742631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:42.743298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:42.750953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:42.751363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:42.752158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:42.752602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:42.790566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:42.791101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:42.791730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lazy-loading 'fault' on Instance uuid 2db2cfae-d080-4862-a736-0f33e0257a64 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:52:42.868218 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e14fcb1-89dd-4e98-bcfe-1d8879d85d8c tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 200 len: 1455 microversion: 2.1 time: 0.129823 Aug 04 14:52:42.868842 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3175/6358] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:42 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:52:43.890995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:52:43.891701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] [instance: 2db2cfae-d080-4862-a736-0f33e0257a64] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:52:43.899750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:43.900237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:43.901060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:52:43.901538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:52:43.916662 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] HTTP exception thrown: Instance 2db2cfae-d080-4862-a736-0f33e0257a64 could not be found. Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Request method failure captured: Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 HTTP/1.1 Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi690ZNO6CCA3JcL-v0LmUHUH1PHrbx--8dwHaryot-BwJHqQOP0LUxUiX7PqSJcscZ2Y5xwWCPS_EPWWOkh7ocGt7d_nhdsYqGIGIgj5nHDO5jaKedha2v6Eazkw-QZ_bbLtvqx0AvXX4Z5qvaDqnpfRT2pVa4LabPmM2_VLyLN3O_GY Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 257ffbae794f4fc5ba5c86c417aee4ec Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestServerMultinode-1126217108 Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/257ffbae794f4fc5ba5c86c417aee4ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_257ffbae794f4fc5ba5c86c417aee4ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/257ffbae794f4fc5ba5c86c417aee4ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/257ffbae794f4fc5ba5c86c417aee4ec"}]}] Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestServerMultinode-1126217108 Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 257ffbae794f4fc5ba5c86c417aee4ec Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestServerMultinode-1126217108 Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestServerMultinode-1126217108-project-admin Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 275f33debe9048dea915478c95b6ddb1 Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestServerMultinode-1126217108-project-admin Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 2db2cfae-d080-4862-a736-0f33e0257a64 could not be found. Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '2db2cfae-d080-4862-a736-0f33e0257a64'} Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db2cfae-d080-4862-a736-0f33e0257a64 could not be found. Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db2cfae-d080-4862-a736-0f33e0257a64 could not be found. Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:52:43.918386 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db2cfae-d080-4862-a736-0f33e0257a64 could not be found. Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] Returning 404 to user: Instance 2db2cfae-d080-4862-a736-0f33e0257a64 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-64a844e0-600c-4809-9303-c1840fbb88a5 tempest-TestServerMultinode-1126217108 tempest-TestServerMultinode-1126217108-project-admin] 10.222.0.66 "GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64" status: 404 len: 111 microversion: 2.1 time: 0.033057 Aug 04 14:52:43.923755 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3184/6359] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:52:43 2022] GET /compute/v2.1/servers/2db2cfae-d080-4862-a736-0f33e0257a64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:53:56.819043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1951971048", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1854217966", "security_groups": [{"name": "tempest-secgroup-smoke-1281426606"}], "block_device_mapping_v2": [{"uuid": "393a79a3-80a3-4e43-9ab4-64b818d8239a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da90baac-d2cd-4bbe-ac2b-56b8aae47252"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:53:56.832771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:53:56.833559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:53:56.995597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] validate_networks() for [('da90baac-d2cd-4bbe-ac2b-56b8aae47252', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:53:57.718929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:53:57.719514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:53:57.720344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:53:57.720963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:53:57.721521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:53:57.739760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:53:57.740601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:53:57.742631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:53:57.743472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:53:57.788484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:53:57.795547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Getting quotas for user 374c75516444430ea550446cd477e015 and project 3cf6b18d5e2242838d39c4f4467ab4f5. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:53:57.886942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:53:57.891355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='393a79a3-80a3-4e43-9ab4-64b818d8239a',volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:53:58.065814 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd8666b4-bcb8-4272-ad68-4c5473293817 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.255579 Aug 04 14:53:58.068005 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3176/6360] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:53:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:53:58.082716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f16cc9cf-c202-427a-b79b-011ff536727e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:53:58.083800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f16cc9cf-c202-427a-b79b-011ff536727e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:53:58.087620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=9 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:53:58.088766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:53:58.176173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f16cc9cf-c202-427a-b79b-011ff536727e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:53:58.192978 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f16cc9cf-c202-427a-b79b-011ff536727e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1095 microversion: 2.1 time: 0.117418 Aug 04 14:53:58.193893 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3185/6361] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:53:58 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1095 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:53:59.217122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-53582798-58f1-4888-9949-60c25cbc3507 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:53:59.217983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-53582798-58f1-4888-9949-60c25cbc3507 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:53:59.227936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53582798-58f1-4888-9949-60c25cbc3507 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:53:59.228433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53582798-58f1-4888-9949-60c25cbc3507 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:53:59.229271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53582798-58f1-4888-9949-60c25cbc3507 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:53:59.229736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53582798-58f1-4888-9949-60c25cbc3507 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:53:59.308269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-53582798-58f1-4888-9949-60c25cbc3507 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:53:59.320548 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-53582798-58f1-4888-9949-60c25cbc3507 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1193 microversion: 2.1 time: 0.108358 Aug 04 14:53:59.321237 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3177/6362] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:53:59 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:00.348157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-47fc0f69-10f6-4ffc-af66-186389fa9285 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:00.349664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-47fc0f69-10f6-4ffc-af66-186389fa9285 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:00.359239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47fc0f69-10f6-4ffc-af66-186389fa9285 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:00.359682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47fc0f69-10f6-4ffc-af66-186389fa9285 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:00.360499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47fc0f69-10f6-4ffc-af66-186389fa9285 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:00.360975 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47fc0f69-10f6-4ffc-af66-186389fa9285 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:00.476856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-47fc0f69-10f6-4ffc-af66-186389fa9285 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:00.485989 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-47fc0f69-10f6-4ffc-af66-186389fa9285 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1211 microversion: 2.1 time: 0.141780 Aug 04 14:54:00.486732 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3186/6363] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:00 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1211 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:01.516276 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d22e73b9-03e1-4dca-a55f-8fa37c978450 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:01.520622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d22e73b9-03e1-4dca-a55f-8fa37c978450 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:01.551561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d22e73b9-03e1-4dca-a55f-8fa37c978450 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:01.552642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d22e73b9-03e1-4dca-a55f-8fa37c978450 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:01.555796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d22e73b9-03e1-4dca-a55f-8fa37c978450 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:01.556971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d22e73b9-03e1-4dca-a55f-8fa37c978450 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:01.912937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d22e73b9-03e1-4dca-a55f-8fa37c978450 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:01.932503 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d22e73b9-03e1-4dca-a55f-8fa37c978450 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1279 microversion: 2.1 time: 0.427485 Aug 04 14:54:01.945494 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3178/6364] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:01 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1279 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:54:01.977566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d492f54c-9d33-40dd-bc67-ca594c888254 req-c569afc9-ef15-4cff-a9f0-7e886b243d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2811e6f-32b9-49c8-bb43-debf26a6c115", "tag": "1972c389-c2d9-4678-aed0-4c67ecb27d41"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:54:01.995394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d492f54c-9d33-40dd-bc67-ca594c888254 req-c569afc9-ef15-4cff-a9f0-7e886b243d88 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:01.996532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d492f54c-9d33-40dd-bc67-ca594c888254 req-c569afc9-ef15-4cff-a9f0-7e886b243d88 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:02.016552 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d492f54c-9d33-40dd-bc67-ca594c888254 req-c569afc9-ef15-4cff-a9f0-7e886b243d88 service nova] Creating event network-changed:1972c389-c2d9-4678-aed0-4c67ecb27d41 for instance b2811e6f-32b9-49c8-bb43-debf26a6c115 on n-h2-844627-10 Aug 04 14:54:02.023506 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d492f54c-9d33-40dd-bc67-ca594c888254 req-c569afc9-ef15-4cff-a9f0-7e886b243d88 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051539 Aug 04 14:54:02.024729 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3187/6365] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:54:02.994167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ed9d52a-eff3-431d-8ef4-4a045b9db89e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:02.995556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ed9d52a-eff3-431d-8ef4-4a045b9db89e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:03.011715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ed9d52a-eff3-431d-8ef4-4a045b9db89e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:03.012620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ed9d52a-eff3-431d-8ef4-4a045b9db89e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:03.014148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ed9d52a-eff3-431d-8ef4-4a045b9db89e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:03.015159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ed9d52a-eff3-431d-8ef4-4a045b9db89e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:03.317399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8ed9d52a-eff3-431d-8ef4-4a045b9db89e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:03.336474 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ed9d52a-eff3-431d-8ef4-4a045b9db89e tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1279 microversion: 2.1 time: 0.350646 Aug 04 14:54:03.343545 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3179/6366] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:02 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1279 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:04.387366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-031e187f-eb75-4ae2-85ab-a03bba145f65 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:04.389913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-031e187f-eb75-4ae2-85ab-a03bba145f65 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:04.407286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-031e187f-eb75-4ae2-85ab-a03bba145f65 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:04.408650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-031e187f-eb75-4ae2-85ab-a03bba145f65 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:04.410801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-031e187f-eb75-4ae2-85ab-a03bba145f65 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:04.412075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-031e187f-eb75-4ae2-85ab-a03bba145f65 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:04.638737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-031e187f-eb75-4ae2-85ab-a03bba145f65 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:04.647758 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-031e187f-eb75-4ae2-85ab-a03bba145f65 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1279 microversion: 2.1 time: 0.273720 Aug 04 14:54:04.648423 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3188/6367] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:04 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1279 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:05.673772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ddd05b22-fbb4-4eb2-bc22-5e3bc8aae5cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:05.675090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ddd05b22-fbb4-4eb2-bc22-5e3bc8aae5cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:05.685368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ddd05b22-fbb4-4eb2-bc22-5e3bc8aae5cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:05.686015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ddd05b22-fbb4-4eb2-bc22-5e3bc8aae5cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:05.686830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ddd05b22-fbb4-4eb2-bc22-5e3bc8aae5cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:05.687399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ddd05b22-fbb4-4eb2-bc22-5e3bc8aae5cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:05.902551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ddd05b22-fbb4-4eb2-bc22-5e3bc8aae5cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:05.912626 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ddd05b22-fbb4-4eb2-bc22-5e3bc8aae5cd tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1279 microversion: 2.1 time: 0.243648 Aug 04 14:54:05.913472 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3180/6368] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:05 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:06.936037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-418f8ad3-6d88-43d6-856b-652b17970455 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:06.936936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-418f8ad3-6d88-43d6-856b-652b17970455 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:06.945523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-418f8ad3-6d88-43d6-856b-652b17970455 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:06.946139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-418f8ad3-6d88-43d6-856b-652b17970455 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:06.946921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-418f8ad3-6d88-43d6-856b-652b17970455 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:06.947388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-418f8ad3-6d88-43d6-856b-652b17970455 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:07.120385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-418f8ad3-6d88-43d6-856b-652b17970455 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:07.136313 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-418f8ad3-6d88-43d6-856b-652b17970455 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.204196 Aug 04 14:54:07.137528 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3189/6369] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:06 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:08.160831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84b87090-0d01-41ab-b1dc-da8a4ddb49d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:08.161897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84b87090-0d01-41ab-b1dc-da8a4ddb49d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:08.166277 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:54:08.167350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:54:08.175577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84b87090-0d01-41ab-b1dc-da8a4ddb49d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:08.176058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84b87090-0d01-41ab-b1dc-da8a4ddb49d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:08.176957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84b87090-0d01-41ab-b1dc-da8a4ddb49d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:08.177427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84b87090-0d01-41ab-b1dc-da8a4ddb49d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:08.344155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84b87090-0d01-41ab-b1dc-da8a4ddb49d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:08.353986 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84b87090-0d01-41ab-b1dc-da8a4ddb49d9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.197875 Aug 04 14:54:08.354625 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3181/6370] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:08 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:54:09.378392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff3aefa1-edc4-4472-b306-94bd19dfa088 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:09.379271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff3aefa1-edc4-4472-b306-94bd19dfa088 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:09.383422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:54:09.390723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3aefa1-edc4-4472-b306-94bd19dfa088 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:09.391179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3aefa1-edc4-4472-b306-94bd19dfa088 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:09.392015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3aefa1-edc4-4472-b306-94bd19dfa088 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:09.392459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3aefa1-edc4-4472-b306-94bd19dfa088 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:09.545559 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff3aefa1-edc4-4472-b306-94bd19dfa088 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:09.556925 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff3aefa1-edc4-4472-b306-94bd19dfa088 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.184348 Aug 04 14:54:09.557797 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3190/6371] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:09 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:10.593609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6704dc0e-1fb7-48f0-b4f6-a438ff197275 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:10.594375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6704dc0e-1fb7-48f0-b4f6-a438ff197275 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:10.601715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6704dc0e-1fb7-48f0-b4f6-a438ff197275 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:10.602211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6704dc0e-1fb7-48f0-b4f6-a438ff197275 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:10.603006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6704dc0e-1fb7-48f0-b4f6-a438ff197275 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:10.603491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6704dc0e-1fb7-48f0-b4f6-a438ff197275 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:10.787936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6704dc0e-1fb7-48f0-b4f6-a438ff197275 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:10.798478 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6704dc0e-1fb7-48f0-b4f6-a438ff197275 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.208737 Aug 04 14:54:10.799551 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3182/6372] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:10 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:54:11.833967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a809110b-921c-4af9-8569-b0d1ceeadb3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:11.834596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a809110b-921c-4af9-8569-b0d1ceeadb3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:11.843025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a809110b-921c-4af9-8569-b0d1ceeadb3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:11.843476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a809110b-921c-4af9-8569-b0d1ceeadb3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:11.844268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a809110b-921c-4af9-8569-b0d1ceeadb3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:11.844711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a809110b-921c-4af9-8569-b0d1ceeadb3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:12.002361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a809110b-921c-4af9-8569-b0d1ceeadb3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:12.016951 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a809110b-921c-4af9-8569-b0d1ceeadb3d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.186710 Aug 04 14:54:12.017905 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3191/6373] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:11 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:13.048060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-40e51a2a-377c-473b-8147-a10375ba0c96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:13.049009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-40e51a2a-377c-473b-8147-a10375ba0c96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:13.056314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40e51a2a-377c-473b-8147-a10375ba0c96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:13.056780 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40e51a2a-377c-473b-8147-a10375ba0c96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:13.057609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40e51a2a-377c-473b-8147-a10375ba0c96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:13.058063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40e51a2a-377c-473b-8147-a10375ba0c96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:13.208264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-40e51a2a-377c-473b-8147-a10375ba0c96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:13.217134 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-40e51a2a-377c-473b-8147-a10375ba0c96 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.172995 Aug 04 14:54:13.217720 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3183/6374] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:13 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:14.238739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6eaf44b9-87bd-4d4b-95f8-cd54359e704d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:14.239469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6eaf44b9-87bd-4d4b-95f8-cd54359e704d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:14.247082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6eaf44b9-87bd-4d4b-95f8-cd54359e704d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:14.247533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6eaf44b9-87bd-4d4b-95f8-cd54359e704d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:14.248333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6eaf44b9-87bd-4d4b-95f8-cd54359e704d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:14.248778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6eaf44b9-87bd-4d4b-95f8-cd54359e704d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:14.410057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6eaf44b9-87bd-4d4b-95f8-cd54359e704d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:14.419695 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6eaf44b9-87bd-4d4b-95f8-cd54359e704d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.184792 Aug 04 14:54:14.420340 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3192/6375] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:14 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:15.442050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a5aeb21c-f0ed-45c4-98cb-d28641a580c6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:15.442648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a5aeb21c-f0ed-45c4-98cb-d28641a580c6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:15.452290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5aeb21c-f0ed-45c4-98cb-d28641a580c6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:15.453195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5aeb21c-f0ed-45c4-98cb-d28641a580c6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:15.454688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5aeb21c-f0ed-45c4-98cb-d28641a580c6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:15.455494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5aeb21c-f0ed-45c4-98cb-d28641a580c6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:15.615923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a5aeb21c-f0ed-45c4-98cb-d28641a580c6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:15.624956 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a5aeb21c-f0ed-45c4-98cb-d28641a580c6 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.186864 Aug 04 14:54:15.625560 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3184/6376] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:15 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:54:16.645628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-86c70286-2118-4aec-8e32-355402eb8d07 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:16.646440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-86c70286-2118-4aec-8e32-355402eb8d07 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:16.654201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86c70286-2118-4aec-8e32-355402eb8d07 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:16.654660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86c70286-2118-4aec-8e32-355402eb8d07 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:16.655473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86c70286-2118-4aec-8e32-355402eb8d07 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:16.655993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-86c70286-2118-4aec-8e32-355402eb8d07 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:16.837485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-86c70286-2118-4aec-8e32-355402eb8d07 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:16.841094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3e5bc206-9859-4519-ad6c-1d85002d9d22 req-5b3c36aa-03b0-4b92-8e2b-848f26b9418f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2811e6f-32b9-49c8-bb43-debf26a6c115", "name": "network-vif-plugged", "status": "completed", "tag": "1972c389-c2d9-4678-aed0-4c67ecb27d41"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:54:16.846156 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-86c70286-2118-4aec-8e32-355402eb8d07 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.204772 Aug 04 14:54:16.846749 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3193/6377] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:16 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:16.865167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3e5bc206-9859-4519-ad6c-1d85002d9d22 req-5b3c36aa-03b0-4b92-8e2b-848f26b9418f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:16.866039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3e5bc206-9859-4519-ad6c-1d85002d9d22 req-5b3c36aa-03b0-4b92-8e2b-848f26b9418f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:16.878846 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3e5bc206-9859-4519-ad6c-1d85002d9d22 req-5b3c36aa-03b0-4b92-8e2b-848f26b9418f service nova] Creating event network-vif-plugged:1972c389-c2d9-4678-aed0-4c67ecb27d41 for instance b2811e6f-32b9-49c8-bb43-debf26a6c115 on n-h2-844627-10 Aug 04 14:54:16.884623 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3e5bc206-9859-4519-ad6c-1d85002d9d22 req-5b3c36aa-03b0-4b92-8e2b-848f26b9418f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051682 Aug 04 14:54:16.885702 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3185/6378] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:54:17.868661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e2f640a7-b41e-4b54-b3c9-d0f31f6d4adb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:17.869433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e2f640a7-b41e-4b54-b3c9-d0f31f6d4adb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:17.876965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2f640a7-b41e-4b54-b3c9-d0f31f6d4adb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:17.877431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2f640a7-b41e-4b54-b3c9-d0f31f6d4adb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:17.878235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2f640a7-b41e-4b54-b3c9-d0f31f6d4adb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:17.878683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e2f640a7-b41e-4b54-b3c9-d0f31f6d4adb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:18.101812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e2f640a7-b41e-4b54-b3c9-d0f31f6d4adb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:18.110255 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e2f640a7-b41e-4b54-b3c9-d0f31f6d4adb tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1267 microversion: 2.1 time: 0.245912 Aug 04 14:54:18.110964 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3194/6379] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:17 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:19.134654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-27a9afa2-0580-4d57-bcda-d0e1bc58eb7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:19.135839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-27a9afa2-0580-4d57-bcda-d0e1bc58eb7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:19.145319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27a9afa2-0580-4d57-bcda-d0e1bc58eb7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:19.146058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27a9afa2-0580-4d57-bcda-d0e1bc58eb7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:19.147351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27a9afa2-0580-4d57-bcda-d0e1bc58eb7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:19.148721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-27a9afa2-0580-4d57-bcda-d0e1bc58eb7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:19.406321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-27a9afa2-0580-4d57-bcda-d0e1bc58eb7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:19.421665 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-27a9afa2-0580-4d57-bcda-d0e1bc58eb7c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1452 microversion: 2.1 time: 0.292344 Aug 04 14:54:19.422208 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3186/6380] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:19 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1452 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:19.444247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-564c2f65-d7f3-4157-a622-f6cd50e40674 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:54:19.445723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-564c2f65-d7f3-4157-a622-f6cd50e40674 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:54:19.454369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-564c2f65-d7f3-4157-a622-f6cd50e40674 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:19.454825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-564c2f65-d7f3-4157-a622-f6cd50e40674 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:19.455616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-564c2f65-d7f3-4157-a622-f6cd50e40674 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:19.456053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-564c2f65-d7f3-4157-a622-f6cd50e40674 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:19.657198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-564c2f65-d7f3-4157-a622-f6cd50e40674 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:54:19.674217 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-564c2f65-d7f3-4157-a622-f6cd50e40674 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1452 microversion: 2.1 time: 0.233258 Aug 04 14:54:19.676079 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3195/6381] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:54:19 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1452 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:54:21.694056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-71d1fac2-3db6-4dd0-9723-8e92fbb48846 req-acd86444-5692-4c5a-8c60-d3aab4919ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2811e6f-32b9-49c8-bb43-debf26a6c115", "tag": "1972c389-c2d9-4678-aed0-4c67ecb27d41"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:54:21.705657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-71d1fac2-3db6-4dd0-9723-8e92fbb48846 req-acd86444-5692-4c5a-8c60-d3aab4919ec8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:54:21.706116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-71d1fac2-3db6-4dd0-9723-8e92fbb48846 req-acd86444-5692-4c5a-8c60-d3aab4919ec8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:54:21.718936 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-71d1fac2-3db6-4dd0-9723-8e92fbb48846 req-acd86444-5692-4c5a-8c60-d3aab4919ec8 service nova] Creating event network-changed:1972c389-c2d9-4678-aed0-4c67ecb27d41 for instance b2811e6f-32b9-49c8-bb43-debf26a6c115 on n-h2-844627-10 Aug 04 14:54:21.724552 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-71d1fac2-3db6-4dd0-9723-8e92fbb48846 req-acd86444-5692-4c5a-8c60-d3aab4919ec8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034132 Aug 04 14:54:21.725230 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3187/6382] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:55:03.621226 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:55:03.621941 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:55:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:55:03.771425 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:55:03.771712 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 14:55:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:55:03.930674 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:55:03.931415 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 14:55:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:55:50.465778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=24 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:55:50.466754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=56 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:55:50.469587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:55:50.470556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=60 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:55:50.471314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b9f7672-50c9-4e29-b714-18de939355a7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:55:50.471835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b9f7672-50c9-4e29-b714-18de939355a7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:55:50.476592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-435dba5f-91ac-4086-9df6-b1b5f4df433d req-58b8a83a-2c89-4cd1-80f6-7334f08cea66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2811e6f-32b9-49c8-bb43-debf26a6c115", "tag": "1972c389-c2d9-4678-aed0-4c67ecb27d41"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:55:50.480454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b9f7672-50c9-4e29-b714-18de939355a7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:50.481074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b9f7672-50c9-4e29-b714-18de939355a7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:50.481883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b9f7672-50c9-4e29-b714-18de939355a7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:50.482596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b9f7672-50c9-4e29-b714-18de939355a7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:50.489603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-435dba5f-91ac-4086-9df6-b1b5f4df433d req-58b8a83a-2c89-4cd1-80f6-7334f08cea66 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:50.490056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-435dba5f-91ac-4086-9df6-b1b5f4df433d req-58b8a83a-2c89-4cd1-80f6-7334f08cea66 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:50.503664 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-435dba5f-91ac-4086-9df6-b1b5f4df433d req-58b8a83a-2c89-4cd1-80f6-7334f08cea66 service nova] Creating event network-changed:1972c389-c2d9-4678-aed0-4c67ecb27d41 for instance b2811e6f-32b9-49c8-bb43-debf26a6c115 on n-h2-844627-10 Aug 04 14:55:50.509863 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-435dba5f-91ac-4086-9df6-b1b5f4df433d req-58b8a83a-2c89-4cd1-80f6-7334f08cea66 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043185 Aug 04 14:55:50.510733 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3188/6383] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:55:50.513388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b9f7672-50c9-4e29-b714-18de939355a7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:55:50.625082 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b9f7672-50c9-4e29-b714-18de939355a7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 204 len: 0 microversion: 2.1 time: 0.159967 Aug 04 14:55:50.626371 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3196/6384] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:55:50 2022] DELETE /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:55:50.637608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d8d5e0f5-422c-4112-9901-c0b301f4a794 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:55:50.638863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d8d5e0f5-422c-4112-9901-c0b301f4a794 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:55:50.649524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d8d5e0f5-422c-4112-9901-c0b301f4a794 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:50.650464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d8d5e0f5-422c-4112-9901-c0b301f4a794 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:50.651537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d8d5e0f5-422c-4112-9901-c0b301f4a794 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:50.652305 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d8d5e0f5-422c-4112-9901-c0b301f4a794 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:50.802332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d8d5e0f5-422c-4112-9901-c0b301f4a794 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:55:50.812711 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d8d5e0f5-422c-4112-9901-c0b301f4a794 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1576 microversion: 2.1 time: 0.181199 Aug 04 14:55:50.813580 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3189/6385] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:55:50 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:55:51.836168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b7d4db2-bf3a-407f-ad80-65721ecb012d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:55:51.837634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b7d4db2-bf3a-407f-ad80-65721ecb012d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:55:51.845251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b7d4db2-bf3a-407f-ad80-65721ecb012d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:51.845713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b7d4db2-bf3a-407f-ad80-65721ecb012d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:51.846497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b7d4db2-bf3a-407f-ad80-65721ecb012d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:51.846936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b7d4db2-bf3a-407f-ad80-65721ecb012d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:52.009839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b7d4db2-bf3a-407f-ad80-65721ecb012d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:55:52.017654 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b7d4db2-bf3a-407f-ad80-65721ecb012d tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1576 microversion: 2.1 time: 0.185766 Aug 04 14:55:52.018490 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3197/6386] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:55:51 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:55:52.618295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-cb667669-721d-47a9-969c-9e4d6e626f6c req-4876fce3-9e30-437a-ad55-f6cc4733ffe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2811e6f-32b9-49c8-bb43-debf26a6c115", "name": "network-vif-deleted", "tag": "1972c389-c2d9-4678-aed0-4c67ecb27d41"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:55:52.630712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cb667669-721d-47a9-969c-9e4d6e626f6c req-4876fce3-9e30-437a-ad55-f6cc4733ffe3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:52.631265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-cb667669-721d-47a9-969c-9e4d6e626f6c req-4876fce3-9e30-437a-ad55-f6cc4733ffe3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:52.643951 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-cb667669-721d-47a9-969c-9e4d6e626f6c req-4876fce3-9e30-437a-ad55-f6cc4733ffe3 service nova] Creating event network-vif-deleted:1972c389-c2d9-4678-aed0-4c67ecb27d41 for instance b2811e6f-32b9-49c8-bb43-debf26a6c115 on n-h2-844627-10 Aug 04 14:55:52.649884 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-cb667669-721d-47a9-969c-9e4d6e626f6c req-4876fce3-9e30-437a-ad55-f6cc4733ffe3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035809 Aug 04 14:55:52.650471 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3190/6387] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:55:53.040297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30397eb7-08f1-4ccc-af96-94525f4119c3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:55:53.040998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-30397eb7-08f1-4ccc-af96-94525f4119c3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:55:53.048378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30397eb7-08f1-4ccc-af96-94525f4119c3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:53.048835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30397eb7-08f1-4ccc-af96-94525f4119c3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:53.049691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30397eb7-08f1-4ccc-af96-94525f4119c3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:53.050136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30397eb7-08f1-4ccc-af96-94525f4119c3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:53.126162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-30397eb7-08f1-4ccc-af96-94525f4119c3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:55:53.133948 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30397eb7-08f1-4ccc-af96-94525f4119c3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1226 microversion: 2.1 time: 0.098081 Aug 04 14:55:53.134522 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3198/6388] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:55:53 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:55:54.155422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af4d9434-354e-4b36-bc85-cf4a2ea4ecb8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:55:54.156358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af4d9434-354e-4b36-bc85-cf4a2ea4ecb8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:55:54.164048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af4d9434-354e-4b36-bc85-cf4a2ea4ecb8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:54.165198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af4d9434-354e-4b36-bc85-cf4a2ea4ecb8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:54.166046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af4d9434-354e-4b36-bc85-cf4a2ea4ecb8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:54.166575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af4d9434-354e-4b36-bc85-cf4a2ea4ecb8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:54.230399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-af4d9434-354e-4b36-bc85-cf4a2ea4ecb8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:55:54.238193 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af4d9434-354e-4b36-bc85-cf4a2ea4ecb8 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1226 microversion: 2.1 time: 0.087000 Aug 04 14:55:54.238766 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3191/6389] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:55:54 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:55:55.259787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b6cfa6b8-aa1b-4c7e-812f-4d58d7d743bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:55:55.260411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b6cfa6b8-aa1b-4c7e-812f-4d58d7d743bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:55:55.267892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b6cfa6b8-aa1b-4c7e-812f-4d58d7d743bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:55.268278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b6cfa6b8-aa1b-4c7e-812f-4d58d7d743bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:55.269103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b6cfa6b8-aa1b-4c7e-812f-4d58d7d743bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:55.269552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b6cfa6b8-aa1b-4c7e-812f-4d58d7d743bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:55.334690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b6cfa6b8-aa1b-4c7e-812f-4d58d7d743bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:55:55.342691 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b6cfa6b8-aa1b-4c7e-812f-4d58d7d743bf tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1226 microversion: 2.1 time: 0.087354 Aug 04 14:55:55.343461 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3199/6390] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:55:55 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:55:56.363631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a5d507a8-90f7-4d5e-8769-d40dd89de840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:55:56.364275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a5d507a8-90f7-4d5e-8769-d40dd89de840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:55:56.371795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d507a8-90f7-4d5e-8769-d40dd89de840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:56.372263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d507a8-90f7-4d5e-8769-d40dd89de840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:56.373100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d507a8-90f7-4d5e-8769-d40dd89de840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:56.373558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5d507a8-90f7-4d5e-8769-d40dd89de840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:56.440117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a5d507a8-90f7-4d5e-8769-d40dd89de840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:55:56.448172 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a5d507a8-90f7-4d5e-8769-d40dd89de840 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 200 len: 1226 microversion: 2.1 time: 0.088417 Aug 04 14:55:56.448752 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3192/6391] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:55:56 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:55:57.469966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:55:57.470587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: b2811e6f-32b9-49c8-bb43-debf26a6c115] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:55:57.477540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:57.477999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:57.478779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:55:57.479223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:55:57.493032 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance b2811e6f-32b9-49c8-bb43-debf26a6c115 could not be found. Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 HTTP/1.1 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance b2811e6f-32b9-49c8-bb43-debf26a6c115 could not be found. Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b2811e6f-32b9-49c8-bb43-debf26a6c115'} Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2811e6f-32b9-49c8-bb43-debf26a6c115 could not be found. Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2811e6f-32b9-49c8-bb43-debf26a6c115 could not be found. Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:55:57.494753 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2811e6f-32b9-49c8-bb43-debf26a6c115 could not be found. Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance b2811e6f-32b9-49c8-bb43-debf26a6c115 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6d57561e-c4c6-439f-8ed3-20e27bada0e4 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115" status: 404 len: 111 microversion: 2.1 time: 0.030248 Aug 04 14:55:57.500586 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3200/6392] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:55:57 2022] GET /compute/v2.1/servers/b2811e6f-32b9-49c8-bb43-debf26a6c115 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:56:03.890837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f56e1aa3-76ff-4c5b-b3a3-ccd587a58a06 req-e48adba2-b40e-4edd-b846-7e7aecb105f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158b5fc8-b117-49e4-8e51-048f21012c10", "tag": "b36e88b7-2c24-499f-a193-e5bc510b6cf0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:03.900236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d2e045ce-cf2b-45b1-be11-29a940630599 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:03.901015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d2e045ce-cf2b-45b1-be11-29a940630599 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:03.908497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2e045ce-cf2b-45b1-be11-29a940630599 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:03.909084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2e045ce-cf2b-45b1-be11-29a940630599 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:03.909451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f56e1aa3-76ff-4c5b-b3a3-ccd587a58a06 req-e48adba2-b40e-4edd-b846-7e7aecb105f0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:03.909872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2e045ce-cf2b-45b1-be11-29a940630599 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:03.910002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f56e1aa3-76ff-4c5b-b3a3-ccd587a58a06 req-e48adba2-b40e-4edd-b846-7e7aecb105f0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:03.910466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d2e045ce-cf2b-45b1-be11-29a940630599 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:03.923352 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f56e1aa3-76ff-4c5b-b3a3-ccd587a58a06 req-e48adba2-b40e-4edd-b846-7e7aecb105f0 service nova] Creating event network-changed:b36e88b7-2c24-499f-a193-e5bc510b6cf0 for instance 158b5fc8-b117-49e4-8e51-048f21012c10 on n-h1-844627-10 Aug 04 14:56:03.931504 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f56e1aa3-76ff-4c5b-b3a3-ccd587a58a06 req-e48adba2-b40e-4edd-b846-7e7aecb105f0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041745 Aug 04 14:56:03.931504 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3201/6393] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:56:03.943528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d2e045ce-cf2b-45b1-be11-29a940630599 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:56:04.041169 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d2e045ce-cf2b-45b1-be11-29a940630599 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 204 len: 0 microversion: 2.1 time: 0.155940 Aug 04 14:56:04.045147 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3193/6394] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:56:03 2022] DELETE /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:56:04.053663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-60dceb1e-8afc-4838-91f1-193da479e1b3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:04.054509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-60dceb1e-8afc-4838-91f1-193da479e1b3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:04.063931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-60dceb1e-8afc-4838-91f1-193da479e1b3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:04.064794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-60dceb1e-8afc-4838-91f1-193da479e1b3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:04.066269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-60dceb1e-8afc-4838-91f1-193da479e1b3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:04.066929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-60dceb1e-8afc-4838-91f1-193da479e1b3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:04.251536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-60dceb1e-8afc-4838-91f1-193da479e1b3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:04.259721 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-60dceb1e-8afc-4838-91f1-193da479e1b3 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1574 microversion: 2.1 time: 0.212408 Aug 04 14:56:04.260389 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3202/6395] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:04 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:05.283543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1f19c3db-d300-41e1-8781-b178c356a8f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:05.284632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1f19c3db-d300-41e1-8781-b178c356a8f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:05.293447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f19c3db-d300-41e1-8781-b178c356a8f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:05.293841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f19c3db-d300-41e1-8781-b178c356a8f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:05.294868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f19c3db-d300-41e1-8781-b178c356a8f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:05.295472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1f19c3db-d300-41e1-8781-b178c356a8f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:05.485483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1f19c3db-d300-41e1-8781-b178c356a8f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:05.493385 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1f19c3db-d300-41e1-8781-b178c356a8f7 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1574 microversion: 2.1 time: 0.215381 Aug 04 14:56:05.494823 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3194/6396] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:05 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:06.402042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-2818d213-be4a-4d7e-ac02-d4ce52c5f26b req-633d6cfd-9f11-4a1e-8cfe-73cafb38485f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158b5fc8-b117-49e4-8e51-048f21012c10", "name": "network-vif-deleted", "tag": "b36e88b7-2c24-499f-a193-e5bc510b6cf0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:06.414184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2818d213-be4a-4d7e-ac02-d4ce52c5f26b req-633d6cfd-9f11-4a1e-8cfe-73cafb38485f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:06.414727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-2818d213-be4a-4d7e-ac02-d4ce52c5f26b req-633d6cfd-9f11-4a1e-8cfe-73cafb38485f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:06.427534 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-2818d213-be4a-4d7e-ac02-d4ce52c5f26b req-633d6cfd-9f11-4a1e-8cfe-73cafb38485f service nova] Creating event network-vif-deleted:b36e88b7-2c24-499f-a193-e5bc510b6cf0 for instance 158b5fc8-b117-49e4-8e51-048f21012c10 on n-h1-844627-10 Aug 04 14:56:06.432915 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-2818d213-be4a-4d7e-ac02-d4ce52c5f26b req-633d6cfd-9f11-4a1e-8cfe-73cafb38485f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036158 Aug 04 14:56:06.433787 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3203/6397] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:56:06.516401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4f0a934-a7ee-4613-ac05-cf61353c072a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:06.517075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4f0a934-a7ee-4613-ac05-cf61353c072a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:06.526130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f0a934-a7ee-4613-ac05-cf61353c072a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:06.526937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f0a934-a7ee-4613-ac05-cf61353c072a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:06.527766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f0a934-a7ee-4613-ac05-cf61353c072a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:06.528213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4f0a934-a7ee-4613-ac05-cf61353c072a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:06.609988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d4f0a934-a7ee-4613-ac05-cf61353c072a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:06.624580 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4f0a934-a7ee-4613-ac05-cf61353c072a tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1225 microversion: 2.1 time: 0.111668 Aug 04 14:56:06.625792 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3195/6398] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:06 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:07.648368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4aca1f54-6b72-4ce2-a3e9-fee48fb3cb8b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:07.649024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4aca1f54-6b72-4ce2-a3e9-fee48fb3cb8b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:07.656355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aca1f54-6b72-4ce2-a3e9-fee48fb3cb8b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:07.656811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aca1f54-6b72-4ce2-a3e9-fee48fb3cb8b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:07.657636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aca1f54-6b72-4ce2-a3e9-fee48fb3cb8b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:07.658085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4aca1f54-6b72-4ce2-a3e9-fee48fb3cb8b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:07.755699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4aca1f54-6b72-4ce2-a3e9-fee48fb3cb8b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:07.764281 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4aca1f54-6b72-4ce2-a3e9-fee48fb3cb8b tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1225 microversion: 2.1 time: 0.121217 Aug 04 14:56:07.764912 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3204/6399] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:07 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:56:08.787965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be16daa8-afc3-4a0e-8438-d193d04b6bf9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:08.788701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be16daa8-afc3-4a0e-8438-d193d04b6bf9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:08.797850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be16daa8-afc3-4a0e-8438-d193d04b6bf9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:08.798337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be16daa8-afc3-4a0e-8438-d193d04b6bf9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:08.799238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be16daa8-afc3-4a0e-8438-d193d04b6bf9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:08.799701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be16daa8-afc3-4a0e-8438-d193d04b6bf9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:09.186320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-be16daa8-afc3-4a0e-8438-d193d04b6bf9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:09.200324 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be16daa8-afc3-4a0e-8438-d193d04b6bf9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1225 microversion: 2.1 time: 0.416563 Aug 04 14:56:09.201063 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3196/6400] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:08 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1225 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:10.226466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be5afa23-c641-481a-9879-9691c403473c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:10.227549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-be5afa23-c641-481a-9879-9691c403473c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:10.239784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be5afa23-c641-481a-9879-9691c403473c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:10.240598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be5afa23-c641-481a-9879-9691c403473c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:10.242104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be5afa23-c641-481a-9879-9691c403473c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:10.242942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be5afa23-c641-481a-9879-9691c403473c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:10.337004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-be5afa23-c641-481a-9879-9691c403473c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374c75516444430ea550446cd477e015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf6b18d5e2242838d39c4f4467ab4f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:10.345842 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-be5afa23-c641-481a-9879-9691c403473c tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 200 len: 1225 microversion: 2.1 time: 0.127245 Aug 04 14:56:10.346550 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3205/6401] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:10 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:11.374218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:11.374822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: 158b5fc8-b117-49e4-8e51-048f21012c10] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:11.382101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:11.382602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:11.383409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:11.383867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:11.401136 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance 158b5fc8-b117-49e4-8e51-048f21012c10 could not be found. Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 HTTP/1.1 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 158b5fc8-b117-49e4-8e51-048f21012c10 could not be found. Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '158b5fc8-b117-49e4-8e51-048f21012c10'} Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158b5fc8-b117-49e4-8e51-048f21012c10 could not be found. Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158b5fc8-b117-49e4-8e51-048f21012c10 could not be found. Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:11.402847 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158b5fc8-b117-49e4-8e51-048f21012c10 could not be found. Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance 158b5fc8-b117-49e4-8e51-048f21012c10 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a38b0b0-c979-4529-9efc-d46df995d035 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10" status: 404 len: 111 microversion: 2.1 time: 0.034345 Aug 04 14:56:11.411286 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3197/6402] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:11 2022] GET /compute/v2.1/servers/158b5fc8-b117-49e4-8e51-048f21012c10 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:56:11.894769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:11.895597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:11.902288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:11.902748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:11.903518 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:11.903957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:11.917672 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 HTTP/1.1 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'fd820c65-e562-4bac-8fe5-dd80fc25d312'} Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:56:11.919364 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f10745fd-d3a2-4910-a1ae-e95b81eade1f tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 404 len: 111 microversion: 2.1 time: 0.030117 Aug 04 14:56:11.926130 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3206/6403] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:56:11 2022] DELETE /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:56:11.929504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:11.930160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] [instance: fd820c65-e562-4bac-8fe5-dd80fc25d312] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:11.937252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:11.937721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:11.938513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:11.938964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:11.953643 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] HTTP exception thrown: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Request method failure captured: Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 HTTP/1.1 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi69qsbHdx1Dy_1VqDSnFHTFw-ILeluVZw7OWjHRcbQRovkr1a5DX6a1nZoR9qwnxZoYsi4d389vuDXtp5Us4EP-2O3gQOhxAaRNmezXGvz6BdH22BQ0czR5HELJplX9KkYIJf9XvH8LvdqDhEZ7TXhs2PNjgzTJ1gb2C9OPqRkjyN0PI Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3cf6b18d5e2242838d39c4f4467ab4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3cf6b18d5e2242838d39c4f4467ab4f5"}]}] Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 3cf6b18d5e2242838d39c4f4467ab4f5 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestVolumeBootPattern-1229292636 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 374c75516444430ea550446cd477e015 Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestVolumeBootPattern-1229292636-project Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'fd820c65-e562-4bac-8fe5-dd80fc25d312'} Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:11.955480 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Returning 404 to user: Instance fd820c65-e562-4bac-8fe5-dd80fc25d312 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c8a3a12-174f-4df8-96df-39ba6e47d2f9 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312" status: 404 len: 111 microversion: 2.1 time: 0.031264 Aug 04 14:56:11.960757 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3198/6404] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:11 2022] GET /compute/v2.1/servers/fd820c65-e562-4bac-8fe5-dd80fc25d312 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:56:15.430231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b09c762f-bc5e-48dc-bfd5-5908e2197e92 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] Calling method '.version_select at 0x7f470005d310>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:15.466252 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b09c762f-bc5e-48dc-bfd5-5908e2197e92 tempest-TestVolumeBootPattern-1229292636 tempest-TestVolumeBootPattern-1229292636-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1854217966" status: 202 len: 0 microversion: 2.1 time: 0.039734 Aug 04 14:56:15.467440 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3207/6405] 10.222.0.66 () {58 vars in 1263 bytes} [Thu Aug 4 14:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1854217966 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:56:36.441883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:36.442656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:36.625777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2061896931", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:36.681639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] validate_networks() for None {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:56:37.040238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:56:37.041990 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:56:37.042273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:56:37.042703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:56:37.043137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:56:37.053958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:37.054768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:37.056845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:37.057706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:37.078298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Getting quotas for project d7e41e2b25884bada4ea5c864412dad6. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:56:37.086040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Getting quotas for user 110eb96c970046a7ba5c0bf26ec18237 and project d7e41e2b25884bada4ea5c864412dad6. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:56:37.099525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:56:37.101857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:56:37.155716 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf2ddaa3-d119-4533-8450-dfae192de37f tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719511 Aug 04 14:56:37.157307 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3199/6406] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:56:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:56:37.170332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:37.171245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:37.177440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba2aaa6a-6271-4b3f-9e56-fdb1545f1933 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:37.178106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba2aaa6a-6271-4b3f-9e56-fdb1545f1933 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:37.244581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba2aaa6a-6271-4b3f-9e56-fdb1545f1933 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:37.256179 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba2aaa6a-6271-4b3f-9e56-fdb1545f1933 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1222 microversion: 2.1 time: 0.087433 Aug 04 14:56:37.257204 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3208/6407] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:37 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:56:38.278610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c1d1bc02-e7a6-4c84-964c-4075524f5910 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:38.279543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c1d1bc02-e7a6-4c84-964c-4075524f5910 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:38.289093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1d1bc02-e7a6-4c84-964c-4075524f5910 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:38.289957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1d1bc02-e7a6-4c84-964c-4075524f5910 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:38.291980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1d1bc02-e7a6-4c84-964c-4075524f5910 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:38.292819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c1d1bc02-e7a6-4c84-964c-4075524f5910 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:38.414542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c1d1bc02-e7a6-4c84-964c-4075524f5910 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:38.430589 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c1d1bc02-e7a6-4c84-964c-4075524f5910 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1274 microversion: 2.1 time: 0.156029 Aug 04 14:56:38.431864 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3200/6408] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:38 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:39.461428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2d774d46-9641-4a6a-bae4-d63f5be842e1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:39.464640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2d774d46-9641-4a6a-bae4-d63f5be842e1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:39.476278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d774d46-9641-4a6a-bae4-d63f5be842e1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:39.477096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d774d46-9641-4a6a-bae4-d63f5be842e1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:39.478758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d774d46-9641-4a6a-bae4-d63f5be842e1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:39.479514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2d774d46-9641-4a6a-bae4-d63f5be842e1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:39.839659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2d774d46-9641-4a6a-bae4-d63f5be842e1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:39.848633 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2d774d46-9641-4a6a-bae4-d63f5be842e1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1322 microversion: 2.1 time: 0.392047 Aug 04 14:56:39.849270 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3209/6409] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:39 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:40.328108 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-bedaeefe-4ce4-4f74-9859-e57dafd4f011 req-231df502-912d-4a32-aa2c-b2fa0bce2e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31789bd6-61d7-4f5d-9dda-8ed679dd1944", "tag": "a17f5e37-f324-47b7-878c-4d4e5bb83269"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:40.341188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bedaeefe-4ce4-4f74-9859-e57dafd4f011 req-231df502-912d-4a32-aa2c-b2fa0bce2e44 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:40.341831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-bedaeefe-4ce4-4f74-9859-e57dafd4f011 req-231df502-912d-4a32-aa2c-b2fa0bce2e44 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:40.355861 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-bedaeefe-4ce4-4f74-9859-e57dafd4f011 req-231df502-912d-4a32-aa2c-b2fa0bce2e44 service nova] Creating event network-changed:a17f5e37-f324-47b7-878c-4d4e5bb83269 for instance 31789bd6-61d7-4f5d-9dda-8ed679dd1944 on n-h2-844627-10 Aug 04 14:56:40.362872 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-bedaeefe-4ce4-4f74-9859-e57dafd4f011 req-231df502-912d-4a32-aa2c-b2fa0bce2e44 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145542 Aug 04 14:56:40.363609 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3201/6410] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:56:40.881417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9dafbc9b-a4e3-4561-ac28-253a6a4b39b1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:40.882095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9dafbc9b-a4e3-4561-ac28-253a6a4b39b1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:40.889878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dafbc9b-a4e3-4561-ac28-253a6a4b39b1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:40.890328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dafbc9b-a4e3-4561-ac28-253a6a4b39b1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:40.891119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dafbc9b-a4e3-4561-ac28-253a6a4b39b1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:40.891561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dafbc9b-a4e3-4561-ac28-253a6a4b39b1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:41.041730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9dafbc9b-a4e3-4561-ac28-253a6a4b39b1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:41.050755 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9dafbc9b-a4e3-4561-ac28-253a6a4b39b1 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1322 microversion: 2.1 time: 0.173503 Aug 04 14:56:41.051646 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3210/6411] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:40 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:42.075699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1dfd939-e91e-4d95-a466-b5af7f291ad5 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:42.076583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e1dfd939-e91e-4d95-a466-b5af7f291ad5 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:42.085644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1dfd939-e91e-4d95-a466-b5af7f291ad5 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:42.086412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1dfd939-e91e-4d95-a466-b5af7f291ad5 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:42.087857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1dfd939-e91e-4d95-a466-b5af7f291ad5 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:42.088418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1dfd939-e91e-4d95-a466-b5af7f291ad5 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:42.236792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e1dfd939-e91e-4d95-a466-b5af7f291ad5 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:42.245233 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e1dfd939-e91e-4d95-a466-b5af7f291ad5 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1322 microversion: 2.1 time: 0.176228 Aug 04 14:56:42.245809 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3202/6412] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:42 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:43.266504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d63df315-4f64-48d1-8ba4-4fb404f04aed tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:43.267173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d63df315-4f64-48d1-8ba4-4fb404f04aed tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:43.274541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d63df315-4f64-48d1-8ba4-4fb404f04aed tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:43.275598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d63df315-4f64-48d1-8ba4-4fb404f04aed tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:43.276410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d63df315-4f64-48d1-8ba4-4fb404f04aed tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:43.276857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d63df315-4f64-48d1-8ba4-4fb404f04aed tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:43.439928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d63df315-4f64-48d1-8ba4-4fb404f04aed tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:43.448510 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d63df315-4f64-48d1-8ba4-4fb404f04aed tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1322 microversion: 2.1 time: 0.185934 Aug 04 14:56:43.449133 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3211/6413] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:43 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:44.482356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c697f02-37b8-4052-9d65-8167be1eb2c9 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:44.483029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c697f02-37b8-4052-9d65-8167be1eb2c9 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:44.490794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c697f02-37b8-4052-9d65-8167be1eb2c9 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:44.491316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c697f02-37b8-4052-9d65-8167be1eb2c9 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:44.492156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c697f02-37b8-4052-9d65-8167be1eb2c9 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:44.492635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c697f02-37b8-4052-9d65-8167be1eb2c9 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:44.655836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c697f02-37b8-4052-9d65-8167be1eb2c9 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:44.665364 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c697f02-37b8-4052-9d65-8167be1eb2c9 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1322 microversion: 2.1 time: 0.186876 Aug 04 14:56:44.665943 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3203/6414] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:44 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:45.527733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e1412f25-f72d-424a-9781-858b6c10f1a8 req-4a808aa3-6333-4ab2-a586-2c1cb7131925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31789bd6-61d7-4f5d-9dda-8ed679dd1944", "name": "network-vif-plugged", "status": "completed", "tag": "a17f5e37-f324-47b7-878c-4d4e5bb83269"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:45.551006 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e1412f25-f72d-424a-9781-858b6c10f1a8 req-4a808aa3-6333-4ab2-a586-2c1cb7131925 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:45.551808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e1412f25-f72d-424a-9781-858b6c10f1a8 req-4a808aa3-6333-4ab2-a586-2c1cb7131925 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:45.572366 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e1412f25-f72d-424a-9781-858b6c10f1a8 req-4a808aa3-6333-4ab2-a586-2c1cb7131925 service nova] Creating event network-vif-plugged:a17f5e37-f324-47b7-878c-4d4e5bb83269 for instance 31789bd6-61d7-4f5d-9dda-8ed679dd1944 on n-h2-844627-10 Aug 04 14:56:45.581942 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e1412f25-f72d-424a-9781-858b6c10f1a8 req-4a808aa3-6333-4ab2-a586-2c1cb7131925 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058718 Aug 04 14:56:45.583358 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3212/6415] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:56:45.687705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f83a9899-4d6b-47ca-b5f9-44dd0e043841 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:45.688829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f83a9899-4d6b-47ca-b5f9-44dd0e043841 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:45.698850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f83a9899-4d6b-47ca-b5f9-44dd0e043841 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:45.700698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f83a9899-4d6b-47ca-b5f9-44dd0e043841 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:45.701734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f83a9899-4d6b-47ca-b5f9-44dd0e043841 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:45.702322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f83a9899-4d6b-47ca-b5f9-44dd0e043841 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:45.880235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f83a9899-4d6b-47ca-b5f9-44dd0e043841 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:45.889228 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f83a9899-4d6b-47ca-b5f9-44dd0e043841 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1322 microversion: 2.1 time: 0.206446 Aug 04 14:56:45.889819 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3204/6416] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:45 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:46.917337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a0da9c21-66da-4564-bfa4-6af19a11aa54 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:46.918534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a0da9c21-66da-4564-bfa4-6af19a11aa54 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:46.932228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0da9c21-66da-4564-bfa4-6af19a11aa54 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:46.933146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0da9c21-66da-4564-bfa4-6af19a11aa54 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:46.934574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0da9c21-66da-4564-bfa4-6af19a11aa54 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:46.935457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0da9c21-66da-4564-bfa4-6af19a11aa54 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:47.088773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a0da9c21-66da-4564-bfa4-6af19a11aa54 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:47.097415 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a0da9c21-66da-4564-bfa4-6af19a11aa54 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1472 microversion: 2.1 time: 0.191039 Aug 04 14:56:47.098136 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3213/6417] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:46 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:47.123516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:47.124736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:47.180140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c0d6e81-ff5b-4bee-bfe1-e6e6b41e25f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Calling method '.version_select at 0x7f46f2f74670>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:47.270902 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c0d6e81-ff5b-4bee-bfe1-e6e6b41e25f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/83d0b41490e24cbf893df64e81043251" status: 200 len: 371 microversion: 2.1 time: 0.153682 Aug 04 14:56:47.271912 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3205/6418] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 14:56:47 2022] GET /compute/v2.1/os-quota-sets/83d0b41490e24cbf893df64e81043251 => generated 371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:56:47.289005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70ec0824-28d5-42ec-b31a-1fedd0589015 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1386968631", "id": 1625290637, "os-flavor-access:is_public": "True"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:47.292166 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:56:47.292166 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:56:47.295327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:47.314389 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-70ec0824-28d5-42ec-b31a-1fedd0589015 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.029708 Aug 04 14:56:47.315674 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3214/6419] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:56:47 2022] POST /compute/v2.1/flavors => generated 438 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:56:47.330450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1625290637"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:47.332802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:47.340499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:47.341097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:47.342004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:47.342523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:47.434794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4f4e77ce778a4c2c968b4b4682cbf060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d0b41490e24cbf893df64e81043251', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:47.446316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1386968631 {{(pid=130961) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 14:56:47.459869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:47.460602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:47.461903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:47.463024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:47.498058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Getting quotas for project d7e41e2b25884bada4ea5c864412dad6. Resources: {'ram', 'cores'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:56:47.507307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Getting quotas for user 110eb96c970046a7ba5c0bf26ec18237 and project d7e41e2b25884bada4ea5c864412dad6. Resources: {'ram', 'cores'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:56:47.526768 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.api [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] ram quota exceeded for 83d0b41490e24cbf893df64e81043251, tried to resize instance. Aug 04 14:56:47.527630 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Request method failure captured: Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944/action HTTP/1.1 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 39 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi694kurtW-8_owLaKmEqbsXnsHl0g5KSXNgU0QcjtTyHIfFYbW1V4nSuH8RN4ZosJ2kxDb3jZBu0ITkHyMvjmAOPQq9tXGy1f3euRKhCW6NrxlCOUwjcvfmU9PdexMQqCoPsKaeaUWhhotHCjXJ8MmdRnk8XEWslCSy4YNXa_1lU_Aw0 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 83d0b41490e24cbf893df64e81043251 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1218284403 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Role: admin,reader,member Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: admin,reader,member Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/83d0b41490e24cbf893df64e81043251"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_83d0b41490e24cbf893df64e81043251"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/83d0b41490e24cbf893df64e81043251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/83d0b41490e24cbf893df64e81043251"}]}] Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1218284403 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 83d0b41490e24cbf893df64e81043251 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1218284403 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersAdminNegativeTestJSON-1218284403-project-admin Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 4f4e77ce778a4c2c968b4b4682cbf060 Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1218284403-project-admin Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: {"resize": {"flavorRef": "1625290637"}} Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '31789bd6-61d7-4f5d-9dda-8ed679dd1944', 'body': {'resize': {'flavorRef': '1625290637'}}} Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:56:47.537510 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f110b530-a755-4241-ac16-23c71d11b902 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944/action" status: 403 len: 118 microversion: 2.1 time: 0.212930 Aug 04 14:56:47.546433 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3206/6420] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:56:47 2022] POST /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944/action => generated 118 bytes in 214 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:56:47.555392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e170191-fa9a-46d7-b696-c7e42cd5aade tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:47.557633 n-d-844627-10 devstack@n-api.service[130960]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:56:47.557633 n-d-844627-10 devstack@n-api.service[130960]: warnings.warn(msg) Aug 04 14:56:47.586895 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e170191-fa9a-46d7-b696-c7e42cd5aade tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1625290637" status: 202 len: 0 microversion: 2.1 time: 0.038802 Aug 04 14:56:47.587504 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3215/6421] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 14:56:47 2022] DELETE /compute/v2.1/flavors/1625290637 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:56:47.596352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8001572b-2ff6-4e3b-b3e7-a18474357fe4 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:47.620699 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8001572b-2ff6-4e3b-b3e7-a18474357fe4 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028244 Aug 04 14:56:47.621342 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3207/6422] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:56:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:47.660727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c9e232f4-5d13-48d6-b031-a574e77d8634 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Calling method '.version_select at 0x7f46f3010a60>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:47.756372 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c9e232f4-5d13-48d6-b031-a574e77d8634 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "GET /compute/v2.1/os-quota-sets/83d0b41490e24cbf893df64e81043251" status: 200 len: 371 microversion: 2.1 time: 0.103118 Aug 04 14:56:47.756999 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3216/6423] 10.222.0.66 () {58 vars in 1242 bytes} [Thu Aug 4 14:56:47 2022] GET /compute/v2.1/os-quota-sets/83d0b41490e24cbf893df64e81043251 => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:56:47.770440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a293e7e0-f6e9-4417-8fbf-5e818e6b3790 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-371005329", "id": 1191191231, "os-flavor-access:is_public": "True"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:47.776888 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:56:47.776888 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:56:47.797783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a293e7e0-f6e9-4417-8fbf-5e818e6b3790 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.032057 Aug 04 14:56:47.798450 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3208/6424] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:56:47 2022] POST /compute/v2.1/flavors => generated 436 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:56:47.814765 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1191191231"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:47.817693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:47.825125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:47.825578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:47.826372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:47.826822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:47.975108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4f4e77ce778a4c2c968b4b4682cbf060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83d0b41490e24cbf893df64e81043251', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:47.982754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-371005329 {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 14:56:47.990573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:47.991026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:47.991847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:47.992292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:48.019257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Getting quotas for project d7e41e2b25884bada4ea5c864412dad6. Resources: {'ram', 'cores'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:56:48.025203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Getting quotas for user 110eb96c970046a7ba5c0bf26ec18237 and project d7e41e2b25884bada4ea5c864412dad6. Resources: {'ram', 'cores'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:56:48.039489 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.compute.api [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] cores quota exceeded for 83d0b41490e24cbf893df64e81043251, tried to resize instance. Aug 04 14:56:48.040196 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Request method failure captured: Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944/action HTTP/1.1 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 39 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi694kurtW-8_owLaKmEqbsXnsHl0g5KSXNgU0QcjtTyHIfFYbW1V4nSuH8RN4ZosJ2kxDb3jZBu0ITkHyMvjmAOPQq9tXGy1f3euRKhCW6NrxlCOUwjcvfmU9PdexMQqCoPsKaeaUWhhotHCjXJ8MmdRnk8XEWslCSy4YNXa_1lU_Aw0 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 83d0b41490e24cbf893df64e81043251 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1218284403 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Role: admin,reader,member Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: admin,reader,member Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/83d0b41490e24cbf893df64e81043251"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_83d0b41490e24cbf893df64e81043251"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/83d0b41490e24cbf893df64e81043251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/83d0b41490e24cbf893df64e81043251"}]}] Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1218284403 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 83d0b41490e24cbf893df64e81043251 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1218284403 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersAdminNegativeTestJSON-1218284403-project-admin Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 4f4e77ce778a4c2c968b4b4682cbf060 Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1218284403-project-admin Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: {"resize": {"flavorRef": "1191191231"}} Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '31789bd6-61d7-4f5d-9dda-8ed679dd1944', 'body': {'resize': {'flavorRef': '1191191231'}}} Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:56:48.042674 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4bdb5207-e93a-4171-9bbc-a575569081f2 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "POST /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944/action" status: 403 len: 113 microversion: 2.1 time: 0.236039 Aug 04 14:56:48.047973 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3217/6425] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:56:47 2022] POST /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944/action => generated 113 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:56:48.058193 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c1672000-c3ab-46e3-ad49-716490296e4a tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:48.059794 n-d-844627-10 devstack@n-api.service[130961]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 14:56:48.059794 n-d-844627-10 devstack@n-api.service[130961]: warnings.warn(msg) Aug 04 14:56:48.080302 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c1672000-c3ab-46e3-ad49-716490296e4a tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "DELETE /compute/v2.1/flavors/1191191231" status: 202 len: 0 microversion: 2.1 time: 0.029524 Aug 04 14:56:48.081003 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3209/6426] 10.222.0.66 () {58 vars in 1161 bytes} [Thu Aug 4 14:56:48 2022] DELETE /compute/v2.1/flavors/1191191231 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:56:48.090161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-68764397-33eb-4c0d-b62f-7582b78c6837 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:48.113652 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-68764397-33eb-4c0d-b62f-7582b78c6837 tempest-ServersAdminNegativeTestJSON-1218284403 tempest-ServersAdminNegativeTestJSON-1218284403-project-admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027844 Aug 04 14:56:48.114259 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3218/6427] 10.222.0.66 () {58 vars in 1146 bytes} [Thu Aug 4 14:56:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:48.134991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-477566a4-cfce-4124-8900-46b45bc48a52 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:48.135643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-477566a4-cfce-4124-8900-46b45bc48a52 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:48.144137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-477566a4-cfce-4124-8900-46b45bc48a52 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:48.144606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-477566a4-cfce-4124-8900-46b45bc48a52 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:48.145495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-477566a4-cfce-4124-8900-46b45bc48a52 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:48.145964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-477566a4-cfce-4124-8900-46b45bc48a52 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:48.174712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-477566a4-cfce-4124-8900-46b45bc48a52 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:56:48.273253 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-477566a4-cfce-4124-8900-46b45bc48a52 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "DELETE /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 204 len: 0 microversion: 2.1 time: 0.142138 Aug 04 14:56:48.273959 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3210/6428] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:56:48 2022] DELETE /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:56:48.284254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d7f6c577-4a96-4899-95fb-9f5e1dc44027 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:48.285223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d7f6c577-4a96-4899-95fb-9f5e1dc44027 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:48.293594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7f6c577-4a96-4899-95fb-9f5e1dc44027 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:48.294364 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7f6c577-4a96-4899-95fb-9f5e1dc44027 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:48.295585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7f6c577-4a96-4899-95fb-9f5e1dc44027 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:48.296325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d7f6c577-4a96-4899-95fb-9f5e1dc44027 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:48.474628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d7f6c577-4a96-4899-95fb-9f5e1dc44027 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:48.488605 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d7f6c577-4a96-4899-95fb-9f5e1dc44027 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1478 microversion: 2.1 time: 0.208638 Aug 04 14:56:48.489748 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3219/6429] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:48 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1478 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:49.511601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a531736f-4bde-4ed9-a3f2-5458607456c7 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:49.512365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a531736f-4bde-4ed9-a3f2-5458607456c7 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:49.520066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a531736f-4bde-4ed9-a3f2-5458607456c7 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:49.520539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a531736f-4bde-4ed9-a3f2-5458607456c7 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:49.521386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a531736f-4bde-4ed9-a3f2-5458607456c7 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:49.521845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a531736f-4bde-4ed9-a3f2-5458607456c7 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:49.822293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a531736f-4bde-4ed9-a3f2-5458607456c7 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110eb96c970046a7ba5c0bf26ec18237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e41e2b25884bada4ea5c864412dad6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:49.838432 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a531736f-4bde-4ed9-a3f2-5458607456c7 tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 200 len: 1478 microversion: 2.1 time: 0.331515 Aug 04 14:56:49.839347 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3211/6430] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:49 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 1478 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:50.300078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e7d23476-f096-45bc-a1b0-3057ad8e3849 req-9bd4247b-bc8c-44a4-a6de-5b3525ecba56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31789bd6-61d7-4f5d-9dda-8ed679dd1944", "name": "network-vif-deleted", "tag": "a17f5e37-f324-47b7-878c-4d4e5bb83269"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:50.317410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e7d23476-f096-45bc-a1b0-3057ad8e3849 req-9bd4247b-bc8c-44a4-a6de-5b3525ecba56 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:50.318230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e7d23476-f096-45bc-a1b0-3057ad8e3849 req-9bd4247b-bc8c-44a4-a6de-5b3525ecba56 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:50.340712 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e7d23476-f096-45bc-a1b0-3057ad8e3849 req-9bd4247b-bc8c-44a4-a6de-5b3525ecba56 service nova] Creating event network-vif-deleted:a17f5e37-f324-47b7-878c-4d4e5bb83269 for instance 31789bd6-61d7-4f5d-9dda-8ed679dd1944 on n-h2-844627-10 Aug 04 14:56:50.350107 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e7d23476-f096-45bc-a1b0-3057ad8e3849 req-9bd4247b-bc8c-44a4-a6de-5b3525ecba56 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059737 Aug 04 14:56:50.351359 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3220/6431] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:56:50.860652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:50.861419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] [instance: 31789bd6-61d7-4f5d-9dda-8ed679dd1944] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:50.869427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:50.869907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:50.870838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:50.871355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:50.887257 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] HTTP exception thrown: Instance 31789bd6-61d7-4f5d-9dda-8ed679dd1944 could not be found. Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Request method failure captured: Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 HTTP/1.1 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi694jLbOsYiHwSd72EYZCpJdZWg9OjJkDxKJsrafLRGDH-1f1yORG-tLxtynvahPmnp58hMwpoXgG5QkwtskLnNHslGGjxBF9N0fAkxZuLjYErcFFhhF4jJ5h9xzm9wFoRStGdpVvA2YAoDeXYVTtKsLrkG_33XZJqL99FGLH2jiKcPU Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: d7e41e2b25884bada4ea5c864412dad6 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1603518931 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d7e41e2b25884bada4ea5c864412dad6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d7e41e2b25884bada4ea5c864412dad6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d7e41e2b25884bada4ea5c864412dad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d7e41e2b25884bada4ea5c864412dad6"}]}] Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1603518931 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: d7e41e2b25884bada4ea5c864412dad6 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1603518931 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersAdminNegativeTestJSON-1603518931-project Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 110eb96c970046a7ba5c0bf26ec18237 Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1603518931-project Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 31789bd6-61d7-4f5d-9dda-8ed679dd1944 could not be found. Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '31789bd6-61d7-4f5d-9dda-8ed679dd1944'} Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31789bd6-61d7-4f5d-9dda-8ed679dd1944 could not be found. Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31789bd6-61d7-4f5d-9dda-8ed679dd1944 could not be found. Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:50.889006 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31789bd6-61d7-4f5d-9dda-8ed679dd1944 could not be found. Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] Returning 404 to user: Instance 31789bd6-61d7-4f5d-9dda-8ed679dd1944 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f9d1f343-72cc-4741-a5af-2ed1f4d2ec9b tempest-ServersAdminNegativeTestJSON-1603518931 tempest-ServersAdminNegativeTestJSON-1603518931-project] 10.222.0.66 "GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944" status: 404 len: 111 microversion: 2.1 time: 0.034525 Aug 04 14:56:50.899332 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3212/6432] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:50 2022] GET /compute/v2.1/servers/31789bd6-61d7-4f5d-9dda-8ed679dd1944 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:56:57.747589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:57.842880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1507552156", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "f5ca3992-95f1-47b2-af9c-b8df4a9e0c32"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:56:57.902787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] validate_networks() for [('f5ca3992-95f1-47b2-af9c-b8df4a9e0c32', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:56:58.010284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:58.292274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:56:58.292697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:56:58.293269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:56:58.293673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:56:58.294084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:56:58.303451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:58.303802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:58.304588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:58.305060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:58.323038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Getting quotas for project 11eaaff5124d41868c3942694ecefc45. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:56:58.328638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Getting quotas for user 5b642798f5014d8491d07db378321968 and project 11eaaff5124d41868c3942694ecefc45. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:56:58.341689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:56:58.344087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:56:58.390721 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b4f9431f-adc8-414a-8481-0274bb2000df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685088 Aug 04 14:56:58.391379 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3221/6433] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:56:58.402351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3052b1b5-5d87-4711-9af2-9567d16407fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:58.402986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3052b1b5-5d87-4711-9af2-9567d16407fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:58.406104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:58.406817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:56:58.467934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3052b1b5-5d87-4711-9af2-9567d16407fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:58.476539 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3052b1b5-5d87-4711-9af2-9567d16407fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1215 microversion: 2.1 time: 0.077968 Aug 04 14:56:58.477167 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3213/6434] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:58 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:56:59.499998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0bc2239f-ccc8-4882-a2bb-725a766745a8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:56:59.501432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0bc2239f-ccc8-4882-a2bb-725a766745a8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:56:59.511394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bc2239f-ccc8-4882-a2bb-725a766745a8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:59.512132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bc2239f-ccc8-4882-a2bb-725a766745a8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:59.513855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bc2239f-ccc8-4882-a2bb-725a766745a8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:56:59.514954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bc2239f-ccc8-4882-a2bb-725a766745a8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:56:59.621522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0bc2239f-ccc8-4882-a2bb-725a766745a8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:56:59.630005 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0bc2239f-ccc8-4882-a2bb-725a766745a8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1273 microversion: 2.1 time: 0.135597 Aug 04 14:56:59.630736 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3222/6435] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:56:59 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:00.651882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f932814-d6a7-4b52-88df-17be0feefe1f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:00.653363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f932814-d6a7-4b52-88df-17be0feefe1f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:00.662622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f932814-d6a7-4b52-88df-17be0feefe1f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:00.663660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f932814-d6a7-4b52-88df-17be0feefe1f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:00.664725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f932814-d6a7-4b52-88df-17be0feefe1f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:00.665630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f932814-d6a7-4b52-88df-17be0feefe1f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:00.963410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f932814-d6a7-4b52-88df-17be0feefe1f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:00.971623 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f932814-d6a7-4b52-88df-17be0feefe1f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1315 microversion: 2.1 time: 0.323803 Aug 04 14:57:00.972208 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3214/6436] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:00 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:01.404181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-17a0ac3a-fb64-43b7-b302-38c43860500e req-f3ea3366-62ed-4f30-b374-8f0e9fd15310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cf25f7-fdde-4c4c-a6e5-0397cc19ff97", "tag": "ff5fef04-108c-4ef2-8b77-ef86b83c3049"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:57:01.433528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-17a0ac3a-fb64-43b7-b302-38c43860500e req-f3ea3366-62ed-4f30-b374-8f0e9fd15310 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:01.433979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-17a0ac3a-fb64-43b7-b302-38c43860500e req-f3ea3366-62ed-4f30-b374-8f0e9fd15310 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:01.452307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-17a0ac3a-fb64-43b7-b302-38c43860500e req-f3ea3366-62ed-4f30-b374-8f0e9fd15310 service nova] Creating event network-changed:ff5fef04-108c-4ef2-8b77-ef86b83c3049 for instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 on n-h2-844627-10 Aug 04 14:57:01.457999 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-17a0ac3a-fb64-43b7-b302-38c43860500e req-f3ea3366-62ed-4f30-b374-8f0e9fd15310 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059964 Aug 04 14:57:01.459271 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3223/6437] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:57:01.991899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3edbd07f-e752-4577-8d3e-e447a9ba41ca tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:01.992536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3edbd07f-e752-4577-8d3e-e447a9ba41ca tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:02.000452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3edbd07f-e752-4577-8d3e-e447a9ba41ca tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:02.000959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3edbd07f-e752-4577-8d3e-e447a9ba41ca tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:02.001772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3edbd07f-e752-4577-8d3e-e447a9ba41ca tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:02.002235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3edbd07f-e752-4577-8d3e-e447a9ba41ca tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:02.154202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3edbd07f-e752-4577-8d3e-e447a9ba41ca tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:02.162129 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3edbd07f-e752-4577-8d3e-e447a9ba41ca tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1315 microversion: 2.1 time: 0.174201 Aug 04 14:57:02.162623 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3215/6438] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:01 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:03.185733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dfd122fc-d25a-4a24-8536-b69bb4ca868c tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:03.187391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dfd122fc-d25a-4a24-8536-b69bb4ca868c tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:03.194214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfd122fc-d25a-4a24-8536-b69bb4ca868c tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:03.194668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfd122fc-d25a-4a24-8536-b69bb4ca868c tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:03.196087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfd122fc-d25a-4a24-8536-b69bb4ca868c tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:03.197339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfd122fc-d25a-4a24-8536-b69bb4ca868c tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:03.347519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dfd122fc-d25a-4a24-8536-b69bb4ca868c tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:03.355171 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dfd122fc-d25a-4a24-8536-b69bb4ca868c tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1315 microversion: 2.1 time: 0.175268 Aug 04 14:57:03.355755 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3224/6439] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:03 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:57:04.375781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-09c3d4b4-05e4-4964-bb2d-22d8a1d659a3 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:04.376420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-09c3d4b4-05e4-4964-bb2d-22d8a1d659a3 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:04.383576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-09c3d4b4-05e4-4964-bb2d-22d8a1d659a3 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:04.384073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-09c3d4b4-05e4-4964-bb2d-22d8a1d659a3 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:04.384892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-09c3d4b4-05e4-4964-bb2d-22d8a1d659a3 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:04.385352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-09c3d4b4-05e4-4964-bb2d-22d8a1d659a3 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:04.519533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-09c3d4b4-05e4-4964-bb2d-22d8a1d659a3 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:04.527886 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-09c3d4b4-05e4-4964-bb2d-22d8a1d659a3 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1315 microversion: 2.1 time: 0.155986 Aug 04 14:57:04.528483 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3216/6440] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:04 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:05.549616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2ad1aedf-39d9-4c9e-9b39-80e51582c882 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:05.550238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2ad1aedf-39d9-4c9e-9b39-80e51582c882 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:05.558204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ad1aedf-39d9-4c9e-9b39-80e51582c882 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:05.558670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ad1aedf-39d9-4c9e-9b39-80e51582c882 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:05.559616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ad1aedf-39d9-4c9e-9b39-80e51582c882 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:05.560097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2ad1aedf-39d9-4c9e-9b39-80e51582c882 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:05.575162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8afd8194-f101-4c73-a018-a2b041525d87 req-d26ea63a-52d2-4b24-b35b-6c60e1281fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cf25f7-fdde-4c4c-a6e5-0397cc19ff97", "name": "network-vif-plugged", "status": "completed", "tag": "ff5fef04-108c-4ef2-8b77-ef86b83c3049"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:57:05.590350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8afd8194-f101-4c73-a018-a2b041525d87 req-d26ea63a-52d2-4b24-b35b-6c60e1281fdf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:05.590898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8afd8194-f101-4c73-a018-a2b041525d87 req-d26ea63a-52d2-4b24-b35b-6c60e1281fdf service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:05.615220 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8afd8194-f101-4c73-a018-a2b041525d87 req-d26ea63a-52d2-4b24-b35b-6c60e1281fdf service nova] Creating event network-vif-plugged:ff5fef04-108c-4ef2-8b77-ef86b83c3049 for instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 on n-h2-844627-10 Aug 04 14:57:05.621365 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8afd8194-f101-4c73-a018-a2b041525d87 req-d26ea63a-52d2-4b24-b35b-6c60e1281fdf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049682 Aug 04 14:57:05.621987 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3217/6441] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:57:05.740853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2ad1aedf-39d9-4c9e-9b39-80e51582c882 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:05.749490 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2ad1aedf-39d9-4c9e-9b39-80e51582c882 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1315 microversion: 2.1 time: 0.203663 Aug 04 14:57:05.750058 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3225/6442] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:05 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:06.771171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4879a46e-62c2-4b70-a62f-4ef3ef3e41ac tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:06.772566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4879a46e-62c2-4b70-a62f-4ef3ef3e41ac tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:06.775592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:06.785749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4879a46e-62c2-4b70-a62f-4ef3ef3e41ac tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:06.786304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4879a46e-62c2-4b70-a62f-4ef3ef3e41ac tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:06.787410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4879a46e-62c2-4b70-a62f-4ef3ef3e41ac tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:06.787926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4879a46e-62c2-4b70-a62f-4ef3ef3e41ac tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:06.811971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:06.946808 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4879a46e-62c2-4b70-a62f-4ef3ef3e41ac tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:06.954829 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4879a46e-62c2-4b70-a62f-4ef3ef3e41ac tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1502 microversion: 2.1 time: 0.188079 Aug 04 14:57:06.955689 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3218/6443] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:06 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:06.975551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:57:06.978500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:06.985594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:06.986125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:06.986972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:06.987492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:07.017083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:07.023314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Old instance type m1.heat2, new instance type m1.heat {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 14:57:07.032488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:57:07.033162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:57:07.033897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:57:07.034524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:57:07.035163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:57:07.133998 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dc96ff78-b773-4bcb-baa5-01c79a461df7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "POST /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97/action" status: 202 len: 0 microversion: 2.1 time: 0.161930 Aug 04 14:57:07.134644 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3226/6444] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:57:06 2022] POST /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:57:07.143213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0fa40a32-0c9a-4a41-9af5-9dd45e853c37 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:07.143747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0fa40a32-0c9a-4a41-9af5-9dd45e853c37 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:07.152742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0fa40a32-0c9a-4a41-9af5-9dd45e853c37 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:07.153282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0fa40a32-0c9a-4a41-9af5-9dd45e853c37 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:07.154252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0fa40a32-0c9a-4a41-9af5-9dd45e853c37 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:07.154699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0fa40a32-0c9a-4a41-9af5-9dd45e853c37 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:07.320281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0fa40a32-0c9a-4a41-9af5-9dd45e853c37 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:07.328492 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0fa40a32-0c9a-4a41-9af5-9dd45e853c37 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1511 microversion: 2.1 time: 0.189373 Aug 04 14:57:07.329138 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3219/6445] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:07 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:08.347754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:08.348541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:08.353039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-11a7a5ed-c1d8-4fcd-9e90-cc063f32caa5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:08.353660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-11a7a5ed-c1d8-4fcd-9e90-cc063f32caa5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:08.355577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:08.364209 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11a7a5ed-c1d8-4fcd-9e90-cc063f32caa5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:08.364665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11a7a5ed-c1d8-4fcd-9e90-cc063f32caa5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:08.365488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11a7a5ed-c1d8-4fcd-9e90-cc063f32caa5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:08.365923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11a7a5ed-c1d8-4fcd-9e90-cc063f32caa5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:08.371415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:08.534554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-11a7a5ed-c1d8-4fcd-9e90-cc063f32caa5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:08.542860 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-11a7a5ed-c1d8-4fcd-9e90-cc063f32caa5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1511 microversion: 2.1 time: 0.196846 Aug 04 14:57:08.543462 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3227/6446] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:08 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:57:09.564149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f1a6c366-7aee-4636-95d8-aca5089f1856 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:09.564798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f1a6c366-7aee-4636-95d8-aca5089f1856 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:09.567039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:09.572954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1a6c366-7aee-4636-95d8-aca5089f1856 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:09.573436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1a6c366-7aee-4636-95d8-aca5089f1856 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:09.574299 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1a6c366-7aee-4636-95d8-aca5089f1856 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:09.574759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f1a6c366-7aee-4636-95d8-aca5089f1856 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:09.715424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f1a6c366-7aee-4636-95d8-aca5089f1856 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:09.723665 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f1a6c366-7aee-4636-95d8-aca5089f1856 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.163364 Aug 04 14:57:09.724243 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3220/6447] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:09 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:10.746460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0d68f656-cb0e-4e05-a903-6b7eaad08ff5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:10.747108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0d68f656-cb0e-4e05-a903-6b7eaad08ff5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:10.754015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d68f656-cb0e-4e05-a903-6b7eaad08ff5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:10.754464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d68f656-cb0e-4e05-a903-6b7eaad08ff5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:10.755234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d68f656-cb0e-4e05-a903-6b7eaad08ff5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:10.755677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d68f656-cb0e-4e05-a903-6b7eaad08ff5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:10.896173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0d68f656-cb0e-4e05-a903-6b7eaad08ff5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:10.904138 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0d68f656-cb0e-4e05-a903-6b7eaad08ff5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.162170 Aug 04 14:57:10.904714 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3228/6448] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:10 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:11.925798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfb495ec-1756-4f53-8d1d-68febd30c2fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:11.926470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cfb495ec-1756-4f53-8d1d-68febd30c2fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:11.934050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfb495ec-1756-4f53-8d1d-68febd30c2fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:11.934529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfb495ec-1756-4f53-8d1d-68febd30c2fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:11.935323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfb495ec-1756-4f53-8d1d-68febd30c2fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:11.935782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfb495ec-1756-4f53-8d1d-68febd30c2fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:12.089586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfb495ec-1756-4f53-8d1d-68febd30c2fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:12.097310 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cfb495ec-1756-4f53-8d1d-68febd30c2fc tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.175483 Aug 04 14:57:12.097985 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3221/6449] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:11 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:13.118304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d9747eb-3179-4b61-8d95-bbd29c1285b1 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:13.118919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d9747eb-3179-4b61-8d95-bbd29c1285b1 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:13.126260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d9747eb-3179-4b61-8d95-bbd29c1285b1 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:13.126719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d9747eb-3179-4b61-8d95-bbd29c1285b1 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:13.127507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d9747eb-3179-4b61-8d95-bbd29c1285b1 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:13.127995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d9747eb-3179-4b61-8d95-bbd29c1285b1 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:13.349346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5d9747eb-3179-4b61-8d95-bbd29c1285b1 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:13.356982 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d9747eb-3179-4b61-8d95-bbd29c1285b1 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.242523 Aug 04 14:57:13.357776 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3229/6450] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:13 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:14.378532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-149e79b3-60ba-442f-afae-f25419d91cc2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:14.379241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-149e79b3-60ba-442f-afae-f25419d91cc2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:14.386839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-149e79b3-60ba-442f-afae-f25419d91cc2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:14.387315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-149e79b3-60ba-442f-afae-f25419d91cc2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:14.388106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-149e79b3-60ba-442f-afae-f25419d91cc2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:14.388567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-149e79b3-60ba-442f-afae-f25419d91cc2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:14.520362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-149e79b3-60ba-442f-afae-f25419d91cc2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:14.528288 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-149e79b3-60ba-442f-afae-f25419d91cc2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.153683 Aug 04 14:57:14.529265 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3222/6451] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:14 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:15.551508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-40e38d37-df01-4b25-bd51-88cfa22d2a3f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:15.552340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-40e38d37-df01-4b25-bd51-88cfa22d2a3f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:15.559505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40e38d37-df01-4b25-bd51-88cfa22d2a3f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:15.559963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40e38d37-df01-4b25-bd51-88cfa22d2a3f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:15.560709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40e38d37-df01-4b25-bd51-88cfa22d2a3f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:15.561177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-40e38d37-df01-4b25-bd51-88cfa22d2a3f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:15.696707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-40e38d37-df01-4b25-bd51-88cfa22d2a3f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:15.704638 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-40e38d37-df01-4b25-bd51-88cfa22d2a3f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.157109 Aug 04 14:57:15.705501 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3230/6452] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:15 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:16.726125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2f5c4109-7f20-4d93-b78e-7bb2118e2b5f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:16.726752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f5c4109-7f20-4d93-b78e-7bb2118e2b5f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:16.733831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f5c4109-7f20-4d93-b78e-7bb2118e2b5f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:16.734307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f5c4109-7f20-4d93-b78e-7bb2118e2b5f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:16.735101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f5c4109-7f20-4d93-b78e-7bb2118e2b5f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:16.735560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f5c4109-7f20-4d93-b78e-7bb2118e2b5f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:16.881928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2f5c4109-7f20-4d93-b78e-7bb2118e2b5f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:16.890640 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2f5c4109-7f20-4d93-b78e-7bb2118e2b5f tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.168408 Aug 04 14:57:16.891215 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3223/6453] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:16 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:17.911754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d96b84fd-8f16-40bc-b3f1-2a0c4e303c99 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:17.912396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d96b84fd-8f16-40bc-b3f1-2a0c4e303c99 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:17.920499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d96b84fd-8f16-40bc-b3f1-2a0c4e303c99 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:17.920982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d96b84fd-8f16-40bc-b3f1-2a0c4e303c99 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:17.921766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d96b84fd-8f16-40bc-b3f1-2a0c4e303c99 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:17.922207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d96b84fd-8f16-40bc-b3f1-2a0c4e303c99 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:18.060555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d96b84fd-8f16-40bc-b3f1-2a0c4e303c99 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:18.068332 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d96b84fd-8f16-40bc-b3f1-2a0c4e303c99 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.160567 Aug 04 14:57:18.068991 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3231/6454] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:17 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:19.093334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1389cd3b-b312-4e7a-a8bb-e34ae7a90f8b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:19.094274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1389cd3b-b312-4e7a-a8bb-e34ae7a90f8b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:19.105092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1389cd3b-b312-4e7a-a8bb-e34ae7a90f8b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:19.105784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1389cd3b-b312-4e7a-a8bb-e34ae7a90f8b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:19.106981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1389cd3b-b312-4e7a-a8bb-e34ae7a90f8b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:19.107646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1389cd3b-b312-4e7a-a8bb-e34ae7a90f8b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:19.250580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1389cd3b-b312-4e7a-a8bb-e34ae7a90f8b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:19.258388 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1389cd3b-b312-4e7a-a8bb-e34ae7a90f8b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.171251 Aug 04 14:57:19.258979 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3224/6455] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:19 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:20.279623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e1045ff-49f1-448d-a073-95e65acebd69 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:20.280247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e1045ff-49f1-448d-a073-95e65acebd69 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:20.287444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e1045ff-49f1-448d-a073-95e65acebd69 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:20.287971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e1045ff-49f1-448d-a073-95e65acebd69 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:20.288678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e1045ff-49f1-448d-a073-95e65acebd69 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:20.289146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e1045ff-49f1-448d-a073-95e65acebd69 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:20.430105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8e1045ff-49f1-448d-a073-95e65acebd69 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:20.438921 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e1045ff-49f1-448d-a073-95e65acebd69 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.163510 Aug 04 14:57:20.439510 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3232/6456] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:20 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:21.460167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-365adf50-4683-4138-96e6-a58975aa571e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:21.460741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-365adf50-4683-4138-96e6-a58975aa571e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:21.468492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-365adf50-4683-4138-96e6-a58975aa571e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:21.469029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-365adf50-4683-4138-96e6-a58975aa571e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:21.469819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-365adf50-4683-4138-96e6-a58975aa571e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:21.470282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-365adf50-4683-4138-96e6-a58975aa571e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:21.614013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-365adf50-4683-4138-96e6-a58975aa571e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:21.622647 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-365adf50-4683-4138-96e6-a58975aa571e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.166450 Aug 04 14:57:21.623245 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3225/6457] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:21 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:22.643686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-14fad981-6051-490f-abec-372c2e855f64 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:22.644296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-14fad981-6051-490f-abec-372c2e855f64 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:22.651324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14fad981-6051-490f-abec-372c2e855f64 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:22.651770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14fad981-6051-490f-abec-372c2e855f64 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:22.652528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14fad981-6051-490f-abec-372c2e855f64 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:22.653000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14fad981-6051-490f-abec-372c2e855f64 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:22.795696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-14fad981-6051-490f-abec-372c2e855f64 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:22.807626 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-14fad981-6051-490f-abec-372c2e855f64 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.167766 Aug 04 14:57:22.808232 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3233/6458] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:22 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:23.828600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a86cf0c5-11f4-46ec-9d5a-39b0a00b14f5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:23.829265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a86cf0c5-11f4-46ec-9d5a-39b0a00b14f5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:23.836524 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a86cf0c5-11f4-46ec-9d5a-39b0a00b14f5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:23.837031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a86cf0c5-11f4-46ec-9d5a-39b0a00b14f5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:23.837831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a86cf0c5-11f4-46ec-9d5a-39b0a00b14f5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:23.838301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a86cf0c5-11f4-46ec-9d5a-39b0a00b14f5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:23.984646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a86cf0c5-11f4-46ec-9d5a-39b0a00b14f5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:23.992383 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a86cf0c5-11f4-46ec-9d5a-39b0a00b14f5 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.167812 Aug 04 14:57:23.993484 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3226/6459] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:23 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:25.014411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2fee2ec1-d72d-4f5d-9fb5-3f5b337c9f91 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:25.015036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2fee2ec1-d72d-4f5d-9fb5-3f5b337c9f91 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:25.022333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fee2ec1-d72d-4f5d-9fb5-3f5b337c9f91 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:25.022815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fee2ec1-d72d-4f5d-9fb5-3f5b337c9f91 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:25.023592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fee2ec1-d72d-4f5d-9fb5-3f5b337c9f91 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:25.024620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2fee2ec1-d72d-4f5d-9fb5-3f5b337c9f91 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:25.158674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2fee2ec1-d72d-4f5d-9fb5-3f5b337c9f91 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:25.166510 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2fee2ec1-d72d-4f5d-9fb5-3f5b337c9f91 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.156029 Aug 04 14:57:25.167089 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3234/6460] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:25 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:26.187762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-865e78ff-69db-451c-8333-def8739362df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:26.188393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-865e78ff-69db-451c-8333-def8739362df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:26.195602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-865e78ff-69db-451c-8333-def8739362df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:26.196726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-865e78ff-69db-451c-8333-def8739362df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:26.197683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-865e78ff-69db-451c-8333-def8739362df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:26.198041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-865e78ff-69db-451c-8333-def8739362df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:26.337422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-865e78ff-69db-451c-8333-def8739362df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:26.345236 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-865e78ff-69db-451c-8333-def8739362df tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.161478 Aug 04 14:57:26.345805 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3227/6461] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:26 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:27.366302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a0ee7e03-16c8-4ded-9166-1500e84a7d03 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:27.366879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a0ee7e03-16c8-4ded-9166-1500e84a7d03 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:27.374082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0ee7e03-16c8-4ded-9166-1500e84a7d03 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:27.374529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0ee7e03-16c8-4ded-9166-1500e84a7d03 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:27.375341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0ee7e03-16c8-4ded-9166-1500e84a7d03 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:27.375785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0ee7e03-16c8-4ded-9166-1500e84a7d03 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:27.507749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a0ee7e03-16c8-4ded-9166-1500e84a7d03 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:27.516082 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a0ee7e03-16c8-4ded-9166-1500e84a7d03 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.153744 Aug 04 14:57:27.516670 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3235/6462] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:27 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:28.538017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6844f34e-d735-4e81-9f69-d187445ea84b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:28.538648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6844f34e-d735-4e81-9f69-d187445ea84b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:28.546248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6844f34e-d735-4e81-9f69-d187445ea84b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:28.546718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6844f34e-d735-4e81-9f69-d187445ea84b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:28.547510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6844f34e-d735-4e81-9f69-d187445ea84b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:28.547966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6844f34e-d735-4e81-9f69-d187445ea84b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:28.680393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6844f34e-d735-4e81-9f69-d187445ea84b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:28.688159 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6844f34e-d735-4e81-9f69-d187445ea84b tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.154108 Aug 04 14:57:28.688734 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3228/6463] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:28 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:29.710194 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-193713c9-2da1-4081-9517-db4357caaaad tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:29.710949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-193713c9-2da1-4081-9517-db4357caaaad tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:29.718143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-193713c9-2da1-4081-9517-db4357caaaad tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:29.718593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-193713c9-2da1-4081-9517-db4357caaaad tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:29.719365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-193713c9-2da1-4081-9517-db4357caaaad tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:29.719801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-193713c9-2da1-4081-9517-db4357caaaad tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:29.864055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-193713c9-2da1-4081-9517-db4357caaaad tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:29.871700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-193713c9-2da1-4081-9517-db4357caaaad tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.165852 Aug 04 14:57:29.872281 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3236/6464] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:29 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:30.892937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cef96887-6bc5-49eb-a20e-bc4c6917d510 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:30.893577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cef96887-6bc5-49eb-a20e-bc4c6917d510 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:30.900706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cef96887-6bc5-49eb-a20e-bc4c6917d510 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:30.901216 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cef96887-6bc5-49eb-a20e-bc4c6917d510 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:30.902009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cef96887-6bc5-49eb-a20e-bc4c6917d510 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:30.902472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cef96887-6bc5-49eb-a20e-bc4c6917d510 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:31.041728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cef96887-6bc5-49eb-a20e-bc4c6917d510 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:31.049972 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cef96887-6bc5-49eb-a20e-bc4c6917d510 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.160885 Aug 04 14:57:31.050567 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3229/6465] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:30 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:32.077885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1c341d0d-c39f-4a88-b698-b2752f234db2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:32.079005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1c341d0d-c39f-4a88-b698-b2752f234db2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:32.088403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c341d0d-c39f-4a88-b698-b2752f234db2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:32.088856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c341d0d-c39f-4a88-b698-b2752f234db2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:32.089649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c341d0d-c39f-4a88-b698-b2752f234db2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:32.090088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c341d0d-c39f-4a88-b698-b2752f234db2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:32.234586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1c341d0d-c39f-4a88-b698-b2752f234db2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:32.243804 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1c341d0d-c39f-4a88-b698-b2752f234db2 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.175241 Aug 04 14:57:32.244396 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3237/6466] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:32 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:33.265820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af87ab7d-25ad-476f-9aa6-bdec9b376f81 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:33.266516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af87ab7d-25ad-476f-9aa6-bdec9b376f81 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:33.273945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af87ab7d-25ad-476f-9aa6-bdec9b376f81 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:33.274421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af87ab7d-25ad-476f-9aa6-bdec9b376f81 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:33.275227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af87ab7d-25ad-476f-9aa6-bdec9b376f81 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:33.275680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af87ab7d-25ad-476f-9aa6-bdec9b376f81 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:33.412418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-af87ab7d-25ad-476f-9aa6-bdec9b376f81 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:33.420689 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af87ab7d-25ad-476f-9aa6-bdec9b376f81 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.159430 Aug 04 14:57:33.421304 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3230/6467] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:33 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:34.442783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4d103aa1-20ef-42e0-a5b4-30d04946780e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:34.443358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4d103aa1-20ef-42e0-a5b4-30d04946780e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:34.450939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d103aa1-20ef-42e0-a5b4-30d04946780e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:34.451378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d103aa1-20ef-42e0-a5b4-30d04946780e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:34.452152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d103aa1-20ef-42e0-a5b4-30d04946780e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:34.452593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d103aa1-20ef-42e0-a5b4-30d04946780e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:34.591191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4d103aa1-20ef-42e0-a5b4-30d04946780e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:34.598883 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4d103aa1-20ef-42e0-a5b4-30d04946780e tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.160176 Aug 04 14:57:34.599464 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3238/6468] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:34 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:35.620083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-912bec9a-cfcc-47c8-a2e2-505137e54531 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:35.620734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-912bec9a-cfcc-47c8-a2e2-505137e54531 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:35.628169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-912bec9a-cfcc-47c8-a2e2-505137e54531 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:35.628652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-912bec9a-cfcc-47c8-a2e2-505137e54531 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:35.629477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-912bec9a-cfcc-47c8-a2e2-505137e54531 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:35.629942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-912bec9a-cfcc-47c8-a2e2-505137e54531 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:35.769065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-912bec9a-cfcc-47c8-a2e2-505137e54531 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:35.777565 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-912bec9a-cfcc-47c8-a2e2-505137e54531 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1516 microversion: 2.1 time: 0.161451 Aug 04 14:57:35.778174 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3231/6469] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:35 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:57:36.780077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b82f6d45-5092-405d-8cbe-f0b18cfd8755 req-4642d8ca-3554-4592-94ff-252141e46f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cf25f7-fdde-4c4c-a6e5-0397cc19ff97", "name": "network-vif-unplugged", "status": "completed", "tag": "ff5fef04-108c-4ef2-8b77-ef86b83c3049"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:57:36.797010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b82f6d45-5092-405d-8cbe-f0b18cfd8755 req-4642d8ca-3554-4592-94ff-252141e46f00 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:36.797920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b82f6d45-5092-405d-8cbe-f0b18cfd8755 req-4642d8ca-3554-4592-94ff-252141e46f00 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:36.799885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfa47677-831b-4ade-8e49-07ff3a4176a0 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:36.800933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cfa47677-831b-4ade-8e49-07ff3a4176a0 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:36.810104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfa47677-831b-4ade-8e49-07ff3a4176a0 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:36.810577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfa47677-831b-4ade-8e49-07ff3a4176a0 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:36.811554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfa47677-831b-4ade-8e49-07ff3a4176a0 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:36.812008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfa47677-831b-4ade-8e49-07ff3a4176a0 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:36.821393 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b82f6d45-5092-405d-8cbe-f0b18cfd8755 req-4642d8ca-3554-4592-94ff-252141e46f00 service nova] Creating event network-vif-unplugged:ff5fef04-108c-4ef2-8b77-ef86b83c3049 for instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 on n-h1-844627-10 Aug 04 14:57:36.832375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-b82f6d45-5092-405d-8cbe-f0b18cfd8755 req-4642d8ca-3554-4592-94ff-252141e46f00 service nova] Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:57:36.853815 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b82f6d45-5092-405d-8cbe-f0b18cfd8755 req-4642d8ca-3554-4592-94ff-252141e46f00 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080755 Aug 04 14:57:36.854947 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3239/6470] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:57:37.044520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfa47677-831b-4ade-8e49-07ff3a4176a0 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:37.046785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=88 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:37.054006 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cfa47677-831b-4ade-8e49-07ff3a4176a0 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1515 microversion: 2.1 time: 0.259166 Aug 04 14:57:37.054596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3232/6471] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:36 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:57:38.077250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6c2ab76d-9dbf-40f5-8d01-99f861e0cb58 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:38.077880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6c2ab76d-9dbf-40f5-8d01-99f861e0cb58 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:38.086104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c2ab76d-9dbf-40f5-8d01-99f861e0cb58 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:38.086568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c2ab76d-9dbf-40f5-8d01-99f861e0cb58 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:38.087459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c2ab76d-9dbf-40f5-8d01-99f861e0cb58 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:38.088102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c2ab76d-9dbf-40f5-8d01-99f861e0cb58 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:38.238587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6c2ab76d-9dbf-40f5-8d01-99f861e0cb58 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:38.247655 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6c2ab76d-9dbf-40f5-8d01-99f861e0cb58 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1513 microversion: 2.1 time: 0.175879 Aug 04 14:57:38.248278 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3240/6472] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:38 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:38.879073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c73d7433-a8fc-40e2-a951-9339d8acf549 req-99449ba6-ca6d-41a7-bec2-be431147dc13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cf25f7-fdde-4c4c-a6e5-0397cc19ff97", "tag": "ff5fef04-108c-4ef2-8b77-ef86b83c3049"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:57:38.885931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=30 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:38.892983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c73d7433-a8fc-40e2-a951-9339d8acf549 req-99449ba6-ca6d-41a7-bec2-be431147dc13 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:38.893442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c73d7433-a8fc-40e2-a951-9339d8acf549 req-99449ba6-ca6d-41a7-bec2-be431147dc13 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:38.906194 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c73d7433-a8fc-40e2-a951-9339d8acf549 req-99449ba6-ca6d-41a7-bec2-be431147dc13 service nova] Creating event network-changed:ff5fef04-108c-4ef2-8b77-ef86b83c3049 for instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 on n-h1-844627-10 Aug 04 14:57:38.911833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-c73d7433-a8fc-40e2-a951-9339d8acf549 req-99449ba6-ca6d-41a7-bec2-be431147dc13 service nova] Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:57:38.923360 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c73d7433-a8fc-40e2-a951-9339d8acf549 req-99449ba6-ca6d-41a7-bec2-be431147dc13 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047989 Aug 04 14:57:38.924121 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3233/6473] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:57:39.270337 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a28fd527-d4f1-4b88-b57e-dd72ad95edc8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:39.271066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a28fd527-d4f1-4b88-b57e-dd72ad95edc8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:39.274149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=28 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:39.280138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a28fd527-d4f1-4b88-b57e-dd72ad95edc8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:39.280605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a28fd527-d4f1-4b88-b57e-dd72ad95edc8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:39.281557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a28fd527-d4f1-4b88-b57e-dd72ad95edc8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:39.282038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a28fd527-d4f1-4b88-b57e-dd72ad95edc8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:39.286408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=82 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:39.512696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a28fd527-d4f1-4b88-b57e-dd72ad95edc8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:39.523530 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a28fd527-d4f1-4b88-b57e-dd72ad95edc8 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1513 microversion: 2.1 time: 0.257051 Aug 04 14:57:39.524212 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3241/6474] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:39 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:40.558835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c99412e8-ffa4-4520-a006-a3b40dedf7da tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:40.559691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c99412e8-ffa4-4520-a006-a3b40dedf7da tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:40.567831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c99412e8-ffa4-4520-a006-a3b40dedf7da tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:40.568088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c99412e8-ffa4-4520-a006-a3b40dedf7da tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:40.569480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c99412e8-ffa4-4520-a006-a3b40dedf7da tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:40.569988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c99412e8-ffa4-4520-a006-a3b40dedf7da tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:40.816311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c99412e8-ffa4-4520-a006-a3b40dedf7da tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:40.824756 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c99412e8-ffa4-4520-a006-a3b40dedf7da tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1513 microversion: 2.1 time: 0.271182 Aug 04 14:57:40.825271 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3234/6475] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:40 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:41.845913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-67141f71-edcb-4fea-adad-584d19a2f5fb tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:41.846489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-67141f71-edcb-4fea-adad-584d19a2f5fb tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:41.853577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67141f71-edcb-4fea-adad-584d19a2f5fb tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:41.854021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67141f71-edcb-4fea-adad-584d19a2f5fb tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:41.854785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67141f71-edcb-4fea-adad-584d19a2f5fb tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:41.855221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67141f71-edcb-4fea-adad-584d19a2f5fb tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:42.341327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67141f71-edcb-4fea-adad-584d19a2f5fb tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:42.354916 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-67141f71-edcb-4fea-adad-584d19a2f5fb tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1510 microversion: 2.1 time: 0.512879 Aug 04 14:57:42.355693 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3242/6476] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:41 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1510 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:42.376942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c8febd9-a0da-4bdf-91c8-eeacd7eaea16 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:42.378139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c8febd9-a0da-4bdf-91c8-eeacd7eaea16 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:42.385478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c8febd9-a0da-4bdf-91c8-eeacd7eaea16 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:42.385996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c8febd9-a0da-4bdf-91c8-eeacd7eaea16 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:42.386799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c8febd9-a0da-4bdf-91c8-eeacd7eaea16 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:42.387315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c8febd9-a0da-4bdf-91c8-eeacd7eaea16 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:42.424566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c8febd9-a0da-4bdf-91c8-eeacd7eaea16 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:57:42.481719 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.api [None req-9c8febd9-a0da-4bdf-91c8-eeacd7eaea16 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Found an unconfirmed migration during delete, id: 16, status: finished Aug 04 14:57:43.862535 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c8febd9-a0da-4bdf-91c8-eeacd7eaea16 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "DELETE /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 204 len: 0 microversion: 2.1 time: 1.489429 Aug 04 14:57:43.863275 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3235/6477] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:57:42 2022] DELETE /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 0 bytes in 1491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:57:43.872477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be1ad3cf-12a4-41d7-bc62-4e1b911d7644 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:43.873121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-be1ad3cf-12a4-41d7-bc62-4e1b911d7644 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:43.880298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be1ad3cf-12a4-41d7-bc62-4e1b911d7644 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:43.880777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be1ad3cf-12a4-41d7-bc62-4e1b911d7644 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:43.881574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be1ad3cf-12a4-41d7-bc62-4e1b911d7644 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:43.882003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be1ad3cf-12a4-41d7-bc62-4e1b911d7644 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:44.015218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-be1ad3cf-12a4-41d7-bc62-4e1b911d7644 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:44.023435 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-be1ad3cf-12a4-41d7-bc62-4e1b911d7644 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1502 microversion: 2.1 time: 0.154907 Aug 04 14:57:44.024024 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3243/6478] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:43 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:44.356072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3584394c-20a2-4bca-8e29-d6c4fd91ccaa req-0165aa9e-a42e-4c5d-bb2c-253d7d951816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cf25f7-fdde-4c4c-a6e5-0397cc19ff97", "name": "network-vif-plugged", "status": "completed", "tag": "ff5fef04-108c-4ef2-8b77-ef86b83c3049"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:57:44.368306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3584394c-20a2-4bca-8e29-d6c4fd91ccaa req-0165aa9e-a42e-4c5d-bb2c-253d7d951816 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:44.368959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3584394c-20a2-4bca-8e29-d6c4fd91ccaa req-0165aa9e-a42e-4c5d-bb2c-253d7d951816 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:44.381227 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3584394c-20a2-4bca-8e29-d6c4fd91ccaa req-0165aa9e-a42e-4c5d-bb2c-253d7d951816 service nova] Creating event network-vif-plugged:ff5fef04-108c-4ef2-8b77-ef86b83c3049 for instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 on n-h1-844627-10 Aug 04 14:57:44.386571 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3584394c-20a2-4bca-8e29-d6c4fd91ccaa req-0165aa9e-a42e-4c5d-bb2c-253d7d951816 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120211 Aug 04 14:57:44.387197 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3236/6479] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:57:45.051598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d20013fd-b2c1-4902-bda0-fd52fe215e30 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:45.052275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d20013fd-b2c1-4902-bda0-fd52fe215e30 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:45.059749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d20013fd-b2c1-4902-bda0-fd52fe215e30 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:45.060202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d20013fd-b2c1-4902-bda0-fd52fe215e30 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:45.061223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d20013fd-b2c1-4902-bda0-fd52fe215e30 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:45.061662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d20013fd-b2c1-4902-bda0-fd52fe215e30 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:45.204100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d20013fd-b2c1-4902-bda0-fd52fe215e30 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b642798f5014d8491d07db378321968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11eaaff5124d41868c3942694ecefc45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:45.212372 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d20013fd-b2c1-4902-bda0-fd52fe215e30 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 200 len: 1502 microversion: 2.1 time: 0.164723 Aug 04 14:57:45.213000 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3244/6480] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:45 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:45.893913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c1529e7e-e0bb-4a6a-a4b1-f374c055f9df req-84997b59-ee18-4342-8e8b-0e003d8dabe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cf25f7-fdde-4c4c-a6e5-0397cc19ff97", "name": "network-vif-deleted", "tag": "ff5fef04-108c-4ef2-8b77-ef86b83c3049"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:57:45.906592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c1529e7e-e0bb-4a6a-a4b1-f374c055f9df req-84997b59-ee18-4342-8e8b-0e003d8dabe5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:45.907200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c1529e7e-e0bb-4a6a-a4b1-f374c055f9df req-84997b59-ee18-4342-8e8b-0e003d8dabe5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:45.920434 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c1529e7e-e0bb-4a6a-a4b1-f374c055f9df req-84997b59-ee18-4342-8e8b-0e003d8dabe5 service nova] Creating event network-vif-deleted:ff5fef04-108c-4ef2-8b77-ef86b83c3049 for instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 on n-h1-844627-10 Aug 04 14:57:45.927284 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c1529e7e-e0bb-4a6a-a4b1-f374c055f9df req-84997b59-ee18-4342-8e8b-0e003d8dabe5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039268 Aug 04 14:57:45.928409 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3237/6481] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:57:46.233875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:46.234497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:46.241576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:46.242040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:46.242852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:46.243296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:46.257214 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] HTTP exception thrown: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Request method failure captured: Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 HTTP/1.1 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6945DBY4jCl5RTx3_RhdOx2w_ZkrsamhyFSfiUfz_tiYH15w4cssfB2GaP6xmJN09FEbRIbDUrJBD4vOCZWZli1TcSohcH7fpd1M8PnvsVgJo5HimGu7zXKkJuNceKbk4wkoGXx0U0biqg_UARNeQyr55gQb6Mdy8xrZ_eJdcA264sk Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 11eaaff5124d41868c3942694ecefc45 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-DeleteServersTestJSON-537864700 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/11eaaff5124d41868c3942694ecefc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_11eaaff5124d41868c3942694ecefc45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/11eaaff5124d41868c3942694ecefc45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/11eaaff5124d41868c3942694ecefc45"}]}] Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-DeleteServersTestJSON-537864700 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 11eaaff5124d41868c3942694ecefc45 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-DeleteServersTestJSON-537864700 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-DeleteServersTestJSON-537864700-project Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 5b642798f5014d8491d07db378321968 Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-DeleteServersTestJSON-537864700-project Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '37cf25f7-fdde-4c4c-a6e5-0397cc19ff97'} Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:57:46.258922 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Returning 404 to user: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1b963969-afb8-4840-b4eb-3403db8009ec tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 404 len: 111 microversion: 2.1 time: 0.030476 Aug 04 14:57:46.264581 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3245/6482] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:46 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:57:46.277516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:46.278128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:46.284822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:46.285319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:46.286120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:46.286575 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:46.306995 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] HTTP exception thrown: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Request method failure captured: Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 HTTP/1.1 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6945DBY4jCl5RTx3_RhdOx2w_ZkrsamhyFSfiUfz_tiYH15w4cssfB2GaP6xmJN09FEbRIbDUrJBD4vOCZWZli1TcSohcH7fpd1M8PnvsVgJo5HimGu7zXKkJuNceKbk4wkoGXx0U0biqg_UARNeQyr55gQb6Mdy8xrZ_eJdcA264sk Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 11eaaff5124d41868c3942694ecefc45 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-DeleteServersTestJSON-537864700 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/11eaaff5124d41868c3942694ecefc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_11eaaff5124d41868c3942694ecefc45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/11eaaff5124d41868c3942694ecefc45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/11eaaff5124d41868c3942694ecefc45"}]}] Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-DeleteServersTestJSON-537864700 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 11eaaff5124d41868c3942694ecefc45 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-DeleteServersTestJSON-537864700 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-DeleteServersTestJSON-537864700-project Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 5b642798f5014d8491d07db378321968 Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-DeleteServersTestJSON-537864700-project Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '37cf25f7-fdde-4c4c-a6e5-0397cc19ff97'} Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:57:46.308723 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Returning 404 to user: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-19de1d76-fcd2-4dfb-9425-23bf508a23c7 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "DELETE /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 404 len: 111 microversion: 2.1 time: 0.038110 Aug 04 14:57:46.314600 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3238/6483] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:57:46 2022] DELETE /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:57:46.318912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:46.319703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] [instance: 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:46.328331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:46.328786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:46.329614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:46.330067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:46.344985 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] HTTP exception thrown: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Request method failure captured: Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 HTTP/1.1 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6945DBY4jCl5RTx3_RhdOx2w_ZkrsamhyFSfiUfz_tiYH15w4cssfB2GaP6xmJN09FEbRIbDUrJBD4vOCZWZli1TcSohcH7fpd1M8PnvsVgJo5HimGu7zXKkJuNceKbk4wkoGXx0U0biqg_UARNeQyr55gQb6Mdy8xrZ_eJdcA264sk Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 11eaaff5124d41868c3942694ecefc45 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-DeleteServersTestJSON-537864700 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/11eaaff5124d41868c3942694ecefc45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_11eaaff5124d41868c3942694ecefc45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/11eaaff5124d41868c3942694ecefc45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/11eaaff5124d41868c3942694ecefc45"}]}] Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-DeleteServersTestJSON-537864700 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 11eaaff5124d41868c3942694ecefc45 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-DeleteServersTestJSON-537864700 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-DeleteServersTestJSON-537864700-project Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 5b642798f5014d8491d07db378321968 Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-DeleteServersTestJSON-537864700-project Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '37cf25f7-fdde-4c4c-a6e5-0397cc19ff97'} Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:57:46.346526 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] Returning 404 to user: Instance 37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b632aa7-10cd-450d-9b42-d79ee5adabf6 tempest-DeleteServersTestJSON-537864700 tempest-DeleteServersTestJSON-537864700-project] 10.222.0.66 "GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97" status: 404 len: 111 microversion: 2.1 time: 0.032882 Aug 04 14:57:46.352018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3246/6484] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:46 2022] GET /compute/v2.1/servers/37cf25f7-fdde-4c4c-a6e5-0397cc19ff97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:57:55.730977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-242287428", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "5499aaeb-22fa-4020-9fc6-d8ef10cfa36a"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:57:55.787221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] validate_networks() for [('5499aaeb-22fa-4020-9fc6-d8ef10cfa36a', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:57:56.177833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:57:56.178279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:57:56.178775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:57:56.179207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:57:56.179642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:57:56.189120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:56.189612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:56.190458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:56.190906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:56.209958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Getting quotas for project 10f3ea3ece9a49d391c4ff8f6582dd1d. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:57:56.218020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Getting quotas for user ff0cc1a818244ddda20f6d3eae22b21d and project 10f3ea3ece9a49d391c4ff8f6582dd1d. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:57:56.234309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:57:56.236637 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:57:56.286820 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fbf56c7c-f71b-4dc1-8d3e-0379177477fb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680423 Aug 04 14:57:56.287814 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3239/6485] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 14:57:56.301793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3cd9a335-a8a0-4d92-9be5-cf04ebcbad50 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:56.302938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3cd9a335-a8a0-4d92-9be5-cf04ebcbad50 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:56.335339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=27 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:57:56.372135 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3cd9a335-a8a0-4d92-9be5-cf04ebcbad50 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:56.381247 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3cd9a335-a8a0-4d92-9be5-cf04ebcbad50 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1217 microversion: 2.1 time: 0.084741 Aug 04 14:57:56.390601 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3247/6486] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:56 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:57.405586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-76e0fdae-6c6d-449d-a094-724b2e10c065 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:57.406426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-76e0fdae-6c6d-449d-a094-724b2e10c065 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:57.416161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76e0fdae-6c6d-449d-a094-724b2e10c065 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:57.416648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76e0fdae-6c6d-449d-a094-724b2e10c065 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:57.417665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76e0fdae-6c6d-449d-a094-724b2e10c065 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:57.418179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-76e0fdae-6c6d-449d-a094-724b2e10c065 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:57.562021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-76e0fdae-6c6d-449d-a094-724b2e10c065 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:57.572142 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-76e0fdae-6c6d-449d-a094-724b2e10c065 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1277 microversion: 2.1 time: 0.171957 Aug 04 14:57:57.572733 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3240/6487] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:57 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:58.595080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cf3acbc2-3a65-40bd-8e5e-eb2d6db7227e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:58.596411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cf3acbc2-3a65-40bd-8e5e-eb2d6db7227e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:58.610891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf3acbc2-3a65-40bd-8e5e-eb2d6db7227e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:58.611590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf3acbc2-3a65-40bd-8e5e-eb2d6db7227e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:58.612729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf3acbc2-3a65-40bd-8e5e-eb2d6db7227e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:58.613383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cf3acbc2-3a65-40bd-8e5e-eb2d6db7227e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:58.854767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cf3acbc2-3a65-40bd-8e5e-eb2d6db7227e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:57:58.865432 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cf3acbc2-3a65-40bd-8e5e-eb2d6db7227e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1317 microversion: 2.1 time: 0.275174 Aug 04 14:57:58.866061 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3248/6488] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:58 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:57:58.968301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fc4d7cca-9d85-4634-98aa-e51387b885fa req-8d9f59b7-bf8d-4af2-bce4-35283af2c197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd25816c-9032-466c-95da-460322d4e33b", "tag": "afc34238-8c01-4376-b391-a5f859bdc392"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:57:58.984643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fc4d7cca-9d85-4634-98aa-e51387b885fa req-8d9f59b7-bf8d-4af2-bce4-35283af2c197 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:58.986631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fc4d7cca-9d85-4634-98aa-e51387b885fa req-8d9f59b7-bf8d-4af2-bce4-35283af2c197 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:59.002740 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fc4d7cca-9d85-4634-98aa-e51387b885fa req-8d9f59b7-bf8d-4af2-bce4-35283af2c197 service nova] Creating event network-changed:afc34238-8c01-4376-b391-a5f859bdc392 for instance dd25816c-9032-466c-95da-460322d4e33b on n-h1-844627-10 Aug 04 14:57:59.009224 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fc4d7cca-9d85-4634-98aa-e51387b885fa req-8d9f59b7-bf8d-4af2-bce4-35283af2c197 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046633 Aug 04 14:57:59.010273 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3241/6489] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:57:59.886408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dea34965-6e59-4ac1-bc1b-c5eefc3e8c58 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:57:59.887519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dea34965-6e59-4ac1-bc1b-c5eefc3e8c58 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:57:59.898767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dea34965-6e59-4ac1-bc1b-c5eefc3e8c58 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:59.899230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dea34965-6e59-4ac1-bc1b-c5eefc3e8c58 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:57:59.900158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dea34965-6e59-4ac1-bc1b-c5eefc3e8c58 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:57:59.900628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dea34965-6e59-4ac1-bc1b-c5eefc3e8c58 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:00.040895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dea34965-6e59-4ac1-bc1b-c5eefc3e8c58 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:00.049019 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dea34965-6e59-4ac1-bc1b-c5eefc3e8c58 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1317 microversion: 2.1 time: 0.166477 Aug 04 14:58:00.049990 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3249/6490] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:57:59 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:01.071965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c187a65f-0562-48e3-bc28-cd52d14d6621 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:01.072701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c187a65f-0562-48e3-bc28-cd52d14d6621 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:01.080539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c187a65f-0562-48e3-bc28-cd52d14d6621 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:01.081038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c187a65f-0562-48e3-bc28-cd52d14d6621 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:01.082115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c187a65f-0562-48e3-bc28-cd52d14d6621 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:01.082579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c187a65f-0562-48e3-bc28-cd52d14d6621 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:01.231700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c187a65f-0562-48e3-bc28-cd52d14d6621 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:01.246937 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c187a65f-0562-48e3-bc28-cd52d14d6621 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1317 microversion: 2.1 time: 0.179678 Aug 04 14:58:01.247541 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3242/6491] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:01 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:02.268745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-10634819-ab50-4a24-9372-0a14c462775e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:02.269430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-10634819-ab50-4a24-9372-0a14c462775e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:02.276177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10634819-ab50-4a24-9372-0a14c462775e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:02.276631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10634819-ab50-4a24-9372-0a14c462775e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:02.277434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10634819-ab50-4a24-9372-0a14c462775e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:02.277875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10634819-ab50-4a24-9372-0a14c462775e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:02.415940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-10634819-ab50-4a24-9372-0a14c462775e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:02.424569 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-10634819-ab50-4a24-9372-0a14c462775e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1317 microversion: 2.1 time: 0.159957 Aug 04 14:58:02.425187 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3250/6492] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:02 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:03.446274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-403f7b2a-053e-4393-ad91-970300a5d243 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:03.446903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-403f7b2a-053e-4393-ad91-970300a5d243 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:03.455332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-403f7b2a-053e-4393-ad91-970300a5d243 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:03.455943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-403f7b2a-053e-4393-ad91-970300a5d243 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:03.457147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-403f7b2a-053e-4393-ad91-970300a5d243 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:03.457821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-403f7b2a-053e-4393-ad91-970300a5d243 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:03.598494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-403f7b2a-053e-4393-ad91-970300a5d243 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:03.613683 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-403f7b2a-053e-4393-ad91-970300a5d243 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1317 microversion: 2.1 time: 0.171821 Aug 04 14:58:03.614300 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3243/6493] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:03 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:04.636000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-25117710-d200-4837-85e8-3bdcadf8f57f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:04.636607 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-25117710-d200-4837-85e8-3bdcadf8f57f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:04.643783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25117710-d200-4837-85e8-3bdcadf8f57f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:04.644235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25117710-d200-4837-85e8-3bdcadf8f57f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:04.645051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25117710-d200-4837-85e8-3bdcadf8f57f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:04.645497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-25117710-d200-4837-85e8-3bdcadf8f57f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:04.787288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-25117710-d200-4837-85e8-3bdcadf8f57f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:04.795054 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-25117710-d200-4837-85e8-3bdcadf8f57f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1317 microversion: 2.1 time: 0.163356 Aug 04 14:58:04.795642 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3251/6494] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:04 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:05.815895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fd44e78a-e999-4cd5-9c5e-76bf772bd192 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:05.816544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fd44e78a-e999-4cd5-9c5e-76bf772bd192 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:05.824136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd44e78a-e999-4cd5-9c5e-76bf772bd192 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:05.824614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd44e78a-e999-4cd5-9c5e-76bf772bd192 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:05.825445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd44e78a-e999-4cd5-9c5e-76bf772bd192 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:05.825907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fd44e78a-e999-4cd5-9c5e-76bf772bd192 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:05.959105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fd44e78a-e999-4cd5-9c5e-76bf772bd192 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:05.967509 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fd44e78a-e999-4cd5-9c5e-76bf772bd192 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1317 microversion: 2.1 time: 0.155566 Aug 04 14:58:05.968087 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3244/6495] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:05 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:06.392893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6d49278a-0453-46a9-90ea-7935380a9281 req-e848f5a2-15e7-4513-8c39-7f98cefd118f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd25816c-9032-466c-95da-460322d4e33b", "name": "network-vif-plugged", "status": "completed", "tag": "afc34238-8c01-4376-b391-a5f859bdc392"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:06.401529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:06.406900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6d49278a-0453-46a9-90ea-7935380a9281 req-e848f5a2-15e7-4513-8c39-7f98cefd118f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:06.407449 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6d49278a-0453-46a9-90ea-7935380a9281 req-e848f5a2-15e7-4513-8c39-7f98cefd118f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:06.420099 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6d49278a-0453-46a9-90ea-7935380a9281 req-e848f5a2-15e7-4513-8c39-7f98cefd118f service nova] Creating event network-vif-plugged:afc34238-8c01-4376-b391-a5f859bdc392 for instance dd25816c-9032-466c-95da-460322d4e33b on n-h1-844627-10 Aug 04 14:58:06.426065 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6d49278a-0453-46a9-90ea-7935380a9281 req-e848f5a2-15e7-4513-8c39-7f98cefd118f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037794 Aug 04 14:58:06.426786 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3252/6496] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:58:06.988586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-227d4ba1-733e-433a-ba99-5d112a44b29f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:06.989239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-227d4ba1-733e-433a-ba99-5d112a44b29f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:06.991247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:06.992117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:06.999376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-227d4ba1-733e-433a-ba99-5d112a44b29f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:06.999844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-227d4ba1-733e-433a-ba99-5d112a44b29f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:07.000636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-227d4ba1-733e-433a-ba99-5d112a44b29f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:07.001111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-227d4ba1-733e-433a-ba99-5d112a44b29f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:07.142357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-227d4ba1-733e-433a-ba99-5d112a44b29f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:07.144966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:07.153468 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-227d4ba1-733e-433a-ba99-5d112a44b29f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1317 microversion: 2.1 time: 0.168633 Aug 04 14:58:07.154252 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3245/6497] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:06 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:08.175577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e4acc949-8081-4c00-bcb3-ac36a437b47a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:08.176279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e4acc949-8081-4c00-bcb3-ac36a437b47a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:08.183231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4acc949-8081-4c00-bcb3-ac36a437b47a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.183676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4acc949-8081-4c00-bcb3-ac36a437b47a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.184430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4acc949-8081-4c00-bcb3-ac36a437b47a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.184890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e4acc949-8081-4c00-bcb3-ac36a437b47a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.319748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e4acc949-8081-4c00-bcb3-ac36a437b47a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:08.327503 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e4acc949-8081-4c00-bcb3-ac36a437b47a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1508 microversion: 2.1 time: 0.157142 Aug 04 14:58:08.328092 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3253/6498] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:08 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:08.348364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-57561e26-7f3d-404f-8eb7-cd9c9051723f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:08.349112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-57561e26-7f3d-404f-8eb7-cd9c9051723f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:08.358666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57561e26-7f3d-404f-8eb7-cd9c9051723f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.359234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57561e26-7f3d-404f-8eb7-cd9c9051723f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.359911 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57561e26-7f3d-404f-8eb7-cd9c9051723f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.360481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-57561e26-7f3d-404f-8eb7-cd9c9051723f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.512699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-57561e26-7f3d-404f-8eb7-cd9c9051723f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:08.521010 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-57561e26-7f3d-404f-8eb7-cd9c9051723f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1508 microversion: 2.1 time: 0.176448 Aug 04 14:58:08.521625 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3246/6499] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:08 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:08.542496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b1da5f04-ab8e-4bd3-ae29-cf199904723b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:08.544937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b1da5f04-ab8e-4bd3-ae29-cf199904723b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:08.551461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1da5f04-ab8e-4bd3-ae29-cf199904723b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.551911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1da5f04-ab8e-4bd3-ae29-cf199904723b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.552677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1da5f04-ab8e-4bd3-ae29-cf199904723b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.553153 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b1da5f04-ab8e-4bd3-ae29-cf199904723b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.621828 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b1da5f04-ab8e-4bd3-ae29-cf199904723b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "PUT /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1080 microversion: 2.1 time: 0.083842 Aug 04 14:58:08.622572 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3254/6500] 10.222.0.66 () {60 vars in 1256 bytes} [Thu Aug 4 14:58:08 2022] PUT /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1080 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:08.639393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b2e1e2f1-6734-4d2a-b860-79399eca1f3b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:08.640690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b2e1e2f1-6734-4d2a-b860-79399eca1f3b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:08.647022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2e1e2f1-6734-4d2a-b860-79399eca1f3b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.647496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2e1e2f1-6734-4d2a-b860-79399eca1f3b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.648298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2e1e2f1-6734-4d2a-b860-79399eca1f3b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.649278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2e1e2f1-6734-4d2a-b860-79399eca1f3b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.799080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b2e1e2f1-6734-4d2a-b860-79399eca1f3b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:08.807260 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b2e1e2f1-6734-4d2a-b860-79399eca1f3b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1506 microversion: 2.1 time: 0.171723 Aug 04 14:58:08.807851 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3247/6501] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:08 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:58:08.827995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-668a6c20-adc2-4d74-b36b-64f1e6e89237 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:08.828619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-668a6c20-adc2-4d74-b36b-64f1e6e89237 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:08.837018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-668a6c20-adc2-4d74-b36b-64f1e6e89237 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.837468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-668a6c20-adc2-4d74-b36b-64f1e6e89237 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.838252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-668a6c20-adc2-4d74-b36b-64f1e6e89237 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:08.838686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-668a6c20-adc2-4d74-b36b-64f1e6e89237 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:08.979279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-668a6c20-adc2-4d74-b36b-64f1e6e89237 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:08.987207 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-668a6c20-adc2-4d74-b36b-64f1e6e89237 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1506 microversion: 2.1 time: 0.163191 Aug 04 14:58:08.987799 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3255/6502] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:08 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:09.007471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:09.010556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:09.012536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:09.018297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:09.018792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:09.019599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:09.020056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:09.051694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:09.058941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Old instance type m1.heat2, new instance type m1.heat {{(pid=130961) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 14:58:09.066000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:58:09.066441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:58:09.066929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:58:09.067353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:58:09.067781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:58:09.146509 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c9db555-8b3e-4785-a329-2e4a3f0c4431 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "POST /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b/action" status: 202 len: 0 microversion: 2.1 time: 0.142889 Aug 04 14:58:09.147129 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3248/6503] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:58:09 2022] POST /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:58:09.160405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b113557-e5bd-40ea-969f-67ab9aeb0ec5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:09.161073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b113557-e5bd-40ea-969f-67ab9aeb0ec5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:09.168528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b113557-e5bd-40ea-969f-67ab9aeb0ec5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:09.168782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b113557-e5bd-40ea-969f-67ab9aeb0ec5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:09.169600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b113557-e5bd-40ea-969f-67ab9aeb0ec5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:09.170043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b113557-e5bd-40ea-969f-67ab9aeb0ec5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:09.318318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b113557-e5bd-40ea-969f-67ab9aeb0ec5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:09.326572 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b113557-e5bd-40ea-969f-67ab9aeb0ec5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1517 microversion: 2.1 time: 0.173094 Aug 04 14:58:09.327157 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3256/6504] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:09 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:10.348749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4c14f31c-e6cc-4b44-a0b6-8a98cfefdf76 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:10.349520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4c14f31c-e6cc-4b44-a0b6-8a98cfefdf76 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:10.355981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c14f31c-e6cc-4b44-a0b6-8a98cfefdf76 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:10.356444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c14f31c-e6cc-4b44-a0b6-8a98cfefdf76 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:10.357274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c14f31c-e6cc-4b44-a0b6-8a98cfefdf76 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:10.357728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4c14f31c-e6cc-4b44-a0b6-8a98cfefdf76 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:10.500950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4c14f31c-e6cc-4b44-a0b6-8a98cfefdf76 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:10.510872 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4c14f31c-e6cc-4b44-a0b6-8a98cfefdf76 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1517 microversion: 2.1 time: 0.167006 Aug 04 14:58:10.511416 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3249/6505] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:10 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:11.533638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f3b78d1-da49-4bd8-bed6-443850f26fc5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:11.534274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f3b78d1-da49-4bd8-bed6-443850f26fc5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:11.537129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=34 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:11.542881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f3b78d1-da49-4bd8-bed6-443850f26fc5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:11.543329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f3b78d1-da49-4bd8-bed6-443850f26fc5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:11.544093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f3b78d1-da49-4bd8-bed6-443850f26fc5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:11.544526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f3b78d1-da49-4bd8-bed6-443850f26fc5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:11.679096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5f3b78d1-da49-4bd8-bed6-443850f26fc5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:11.687044 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f3b78d1-da49-4bd8-bed6-443850f26fc5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.157359 Aug 04 14:58:11.690682 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3257/6506] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:11 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:12.708608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-05c136b0-1fc0-464f-8ca6-fb0acd5335ea tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:12.709281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-05c136b0-1fc0-464f-8ca6-fb0acd5335ea tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:12.716425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05c136b0-1fc0-464f-8ca6-fb0acd5335ea tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:12.716931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05c136b0-1fc0-464f-8ca6-fb0acd5335ea tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:12.717753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05c136b0-1fc0-464f-8ca6-fb0acd5335ea tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:12.718196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05c136b0-1fc0-464f-8ca6-fb0acd5335ea tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:12.854903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-05c136b0-1fc0-464f-8ca6-fb0acd5335ea tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:12.864639 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-05c136b0-1fc0-464f-8ca6-fb0acd5335ea tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.159959 Aug 04 14:58:12.865350 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3250/6507] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:12 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:13.892372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dcc5c1ec-f2e3-4a9a-8296-74780e0e6d46 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:13.893090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dcc5c1ec-f2e3-4a9a-8296-74780e0e6d46 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:13.900473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dcc5c1ec-f2e3-4a9a-8296-74780e0e6d46 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:13.900956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dcc5c1ec-f2e3-4a9a-8296-74780e0e6d46 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:13.901736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dcc5c1ec-f2e3-4a9a-8296-74780e0e6d46 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:13.902176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dcc5c1ec-f2e3-4a9a-8296-74780e0e6d46 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:14.037586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dcc5c1ec-f2e3-4a9a-8296-74780e0e6d46 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:14.045700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dcc5c1ec-f2e3-4a9a-8296-74780e0e6d46 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.157624 Aug 04 14:58:14.046302 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3258/6508] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:13 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:15.067121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-98739501-39a5-4fb8-b630-da9030769e8d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:15.067748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-98739501-39a5-4fb8-b630-da9030769e8d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:15.075207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98739501-39a5-4fb8-b630-da9030769e8d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:15.075671 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98739501-39a5-4fb8-b630-da9030769e8d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:15.076447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98739501-39a5-4fb8-b630-da9030769e8d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:15.076926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-98739501-39a5-4fb8-b630-da9030769e8d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:15.217596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-98739501-39a5-4fb8-b630-da9030769e8d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:15.225250 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-98739501-39a5-4fb8-b630-da9030769e8d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.162032 Aug 04 14:58:15.225823 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3251/6509] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:15 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:16.245911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc0a5700-0528-4ce3-9de6-0970a0681652 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:16.246555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bc0a5700-0528-4ce3-9de6-0970a0681652 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:16.253586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc0a5700-0528-4ce3-9de6-0970a0681652 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:16.254038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc0a5700-0528-4ce3-9de6-0970a0681652 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:16.254834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc0a5700-0528-4ce3-9de6-0970a0681652 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:16.255263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc0a5700-0528-4ce3-9de6-0970a0681652 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:16.391177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bc0a5700-0528-4ce3-9de6-0970a0681652 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:16.400503 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bc0a5700-0528-4ce3-9de6-0970a0681652 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.158951 Aug 04 14:58:16.401160 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3259/6510] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:16 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:17.423198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-96a8f9b6-c59e-41c9-bbbf-25501a5d3e03 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:17.423778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-96a8f9b6-c59e-41c9-bbbf-25501a5d3e03 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:17.431595 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96a8f9b6-c59e-41c9-bbbf-25501a5d3e03 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:17.432069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96a8f9b6-c59e-41c9-bbbf-25501a5d3e03 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:17.432885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96a8f9b6-c59e-41c9-bbbf-25501a5d3e03 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:17.433358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96a8f9b6-c59e-41c9-bbbf-25501a5d3e03 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:17.574372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-96a8f9b6-c59e-41c9-bbbf-25501a5d3e03 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:17.582302 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-96a8f9b6-c59e-41c9-bbbf-25501a5d3e03 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.162918 Aug 04 14:58:17.582879 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3252/6511] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:17 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:18.605246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac15bfcd-349d-4075-91be-8f85bba8e469 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:18.605872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac15bfcd-349d-4075-91be-8f85bba8e469 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:18.613688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac15bfcd-349d-4075-91be-8f85bba8e469 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:18.614152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac15bfcd-349d-4075-91be-8f85bba8e469 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:18.614934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac15bfcd-349d-4075-91be-8f85bba8e469 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:18.615377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac15bfcd-349d-4075-91be-8f85bba8e469 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:18.759322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac15bfcd-349d-4075-91be-8f85bba8e469 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:18.767416 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac15bfcd-349d-4075-91be-8f85bba8e469 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.166040 Aug 04 14:58:18.768023 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3260/6512] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:18 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:19.790728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c743ab4e-f7c4-4aee-9965-9975ca764543 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:19.791439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c743ab4e-f7c4-4aee-9965-9975ca764543 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:19.799692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c743ab4e-f7c4-4aee-9965-9975ca764543 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:19.800191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c743ab4e-f7c4-4aee-9965-9975ca764543 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:19.801025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c743ab4e-f7c4-4aee-9965-9975ca764543 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:19.801482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c743ab4e-f7c4-4aee-9965-9975ca764543 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:19.933962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c743ab4e-f7c4-4aee-9965-9975ca764543 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:19.941938 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c743ab4e-f7c4-4aee-9965-9975ca764543 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.156452 Aug 04 14:58:19.942510 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3253/6513] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:19 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:20.963139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21105fa4-ac6b-46e2-97e7-472153e3ae86 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:20.963770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-21105fa4-ac6b-46e2-97e7-472153e3ae86 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:20.970738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21105fa4-ac6b-46e2-97e7-472153e3ae86 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:20.971189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21105fa4-ac6b-46e2-97e7-472153e3ae86 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:20.971961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21105fa4-ac6b-46e2-97e7-472153e3ae86 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:20.972399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21105fa4-ac6b-46e2-97e7-472153e3ae86 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:21.120157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-21105fa4-ac6b-46e2-97e7-472153e3ae86 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:21.127880 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-21105fa4-ac6b-46e2-97e7-472153e3ae86 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.168788 Aug 04 14:58:21.128457 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3261/6514] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:20 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:22.150492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-312c37f6-0185-4310-bd02-68123f13a91b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:22.151127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-312c37f6-0185-4310-bd02-68123f13a91b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:22.160849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-312c37f6-0185-4310-bd02-68123f13a91b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:22.161333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-312c37f6-0185-4310-bd02-68123f13a91b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:22.162134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-312c37f6-0185-4310-bd02-68123f13a91b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:22.162572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-312c37f6-0185-4310-bd02-68123f13a91b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:22.303838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-312c37f6-0185-4310-bd02-68123f13a91b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:22.317468 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-312c37f6-0185-4310-bd02-68123f13a91b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.171687 Aug 04 14:58:22.318087 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3254/6515] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:22 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:23.339557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e053ff5b-7ff2-4c40-94b3-112ea6a038db tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:23.340204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e053ff5b-7ff2-4c40-94b3-112ea6a038db tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:23.347240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e053ff5b-7ff2-4c40-94b3-112ea6a038db tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:23.347616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e053ff5b-7ff2-4c40-94b3-112ea6a038db tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:23.348389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e053ff5b-7ff2-4c40-94b3-112ea6a038db tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:23.348830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e053ff5b-7ff2-4c40-94b3-112ea6a038db tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:23.488956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e053ff5b-7ff2-4c40-94b3-112ea6a038db tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:23.496993 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e053ff5b-7ff2-4c40-94b3-112ea6a038db tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.161360 Aug 04 14:58:23.497596 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3262/6516] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:23 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:23.940940 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 14:58:23.941588 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 14:58:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 14:58:24.518094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b5bfd428-aa47-4eae-b208-4c9c227897d8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:24.518738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b5bfd428-aa47-4eae-b208-4c9c227897d8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:24.526190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5bfd428-aa47-4eae-b208-4c9c227897d8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:24.526722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5bfd428-aa47-4eae-b208-4c9c227897d8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:24.527457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5bfd428-aa47-4eae-b208-4c9c227897d8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:24.527913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5bfd428-aa47-4eae-b208-4c9c227897d8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:24.672418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b5bfd428-aa47-4eae-b208-4c9c227897d8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:24.681008 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b5bfd428-aa47-4eae-b208-4c9c227897d8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.166839 Aug 04 14:58:24.681612 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3255/6517] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:24 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:25.702632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1d4b2114-2b0b-4627-9bb4-b7871f0d97a0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:25.703255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1d4b2114-2b0b-4627-9bb4-b7871f0d97a0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:25.710948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d4b2114-2b0b-4627-9bb4-b7871f0d97a0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:25.711658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d4b2114-2b0b-4627-9bb4-b7871f0d97a0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:25.712027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d4b2114-2b0b-4627-9bb4-b7871f0d97a0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:25.712459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d4b2114-2b0b-4627-9bb4-b7871f0d97a0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:25.855061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d4b2114-2b0b-4627-9bb4-b7871f0d97a0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:25.862700 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1d4b2114-2b0b-4627-9bb4-b7871f0d97a0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.164052 Aug 04 14:58:25.863270 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3263/6518] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:25 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:26.884649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a9d05097-2802-4c2a-944b-47b71f36d157 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:26.885310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a9d05097-2802-4c2a-944b-47b71f36d157 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:26.892279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9d05097-2802-4c2a-944b-47b71f36d157 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:26.892751 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9d05097-2802-4c2a-944b-47b71f36d157 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:26.893566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9d05097-2802-4c2a-944b-47b71f36d157 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:26.894022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9d05097-2802-4c2a-944b-47b71f36d157 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:27.030405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a9d05097-2802-4c2a-944b-47b71f36d157 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:27.038355 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a9d05097-2802-4c2a-944b-47b71f36d157 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.158216 Aug 04 14:58:27.038935 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3256/6519] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:26 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:28.060583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6948f806-4f85-4c95-8f9f-efb9346e50f2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:28.061271 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6948f806-4f85-4c95-8f9f-efb9346e50f2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:28.068707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6948f806-4f85-4c95-8f9f-efb9346e50f2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:28.069198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6948f806-4f85-4c95-8f9f-efb9346e50f2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:28.069997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6948f806-4f85-4c95-8f9f-efb9346e50f2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:28.070433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6948f806-4f85-4c95-8f9f-efb9346e50f2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:28.073951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:28.208536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6948f806-4f85-4c95-8f9f-efb9346e50f2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:28.216710 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6948f806-4f85-4c95-8f9f-efb9346e50f2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.160318 Aug 04 14:58:28.217326 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3264/6520] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:28 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:29.238185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-91d61da9-d289-45ef-bb33-b6a74cd4603a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:29.238941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-91d61da9-d289-45ef-bb33-b6a74cd4603a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:29.247451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d61da9-d289-45ef-bb33-b6a74cd4603a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:29.247928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d61da9-d289-45ef-bb33-b6a74cd4603a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:29.248734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d61da9-d289-45ef-bb33-b6a74cd4603a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:29.249231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-91d61da9-d289-45ef-bb33-b6a74cd4603a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:29.409526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-91d61da9-d289-45ef-bb33-b6a74cd4603a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:29.417908 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-91d61da9-d289-45ef-bb33-b6a74cd4603a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.183846 Aug 04 14:58:29.418494 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3257/6521] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:29 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:30.442229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8da035ca-b79d-4b3e-9eec-2a0eb5499acb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:30.442822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8da035ca-b79d-4b3e-9eec-2a0eb5499acb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:30.450825 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8da035ca-b79d-4b3e-9eec-2a0eb5499acb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:30.451269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8da035ca-b79d-4b3e-9eec-2a0eb5499acb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:30.452057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8da035ca-b79d-4b3e-9eec-2a0eb5499acb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:30.452505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8da035ca-b79d-4b3e-9eec-2a0eb5499acb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:30.587373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8da035ca-b79d-4b3e-9eec-2a0eb5499acb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:30.595707 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8da035ca-b79d-4b3e-9eec-2a0eb5499acb tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.159080 Aug 04 14:58:30.596551 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3265/6522] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:30 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:31.617622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-efdd1b4c-9bf3-44b5-8a96-e09a91c2c1c1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:31.618279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-efdd1b4c-9bf3-44b5-8a96-e09a91c2c1c1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:31.625707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efdd1b4c-9bf3-44b5-8a96-e09a91c2c1c1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:31.626173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efdd1b4c-9bf3-44b5-8a96-e09a91c2c1c1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:31.626965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efdd1b4c-9bf3-44b5-8a96-e09a91c2c1c1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:31.627414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-efdd1b4c-9bf3-44b5-8a96-e09a91c2c1c1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:31.761462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-efdd1b4c-9bf3-44b5-8a96-e09a91c2c1c1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:31.769673 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-efdd1b4c-9bf3-44b5-8a96-e09a91c2c1c1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.155890 Aug 04 14:58:31.770269 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3258/6523] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:31 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:58:32.791773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fbc598ae-de2b-4dca-9c67-8d06f1b2cb87 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:32.792381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fbc598ae-de2b-4dca-9c67-8d06f1b2cb87 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:32.799330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbc598ae-de2b-4dca-9c67-8d06f1b2cb87 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:32.799781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbc598ae-de2b-4dca-9c67-8d06f1b2cb87 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:32.800569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbc598ae-de2b-4dca-9c67-8d06f1b2cb87 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:32.801040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fbc598ae-de2b-4dca-9c67-8d06f1b2cb87 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:32.938161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fbc598ae-de2b-4dca-9c67-8d06f1b2cb87 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:32.946805 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fbc598ae-de2b-4dca-9c67-8d06f1b2cb87 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.159514 Aug 04 14:58:32.947400 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3266/6524] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:32 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:33.968399 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-706b1458-5738-414f-aa49-c826e947c917 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:33.969180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-706b1458-5738-414f-aa49-c826e947c917 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:33.978211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706b1458-5738-414f-aa49-c826e947c917 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:33.978211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706b1458-5738-414f-aa49-c826e947c917 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:33.979052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706b1458-5738-414f-aa49-c826e947c917 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:33.979534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-706b1458-5738-414f-aa49-c826e947c917 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:34.117925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-706b1458-5738-414f-aa49-c826e947c917 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:34.125506 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-706b1458-5738-414f-aa49-c826e947c917 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.161293 Aug 04 14:58:34.126075 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3259/6525] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:33 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:35.146978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab6b53ae-2ace-4794-8b05-32bb0b55f5de tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:35.147599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ab6b53ae-2ace-4794-8b05-32bb0b55f5de tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:35.154797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab6b53ae-2ace-4794-8b05-32bb0b55f5de tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:35.155252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab6b53ae-2ace-4794-8b05-32bb0b55f5de tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:35.156120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab6b53ae-2ace-4794-8b05-32bb0b55f5de tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:35.156478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab6b53ae-2ace-4794-8b05-32bb0b55f5de tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:35.296520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ab6b53ae-2ace-4794-8b05-32bb0b55f5de tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:35.305091 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab6b53ae-2ace-4794-8b05-32bb0b55f5de tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.161434 Aug 04 14:58:35.305692 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3267/6526] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:35 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:36.326910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01ddac1a-e8c7-4846-a148-00f2bc1f3f4f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:36.327531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-01ddac1a-e8c7-4846-a148-00f2bc1f3f4f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:36.334865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01ddac1a-e8c7-4846-a148-00f2bc1f3f4f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:36.335337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01ddac1a-e8c7-4846-a148-00f2bc1f3f4f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:36.336112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01ddac1a-e8c7-4846-a148-00f2bc1f3f4f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:36.336565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01ddac1a-e8c7-4846-a148-00f2bc1f3f4f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:36.473977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-01ddac1a-e8c7-4846-a148-00f2bc1f3f4f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:36.481684 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-01ddac1a-e8c7-4846-a148-00f2bc1f3f4f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.158715 Aug 04 14:58:36.482268 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3260/6527] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:36 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:58:37.504071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fcc0921a-4eb7-4c92-9d2a-767363e63e2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:37.504696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fcc0921a-4eb7-4c92-9d2a-767363e63e2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:37.512618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcc0921a-4eb7-4c92-9d2a-767363e63e2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:37.513105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcc0921a-4eb7-4c92-9d2a-767363e63e2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:37.513886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcc0921a-4eb7-4c92-9d2a-767363e63e2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:37.514322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fcc0921a-4eb7-4c92-9d2a-767363e63e2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:37.650249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fcc0921a-4eb7-4c92-9d2a-767363e63e2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:37.657854 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fcc0921a-4eb7-4c92-9d2a-767363e63e2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1522 microversion: 2.1 time: 0.157727 Aug 04 14:58:37.658423 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3268/6528] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:37 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:38.679044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7d25e851-62c0-4c0c-a6bf-3de33ef23d2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:38.679660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7d25e851-62c0-4c0c-a6bf-3de33ef23d2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:38.687283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d25e851-62c0-4c0c-a6bf-3de33ef23d2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:38.687758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d25e851-62c0-4c0c-a6bf-3de33ef23d2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:38.688565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d25e851-62c0-4c0c-a6bf-3de33ef23d2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:38.689061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7d25e851-62c0-4c0c-a6bf-3de33ef23d2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:38.692159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:39.029937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7d25e851-62c0-4c0c-a6bf-3de33ef23d2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:39.042569 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7d25e851-62c0-4c0c-a6bf-3de33ef23d2b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1521 microversion: 2.1 time: 0.367300 Aug 04 14:58:39.043461 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3261/6529] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:38 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:39.146408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0ab8cc23-4b3e-4a9f-82f2-a72c7d1f6393 req-bedce079-8be0-4ae5-9d7e-0fbe7677364d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd25816c-9032-466c-95da-460322d4e33b", "name": "network-vif-unplugged", "status": "completed", "tag": "afc34238-8c01-4376-b391-a5f859bdc392"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:39.157803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0ab8cc23-4b3e-4a9f-82f2-a72c7d1f6393 req-bedce079-8be0-4ae5-9d7e-0fbe7677364d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:39.158246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0ab8cc23-4b3e-4a9f-82f2-a72c7d1f6393 req-bedce079-8be0-4ae5-9d7e-0fbe7677364d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:39.174660 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0ab8cc23-4b3e-4a9f-82f2-a72c7d1f6393 req-bedce079-8be0-4ae5-9d7e-0fbe7677364d service nova] Creating event network-vif-unplugged:afc34238-8c01-4376-b391-a5f859bdc392 for instance dd25816c-9032-466c-95da-460322d4e33b on n-h2-844627-10 Aug 04 14:58:39.181407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-0ab8cc23-4b3e-4a9f-82f2-a72c7d1f6393 req-bedce079-8be0-4ae5-9d7e-0fbe7677364d service nova] Instance dd25816c-9032-466c-95da-460322d4e33b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:58:39.193826 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0ab8cc23-4b3e-4a9f-82f2-a72c7d1f6393 req-bedce079-8be0-4ae5-9d7e-0fbe7677364d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052733 Aug 04 14:58:39.194202 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3269/6530] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:58:40.074674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fc62eac5-b375-42c1-9b8e-c57043fda4a8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:40.075585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fc62eac5-b375-42c1-9b8e-c57043fda4a8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:40.077481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=32 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:40.084520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc62eac5-b375-42c1-9b8e-c57043fda4a8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:40.085020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc62eac5-b375-42c1-9b8e-c57043fda4a8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:40.086371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc62eac5-b375-42c1-9b8e-c57043fda4a8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:40.087152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc62eac5-b375-42c1-9b8e-c57043fda4a8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:40.233733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fc62eac5-b375-42c1-9b8e-c57043fda4a8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:40.241365 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fc62eac5-b375-42c1-9b8e-c57043fda4a8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1519 microversion: 2.1 time: 0.173265 Aug 04 14:58:40.241987 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3262/6531] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:40 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:41.229007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6cb1791e-043c-4517-92fd-c4816387b789 req-b0015438-c330-444e-9cae-5b4567a3f022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd25816c-9032-466c-95da-460322d4e33b", "tag": "afc34238-8c01-4376-b391-a5f859bdc392"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:41.238569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6cb1791e-043c-4517-92fd-c4816387b789 req-b0015438-c330-444e-9cae-5b4567a3f022 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:41.239009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6cb1791e-043c-4517-92fd-c4816387b789 req-b0015438-c330-444e-9cae-5b4567a3f022 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:41.250574 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6cb1791e-043c-4517-92fd-c4816387b789 req-b0015438-c330-444e-9cae-5b4567a3f022 service nova] Creating event network-changed:afc34238-8c01-4376-b391-a5f859bdc392 for instance dd25816c-9032-466c-95da-460322d4e33b on n-h2-844627-10 Aug 04 14:58:41.256124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-6cb1791e-043c-4517-92fd-c4816387b789 req-b0015438-c330-444e-9cae-5b4567a3f022 service nova] Instance dd25816c-9032-466c-95da-460322d4e33b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:58:41.262686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3370ce1c-ae31-4551-a32d-788f38ed88ee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:41.263464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3370ce1c-ae31-4551-a32d-788f38ed88ee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:41.268359 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6cb1791e-043c-4517-92fd-c4816387b789 req-b0015438-c330-444e-9cae-5b4567a3f022 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044426 Aug 04 14:58:41.269196 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3270/6532] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:58:41.271431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3370ce1c-ae31-4551-a32d-788f38ed88ee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:41.271952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3370ce1c-ae31-4551-a32d-788f38ed88ee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:41.272633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3370ce1c-ae31-4551-a32d-788f38ed88ee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:41.273921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3370ce1c-ae31-4551-a32d-788f38ed88ee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:41.566218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3370ce1c-ae31-4551-a32d-788f38ed88ee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:41.574873 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3370ce1c-ae31-4551-a32d-788f38ed88ee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1519 microversion: 2.1 time: 0.316045 Aug 04 14:58:41.575546 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3263/6533] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:41 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1519 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:58:42.598301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b58ec80b-bd0d-4dcf-ae28-26d6c433a9c0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:42.598997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b58ec80b-bd0d-4dcf-ae28-26d6c433a9c0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:42.601149 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=28 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:42.607241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b58ec80b-bd0d-4dcf-ae28-26d6c433a9c0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:42.607699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b58ec80b-bd0d-4dcf-ae28-26d6c433a9c0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:42.608480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b58ec80b-bd0d-4dcf-ae28-26d6c433a9c0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:42.608966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b58ec80b-bd0d-4dcf-ae28-26d6c433a9c0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:42.743330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b58ec80b-bd0d-4dcf-ae28-26d6c433a9c0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:42.750964 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b58ec80b-bd0d-4dcf-ae28-26d6c433a9c0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1516 microversion: 2.1 time: 0.158824 Aug 04 14:58:42.751537 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3271/6534] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:42 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:58:42.771649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4f6e8584-d599-45f5-806c-ef16caca3c35 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:42.772314 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4f6e8584-d599-45f5-806c-ef16caca3c35 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:42.780011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f6e8584-d599-45f5-806c-ef16caca3c35 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:42.780483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f6e8584-d599-45f5-806c-ef16caca3c35 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:42.781319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f6e8584-d599-45f5-806c-ef16caca3c35 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:42.781782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4f6e8584-d599-45f5-806c-ef16caca3c35 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:42.840389 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4f6e8584-d599-45f5-806c-ef16caca3c35 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "POST /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b/action" status: 204 len: 0 microversion: 2.1 time: 0.072549 Aug 04 14:58:42.841052 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3264/6535] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:58:42 2022] POST /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:58:42.849192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-74eb7862-25ad-481b-94c5-c38a7de5c203 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:42.849814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-74eb7862-25ad-481b-94c5-c38a7de5c203 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:42.856584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74eb7862-25ad-481b-94c5-c38a7de5c203 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:42.856980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74eb7862-25ad-481b-94c5-c38a7de5c203 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:42.857966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74eb7862-25ad-481b-94c5-c38a7de5c203 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:42.858557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74eb7862-25ad-481b-94c5-c38a7de5c203 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:43.074308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-74eb7862-25ad-481b-94c5-c38a7de5c203 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:43.081930 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-74eb7862-25ad-481b-94c5-c38a7de5c203 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1516 microversion: 2.1 time: 0.236678 Aug 04 14:58:43.082768 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3272/6536] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:42 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:43.972945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-07799ea5-7609-4c6d-bba0-0eb61f85cb2d req-14f56852-36e0-46be-a00b-40933d6e04c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd25816c-9032-466c-95da-460322d4e33b", "name": "network-vif-plugged", "status": "completed", "tag": "afc34238-8c01-4376-b391-a5f859bdc392"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:43.985795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-07799ea5-7609-4c6d-bba0-0eb61f85cb2d req-14f56852-36e0-46be-a00b-40933d6e04c5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:43.986528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-07799ea5-7609-4c6d-bba0-0eb61f85cb2d req-14f56852-36e0-46be-a00b-40933d6e04c5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:43.999498 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-07799ea5-7609-4c6d-bba0-0eb61f85cb2d req-14f56852-36e0-46be-a00b-40933d6e04c5 service nova] Creating event network-vif-plugged:afc34238-8c01-4376-b391-a5f859bdc392 for instance dd25816c-9032-466c-95da-460322d4e33b on n-h2-844627-10 Aug 04 14:58:44.004505 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-07799ea5-7609-4c6d-bba0-0eb61f85cb2d req-14f56852-36e0-46be-a00b-40933d6e04c5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037610 Aug 04 14:58:44.005558 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3265/6537] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:58:44.102993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8e8e3da8-3c18-4ea8-a353-e5d3663aa5c5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:44.103519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8e8e3da8-3c18-4ea8-a353-e5d3663aa5c5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:44.110384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e8e3da8-3c18-4ea8-a353-e5d3663aa5c5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:44.110828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e8e3da8-3c18-4ea8-a353-e5d3663aa5c5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:44.111601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e8e3da8-3c18-4ea8-a353-e5d3663aa5c5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:44.112033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8e8e3da8-3c18-4ea8-a353-e5d3663aa5c5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:44.259173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8e8e3da8-3c18-4ea8-a353-e5d3663aa5c5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:44.266949 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8e8e3da8-3c18-4ea8-a353-e5d3663aa5c5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1508 microversion: 2.1 time: 0.167879 Aug 04 14:58:44.267535 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3273/6538] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:44 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:44.289363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0f213ce5-092c-43fd-83d2-1dc547e09270 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:44.290102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0f213ce5-092c-43fd-83d2-1dc547e09270 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:44.296508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f213ce5-092c-43fd-83d2-1dc547e09270 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:44.297037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f213ce5-092c-43fd-83d2-1dc547e09270 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:44.297902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f213ce5-092c-43fd-83d2-1dc547e09270 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:44.298362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0f213ce5-092c-43fd-83d2-1dc547e09270 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:44.436365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0f213ce5-092c-43fd-83d2-1dc547e09270 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:44.444577 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0f213ce5-092c-43fd-83d2-1dc547e09270 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1508 microversion: 2.1 time: 0.159556 Aug 04 14:58:44.446603 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3266/6539] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:44 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:44.470598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-680f6b64-4d36-47d0-a687-7833ff44e6a1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Action: 'create', calling method: .version_select at 0x7f46f3ba2d30>, body: {"keypair": {"name": "tempest-keypair-1913808007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+6DrbTZog5NjNbNdiTU7ryT4Y0EiPnj4Eg9+cjPqxpcFQobptqqftxOenhCeLfgYZO7S/Hx3QLelpJKYywe+MFmv0tfi5e38Sj6ZyxOID8g5vDJtzqjSwIpFGlc6AWdw=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:44.486824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-680f6b64-4d36-47d0-a687-7833ff44e6a1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Getting quotas for project 10f3ea3ece9a49d391c4ff8f6582dd1d. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:58:44.493232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-680f6b64-4d36-47d0-a687-7833ff44e6a1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Getting quotas for user ff0cc1a818244ddda20f6d3eae22b21d and project 10f3ea3ece9a49d391c4ff8f6582dd1d. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:58:44.523315 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-680f6b64-4d36-47d0-a687-7833ff44e6a1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056711 Aug 04 14:58:44.523935 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3274/6540] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:58:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:58:45.764476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-22e1bd38-383f-4064-9d34-eaee908b250f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:45.765164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-22e1bd38-383f-4064-9d34-eaee908b250f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:45.772430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22e1bd38-383f-4064-9d34-eaee908b250f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:45.773018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22e1bd38-383f-4064-9d34-eaee908b250f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:45.774339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22e1bd38-383f-4064-9d34-eaee908b250f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:45.774797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-22e1bd38-383f-4064-9d34-eaee908b250f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:45.908405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-22e1bd38-383f-4064-9d34-eaee908b250f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:45.916250 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-22e1bd38-383f-4064-9d34-eaee908b250f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 200 len: 1508 microversion: 2.1 time: 0.155730 Aug 04 14:58:45.916753 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3267/6541] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:45 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:45.937243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d31b928-b5c2-4452-a030-9bd2b974c35e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:45.937861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d31b928-b5c2-4452-a030-9bd2b974c35e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:45.947709 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d31b928-b5c2-4452-a030-9bd2b974c35e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:45.948171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d31b928-b5c2-4452-a030-9bd2b974c35e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:45.948984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d31b928-b5c2-4452-a030-9bd2b974c35e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:45.949431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d31b928-b5c2-4452-a030-9bd2b974c35e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:45.975673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d31b928-b5c2-4452-a030-9bd2b974c35e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:58:46.051752 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d31b928-b5c2-4452-a030-9bd2b974c35e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 204 len: 0 microversion: 2.1 time: 0.119040 Aug 04 14:58:46.052368 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3275/6542] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:58:45 2022] DELETE /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:58:46.115155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-983035090", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "5499aaeb-22fa-4020-9fc6-d8ef10cfa36a"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:46.171508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] validate_networks() for [('5499aaeb-22fa-4020-9fc6-d8ef10cfa36a', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:58:46.545516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:58:46.545956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:58:46.546438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:58:46.546861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:58:46.547286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:58:46.556412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:46.556891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:46.557711 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:46.558163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:46.576504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Getting quotas for project 10f3ea3ece9a49d391c4ff8f6582dd1d. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:58:46.582015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Getting quotas for user ff0cc1a818244ddda20f6d3eae22b21d and project 10f3ea3ece9a49d391c4ff8f6582dd1d. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:58:46.595622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:58:46.597921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:58:46.641737 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2f7bb65a-f28e-4f27-a316-20dab7adbc1c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530528 Aug 04 14:58:46.642384 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3268/6543] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:58:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:58:46.654558 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f36d5c8-e64f-4cde-b52c-b2b351580209 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:46.655375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f36d5c8-e64f-4cde-b52c-b2b351580209 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:46.716268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9f36d5c8-e64f-4cde-b52c-b2b351580209 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:46.723500 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f36d5c8-e64f-4cde-b52c-b2b351580209 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1217 microversion: 2.1 time: 0.073258 Aug 04 14:58:46.724164 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3276/6544] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:46 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:47.744969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6899a5d7-15ef-4731-9818-6b01ebdd52f5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:47.746658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6899a5d7-15ef-4731-9818-6b01ebdd52f5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:47.755061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6899a5d7-15ef-4731-9818-6b01ebdd52f5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:47.755821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6899a5d7-15ef-4731-9818-6b01ebdd52f5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:47.756842 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6899a5d7-15ef-4731-9818-6b01ebdd52f5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:47.757535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6899a5d7-15ef-4731-9818-6b01ebdd52f5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:47.913916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6899a5d7-15ef-4731-9818-6b01ebdd52f5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:47.924046 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6899a5d7-15ef-4731-9818-6b01ebdd52f5 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1277 microversion: 2.1 time: 0.183175 Aug 04 14:58:47.924816 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3269/6545] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:47 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:48.449491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3580d10b-f87d-4e41-b4b7-d291232075ea req-08b298b4-426d-451b-bf93-de434b572b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd25816c-9032-466c-95da-460322d4e33b", "name": "network-vif-deleted", "tag": "afc34238-8c01-4376-b391-a5f859bdc392"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:48.466668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3580d10b-f87d-4e41-b4b7-d291232075ea req-08b298b4-426d-451b-bf93-de434b572b82 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:48.467482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3580d10b-f87d-4e41-b4b7-d291232075ea req-08b298b4-426d-451b-bf93-de434b572b82 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:48.482517 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3580d10b-f87d-4e41-b4b7-d291232075ea req-08b298b4-426d-451b-bf93-de434b572b82 service nova] Creating event network-vif-deleted:afc34238-8c01-4376-b391-a5f859bdc392 for instance dd25816c-9032-466c-95da-460322d4e33b on n-h2-844627-10 Aug 04 14:58:48.489368 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3580d10b-f87d-4e41-b4b7-d291232075ea req-08b298b4-426d-451b-bf93-de434b572b82 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044873 Aug 04 14:58:48.490882 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3277/6546] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:58:48.946117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-20e495b4-a505-4019-82e5-b8cac9dcab9f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:48.946912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-20e495b4-a505-4019-82e5-b8cac9dcab9f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:48.954402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e495b4-a505-4019-82e5-b8cac9dcab9f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:48.954924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e495b4-a505-4019-82e5-b8cac9dcab9f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:48.955736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e495b4-a505-4019-82e5-b8cac9dcab9f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:48.956197 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e495b4-a505-4019-82e5-b8cac9dcab9f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:49.520209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-20e495b4-a505-4019-82e5-b8cac9dcab9f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:49.530370 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-20e495b4-a505-4019-82e5-b8cac9dcab9f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1317 microversion: 2.1 time: 0.588731 Aug 04 14:58:49.530994 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3270/6547] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:48 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:50.522608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a3aa99ae-4369-4fcc-abe6-9ed93ccdbab4 req-fc779f59-12e2-4fc7-837b-3b2945940c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8005322-6d9a-4389-997b-0fa884370e79", "tag": "0c8a3e30-0332-43f8-b45d-e1b0044904db"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:50.533555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a3aa99ae-4369-4fcc-abe6-9ed93ccdbab4 req-fc779f59-12e2-4fc7-837b-3b2945940c3a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:50.534001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a3aa99ae-4369-4fcc-abe6-9ed93ccdbab4 req-fc779f59-12e2-4fc7-837b-3b2945940c3a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:50.545592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a3aa99ae-4369-4fcc-abe6-9ed93ccdbab4 req-fc779f59-12e2-4fc7-837b-3b2945940c3a service nova] Creating event network-changed:0c8a3e30-0332-43f8-b45d-e1b0044904db for instance a8005322-6d9a-4389-997b-0fa884370e79 on n-h2-844627-10 Aug 04 14:58:50.550432 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a3aa99ae-4369-4fcc-abe6-9ed93ccdbab4 req-fc779f59-12e2-4fc7-837b-3b2945940c3a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031983 Aug 04 14:58:50.551032 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3278/6548] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:58:50.554503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2968dc7c-eecf-411b-9a17-36f827ba8c2d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:50.555079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2968dc7c-eecf-411b-9a17-36f827ba8c2d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:50.560956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2968dc7c-eecf-411b-9a17-36f827ba8c2d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:50.561419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2968dc7c-eecf-411b-9a17-36f827ba8c2d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:50.562199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2968dc7c-eecf-411b-9a17-36f827ba8c2d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:50.562768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2968dc7c-eecf-411b-9a17-36f827ba8c2d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:50.700782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2968dc7c-eecf-411b-9a17-36f827ba8c2d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:50.708756 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2968dc7c-eecf-411b-9a17-36f827ba8c2d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1317 microversion: 2.1 time: 0.159551 Aug 04 14:58:50.709381 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3271/6549] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:50 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:58:51.732283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd3897f2-f6a8-449d-a277-f0228521b038 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:51.733011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bd3897f2-f6a8-449d-a277-f0228521b038 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:51.739348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd3897f2-f6a8-449d-a277-f0228521b038 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:51.739786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd3897f2-f6a8-449d-a277-f0228521b038 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:51.740557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd3897f2-f6a8-449d-a277-f0228521b038 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:51.741024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd3897f2-f6a8-449d-a277-f0228521b038 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:51.885184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd3897f2-f6a8-449d-a277-f0228521b038 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:51.893871 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd3897f2-f6a8-449d-a277-f0228521b038 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1317 microversion: 2.1 time: 0.167421 Aug 04 14:58:51.894652 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3279/6550] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:51 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:52.916167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c539af1-ecca-48c0-9980-36d46a72129f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:52.916789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c539af1-ecca-48c0-9980-36d46a72129f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:52.924303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c539af1-ecca-48c0-9980-36d46a72129f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:52.924770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c539af1-ecca-48c0-9980-36d46a72129f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:52.925593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c539af1-ecca-48c0-9980-36d46a72129f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:52.926050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c539af1-ecca-48c0-9980-36d46a72129f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:53.068494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3c539af1-ecca-48c0-9980-36d46a72129f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:53.077035 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c539af1-ecca-48c0-9980-36d46a72129f tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1317 microversion: 2.1 time: 0.165033 Aug 04 14:58:53.077833 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3272/6551] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:52 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:54.034288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5fa30837-ad76-4f80-8927-8b435c67734e req-6b2dd89d-64ff-4e97-a7fe-c4b50418eb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8005322-6d9a-4389-997b-0fa884370e79", "name": "network-vif-plugged", "status": "completed", "tag": "0c8a3e30-0332-43f8-b45d-e1b0044904db"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:54.045774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5fa30837-ad76-4f80-8927-8b435c67734e req-6b2dd89d-64ff-4e97-a7fe-c4b50418eb6f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:54.046212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5fa30837-ad76-4f80-8927-8b435c67734e req-6b2dd89d-64ff-4e97-a7fe-c4b50418eb6f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:54.058669 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5fa30837-ad76-4f80-8927-8b435c67734e req-6b2dd89d-64ff-4e97-a7fe-c4b50418eb6f service nova] Creating event network-vif-plugged:0c8a3e30-0332-43f8-b45d-e1b0044904db for instance a8005322-6d9a-4389-997b-0fa884370e79 on n-h2-844627-10 Aug 04 14:58:54.063671 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5fa30837-ad76-4f80-8927-8b435c67734e req-6b2dd89d-64ff-4e97-a7fe-c4b50418eb6f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033379 Aug 04 14:58:54.064294 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3280/6552] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:58:54.099649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61e3dd6f-8067-4248-a333-5ef76e789357 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:54.100415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61e3dd6f-8067-4248-a333-5ef76e789357 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:54.110421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61e3dd6f-8067-4248-a333-5ef76e789357 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:54.111161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61e3dd6f-8067-4248-a333-5ef76e789357 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:54.112316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61e3dd6f-8067-4248-a333-5ef76e789357 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:54.112445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61e3dd6f-8067-4248-a333-5ef76e789357 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:54.302159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61e3dd6f-8067-4248-a333-5ef76e789357 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:54.311806 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61e3dd6f-8067-4248-a333-5ef76e789357 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1317 microversion: 2.1 time: 0.217970 Aug 04 14:58:54.312464 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3273/6553] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:54 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:55.337953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21a61fc3-0060-4829-a779-f5be413034a4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:55.338584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-21a61fc3-0060-4829-a779-f5be413034a4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:55.345158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21a61fc3-0060-4829-a779-f5be413034a4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:55.345611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21a61fc3-0060-4829-a779-f5be413034a4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:55.346391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21a61fc3-0060-4829-a779-f5be413034a4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:55.346832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21a61fc3-0060-4829-a779-f5be413034a4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:55.488203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-21a61fc3-0060-4829-a779-f5be413034a4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:55.496414 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-21a61fc3-0060-4829-a779-f5be413034a4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1317 microversion: 2.1 time: 0.164514 Aug 04 14:58:55.497049 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3281/6554] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:55 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:56.518954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aca27622-d1e2-41a4-98f1-23ab3215244d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:56.519591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aca27622-d1e2-41a4-98f1-23ab3215244d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:56.526753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aca27622-d1e2-41a4-98f1-23ab3215244d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:56.527223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aca27622-d1e2-41a4-98f1-23ab3215244d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:56.528015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aca27622-d1e2-41a4-98f1-23ab3215244d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:56.528474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aca27622-d1e2-41a4-98f1-23ab3215244d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:56.564800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:56.589393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:56.675957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aca27622-d1e2-41a4-98f1-23ab3215244d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:56.687830 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aca27622-d1e2-41a4-98f1-23ab3215244d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1508 microversion: 2.1 time: 0.172732 Aug 04 14:58:56.688417 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3274/6555] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:56 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:56.713044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f1a7364d-3407-4c17-bde6-ee1df524eed2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:56.713044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f1a7364d-3407-4c17-bde6-ee1df524eed2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:56.719001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1a7364d-3407-4c17-bde6-ee1df524eed2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:56.719448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1a7364d-3407-4c17-bde6-ee1df524eed2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:56.720230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1a7364d-3407-4c17-bde6-ee1df524eed2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:56.720671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f1a7364d-3407-4c17-bde6-ee1df524eed2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:56.721305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:56.872714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f1a7364d-3407-4c17-bde6-ee1df524eed2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:56.886473 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f1a7364d-3407-4c17-bde6-ee1df524eed2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1508 microversion: 2.1 time: 0.181175 Aug 04 14:58:56.887075 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3282/6556] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:56 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:58:56.906772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:58:56.909474 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:56.916294 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:56.916770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:56.917601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:56.918066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:56.947662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:56.954034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Old instance type m1.heat2, new instance type m1.heat {{(pid=130961) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 14:58:56.961004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:58:56.961449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:58:56.961953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:58:56.962383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:58:56.962816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:58:57.038200 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5dd9fd40-5531-411a-9f88-ecaed3462036 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "POST /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79/action" status: 202 len: 0 microversion: 2.1 time: 0.135231 Aug 04 14:58:57.039675 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3275/6557] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:58:56 2022] POST /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 14:58:57.048372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bb9911d9-7879-4e6f-a3e3-dce9e7aec50b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:57.049124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bb9911d9-7879-4e6f-a3e3-dce9e7aec50b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:57.056136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb9911d9-7879-4e6f-a3e3-dce9e7aec50b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:57.056586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb9911d9-7879-4e6f-a3e3-dce9e7aec50b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:57.057437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb9911d9-7879-4e6f-a3e3-dce9e7aec50b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:57.057881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bb9911d9-7879-4e6f-a3e3-dce9e7aec50b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:57.218274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bb9911d9-7879-4e6f-a3e3-dce9e7aec50b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:57.220540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:57.229230 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bb9911d9-7879-4e6f-a3e3-dce9e7aec50b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1515 microversion: 2.1 time: 0.184887 Aug 04 14:58:57.229854 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3283/6558] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:57 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:58:58.250719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-83c10464-2ec4-48c2-84cb-c442d8284c69 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:58.251370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-83c10464-2ec4-48c2-84cb-c442d8284c69 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:58.259251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83c10464-2ec4-48c2-84cb-c442d8284c69 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:58.259715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83c10464-2ec4-48c2-84cb-c442d8284c69 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:58.260503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83c10464-2ec4-48c2-84cb-c442d8284c69 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:58.261085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-83c10464-2ec4-48c2-84cb-c442d8284c69 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:58.281386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:58:58.435337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-83c10464-2ec4-48c2-84cb-c442d8284c69 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:58.443631 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-83c10464-2ec4-48c2-84cb-c442d8284c69 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1515 microversion: 2.1 time: 0.196927 Aug 04 14:58:58.444237 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3276/6559] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:58 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:58:59.465600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9bceec0c-f04b-4dc6-863f-ed08434c360a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:58:59.466249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9bceec0c-f04b-4dc6-863f-ed08434c360a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:58:59.475290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bceec0c-f04b-4dc6-863f-ed08434c360a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:59.475748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bceec0c-f04b-4dc6-863f-ed08434c360a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:59.477205 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bceec0c-f04b-4dc6-863f-ed08434c360a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:58:59.477649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9bceec0c-f04b-4dc6-863f-ed08434c360a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:58:59.623161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9bceec0c-f04b-4dc6-863f-ed08434c360a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:58:59.630712 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9bceec0c-f04b-4dc6-863f-ed08434c360a tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.169150 Aug 04 14:58:59.631285 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3284/6560] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:58:59 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:59:00.652435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33f33825-4600-416c-995e-7c1f5bdc2be8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:00.653092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-33f33825-4600-416c-995e-7c1f5bdc2be8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:00.660297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33f33825-4600-416c-995e-7c1f5bdc2be8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:00.660772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33f33825-4600-416c-995e-7c1f5bdc2be8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:00.661600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33f33825-4600-416c-995e-7c1f5bdc2be8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:00.662060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33f33825-4600-416c-995e-7c1f5bdc2be8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:00.811802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-33f33825-4600-416c-995e-7c1f5bdc2be8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:00.820500 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-33f33825-4600-416c-995e-7c1f5bdc2be8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.172026 Aug 04 14:59:00.821123 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3277/6561] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:00 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:01.842124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b12be235-34b6-4e91-97d7-aa4008292343 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:01.842778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b12be235-34b6-4e91-97d7-aa4008292343 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:01.849557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b12be235-34b6-4e91-97d7-aa4008292343 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:01.850012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b12be235-34b6-4e91-97d7-aa4008292343 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:01.850786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b12be235-34b6-4e91-97d7-aa4008292343 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:01.851228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b12be235-34b6-4e91-97d7-aa4008292343 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:01.986022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b12be235-34b6-4e91-97d7-aa4008292343 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:01.994243 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b12be235-34b6-4e91-97d7-aa4008292343 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.156298 Aug 04 14:59:01.994901 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3285/6562] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:01 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:03.015939 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-97432b0a-cb16-45d3-ab28-465ae83e5062 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:03.016591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-97432b0a-cb16-45d3-ab28-465ae83e5062 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:03.023896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97432b0a-cb16-45d3-ab28-465ae83e5062 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:03.024359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97432b0a-cb16-45d3-ab28-465ae83e5062 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:03.025255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97432b0a-cb16-45d3-ab28-465ae83e5062 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:03.026004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-97432b0a-cb16-45d3-ab28-465ae83e5062 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:03.167850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-97432b0a-cb16-45d3-ab28-465ae83e5062 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:03.175580 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-97432b0a-cb16-45d3-ab28-465ae83e5062 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.163643 Aug 04 14:59:03.176150 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3278/6563] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:03 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:04.196984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8b1fbc5b-9c6b-4da8-9786-af08e556b8c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:04.197697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8b1fbc5b-9c6b-4da8-9786-af08e556b8c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:04.204894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b1fbc5b-9c6b-4da8-9786-af08e556b8c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:04.205349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b1fbc5b-9c6b-4da8-9786-af08e556b8c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:04.206126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b1fbc5b-9c6b-4da8-9786-af08e556b8c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:04.206566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8b1fbc5b-9c6b-4da8-9786-af08e556b8c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:04.344813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8b1fbc5b-9c6b-4da8-9786-af08e556b8c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:04.355587 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8b1fbc5b-9c6b-4da8-9786-af08e556b8c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.162735 Aug 04 14:59:04.356189 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3286/6564] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:04 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:05.379815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fb8b1829-13cc-4b81-9463-64a5609f1e9c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:05.380380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fb8b1829-13cc-4b81-9463-64a5609f1e9c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:05.388322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb8b1829-13cc-4b81-9463-64a5609f1e9c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:05.388792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb8b1829-13cc-4b81-9463-64a5609f1e9c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:05.389620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb8b1829-13cc-4b81-9463-64a5609f1e9c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:05.390085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fb8b1829-13cc-4b81-9463-64a5609f1e9c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:05.536131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fb8b1829-13cc-4b81-9463-64a5609f1e9c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:05.544476 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fb8b1829-13cc-4b81-9463-64a5609f1e9c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.170075 Aug 04 14:59:05.545156 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3279/6565] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:05 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:06.569001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5dda6e61-162c-470a-959c-e732833f2b8c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:06.570107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5dda6e61-162c-470a-959c-e732833f2b8c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:06.577173 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dda6e61-162c-470a-959c-e732833f2b8c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:06.577625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dda6e61-162c-470a-959c-e732833f2b8c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:06.578398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dda6e61-162c-470a-959c-e732833f2b8c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:06.578841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5dda6e61-162c-470a-959c-e732833f2b8c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:06.717622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5dda6e61-162c-470a-959c-e732833f2b8c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:06.725909 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5dda6e61-162c-470a-959c-e732833f2b8c tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.160760 Aug 04 14:59:06.726589 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3287/6566] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:06 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:07.747611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4a4ae2be-eb93-4b84-9295-f9a2a6ab5f1e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:07.748479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4a4ae2be-eb93-4b84-9295-f9a2a6ab5f1e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:07.755882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a4ae2be-eb93-4b84-9295-f9a2a6ab5f1e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:07.756350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a4ae2be-eb93-4b84-9295-f9a2a6ab5f1e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:07.757203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a4ae2be-eb93-4b84-9295-f9a2a6ab5f1e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:07.758205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a4ae2be-eb93-4b84-9295-f9a2a6ab5f1e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:07.925943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4a4ae2be-eb93-4b84-9295-f9a2a6ab5f1e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:07.934490 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4a4ae2be-eb93-4b84-9295-f9a2a6ab5f1e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.190756 Aug 04 14:59:07.935071 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3280/6567] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:07 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:08.956453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d4478eb-1d36-4618-a503-28d4a9621df2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:08.957166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d4478eb-1d36-4618-a503-28d4a9621df2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:08.964791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d4478eb-1d36-4618-a503-28d4a9621df2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:08.965276 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d4478eb-1d36-4618-a503-28d4a9621df2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:08.966099 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d4478eb-1d36-4618-a503-28d4a9621df2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:08.966540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d4478eb-1d36-4618-a503-28d4a9621df2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:09.103279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d4478eb-1d36-4618-a503-28d4a9621df2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:09.110953 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d4478eb-1d36-4618-a503-28d4a9621df2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.158648 Aug 04 14:59:09.111529 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3288/6568] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:08 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:10.132623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9e37e93c-431e-4fb7-a64c-2e034d47d0b1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:10.133293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9e37e93c-431e-4fb7-a64c-2e034d47d0b1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:10.135509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:59:10.141256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e37e93c-431e-4fb7-a64c-2e034d47d0b1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:10.141858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e37e93c-431e-4fb7-a64c-2e034d47d0b1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:10.142857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e37e93c-431e-4fb7-a64c-2e034d47d0b1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:10.143329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e37e93c-431e-4fb7-a64c-2e034d47d0b1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:10.295630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9e37e93c-431e-4fb7-a64c-2e034d47d0b1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:10.303341 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9e37e93c-431e-4fb7-a64c-2e034d47d0b1 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.174680 Aug 04 14:59:10.303921 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3281/6569] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:10 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:11.326152 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9221dc92-4902-4126-b563-0f0f2acef7b4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:11.326781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9221dc92-4902-4126-b563-0f0f2acef7b4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:11.334647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9221dc92-4902-4126-b563-0f0f2acef7b4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:11.335142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9221dc92-4902-4126-b563-0f0f2acef7b4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:11.336666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9221dc92-4902-4126-b563-0f0f2acef7b4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:11.337169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9221dc92-4902-4126-b563-0f0f2acef7b4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:11.486122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9221dc92-4902-4126-b563-0f0f2acef7b4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:11.494451 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9221dc92-4902-4126-b563-0f0f2acef7b4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.172336 Aug 04 14:59:11.495041 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3289/6570] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:11 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:12.516087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e21f89b-247a-4e96-beed-04c153b760c7 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:12.516714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e21f89b-247a-4e96-beed-04c153b760c7 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:12.524586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e21f89b-247a-4e96-beed-04c153b760c7 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:12.525126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e21f89b-247a-4e96-beed-04c153b760c7 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:12.525991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e21f89b-247a-4e96-beed-04c153b760c7 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:12.526485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e21f89b-247a-4e96-beed-04c153b760c7 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:12.676915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7e21f89b-247a-4e96-beed-04c153b760c7 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:12.685819 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e21f89b-247a-4e96-beed-04c153b760c7 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.173887 Aug 04 14:59:12.686411 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3282/6571] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:12 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:13.707567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ecc214e6-29a3-4cc8-882b-ac0f925bf2bc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:13.708492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ecc214e6-29a3-4cc8-882b-ac0f925bf2bc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:13.711324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:59:13.718098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecc214e6-29a3-4cc8-882b-ac0f925bf2bc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:13.718579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecc214e6-29a3-4cc8-882b-ac0f925bf2bc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:13.719370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecc214e6-29a3-4cc8-882b-ac0f925bf2bc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:13.719840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ecc214e6-29a3-4cc8-882b-ac0f925bf2bc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:13.857225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ecc214e6-29a3-4cc8-882b-ac0f925bf2bc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:13.864719 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ecc214e6-29a3-4cc8-882b-ac0f925bf2bc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.161119 Aug 04 14:59:13.865317 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3290/6572] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:13 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:14.886646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3742f56c-3319-46b8-be77-1fa4b7a600f0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:14.887371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3742f56c-3319-46b8-be77-1fa4b7a600f0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:14.895128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3742f56c-3319-46b8-be77-1fa4b7a600f0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:14.895596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3742f56c-3319-46b8-be77-1fa4b7a600f0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:14.896388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3742f56c-3319-46b8-be77-1fa4b7a600f0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:14.896838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3742f56c-3319-46b8-be77-1fa4b7a600f0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:15.040359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3742f56c-3319-46b8-be77-1fa4b7a600f0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:15.049072 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3742f56c-3319-46b8-be77-1fa4b7a600f0 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.166837 Aug 04 14:59:15.049662 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3283/6573] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:14 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:16.069831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-96da7274-b7b4-4a8b-893b-828f05d6c4dc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:16.070511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-96da7274-b7b4-4a8b-893b-828f05d6c4dc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:16.078011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96da7274-b7b4-4a8b-893b-828f05d6c4dc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:16.078468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96da7274-b7b4-4a8b-893b-828f05d6c4dc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:16.079254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96da7274-b7b4-4a8b-893b-828f05d6c4dc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:16.079700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-96da7274-b7b4-4a8b-893b-828f05d6c4dc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:16.298455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-96da7274-b7b4-4a8b-893b-828f05d6c4dc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:16.306717 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-96da7274-b7b4-4a8b-893b-828f05d6c4dc tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.240839 Aug 04 14:59:16.307314 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3291/6574] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:16 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:17.333934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-05c38bd9-dc52-462b-8760-85399eb11f22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:17.334566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-05c38bd9-dc52-462b-8760-85399eb11f22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:17.341677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05c38bd9-dc52-462b-8760-85399eb11f22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:17.342145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05c38bd9-dc52-462b-8760-85399eb11f22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:17.342935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05c38bd9-dc52-462b-8760-85399eb11f22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:17.343397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05c38bd9-dc52-462b-8760-85399eb11f22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:17.489549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-05c38bd9-dc52-462b-8760-85399eb11f22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:17.498843 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-05c38bd9-dc52-462b-8760-85399eb11f22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.169472 Aug 04 14:59:17.499454 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3284/6575] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:17 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:18.519664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3b6155e0-c2f1-4790-b6de-ef265439cdf3 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:18.520319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3b6155e0-c2f1-4790-b6de-ef265439cdf3 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:18.527881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b6155e0-c2f1-4790-b6de-ef265439cdf3 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:18.528338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b6155e0-c2f1-4790-b6de-ef265439cdf3 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:18.529151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b6155e0-c2f1-4790-b6de-ef265439cdf3 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:18.529598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3b6155e0-c2f1-4790-b6de-ef265439cdf3 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:18.667244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3b6155e0-c2f1-4790-b6de-ef265439cdf3 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:18.675041 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3b6155e0-c2f1-4790-b6de-ef265439cdf3 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.159273 Aug 04 14:59:18.675615 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3292/6576] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:18 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:19.698334 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df764f7f-6363-44a1-a8cb-d69657cbbc62 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:19.699413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-df764f7f-6363-44a1-a8cb-d69657cbbc62 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:19.712318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df764f7f-6363-44a1-a8cb-d69657cbbc62 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:19.713190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df764f7f-6363-44a1-a8cb-d69657cbbc62 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:19.714455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df764f7f-6363-44a1-a8cb-d69657cbbc62 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:19.715284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df764f7f-6363-44a1-a8cb-d69657cbbc62 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:19.860271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-df764f7f-6363-44a1-a8cb-d69657cbbc62 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:19.868799 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-df764f7f-6363-44a1-a8cb-d69657cbbc62 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.175518 Aug 04 14:59:19.869417 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3285/6577] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:19 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:20.891548 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f44e711-4c1d-456d-90df-e3f701e912a6 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:20.892196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f44e711-4c1d-456d-90df-e3f701e912a6 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:20.900091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f44e711-4c1d-456d-90df-e3f701e912a6 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:20.900541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f44e711-4c1d-456d-90df-e3f701e912a6 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:20.901379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f44e711-4c1d-456d-90df-e3f701e912a6 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:20.901818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f44e711-4c1d-456d-90df-e3f701e912a6 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:21.073808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6f44e711-4c1d-456d-90df-e3f701e912a6 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:21.082482 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f44e711-4c1d-456d-90df-e3f701e912a6 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.195188 Aug 04 14:59:21.083080 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3293/6578] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:20 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:22.104844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bc5af03a-fb07-4b9a-852e-3ba7092799c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:22.105484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bc5af03a-fb07-4b9a-852e-3ba7092799c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:22.112563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc5af03a-fb07-4b9a-852e-3ba7092799c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:22.113070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc5af03a-fb07-4b9a-852e-3ba7092799c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:22.113864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc5af03a-fb07-4b9a-852e-3ba7092799c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:22.114326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bc5af03a-fb07-4b9a-852e-3ba7092799c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:22.261098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bc5af03a-fb07-4b9a-852e-3ba7092799c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:22.269240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bc5af03a-fb07-4b9a-852e-3ba7092799c4 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.168776 Aug 04 14:59:22.269861 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3286/6579] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:22 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:23.291111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2f25ed4a-97d6-494f-9fc9-6409ce79cf78 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:23.291746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2f25ed4a-97d6-494f-9fc9-6409ce79cf78 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:23.300525 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f25ed4a-97d6-494f-9fc9-6409ce79cf78 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:23.301011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f25ed4a-97d6-494f-9fc9-6409ce79cf78 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:23.301798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f25ed4a-97d6-494f-9fc9-6409ce79cf78 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:23.302234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f25ed4a-97d6-494f-9fc9-6409ce79cf78 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:23.442404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2f25ed4a-97d6-494f-9fc9-6409ce79cf78 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:23.450650 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2f25ed4a-97d6-494f-9fc9-6409ce79cf78 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.163992 Aug 04 14:59:23.451245 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3294/6580] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:23 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:24.473364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c0597e42-8c5a-4727-8b94-9316f055885b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:24.473958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c0597e42-8c5a-4727-8b94-9316f055885b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:24.480950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0597e42-8c5a-4727-8b94-9316f055885b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:24.481419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0597e42-8c5a-4727-8b94-9316f055885b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:24.482226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0597e42-8c5a-4727-8b94-9316f055885b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:24.482675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c0597e42-8c5a-4727-8b94-9316f055885b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:24.619806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c0597e42-8c5a-4727-8b94-9316f055885b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:24.628256 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c0597e42-8c5a-4727-8b94-9316f055885b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.158667 Aug 04 14:59:24.628851 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3287/6581] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:24 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:59:25.652961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-97581287-56a9-4c08-91e5-4a4690bdaef2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:25.654183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-97581287-56a9-4c08-91e5-4a4690bdaef2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:25.666296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97581287-56a9-4c08-91e5-4a4690bdaef2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:25.666753 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97581287-56a9-4c08-91e5-4a4690bdaef2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:25.667560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97581287-56a9-4c08-91e5-4a4690bdaef2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:25.668002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97581287-56a9-4c08-91e5-4a4690bdaef2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:25.837589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-97581287-56a9-4c08-91e5-4a4690bdaef2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:25.846234 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-97581287-56a9-4c08-91e5-4a4690bdaef2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.200577 Aug 04 14:59:25.846851 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3295/6582] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:25 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:26.870031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-de2f35ba-616e-43b1-a062-568ed7c045cd tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:26.870728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-de2f35ba-616e-43b1-a062-568ed7c045cd tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:26.878291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de2f35ba-616e-43b1-a062-568ed7c045cd tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:26.878903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de2f35ba-616e-43b1-a062-568ed7c045cd tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:26.879915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de2f35ba-616e-43b1-a062-568ed7c045cd tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:26.880477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-de2f35ba-616e-43b1-a062-568ed7c045cd tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:27.033238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-de2f35ba-616e-43b1-a062-568ed7c045cd tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:27.041728 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-de2f35ba-616e-43b1-a062-568ed7c045cd tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.176476 Aug 04 14:59:27.042329 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3288/6583] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:26 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:28.066238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f682297-63b0-4e2c-9b19-ce3f6c431435 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:28.066850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f682297-63b0-4e2c-9b19-ce3f6c431435 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:28.074562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f682297-63b0-4e2c-9b19-ce3f6c431435 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:28.075017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f682297-63b0-4e2c-9b19-ce3f6c431435 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:28.075808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f682297-63b0-4e2c-9b19-ce3f6c431435 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:28.076251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f682297-63b0-4e2c-9b19-ce3f6c431435 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:28.222692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9f682297-63b0-4e2c-9b19-ce3f6c431435 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:28.231110 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f682297-63b0-4e2c-9b19-ce3f6c431435 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.170691 Aug 04 14:59:28.231695 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3296/6584] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:28 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:29.251859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c82b6a5b-7754-4198-b411-912c0d59f767 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:29.252446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c82b6a5b-7754-4198-b411-912c0d59f767 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:29.260384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c82b6a5b-7754-4198-b411-912c0d59f767 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:29.260824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c82b6a5b-7754-4198-b411-912c0d59f767 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:29.261657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c82b6a5b-7754-4198-b411-912c0d59f767 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:29.262115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c82b6a5b-7754-4198-b411-912c0d59f767 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:29.265051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=75 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:59:29.405782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c82b6a5b-7754-4198-b411-912c0d59f767 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:29.413972 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c82b6a5b-7754-4198-b411-912c0d59f767 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.166062 Aug 04 14:59:29.414571 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3289/6585] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:29 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 14:59:30.434921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d011f598-1daa-411f-b1eb-602fabdb20d2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:30.435503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d011f598-1daa-411f-b1eb-602fabdb20d2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:30.442893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d011f598-1daa-411f-b1eb-602fabdb20d2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:30.443352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d011f598-1daa-411f-b1eb-602fabdb20d2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:30.444136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d011f598-1daa-411f-b1eb-602fabdb20d2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:30.444573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d011f598-1daa-411f-b1eb-602fabdb20d2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:30.447490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=80 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:59:30.590220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d011f598-1daa-411f-b1eb-602fabdb20d2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:30.599343 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d011f598-1daa-411f-b1eb-602fabdb20d2 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1520 microversion: 2.1 time: 0.168760 Aug 04 14:59:30.599996 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3297/6586] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:30 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:31.376722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-927bab06-291e-400a-9655-8433bc1bfa70 req-928a1989-41b8-4ad6-804d-6b075e38f62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8005322-6d9a-4389-997b-0fa884370e79", "name": "network-vif-unplugged", "status": "completed", "tag": "0c8a3e30-0332-43f8-b45d-e1b0044904db"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:59:31.390706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-927bab06-291e-400a-9655-8433bc1bfa70 req-928a1989-41b8-4ad6-804d-6b075e38f62d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:31.391544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-927bab06-291e-400a-9655-8433bc1bfa70 req-928a1989-41b8-4ad6-804d-6b075e38f62d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:31.409222 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-927bab06-291e-400a-9655-8433bc1bfa70 req-928a1989-41b8-4ad6-804d-6b075e38f62d service nova] Creating event network-vif-unplugged:0c8a3e30-0332-43f8-b45d-e1b0044904db for instance a8005322-6d9a-4389-997b-0fa884370e79 on n-h1-844627-10 Aug 04 14:59:31.417585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-927bab06-291e-400a-9655-8433bc1bfa70 req-928a1989-41b8-4ad6-804d-6b075e38f62d service nova] Instance a8005322-6d9a-4389-997b-0fa884370e79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:59:31.432781 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-927bab06-291e-400a-9655-8433bc1bfa70 req-928a1989-41b8-4ad6-804d-6b075e38f62d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060478 Aug 04 14:59:31.434575 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3290/6587] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:59:31.626298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-15afe047-3346-43ca-9ed4-d8ffff11908b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:31.627519 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-15afe047-3346-43ca-9ed4-d8ffff11908b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:31.640849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15afe047-3346-43ca-9ed4-d8ffff11908b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:31.641764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15afe047-3346-43ca-9ed4-d8ffff11908b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:31.643262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15afe047-3346-43ca-9ed4-d8ffff11908b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:31.644163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-15afe047-3346-43ca-9ed4-d8ffff11908b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:31.931311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-15afe047-3346-43ca-9ed4-d8ffff11908b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:31.942064 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-15afe047-3346-43ca-9ed4-d8ffff11908b tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1519 microversion: 2.1 time: 0.323277 Aug 04 14:59:31.942893 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3298/6588] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:31 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1519 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:32.980898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-46e79136-b90d-40e4-bc9b-f6f546b6ceaa tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:32.981613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-46e79136-b90d-40e4-bc9b-f6f546b6ceaa tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:32.988133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46e79136-b90d-40e4-bc9b-f6f546b6ceaa tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:32.988604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46e79136-b90d-40e4-bc9b-f6f546b6ceaa tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:32.989435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46e79136-b90d-40e4-bc9b-f6f546b6ceaa tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:32.989897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46e79136-b90d-40e4-bc9b-f6f546b6ceaa tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:33.134041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-46e79136-b90d-40e4-bc9b-f6f546b6ceaa tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:33.147076 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-46e79136-b90d-40e4-bc9b-f6f546b6ceaa tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1517 microversion: 2.1 time: 0.171602 Aug 04 14:59:33.148326 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3291/6589] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:32 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:33.479083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b181f478-ded6-4a7e-87bd-a5994182ee66 req-66b6f479-9b0e-453c-a535-dc92afba8e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8005322-6d9a-4389-997b-0fa884370e79", "tag": "0c8a3e30-0332-43f8-b45d-e1b0044904db"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:59:33.490351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b181f478-ded6-4a7e-87bd-a5994182ee66 req-66b6f479-9b0e-453c-a535-dc92afba8e26 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:33.490794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b181f478-ded6-4a7e-87bd-a5994182ee66 req-66b6f479-9b0e-453c-a535-dc92afba8e26 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:33.504080 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b181f478-ded6-4a7e-87bd-a5994182ee66 req-66b6f479-9b0e-453c-a535-dc92afba8e26 service nova] Creating event network-changed:0c8a3e30-0332-43f8-b45d-e1b0044904db for instance a8005322-6d9a-4389-997b-0fa884370e79 on n-h1-844627-10 Aug 04 14:59:33.510842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-b181f478-ded6-4a7e-87bd-a5994182ee66 req-66b6f479-9b0e-453c-a535-dc92afba8e26 service nova] Instance a8005322-6d9a-4389-997b-0fa884370e79 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 14:59:33.522037 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b181f478-ded6-4a7e-87bd-a5994182ee66 req-66b6f479-9b0e-453c-a535-dc92afba8e26 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046674 Aug 04 14:59:33.522707 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3299/6590] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 14:59:34.170792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3ebd7164-97a3-469b-9699-f819276247e8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:34.171574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3ebd7164-97a3-469b-9699-f819276247e8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:34.178907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ebd7164-97a3-469b-9699-f819276247e8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:34.179386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ebd7164-97a3-469b-9699-f819276247e8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:34.180201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ebd7164-97a3-469b-9699-f819276247e8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:34.180660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3ebd7164-97a3-469b-9699-f819276247e8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:34.439313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3ebd7164-97a3-469b-9699-f819276247e8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:34.447670 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3ebd7164-97a3-469b-9699-f819276247e8 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1517 microversion: 2.1 time: 0.281062 Aug 04 14:59:34.448256 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3292/6591] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:34 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:35.471368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-465c9e2e-ca7f-40de-906d-235dba36d3ca tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:35.472077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-465c9e2e-ca7f-40de-906d-235dba36d3ca tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:35.478744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-465c9e2e-ca7f-40de-906d-235dba36d3ca tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:35.479213 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-465c9e2e-ca7f-40de-906d-235dba36d3ca tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:35.479995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-465c9e2e-ca7f-40de-906d-235dba36d3ca tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:35.480440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-465c9e2e-ca7f-40de-906d-235dba36d3ca tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:35.701851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-465c9e2e-ca7f-40de-906d-235dba36d3ca tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:35.710649 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-465c9e2e-ca7f-40de-906d-235dba36d3ca tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1514 microversion: 2.1 time: 0.244139 Aug 04 14:59:35.711343 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3300/6592] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:35 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:35.731410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f6a738d-7d86-4d13-a3a3-6ea3fca69bee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:59:35.732248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f6a738d-7d86-4d13-a3a3-6ea3fca69bee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:35.740030 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f6a738d-7d86-4d13-a3a3-6ea3fca69bee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:35.740495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f6a738d-7d86-4d13-a3a3-6ea3fca69bee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:35.741345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f6a738d-7d86-4d13-a3a3-6ea3fca69bee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:35.741801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f6a738d-7d86-4d13-a3a3-6ea3fca69bee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:35.803611 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f6a738d-7d86-4d13-a3a3-6ea3fca69bee tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "POST /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79/action" status: 204 len: 0 microversion: 2.1 time: 0.075879 Aug 04 14:59:35.804327 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3293/6593] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 14:59:35 2022] POST /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:59:35.813788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-304b92b3-44db-4b2d-9ace-2cc447d3859d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:35.814509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-304b92b3-44db-4b2d-9ace-2cc447d3859d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:35.821462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-304b92b3-44db-4b2d-9ace-2cc447d3859d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:35.821985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-304b92b3-44db-4b2d-9ace-2cc447d3859d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:35.822791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-304b92b3-44db-4b2d-9ace-2cc447d3859d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:35.823238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-304b92b3-44db-4b2d-9ace-2cc447d3859d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:36.128566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-304b92b3-44db-4b2d-9ace-2cc447d3859d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:36.138567 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-304b92b3-44db-4b2d-9ace-2cc447d3859d tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1514 microversion: 2.1 time: 0.328778 Aug 04 14:59:36.139422 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3301/6594] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:35 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:37.161392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1787d35b-bafe-4a8e-9058-4b91f855402e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:37.162504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1787d35b-bafe-4a8e-9058-4b91f855402e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:37.171510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1787d35b-bafe-4a8e-9058-4b91f855402e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.172749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1787d35b-bafe-4a8e-9058-4b91f855402e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.173864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1787d35b-bafe-4a8e-9058-4b91f855402e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.174586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1787d35b-bafe-4a8e-9058-4b91f855402e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.336418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1787d35b-bafe-4a8e-9058-4b91f855402e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:37.350499 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1787d35b-bafe-4a8e-9058-4b91f855402e tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1506 microversion: 2.1 time: 0.193848 Aug 04 14:59:37.351165 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3294/6595] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:37 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:37.370646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6163403c-c7a1-4ee1-83c5-9cb565479792 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:37.371265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6163403c-c7a1-4ee1-83c5-9cb565479792 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:37.378282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6163403c-c7a1-4ee1-83c5-9cb565479792 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.378741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6163403c-c7a1-4ee1-83c5-9cb565479792 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.379513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6163403c-c7a1-4ee1-83c5-9cb565479792 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.379954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6163403c-c7a1-4ee1-83c5-9cb565479792 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.516740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6163403c-c7a1-4ee1-83c5-9cb565479792 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:37.526244 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6163403c-c7a1-4ee1-83c5-9cb565479792 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1506 microversion: 2.1 time: 0.159482 Aug 04 14:59:37.526825 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3302/6596] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:37 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:37.545932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f6ecbbb2-29f5-40cb-9377-2a7bc7fc9e22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:37.546567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f6ecbbb2-29f5-40cb-9377-2a7bc7fc9e22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:37.553127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6ecbbb2-29f5-40cb-9377-2a7bc7fc9e22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.553622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6ecbbb2-29f5-40cb-9377-2a7bc7fc9e22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.554423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6ecbbb2-29f5-40cb-9377-2a7bc7fc9e22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.554877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6ecbbb2-29f5-40cb-9377-2a7bc7fc9e22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.695275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f6ecbbb2-29f5-40cb-9377-2a7bc7fc9e22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:37.705872 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f6ecbbb2-29f5-40cb-9377-2a7bc7fc9e22 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1506 microversion: 2.1 time: 0.163532 Aug 04 14:59:37.706575 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3295/6597] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:37 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:37.725954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4616b2b8-985c-4b8b-8436-4f84f1fc8c12 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:37.726361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4616b2b8-985c-4b8b-8436-4f84f1fc8c12 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:37.732474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4616b2b8-985c-4b8b-8436-4f84f1fc8c12 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.732961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4616b2b8-985c-4b8b-8436-4f84f1fc8c12 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.733738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4616b2b8-985c-4b8b-8436-4f84f1fc8c12 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.734170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4616b2b8-985c-4b8b-8436-4f84f1fc8c12 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.761197 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4616b2b8-985c-4b8b-8436-4f84f1fc8c12 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:59:37.849947 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4616b2b8-985c-4b8b-8436-4f84f1fc8c12 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 204 len: 0 microversion: 2.1 time: 0.127610 Aug 04 14:59:37.850634 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3303/6598] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:59:37 2022] DELETE /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:59:37.871211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fda4794f-35cd-40d4-8a51-9732eb5c1d23 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:37.871746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fda4794f-35cd-40d4-8a51-9732eb5c1d23 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:37.878212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fda4794f-35cd-40d4-8a51-9732eb5c1d23 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.878662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fda4794f-35cd-40d4-8a51-9732eb5c1d23 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.879467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fda4794f-35cd-40d4-8a51-9732eb5c1d23 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.879926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fda4794f-35cd-40d4-8a51-9732eb5c1d23 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.906010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fda4794f-35cd-40d4-8a51-9732eb5c1d23 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 14:59:37.951555 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.compute.api [None req-fda4794f-35cd-40d4-8a51-9732eb5c1d23 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Instance is already in deleting state, ignoring this request Aug 04 14:59:37.952404 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fda4794f-35cd-40d4-8a51-9732eb5c1d23 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 204 len: 0 microversion: 2.1 time: 0.088914 Aug 04 14:59:37.952992 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3296/6599] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:59:37 2022] DELETE /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 14:59:37.962128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9c678a4e-f0fe-4bcc-8ed0-661388d29251 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:37.962843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9c678a4e-f0fe-4bcc-8ed0-661388d29251 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:37.969253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c678a4e-f0fe-4bcc-8ed0-661388d29251 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.969710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c678a4e-f0fe-4bcc-8ed0-661388d29251 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:37.970481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c678a4e-f0fe-4bcc-8ed0-661388d29251 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:37.970922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9c678a4e-f0fe-4bcc-8ed0-661388d29251 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:38.122336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9c678a4e-f0fe-4bcc-8ed0-661388d29251 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:38.130206 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9c678a4e-f0fe-4bcc-8ed0-661388d29251 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1512 microversion: 2.1 time: 0.172702 Aug 04 14:59:38.130799 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3304/6600] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:37 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:38.798660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f216c981-4ba4-4dd5-a8c0-43d09f53d740 req-e1b3ec9c-545f-4e27-9695-08ffe13d7220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8005322-6d9a-4389-997b-0fa884370e79", "name": "network-vif-plugged", "status": "completed", "tag": "0c8a3e30-0332-43f8-b45d-e1b0044904db"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:59:38.809969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f216c981-4ba4-4dd5-a8c0-43d09f53d740 req-e1b3ec9c-545f-4e27-9695-08ffe13d7220 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:38.810495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f216c981-4ba4-4dd5-a8c0-43d09f53d740 req-e1b3ec9c-545f-4e27-9695-08ffe13d7220 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:38.822446 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f216c981-4ba4-4dd5-a8c0-43d09f53d740 req-e1b3ec9c-545f-4e27-9695-08ffe13d7220 service nova] Creating event network-vif-plugged:0c8a3e30-0332-43f8-b45d-e1b0044904db for instance a8005322-6d9a-4389-997b-0fa884370e79 on n-h1-844627-10 Aug 04 14:59:38.827398 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f216c981-4ba4-4dd5-a8c0-43d09f53d740 req-e1b3ec9c-545f-4e27-9695-08ffe13d7220 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Aug 04 14:59:38.827995 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3297/6601] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:59:39.151830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac402a92-0738-4fb7-8a28-6fc77138c405 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:39.152474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac402a92-0738-4fb7-8a28-6fc77138c405 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:39.159482 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac402a92-0738-4fb7-8a28-6fc77138c405 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:39.159932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac402a92-0738-4fb7-8a28-6fc77138c405 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:39.160706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac402a92-0738-4fb7-8a28-6fc77138c405 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:39.161176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac402a92-0738-4fb7-8a28-6fc77138c405 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:39.298568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac402a92-0738-4fb7-8a28-6fc77138c405 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:39.306697 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac402a92-0738-4fb7-8a28-6fc77138c405 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1512 microversion: 2.1 time: 0.159364 Aug 04 14:59:39.307272 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3305/6602] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:39 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:39.870442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-e8b75f92-ab7d-43c2-abf7-5db09afa73d8 req-86b5cefa-d626-4023-9a1b-26fde72e393a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8005322-6d9a-4389-997b-0fa884370e79", "name": "network-vif-deleted", "tag": "0c8a3e30-0332-43f8-b45d-e1b0044904db"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:59:39.881531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e8b75f92-ab7d-43c2-abf7-5db09afa73d8 req-86b5cefa-d626-4023-9a1b-26fde72e393a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:39.882020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e8b75f92-ab7d-43c2-abf7-5db09afa73d8 req-86b5cefa-d626-4023-9a1b-26fde72e393a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:39.898207 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-e8b75f92-ab7d-43c2-abf7-5db09afa73d8 req-86b5cefa-d626-4023-9a1b-26fde72e393a service nova] Creating event network-vif-deleted:0c8a3e30-0332-43f8-b45d-e1b0044904db for instance a8005322-6d9a-4389-997b-0fa884370e79 on n-h1-844627-10 Aug 04 14:59:39.904537 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-e8b75f92-ab7d-43c2-abf7-5db09afa73d8 req-86b5cefa-d626-4023-9a1b-26fde72e393a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047255 Aug 04 14:59:39.905040 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3298/6603] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:59:40.327550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:40.328157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:40.336758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:40.337334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:40.338012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:40.338441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:40.370322 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:40.370780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:40.371272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lazy-loading 'fault' on Instance uuid a8005322-6d9a-4389-997b-0fa884370e79 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 14:59:40.414715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cc1a818244ddda20f6d3eae22b21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ea3ece9a49d391c4ff8f6582dd1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:40.422198 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-07f73291-6744-4946-8e1b-95b7a2a47055 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 200 len: 1305 microversion: 2.1 time: 0.098502 Aug 04 14:59:40.422837 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3306/6604] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:40 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:41.444441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:41.445080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: a8005322-6d9a-4389-997b-0fa884370e79] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:41.447151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=36 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:59:41.452759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:41.453253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:41.454039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:41.454495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:41.468595 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] HTTP exception thrown: Instance a8005322-6d9a-4389-997b-0fa884370e79 could not be found. Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Request method failure captured: Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 HTTP/1.1 Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi695z8D9at9bJ7H3fhhCyUITImrFhowwbLxDixpfQbfyMXNfioSE6TInuipTBpdS-u7vIVGqk_op_YtDq7tQqtfNzLqtGVAj4GIwnuwzNSLL4r1dpGbEOhPKvY8dy5VwiOegd5TwXsV3FITI9vqa0JIkZ6DwPLfb8iQ4pCVBadtJKSMk Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 10f3ea3ece9a49d391c4ff8f6582dd1d Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1848246728 Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/10f3ea3ece9a49d391c4ff8f6582dd1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_10f3ea3ece9a49d391c4ff8f6582dd1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/10f3ea3ece9a49d391c4ff8f6582dd1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/10f3ea3ece9a49d391c4ff8f6582dd1d"}]}] Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerDiskConfigTestJSON-1848246728 Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 10f3ea3ece9a49d391c4ff8f6582dd1d Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1848246728 Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerDiskConfigTestJSON-1848246728-project Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: ff0cc1a818244ddda20f6d3eae22b21d Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerDiskConfigTestJSON-1848246728-project Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance a8005322-6d9a-4389-997b-0fa884370e79 could not be found. Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'a8005322-6d9a-4389-997b-0fa884370e79'} Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8005322-6d9a-4389-997b-0fa884370e79 could not be found. Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8005322-6d9a-4389-997b-0fa884370e79 could not be found. Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:59:41.470283 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8005322-6d9a-4389-997b-0fa884370e79 could not be found. Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Returning 404 to user: Instance a8005322-6d9a-4389-997b-0fa884370e79 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c8120e4-48d1-45dd-97e6-379defcc3599 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79" status: 404 len: 111 microversion: 2.1 time: 0.032714 Aug 04 14:59:41.476309 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3299/6605] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:41 2022] GET /compute/v2.1/servers/a8005322-6d9a-4389-997b-0fa884370e79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:59:41.482729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-43cd43e8-94ec-4779-b73a-0f90058a1eba tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '.version_select at 0x7f470007edc0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:41.502832 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-43cd43e8-94ec-4779-b73a-0f90058a1eba tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913808007" status: 202 len: 0 microversion: 2.1 time: 0.024074 Aug 04 14:59:41.503444 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3307/6606] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 14:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913808007 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 14:59:42.159281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:42.159797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:42.168955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:42.169367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:42.170149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:42.170599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:42.188784 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] HTTP exception thrown: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Request method failure captured: Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b HTTP/1.1 Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi695z8D9at9bJ7H3fhhCyUITImrFhowwbLxDixpfQbfyMXNfioSE6TInuipTBpdS-u7vIVGqk_op_YtDq7tQqtfNzLqtGVAj4GIwnuwzNSLL4r1dpGbEOhPKvY8dy5VwiOegd5TwXsV3FITI9vqa0JIkZ6DwPLfb8iQ4pCVBadtJKSMk Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 10f3ea3ece9a49d391c4ff8f6582dd1d Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1848246728 Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/10f3ea3ece9a49d391c4ff8f6582dd1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_10f3ea3ece9a49d391c4ff8f6582dd1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/10f3ea3ece9a49d391c4ff8f6582dd1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/10f3ea3ece9a49d391c4ff8f6582dd1d"}]}] Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerDiskConfigTestJSON-1848246728 Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 10f3ea3ece9a49d391c4ff8f6582dd1d Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1848246728 Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerDiskConfigTestJSON-1848246728-project Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: ff0cc1a818244ddda20f6d3eae22b21d Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerDiskConfigTestJSON-1848246728-project Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'dd25816c-9032-466c-95da-460322d4e33b'} Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:59:42.192356 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Returning 404 to user: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dae8c49e-1e49-42bb-a2f3-6bcf3d06cead tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 404 len: 111 microversion: 2.1 time: 0.042614 Aug 04 14:59:42.205244 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3300/6607] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 14:59:42 2022] DELETE /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 14:59:42.209854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:42.210485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] [instance: dd25816c-9032-466c-95da-460322d4e33b] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:42.218171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:42.218628 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:42.219412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:42.219856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:42.237121 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] HTTP exception thrown: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Request method failure captured: Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b HTTP/1.1 Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi695z8D9at9bJ7H3fhhCyUITImrFhowwbLxDixpfQbfyMXNfioSE6TInuipTBpdS-u7vIVGqk_op_YtDq7tQqtfNzLqtGVAj4GIwnuwzNSLL4r1dpGbEOhPKvY8dy5VwiOegd5TwXsV3FITI9vqa0JIkZ6DwPLfb8iQ4pCVBadtJKSMk Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 10f3ea3ece9a49d391c4ff8f6582dd1d Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1848246728 Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/10f3ea3ece9a49d391c4ff8f6582dd1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_10f3ea3ece9a49d391c4ff8f6582dd1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/10f3ea3ece9a49d391c4ff8f6582dd1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/10f3ea3ece9a49d391c4ff8f6582dd1d"}]}] Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerDiskConfigTestJSON-1848246728 Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 10f3ea3ece9a49d391c4ff8f6582dd1d Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1848246728 Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerDiskConfigTestJSON-1848246728-project Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: ff0cc1a818244ddda20f6d3eae22b21d Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerDiskConfigTestJSON-1848246728-project Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'dd25816c-9032-466c-95da-460322d4e33b'} Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 14:59:42.238778 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] Returning 404 to user: Instance dd25816c-9032-466c-95da-460322d4e33b could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18a4d874-56d0-431c-8e3f-10f862e39ae9 tempest-ServerDiskConfigTestJSON-1848246728 tempest-ServerDiskConfigTestJSON-1848246728-project] 10.222.0.66 "GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b" status: 404 len: 111 microversion: 2.1 time: 0.034658 Aug 04 14:59:42.244230 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3308/6608] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:42 2022] GET /compute/v2.1/servers/dd25816c-9032-466c-95da-460322d4e33b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 14:59:51.119812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e9aacd2-6992-4a69-bcbe-dcc1959c90af tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'create', calling method: .version_select at 0x7f46f2ef9a60>, body: {"keypair": {"name": "tempest-keypair-60970359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPvXvPN8C4cpzjDHeF1e1JNy344W55zxe4/2JSNc2SIFUOK1Ex3MErHC3MFWCwJpEn0NRmD4ikzzm/8iKFzzU9XA8jalsRWG8kmuuFRRRLnQORtW6TwOS0jO6IXFQCHFA=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:59:51.136686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6e9aacd2-6992-4a69-bcbe-dcc1959c90af tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for project 48f20653eeda4766ade302734491bacd. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:59:51.151638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6e9aacd2-6992-4a69-bcbe-dcc1959c90af tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for user 35f4358920e5413484e70ee52fb8fdee and project 48f20653eeda4766ade302734491bacd. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:59:51.191263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e9aacd2-6992-4a69-bcbe-dcc1959c90af tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.218273 Aug 04 14:59:51.192181 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3301/6609] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 14:59:50 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:59:52.882219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-620279151", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e43235c-2d86-4b5d-a90f-42a2ad5be711"}], "security_groups": [{"name": "tempest-securitygroup--1442303699"}], "key_name": "tempest-keypair-60970359", "user_data": "}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:59:52.891784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:59:52.892437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:59:53.002390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] validate_networks() for [('4e43235c-2d86-4b5d-a90f-42a2ad5be711', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 14:59:53.410710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 14:59:53.411136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 14:59:53.411650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 14:59:53.412060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 14:59:53.412478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 14:59:53.422230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:53.422690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:53.423490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:53.424106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:53.442882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 14:59:53.448687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for user 35f4358920e5413484e70ee52fb8fdee and project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 14:59:53.463158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 14:59:53.465652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 14:59:53.524588 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-74db2681-9917-4cab-bee6-a8f174cdf0a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.647208 Aug 04 14:59:53.525296 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3309/6610] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 14:59:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 14:59:53.536026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c9b3feed-c259-4569-bad0-7360ae95ac2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:53.536659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c9b3feed-c259-4569-bad0-7360ae95ac2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:53.541171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 14:59:53.611868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c9b3feed-c259-4569-bad0-7360ae95ac2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:53.622562 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c9b3feed-c259-4569-bad0-7360ae95ac2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1236 microversion: 2.1 time: 0.090337 Aug 04 14:59:53.623165 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3302/6611] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:53 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:54.643545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2a510307-f838-4273-a8b6-76b6f8728903 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:54.644161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2a510307-f838-4273-a8b6-76b6f8728903 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:54.651801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a510307-f838-4273-a8b6-76b6f8728903 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:54.652249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a510307-f838-4273-a8b6-76b6f8728903 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:54.653059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a510307-f838-4273-a8b6-76b6f8728903 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:54.653495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a510307-f838-4273-a8b6-76b6f8728903 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:54.733567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a510307-f838-4273-a8b6-76b6f8728903 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:54.741833 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2a510307-f838-4273-a8b6-76b6f8728903 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1288 microversion: 2.1 time: 0.102634 Aug 04 14:59:54.742620 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3310/6612] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:54 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:55.765912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6b26c9a7-768a-4ba0-a83c-09c3aca077a4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:55.766447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6b26c9a7-768a-4ba0-a83c-09c3aca077a4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:55.775735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b26c9a7-768a-4ba0-a83c-09c3aca077a4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:55.776217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b26c9a7-768a-4ba0-a83c-09c3aca077a4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:55.777054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b26c9a7-768a-4ba0-a83c-09c3aca077a4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:55.777514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6b26c9a7-768a-4ba0-a83c-09c3aca077a4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:55.974087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6b26c9a7-768a-4ba0-a83c-09c3aca077a4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:55.982899 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6b26c9a7-768a-4ba0-a83c-09c3aca077a4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1362 microversion: 2.1 time: 0.223340 Aug 04 14:59:55.983757 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3303/6613] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:55 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:56.273569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e088e5cc-584b-4b0e-a27c-e62831c688ca req-9cc3f385-139e-4449-85f2-dbd47b60286b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffcb832b-77b1-4a31-844f-d9a0b54a8d2e", "tag": "5a26db9e-6a6e-4eef-81a7-bc5256fa8f55"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 14:59:56.286951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e088e5cc-584b-4b0e-a27c-e62831c688ca req-9cc3f385-139e-4449-85f2-dbd47b60286b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:56.287207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e088e5cc-584b-4b0e-a27c-e62831c688ca req-9cc3f385-139e-4449-85f2-dbd47b60286b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:56.299986 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e088e5cc-584b-4b0e-a27c-e62831c688ca req-9cc3f385-139e-4449-85f2-dbd47b60286b service nova] Creating event network-changed:5a26db9e-6a6e-4eef-81a7-bc5256fa8f55 for instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e on n-h1-844627-10 Aug 04 14:59:56.306717 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e088e5cc-584b-4b0e-a27c-e62831c688ca req-9cc3f385-139e-4449-85f2-dbd47b60286b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038705 Aug 04 14:59:56.307853 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3311/6614] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 14:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 14:59:57.003915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f089c021-e7e9-4b3e-bbc1-5833888fe6c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:57.004547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f089c021-e7e9-4b3e-bbc1-5833888fe6c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:57.011622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f089c021-e7e9-4b3e-bbc1-5833888fe6c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:57.012087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f089c021-e7e9-4b3e-bbc1-5833888fe6c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:57.012857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f089c021-e7e9-4b3e-bbc1-5833888fe6c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:57.013365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f089c021-e7e9-4b3e-bbc1-5833888fe6c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:57.152956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f089c021-e7e9-4b3e-bbc1-5833888fe6c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:57.166383 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f089c021-e7e9-4b3e-bbc1-5833888fe6c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1362 microversion: 2.1 time: 0.166378 Aug 04 14:59:57.167071 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3304/6615] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:56 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:58.187686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df773d14-31ed-4016-933f-9fb2eb30b0ab tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:58.188415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df773d14-31ed-4016-933f-9fb2eb30b0ab tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:58.196768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df773d14-31ed-4016-933f-9fb2eb30b0ab tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:58.197253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df773d14-31ed-4016-933f-9fb2eb30b0ab tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:58.198052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df773d14-31ed-4016-933f-9fb2eb30b0ab tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:58.198490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df773d14-31ed-4016-933f-9fb2eb30b0ab tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:58.328467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df773d14-31ed-4016-933f-9fb2eb30b0ab tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:58.337041 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df773d14-31ed-4016-933f-9fb2eb30b0ab tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1362 microversion: 2.1 time: 0.153628 Aug 04 14:59:58.337621 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3312/6616] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:58 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 14:59:59.357953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-48d09af1-1b40-4464-80c8-d67bc9105f12 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 14:59:59.358620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-48d09af1-1b40-4464-80c8-d67bc9105f12 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 14:59:59.365651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-48d09af1-1b40-4464-80c8-d67bc9105f12 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:59.366119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-48d09af1-1b40-4464-80c8-d67bc9105f12 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:59.366899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-48d09af1-1b40-4464-80c8-d67bc9105f12 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 14:59:59.367347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-48d09af1-1b40-4464-80c8-d67bc9105f12 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 14:59:59.505574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-48d09af1-1b40-4464-80c8-d67bc9105f12 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 14:59:59.514294 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-48d09af1-1b40-4464-80c8-d67bc9105f12 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1362 microversion: 2.1 time: 0.160222 Aug 04 14:59:59.514876 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3305/6617] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 14:59:59 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:00:00.534917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d26ac2ed-0422-440a-b70b-0b89b610d0f8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:00:00.535561 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d26ac2ed-0422-440a-b70b-0b89b610d0f8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:00:00.543162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d26ac2ed-0422-440a-b70b-0b89b610d0f8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:00.543603 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d26ac2ed-0422-440a-b70b-0b89b610d0f8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:00.544360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d26ac2ed-0422-440a-b70b-0b89b610d0f8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:00.544793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d26ac2ed-0422-440a-b70b-0b89b610d0f8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:00.673910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d26ac2ed-0422-440a-b70b-0b89b610d0f8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:00:00.681468 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d26ac2ed-0422-440a-b70b-0b89b610d0f8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1362 microversion: 2.1 time: 0.150545 Aug 04 15:00:00.682040 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3313/6618] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:00:00 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:00:01.701665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4414d12-45d0-4011-9407-f8dbd7937d89 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:00:01.702293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4414d12-45d0-4011-9407-f8dbd7937d89 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:00:01.709630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4414d12-45d0-4011-9407-f8dbd7937d89 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:01.710098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4414d12-45d0-4011-9407-f8dbd7937d89 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:01.711385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4414d12-45d0-4011-9407-f8dbd7937d89 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:01.711836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4414d12-45d0-4011-9407-f8dbd7937d89 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:01.847675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d4414d12-45d0-4011-9407-f8dbd7937d89 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:00:01.856012 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4414d12-45d0-4011-9407-f8dbd7937d89 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1362 microversion: 2.1 time: 0.158276 Aug 04 15:00:01.856596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3306/6619] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:00:01 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:00:02.875851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-28a96b0c-4a81-4705-80a8-0ff619a89e6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:00:02.876466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-28a96b0c-4a81-4705-80a8-0ff619a89e6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:00:02.883040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28a96b0c-4a81-4705-80a8-0ff619a89e6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:02.883496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28a96b0c-4a81-4705-80a8-0ff619a89e6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:02.885243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28a96b0c-4a81-4705-80a8-0ff619a89e6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:02.885428 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28a96b0c-4a81-4705-80a8-0ff619a89e6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:02.897421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-c5b3f90d-506d-4df7-8452-61f0f314d0ba req-43abbcf3-8420-4caa-ac1d-5547698205cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffcb832b-77b1-4a31-844f-d9a0b54a8d2e", "name": "network-vif-plugged", "status": "completed", "tag": "5a26db9e-6a6e-4eef-81a7-bc5256fa8f55"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:00:02.911425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c5b3f90d-506d-4df7-8452-61f0f314d0ba req-43abbcf3-8420-4caa-ac1d-5547698205cc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:02.911887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-c5b3f90d-506d-4df7-8452-61f0f314d0ba req-43abbcf3-8420-4caa-ac1d-5547698205cc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:02.923974 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-c5b3f90d-506d-4df7-8452-61f0f314d0ba req-43abbcf3-8420-4caa-ac1d-5547698205cc service nova] Creating event network-vif-plugged:5a26db9e-6a6e-4eef-81a7-bc5256fa8f55 for instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e on n-h1-844627-10 Aug 04 15:00:02.929196 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-c5b3f90d-506d-4df7-8452-61f0f314d0ba req-43abbcf3-8420-4caa-ac1d-5547698205cc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035479 Aug 04 15:00:02.929967 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3307/6620] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:00:03.044326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-28a96b0c-4a81-4705-80a8-0ff619a89e6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:00:03.052203 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-28a96b0c-4a81-4705-80a8-0ff619a89e6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1362 microversion: 2.1 time: 0.180435 Aug 04 15:00:03.052776 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3314/6621] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:00:02 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:00:04.070666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:00:04.075871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-eb02a984-1f75-491e-bbfe-5f8bc11824ec tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:00:04.076612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-eb02a984-1f75-491e-bbfe-5f8bc11824ec tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:00:04.083509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb02a984-1f75-491e-bbfe-5f8bc11824ec tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:04.083975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb02a984-1f75-491e-bbfe-5f8bc11824ec tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:04.085101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb02a984-1f75-491e-bbfe-5f8bc11824ec tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:04.085557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-eb02a984-1f75-491e-bbfe-5f8bc11824ec tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:04.225742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-eb02a984-1f75-491e-bbfe-5f8bc11824ec tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:00:04.234017 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-eb02a984-1f75-491e-bbfe-5f8bc11824ec tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1362 microversion: 2.1 time: 0.164389 Aug 04 15:00:04.234584 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3308/6622] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:00:04 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:00:05.254112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-101384a4-be42-4e77-8cb2-66b31ffaabc2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:00:05.254724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-101384a4-be42-4e77-8cb2-66b31ffaabc2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:00:05.256686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:00:05.257383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:00:05.264564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-101384a4-be42-4e77-8cb2-66b31ffaabc2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:05.265042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-101384a4-be42-4e77-8cb2-66b31ffaabc2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:05.265818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-101384a4-be42-4e77-8cb2-66b31ffaabc2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:05.266259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-101384a4-be42-4e77-8cb2-66b31ffaabc2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:05.411970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-101384a4-be42-4e77-8cb2-66b31ffaabc2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:00:05.420193 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-101384a4-be42-4e77-8cb2-66b31ffaabc2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1548 microversion: 2.1 time: 0.170274 Aug 04 15:00:05.420779 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3315/6623] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:00:05 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:00:05.440068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3eb9ce8f-ce3f-4290-ba8e-d614133535c9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:00:05.440624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3eb9ce8f-ce3f-4290-ba8e-d614133535c9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:00:05.447652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3eb9ce8f-ce3f-4290-ba8e-d614133535c9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:05.448115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3eb9ce8f-ce3f-4290-ba8e-d614133535c9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:05.448927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3eb9ce8f-ce3f-4290-ba8e-d614133535c9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:05.449382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3eb9ce8f-ce3f-4290-ba8e-d614133535c9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:05.531398 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3eb9ce8f-ce3f-4290-ba8e-d614133535c9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095149 Aug 04 15:00:05.532039 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3309/6624] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 15:00:05 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:00:06.492003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6ba46858-669b-4420-a857-2206da19e8d6 req-01324863-39f3-4931-9243-4c72b6d7c06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffcb832b-77b1-4a31-844f-d9a0b54a8d2e", "tag": "5a26db9e-6a6e-4eef-81a7-bc5256fa8f55"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:00:06.503307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6ba46858-669b-4420-a857-2206da19e8d6 req-01324863-39f3-4931-9243-4c72b6d7c06d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:00:06.503758 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6ba46858-669b-4420-a857-2206da19e8d6 req-01324863-39f3-4931-9243-4c72b6d7c06d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:00:06.514970 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6ba46858-669b-4420-a857-2206da19e8d6 req-01324863-39f3-4931-9243-4c72b6d7c06d service nova] Creating event network-changed:5a26db9e-6a6e-4eef-81a7-bc5256fa8f55 for instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e on n-h1-844627-10 Aug 04 15:00:06.520080 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6ba46858-669b-4420-a857-2206da19e8d6 req-01324863-39f3-4931-9243-4c72b6d7c06d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031836 Aug 04 15:00:06.520692 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3316/6625] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:01:11.041458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:11.042227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=36 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:11.047023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5fecf2bb-e806-41ea-a20a-e32ab9834a3a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:11.047638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5fecf2bb-e806-41ea-a20a-e32ab9834a3a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:11.055602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fecf2bb-e806-41ea-a20a-e32ab9834a3a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.056065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fecf2bb-e806-41ea-a20a-e32ab9834a3a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.056845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fecf2bb-e806-41ea-a20a-e32ab9834a3a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.057327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5fecf2bb-e806-41ea-a20a-e32ab9834a3a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.197476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5fecf2bb-e806-41ea-a20a-e32ab9834a3a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:11.205060 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5fecf2bb-e806-41ea-a20a-e32ab9834a3a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1667 microversion: 2.1 time: 0.166438 Aug 04 15:01:11.205638 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3310/6626] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:11 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1667 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:11.224206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:11.225083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=36 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:11.229929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7bc585c7-9801-4722-a646-11ca622b0296 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:11.230743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7bc585c7-9801-4722-a646-11ca622b0296 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:11.239373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bc585c7-9801-4722-a646-11ca622b0296 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.239820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bc585c7-9801-4722-a646-11ca622b0296 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.241183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bc585c7-9801-4722-a646-11ca622b0296 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.241627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7bc585c7-9801-4722-a646-11ca622b0296 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.370615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7bc585c7-9801-4722-a646-11ca622b0296 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:11.378405 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7bc585c7-9801-4722-a646-11ca622b0296 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1667 microversion: 2.1 time: 0.156929 Aug 04 15:01:11.378982 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3317/6627] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:11 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:11.398565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-add4c33c-3992-4840-9f33-eb3a0d5364b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:11.399199 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-add4c33c-3992-4840-9f33-eb3a0d5364b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:11.405385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-add4c33c-3992-4840-9f33-eb3a0d5364b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.405857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-add4c33c-3992-4840-9f33-eb3a0d5364b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.406647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-add4c33c-3992-4840-9f33-eb3a0d5364b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.407101 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-add4c33c-3992-4840-9f33-eb3a0d5364b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.539797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-add4c33c-3992-4840-9f33-eb3a0d5364b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:11.547690 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-add4c33c-3992-4840-9f33-eb3a0d5364b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1667 microversion: 2.1 time: 0.153066 Aug 04 15:01:11.548275 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3311/6628] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:11 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:11.568217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:11.570662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:11.576676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.577185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.577956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.578409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.606989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:11.614160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Old instance type m1.heat2, new instance type m1.heat {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 15:01:11.621465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:01:11.621881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:01:11.622352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:01:11.622755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:01:11.623162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:01:11.685217 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7f04dcf4-c285-49dd-8e39-1abe399aad2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e/action" status: 202 len: 0 microversion: 2.1 time: 0.120849 Aug 04 15:01:11.686035 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3318/6629] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:01:11 2022] POST /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:01:11.694259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d88c9e63-d2d6-4560-9030-5c3485fbe47b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:11.694887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d88c9e63-d2d6-4560-9030-5c3485fbe47b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:11.701066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88c9e63-d2d6-4560-9030-5c3485fbe47b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.701531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88c9e63-d2d6-4560-9030-5c3485fbe47b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.702323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88c9e63-d2d6-4560-9030-5c3485fbe47b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:11.702757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88c9e63-d2d6-4560-9030-5c3485fbe47b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:11.841107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d88c9e63-d2d6-4560-9030-5c3485fbe47b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:11.848793 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d88c9e63-d2d6-4560-9030-5c3485fbe47b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1676 microversion: 2.1 time: 0.158477 Aug 04 15:01:11.849391 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3312/6630] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:11 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:12.872375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-809f3732-b711-4ef0-91e3-a7076b4104b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:12.873111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-809f3732-b711-4ef0-91e3-a7076b4104b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:12.880300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-809f3732-b711-4ef0-91e3-a7076b4104b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:12.880796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-809f3732-b711-4ef0-91e3-a7076b4104b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:12.882277 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-809f3732-b711-4ef0-91e3-a7076b4104b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:12.882631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-809f3732-b711-4ef0-91e3-a7076b4104b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:13.104362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-809f3732-b711-4ef0-91e3-a7076b4104b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:13.111939 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-809f3732-b711-4ef0-91e3-a7076b4104b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1676 microversion: 2.1 time: 0.244853 Aug 04 15:01:13.112521 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3319/6631] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:12 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:14.134463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ff48599d-60fc-471e-be30-de9adb2cec2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:14.135100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ff48599d-60fc-471e-be30-de9adb2cec2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:14.142162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff48599d-60fc-471e-be30-de9adb2cec2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:14.142636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff48599d-60fc-471e-be30-de9adb2cec2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:14.143426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff48599d-60fc-471e-be30-de9adb2cec2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:14.143884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ff48599d-60fc-471e-be30-de9adb2cec2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:14.287291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ff48599d-60fc-471e-be30-de9adb2cec2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:14.296099 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ff48599d-60fc-471e-be30-de9adb2cec2b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.166195 Aug 04 15:01:14.296674 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3313/6632] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:14 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:15.318818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-37a5c7e7-98b8-4575-a6b6-437e922bd72e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:15.319440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-37a5c7e7-98b8-4575-a6b6-437e922bd72e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:15.326418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37a5c7e7-98b8-4575-a6b6-437e922bd72e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:15.326865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37a5c7e7-98b8-4575-a6b6-437e922bd72e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:15.327635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37a5c7e7-98b8-4575-a6b6-437e922bd72e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:15.328073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-37a5c7e7-98b8-4575-a6b6-437e922bd72e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:15.467557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-37a5c7e7-98b8-4575-a6b6-437e922bd72e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:15.475392 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-37a5c7e7-98b8-4575-a6b6-437e922bd72e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.161021 Aug 04 15:01:15.476010 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3320/6633] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:15 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:16.496436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f7dfa178-8e58-488f-94a1-945aa5d4023d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:16.497116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f7dfa178-8e58-488f-94a1-945aa5d4023d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:16.504025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7dfa178-8e58-488f-94a1-945aa5d4023d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:16.504482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7dfa178-8e58-488f-94a1-945aa5d4023d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:16.505281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7dfa178-8e58-488f-94a1-945aa5d4023d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:16.505772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7dfa178-8e58-488f-94a1-945aa5d4023d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:16.635269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f7dfa178-8e58-488f-94a1-945aa5d4023d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:16.643122 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f7dfa178-8e58-488f-94a1-945aa5d4023d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.150615 Aug 04 15:01:16.643706 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3314/6634] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:16 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:17.664382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-13da1c3d-77cc-4253-8efa-6dcdb6025871 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:17.665049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-13da1c3d-77cc-4253-8efa-6dcdb6025871 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:17.671989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13da1c3d-77cc-4253-8efa-6dcdb6025871 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:17.672441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13da1c3d-77cc-4253-8efa-6dcdb6025871 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:17.673235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13da1c3d-77cc-4253-8efa-6dcdb6025871 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:17.673682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-13da1c3d-77cc-4253-8efa-6dcdb6025871 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:17.819343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-13da1c3d-77cc-4253-8efa-6dcdb6025871 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:17.827037 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-13da1c3d-77cc-4253-8efa-6dcdb6025871 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.167153 Aug 04 15:01:17.827607 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3321/6635] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:17 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:18.848910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f423bceb-943a-4c16-9a86-311d5dcdb4f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:18.849561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f423bceb-943a-4c16-9a86-311d5dcdb4f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:18.856804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f423bceb-943a-4c16-9a86-311d5dcdb4f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:18.857308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f423bceb-943a-4c16-9a86-311d5dcdb4f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:18.858100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f423bceb-943a-4c16-9a86-311d5dcdb4f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:18.858563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f423bceb-943a-4c16-9a86-311d5dcdb4f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:18.988253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f423bceb-943a-4c16-9a86-311d5dcdb4f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:18.996388 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f423bceb-943a-4c16-9a86-311d5dcdb4f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.151485 Aug 04 15:01:18.996971 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3315/6636] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:18 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:20.017391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f4e481c0-76f0-4b8b-8e1d-88e5fa596f1e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:20.018000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f4e481c0-76f0-4b8b-8e1d-88e5fa596f1e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:20.025496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4e481c0-76f0-4b8b-8e1d-88e5fa596f1e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:20.025943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4e481c0-76f0-4b8b-8e1d-88e5fa596f1e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:20.026696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4e481c0-76f0-4b8b-8e1d-88e5fa596f1e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:20.027128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4e481c0-76f0-4b8b-8e1d-88e5fa596f1e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:20.156841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f4e481c0-76f0-4b8b-8e1d-88e5fa596f1e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:20.165939 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f4e481c0-76f0-4b8b-8e1d-88e5fa596f1e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.152369 Aug 04 15:01:20.166531 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3322/6637] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:20 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:21.188120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7042d9de-9aa2-427d-b41d-ef5f7641360d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:21.188765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7042d9de-9aa2-427d-b41d-ef5f7641360d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:21.197001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7042d9de-9aa2-427d-b41d-ef5f7641360d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:21.197469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7042d9de-9aa2-427d-b41d-ef5f7641360d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:21.198290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7042d9de-9aa2-427d-b41d-ef5f7641360d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:21.198744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7042d9de-9aa2-427d-b41d-ef5f7641360d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:21.331660 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7042d9de-9aa2-427d-b41d-ef5f7641360d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:21.339988 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7042d9de-9aa2-427d-b41d-ef5f7641360d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.156164 Aug 04 15:01:21.340584 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3316/6638] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:21 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:22.360749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f466d6ac-a378-4d10-82e8-3c7aa1afa7d4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:22.361409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f466d6ac-a378-4d10-82e8-3c7aa1afa7d4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:22.368634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f466d6ac-a378-4d10-82e8-3c7aa1afa7d4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:22.369119 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f466d6ac-a378-4d10-82e8-3c7aa1afa7d4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:22.369891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f466d6ac-a378-4d10-82e8-3c7aa1afa7d4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:22.370334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f466d6ac-a378-4d10-82e8-3c7aa1afa7d4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:22.511383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f466d6ac-a378-4d10-82e8-3c7aa1afa7d4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:22.521836 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f466d6ac-a378-4d10-82e8-3c7aa1afa7d4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.164049 Aug 04 15:01:22.521836 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3323/6639] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:22 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:23.542640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2755a6c8-9386-463b-9511-c7a3a36657cf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:23.543278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2755a6c8-9386-463b-9511-c7a3a36657cf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:23.550298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2755a6c8-9386-463b-9511-c7a3a36657cf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:23.550768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2755a6c8-9386-463b-9511-c7a3a36657cf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:23.551553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2755a6c8-9386-463b-9511-c7a3a36657cf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:23.552009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2755a6c8-9386-463b-9511-c7a3a36657cf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:23.689484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2755a6c8-9386-463b-9511-c7a3a36657cf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:23.697101 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2755a6c8-9386-463b-9511-c7a3a36657cf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.158862 Aug 04 15:01:23.697684 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3317/6640] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:23 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:24.719702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-490810e3-d29e-4ba1-bb68-5a166873b51f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:24.720323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-490810e3-d29e-4ba1-bb68-5a166873b51f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:24.727944 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-490810e3-d29e-4ba1-bb68-5a166873b51f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:24.728399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-490810e3-d29e-4ba1-bb68-5a166873b51f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:24.729202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-490810e3-d29e-4ba1-bb68-5a166873b51f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:24.729647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-490810e3-d29e-4ba1-bb68-5a166873b51f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:24.861244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-490810e3-d29e-4ba1-bb68-5a166873b51f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:24.868833 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-490810e3-d29e-4ba1-bb68-5a166873b51f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1681 microversion: 2.1 time: 0.153077 Aug 04 15:01:24.869443 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3324/6641] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:24 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:25.889695 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2177f015-fa8f-4f0d-b009-051e0d9fa448 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:25.890358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2177f015-fa8f-4f0d-b009-051e0d9fa448 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:25.897451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2177f015-fa8f-4f0d-b009-051e0d9fa448 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:25.897953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2177f015-fa8f-4f0d-b009-051e0d9fa448 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:25.898722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2177f015-fa8f-4f0d-b009-051e0d9fa448 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:25.899172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2177f015-fa8f-4f0d-b009-051e0d9fa448 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:26.088797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2177f015-fa8f-4f0d-b009-051e0d9fa448 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:26.096365 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2177f015-fa8f-4f0d-b009-051e0d9fa448 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1680 microversion: 2.1 time: 0.210649 Aug 04 15:01:26.096967 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3318/6642] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:25 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:26.148624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-04b23a0c-e04f-4ee8-ab46-1062c489ff06 req-0e914ba2-5dd4-471f-a7ea-0b3ba547c830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffcb832b-77b1-4a31-844f-d9a0b54a8d2e", "name": "network-vif-unplugged", "status": "completed", "tag": "5a26db9e-6a6e-4eef-81a7-bc5256fa8f55"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:26.159971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-04b23a0c-e04f-4ee8-ab46-1062c489ff06 req-0e914ba2-5dd4-471f-a7ea-0b3ba547c830 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:26.160431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-04b23a0c-e04f-4ee8-ab46-1062c489ff06 req-0e914ba2-5dd4-471f-a7ea-0b3ba547c830 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:26.175440 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-04b23a0c-e04f-4ee8-ab46-1062c489ff06 req-0e914ba2-5dd4-471f-a7ea-0b3ba547c830 service nova] Creating event network-vif-unplugged:5a26db9e-6a6e-4eef-81a7-bc5256fa8f55 for instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e on n-h2-844627-10 Aug 04 15:01:26.181200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-04b23a0c-e04f-4ee8-ab46-1062c489ff06 req-0e914ba2-5dd4-471f-a7ea-0b3ba547c830 service nova] Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:01:26.192219 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-04b23a0c-e04f-4ee8-ab46-1062c489ff06 req-0e914ba2-5dd4-471f-a7ea-0b3ba547c830 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047855 Aug 04 15:01:26.192844 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3325/6643] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:01:27.119561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-187fb7bf-3cf0-458f-98ab-b9a3361be6f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:27.120377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-187fb7bf-3cf0-458f-98ab-b9a3361be6f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:27.127403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-187fb7bf-3cf0-458f-98ab-b9a3361be6f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:27.127875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-187fb7bf-3cf0-458f-98ab-b9a3361be6f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:27.128672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-187fb7bf-3cf0-458f-98ab-b9a3361be6f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:27.129151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-187fb7bf-3cf0-458f-98ab-b9a3361be6f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:27.263207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-187fb7bf-3cf0-458f-98ab-b9a3361be6f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:27.270812 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-187fb7bf-3cf0-458f-98ab-b9a3361be6f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1678 microversion: 2.1 time: 0.155297 Aug 04 15:01:27.271380 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3319/6644] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:27 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:28.235798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3b15940f-96f2-4546-a121-8ca0b6360ecf req-b613377d-e16c-4bab-9c6e-9ecdf5397460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffcb832b-77b1-4a31-844f-d9a0b54a8d2e", "tag": "5a26db9e-6a6e-4eef-81a7-bc5256fa8f55"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:28.246734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3b15940f-96f2-4546-a121-8ca0b6360ecf req-b613377d-e16c-4bab-9c6e-9ecdf5397460 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:28.247082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3b15940f-96f2-4546-a121-8ca0b6360ecf req-b613377d-e16c-4bab-9c6e-9ecdf5397460 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:28.259597 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3b15940f-96f2-4546-a121-8ca0b6360ecf req-b613377d-e16c-4bab-9c6e-9ecdf5397460 service nova] Creating event network-changed:5a26db9e-6a6e-4eef-81a7-bc5256fa8f55 for instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e on n-h2-844627-10 Aug 04 15:01:28.265639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-3b15940f-96f2-4546-a121-8ca0b6360ecf req-b613377d-e16c-4bab-9c6e-9ecdf5397460 service nova] Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:01:28.276542 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3b15940f-96f2-4546-a121-8ca0b6360ecf req-b613377d-e16c-4bab-9c6e-9ecdf5397460 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045692 Aug 04 15:01:28.277213 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3326/6645] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:01:28.293137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f6446d1e-72a8-4b0c-972a-70c7d2ad983e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:28.293798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f6446d1e-72a8-4b0c-972a-70c7d2ad983e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:28.301038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6446d1e-72a8-4b0c-972a-70c7d2ad983e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:28.301522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6446d1e-72a8-4b0c-972a-70c7d2ad983e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:28.302328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6446d1e-72a8-4b0c-972a-70c7d2ad983e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:28.302798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6446d1e-72a8-4b0c-972a-70c7d2ad983e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:28.623149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f6446d1e-72a8-4b0c-972a-70c7d2ad983e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:28.639845 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f6446d1e-72a8-4b0c-972a-70c7d2ad983e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1678 microversion: 2.1 time: 0.350702 Aug 04 15:01:28.641920 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3320/6646] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:28 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1678 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:29.666404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ff3ec761-52c8-4eb8-b338-8819f03bcdaf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:29.667054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ff3ec761-52c8-4eb8-b338-8819f03bcdaf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:29.673338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3ec761-52c8-4eb8-b338-8819f03bcdaf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:29.673791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3ec761-52c8-4eb8-b338-8819f03bcdaf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:29.674555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3ec761-52c8-4eb8-b338-8819f03bcdaf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:29.674992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ff3ec761-52c8-4eb8-b338-8819f03bcdaf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:29.813051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ff3ec761-52c8-4eb8-b338-8819f03bcdaf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:29.821156 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ff3ec761-52c8-4eb8-b338-8819f03bcdaf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1675 microversion: 2.1 time: 0.160421 Aug 04 15:01:29.821756 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3327/6647] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:29 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:29.842631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-feda2e36-11e7-42a2-8a09-0642929f5848 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:29.843188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-feda2e36-11e7-42a2-8a09-0642929f5848 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:29.850676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-feda2e36-11e7-42a2-8a09-0642929f5848 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:29.851679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-feda2e36-11e7-42a2-8a09-0642929f5848 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:29.852482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-feda2e36-11e7-42a2-8a09-0642929f5848 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:29.852997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-feda2e36-11e7-42a2-8a09-0642929f5848 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:29.916118 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-feda2e36-11e7-42a2-8a09-0642929f5848 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e/action" status: 204 len: 0 microversion: 2.1 time: 0.077255 Aug 04 15:01:29.916819 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3321/6648] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:01:29 2022] POST /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:01:29.925418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2cc11626-69a0-47c0-b3dc-0ee316354849 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:29.926036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2cc11626-69a0-47c0-b3dc-0ee316354849 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:29.935142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2cc11626-69a0-47c0-b3dc-0ee316354849 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:29.935621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2cc11626-69a0-47c0-b3dc-0ee316354849 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:29.936442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2cc11626-69a0-47c0-b3dc-0ee316354849 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:29.937259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2cc11626-69a0-47c0-b3dc-0ee316354849 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:30.516334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2cc11626-69a0-47c0-b3dc-0ee316354849 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:30.525111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2cc11626-69a0-47c0-b3dc-0ee316354849 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1675 microversion: 2.1 time: 0.603515 Aug 04 15:01:30.525885 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3328/6649] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:29 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1675 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:31.548145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b11f7de7-6135-4009-913c-000fb39bd3eb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:31.548907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b11f7de7-6135-4009-913c-000fb39bd3eb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:31.555868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b11f7de7-6135-4009-913c-000fb39bd3eb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:31.556339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b11f7de7-6135-4009-913c-000fb39bd3eb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:31.557179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b11f7de7-6135-4009-913c-000fb39bd3eb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:31.558016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b11f7de7-6135-4009-913c-000fb39bd3eb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:31.724437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b11f7de7-6135-4009-913c-000fb39bd3eb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:31.732821 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b11f7de7-6135-4009-913c-000fb39bd3eb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1675 microversion: 2.1 time: 0.189993 Aug 04 15:01:31.733457 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3322/6650] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:31 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:32.755867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c714ec9b-d207-4875-97fe-e3dfbc541263 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:32.756682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c714ec9b-d207-4875-97fe-e3dfbc541263 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:32.763917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c714ec9b-d207-4875-97fe-e3dfbc541263 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:32.764381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c714ec9b-d207-4875-97fe-e3dfbc541263 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:32.765207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c714ec9b-d207-4875-97fe-e3dfbc541263 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:32.765657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c714ec9b-d207-4875-97fe-e3dfbc541263 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:32.816392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-74861769-51c0-475d-aa14-4323d687c4ad req-41b981de-ed1f-4100-85bf-397203676af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffcb832b-77b1-4a31-844f-d9a0b54a8d2e", "name": "network-vif-plugged", "status": "completed", "tag": "5a26db9e-6a6e-4eef-81a7-bc5256fa8f55"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:32.828683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-74861769-51c0-475d-aa14-4323d687c4ad req-41b981de-ed1f-4100-85bf-397203676af3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:32.829177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-74861769-51c0-475d-aa14-4323d687c4ad req-41b981de-ed1f-4100-85bf-397203676af3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:32.842220 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-74861769-51c0-475d-aa14-4323d687c4ad req-41b981de-ed1f-4100-85bf-397203676af3 service nova] Creating event network-vif-plugged:5a26db9e-6a6e-4eef-81a7-bc5256fa8f55 for instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e on n-h2-844627-10 Aug 04 15:01:32.847354 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-74861769-51c0-475d-aa14-4323d687c4ad req-41b981de-ed1f-4100-85bf-397203676af3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035930 Aug 04 15:01:32.848486 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3323/6651] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:01:32.966065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c714ec9b-d207-4875-97fe-e3dfbc541263 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:32.973880 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c714ec9b-d207-4875-97fe-e3dfbc541263 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1667 microversion: 2.1 time: 0.222921 Aug 04 15:01:32.974474 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3329/6652] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:32 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1667 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:32.995897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1724c873-9caa-4904-947b-121ed509bcb9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:32.996626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1724c873-9caa-4904-947b-121ed509bcb9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:33.003155 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1724c873-9caa-4904-947b-121ed509bcb9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:33.003618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1724c873-9caa-4904-947b-121ed509bcb9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:33.004412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1724c873-9caa-4904-947b-121ed509bcb9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:33.004861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1724c873-9caa-4904-947b-121ed509bcb9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:33.144300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1724c873-9caa-4904-947b-121ed509bcb9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:33.152739 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1724c873-9caa-4904-947b-121ed509bcb9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1667 microversion: 2.1 time: 0.161131 Aug 04 15:01:33.153363 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3324/6653] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:32 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:33.174108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8fd77fce-fb5c-4fd9-a81c-636a093f4495 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:33.174737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8fd77fce-fb5c-4fd9-a81c-636a093f4495 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:33.181267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fd77fce-fb5c-4fd9-a81c-636a093f4495 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:33.181711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fd77fce-fb5c-4fd9-a81c-636a093f4495 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:33.182498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fd77fce-fb5c-4fd9-a81c-636a093f4495 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:33.182928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fd77fce-fb5c-4fd9-a81c-636a093f4495 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:33.331789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8fd77fce-fb5c-4fd9-a81c-636a093f4495 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:33.341150 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8fd77fce-fb5c-4fd9-a81c-636a093f4495 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1667 microversion: 2.1 time: 0.171211 Aug 04 15:01:33.341748 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3330/6654] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:33 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1667 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:33.365259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f59a9b6d-b5c9-4df7-8bb7-f824eca12ae4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:33.365789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f59a9b6d-b5c9-4df7-8bb7-f824eca12ae4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:33.372424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f59a9b6d-b5c9-4df7-8bb7-f824eca12ae4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:33.372941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f59a9b6d-b5c9-4df7-8bb7-f824eca12ae4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:33.373729 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f59a9b6d-b5c9-4df7-8bb7-f824eca12ae4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:33.374219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f59a9b6d-b5c9-4df7-8bb7-f824eca12ae4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:33.402454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f59a9b6d-b5c9-4df7-8bb7-f824eca12ae4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:01:33.416401 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:33.483810 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f59a9b6d-b5c9-4df7-8bb7-f824eca12ae4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 204 len: 0 microversion: 2.1 time: 0.122290 Aug 04 15:01:33.484403 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3325/6655] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:01:33 2022] DELETE /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:01:33.493019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-365914cf-934e-455c-a5e6-f706ba6b8858 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:33.493647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-365914cf-934e-455c-a5e6-f706ba6b8858 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:33.499952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-365914cf-934e-455c-a5e6-f706ba6b8858 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:33.500235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-365914cf-934e-455c-a5e6-f706ba6b8858 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:33.501031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-365914cf-934e-455c-a5e6-f706ba6b8858 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:33.501970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-365914cf-934e-455c-a5e6-f706ba6b8858 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:33.644751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-365914cf-934e-455c-a5e6-f706ba6b8858 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:33.652546 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-365914cf-934e-455c-a5e6-f706ba6b8858 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1673 microversion: 2.1 time: 0.163460 Aug 04 15:01:33.653154 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3331/6656] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:33 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:34.673981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-61f8d8cd-4260-4ced-92a4-1edae2e6853a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:34.674775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-61f8d8cd-4260-4ced-92a4-1edae2e6853a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:34.682581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61f8d8cd-4260-4ced-92a4-1edae2e6853a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:34.683048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61f8d8cd-4260-4ced-92a4-1edae2e6853a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:34.683851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61f8d8cd-4260-4ced-92a4-1edae2e6853a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:34.684339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-61f8d8cd-4260-4ced-92a4-1edae2e6853a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:34.828274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-61f8d8cd-4260-4ced-92a4-1edae2e6853a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:34.840502 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-61f8d8cd-4260-4ced-92a4-1edae2e6853a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1673 microversion: 2.1 time: 0.170590 Aug 04 15:01:34.841612 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3326/6657] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:34 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:35.793408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-bbf6470c-b6ea-49f2-8d2a-3b19ad2f48ec req-11f5c703-ec19-48d3-9097-ef6d9a96c98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffcb832b-77b1-4a31-844f-d9a0b54a8d2e", "name": "network-vif-deleted", "tag": "5a26db9e-6a6e-4eef-81a7-bc5256fa8f55"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:35.805655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bbf6470c-b6ea-49f2-8d2a-3b19ad2f48ec req-11f5c703-ec19-48d3-9097-ef6d9a96c98b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:35.806098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bbf6470c-b6ea-49f2-8d2a-3b19ad2f48ec req-11f5c703-ec19-48d3-9097-ef6d9a96c98b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:35.818715 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-bbf6470c-b6ea-49f2-8d2a-3b19ad2f48ec req-11f5c703-ec19-48d3-9097-ef6d9a96c98b service nova] Creating event network-vif-deleted:5a26db9e-6a6e-4eef-81a7-bc5256fa8f55 for instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e on n-h2-844627-10 Aug 04 15:01:35.826781 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-bbf6470c-b6ea-49f2-8d2a-3b19ad2f48ec req-11f5c703-ec19-48d3-9097-ef6d9a96c98b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037093 Aug 04 15:01:35.827673 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3332/6658] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:01:35.863444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cfdaa267-4754-4235-b932-7e2917912414 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:35.864845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cfdaa267-4754-4235-b932-7e2917912414 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:35.873347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfdaa267-4754-4235-b932-7e2917912414 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:35.873822 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfdaa267-4754-4235-b932-7e2917912414 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:35.874632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfdaa267-4754-4235-b932-7e2917912414 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:35.875306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cfdaa267-4754-4235-b932-7e2917912414 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:36.042002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cfdaa267-4754-4235-b932-7e2917912414 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:36.050263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cfdaa267-4754-4235-b932-7e2917912414 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 200 len: 1321 microversion: 2.1 time: 0.190679 Aug 04 15:01:36.050781 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3327/6659] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:35 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:37.074350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:37.075093 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:37.081484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:37.081939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:37.082751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:37.083193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:37.097861 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e HTTP/1.1 Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'ffcb832b-77b1-4a31-844f-d9a0b54a8d2e'} Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:01:37.099654 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f2dd24c-c232-450e-b138-ac0865548280 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 404 len: 111 microversion: 2.1 time: 0.032445 Aug 04 15:01:37.104839 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3333/6660] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:37 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:01:37.115337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:37.115967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:37.123353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:37.123814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:37.124610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:37.125100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:37.139806 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e HTTP/1.1 Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'ffcb832b-77b1-4a31-844f-d9a0b54a8d2e'} Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:01:37.141564 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-639ad663-848a-49d3-b08c-0f11bf676ebd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 404 len: 111 microversion: 2.1 time: 0.031739 Aug 04 15:01:37.145231 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3328/6661] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:37 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:01:37.221385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1911834342", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4e43235c-2d86-4b5d-a90f-42a2ad5be711"}], "security_groups": [{"name": "tempest-securitygroup--1442303699"}], "key_name": "tempest-keypair-60970359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:37.334204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] validate_networks() for [('4e43235c-2d86-4b5d-a90f-42a2ad5be711', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:01:37.728832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:01:37.729280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:01:37.729749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:01:37.730154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:01:37.730569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:01:37.739669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:37.740109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:37.740961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:37.741376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:37.748840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:37.761615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:01:37.767268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for user 35f4358920e5413484e70ee52fb8fdee and project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:01:37.780102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:01:37.782534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:01:37.831446 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-83ed72e1-30ca-41db-a0dd-65c88879c402 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.614118 Aug 04 15:01:37.832105 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3334/6662] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:01:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:01:37.843341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6f045ada-4eec-4701-bf1f-06a7e8bc86f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:37.843980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6f045ada-4eec-4701-bf1f-06a7e8bc86f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:37.902754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f045ada-4eec-4701-bf1f-06a7e8bc86f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:37.910506 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6f045ada-4eec-4701-bf1f-06a7e8bc86f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1237 microversion: 2.1 time: 0.070933 Aug 04 15:01:37.911094 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3329/6663] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:37 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:38.933861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-afe64f9b-d9a8-441f-ac6d-00dd356de175 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:38.934490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-afe64f9b-d9a8-441f-ac6d-00dd356de175 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:38.942236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afe64f9b-d9a8-441f-ac6d-00dd356de175 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:38.942968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afe64f9b-d9a8-441f-ac6d-00dd356de175 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:38.943839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afe64f9b-d9a8-441f-ac6d-00dd356de175 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:38.944291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-afe64f9b-d9a8-441f-ac6d-00dd356de175 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:39.080813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-afe64f9b-d9a8-441f-ac6d-00dd356de175 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:39.089367 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-afe64f9b-d9a8-441f-ac6d-00dd356de175 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1307 microversion: 2.1 time: 0.160854 Aug 04 15:01:39.090009 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3335/6664] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:38 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1307 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:40.113176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a694d44-300e-405c-be4b-12b7d226707b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:40.113993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a694d44-300e-405c-be4b-12b7d226707b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:40.121683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a694d44-300e-405c-be4b-12b7d226707b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:40.122162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a694d44-300e-405c-be4b-12b7d226707b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:40.123002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a694d44-300e-405c-be4b-12b7d226707b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:40.123467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a694d44-300e-405c-be4b-12b7d226707b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:40.365726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a694d44-300e-405c-be4b-12b7d226707b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:40.375714 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a694d44-300e-405c-be4b-12b7d226707b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1363 microversion: 2.1 time: 0.267785 Aug 04 15:01:40.376568 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3330/6665] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:40 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:40.703479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ddebce23-5818-4786-ad6e-b47d460d7986 req-5d025d3f-e32f-4004-a523-45ed1ad8db02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43dac9e-93ae-42de-86d5-cdcb591d9830", "tag": "20fd499b-16d7-49a8-b652-5ecb3d7fe3c0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:40.714141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ddebce23-5818-4786-ad6e-b47d460d7986 req-5d025d3f-e32f-4004-a523-45ed1ad8db02 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:40.714598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ddebce23-5818-4786-ad6e-b47d460d7986 req-5d025d3f-e32f-4004-a523-45ed1ad8db02 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:40.732847 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ddebce23-5818-4786-ad6e-b47d460d7986 req-5d025d3f-e32f-4004-a523-45ed1ad8db02 service nova] Creating event network-changed:20fd499b-16d7-49a8-b652-5ecb3d7fe3c0 for instance b43dac9e-93ae-42de-86d5-cdcb591d9830 on n-h1-844627-10 Aug 04 15:01:40.741173 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ddebce23-5818-4786-ad6e-b47d460d7986 req-5d025d3f-e32f-4004-a523-45ed1ad8db02 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131979 Aug 04 15:01:40.742743 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3336/6666] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:01:41.399046 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fefcbb71-3857-4ee9-a39f-e43c74da8f36 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:41.399815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fefcbb71-3857-4ee9-a39f-e43c74da8f36 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:41.402599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:41.408489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fefcbb71-3857-4ee9-a39f-e43c74da8f36 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:41.408993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fefcbb71-3857-4ee9-a39f-e43c74da8f36 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:41.409787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fefcbb71-3857-4ee9-a39f-e43c74da8f36 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:41.410238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fefcbb71-3857-4ee9-a39f-e43c74da8f36 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:41.555505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fefcbb71-3857-4ee9-a39f-e43c74da8f36 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:41.563770 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fefcbb71-3857-4ee9-a39f-e43c74da8f36 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1363 microversion: 2.1 time: 0.169294 Aug 04 15:01:41.564376 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3331/6667] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:41 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:42.591909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-255b529b-c501-4e13-ab50-8f8fb5096fa1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:42.592993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-255b529b-c501-4e13-ab50-8f8fb5096fa1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:42.595502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:42.602783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-255b529b-c501-4e13-ab50-8f8fb5096fa1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:42.603245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-255b529b-c501-4e13-ab50-8f8fb5096fa1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:42.604029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-255b529b-c501-4e13-ab50-8f8fb5096fa1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:42.604463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-255b529b-c501-4e13-ab50-8f8fb5096fa1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:42.758073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-255b529b-c501-4e13-ab50-8f8fb5096fa1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:42.767530 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-255b529b-c501-4e13-ab50-8f8fb5096fa1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1363 microversion: 2.1 time: 0.183499 Aug 04 15:01:42.768120 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3337/6668] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:42 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:43.789484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e7a1f054-922a-4c7e-9b45-997eb2e518f3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:43.790176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e7a1f054-922a-4c7e-9b45-997eb2e518f3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:43.800824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7a1f054-922a-4c7e-9b45-997eb2e518f3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:43.801545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7a1f054-922a-4c7e-9b45-997eb2e518f3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:43.802896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7a1f054-922a-4c7e-9b45-997eb2e518f3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:43.803718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e7a1f054-922a-4c7e-9b45-997eb2e518f3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:43.957189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e7a1f054-922a-4c7e-9b45-997eb2e518f3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:43.966345 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e7a1f054-922a-4c7e-9b45-997eb2e518f3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1363 microversion: 2.1 time: 0.180872 Aug 04 15:01:43.966948 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3332/6669] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:43 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:01:44.106568 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:01:44.106792 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:01:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:01:44.988004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-28a6176b-03fb-4970-b0a2-de0690b77139 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:44.988653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-28a6176b-03fb-4970-b0a2-de0690b77139 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:44.995828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28a6176b-03fb-4970-b0a2-de0690b77139 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:44.996342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28a6176b-03fb-4970-b0a2-de0690b77139 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:44.997160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28a6176b-03fb-4970-b0a2-de0690b77139 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:44.997606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-28a6176b-03fb-4970-b0a2-de0690b77139 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:45.140862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-28a6176b-03fb-4970-b0a2-de0690b77139 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:45.149461 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-28a6176b-03fb-4970-b0a2-de0690b77139 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1363 microversion: 2.1 time: 0.165586 Aug 04 15:01:45.150075 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3338/6670] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:44 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:46.179758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e483456-da21-4da6-9d98-178ac6e906d1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:46.180398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e483456-da21-4da6-9d98-178ac6e906d1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:46.187659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e483456-da21-4da6-9d98-178ac6e906d1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:46.188131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e483456-da21-4da6-9d98-178ac6e906d1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:46.188959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e483456-da21-4da6-9d98-178ac6e906d1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:46.189420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e483456-da21-4da6-9d98-178ac6e906d1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:46.323296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3e483456-da21-4da6-9d98-178ac6e906d1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:46.330910 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e483456-da21-4da6-9d98-178ac6e906d1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1363 microversion: 2.1 time: 0.155897 Aug 04 15:01:46.331486 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3333/6671] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:46 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:47.352023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-336cf269-0625-46aa-bcf4-b2d5e3cf1bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:47.352632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-336cf269-0625-46aa-bcf4-b2d5e3cf1bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:47.359782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-336cf269-0625-46aa-bcf4-b2d5e3cf1bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:47.360240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-336cf269-0625-46aa-bcf4-b2d5e3cf1bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:47.361054 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-336cf269-0625-46aa-bcf4-b2d5e3cf1bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:47.361501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-336cf269-0625-46aa-bcf4-b2d5e3cf1bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:47.493180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-4fb6f4e8-2d1c-4a67-b475-1af770b0a26f req-06f5bfcc-c4f7-4be1-9142-a5fa1f0511b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43dac9e-93ae-42de-86d5-cdcb591d9830", "name": "network-vif-plugged", "status": "completed", "tag": "20fd499b-16d7-49a8-b652-5ecb3d7fe3c0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:47.495778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-336cf269-0625-46aa-bcf4-b2d5e3cf1bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:47.506584 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-336cf269-0625-46aa-bcf4-b2d5e3cf1bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1363 microversion: 2.1 time: 0.158430 Aug 04 15:01:47.507633 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3339/6672] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:47 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:47.511705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4fb6f4e8-2d1c-4a67-b475-1af770b0a26f req-06f5bfcc-c4f7-4be1-9142-a5fa1f0511b9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:47.512190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4fb6f4e8-2d1c-4a67-b475-1af770b0a26f req-06f5bfcc-c4f7-4be1-9142-a5fa1f0511b9 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:47.524345 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-4fb6f4e8-2d1c-4a67-b475-1af770b0a26f req-06f5bfcc-c4f7-4be1-9142-a5fa1f0511b9 service nova] Creating event network-vif-plugged:20fd499b-16d7-49a8-b652-5ecb3d7fe3c0 for instance b43dac9e-93ae-42de-86d5-cdcb591d9830 on n-h1-844627-10 Aug 04 15:01:47.529671 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-4fb6f4e8-2d1c-4a67-b475-1af770b0a26f req-06f5bfcc-c4f7-4be1-9142-a5fa1f0511b9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041426 Aug 04 15:01:47.530336 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3334/6673] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:01:48.530230 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f871064-c376-4cf6-ab39-1900aac72bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:48.530755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f871064-c376-4cf6-ab39-1900aac72bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:48.533052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:48.533895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:48.543902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f871064-c376-4cf6-ab39-1900aac72bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:48.544348 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f871064-c376-4cf6-ab39-1900aac72bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:48.545146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f871064-c376-4cf6-ab39-1900aac72bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:48.545583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f871064-c376-4cf6-ab39-1900aac72bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:48.679297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9f871064-c376-4cf6-ab39-1900aac72bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:48.687144 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f871064-c376-4cf6-ab39-1900aac72bc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1363 microversion: 2.1 time: 0.161558 Aug 04 15:01:48.687733 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3340/6674] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:48 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:49.709374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c6bb755-8b3f-49d5-9db9-91295bc73ea8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:49.710759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c6bb755-8b3f-49d5-9db9-91295bc73ea8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:49.713286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:01:49.719558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c6bb755-8b3f-49d5-9db9-91295bc73ea8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:49.720032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c6bb755-8b3f-49d5-9db9-91295bc73ea8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:49.720825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c6bb755-8b3f-49d5-9db9-91295bc73ea8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:49.721303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c6bb755-8b3f-49d5-9db9-91295bc73ea8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:49.853636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c6bb755-8b3f-49d5-9db9-91295bc73ea8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:01:49.861462 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c6bb755-8b3f-49d5-9db9-91295bc73ea8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1550 microversion: 2.1 time: 0.156193 Aug 04 15:01:49.862051 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3335/6675] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:01:49 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:01:49.882667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f8e17a96-09ed-47f3-9b82-67356edfe64f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:01:49.883200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f8e17a96-09ed-47f3-9b82-67356edfe64f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:01:49.890060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8e17a96-09ed-47f3-9b82-67356edfe64f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:49.890505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8e17a96-09ed-47f3-9b82-67356edfe64f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:49.891263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8e17a96-09ed-47f3-9b82-67356edfe64f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:49.891699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8e17a96-09ed-47f3-9b82-67356edfe64f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:49.975095 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f8e17a96-09ed-47f3-9b82-67356edfe64f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096823 Aug 04 15:01:49.975698 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3341/6676] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 15:01:49 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:01:51.284331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6ac8fc8d-1ac6-482b-9c3d-d350bc57dfc3 req-33d9e288-917b-4d90-9890-52b0ca76078e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43dac9e-93ae-42de-86d5-cdcb591d9830", "tag": "20fd499b-16d7-49a8-b652-5ecb3d7fe3c0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:01:51.294778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6ac8fc8d-1ac6-482b-9c3d-d350bc57dfc3 req-33d9e288-917b-4d90-9890-52b0ca76078e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:01:51.295235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6ac8fc8d-1ac6-482b-9c3d-d350bc57dfc3 req-33d9e288-917b-4d90-9890-52b0ca76078e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:01:51.306260 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6ac8fc8d-1ac6-482b-9c3d-d350bc57dfc3 req-33d9e288-917b-4d90-9890-52b0ca76078e service nova] Creating event network-changed:20fd499b-16d7-49a8-b652-5ecb3d7fe3c0 for instance b43dac9e-93ae-42de-86d5-cdcb591d9830 on n-h1-844627-10 Aug 04 15:01:51.312437 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6ac8fc8d-1ac6-482b-9c3d-d350bc57dfc3 req-33d9e288-917b-4d90-9890-52b0ca76078e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031827 Aug 04 15:01:51.313078 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3336/6677] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:02:53.014993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=9 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:02:53.015779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=36 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:02:53.020082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d8669ef3-baca-44a6-957a-75e9f06d6589 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:02:53.027501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8669ef3-baca-44a6-957a-75e9f06d6589 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:53.027955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8669ef3-baca-44a6-957a-75e9f06d6589 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:53.050785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d8669ef3-baca-44a6-957a-75e9f06d6589 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Going to try to stop instance {{(pid=130960) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 15:02:53.093516 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d8669ef3-baca-44a6-957a-75e9f06d6589 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/action" status: 202 len: 0 microversion: 2.1 time: 0.080665 Aug 04 15:02:53.094133 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3342/6678] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:02:53 2022] POST /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:02:53.101722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=11 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:02:53.102493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:02:53.108171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a5e5fca0-3a5b-455e-84fc-2f133e0a5e73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:02:53.109004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a5e5fca0-3a5b-455e-84fc-2f133e0a5e73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:02:53.116965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5e5fca0-3a5b-455e-84fc-2f133e0a5e73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:53.117461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5e5fca0-3a5b-455e-84fc-2f133e0a5e73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:53.118317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5e5fca0-3a5b-455e-84fc-2f133e0a5e73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:53.118778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a5e5fca0-3a5b-455e-84fc-2f133e0a5e73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:53.258856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a5e5fca0-3a5b-455e-84fc-2f133e0a5e73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:02:53.266625 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a5e5fca0-3a5b-455e-84fc-2f133e0a5e73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.168034 Aug 04 15:02:53.267138 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3337/6679] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:02:53 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:02:54.289448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9dd3b268-f761-4419-bb9d-465432c3a3d9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:02:54.290160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9dd3b268-f761-4419-bb9d-465432c3a3d9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:02:54.297506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dd3b268-f761-4419-bb9d-465432c3a3d9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:54.298029 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dd3b268-f761-4419-bb9d-465432c3a3d9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:54.298820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dd3b268-f761-4419-bb9d-465432c3a3d9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:54.299266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9dd3b268-f761-4419-bb9d-465432c3a3d9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:54.434756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9dd3b268-f761-4419-bb9d-465432c3a3d9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:02:54.443111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9dd3b268-f761-4419-bb9d-465432c3a3d9 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.158516 Aug 04 15:02:54.443711 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3343/6680] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:02:54 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:02:55.466435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-810ceb9a-f2ce-4dc7-9b73-e4986c326f60 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:02:55.466977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-810ceb9a-f2ce-4dc7-9b73-e4986c326f60 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:02:55.474121 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-810ceb9a-f2ce-4dc7-9b73-e4986c326f60 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:55.474586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-810ceb9a-f2ce-4dc7-9b73-e4986c326f60 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:55.475378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-810ceb9a-f2ce-4dc7-9b73-e4986c326f60 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:55.475830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-810ceb9a-f2ce-4dc7-9b73-e4986c326f60 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:55.613498 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-810ceb9a-f2ce-4dc7-9b73-e4986c326f60 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:02:55.622614 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-810ceb9a-f2ce-4dc7-9b73-e4986c326f60 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.160600 Aug 04 15:02:55.623245 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3338/6681] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:02:55 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:02:56.643672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-64eb8533-8ff2-40c1-a67b-a0547fcd86d6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:02:56.644317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-64eb8533-8ff2-40c1-a67b-a0547fcd86d6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:02:56.651394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64eb8533-8ff2-40c1-a67b-a0547fcd86d6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:56.651842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64eb8533-8ff2-40c1-a67b-a0547fcd86d6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:56.652652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64eb8533-8ff2-40c1-a67b-a0547fcd86d6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:56.653116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-64eb8533-8ff2-40c1-a67b-a0547fcd86d6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:56.789597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-64eb8533-8ff2-40c1-a67b-a0547fcd86d6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:02:56.797848 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-64eb8533-8ff2-40c1-a67b-a0547fcd86d6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.158169 Aug 04 15:02:56.798444 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3344/6682] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:02:56 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:02:57.819361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6d5f7213-2956-42fa-a12e-16d2bfce277c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:02:57.820025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6d5f7213-2956-42fa-a12e-16d2bfce277c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:02:57.828221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d5f7213-2956-42fa-a12e-16d2bfce277c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:57.828697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d5f7213-2956-42fa-a12e-16d2bfce277c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:57.829650 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d5f7213-2956-42fa-a12e-16d2bfce277c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:57.830104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6d5f7213-2956-42fa-a12e-16d2bfce277c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:57.973447 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6d5f7213-2956-42fa-a12e-16d2bfce277c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:02:57.981581 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6d5f7213-2956-42fa-a12e-16d2bfce277c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.166175 Aug 04 15:02:57.982173 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3339/6683] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:02:57 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:02:59.003401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-98350cb4-f4bd-42ed-9cdd-999184dbeb03 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:02:59.004662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-98350cb4-f4bd-42ed-9cdd-999184dbeb03 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:02:59.011245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-98350cb4-f4bd-42ed-9cdd-999184dbeb03 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:59.011703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-98350cb4-f4bd-42ed-9cdd-999184dbeb03 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:59.012490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-98350cb4-f4bd-42ed-9cdd-999184dbeb03 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:02:59.012963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-98350cb4-f4bd-42ed-9cdd-999184dbeb03 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:02:59.174941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-98350cb4-f4bd-42ed-9cdd-999184dbeb03 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:02:59.182662 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-98350cb4-f4bd-42ed-9cdd-999184dbeb03 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.183220 Aug 04 15:02:59.183231 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3345/6684] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:02:58 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:00.203773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-afbd5bef-510c-43e7-9b6a-b07a33b4c14c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:00.204464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-afbd5bef-510c-43e7-9b6a-b07a33b4c14c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:00.211854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afbd5bef-510c-43e7-9b6a-b07a33b4c14c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:00.212330 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afbd5bef-510c-43e7-9b6a-b07a33b4c14c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:00.213149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afbd5bef-510c-43e7-9b6a-b07a33b4c14c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:00.213870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-afbd5bef-510c-43e7-9b6a-b07a33b4c14c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:00.347854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-afbd5bef-510c-43e7-9b6a-b07a33b4c14c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:00.356196 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-afbd5bef-510c-43e7-9b6a-b07a33b4c14c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.156368 Aug 04 15:03:00.356769 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3340/6685] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:00 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:01.377779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a5d61ff-9636-4fe6-b1d7-558869fe8189 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:01.378403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8a5d61ff-9636-4fe6-b1d7-558869fe8189 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:01.386022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a5d61ff-9636-4fe6-b1d7-558869fe8189 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:01.386480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a5d61ff-9636-4fe6-b1d7-558869fe8189 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:01.387254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a5d61ff-9636-4fe6-b1d7-558869fe8189 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:01.387699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a5d61ff-9636-4fe6-b1d7-558869fe8189 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:01.522130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a5d61ff-9636-4fe6-b1d7-558869fe8189 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:01.529774 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8a5d61ff-9636-4fe6-b1d7-558869fe8189 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.155915 Aug 04 15:03:01.530347 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3346/6686] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:01 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:02.550818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dcf31d84-f7bf-4da5-8bb1-29711ce1b144 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:02.551970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dcf31d84-f7bf-4da5-8bb1-29711ce1b144 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:02.561538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcf31d84-f7bf-4da5-8bb1-29711ce1b144 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:02.562000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcf31d84-f7bf-4da5-8bb1-29711ce1b144 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:02.562845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcf31d84-f7bf-4da5-8bb1-29711ce1b144 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:02.563275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dcf31d84-f7bf-4da5-8bb1-29711ce1b144 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:02.700218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dcf31d84-f7bf-4da5-8bb1-29711ce1b144 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:02.707898 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dcf31d84-f7bf-4da5-8bb1-29711ce1b144 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.161122 Aug 04 15:03:02.708408 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3341/6687] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:02 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:03.730470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8799a9b5-819e-4ea0-a5e9-f6fac66f83fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:03.731088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8799a9b5-819e-4ea0-a5e9-f6fac66f83fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:03.739394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8799a9b5-819e-4ea0-a5e9-f6fac66f83fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:03.740193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8799a9b5-819e-4ea0-a5e9-f6fac66f83fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:03.741514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8799a9b5-819e-4ea0-a5e9-f6fac66f83fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:03.741972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8799a9b5-819e-4ea0-a5e9-f6fac66f83fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:03.874344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8799a9b5-819e-4ea0-a5e9-f6fac66f83fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:03.882059 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8799a9b5-819e-4ea0-a5e9-f6fac66f83fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1656 microversion: 2.1 time: 0.156320 Aug 04 15:03:03.882636 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3347/6688] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:03 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:03.903902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:03.906219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:03.913376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:03.913851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:03.914638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:03.915100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:03.943327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:03.949779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Old instance type m1.heat2, new instance type m1.heat {{(pid=130961) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 15:03:03.956175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:03:03.956620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:03:03.957157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:03:03.957587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:03:03.958019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:03:04.023339 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-118e1e63-699f-4a45-ba86-f31d4214963d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/action" status: 202 len: 0 microversion: 2.1 time: 0.123760 Aug 04 15:03:04.023934 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3342/6689] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:03:03 2022] POST /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:03:04.032731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e782a321-8281-4dcd-a5f8-246986938ddc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:04.033520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e782a321-8281-4dcd-a5f8-246986938ddc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:04.039818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e782a321-8281-4dcd-a5f8-246986938ddc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:04.040317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e782a321-8281-4dcd-a5f8-246986938ddc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:04.041132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e782a321-8281-4dcd-a5f8-246986938ddc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:04.041580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e782a321-8281-4dcd-a5f8-246986938ddc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:04.179293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e782a321-8281-4dcd-a5f8-246986938ddc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:04.186893 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e782a321-8281-4dcd-a5f8-246986938ddc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.158009 Aug 04 15:03:04.187683 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3348/6690] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:04 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:05.209335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-975eb1e5-33af-4d21-bfbb-286462b667b8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:05.209973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-975eb1e5-33af-4d21-bfbb-286462b667b8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:05.217797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-975eb1e5-33af-4d21-bfbb-286462b667b8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:05.218269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-975eb1e5-33af-4d21-bfbb-286462b667b8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:05.219054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-975eb1e5-33af-4d21-bfbb-286462b667b8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:05.219513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-975eb1e5-33af-4d21-bfbb-286462b667b8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:05.355497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-975eb1e5-33af-4d21-bfbb-286462b667b8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:05.363462 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-975eb1e5-33af-4d21-bfbb-286462b667b8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1679 microversion: 2.1 time: 0.158188 Aug 04 15:03:05.364053 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3343/6691] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:05 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:06.385486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c6ba4fb1-4c19-4fdc-8a5a-a68f48de2ddf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:06.386050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c6ba4fb1-4c19-4fdc-8a5a-a68f48de2ddf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:06.393233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6ba4fb1-4c19-4fdc-8a5a-a68f48de2ddf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:06.393686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6ba4fb1-4c19-4fdc-8a5a-a68f48de2ddf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:06.394474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6ba4fb1-4c19-4fdc-8a5a-a68f48de2ddf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:06.394926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c6ba4fb1-4c19-4fdc-8a5a-a68f48de2ddf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:06.533237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c6ba4fb1-4c19-4fdc-8a5a-a68f48de2ddf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:06.541166 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c6ba4fb1-4c19-4fdc-8a5a-a68f48de2ddf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1684 microversion: 2.1 time: 0.160131 Aug 04 15:03:06.541766 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3349/6692] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:06 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:07.563170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5b1fc91c-85da-43db-81db-22cb85c7e4c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:07.563833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b1fc91c-85da-43db-81db-22cb85c7e4c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:07.570826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b1fc91c-85da-43db-81db-22cb85c7e4c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:07.571287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b1fc91c-85da-43db-81db-22cb85c7e4c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:07.572770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b1fc91c-85da-43db-81db-22cb85c7e4c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:07.573278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b1fc91c-85da-43db-81db-22cb85c7e4c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:07.703858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5b1fc91c-85da-43db-81db-22cb85c7e4c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:07.711614 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5b1fc91c-85da-43db-81db-22cb85c7e4c7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1684 microversion: 2.1 time: 0.152394 Aug 04 15:03:07.712192 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3344/6693] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:07 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:08.560410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-8e0be04b-cbfe-45de-8af4-4a71e297379f req-921f8153-754f-473e-a78b-362fd50633d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43dac9e-93ae-42de-86d5-cdcb591d9830", "name": "network-vif-unplugged", "status": "completed", "tag": "20fd499b-16d7-49a8-b652-5ecb3d7fe3c0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:08.572182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8e0be04b-cbfe-45de-8af4-4a71e297379f req-921f8153-754f-473e-a78b-362fd50633d2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:08.572677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8e0be04b-cbfe-45de-8af4-4a71e297379f req-921f8153-754f-473e-a78b-362fd50633d2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:08.585137 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-8e0be04b-cbfe-45de-8af4-4a71e297379f req-921f8153-754f-473e-a78b-362fd50633d2 service nova] Creating event network-vif-unplugged:20fd499b-16d7-49a8-b652-5ecb3d7fe3c0 for instance b43dac9e-93ae-42de-86d5-cdcb591d9830 on n-h2-844627-10 Aug 04 15:03:08.591170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-8e0be04b-cbfe-45de-8af4-4a71e297379f req-921f8153-754f-473e-a78b-362fd50633d2 service nova] Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:03:08.602672 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-8e0be04b-cbfe-45de-8af4-4a71e297379f req-921f8153-754f-473e-a78b-362fd50633d2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046873 Aug 04 15:03:08.604085 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3350/6694] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:03:08.743856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec7180d7-d3ca-42ed-b369-c86f2e58ee6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:08.744538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ec7180d7-d3ca-42ed-b369-c86f2e58ee6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:08.751676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec7180d7-d3ca-42ed-b369-c86f2e58ee6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:08.752142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec7180d7-d3ca-42ed-b369-c86f2e58ee6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:08.752964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec7180d7-d3ca-42ed-b369-c86f2e58ee6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:08.753422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec7180d7-d3ca-42ed-b369-c86f2e58ee6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:08.951971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ec7180d7-d3ca-42ed-b369-c86f2e58ee6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:08.959672 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec7180d7-d3ca-42ed-b369-c86f2e58ee6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1683 microversion: 2.1 time: 0.219719 Aug 04 15:03:08.960268 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3345/6695] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:08 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1683 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:09.983755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4b1a1c36-73ac-4992-b5f1-6921eeca02e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:09.984473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4b1a1c36-73ac-4992-b5f1-6921eeca02e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:09.991215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b1a1c36-73ac-4992-b5f1-6921eeca02e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:09.991658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b1a1c36-73ac-4992-b5f1-6921eeca02e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:09.992418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b1a1c36-73ac-4992-b5f1-6921eeca02e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:09.992853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b1a1c36-73ac-4992-b5f1-6921eeca02e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:10.140293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4b1a1c36-73ac-4992-b5f1-6921eeca02e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:10.148190 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4b1a1c36-73ac-4992-b5f1-6921eeca02e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1681 microversion: 2.1 time: 0.169559 Aug 04 15:03:10.148779 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3351/6696] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:09 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:10.621138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-1400d928-83ef-48f8-8c7a-cf4bcd9bd5cd req-5aa36497-a84a-4813-b3d7-c613baeeceda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43dac9e-93ae-42de-86d5-cdcb591d9830", "tag": "20fd499b-16d7-49a8-b652-5ecb3d7fe3c0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:10.630941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1400d928-83ef-48f8-8c7a-cf4bcd9bd5cd req-5aa36497-a84a-4813-b3d7-c613baeeceda service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:10.631407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1400d928-83ef-48f8-8c7a-cf4bcd9bd5cd req-5aa36497-a84a-4813-b3d7-c613baeeceda service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:10.643267 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-1400d928-83ef-48f8-8c7a-cf4bcd9bd5cd req-5aa36497-a84a-4813-b3d7-c613baeeceda service nova] Creating event network-changed:20fd499b-16d7-49a8-b652-5ecb3d7fe3c0 for instance b43dac9e-93ae-42de-86d5-cdcb591d9830 on n-h2-844627-10 Aug 04 15:03:10.648512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-1400d928-83ef-48f8-8c7a-cf4bcd9bd5cd req-5aa36497-a84a-4813-b3d7-c613baeeceda service nova] Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:03:10.660231 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-1400d928-83ef-48f8-8c7a-cf4bcd9bd5cd req-5aa36497-a84a-4813-b3d7-c613baeeceda service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044544 Aug 04 15:03:10.660817 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3346/6697] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:03:11.175747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a0a89d63-4d13-4e2b-b20a-0a12d340dccc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:11.176477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a0a89d63-4d13-4e2b-b20a-0a12d340dccc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:11.184499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0a89d63-4d13-4e2b-b20a-0a12d340dccc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:11.185062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0a89d63-4d13-4e2b-b20a-0a12d340dccc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:11.185812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0a89d63-4d13-4e2b-b20a-0a12d340dccc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:11.186514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0a89d63-4d13-4e2b-b20a-0a12d340dccc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:11.488302 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a0a89d63-4d13-4e2b-b20a-0a12d340dccc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:11.497262 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a0a89d63-4d13-4e2b-b20a-0a12d340dccc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1677 microversion: 2.1 time: 0.325875 Aug 04 15:03:11.497991 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3352/6698] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:11 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1677 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:03:11.518757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ee0aed94-80de-40df-864a-ad60d6f49de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:11.519400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ee0aed94-80de-40df-864a-ad60d6f49de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:11.526019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee0aed94-80de-40df-864a-ad60d6f49de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:11.526559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee0aed94-80de-40df-864a-ad60d6f49de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:11.527424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee0aed94-80de-40df-864a-ad60d6f49de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:11.527941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ee0aed94-80de-40df-864a-ad60d6f49de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:11.588012 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ee0aed94-80de-40df-864a-ad60d6f49de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/action" status: 204 len: 0 microversion: 2.1 time: 0.073341 Aug 04 15:03:11.589142 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3347/6699] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:03:11 2022] POST /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 15:03:11.598692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b8e77dd0-0ac8-4299-99ee-ad54c26d3006 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:11.599795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b8e77dd0-0ac8-4299-99ee-ad54c26d3006 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:11.607981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8e77dd0-0ac8-4299-99ee-ad54c26d3006 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:11.608633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8e77dd0-0ac8-4299-99ee-ad54c26d3006 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:11.609878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8e77dd0-0ac8-4299-99ee-ad54c26d3006 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:11.610465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8e77dd0-0ac8-4299-99ee-ad54c26d3006 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:11.773524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b8e77dd0-0ac8-4299-99ee-ad54c26d3006 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:11.782225 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b8e77dd0-0ac8-4299-99ee-ad54c26d3006 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1677 microversion: 2.1 time: 0.188748 Aug 04 15:03:11.782822 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3353/6700] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:11 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:12.805676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3488bc04-a8be-4c60-9aff-620baf058796 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:12.807044 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3488bc04-a8be-4c60-9aff-620baf058796 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:12.814267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3488bc04-a8be-4c60-9aff-620baf058796 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:12.814788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3488bc04-a8be-4c60-9aff-620baf058796 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:12.815777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3488bc04-a8be-4c60-9aff-620baf058796 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:12.816522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3488bc04-a8be-4c60-9aff-620baf058796 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:12.953355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3488bc04-a8be-4c60-9aff-620baf058796 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:12.960785 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3488bc04-a8be-4c60-9aff-620baf058796 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1677 microversion: 2.1 time: 0.160551 Aug 04 15:03:12.961378 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3348/6701] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:12 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:13.982764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e302a1c-c7ca-44c2-8591-abb940e49a6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:13.983388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7e302a1c-c7ca-44c2-8591-abb940e49a6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:13.990528 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e302a1c-c7ca-44c2-8591-abb940e49a6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:13.990984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e302a1c-c7ca-44c2-8591-abb940e49a6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:13.991794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e302a1c-c7ca-44c2-8591-abb940e49a6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:13.992235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e302a1c-c7ca-44c2-8591-abb940e49a6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:14.126116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7e302a1c-c7ca-44c2-8591-abb940e49a6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:14.133589 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7e302a1c-c7ca-44c2-8591-abb940e49a6f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1656 microversion: 2.1 time: 0.154802 Aug 04 15:03:14.134154 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3354/6702] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:13 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:14.154804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b5573d58-15b2-4e1f-a17a-cfc098333084 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:14.155441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b5573d58-15b2-4e1f-a17a-cfc098333084 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:14.162825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5573d58-15b2-4e1f-a17a-cfc098333084 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:14.163383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5573d58-15b2-4e1f-a17a-cfc098333084 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:14.164230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5573d58-15b2-4e1f-a17a-cfc098333084 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:14.164796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b5573d58-15b2-4e1f-a17a-cfc098333084 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:14.294407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b5573d58-15b2-4e1f-a17a-cfc098333084 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:14.302040 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b5573d58-15b2-4e1f-a17a-cfc098333084 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1656 microversion: 2.1 time: 0.151253 Aug 04 15:03:14.302605 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3349/6703] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:14 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:14.322965 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2b3007c3-b020-49c9-86d9-3bbaa3e33cc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:14.329025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b3007c3-b020-49c9-86d9-3bbaa3e33cc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:14.329470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b3007c3-b020-49c9-86d9-3bbaa3e33cc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:14.351035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2b3007c3-b020-49c9-86d9-3bbaa3e33cc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Going to try to start instance {{(pid=130960) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 15:03:14.393605 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2b3007c3-b020-49c9-86d9-3bbaa3e33cc3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/action" status: 202 len: 0 microversion: 2.1 time: 0.074932 Aug 04 15:03:14.394233 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3355/6704] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:03:14 2022] POST /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:03:14.403432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-42689091-0c14-4401-80fa-37add9711806 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:14.404063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-42689091-0c14-4401-80fa-37add9711806 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:14.411174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42689091-0c14-4401-80fa-37add9711806 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:14.411897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42689091-0c14-4401-80fa-37add9711806 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:14.413480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42689091-0c14-4401-80fa-37add9711806 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:14.414302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-42689091-0c14-4401-80fa-37add9711806 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:14.975537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-42689091-0c14-4401-80fa-37add9711806 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:14.983161 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-42689091-0c14-4401-80fa-37add9711806 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1665 microversion: 2.1 time: 0.584164 Aug 04 15:03:14.983732 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3350/6705] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:14 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1665 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:15.356315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f3d1d6d6-34fd-42ec-8348-d9060d73c2de req-2c3ee53d-399c-46b9-a099-7201a9fa8e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43dac9e-93ae-42de-86d5-cdcb591d9830", "name": "network-vif-plugged", "status": "completed", "tag": "20fd499b-16d7-49a8-b652-5ecb3d7fe3c0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:15.367307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f3d1d6d6-34fd-42ec-8348-d9060d73c2de req-2c3ee53d-399c-46b9-a099-7201a9fa8e24 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:15.367757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f3d1d6d6-34fd-42ec-8348-d9060d73c2de req-2c3ee53d-399c-46b9-a099-7201a9fa8e24 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:15.380452 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f3d1d6d6-34fd-42ec-8348-d9060d73c2de req-2c3ee53d-399c-46b9-a099-7201a9fa8e24 service nova] Creating event network-vif-plugged:20fd499b-16d7-49a8-b652-5ecb3d7fe3c0 for instance b43dac9e-93ae-42de-86d5-cdcb591d9830 on n-h2-844627-10 Aug 04 15:03:15.385480 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f3d1d6d6-34fd-42ec-8348-d9060d73c2de req-2c3ee53d-399c-46b9-a099-7201a9fa8e24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106127 Aug 04 15:03:15.386108 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3356/6706] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:03:16.005009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e088468-5ae4-427a-92bc-53a913e88e31 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:16.005707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e088468-5ae4-427a-92bc-53a913e88e31 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:16.012790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e088468-5ae4-427a-92bc-53a913e88e31 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:16.013291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e088468-5ae4-427a-92bc-53a913e88e31 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:16.014080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e088468-5ae4-427a-92bc-53a913e88e31 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:16.014535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e088468-5ae4-427a-92bc-53a913e88e31 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:16.030130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:03:16.151139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7e088468-5ae4-427a-92bc-53a913e88e31 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:16.158868 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e088468-5ae4-427a-92bc-53a913e88e31 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1669 microversion: 2.1 time: 0.157815 Aug 04 15:03:16.159484 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3351/6707] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:15 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:16.180386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c421205-8a4f-409f-9096-65888887ad84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:16.181039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3c421205-8a4f-409f-9096-65888887ad84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:16.188550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c421205-8a4f-409f-9096-65888887ad84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:16.189174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c421205-8a4f-409f-9096-65888887ad84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:16.189946 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c421205-8a4f-409f-9096-65888887ad84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:16.190392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c421205-8a4f-409f-9096-65888887ad84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:16.207983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:03:16.219764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3c421205-8a4f-409f-9096-65888887ad84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:03:16.298330 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c421205-8a4f-409f-9096-65888887ad84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 204 len: 0 microversion: 2.1 time: 0.121753 Aug 04 15:03:16.299052 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3357/6708] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:03:16 2022] DELETE /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:03:16.307574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a32cf05-0b92-417f-9361-505a069a3f2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:16.308209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a32cf05-0b92-417f-9361-505a069a3f2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:16.314332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a32cf05-0b92-417f-9361-505a069a3f2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:16.314807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a32cf05-0b92-417f-9361-505a069a3f2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:16.315596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a32cf05-0b92-417f-9361-505a069a3f2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:16.316055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a32cf05-0b92-417f-9361-505a069a3f2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:16.450610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2a32cf05-0b92-417f-9361-505a069a3f2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:16.458267 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a32cf05-0b92-417f-9361-505a069a3f2c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1675 microversion: 2.1 time: 0.154710 Aug 04 15:03:16.458842 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3352/6709] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:16 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:17.481375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d00f7380-a724-4e04-9321-5bccc8997c87 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:17.482079 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d00f7380-a724-4e04-9321-5bccc8997c87 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:17.489844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d00f7380-a724-4e04-9321-5bccc8997c87 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:17.490300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d00f7380-a724-4e04-9321-5bccc8997c87 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:17.491070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d00f7380-a724-4e04-9321-5bccc8997c87 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:17.491513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d00f7380-a724-4e04-9321-5bccc8997c87 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:17.656080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d00f7380-a724-4e04-9321-5bccc8997c87 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:17.663854 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d00f7380-a724-4e04-9321-5bccc8997c87 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1675 microversion: 2.1 time: 0.187330 Aug 04 15:03:17.664447 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3358/6710] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:17 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:18.496287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5dd8fc6e-942f-4d58-b520-85dc5eea8260 req-bb0c0dda-39e8-414e-8da8-c711ae50578f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43dac9e-93ae-42de-86d5-cdcb591d9830", "name": "network-vif-deleted", "tag": "20fd499b-16d7-49a8-b652-5ecb3d7fe3c0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:18.509522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5dd8fc6e-942f-4d58-b520-85dc5eea8260 req-bb0c0dda-39e8-414e-8da8-c711ae50578f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:18.510375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5dd8fc6e-942f-4d58-b520-85dc5eea8260 req-bb0c0dda-39e8-414e-8da8-c711ae50578f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:18.524515 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5dd8fc6e-942f-4d58-b520-85dc5eea8260 req-bb0c0dda-39e8-414e-8da8-c711ae50578f service nova] Creating event network-vif-deleted:20fd499b-16d7-49a8-b652-5ecb3d7fe3c0 for instance b43dac9e-93ae-42de-86d5-cdcb591d9830 on n-h2-844627-10 Aug 04 15:03:18.531165 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5dd8fc6e-942f-4d58-b520-85dc5eea8260 req-bb0c0dda-39e8-414e-8da8-c711ae50578f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038745 Aug 04 15:03:18.532257 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3353/6711] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:03:18.685977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:18.686597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:18.693967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:18.694511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:18.695288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:18.695844 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:18.729018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:18.729570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:18.729997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lazy-loading 'fault' on Instance uuid b43dac9e-93ae-42de-86d5-cdcb591d9830 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:03:18.780590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:18.788531 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0d710211-c7bb-43fb-9873-ffcf69976557 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 200 len: 1327 microversion: 2.1 time: 0.106440 Aug 04 15:03:18.800958 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3359/6712] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:18 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:19.812042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:19.812785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:19.820014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:19.820483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:19.821287 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:19.821737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:19.835406 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 HTTP/1.1 Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b43dac9e-93ae-42de-86d5-cdcb591d9830'} Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:03:19.837084 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-81ed2cfc-1b94-4703-a61b-ebe4dca6d725 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 404 len: 111 microversion: 2.1 time: 0.030820 Aug 04 15:03:19.841614 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3354/6713] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:19 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:03:19.856075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:19.856791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:19.864129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:19.864579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:19.865382 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:19.865820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:19.879720 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 HTTP/1.1 Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b43dac9e-93ae-42de-86d5-cdcb591d9830'} Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:03:19.881430 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c363829f-481c-4b15-8693-65cdea0ea066 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 404 len: 111 microversion: 2.1 time: 0.031389 Aug 04 15:03:19.885285 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3360/6714] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:19 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:03:19.937557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-792977282", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4e43235c-2d86-4b5d-a90f-42a2ad5be711"}], "security_groups": [{"name": "tempest-securitygroup--1442303699"}], "key_name": "tempest-keypair-60970359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:20.042887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] validate_networks() for [('4e43235c-2d86-4b5d-a90f-42a2ad5be711', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:03:20.469801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:03:20.470245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:03:20.470741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:03:20.471178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:03:20.471620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:03:20.480662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:20.481163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:20.481995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:20.482452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:20.499292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:03:20.504753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for user 35f4358920e5413484e70ee52fb8fdee and project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:03:20.517906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:03:20.520205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:03:20.565812 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68855c9c-2aed-46f8-a9f7-05456259ef5e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.632071 Aug 04 15:03:20.566466 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3355/6715] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:03:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:03:20.577977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a83858c0-1fe3-4f09-95a0-9cef1f7c5359 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:20.578626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a83858c0-1fe3-4f09-95a0-9cef1f7c5359 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:20.636294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a83858c0-1fe3-4f09-95a0-9cef1f7c5359 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:20.642966 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a83858c0-1fe3-4f09-95a0-9cef1f7c5359 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1236 microversion: 2.1 time: 0.068988 Aug 04 15:03:20.643534 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3361/6716] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:20 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:21.664563 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-531ffcaf-356d-4bf2-9a4b-6a9f363797cc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:21.665211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-531ffcaf-356d-4bf2-9a4b-6a9f363797cc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:21.673080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-531ffcaf-356d-4bf2-9a4b-6a9f363797cc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:21.673579 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-531ffcaf-356d-4bf2-9a4b-6a9f363797cc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:21.674371 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-531ffcaf-356d-4bf2-9a4b-6a9f363797cc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:21.674815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-531ffcaf-356d-4bf2-9a4b-6a9f363797cc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:21.772144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-531ffcaf-356d-4bf2-9a4b-6a9f363797cc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:21.780351 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-531ffcaf-356d-4bf2-9a4b-6a9f363797cc tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1294 microversion: 2.1 time: 0.120552 Aug 04 15:03:21.780954 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3356/6717] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:21 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:22.802679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dec2ecde-48a6-4b89-8a95-c4df71c636ee tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:22.803310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dec2ecde-48a6-4b89-8a95-c4df71c636ee tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:22.812430 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dec2ecde-48a6-4b89-8a95-c4df71c636ee tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:22.813239 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dec2ecde-48a6-4b89-8a95-c4df71c636ee tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:22.813952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dec2ecde-48a6-4b89-8a95-c4df71c636ee tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:22.814388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dec2ecde-48a6-4b89-8a95-c4df71c636ee tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:22.895710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-24ff9a85-1221-48f3-8b96-849a0949b828 req-ee49d096-6a61-4ea3-a62f-31df7b0e1d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345984cb-fb51-40a7-81ef-bfd89eb81a28", "tag": "3c4a3dc7-8e10-4ee0-b7e2-1955b9975540"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:22.907954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-24ff9a85-1221-48f3-8b96-849a0949b828 req-ee49d096-6a61-4ea3-a62f-31df7b0e1d9f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:22.909341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-24ff9a85-1221-48f3-8b96-849a0949b828 req-ee49d096-6a61-4ea3-a62f-31df7b0e1d9f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:22.922516 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-24ff9a85-1221-48f3-8b96-849a0949b828 req-ee49d096-6a61-4ea3-a62f-31df7b0e1d9f service nova] Creating event network-changed:3c4a3dc7-8e10-4ee0-b7e2-1955b9975540 for instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 on n-h2-844627-10 Aug 04 15:03:22.927430 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-24ff9a85-1221-48f3-8b96-849a0949b828 req-ee49d096-6a61-4ea3-a62f-31df7b0e1d9f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035671 Aug 04 15:03:22.928355 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3357/6718] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:03:23.076032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dec2ecde-48a6-4b89-8a95-c4df71c636ee tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:23.083897 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dec2ecde-48a6-4b89-8a95-c4df71c636ee tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1362 microversion: 2.1 time: 0.285144 Aug 04 15:03:23.084569 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3362/6719] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:22 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:24.107700 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-81273d97-3413-4798-92f8-4ac524fa9f4c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:24.108410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-81273d97-3413-4798-92f8-4ac524fa9f4c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:24.110380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:03:24.116006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81273d97-3413-4798-92f8-4ac524fa9f4c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:24.116682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81273d97-3413-4798-92f8-4ac524fa9f4c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:24.117500 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81273d97-3413-4798-92f8-4ac524fa9f4c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:24.117946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81273d97-3413-4798-92f8-4ac524fa9f4c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:24.329947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-81273d97-3413-4798-92f8-4ac524fa9f4c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:24.337457 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-81273d97-3413-4798-92f8-4ac524fa9f4c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1362 microversion: 2.1 time: 0.235372 Aug 04 15:03:24.338031 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3358/6720] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:24 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:25.358595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6a7f6c0f-ac32-4e11-b167-5b0f2fc42e6d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:25.359229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6a7f6c0f-ac32-4e11-b167-5b0f2fc42e6d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:25.362155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:03:25.367570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a7f6c0f-ac32-4e11-b167-5b0f2fc42e6d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:25.368016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a7f6c0f-ac32-4e11-b167-5b0f2fc42e6d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:25.369311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a7f6c0f-ac32-4e11-b167-5b0f2fc42e6d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:25.369750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a7f6c0f-ac32-4e11-b167-5b0f2fc42e6d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:25.502529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6a7f6c0f-ac32-4e11-b167-5b0f2fc42e6d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:25.510841 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6a7f6c0f-ac32-4e11-b167-5b0f2fc42e6d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1362 microversion: 2.1 time: 0.156145 Aug 04 15:03:25.511411 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3363/6721] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:25 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:26.532269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d3fcc0be-2050-495b-903f-413aed959b7c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:26.532926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d3fcc0be-2050-495b-903f-413aed959b7c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:26.539928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3fcc0be-2050-495b-903f-413aed959b7c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:26.540396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3fcc0be-2050-495b-903f-413aed959b7c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:26.541706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3fcc0be-2050-495b-903f-413aed959b7c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:26.542161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d3fcc0be-2050-495b-903f-413aed959b7c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:26.675272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d3fcc0be-2050-495b-903f-413aed959b7c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:26.683499 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d3fcc0be-2050-495b-903f-413aed959b7c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1362 microversion: 2.1 time: 0.155181 Aug 04 15:03:26.684093 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3359/6722] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:26 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:27.704128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d1cfcc8-5ab9-407d-bbd7-0bca013883f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:27.704740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d1cfcc8-5ab9-407d-bbd7-0bca013883f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:27.712678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d1cfcc8-5ab9-407d-bbd7-0bca013883f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:27.713155 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d1cfcc8-5ab9-407d-bbd7-0bca013883f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:27.713927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d1cfcc8-5ab9-407d-bbd7-0bca013883f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:27.714619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d1cfcc8-5ab9-407d-bbd7-0bca013883f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:27.867269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d1cfcc8-5ab9-407d-bbd7-0bca013883f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:27.875324 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d1cfcc8-5ab9-407d-bbd7-0bca013883f5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1362 microversion: 2.1 time: 0.175142 Aug 04 15:03:27.875907 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3364/6723] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:27 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:28.895689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9fbbebc1-7ed3-4ba2-a688-884d517829e1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:28.896303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9fbbebc1-7ed3-4ba2-a688-884d517829e1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:28.903412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fbbebc1-7ed3-4ba2-a688-884d517829e1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:28.903874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fbbebc1-7ed3-4ba2-a688-884d517829e1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:28.904656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fbbebc1-7ed3-4ba2-a688-884d517829e1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:28.905132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9fbbebc1-7ed3-4ba2-a688-884d517829e1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:29.048438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9fbbebc1-7ed3-4ba2-a688-884d517829e1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:29.056118 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9fbbebc1-7ed3-4ba2-a688-884d517829e1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1362 microversion: 2.1 time: 0.164318 Aug 04 15:03:29.056739 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3360/6724] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:28 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:29.306164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-37a52c47-0bcb-4940-bf47-f167b2d80acf req-d63bf892-9946-422a-9ca0-4e2de45cbf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345984cb-fb51-40a7-81ef-bfd89eb81a28", "name": "network-vif-plugged", "status": "completed", "tag": "3c4a3dc7-8e10-4ee0-b7e2-1955b9975540"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:29.318701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-37a52c47-0bcb-4940-bf47-f167b2d80acf req-d63bf892-9946-422a-9ca0-4e2de45cbf23 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:29.319591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-37a52c47-0bcb-4940-bf47-f167b2d80acf req-d63bf892-9946-422a-9ca0-4e2de45cbf23 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:29.331225 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-37a52c47-0bcb-4940-bf47-f167b2d80acf req-d63bf892-9946-422a-9ca0-4e2de45cbf23 service nova] Creating event network-vif-plugged:3c4a3dc7-8e10-4ee0-b7e2-1955b9975540 for instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 on n-h2-844627-10 Aug 04 15:03:29.336434 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-37a52c47-0bcb-4940-bf47-f167b2d80acf req-d63bf892-9946-422a-9ca0-4e2de45cbf23 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033789 Aug 04 15:03:29.337070 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3365/6725] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:03:30.077947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6f6d0a0a-9192-44e8-abd4-1f3a6095eb25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:30.078591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6f6d0a0a-9192-44e8-abd4-1f3a6095eb25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:30.085652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f6d0a0a-9192-44e8-abd4-1f3a6095eb25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:30.086120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f6d0a0a-9192-44e8-abd4-1f3a6095eb25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:30.086903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f6d0a0a-9192-44e8-abd4-1f3a6095eb25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:30.087971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f6d0a0a-9192-44e8-abd4-1f3a6095eb25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:30.218730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f6d0a0a-9192-44e8-abd4-1f3a6095eb25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:30.226472 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6f6d0a0a-9192-44e8-abd4-1f3a6095eb25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1362 microversion: 2.1 time: 0.152420 Aug 04 15:03:30.227051 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3361/6726] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:30 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:31.251203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-064b29a1-e524-4ab3-b08c-a4c52f4b3054 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:31.251926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-064b29a1-e524-4ab3-b08c-a4c52f4b3054 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:31.254838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:03:31.262483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-064b29a1-e524-4ab3-b08c-a4c52f4b3054 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:31.262933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-064b29a1-e524-4ab3-b08c-a4c52f4b3054 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:31.263725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-064b29a1-e524-4ab3-b08c-a4c52f4b3054 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:31.264170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-064b29a1-e524-4ab3-b08c-a4c52f4b3054 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:31.754771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-064b29a1-e524-4ab3-b08c-a4c52f4b3054 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:03:31.762903 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-064b29a1-e524-4ab3-b08c-a4c52f4b3054 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1548 microversion: 2.1 time: 0.516683 Aug 04 15:03:31.763501 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3366/6727] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:03:31 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1548 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:03:31.784397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5544bd3f-f38c-4785-b332-86a786f0ee65 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:03:31.784984 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5544bd3f-f38c-4785-b332-86a786f0ee65 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:03:31.786861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:03:31.787549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:03:31.795531 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5544bd3f-f38c-4785-b332-86a786f0ee65 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:31.795997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5544bd3f-f38c-4785-b332-86a786f0ee65 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:31.796784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5544bd3f-f38c-4785-b332-86a786f0ee65 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:31.797254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5544bd3f-f38c-4785-b332-86a786f0ee65 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:31.881688 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5544bd3f-f38c-4785-b332-86a786f0ee65 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101209 Aug 04 15:03:31.882323 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3362/6728] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 15:03:31 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:03:32.891568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5374bf05-66ee-40a8-9cc1-faa6dfea1626 req-f1c2a51e-748e-4a40-a409-dc639bd674f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345984cb-fb51-40a7-81ef-bfd89eb81a28", "tag": "3c4a3dc7-8e10-4ee0-b7e2-1955b9975540"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:03:32.903182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5374bf05-66ee-40a8-9cc1-faa6dfea1626 req-f1c2a51e-748e-4a40-a409-dc639bd674f8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:03:32.903737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5374bf05-66ee-40a8-9cc1-faa6dfea1626 req-f1c2a51e-748e-4a40-a409-dc639bd674f8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:03:32.916629 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5374bf05-66ee-40a8-9cc1-faa6dfea1626 req-f1c2a51e-748e-4a40-a409-dc639bd674f8 service nova] Creating event network-changed:3c4a3dc7-8e10-4ee0-b7e2-1955b9975540 for instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 on n-h2-844627-10 Aug 04 15:03:32.922515 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5374bf05-66ee-40a8-9cc1-faa6dfea1626 req-f1c2a51e-748e-4a40-a409-dc639bd674f8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034582 Aug 04 15:03:32.923139 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3367/6729] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:04:07.741948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=9 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:07.742832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=51 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:07.748797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:07.751133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:07.758391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:07.758853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:07.759638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:07.760084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:07.788227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:07.794882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Old instance type m1.heat2, new instance type m1.heat {{(pid=130961) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 15:04:07.801181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:04:07.801613 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:04:07.802098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:04:07.802512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:04:07.802933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:04:07.867180 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af2ac4aa-28e8-4820-bb59-6db529b98331 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28/action" status: 202 len: 0 microversion: 2.1 time: 0.127208 Aug 04 15:04:07.867779 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3363/6730] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:04:07 2022] POST /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:04:07.875448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=9 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:07.876318 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:07.881639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-73715ab0-dde0-4752-8f1e-4a72af83610a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:07.881940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-73715ab0-dde0-4752-8f1e-4a72af83610a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:07.889634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73715ab0-dde0-4752-8f1e-4a72af83610a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:07.890151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73715ab0-dde0-4752-8f1e-4a72af83610a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:07.891053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73715ab0-dde0-4752-8f1e-4a72af83610a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:07.891557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73715ab0-dde0-4752-8f1e-4a72af83610a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:08.031476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-73715ab0-dde0-4752-8f1e-4a72af83610a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:08.039987 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-73715ab0-dde0-4752-8f1e-4a72af83610a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1676 microversion: 2.1 time: 0.167151 Aug 04 15:04:08.040677 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3368/6731] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:07 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:09.064125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b4710a9c-0475-4cbb-9fc8-9d1947493bf6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:09.064769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b4710a9c-0475-4cbb-9fc8-9d1947493bf6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:09.071055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4710a9c-0475-4cbb-9fc8-9d1947493bf6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:09.071526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4710a9c-0475-4cbb-9fc8-9d1947493bf6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:09.072311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4710a9c-0475-4cbb-9fc8-9d1947493bf6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:09.072768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b4710a9c-0475-4cbb-9fc8-9d1947493bf6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:09.207942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b4710a9c-0475-4cbb-9fc8-9d1947493bf6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:09.216238 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b4710a9c-0475-4cbb-9fc8-9d1947493bf6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1676 microversion: 2.1 time: 0.158021 Aug 04 15:04:09.216818 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3364/6732] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:09 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:10.238193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-70e68315-ea44-44a1-8f2a-116acff210e6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:10.238801 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-70e68315-ea44-44a1-8f2a-116acff210e6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:10.246130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70e68315-ea44-44a1-8f2a-116acff210e6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:10.246574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70e68315-ea44-44a1-8f2a-116acff210e6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:10.247327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70e68315-ea44-44a1-8f2a-116acff210e6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:10.247755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-70e68315-ea44-44a1-8f2a-116acff210e6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:10.380945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-70e68315-ea44-44a1-8f2a-116acff210e6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:10.389613 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-70e68315-ea44-44a1-8f2a-116acff210e6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.155355 Aug 04 15:04:10.390221 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3369/6733] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:10 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:11.411491 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f8d63dd8-1127-45cd-8343-b51f3b8e7485 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:11.412196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f8d63dd8-1127-45cd-8343-b51f3b8e7485 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:11.419633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f8d63dd8-1127-45cd-8343-b51f3b8e7485 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:11.420093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f8d63dd8-1127-45cd-8343-b51f3b8e7485 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:11.420882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f8d63dd8-1127-45cd-8343-b51f3b8e7485 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:11.421398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f8d63dd8-1127-45cd-8343-b51f3b8e7485 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:11.561982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f8d63dd8-1127-45cd-8343-b51f3b8e7485 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:11.569762 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f8d63dd8-1127-45cd-8343-b51f3b8e7485 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.162283 Aug 04 15:04:11.570340 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3365/6734] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:11 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:12.596650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-113d7eb3-4d56-4d7f-8e34-bbb88eb91de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:12.597307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-113d7eb3-4d56-4d7f-8e34-bbb88eb91de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:12.604327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-113d7eb3-4d56-4d7f-8e34-bbb88eb91de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:12.604783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-113d7eb3-4d56-4d7f-8e34-bbb88eb91de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:12.605590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-113d7eb3-4d56-4d7f-8e34-bbb88eb91de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:12.606036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-113d7eb3-4d56-4d7f-8e34-bbb88eb91de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:12.736928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-113d7eb3-4d56-4d7f-8e34-bbb88eb91de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:12.744531 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-113d7eb3-4d56-4d7f-8e34-bbb88eb91de7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.152125 Aug 04 15:04:12.745637 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3370/6735] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:12 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:13.766806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5a95fc71-d68a-47f5-b0f0-f02dfa558432 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:13.767427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5a95fc71-d68a-47f5-b0f0-f02dfa558432 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:13.774355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a95fc71-d68a-47f5-b0f0-f02dfa558432 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:13.774814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a95fc71-d68a-47f5-b0f0-f02dfa558432 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:13.775582 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a95fc71-d68a-47f5-b0f0-f02dfa558432 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:13.776031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5a95fc71-d68a-47f5-b0f0-f02dfa558432 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:13.914958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5a95fc71-d68a-47f5-b0f0-f02dfa558432 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:13.922626 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5a95fc71-d68a-47f5-b0f0-f02dfa558432 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.159859 Aug 04 15:04:13.923196 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3366/6736] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:13 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:14.943668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eebb9f37-6898-4727-9c74-a7b9b360c911 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:14.944283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eebb9f37-6898-4727-9c74-a7b9b360c911 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:14.951229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eebb9f37-6898-4727-9c74-a7b9b360c911 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:14.951684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eebb9f37-6898-4727-9c74-a7b9b360c911 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:14.952461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eebb9f37-6898-4727-9c74-a7b9b360c911 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:14.952921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eebb9f37-6898-4727-9c74-a7b9b360c911 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:15.093384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eebb9f37-6898-4727-9c74-a7b9b360c911 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:15.100908 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eebb9f37-6898-4727-9c74-a7b9b360c911 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.161154 Aug 04 15:04:15.101501 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3371/6737] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:14 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:16.122523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bda74ac6-cbe6-4ea9-8c7d-7b6df43e9b05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:16.123138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bda74ac6-cbe6-4ea9-8c7d-7b6df43e9b05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:16.130196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bda74ac6-cbe6-4ea9-8c7d-7b6df43e9b05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:16.130667 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bda74ac6-cbe6-4ea9-8c7d-7b6df43e9b05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:16.131456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bda74ac6-cbe6-4ea9-8c7d-7b6df43e9b05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:16.131914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bda74ac6-cbe6-4ea9-8c7d-7b6df43e9b05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:16.261617 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bda74ac6-cbe6-4ea9-8c7d-7b6df43e9b05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:16.269278 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bda74ac6-cbe6-4ea9-8c7d-7b6df43e9b05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.151285 Aug 04 15:04:16.269851 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3367/6738] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:16 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:17.290877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7cb389fb-de15-42e2-a86b-465433ea510d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:17.291487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7cb389fb-de15-42e2-a86b-465433ea510d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:17.298914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cb389fb-de15-42e2-a86b-465433ea510d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:17.299360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cb389fb-de15-42e2-a86b-465433ea510d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:17.300115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cb389fb-de15-42e2-a86b-465433ea510d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:17.300546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7cb389fb-de15-42e2-a86b-465433ea510d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:17.438611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7cb389fb-de15-42e2-a86b-465433ea510d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:17.446200 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7cb389fb-de15-42e2-a86b-465433ea510d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.159189 Aug 04 15:04:17.446771 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3372/6739] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:17 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:18.467704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-01964759-b8f2-4fb7-9eb9-1f216bd6d94d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:18.468335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-01964759-b8f2-4fb7-9eb9-1f216bd6d94d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:18.475482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01964759-b8f2-4fb7-9eb9-1f216bd6d94d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:18.476020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01964759-b8f2-4fb7-9eb9-1f216bd6d94d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:18.476721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01964759-b8f2-4fb7-9eb9-1f216bd6d94d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:18.477191 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-01964759-b8f2-4fb7-9eb9-1f216bd6d94d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:18.615443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-01964759-b8f2-4fb7-9eb9-1f216bd6d94d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:18.623798 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-01964759-b8f2-4fb7-9eb9-1f216bd6d94d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.160249 Aug 04 15:04:18.624423 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3368/6740] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:18 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:19.646733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75f6d0a7-3a69-49d8-81fc-63c9ef97f6e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:19.647336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75f6d0a7-3a69-49d8-81fc-63c9ef97f6e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:19.654065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75f6d0a7-3a69-49d8-81fc-63c9ef97f6e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:19.654648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75f6d0a7-3a69-49d8-81fc-63c9ef97f6e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:19.655284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75f6d0a7-3a69-49d8-81fc-63c9ef97f6e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:19.655723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75f6d0a7-3a69-49d8-81fc-63c9ef97f6e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:19.789554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-75f6d0a7-3a69-49d8-81fc-63c9ef97f6e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:19.800111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75f6d0a7-3a69-49d8-81fc-63c9ef97f6e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.157631 Aug 04 15:04:19.800693 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3373/6741] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:19 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:20.822369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d88640cd-9235-4062-a0fc-a3bb2b6114e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:20.823002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d88640cd-9235-4062-a0fc-a3bb2b6114e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:20.830745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88640cd-9235-4062-a0fc-a3bb2b6114e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:20.831213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88640cd-9235-4062-a0fc-a3bb2b6114e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:20.832007 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88640cd-9235-4062-a0fc-a3bb2b6114e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:20.832458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d88640cd-9235-4062-a0fc-a3bb2b6114e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:21.038118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d88640cd-9235-4062-a0fc-a3bb2b6114e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:21.046183 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d88640cd-9235-4062-a0fc-a3bb2b6114e8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.227801 Aug 04 15:04:21.046758 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3369/6742] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:20 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:22.066874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0defa4e2-55d0-4aaa-ab74-7dc13d7d8148 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:22.067490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0defa4e2-55d0-4aaa-ab74-7dc13d7d8148 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:22.074702 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0defa4e2-55d0-4aaa-ab74-7dc13d7d8148 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:22.075150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0defa4e2-55d0-4aaa-ab74-7dc13d7d8148 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:22.076410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0defa4e2-55d0-4aaa-ab74-7dc13d7d8148 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:22.076847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0defa4e2-55d0-4aaa-ab74-7dc13d7d8148 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:22.216820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0defa4e2-55d0-4aaa-ab74-7dc13d7d8148 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:22.224409 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0defa4e2-55d0-4aaa-ab74-7dc13d7d8148 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.161479 Aug 04 15:04:22.225002 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3374/6743] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:22 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:04:23.246627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e1f9b065-0d22-4eb2-84ec-632cf85f49a3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:23.247293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e1f9b065-0d22-4eb2-84ec-632cf85f49a3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:23.254421 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1f9b065-0d22-4eb2-84ec-632cf85f49a3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:23.254891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1f9b065-0d22-4eb2-84ec-632cf85f49a3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:23.255682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1f9b065-0d22-4eb2-84ec-632cf85f49a3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:23.256139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e1f9b065-0d22-4eb2-84ec-632cf85f49a3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:23.385200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e1f9b065-0d22-4eb2-84ec-632cf85f49a3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:23.393256 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e1f9b065-0d22-4eb2-84ec-632cf85f49a3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.151470 Aug 04 15:04:23.393839 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3370/6744] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:23 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:24.415098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e554dac9-a536-4c99-a671-edc7a7431cd7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:24.415639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e554dac9-a536-4c99-a671-edc7a7431cd7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:24.423089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e554dac9-a536-4c99-a671-edc7a7431cd7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:24.423541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e554dac9-a536-4c99-a671-edc7a7431cd7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:24.424330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e554dac9-a536-4c99-a671-edc7a7431cd7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:24.424770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e554dac9-a536-4c99-a671-edc7a7431cd7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:24.552986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e554dac9-a536-4c99-a671-edc7a7431cd7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:24.560572 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e554dac9-a536-4c99-a671-edc7a7431cd7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.149338 Aug 04 15:04:24.561145 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3375/6745] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:24 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:25.581692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37cda8c9-0075-4dec-9ef7-7b62023d063d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:25.582320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-37cda8c9-0075-4dec-9ef7-7b62023d063d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:25.588580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37cda8c9-0075-4dec-9ef7-7b62023d063d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:25.589072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37cda8c9-0075-4dec-9ef7-7b62023d063d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:25.589875 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37cda8c9-0075-4dec-9ef7-7b62023d063d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:25.590331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37cda8c9-0075-4dec-9ef7-7b62023d063d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:25.726041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-37cda8c9-0075-4dec-9ef7-7b62023d063d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:25.734112 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37cda8c9-0075-4dec-9ef7-7b62023d063d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1681 microversion: 2.1 time: 0.157435 Aug 04 15:04:25.734689 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3371/6746] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:25 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:26.755487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-118e9989-dd4d-4833-a209-0dedd325ee73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:26.756978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-118e9989-dd4d-4833-a209-0dedd325ee73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:26.765008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-118e9989-dd4d-4833-a209-0dedd325ee73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:26.765467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-118e9989-dd4d-4833-a209-0dedd325ee73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:26.766481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-118e9989-dd4d-4833-a209-0dedd325ee73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:26.767012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-118e9989-dd4d-4833-a209-0dedd325ee73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:26.906843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-118e9989-dd4d-4833-a209-0dedd325ee73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:26.914567 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-118e9989-dd4d-4833-a209-0dedd325ee73 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1680 microversion: 2.1 time: 0.162986 Aug 04 15:04:26.915160 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3376/6747] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:26 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:27.270540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a3542a01-cf66-4b62-abe8-0859263538a1 req-6669f8e8-b8b1-4b4c-b59c-256643fd1f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345984cb-fb51-40a7-81ef-bfd89eb81a28", "name": "network-vif-unplugged", "status": "completed", "tag": "3c4a3dc7-8e10-4ee0-b7e2-1955b9975540"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:27.280592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a3542a01-cf66-4b62-abe8-0859263538a1 req-6669f8e8-b8b1-4b4c-b59c-256643fd1f0c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:27.281119 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a3542a01-cf66-4b62-abe8-0859263538a1 req-6669f8e8-b8b1-4b4c-b59c-256643fd1f0c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:27.296592 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a3542a01-cf66-4b62-abe8-0859263538a1 req-6669f8e8-b8b1-4b4c-b59c-256643fd1f0c service nova] Creating event network-vif-unplugged:3c4a3dc7-8e10-4ee0-b7e2-1955b9975540 for instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 on n-h1-844627-10 Aug 04 15:04:27.302298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-a3542a01-cf66-4b62-abe8-0859263538a1 req-6669f8e8-b8b1-4b4c-b59c-256643fd1f0c service nova] Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:04:27.314038 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a3542a01-cf66-4b62-abe8-0859263538a1 req-6669f8e8-b8b1-4b4c-b59c-256643fd1f0c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111612 Aug 04 15:04:27.315027 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3372/6748] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:04:27.935367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e42f4568-f5e7-4954-92dd-72713e2c4acf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:27.936018 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e42f4568-f5e7-4954-92dd-72713e2c4acf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:27.943015 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e42f4568-f5e7-4954-92dd-72713e2c4acf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:27.943461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e42f4568-f5e7-4954-92dd-72713e2c4acf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:27.944240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e42f4568-f5e7-4954-92dd-72713e2c4acf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:27.944669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e42f4568-f5e7-4954-92dd-72713e2c4acf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:28.097643 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e42f4568-f5e7-4954-92dd-72713e2c4acf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:28.106709 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e42f4568-f5e7-4954-92dd-72713e2c4acf tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1680 microversion: 2.1 time: 0.175148 Aug 04 15:04:28.107326 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3377/6749] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:27 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:29.129311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-49a59e9f-c64f-4830-8006-b3e18bb01724 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:29.130039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-49a59e9f-c64f-4830-8006-b3e18bb01724 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:29.136331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49a59e9f-c64f-4830-8006-b3e18bb01724 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:29.136805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49a59e9f-c64f-4830-8006-b3e18bb01724 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:29.137618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49a59e9f-c64f-4830-8006-b3e18bb01724 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:29.138073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-49a59e9f-c64f-4830-8006-b3e18bb01724 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:29.285672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-49a59e9f-c64f-4830-8006-b3e18bb01724 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:29.293421 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-49a59e9f-c64f-4830-8006-b3e18bb01724 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1678 microversion: 2.1 time: 0.169420 Aug 04 15:04:29.294004 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3373/6750] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:29 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:29.357392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a2c48f4c-ab80-4369-ab14-387eaed39210 req-86343b23-9118-4fe7-80bd-8b280858aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345984cb-fb51-40a7-81ef-bfd89eb81a28", "tag": "3c4a3dc7-8e10-4ee0-b7e2-1955b9975540"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:29.367927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a2c48f4c-ab80-4369-ab14-387eaed39210 req-86343b23-9118-4fe7-80bd-8b280858aa06 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:29.368379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a2c48f4c-ab80-4369-ab14-387eaed39210 req-86343b23-9118-4fe7-80bd-8b280858aa06 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:29.380429 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a2c48f4c-ab80-4369-ab14-387eaed39210 req-86343b23-9118-4fe7-80bd-8b280858aa06 service nova] Creating event network-changed:3c4a3dc7-8e10-4ee0-b7e2-1955b9975540 for instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 on n-h1-844627-10 Aug 04 15:04:29.385921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-a2c48f4c-ab80-4369-ab14-387eaed39210 req-86343b23-9118-4fe7-80bd-8b280858aa06 service nova] Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:04:29.397475 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a2c48f4c-ab80-4369-ab14-387eaed39210 req-86343b23-9118-4fe7-80bd-8b280858aa06 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044051 Aug 04 15:04:29.398127 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3378/6751] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:04:30.315946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b99d8b35-15fa-41a0-add3-a86e2c2928fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:30.316606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b99d8b35-15fa-41a0-add3-a86e2c2928fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:30.323837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b99d8b35-15fa-41a0-add3-a86e2c2928fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:30.324307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b99d8b35-15fa-41a0-add3-a86e2c2928fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:30.325131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b99d8b35-15fa-41a0-add3-a86e2c2928fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:30.325590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b99d8b35-15fa-41a0-add3-a86e2c2928fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:30.459591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b99d8b35-15fa-41a0-add3-a86e2c2928fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:30.468184 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b99d8b35-15fa-41a0-add3-a86e2c2928fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1678 microversion: 2.1 time: 0.156143 Aug 04 15:04:30.468917 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3374/6752] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:30 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:31.491994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-81aa5143-b8d4-4ed3-b26c-6796e5d02177 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:31.492823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-81aa5143-b8d4-4ed3-b26c-6796e5d02177 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:31.499997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81aa5143-b8d4-4ed3-b26c-6796e5d02177 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:31.500444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81aa5143-b8d4-4ed3-b26c-6796e5d02177 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:31.501245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81aa5143-b8d4-4ed3-b26c-6796e5d02177 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:31.501677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-81aa5143-b8d4-4ed3-b26c-6796e5d02177 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:31.659394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-81aa5143-b8d4-4ed3-b26c-6796e5d02177 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:31.667194 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-81aa5143-b8d4-4ed3-b26c-6796e5d02177 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1675 microversion: 2.1 time: 0.180903 Aug 04 15:04:31.667776 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3379/6753] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:31 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:31.688904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:31.689481 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:31.696553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:31.697073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:31.697898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:31.698351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:31.737783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:31.738254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:31.739076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:31.739522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:31.761176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:04:31.766535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for user 35f4358920e5413484e70ee52fb8fdee and project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:04:31.859809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:31.891187 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-46717070-c9ca-4d49-b55e-10b178077095 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28/action" status: 202 len: 0 microversion: 2.1 time: 0.206687 Aug 04 15:04:31.891986 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3375/6754] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:04:31 2022] POST /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:04:31.902246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cb154223-1aa9-4a6b-9ef2-0b31eae30506 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:31.903162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cb154223-1aa9-4a6b-9ef2-0b31eae30506 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:31.910868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb154223-1aa9-4a6b-9ef2-0b31eae30506 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:31.911317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb154223-1aa9-4a6b-9ef2-0b31eae30506 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:31.912524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb154223-1aa9-4a6b-9ef2-0b31eae30506 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:31.913005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb154223-1aa9-4a6b-9ef2-0b31eae30506 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:32.126623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cb154223-1aa9-4a6b-9ef2-0b31eae30506 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:32.136732 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cb154223-1aa9-4a6b-9ef2-0b31eae30506 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1674 microversion: 2.1 time: 0.238675 Aug 04 15:04:32.137968 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3380/6755] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:31 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:04:33.160516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3cfc88e2-b4ba-4f93-9bd0-350d34b906c6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:33.161301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3cfc88e2-b4ba-4f93-9bd0-350d34b906c6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:33.169374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cfc88e2-b4ba-4f93-9bd0-350d34b906c6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:33.169853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cfc88e2-b4ba-4f93-9bd0-350d34b906c6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:33.171147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cfc88e2-b4ba-4f93-9bd0-350d34b906c6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:33.171719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3cfc88e2-b4ba-4f93-9bd0-350d34b906c6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:33.309177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3cfc88e2-b4ba-4f93-9bd0-350d34b906c6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:33.317718 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3cfc88e2-b4ba-4f93-9bd0-350d34b906c6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1674 microversion: 2.1 time: 0.162414 Aug 04 15:04:33.318309 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3376/6756] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:33 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:34.292483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-348e8464-f1b0-4864-819f-df83dbe88d8f req-977f49b7-0ac2-4206-806d-ced1c03d69fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345984cb-fb51-40a7-81ef-bfd89eb81a28", "name": "network-vif-plugged", "status": "completed", "tag": "3c4a3dc7-8e10-4ee0-b7e2-1955b9975540"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:34.302840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-348e8464-f1b0-4864-819f-df83dbe88d8f req-977f49b7-0ac2-4206-806d-ced1c03d69fe service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:34.303283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-348e8464-f1b0-4864-819f-df83dbe88d8f req-977f49b7-0ac2-4206-806d-ced1c03d69fe service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:34.315587 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-348e8464-f1b0-4864-819f-df83dbe88d8f req-977f49b7-0ac2-4206-806d-ced1c03d69fe service nova] Creating event network-vif-plugged:3c4a3dc7-8e10-4ee0-b7e2-1955b9975540 for instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 on n-h1-844627-10 Aug 04 15:04:34.321092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-348e8464-f1b0-4864-819f-df83dbe88d8f req-977f49b7-0ac2-4206-806d-ced1c03d69fe service nova] Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:04:34.333342 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-348e8464-f1b0-4864-819f-df83dbe88d8f req-977f49b7-0ac2-4206-806d-ced1c03d69fe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043991 Aug 04 15:04:34.340162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5d7b5ea-c7dc-48ed-ae63-eb3ba245121b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:34.341067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d5d7b5ea-c7dc-48ed-ae63-eb3ba245121b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:34.344846 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3381/6757] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:04:34.348937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5d7b5ea-c7dc-48ed-ae63-eb3ba245121b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:34.349409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5d7b5ea-c7dc-48ed-ae63-eb3ba245121b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:34.350198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5d7b5ea-c7dc-48ed-ae63-eb3ba245121b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:34.350646 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5d7b5ea-c7dc-48ed-ae63-eb3ba245121b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:34.484382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d5d7b5ea-c7dc-48ed-ae63-eb3ba245121b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:34.491901 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d5d7b5ea-c7dc-48ed-ae63-eb3ba245121b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1674 microversion: 2.1 time: 0.155625 Aug 04 15:04:34.492461 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3377/6758] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:34 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:35.515986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3711d861-ee94-4998-a96d-22ebbc8fef35 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:35.516687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3711d861-ee94-4998-a96d-22ebbc8fef35 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:35.523246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3711d861-ee94-4998-a96d-22ebbc8fef35 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:35.523697 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3711d861-ee94-4998-a96d-22ebbc8fef35 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:35.524472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3711d861-ee94-4998-a96d-22ebbc8fef35 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:35.524935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3711d861-ee94-4998-a96d-22ebbc8fef35 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:35.763184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3711d861-ee94-4998-a96d-22ebbc8fef35 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:35.771349 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3711d861-ee94-4998-a96d-22ebbc8fef35 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1674 microversion: 2.1 time: 0.261123 Aug 04 15:04:35.772022 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3382/6759] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:35 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1674 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:35.829394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a5c4322b-4495-489d-ae53-cf792cd6b97a req-28b82bdd-5d57-4399-ab56-04a1794bbc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345984cb-fb51-40a7-81ef-bfd89eb81a28", "name": "network-vif-unplugged", "status": "completed", "tag": "3c4a3dc7-8e10-4ee0-b7e2-1955b9975540"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:35.841133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a5c4322b-4495-489d-ae53-cf792cd6b97a req-28b82bdd-5d57-4399-ab56-04a1794bbc6a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:35.841636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a5c4322b-4495-489d-ae53-cf792cd6b97a req-28b82bdd-5d57-4399-ab56-04a1794bbc6a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:35.858311 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a5c4322b-4495-489d-ae53-cf792cd6b97a req-28b82bdd-5d57-4399-ab56-04a1794bbc6a service nova] Creating event network-vif-unplugged:3c4a3dc7-8e10-4ee0-b7e2-1955b9975540 for instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 on n-h2-844627-10 Aug 04 15:04:35.864086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-a5c4322b-4495-489d-ae53-cf792cd6b97a req-28b82bdd-5d57-4399-ab56-04a1794bbc6a service nova] Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:04:35.876205 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a5c4322b-4495-489d-ae53-cf792cd6b97a req-28b82bdd-5d57-4399-ab56-04a1794bbc6a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051442 Aug 04 15:04:35.876903 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3378/6760] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:04:36.792940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-efbdac16-8246-441f-905b-9ca690a49c7d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:36.793556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-efbdac16-8246-441f-905b-9ca690a49c7d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:36.800674 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efbdac16-8246-441f-905b-9ca690a49c7d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:36.801150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efbdac16-8246-441f-905b-9ca690a49c7d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:36.801936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efbdac16-8246-441f-905b-9ca690a49c7d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:36.802376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-efbdac16-8246-441f-905b-9ca690a49c7d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:36.936023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-efbdac16-8246-441f-905b-9ca690a49c7d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:36.943578 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-efbdac16-8246-441f-905b-9ca690a49c7d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1674 microversion: 2.1 time: 0.154571 Aug 04 15:04:36.944152 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3383/6761] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:36 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:37.909174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ed6f9d3d-3011-42dd-8f37-bc1213613797 req-75c37065-31af-4b04-b451-38c70e4601e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345984cb-fb51-40a7-81ef-bfd89eb81a28", "tag": "3c4a3dc7-8e10-4ee0-b7e2-1955b9975540"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:37.914955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:37.921873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ed6f9d3d-3011-42dd-8f37-bc1213613797 req-75c37065-31af-4b04-b451-38c70e4601e7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:37.922378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ed6f9d3d-3011-42dd-8f37-bc1213613797 req-75c37065-31af-4b04-b451-38c70e4601e7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:37.934438 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ed6f9d3d-3011-42dd-8f37-bc1213613797 req-75c37065-31af-4b04-b451-38c70e4601e7 service nova] Creating event network-changed:3c4a3dc7-8e10-4ee0-b7e2-1955b9975540 for instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 on n-h2-844627-10 Aug 04 15:04:37.939722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-ed6f9d3d-3011-42dd-8f37-bc1213613797 req-75c37065-31af-4b04-b451-38c70e4601e7 service nova] Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:04:37.950202 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ed6f9d3d-3011-42dd-8f37-bc1213613797 req-75c37065-31af-4b04-b451-38c70e4601e7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045967 Aug 04 15:04:37.950794 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3379/6762] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:04:37.964699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3eaa9e9f-d086-40eb-9e3d-595a727ee2c1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:37.965409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3eaa9e9f-d086-40eb-9e3d-595a727ee2c1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:37.969888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=33 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:37.974027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3eaa9e9f-d086-40eb-9e3d-595a727ee2c1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:37.974480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3eaa9e9f-d086-40eb-9e3d-595a727ee2c1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:37.975259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3eaa9e9f-d086-40eb-9e3d-595a727ee2c1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:37.975740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3eaa9e9f-d086-40eb-9e3d-595a727ee2c1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:37.978649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=93 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:38.151248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3eaa9e9f-d086-40eb-9e3d-595a727ee2c1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:38.169641 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3eaa9e9f-d086-40eb-9e3d-595a727ee2c1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1674 microversion: 2.1 time: 0.208100 Aug 04 15:04:38.171289 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3384/6763] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:37 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:39.194333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac10763a-a0a9-42cb-a12b-e030dab3f991 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:39.195054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ac10763a-a0a9-42cb-a12b-e030dab3f991 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:39.201419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac10763a-a0a9-42cb-a12b-e030dab3f991 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.201892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac10763a-a0a9-42cb-a12b-e030dab3f991 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:39.202677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac10763a-a0a9-42cb-a12b-e030dab3f991 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.203134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac10763a-a0a9-42cb-a12b-e030dab3f991 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:39.340202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ac10763a-a0a9-42cb-a12b-e030dab3f991 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:39.348604 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac10763a-a0a9-42cb-a12b-e030dab3f991 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1667 microversion: 2.1 time: 0.159475 Aug 04 15:04:39.349214 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3380/6764] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:39 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:39.370187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3d4adf54-acda-4e6a-b861-10dc461b0056 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:39.371164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3d4adf54-acda-4e6a-b861-10dc461b0056 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:39.378044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d4adf54-acda-4e6a-b861-10dc461b0056 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.378497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d4adf54-acda-4e6a-b861-10dc461b0056 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:39.379263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d4adf54-acda-4e6a-b861-10dc461b0056 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.379703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3d4adf54-acda-4e6a-b861-10dc461b0056 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:39.524550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3d4adf54-acda-4e6a-b861-10dc461b0056 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:39.532666 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3d4adf54-acda-4e6a-b861-10dc461b0056 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1667 microversion: 2.1 time: 0.167078 Aug 04 15:04:39.533266 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3385/6765] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:39 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1667 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:39.553353 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9dce03f2-7179-4aa2-ba6f-6ca98bcf0681 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:39.553995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9dce03f2-7179-4aa2-ba6f-6ca98bcf0681 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:39.560557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9dce03f2-7179-4aa2-ba6f-6ca98bcf0681 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.561188 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9dce03f2-7179-4aa2-ba6f-6ca98bcf0681 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:39.561902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9dce03f2-7179-4aa2-ba6f-6ca98bcf0681 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.562362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9dce03f2-7179-4aa2-ba6f-6ca98bcf0681 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:39.733082 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9dce03f2-7179-4aa2-ba6f-6ca98bcf0681 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:39.750958 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9dce03f2-7179-4aa2-ba6f-6ca98bcf0681 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1667 microversion: 2.1 time: 0.201527 Aug 04 15:04:39.751563 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3381/6766] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:39 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1667 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:39.772377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5891a75-ce0a-4b1b-af3b-34ebeb2eb57c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:39.772922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5891a75-ce0a-4b1b-af3b-34ebeb2eb57c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:39.782357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5891a75-ce0a-4b1b-af3b-34ebeb2eb57c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.782357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5891a75-ce0a-4b1b-af3b-34ebeb2eb57c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:39.782357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5891a75-ce0a-4b1b-af3b-34ebeb2eb57c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.782357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5891a75-ce0a-4b1b-af3b-34ebeb2eb57c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:39.815391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5891a75-ce0a-4b1b-af3b-34ebeb2eb57c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:04:39.907206 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5891a75-ce0a-4b1b-af3b-34ebeb2eb57c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 204 len: 0 microversion: 2.1 time: 0.138781 Aug 04 15:04:39.907831 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3386/6767] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:04:39 2022] DELETE /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:04:39.917492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-064b1ea3-87d9-4694-8197-32c550cc0c33 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:39.918131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-064b1ea3-87d9-4694-8197-32c550cc0c33 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:39.925654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-064b1ea3-87d9-4694-8197-32c550cc0c33 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.926117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-064b1ea3-87d9-4694-8197-32c550cc0c33 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:39.926905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-064b1ea3-87d9-4694-8197-32c550cc0c33 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:39.927352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-064b1ea3-87d9-4694-8197-32c550cc0c33 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:40.081376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-064b1ea3-87d9-4694-8197-32c550cc0c33 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:40.092424 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-064b1ea3-87d9-4694-8197-32c550cc0c33 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1673 microversion: 2.1 time: 0.179454 Aug 04 15:04:40.093052 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3382/6768] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:39 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:41.115339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-78f1f2c3-f2f3-4391-9879-dbc64f476d97 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:41.116041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-78f1f2c3-f2f3-4391-9879-dbc64f476d97 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:41.123049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78f1f2c3-f2f3-4391-9879-dbc64f476d97 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:41.123498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78f1f2c3-f2f3-4391-9879-dbc64f476d97 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:41.124263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78f1f2c3-f2f3-4391-9879-dbc64f476d97 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:41.124695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-78f1f2c3-f2f3-4391-9879-dbc64f476d97 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:41.270410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-78f1f2c3-f2f3-4391-9879-dbc64f476d97 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:41.278421 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-78f1f2c3-f2f3-4391-9879-dbc64f476d97 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1673 microversion: 2.1 time: 0.167258 Aug 04 15:04:41.279052 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3387/6769] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:41 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:42.151465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-286a9b53-cbfe-4cd5-9a54-249d7efed569 req-b368cfe1-9f26-4938-88f8-fa5f327d6a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345984cb-fb51-40a7-81ef-bfd89eb81a28", "name": "network-vif-deleted", "tag": "3c4a3dc7-8e10-4ee0-b7e2-1955b9975540"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:42.157980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:42.165428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-286a9b53-cbfe-4cd5-9a54-249d7efed569 req-b368cfe1-9f26-4938-88f8-fa5f327d6a58 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:42.165519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-286a9b53-cbfe-4cd5-9a54-249d7efed569 req-b368cfe1-9f26-4938-88f8-fa5f327d6a58 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:42.183543 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-286a9b53-cbfe-4cd5-9a54-249d7efed569 req-b368cfe1-9f26-4938-88f8-fa5f327d6a58 service nova] Creating event network-vif-deleted:3c4a3dc7-8e10-4ee0-b7e2-1955b9975540 for instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 on n-h2-844627-10 Aug 04 15:04:42.191037 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-286a9b53-cbfe-4cd5-9a54-249d7efed569 req-b368cfe1-9f26-4938-88f8-fa5f327d6a58 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044435 Aug 04 15:04:42.192079 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3383/6770] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:04:42.300474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:42.301129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:42.309007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:42.309457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:42.310240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:42.311247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:42.346248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:42.346700 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:42.347154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lazy-loading 'fault' on Instance uuid 345984cb-fb51-40a7-81ef-bfd89eb81a28 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:04:42.390776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:42.401769 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b8eec058-fd35-4ea5-874a-f3a90613e09b tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 200 len: 1326 microversion: 2.1 time: 0.105266 Aug 04 15:04:42.402566 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3388/6771] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:42 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:43.428526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:43.429232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:43.436281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:43.436778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:43.437568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:43.438022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:43.455093 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 HTTP/1.1 Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '345984cb-fb51-40a7-81ef-bfd89eb81a28'} Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:04:43.456788 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.461534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:04:43.461534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:04:43.461534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:04:43.461534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:04:43.461534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:04:43.461534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.461534 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.465344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:04:43.466583 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-96083b1c-71c1-46f6-902e-9fb7b6b97af3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 404 len: 111 microversion: 2.1 time: 0.045382 Aug 04 15:04:43.467177 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3384/6772] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:43 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:04:43.488685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:43.489532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:43.497332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:43.498612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:43.499543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:43.500113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:43.516469 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 HTTP/1.1 Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '345984cb-fb51-40a7-81ef-bfd89eb81a28'} Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:04:43.518376 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ddcde0f4-13b1-4aab-a613-88eca532d57a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 404 len: 111 microversion: 2.1 time: 0.035317 Aug 04 15:04:43.522685 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3389/6773] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:43 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:04:43.572831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1128452267", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "4e43235c-2d86-4b5d-a90f-42a2ad5be711"}], "security_groups": [{"name": "tempest-securitygroup--1442303699"}], "key_name": "tempest-keypair-60970359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:43.687280 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] validate_networks() for [('4e43235c-2d86-4b5d-a90f-42a2ad5be711', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:04:44.086858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:04:44.087333 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:04:44.087813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:04:44.088238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:04:44.088670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:04:44.099493 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:44.099959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:44.100782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:44.101265 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:44.120006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:04:44.125766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for user 35f4358920e5413484e70ee52fb8fdee and project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:04:44.139235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:04:44.141612 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:04:44.190657 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3b5c1d49-3f10-4a97-ae96-37eda0db0643 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.621647 Aug 04 15:04:44.191343 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3385/6774] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:04:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:04:44.203123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-97c71221-9ddf-481c-a88e-5ac490f2f4db tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:44.203764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-97c71221-9ddf-481c-a88e-5ac490f2f4db tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:44.259023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-97c71221-9ddf-481c-a88e-5ac490f2f4db tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:44.267306 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-97c71221-9ddf-481c-a88e-5ac490f2f4db tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1237 microversion: 2.1 time: 0.068570 Aug 04 15:04:44.268088 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3390/6775] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:44 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:45.291250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b31a8942-b60b-44d9-85dc-55400e6b3a80 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:45.291883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b31a8942-b60b-44d9-85dc-55400e6b3a80 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:45.300331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b31a8942-b60b-44d9-85dc-55400e6b3a80 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:45.301130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b31a8942-b60b-44d9-85dc-55400e6b3a80 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:45.302136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b31a8942-b60b-44d9-85dc-55400e6b3a80 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:45.302596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b31a8942-b60b-44d9-85dc-55400e6b3a80 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:45.388397 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b31a8942-b60b-44d9-85dc-55400e6b3a80 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:45.398569 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b31a8942-b60b-44d9-85dc-55400e6b3a80 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1297 microversion: 2.1 time: 0.112259 Aug 04 15:04:45.399622 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3386/6776] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:45 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:04:46.421971 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23ca5a34-561b-44e4-b74c-422bd9e4b38d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:46.422590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-23ca5a34-561b-44e4-b74c-422bd9e4b38d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:46.430984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23ca5a34-561b-44e4-b74c-422bd9e4b38d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:46.431443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23ca5a34-561b-44e4-b74c-422bd9e4b38d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:46.432224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23ca5a34-561b-44e4-b74c-422bd9e4b38d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:46.432713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23ca5a34-561b-44e4-b74c-422bd9e4b38d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:46.574344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-23ca5a34-561b-44e4-b74c-422bd9e4b38d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:46.583387 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-23ca5a34-561b-44e4-b74c-422bd9e4b38d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1363 microversion: 2.1 time: 0.165803 Aug 04 15:04:46.584176 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3391/6777] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:46 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:46.726521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ea0ff9ef-3917-49cd-8a02-a34bb193be62 req-6b783cfe-3af8-4959-93bc-76ab0c8218b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:46.738618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ea0ff9ef-3917-49cd-8a02-a34bb193be62 req-6b783cfe-3af8-4959-93bc-76ab0c8218b1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:46.739254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ea0ff9ef-3917-49cd-8a02-a34bb193be62 req-6b783cfe-3af8-4959-93bc-76ab0c8218b1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:46.752405 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ea0ff9ef-3917-49cd-8a02-a34bb193be62 req-6b783cfe-3af8-4959-93bc-76ab0c8218b1 service nova] Creating event network-changed:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h1-844627-10 Aug 04 15:04:46.757669 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ea0ff9ef-3917-49cd-8a02-a34bb193be62 req-6b783cfe-3af8-4959-93bc-76ab0c8218b1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034835 Aug 04 15:04:46.759582 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3387/6778] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:04:47.606624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-05d8681b-8e8d-4a66-9686-492df7698aa3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:47.607225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-05d8681b-8e8d-4a66-9686-492df7698aa3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:47.615306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05d8681b-8e8d-4a66-9686-492df7698aa3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:47.615757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05d8681b-8e8d-4a66-9686-492df7698aa3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:47.616551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05d8681b-8e8d-4a66-9686-492df7698aa3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:47.617016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05d8681b-8e8d-4a66-9686-492df7698aa3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:47.765289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-05d8681b-8e8d-4a66-9686-492df7698aa3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:47.773890 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-05d8681b-8e8d-4a66-9686-492df7698aa3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1363 microversion: 2.1 time: 0.171139 Aug 04 15:04:47.774487 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3392/6779] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:47 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:48.798347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-853eb1a9-4cde-4d47-9988-c4bec47ec814 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:48.799107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-853eb1a9-4cde-4d47-9988-c4bec47ec814 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:48.806000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-853eb1a9-4cde-4d47-9988-c4bec47ec814 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:48.806495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-853eb1a9-4cde-4d47-9988-c4bec47ec814 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:48.807301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-853eb1a9-4cde-4d47-9988-c4bec47ec814 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:48.807758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-853eb1a9-4cde-4d47-9988-c4bec47ec814 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:48.946485 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-853eb1a9-4cde-4d47-9988-c4bec47ec814 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:48.954859 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-853eb1a9-4cde-4d47-9988-c4bec47ec814 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1363 microversion: 2.1 time: 0.162591 Aug 04 15:04:48.955470 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3388/6780] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:48 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:04:49.977907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7657c4b3-368c-491c-a2f2-fd5076c35add tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:49.978535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7657c4b3-368c-491c-a2f2-fd5076c35add tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:49.987084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7657c4b3-368c-491c-a2f2-fd5076c35add tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:49.987530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7657c4b3-368c-491c-a2f2-fd5076c35add tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:49.988351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7657c4b3-368c-491c-a2f2-fd5076c35add tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:49.988790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7657c4b3-368c-491c-a2f2-fd5076c35add tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:50.134655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7657c4b3-368c-491c-a2f2-fd5076c35add tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:50.142458 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7657c4b3-368c-491c-a2f2-fd5076c35add tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1363 microversion: 2.1 time: 0.168391 Aug 04 15:04:50.143053 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3393/6781] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:49 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:51.215375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37ca5606-9205-4e7f-bff2-706624d085e3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:51.216032 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-37ca5606-9205-4e7f-bff2-706624d085e3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:51.222769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37ca5606-9205-4e7f-bff2-706624d085e3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:51.223229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37ca5606-9205-4e7f-bff2-706624d085e3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:51.224016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37ca5606-9205-4e7f-bff2-706624d085e3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:51.224467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37ca5606-9205-4e7f-bff2-706624d085e3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:51.413212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-37ca5606-9205-4e7f-bff2-706624d085e3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:51.422363 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37ca5606-9205-4e7f-bff2-706624d085e3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1363 microversion: 2.1 time: 0.262223 Aug 04 15:04:51.423162 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3389/6782] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:51 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:04:52.386168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a57b7596-21cf-4c4d-a355-a04a87d7b3f5 req-e180b412-e3e9-4145-b9c6-24929c4b0c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "name": "network-vif-plugged", "status": "completed", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:52.397556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a57b7596-21cf-4c4d-a355-a04a87d7b3f5 req-e180b412-e3e9-4145-b9c6-24929c4b0c91 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:52.398002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a57b7596-21cf-4c4d-a355-a04a87d7b3f5 req-e180b412-e3e9-4145-b9c6-24929c4b0c91 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:52.410270 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a57b7596-21cf-4c4d-a355-a04a87d7b3f5 req-e180b412-e3e9-4145-b9c6-24929c4b0c91 service nova] Creating event network-vif-plugged:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h1-844627-10 Aug 04 15:04:52.415522 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a57b7596-21cf-4c4d-a355-a04a87d7b3f5 req-e180b412-e3e9-4145-b9c6-24929c4b0c91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033436 Aug 04 15:04:52.416070 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3394/6783] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:04:52.443890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-02ee66ea-b677-4685-b3b4-b7ddd9722d92 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:52.444532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-02ee66ea-b677-4685-b3b4-b7ddd9722d92 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:52.452480 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02ee66ea-b677-4685-b3b4-b7ddd9722d92 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:52.452978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02ee66ea-b677-4685-b3b4-b7ddd9722d92 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:52.454126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02ee66ea-b677-4685-b3b4-b7ddd9722d92 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:52.454446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-02ee66ea-b677-4685-b3b4-b7ddd9722d92 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:52.621049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-02ee66ea-b677-4685-b3b4-b7ddd9722d92 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:52.630434 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-02ee66ea-b677-4685-b3b4-b7ddd9722d92 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1363 microversion: 2.1 time: 0.190499 Aug 04 15:04:52.631030 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3390/6784] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:52 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:53.653122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e7e4c95c-00b7-4df9-ae3a-975855566155 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:53.653840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e7e4c95c-00b7-4df9-ae3a-975855566155 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:53.661075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7e4c95c-00b7-4df9-ae3a-975855566155 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:53.661533 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7e4c95c-00b7-4df9-ae3a-975855566155 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:53.662331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7e4c95c-00b7-4df9-ae3a-975855566155 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:53.662778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e7e4c95c-00b7-4df9-ae3a-975855566155 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:53.814737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e7e4c95c-00b7-4df9-ae3a-975855566155 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:53.822595 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e7e4c95c-00b7-4df9-ae3a-975855566155 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1363 microversion: 2.1 time: 0.174525 Aug 04 15:04:53.823181 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3395/6785] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:53 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:54.845600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7f920f67-fd46-4741-8859-82bf4b59856c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:54.846242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7f920f67-fd46-4741-8859-82bf4b59856c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:54.849253 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:54.850002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:54.859940 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f920f67-fd46-4741-8859-82bf4b59856c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:54.860416 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f920f67-fd46-4741-8859-82bf4b59856c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:54.861264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f920f67-fd46-4741-8859-82bf4b59856c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:54.861718 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f920f67-fd46-4741-8859-82bf4b59856c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:55.017748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7f920f67-fd46-4741-8859-82bf4b59856c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:04:55.028652 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7f920f67-fd46-4741-8859-82bf4b59856c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1549 microversion: 2.1 time: 0.187301 Aug 04 15:04:55.029220 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3391/6786] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:04:54 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:04:55.050691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5bfa641a-96cd-490c-9b6f-652e7927950a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:04:55.051489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5bfa641a-96cd-490c-9b6f-652e7927950a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:04:55.054076 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:04:55.066288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bfa641a-96cd-490c-9b6f-652e7927950a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:55.067104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bfa641a-96cd-490c-9b6f-652e7927950a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:55.068539 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bfa641a-96cd-490c-9b6f-652e7927950a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:55.069400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5bfa641a-96cd-490c-9b6f-652e7927950a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:55.185449 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5bfa641a-96cd-490c-9b6f-652e7927950a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139025 Aug 04 15:04:55.186173 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3396/6787] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 15:04:55 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:04:56.637194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-fa244b94-aa52-4428-85d8-1383221e0d63 req-80dacd81-bfc8-41e8-9e04-00d390cc732d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:04:56.658153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fa244b94-aa52-4428-85d8-1383221e0d63 req-80dacd81-bfc8-41e8-9e04-00d390cc732d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:04:56.659095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-fa244b94-aa52-4428-85d8-1383221e0d63 req-80dacd81-bfc8-41e8-9e04-00d390cc732d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:04:56.683537 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-fa244b94-aa52-4428-85d8-1383221e0d63 req-80dacd81-bfc8-41e8-9e04-00d390cc732d service nova] Creating event network-changed:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h1-844627-10 Aug 04 15:04:56.691575 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-fa244b94-aa52-4428-85d8-1383221e0d63 req-80dacd81-bfc8-41e8-9e04-00d390cc732d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062194 Aug 04 15:04:56.692209 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3392/6788] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:05:03.637431 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:05:03.638021 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:05:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:05:03.954536 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:05:03.955089 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:05:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:06:01.723461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:01.724278 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:01.728634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d50d1ef-c718-441b-aa09-ec57944e47f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:01.729359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d50d1ef-c718-441b-aa09-ec57944e47f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:01.740742 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d50d1ef-c718-441b-aa09-ec57944e47f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:01.741198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d50d1ef-c718-441b-aa09-ec57944e47f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:01.742086 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d50d1ef-c718-441b-aa09-ec57944e47f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:01.742582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d50d1ef-c718-441b-aa09-ec57944e47f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:01.884071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d50d1ef-c718-441b-aa09-ec57944e47f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:01.892529 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d50d1ef-c718-441b-aa09-ec57944e47f1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1668 microversion: 2.1 time: 0.172128 Aug 04 15:06:01.893153 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3397/6789] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:01 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:01.912936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:01.913704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:01.918357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6bbf6f76-5346-44e4-9a95-81ada7213220 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd5123b2-140e-43a8-9b18-3b35c538a9f3"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:06:01.920825 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6bbf6f76-5346-44e4-9a95-81ada7213220 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:01.930689 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bbf6f76-5346-44e4-9a95-81ada7213220 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:01.931160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bbf6f76-5346-44e4-9a95-81ada7213220 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:01.931955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bbf6f76-5346-44e4-9a95-81ada7213220 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:01.932411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bbf6f76-5346-44e4-9a95-81ada7213220 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:02.203384 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6bbf6f76-5346-44e4-9a95-81ada7213220 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292858 Aug 04 15:06:02.203999 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3393/6790] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 15:06:01 2022] POST /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:06:12.924384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:06:12.926669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:12.929258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:12.929928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:12.935802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:12.936259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:12.937071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:12.937690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:12.972646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:12.979078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Old instance type m1.heat2, new instance type m1.heat {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 15:06:12.985869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:06:12.986288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:06:12.986767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:06:12.987396 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:06:12.987903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:06:13.058131 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [eae4f481-b9f1-41c5-925b-c9770524eab3] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:06:14.065874 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [eae4f481-b9f1-41c5-925b-c9770524eab3] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 40194. Aug 04 15:06:14.069767 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cca631d2-b59b-4eac-b343-f6c45d9b9b26 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/action" status: 202 len: 0 microversion: 2.1 time: 1.149353 Aug 04 15:06:14.070539 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3398/6791] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:06:12 2022] POST /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/action => generated 0 bytes in 1151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:06:14.077013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:14.077899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:14.083395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6ce848a0-cefc-4081-997b-7ce3bb807123 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:14.084106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6ce848a0-cefc-4081-997b-7ce3bb807123 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:14.093543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ce848a0-cefc-4081-997b-7ce3bb807123 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:14.094291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ce848a0-cefc-4081-997b-7ce3bb807123 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:14.095138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ce848a0-cefc-4081-997b-7ce3bb807123 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:14.095799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6ce848a0-cefc-4081-997b-7ce3bb807123 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:14.244010 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6ce848a0-cefc-4081-997b-7ce3bb807123 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:14.253030 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6ce848a0-cefc-4081-997b-7ce3bb807123 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1723 microversion: 2.1 time: 0.177895 Aug 04 15:06:14.253799 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3394/6792] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:14 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:06:15.276890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6931f49b-9ad1-47dd-8f5b-f5796b0336ff tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:15.277496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6931f49b-9ad1-47dd-8f5b-f5796b0336ff tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:15.284831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6931f49b-9ad1-47dd-8f5b-f5796b0336ff tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:15.285315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6931f49b-9ad1-47dd-8f5b-f5796b0336ff tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:15.286198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6931f49b-9ad1-47dd-8f5b-f5796b0336ff tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:15.286560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6931f49b-9ad1-47dd-8f5b-f5796b0336ff tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:15.422242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6931f49b-9ad1-47dd-8f5b-f5796b0336ff tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:15.430913 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6931f49b-9ad1-47dd-8f5b-f5796b0336ff tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1723 microversion: 2.1 time: 0.158758 Aug 04 15:06:15.431514 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3399/6793] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:15 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:16.453076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65e27df8-f35f-448b-9993-599ca7b0aabd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:16.453608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-65e27df8-f35f-448b-9993-599ca7b0aabd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:16.460705 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65e27df8-f35f-448b-9993-599ca7b0aabd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:16.461218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65e27df8-f35f-448b-9993-599ca7b0aabd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:16.461999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65e27df8-f35f-448b-9993-599ca7b0aabd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:16.462455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65e27df8-f35f-448b-9993-599ca7b0aabd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:16.595438 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-65e27df8-f35f-448b-9993-599ca7b0aabd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:16.603724 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-65e27df8-f35f-448b-9993-599ca7b0aabd tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.154644 Aug 04 15:06:16.604293 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3395/6794] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:16 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:17.626245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-87c93d6f-d86f-4cba-bf48-ecf09d1255a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:17.626851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-87c93d6f-d86f-4cba-bf48-ecf09d1255a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:17.634243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c93d6f-d86f-4cba-bf48-ecf09d1255a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:17.634796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c93d6f-d86f-4cba-bf48-ecf09d1255a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:17.635694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c93d6f-d86f-4cba-bf48-ecf09d1255a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:17.636140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87c93d6f-d86f-4cba-bf48-ecf09d1255a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:17.768677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-87c93d6f-d86f-4cba-bf48-ecf09d1255a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:17.776686 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-87c93d6f-d86f-4cba-bf48-ecf09d1255a2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.154684 Aug 04 15:06:17.777313 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3400/6795] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:17 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:18.798520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9b742162-e81c-4da4-b576-8ebc5075b9fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:18.799148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9b742162-e81c-4da4-b576-8ebc5075b9fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:18.806967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b742162-e81c-4da4-b576-8ebc5075b9fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:18.807434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b742162-e81c-4da4-b576-8ebc5075b9fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:18.808229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b742162-e81c-4da4-b576-8ebc5075b9fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:18.808738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9b742162-e81c-4da4-b576-8ebc5075b9fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:18.939534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9b742162-e81c-4da4-b576-8ebc5075b9fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:18.947653 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9b742162-e81c-4da4-b576-8ebc5075b9fb tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.153140 Aug 04 15:06:18.948227 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3396/6796] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:18 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:19.969288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8fad0b9e-59ad-4872-abad-de36e7ff658d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:19.969941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8fad0b9e-59ad-4872-abad-de36e7ff658d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:19.977143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fad0b9e-59ad-4872-abad-de36e7ff658d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:19.977602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fad0b9e-59ad-4872-abad-de36e7ff658d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:19.978378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fad0b9e-59ad-4872-abad-de36e7ff658d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:19.978828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8fad0b9e-59ad-4872-abad-de36e7ff658d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:20.116055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8fad0b9e-59ad-4872-abad-de36e7ff658d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:20.124723 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8fad0b9e-59ad-4872-abad-de36e7ff658d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.159465 Aug 04 15:06:20.125809 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3401/6797] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:19 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:21.151944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-445573aa-427d-4e24-b902-8ac8c120585f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:21.152906 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-445573aa-427d-4e24-b902-8ac8c120585f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:21.160622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-445573aa-427d-4e24-b902-8ac8c120585f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:21.161126 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-445573aa-427d-4e24-b902-8ac8c120585f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:21.161913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-445573aa-427d-4e24-b902-8ac8c120585f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:21.162519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-445573aa-427d-4e24-b902-8ac8c120585f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:21.293561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-445573aa-427d-4e24-b902-8ac8c120585f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:21.302309 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-445573aa-427d-4e24-b902-8ac8c120585f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.156736 Aug 04 15:06:21.302889 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3397/6798] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:21 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:22.323675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-065d0bb9-b2d0-4801-b7c0-f7b8aafeecf3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:22.324297 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-065d0bb9-b2d0-4801-b7c0-f7b8aafeecf3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:22.331282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-065d0bb9-b2d0-4801-b7c0-f7b8aafeecf3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:22.331736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-065d0bb9-b2d0-4801-b7c0-f7b8aafeecf3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:22.332544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-065d0bb9-b2d0-4801-b7c0-f7b8aafeecf3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:22.333102 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-065d0bb9-b2d0-4801-b7c0-f7b8aafeecf3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:22.467737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-065d0bb9-b2d0-4801-b7c0-f7b8aafeecf3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:22.476092 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-065d0bb9-b2d0-4801-b7c0-f7b8aafeecf3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.156366 Aug 04 15:06:22.476913 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3402/6799] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:22 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:23.498394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a886f900-0fdd-40fe-83df-dd7d7194465d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:23.499025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a886f900-0fdd-40fe-83df-dd7d7194465d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:23.506346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a886f900-0fdd-40fe-83df-dd7d7194465d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:23.506821 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a886f900-0fdd-40fe-83df-dd7d7194465d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:23.509169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a886f900-0fdd-40fe-83df-dd7d7194465d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:23.509169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a886f900-0fdd-40fe-83df-dd7d7194465d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:23.648362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a886f900-0fdd-40fe-83df-dd7d7194465d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:23.656495 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a886f900-0fdd-40fe-83df-dd7d7194465d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.162127 Aug 04 15:06:23.657103 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3398/6800] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:23 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:24.678581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9ee820c-e4f0-4d87-8190-d94b8b4c915c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:24.679193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a9ee820c-e4f0-4d87-8190-d94b8b4c915c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:24.686296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9ee820c-e4f0-4d87-8190-d94b8b4c915c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:24.686741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9ee820c-e4f0-4d87-8190-d94b8b4c915c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:24.687536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9ee820c-e4f0-4d87-8190-d94b8b4c915c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:24.688008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9ee820c-e4f0-4d87-8190-d94b8b4c915c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:24.824289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a9ee820c-e4f0-4d87-8190-d94b8b4c915c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:24.832823 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a9ee820c-e4f0-4d87-8190-d94b8b4c915c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.158211 Aug 04 15:06:24.833423 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3403/6801] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:24 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:25.854081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c91957d2-f1ef-4066-8d65-dbbf92daade0 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:25.854728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c91957d2-f1ef-4066-8d65-dbbf92daade0 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:25.861741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c91957d2-f1ef-4066-8d65-dbbf92daade0 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:25.862878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c91957d2-f1ef-4066-8d65-dbbf92daade0 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:25.863704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c91957d2-f1ef-4066-8d65-dbbf92daade0 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:25.864161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c91957d2-f1ef-4066-8d65-dbbf92daade0 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:26.000258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c91957d2-f1ef-4066-8d65-dbbf92daade0 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:26.008545 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c91957d2-f1ef-4066-8d65-dbbf92daade0 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.158322 Aug 04 15:06:26.009166 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3399/6802] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:25 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:27.029750 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dfc9b801-ee23-40e8-bddd-93e92d67b16c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:27.030368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dfc9b801-ee23-40e8-bddd-93e92d67b16c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:27.037343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfc9b801-ee23-40e8-bddd-93e92d67b16c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:27.037794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfc9b801-ee23-40e8-bddd-93e92d67b16c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:27.038563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfc9b801-ee23-40e8-bddd-93e92d67b16c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:27.039000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfc9b801-ee23-40e8-bddd-93e92d67b16c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:27.173085 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dfc9b801-ee23-40e8-bddd-93e92d67b16c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:27.182603 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dfc9b801-ee23-40e8-bddd-93e92d67b16c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.156655 Aug 04 15:06:27.183228 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3404/6803] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:27 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:28.203693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-03e6ad59-53f4-4071-91a7-45ca2cdc8e32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:28.204331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-03e6ad59-53f4-4071-91a7-45ca2cdc8e32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:28.212139 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03e6ad59-53f4-4071-91a7-45ca2cdc8e32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:28.212610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03e6ad59-53f4-4071-91a7-45ca2cdc8e32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:28.213428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03e6ad59-53f4-4071-91a7-45ca2cdc8e32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:28.213888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-03e6ad59-53f4-4071-91a7-45ca2cdc8e32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:28.352668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-03e6ad59-53f4-4071-91a7-45ca2cdc8e32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:28.360799 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-03e6ad59-53f4-4071-91a7-45ca2cdc8e32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.161127 Aug 04 15:06:28.361395 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3400/6804] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:28 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:29.382485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-31b6c72d-c7ed-4227-8fa6-740f78fab9a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:29.383019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-31b6c72d-c7ed-4227-8fa6-740f78fab9a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:29.389918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31b6c72d-c7ed-4227-8fa6-740f78fab9a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:29.390370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31b6c72d-c7ed-4227-8fa6-740f78fab9a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:29.391137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31b6c72d-c7ed-4227-8fa6-740f78fab9a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:29.391579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-31b6c72d-c7ed-4227-8fa6-740f78fab9a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:29.524241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-31b6c72d-c7ed-4227-8fa6-740f78fab9a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:29.532808 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-31b6c72d-c7ed-4227-8fa6-740f78fab9a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.154749 Aug 04 15:06:29.533436 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3405/6805] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:29 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:30.557670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-581dd006-0d03-46bc-9ed6-94e120955a8d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:30.558315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-581dd006-0d03-46bc-9ed6-94e120955a8d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:30.565320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-581dd006-0d03-46bc-9ed6-94e120955a8d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:30.565797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-581dd006-0d03-46bc-9ed6-94e120955a8d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:30.567167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-581dd006-0d03-46bc-9ed6-94e120955a8d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:30.567626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-581dd006-0d03-46bc-9ed6-94e120955a8d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:30.700466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-581dd006-0d03-46bc-9ed6-94e120955a8d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:30.709126 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-581dd006-0d03-46bc-9ed6-94e120955a8d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.155474 Aug 04 15:06:30.709787 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3401/6806] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:30 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:31.731386 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7f27fb4-b4ef-4c52-a080-69cef8e8b4a6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:31.732003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7f27fb4-b4ef-4c52-a080-69cef8e8b4a6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:31.739589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7f27fb4-b4ef-4c52-a080-69cef8e8b4a6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:31.740037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7f27fb4-b4ef-4c52-a080-69cef8e8b4a6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:31.740795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7f27fb4-b4ef-4c52-a080-69cef8e8b4a6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:31.741254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7f27fb4-b4ef-4c52-a080-69cef8e8b4a6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:31.884165 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f7f27fb4-b4ef-4c52-a080-69cef8e8b4a6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:31.892416 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7f27fb4-b4ef-4c52-a080-69cef8e8b4a6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.164968 Aug 04 15:06:31.893019 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3406/6807] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:31 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:32.913774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-929d080e-8023-4363-b790-7e1a536fbad3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:32.914308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-929d080e-8023-4363-b790-7e1a536fbad3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:32.921366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-929d080e-8023-4363-b790-7e1a536fbad3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:32.921834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-929d080e-8023-4363-b790-7e1a536fbad3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:32.922615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-929d080e-8023-4363-b790-7e1a536fbad3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:32.923073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-929d080e-8023-4363-b790-7e1a536fbad3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:33.053783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-929d080e-8023-4363-b790-7e1a536fbad3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:33.065911 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-929d080e-8023-4363-b790-7e1a536fbad3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.156079 Aug 04 15:06:33.066485 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3402/6808] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:32 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:34.089335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-360d885b-2cff-487c-b7e2-08fc007e56a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:34.089985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-360d885b-2cff-487c-b7e2-08fc007e56a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:34.097741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-360d885b-2cff-487c-b7e2-08fc007e56a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:34.098260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-360d885b-2cff-487c-b7e2-08fc007e56a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:34.099544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-360d885b-2cff-487c-b7e2-08fc007e56a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:34.099985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-360d885b-2cff-487c-b7e2-08fc007e56a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:34.242438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-360d885b-2cff-487c-b7e2-08fc007e56a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:34.250865 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-360d885b-2cff-487c-b7e2-08fc007e56a8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1728 microversion: 2.1 time: 0.165450 Aug 04 15:06:34.251465 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3407/6809] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:34 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:35.272239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f40dc3d-c6fd-40d5-bd1d-6d2de2551712 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:35.272860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f40dc3d-c6fd-40d5-bd1d-6d2de2551712 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:35.280429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f40dc3d-c6fd-40d5-bd1d-6d2de2551712 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:35.281021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f40dc3d-c6fd-40d5-bd1d-6d2de2551712 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:35.281892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f40dc3d-c6fd-40d5-bd1d-6d2de2551712 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:35.282381 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f40dc3d-c6fd-40d5-bd1d-6d2de2551712 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:35.482796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f40dc3d-c6fd-40d5-bd1d-6d2de2551712 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:35.492099 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f40dc3d-c6fd-40d5-bd1d-6d2de2551712 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1727 microversion: 2.1 time: 0.223668 Aug 04 15:06:35.493152 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3403/6810] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:35 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:35.804849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-46ffe700-c1f1-4631-9bf4-776028bf8785 req-6414cbd4-a098-4e9a-a30d-9339cf7e562b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "name": "network-vif-unplugged", "status": "completed", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:06:35.816760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-46ffe700-c1f1-4631-9bf4-776028bf8785 req-6414cbd4-a098-4e9a-a30d-9339cf7e562b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:35.817380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-46ffe700-c1f1-4631-9bf4-776028bf8785 req-6414cbd4-a098-4e9a-a30d-9339cf7e562b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:35.830307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-46ffe700-c1f1-4631-9bf4-776028bf8785 req-6414cbd4-a098-4e9a-a30d-9339cf7e562b service nova] Creating event network-vif-unplugged:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h2-844627-10 Aug 04 15:06:35.836272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-46ffe700-c1f1-4631-9bf4-776028bf8785 req-6414cbd4-a098-4e9a-a30d-9339cf7e562b service nova] Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:06:35.849485 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-46ffe700-c1f1-4631-9bf4-776028bf8785 req-6414cbd4-a098-4e9a-a30d-9339cf7e562b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047489 Aug 04 15:06:35.850101 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3408/6811] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:06:36.517995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f355dbb-b98a-4ff2-b4ab-e372f659db25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:36.518753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f355dbb-b98a-4ff2-b4ab-e372f659db25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:36.526388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f355dbb-b98a-4ff2-b4ab-e372f659db25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:36.526860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f355dbb-b98a-4ff2-b4ab-e372f659db25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:36.527664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f355dbb-b98a-4ff2-b4ab-e372f659db25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:36.528120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f355dbb-b98a-4ff2-b4ab-e372f659db25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:36.800962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f355dbb-b98a-4ff2-b4ab-e372f659db25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:36.811850 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f355dbb-b98a-4ff2-b4ab-e372f659db25 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1727 microversion: 2.1 time: 0.298718 Aug 04 15:06:36.812448 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3404/6812] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:36 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1727 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:37.835582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e117a610-6746-48e5-8f0d-9ff57abf4b0c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:37.836241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e117a610-6746-48e5-8f0d-9ff57abf4b0c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:37.844334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e117a610-6746-48e5-8f0d-9ff57abf4b0c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:37.844793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e117a610-6746-48e5-8f0d-9ff57abf4b0c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:37.845612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e117a610-6746-48e5-8f0d-9ff57abf4b0c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:37.846075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e117a610-6746-48e5-8f0d-9ff57abf4b0c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:37.887222 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a9826ef6-a362-4427-b576-62bc8452e630 req-20153a89-05dc-42dd-b1db-3c232500314e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:06:37.899502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a9826ef6-a362-4427-b576-62bc8452e630 req-20153a89-05dc-42dd-b1db-3c232500314e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:37.899966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a9826ef6-a362-4427-b576-62bc8452e630 req-20153a89-05dc-42dd-b1db-3c232500314e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:37.914466 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a9826ef6-a362-4427-b576-62bc8452e630 req-20153a89-05dc-42dd-b1db-3c232500314e service nova] Creating event network-changed:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h2-844627-10 Aug 04 15:06:37.922258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-a9826ef6-a362-4427-b576-62bc8452e630 req-20153a89-05dc-42dd-b1db-3c232500314e service nova] Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:06:37.934749 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a9826ef6-a362-4427-b576-62bc8452e630 req-20153a89-05dc-42dd-b1db-3c232500314e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051173 Aug 04 15:06:37.935743 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3405/6813] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:06:38.140714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e117a610-6746-48e5-8f0d-9ff57abf4b0c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:38.154698 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e117a610-6746-48e5-8f0d-9ff57abf4b0c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1725 microversion: 2.1 time: 0.323649 Aug 04 15:06:38.156610 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3409/6814] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:37 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1725 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:39.180021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c408eef-ff25-4f3f-b1cc-5105ff733792 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:39.181075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1c408eef-ff25-4f3f-b1cc-5105ff733792 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:39.188640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c408eef-ff25-4f3f-b1cc-5105ff733792 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:39.189087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c408eef-ff25-4f3f-b1cc-5105ff733792 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:39.189933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c408eef-ff25-4f3f-b1cc-5105ff733792 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:39.190393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c408eef-ff25-4f3f-b1cc-5105ff733792 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:39.361167 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c408eef-ff25-4f3f-b1cc-5105ff733792 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:39.373619 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1c408eef-ff25-4f3f-b1cc-5105ff733792 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1725 microversion: 2.1 time: 0.199637 Aug 04 15:06:39.374239 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3406/6815] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:39 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:40.397274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4e19898f-23d4-46dd-a059-a244277abe06 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:40.398081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4e19898f-23d4-46dd-a059-a244277abe06 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:40.405266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e19898f-23d4-46dd-a059-a244277abe06 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:40.405710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e19898f-23d4-46dd-a059-a244277abe06 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:40.406492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e19898f-23d4-46dd-a059-a244277abe06 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:40.406934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e19898f-23d4-46dd-a059-a244277abe06 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:40.606463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4e19898f-23d4-46dd-a059-a244277abe06 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:40.614695 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4e19898f-23d4-46dd-a059-a244277abe06 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1725 microversion: 2.1 time: 0.222073 Aug 04 15:06:40.615472 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3410/6816] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:40 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:41.636308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2d79ad61-7e8f-4acb-ad1c-b02b98dbeff1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:41.637039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2d79ad61-7e8f-4acb-ad1c-b02b98dbeff1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:41.645070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d79ad61-7e8f-4acb-ad1c-b02b98dbeff1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:41.645552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d79ad61-7e8f-4acb-ad1c-b02b98dbeff1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:41.646360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d79ad61-7e8f-4acb-ad1c-b02b98dbeff1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:41.646819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d79ad61-7e8f-4acb-ad1c-b02b98dbeff1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:41.803136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2d79ad61-7e8f-4acb-ad1c-b02b98dbeff1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:41.811915 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2d79ad61-7e8f-4acb-ad1c-b02b98dbeff1 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1725 microversion: 2.1 time: 0.179904 Aug 04 15:06:41.825783 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3407/6817] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:41 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:42.833810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b2f36375-8a25-4348-99ec-a1b6c94f5f55 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:42.834444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b2f36375-8a25-4348-99ec-a1b6c94f5f55 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:42.842410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2f36375-8a25-4348-99ec-a1b6c94f5f55 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:42.842883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2f36375-8a25-4348-99ec-a1b6c94f5f55 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:42.843716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2f36375-8a25-4348-99ec-a1b6c94f5f55 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:42.844414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b2f36375-8a25-4348-99ec-a1b6c94f5f55 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:42.996032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b2f36375-8a25-4348-99ec-a1b6c94f5f55 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:42.998582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:43.006556 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b2f36375-8a25-4348-99ec-a1b6c94f5f55 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1725 microversion: 2.1 time: 0.176751 Aug 04 15:06:43.007178 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3411/6818] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:42 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:44.028851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f700b8cc-0381-4ecd-8f0b-d6c275f4f145 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:44.029796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f700b8cc-0381-4ecd-8f0b-d6c275f4f145 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:44.037722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f700b8cc-0381-4ecd-8f0b-d6c275f4f145 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:44.038227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f700b8cc-0381-4ecd-8f0b-d6c275f4f145 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:44.039146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f700b8cc-0381-4ecd-8f0b-d6c275f4f145 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:44.039818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f700b8cc-0381-4ecd-8f0b-d6c275f4f145 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:44.208604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f700b8cc-0381-4ecd-8f0b-d6c275f4f145 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:44.212263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=87 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:44.220402 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f700b8cc-0381-4ecd-8f0b-d6c275f4f145 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1725 microversion: 2.1 time: 0.195755 Aug 04 15:06:44.221026 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3408/6819] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:44 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:45.243360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c4b5ecd1-4706-4f4e-9d49-68b9ddaf7e3c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:45.243994 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c4b5ecd1-4706-4f4e-9d49-68b9ddaf7e3c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:45.247941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=33 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:45.256080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4b5ecd1-4706-4f4e-9d49-68b9ddaf7e3c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:45.256549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4b5ecd1-4706-4f4e-9d49-68b9ddaf7e3c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:45.257361 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4b5ecd1-4706-4f4e-9d49-68b9ddaf7e3c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:45.257798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4b5ecd1-4706-4f4e-9d49-68b9ddaf7e3c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:45.404984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c4b5ecd1-4706-4f4e-9d49-68b9ddaf7e3c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:45.413470 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c4b5ecd1-4706-4f4e-9d49-68b9ddaf7e3c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1725 microversion: 2.1 time: 0.174686 Aug 04 15:06:45.413980 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3412/6820] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:45 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:46.434790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d4e9f440-bd32-44ae-b04a-495ab2249c9d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:46.435351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d4e9f440-bd32-44ae-b04a-495ab2249c9d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:46.438415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=31 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:46.444212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e9f440-bd32-44ae-b04a-495ab2249c9d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:46.444682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e9f440-bd32-44ae-b04a-495ab2249c9d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:46.445509 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e9f440-bd32-44ae-b04a-495ab2249c9d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:46.446124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d4e9f440-bd32-44ae-b04a-495ab2249c9d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:46.590820 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d4e9f440-bd32-44ae-b04a-495ab2249c9d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:46.601356 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d4e9f440-bd32-44ae-b04a-495ab2249c9d tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1725 microversion: 2.1 time: 0.170455 Aug 04 15:06:46.602239 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3409/6821] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:46 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:47.625470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2b434237-a654-46b7-a831-c152b81220d7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:47.626081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2b434237-a654-46b7-a831-c152b81220d7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:47.633261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b434237-a654-46b7-a831-c152b81220d7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:47.633955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b434237-a654-46b7-a831-c152b81220d7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:47.635090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b434237-a654-46b7-a831-c152b81220d7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:47.635760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b434237-a654-46b7-a831-c152b81220d7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:47.794726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2b434237-a654-46b7-a831-c152b81220d7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:47.803432 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2b434237-a654-46b7-a831-c152b81220d7 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1725 microversion: 2.1 time: 0.181837 Aug 04 15:06:47.804047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3413/6822] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:47 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:48.825783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9ab34aa-6649-4d9d-bddb-0a909003c774 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:48.826420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f9ab34aa-6649-4d9d-bddb-0a909003c774 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:48.834288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9ab34aa-6649-4d9d-bddb-0a909003c774 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:48.834754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9ab34aa-6649-4d9d-bddb-0a909003c774 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:48.835558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9ab34aa-6649-4d9d-bddb-0a909003c774 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:48.836008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f9ab34aa-6649-4d9d-bddb-0a909003c774 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:48.980449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f9ab34aa-6649-4d9d-bddb-0a909003c774 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:48.990011 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f9ab34aa-6649-4d9d-bddb-0a909003c774 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1722 microversion: 2.1 time: 0.167305 Aug 04 15:06:48.990526 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3410/6823] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:48 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:49.011314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:06:49.011886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:49.019451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:49.019893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:49.020680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:49.021146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:49.062307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:49.062752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:49.063540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:49.063978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:49.085670 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:06:49.091507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Getting quotas for user 35f4358920e5413484e70ee52fb8fdee and project 48f20653eeda4766ade302734491bacd. Resources: {'ram', 'cores'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:06:49.210229 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a51f4c77-f4cd-4701-9b74-22d38c170c27 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "POST /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/action" status: 202 len: 0 microversion: 2.1 time: 0.202796 Aug 04 15:06:49.210877 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3414/6824] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:06:49 2022] POST /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:06:49.221160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c749bf2-2ded-442d-8001-8e3bd4bd817c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:49.221807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1c749bf2-2ded-442d-8001-8e3bd4bd817c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:49.229735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c749bf2-2ded-442d-8001-8e3bd4bd817c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:49.230245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c749bf2-2ded-442d-8001-8e3bd4bd817c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:49.231114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c749bf2-2ded-442d-8001-8e3bd4bd817c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:49.231703 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c749bf2-2ded-442d-8001-8e3bd4bd817c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:49.433624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c749bf2-2ded-442d-8001-8e3bd4bd817c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:49.442098 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1c749bf2-2ded-442d-8001-8e3bd4bd817c tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.226640 Aug 04 15:06:49.442834 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3411/6825] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:49 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:50.465039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e1548cbc-4141-43b8-a1fd-5250e317f2b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:50.465691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e1548cbc-4141-43b8-a1fd-5250e317f2b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:50.473251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1548cbc-4141-43b8-a1fd-5250e317f2b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:50.474183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1548cbc-4141-43b8-a1fd-5250e317f2b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:50.474950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1548cbc-4141-43b8-a1fd-5250e317f2b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:50.475381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e1548cbc-4141-43b8-a1fd-5250e317f2b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:50.617193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e1548cbc-4141-43b8-a1fd-5250e317f2b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:50.625527 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e1548cbc-4141-43b8-a1fd-5250e317f2b5 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.165782 Aug 04 15:06:50.626331 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3415/6826] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:50 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:06:51.646543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-661d25dd-a4e8-4a3b-bded-d15cb61f4a6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:51.647349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-661d25dd-a4e8-4a3b-bded-d15cb61f4a6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:51.657790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-661d25dd-a4e8-4a3b-bded-d15cb61f4a6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:51.658254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-661d25dd-a4e8-4a3b-bded-d15cb61f4a6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:51.659037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-661d25dd-a4e8-4a3b-bded-d15cb61f4a6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:51.659495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-661d25dd-a4e8-4a3b-bded-d15cb61f4a6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:51.796166 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-661d25dd-a4e8-4a3b-bded-d15cb61f4a6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:51.804915 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-661d25dd-a4e8-4a3b-bded-d15cb61f4a6e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.162218 Aug 04 15:06:51.805500 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3412/6827] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:51 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:52.324486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a9e99ab9-7c89-4371-ba0c-c701ddca555d req-c87568a6-f1ee-4c27-807e-a3702b09de81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "name": "network-vif-plugged", "status": "completed", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:06:52.336266 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a9e99ab9-7c89-4371-ba0c-c701ddca555d req-c87568a6-f1ee-4c27-807e-a3702b09de81 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:52.336816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a9e99ab9-7c89-4371-ba0c-c701ddca555d req-c87568a6-f1ee-4c27-807e-a3702b09de81 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:52.352345 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a9e99ab9-7c89-4371-ba0c-c701ddca555d req-c87568a6-f1ee-4c27-807e-a3702b09de81 service nova] Creating event network-vif-plugged:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h2-844627-10 Aug 04 15:06:52.358909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-a9e99ab9-7c89-4371-ba0c-c701ddca555d req-c87568a6-f1ee-4c27-807e-a3702b09de81 service nova] Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:06:52.369833 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a9e99ab9-7c89-4371-ba0c-c701ddca555d req-c87568a6-f1ee-4c27-807e-a3702b09de81 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049969 Aug 04 15:06:52.370552 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3416/6828] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:06:52.827571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-86c60b92-0943-4dce-84d7-0d29f92e181f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:52.828351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-86c60b92-0943-4dce-84d7-0d29f92e181f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:52.836449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86c60b92-0943-4dce-84d7-0d29f92e181f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:52.836952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86c60b92-0943-4dce-84d7-0d29f92e181f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:52.837768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86c60b92-0943-4dce-84d7-0d29f92e181f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:52.838224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86c60b92-0943-4dce-84d7-0d29f92e181f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:52.979303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-86c60b92-0943-4dce-84d7-0d29f92e181f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:52.988765 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-86c60b92-0943-4dce-84d7-0d29f92e181f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.165208 Aug 04 15:06:52.989376 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3413/6829] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:52 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:54.011766 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b40bd9ee-bc2f-4040-8135-932f1ead5166 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:54.012460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b40bd9ee-bc2f-4040-8135-932f1ead5166 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:54.019730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b40bd9ee-bc2f-4040-8135-932f1ead5166 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:54.020178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b40bd9ee-bc2f-4040-8135-932f1ead5166 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:54.021471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b40bd9ee-bc2f-4040-8135-932f1ead5166 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:54.021906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b40bd9ee-bc2f-4040-8135-932f1ead5166 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:54.173886 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b40bd9ee-bc2f-4040-8135-932f1ead5166 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:54.182539 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b40bd9ee-bc2f-4040-8135-932f1ead5166 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.175760 Aug 04 15:06:54.183135 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3417/6830] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:54 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:54.876408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-4de7b902-df1f-47ad-a188-b000a7ae9fd4 req-9e5f5d36-71f4-4e39-8e20-ca6b10741659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "name": "network-vif-unplugged", "status": "completed", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:06:54.886626 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4de7b902-df1f-47ad-a188-b000a7ae9fd4 req-9e5f5d36-71f4-4e39-8e20-ca6b10741659 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:54.887088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-4de7b902-df1f-47ad-a188-b000a7ae9fd4 req-9e5f5d36-71f4-4e39-8e20-ca6b10741659 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:54.899581 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-4de7b902-df1f-47ad-a188-b000a7ae9fd4 req-9e5f5d36-71f4-4e39-8e20-ca6b10741659 service nova] Creating event network-vif-unplugged:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h1-844627-10 Aug 04 15:06:54.905592 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [req-4de7b902-df1f-47ad-a188-b000a7ae9fd4 req-9e5f5d36-71f4-4e39-8e20-ca6b10741659 service nova] Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130961) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:06:54.918472 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-4de7b902-df1f-47ad-a188-b000a7ae9fd4 req-9e5f5d36-71f4-4e39-8e20-ca6b10741659 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097963 Aug 04 15:06:54.919827 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3414/6831] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:06:55.204893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-07addecf-1e74-4072-a6a5-5d822ed2cf72 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:55.205512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-07addecf-1e74-4072-a6a5-5d822ed2cf72 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:55.213234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07addecf-1e74-4072-a6a5-5d822ed2cf72 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:55.213701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07addecf-1e74-4072-a6a5-5d822ed2cf72 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:55.215246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07addecf-1e74-4072-a6a5-5d822ed2cf72 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:55.215696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07addecf-1e74-4072-a6a5-5d822ed2cf72 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:55.464433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-07addecf-1e74-4072-a6a5-5d822ed2cf72 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:55.473422 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-07addecf-1e74-4072-a6a5-5d822ed2cf72 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.272654 Aug 04 15:06:55.474018 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3418/6832] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:55 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:56.498058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-095cab2a-9d84-4e68-8b40-1cc13c988465 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:56.498818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-095cab2a-9d84-4e68-8b40-1cc13c988465 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:56.506060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-095cab2a-9d84-4e68-8b40-1cc13c988465 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:56.506545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-095cab2a-9d84-4e68-8b40-1cc13c988465 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:56.507356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-095cab2a-9d84-4e68-8b40-1cc13c988465 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:56.507813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-095cab2a-9d84-4e68-8b40-1cc13c988465 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:56.652967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-095cab2a-9d84-4e68-8b40-1cc13c988465 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:56.663033 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-095cab2a-9d84-4e68-8b40-1cc13c988465 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.170331 Aug 04 15:06:56.663753 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3415/6833] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:56 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:56.934312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-5990091d-b187-4395-b6d9-7de5b9075c7c req-701e84d2-16ef-4d7c-9a45-4592212bda6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:06:56.945107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5990091d-b187-4395-b6d9-7de5b9075c7c req-701e84d2-16ef-4d7c-9a45-4592212bda6a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:56.945551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-5990091d-b187-4395-b6d9-7de5b9075c7c req-701e84d2-16ef-4d7c-9a45-4592212bda6a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:56.957523 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-5990091d-b187-4395-b6d9-7de5b9075c7c req-701e84d2-16ef-4d7c-9a45-4592212bda6a service nova] Creating event network-changed:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h1-844627-10 Aug 04 15:06:56.963972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-5990091d-b187-4395-b6d9-7de5b9075c7c req-701e84d2-16ef-4d7c-9a45-4592212bda6a service nova] Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:06:56.976645 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-5990091d-b187-4395-b6d9-7de5b9075c7c req-701e84d2-16ef-4d7c-9a45-4592212bda6a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045739 Aug 04 15:06:56.977304 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3419/6834] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:06:57.687523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-86bec031-2118-4f7d-a94d-8a180301fd7f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:57.689977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-86bec031-2118-4f7d-a94d-8a180301fd7f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:57.700014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86bec031-2118-4f7d-a94d-8a180301fd7f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:57.701272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86bec031-2118-4f7d-a94d-8a180301fd7f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:57.702578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86bec031-2118-4f7d-a94d-8a180301fd7f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:57.703054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-86bec031-2118-4f7d-a94d-8a180301fd7f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:57.983078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-86bec031-2118-4f7d-a94d-8a180301fd7f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:57.995201 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-86bec031-2118-4f7d-a94d-8a180301fd7f tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.314311 Aug 04 15:06:57.996314 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3416/6835] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:57 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:06:59.020610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e28e67ee-e0f3-4ffe-a421-df68fdc5111e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:06:59.021341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e28e67ee-e0f3-4ffe-a421-df68fdc5111e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:06:59.033929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e28e67ee-e0f3-4ffe-a421-df68fdc5111e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:59.034673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e28e67ee-e0f3-4ffe-a421-df68fdc5111e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:59.036514 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e28e67ee-e0f3-4ffe-a421-df68fdc5111e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:06:59.037309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e28e67ee-e0f3-4ffe-a421-df68fdc5111e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:06:59.077725 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:06:59.200960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e28e67ee-e0f3-4ffe-a421-df68fdc5111e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:06:59.209470 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e28e67ee-e0f3-4ffe-a421-df68fdc5111e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.194908 Aug 04 15:06:59.210484 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3420/6836] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:06:59 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:00.231473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-06dedf88-3bec-46a2-958e-7ea0159b01d8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:00.232133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-06dedf88-3bec-46a2-958e-7ea0159b01d8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:00.239748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-06dedf88-3bec-46a2-958e-7ea0159b01d8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:00.240214 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-06dedf88-3bec-46a2-958e-7ea0159b01d8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:00.241115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-06dedf88-3bec-46a2-958e-7ea0159b01d8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:00.241568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-06dedf88-3bec-46a2-958e-7ea0159b01d8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:00.394379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-06dedf88-3bec-46a2-958e-7ea0159b01d8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:00.403794 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-06dedf88-3bec-46a2-958e-7ea0159b01d8 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.176130 Aug 04 15:07:00.404396 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3417/6837] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:00 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:07:01.426875 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c0d9694-e8a2-4579-a083-48fc631d9303 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:01.427429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3c0d9694-e8a2-4579-a083-48fc631d9303 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:01.436309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c0d9694-e8a2-4579-a083-48fc631d9303 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:01.436968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c0d9694-e8a2-4579-a083-48fc631d9303 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:01.437997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c0d9694-e8a2-4579-a083-48fc631d9303 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:01.438185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c0d9694-e8a2-4579-a083-48fc631d9303 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:01.574903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c0d9694-e8a2-4579-a083-48fc631d9303 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:01.582930 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c0d9694-e8a2-4579-a083-48fc631d9303 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.160139 Aug 04 15:07:01.583516 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3421/6838] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:01 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:02.605211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0e03e704-555c-42ce-8a77-c769135ce16a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:02.606104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0e03e704-555c-42ce-8a77-c769135ce16a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:02.618470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e03e704-555c-42ce-8a77-c769135ce16a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:02.618948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e03e704-555c-42ce-8a77-c769135ce16a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:02.619764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e03e704-555c-42ce-8a77-c769135ce16a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:02.620242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0e03e704-555c-42ce-8a77-c769135ce16a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:02.766902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0e03e704-555c-42ce-8a77-c769135ce16a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:02.775712 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0e03e704-555c-42ce-8a77-c769135ce16a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.174584 Aug 04 15:07:02.776372 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3418/6839] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:02 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:03.797756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7c8d3ac8-13e3-4615-a426-3eabe502ea04 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:03.798373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7c8d3ac8-13e3-4615-a426-3eabe502ea04 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:03.806391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c8d3ac8-13e3-4615-a426-3eabe502ea04 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:03.806843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c8d3ac8-13e3-4615-a426-3eabe502ea04 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:03.807621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c8d3ac8-13e3-4615-a426-3eabe502ea04 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:03.808063 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7c8d3ac8-13e3-4615-a426-3eabe502ea04 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:03.950130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7c8d3ac8-13e3-4615-a426-3eabe502ea04 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:03.958556 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7c8d3ac8-13e3-4615-a426-3eabe502ea04 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.164678 Aug 04 15:07:03.959315 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3422/6840] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:03 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:04.981038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dedd2a50-2c3d-48fe-89d0-1e7d28f8aa63 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:04.981674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dedd2a50-2c3d-48fe-89d0-1e7d28f8aa63 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:04.988919 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dedd2a50-2c3d-48fe-89d0-1e7d28f8aa63 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:04.989393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dedd2a50-2c3d-48fe-89d0-1e7d28f8aa63 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:04.990674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dedd2a50-2c3d-48fe-89d0-1e7d28f8aa63 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:04.991132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dedd2a50-2c3d-48fe-89d0-1e7d28f8aa63 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:05.128062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dedd2a50-2c3d-48fe-89d0-1e7d28f8aa63 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:05.136574 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dedd2a50-2c3d-48fe-89d0-1e7d28f8aa63 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.159586 Aug 04 15:07:05.137177 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3419/6841] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:04 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:06.158115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4b597809-c7d5-4b6c-bbe1-9ab42aa181c4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:06.158733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4b597809-c7d5-4b6c-bbe1-9ab42aa181c4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:06.165992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b597809-c7d5-4b6c-bbe1-9ab42aa181c4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:06.166451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b597809-c7d5-4b6c-bbe1-9ab42aa181c4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:06.167240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b597809-c7d5-4b6c-bbe1-9ab42aa181c4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:06.167687 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b597809-c7d5-4b6c-bbe1-9ab42aa181c4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:06.322992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4b597809-c7d5-4b6c-bbe1-9ab42aa181c4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:06.331150 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4b597809-c7d5-4b6c-bbe1-9ab42aa181c4 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.177010 Aug 04 15:07:06.331731 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3423/6842] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:06 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:07.354142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-65bb70b1-c0ca-47cc-a7c2-310062024389 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:07.354769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-65bb70b1-c0ca-47cc-a7c2-310062024389 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:07.362327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65bb70b1-c0ca-47cc-a7c2-310062024389 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:07.362713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65bb70b1-c0ca-47cc-a7c2-310062024389 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:07.363526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65bb70b1-c0ca-47cc-a7c2-310062024389 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:07.363983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-65bb70b1-c0ca-47cc-a7c2-310062024389 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:07.502639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-65bb70b1-c0ca-47cc-a7c2-310062024389 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:07.511363 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-65bb70b1-c0ca-47cc-a7c2-310062024389 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.161699 Aug 04 15:07:07.511950 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3420/6843] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:07 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:08.533409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca1691ef-2066-401e-81eb-12e1959f9804 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:08.534024 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ca1691ef-2066-401e-81eb-12e1959f9804 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:08.541182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca1691ef-2066-401e-81eb-12e1959f9804 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:08.541634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca1691ef-2066-401e-81eb-12e1959f9804 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:08.542412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca1691ef-2066-401e-81eb-12e1959f9804 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:08.542848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca1691ef-2066-401e-81eb-12e1959f9804 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:08.680947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ca1691ef-2066-401e-81eb-12e1959f9804 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:08.688997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca1691ef-2066-401e-81eb-12e1959f9804 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1721 microversion: 2.1 time: 0.159732 Aug 04 15:07:08.689586 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3424/6844] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:08 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:09.710693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6f31b452-117d-4a01-94df-04e0754d5a32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:09.711264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6f31b452-117d-4a01-94df-04e0754d5a32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:09.717610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f31b452-117d-4a01-94df-04e0754d5a32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:09.718077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f31b452-117d-4a01-94df-04e0754d5a32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:09.718881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f31b452-117d-4a01-94df-04e0754d5a32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:09.719378 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6f31b452-117d-4a01-94df-04e0754d5a32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:09.856573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6f31b452-117d-4a01-94df-04e0754d5a32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:09.864793 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6f31b452-117d-4a01-94df-04e0754d5a32 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1714 microversion: 2.1 time: 0.158509 Aug 04 15:07:09.866081 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3421/6845] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:09 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:09.885691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b87085aa-19f7-49f0-8ae6-42a525d2d276 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:09.886461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b87085aa-19f7-49f0-8ae6-42a525d2d276 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:09.893789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b87085aa-19f7-49f0-8ae6-42a525d2d276 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:09.894225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b87085aa-19f7-49f0-8ae6-42a525d2d276 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:09.895012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b87085aa-19f7-49f0-8ae6-42a525d2d276 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:09.895481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b87085aa-19f7-49f0-8ae6-42a525d2d276 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:10.031586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b87085aa-19f7-49f0-8ae6-42a525d2d276 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:10.040784 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b87085aa-19f7-49f0-8ae6-42a525d2d276 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1714 microversion: 2.1 time: 0.158918 Aug 04 15:07:10.041417 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3425/6846] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:09 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:10.062038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ba979fdf-8208-423d-9ce4-0281a3bed162 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:10.062659 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ba979fdf-8208-423d-9ce4-0281a3bed162 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:10.069310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba979fdf-8208-423d-9ce4-0281a3bed162 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:10.069778 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba979fdf-8208-423d-9ce4-0281a3bed162 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:10.070572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba979fdf-8208-423d-9ce4-0281a3bed162 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:10.071070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ba979fdf-8208-423d-9ce4-0281a3bed162 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:10.211454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ba979fdf-8208-423d-9ce4-0281a3bed162 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:10.219933 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ba979fdf-8208-423d-9ce4-0281a3bed162 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1714 microversion: 2.1 time: 0.161626 Aug 04 15:07:10.220514 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3422/6847] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:10 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:07:10.240346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6ff3c49d-6cae-4f34-9d68-293d0eb021da tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:10.240795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6ff3c49d-6cae-4f34-9d68-293d0eb021da tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:10.246797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ff3c49d-6cae-4f34-9d68-293d0eb021da tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:10.247244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ff3c49d-6cae-4f34-9d68-293d0eb021da tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:10.248003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ff3c49d-6cae-4f34-9d68-293d0eb021da tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:10.248440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ff3c49d-6cae-4f34-9d68-293d0eb021da tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:10.250992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:10.275912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6ff3c49d-6cae-4f34-9d68-293d0eb021da tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:07:10.353557 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6ff3c49d-6cae-4f34-9d68-293d0eb021da tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 204 len: 0 microversion: 2.1 time: 0.116786 Aug 04 15:07:10.354163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3426/6848] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:07:10 2022] DELETE /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:07:10.362621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-938f6bfa-8bb8-40ad-956a-538a579fda4a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:10.363260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-938f6bfa-8bb8-40ad-956a-538a579fda4a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:10.369587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-938f6bfa-8bb8-40ad-956a-538a579fda4a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:10.370054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-938f6bfa-8bb8-40ad-956a-538a579fda4a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:10.370840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-938f6bfa-8bb8-40ad-956a-538a579fda4a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:10.371297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-938f6bfa-8bb8-40ad-956a-538a579fda4a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:10.500907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-938f6bfa-8bb8-40ad-956a-538a579fda4a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:10.509574 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-938f6bfa-8bb8-40ad-956a-538a579fda4a tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1720 microversion: 2.1 time: 0.150377 Aug 04 15:07:10.510161 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3423/6849] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:10 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:07:10.977751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-759647a2-a98f-49e5-9f9a-258e7fe563d0 req-8561e6e2-8afc-4414-b667-27eb1854fa93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "name": "network-vif-plugged", "status": "completed", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:10.989779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-759647a2-a98f-49e5-9f9a-258e7fe563d0 req-8561e6e2-8afc-4414-b667-27eb1854fa93 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:10.990708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-759647a2-a98f-49e5-9f9a-258e7fe563d0 req-8561e6e2-8afc-4414-b667-27eb1854fa93 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:11.001754 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-759647a2-a98f-49e5-9f9a-258e7fe563d0 req-8561e6e2-8afc-4414-b667-27eb1854fa93 service nova] Creating event network-vif-plugged:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h1-844627-10 Aug 04 15:07:11.007435 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-759647a2-a98f-49e5-9f9a-258e7fe563d0 req-8561e6e2-8afc-4414-b667-27eb1854fa93 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034618 Aug 04 15:07:11.008054 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3427/6850] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:07:11.532302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9d323209-7940-461f-89e0-2b31251efae3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:11.532965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9d323209-7940-461f-89e0-2b31251efae3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:11.540587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d323209-7940-461f-89e0-2b31251efae3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:11.541084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d323209-7940-461f-89e0-2b31251efae3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:11.541871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d323209-7940-461f-89e0-2b31251efae3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:11.542331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9d323209-7940-461f-89e0-2b31251efae3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:11.672138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9d323209-7940-461f-89e0-2b31251efae3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:11.680769 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9d323209-7940-461f-89e0-2b31251efae3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1720 microversion: 2.1 time: 0.152730 Aug 04 15:07:11.681364 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3424/6851] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:11 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:12.714065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-946a9bea-7460-4608-acb0-bfd800db7253 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:12.714689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-946a9bea-7460-4608-acb0-bfd800db7253 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:12.721330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-946a9bea-7460-4608-acb0-bfd800db7253 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:12.721979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-946a9bea-7460-4608-acb0-bfd800db7253 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:12.722727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-946a9bea-7460-4608-acb0-bfd800db7253 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:12.723164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-946a9bea-7460-4608-acb0-bfd800db7253 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:12.951790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-946a9bea-7460-4608-acb0-bfd800db7253 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:12.960080 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-946a9bea-7460-4608-acb0-bfd800db7253 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1720 microversion: 2.1 time: 0.260621 Aug 04 15:07:12.960686 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3428/6852] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:12 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1720 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:13.344354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0320d071-72c3-4d1f-9449-2efa863fcf73 req-6204eaef-4ef0-4b68-88d9-99593f1a4b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5", "name": "network-vif-deleted", "tag": "001f0b55-5b56-4a57-9dde-fca44f16cd67"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:13.358475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0320d071-72c3-4d1f-9449-2efa863fcf73 req-6204eaef-4ef0-4b68-88d9-99593f1a4b58 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:13.358941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0320d071-72c3-4d1f-9449-2efa863fcf73 req-6204eaef-4ef0-4b68-88d9-99593f1a4b58 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:13.373035 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0320d071-72c3-4d1f-9449-2efa863fcf73 req-6204eaef-4ef0-4b68-88d9-99593f1a4b58 service nova] Creating event network-vif-deleted:001f0b55-5b56-4a57-9dde-fca44f16cd67 for instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 on n-h1-844627-10 Aug 04 15:07:13.379536 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0320d071-72c3-4d1f-9449-2efa863fcf73 req-6204eaef-4ef0-4b68-88d9-99593f1a4b58 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038929 Aug 04 15:07:13.380475 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3425/6853] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:07:13.984375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df643072-dd60-4015-9df0-737a19330c08 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:13.985840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df643072-dd60-4015-9df0-737a19330c08 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:13.998357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df643072-dd60-4015-9df0-737a19330c08 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:13.998810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df643072-dd60-4015-9df0-737a19330c08 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:13.999582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df643072-dd60-4015-9df0-737a19330c08 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:14.000017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df643072-dd60-4015-9df0-737a19330c08 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:14.081774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df643072-dd60-4015-9df0-737a19330c08 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:14.091309 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df643072-dd60-4015-9df0-737a19330c08 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1368 microversion: 2.1 time: 0.111593 Aug 04 15:07:14.107172 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3429/6854] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:13 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1368 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:15.115843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7c4154b3-b167-4a90-b856-493e8990751e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:15.116489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7c4154b3-b167-4a90-b856-493e8990751e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:15.123670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c4154b3-b167-4a90-b856-493e8990751e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:15.124141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c4154b3-b167-4a90-b856-493e8990751e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:15.124987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c4154b3-b167-4a90-b856-493e8990751e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:15.125442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7c4154b3-b167-4a90-b856-493e8990751e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:15.144238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=100 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:15.203084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7c4154b3-b167-4a90-b856-493e8990751e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:15.216006 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7c4154b3-b167-4a90-b856-493e8990751e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1368 microversion: 2.1 time: 0.106040 Aug 04 15:07:15.216738 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3426/6855] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:15 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:16.237553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5124af35-b57a-4836-9d66-af449e729e84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:16.238178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5124af35-b57a-4836-9d66-af449e729e84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:16.241095 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:16.246937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5124af35-b57a-4836-9d66-af449e729e84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:16.247388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5124af35-b57a-4836-9d66-af449e729e84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:16.248171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5124af35-b57a-4836-9d66-af449e729e84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:16.248608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5124af35-b57a-4836-9d66-af449e729e84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:16.321073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5124af35-b57a-4836-9d66-af449e729e84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:16.334876 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5124af35-b57a-4836-9d66-af449e729e84 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1368 microversion: 2.1 time: 0.101237 Aug 04 15:07:16.335462 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3430/6856] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:16 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:17.358551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7f7d07a5-2b9a-4624-a45d-8c3083c668be tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:17.359292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7f7d07a5-2b9a-4624-a45d-8c3083c668be tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:17.362233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=36 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:17.369273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f7d07a5-2b9a-4624-a45d-8c3083c668be tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:17.369783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f7d07a5-2b9a-4624-a45d-8c3083c668be tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:17.370639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f7d07a5-2b9a-4624-a45d-8c3083c668be tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:17.371469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7f7d07a5-2b9a-4624-a45d-8c3083c668be tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:17.448398 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7f7d07a5-2b9a-4624-a45d-8c3083c668be tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f4358920e5413484e70ee52fb8fdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48f20653eeda4766ade302734491bacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:17.457184 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7f7d07a5-2b9a-4624-a45d-8c3083c668be tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 200 len: 1368 microversion: 2.1 time: 0.102550 Aug 04 15:07:17.457938 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3427/6857] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:17 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:18.478393 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:18.479048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:18.487910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:18.487910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:18.488184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:18.488472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:18.504280 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 HTTP/1.1 Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5'} Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:18.505983 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-97a97722-b729-413c-be34-341b2be30583 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 404 len: 111 microversion: 2.1 time: 0.033631 Aug 04 15:07:18.511757 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3431/6858] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:18 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:18.573777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:18.576104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:18.583554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:18.584020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:18.584861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:18.585346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:18.599541 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/os-volume_attachments HTTP/1.1 Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': '9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5'} Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:18.601407 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f28243b-1f1a-4054-9ab7-920084834a05 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033984 Aug 04 15:07:18.605434 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3428/6859] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:07:18 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:22.026688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:22.027375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:22.035420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.035865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.036656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.037127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.054217 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 HTTP/1.1 Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5'} Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:22.055816 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d8d99553-af6a-435c-93e9-96ef2ce1b5b3 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 404 len: 111 microversion: 2.1 time: 0.034806 Aug 04 15:07:22.064056 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3432/6860] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:07:22 2022] DELETE /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:22.071598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:22.072262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:22.080308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.080783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.081652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.082109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.097626 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 HTTP/1.1 Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5'} Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.099221 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance 9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-18b4018f-c36e-465a-b05c-f13057974670 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5" status: 404 len: 111 microversion: 2.1 time: 0.038673 Aug 04 15:07:22.106951 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3429/6861] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:22 2022] GET /compute/v2.1/servers/9d3a69ff-f3a7-4bac-9a23-e669b7e3a2b5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:22.111660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:22.112191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:22.121719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.122454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.123646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.124349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.147882 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 HTTP/1.1 Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '345984cb-fb51-40a7-81ef-bfd89eb81a28'} Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:22.149785 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4bc586e3-3ae4-4a9f-9153-61da9d9d2eea tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 404 len: 111 microversion: 2.1 time: 0.044757 Aug 04 15:07:22.153951 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3433/6862] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:07:22 2022] DELETE /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:22.163244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:22.163901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: 345984cb-fb51-40a7-81ef-bfd89eb81a28] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:22.170658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.171164 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.172096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.172615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.189277 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 HTTP/1.1 Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '345984cb-fb51-40a7-81ef-bfd89eb81a28'} Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.190993 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance 345984cb-fb51-40a7-81ef-bfd89eb81a28 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-abfb0f27-ce7a-4e48-be0d-c987f84a9ae6 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28" status: 404 len: 111 microversion: 2.1 time: 0.034364 Aug 04 15:07:22.195303 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3430/6863] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:22 2022] GET /compute/v2.1/servers/345984cb-fb51-40a7-81ef-bfd89eb81a28 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:22.201849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:22.202352 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:22.208755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.209240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.210535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.210982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.226363 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 HTTP/1.1 Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'b43dac9e-93ae-42de-86d5-cdcb591d9830'} Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:22.227931 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a19618bd-1a3b-4358-b267-722932689e4e tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 404 len: 111 microversion: 2.1 time: 0.031512 Aug 04 15:07:22.232227 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3434/6864] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:07:22 2022] DELETE /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:22.238068 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:22.238702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: b43dac9e-93ae-42de-86d5-cdcb591d9830] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:22.245847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.246321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.247127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.247588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.264266 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 HTTP/1.1 Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'b43dac9e-93ae-42de-86d5-cdcb591d9830'} Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.265869 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance b43dac9e-93ae-42de-86d5-cdcb591d9830 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-409be0c6-dedc-4012-b9b1-31c552c416d2 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830" status: 404 len: 111 microversion: 2.1 time: 0.033257 Aug 04 15:07:22.272664 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3431/6865] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:22 2022] GET /compute/v2.1/servers/b43dac9e-93ae-42de-86d5-cdcb591d9830 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:22.276967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:22.277488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:22.288251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.289295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.290937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.291839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.313222 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e HTTP/1.1 Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'ffcb832b-77b1-4a31-844f-d9a0b54a8d2e'} Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:22.314941 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5521513d-34bf-4712-9c31-f2291e4b1619 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 404 len: 111 microversion: 2.1 time: 0.043279 Aug 04 15:07:22.321903 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3435/6866] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:07:22 2022] DELETE /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 15:07:22.326995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:22.327831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] [instance: ffcb832b-77b1-4a31-844f-d9a0b54a8d2e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:22.337065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.337621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.338702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:22.339187 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:22.357875 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] HTTP exception thrown: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Request method failure captured: Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e HTTP/1.1 Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi697m-_KNfkcUVm3kmlStPxrnF3tsWpio9rwrvfYTgtEbuCvgwhtJ3WnhAKDE9lgr5BTkc9B7rsBQtq6imdzoLkMBs8YOauJK6KWELPDTsqvb87I7lAUxGbvY3L_looHn-dynWwHsT3okiVcxrwEqKB4UjQ4M9OPOqM0P2MG3PR--4k4 Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_48f20653eeda4766ade302734491bacd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/48f20653eeda4766ade302734491bacd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/48f20653eeda4766ade302734491bacd"}]}] Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 48f20653eeda4766ade302734491bacd Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065342508 Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 35f4358920e5413484e70ee52fb8fdee Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServerActionsTestJSON-2065342508-project Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'ffcb832b-77b1-4a31-844f-d9a0b54a8d2e'} Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:22.359701 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Returning 404 to user: Instance ffcb832b-77b1-4a31-844f-d9a0b54a8d2e could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-df321b6d-1752-4bac-8e42-fdc50ad48b79 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e" status: 404 len: 111 microversion: 2.1 time: 0.039781 Aug 04 15:07:22.365686 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3432/6867] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:22 2022] GET /compute/v2.1/servers/ffcb832b-77b1-4a31-844f-d9a0b54a8d2e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:22.372431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0f5c5347-27f7-4582-bdb6-3ee6c01cf231 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] Calling method '.version_select at 0x7f46f2dd4ca0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:22.402846 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0f5c5347-27f7-4582-bdb6-3ee6c01cf231 tempest-ServerActionsTestJSON-2065342508 tempest-ServerActionsTestJSON-2065342508-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-60970359" status: 202 len: 0 microversion: 2.1 time: 0.035267 Aug 04 15:07:22.403437 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3436/6868] 10.222.0.66 () {58 vars in 1215 bytes} [Thu Aug 4 15:07:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-60970359 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:07:32.659200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=11 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:32.660607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=19 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:32.799045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-145161927", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "6d82db0d-9f45-4236-adec-80ea46cae7da"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:32.856833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] validate_networks() for [('6d82db0d-9f45-4236-adec-80ea46cae7da', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:07:33.243138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:07:33.243588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:07:33.244080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:07:33.244533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:07:33.244992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:07:33.254363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:33.254889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:33.255645 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:33.256098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:33.273892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Getting quotas for project b627e5e46f664e21ba36cbc583de6924. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:07:33.279288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Getting quotas for user 65df928dfb63499383d1d6032ffa97e4 and project b627e5e46f664e21ba36cbc583de6924. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:07:33.291758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:07:33.294117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:07:33.342321 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f100d042-3ffe-4bf0-8a8a-c5d50c85890a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688299 Aug 04 15:07:33.343128 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3433/6869] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:07:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:07:33.352258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:33.353067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:33.359609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6e54c375-9604-412e-aede-af73fa0acdff tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:33.360584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6e54c375-9604-412e-aede-af73fa0acdff tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:33.424635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6e54c375-9604-412e-aede-af73fa0acdff tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:33.433083 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6e54c375-9604-412e-aede-af73fa0acdff tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1216 microversion: 2.1 time: 0.082423 Aug 04 15:07:33.433913 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3437/6870] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:33 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:34.455826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-53170741-7043-4e0b-ae71-df4320b16026 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:34.456525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-53170741-7043-4e0b-ae71-df4320b16026 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:34.469475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53170741-7043-4e0b-ae71-df4320b16026 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:34.469946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53170741-7043-4e0b-ae71-df4320b16026 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:34.471058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53170741-7043-4e0b-ae71-df4320b16026 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:34.471561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-53170741-7043-4e0b-ae71-df4320b16026 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:34.564610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-53170741-7043-4e0b-ae71-df4320b16026 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:34.575779 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-53170741-7043-4e0b-ae71-df4320b16026 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1276 microversion: 2.1 time: 0.123824 Aug 04 15:07:34.576365 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3434/6871] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:34 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:35.598324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a5be683a-35ea-4200-aeb7-f42c866c1389 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:35.598884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a5be683a-35ea-4200-aeb7-f42c866c1389 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:35.612681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5be683a-35ea-4200-aeb7-f42c866c1389 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:35.613493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5be683a-35ea-4200-aeb7-f42c866c1389 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:35.614540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5be683a-35ea-4200-aeb7-f42c866c1389 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:35.615190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a5be683a-35ea-4200-aeb7-f42c866c1389 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:35.909914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a5be683a-35ea-4200-aeb7-f42c866c1389 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:35.920408 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a5be683a-35ea-4200-aeb7-f42c866c1389 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1316 microversion: 2.1 time: 0.326714 Aug 04 15:07:35.921022 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3438/6872] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:35 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:36.074839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3a02aa33-07b9-464e-8aed-d6eafbad5e61 req-4422fbd2-b637-4ccf-bf90-7782efaa7c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8ba614-c5b4-4be2-aaaa-4a0de1806d30", "tag": "c9df8146-1315-472b-a5b6-aa3476885e99"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:36.088404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3a02aa33-07b9-464e-8aed-d6eafbad5e61 req-4422fbd2-b637-4ccf-bf90-7782efaa7c3b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:36.089147 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3a02aa33-07b9-464e-8aed-d6eafbad5e61 req-4422fbd2-b637-4ccf-bf90-7782efaa7c3b service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:36.103753 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3a02aa33-07b9-464e-8aed-d6eafbad5e61 req-4422fbd2-b637-4ccf-bf90-7782efaa7c3b service nova] Creating event network-changed:c9df8146-1315-472b-a5b6-aa3476885e99 for instance 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 on n-h2-844627-10 Aug 04 15:07:36.110354 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3a02aa33-07b9-464e-8aed-d6eafbad5e61 req-4422fbd2-b637-4ccf-bf90-7782efaa7c3b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042421 Aug 04 15:07:36.111810 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3435/6873] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:07:36.942480 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-58b4f11c-0785-43c3-9439-e0b5886b839c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:36.943356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-58b4f11c-0785-43c3-9439-e0b5886b839c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:36.951837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58b4f11c-0785-43c3-9439-e0b5886b839c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:36.952407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58b4f11c-0785-43c3-9439-e0b5886b839c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:36.953526 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58b4f11c-0785-43c3-9439-e0b5886b839c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:36.954087 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58b4f11c-0785-43c3-9439-e0b5886b839c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:37.098365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-58b4f11c-0785-43c3-9439-e0b5886b839c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:37.106920 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-58b4f11c-0785-43c3-9439-e0b5886b839c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1316 microversion: 2.1 time: 0.168281 Aug 04 15:07:37.107506 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3439/6874] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:36 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:38.129786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1738ed6f-1674-41e2-85ef-590743be0bcc tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:38.130446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1738ed6f-1674-41e2-85ef-590743be0bcc tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:38.137460 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1738ed6f-1674-41e2-85ef-590743be0bcc tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:38.137922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1738ed6f-1674-41e2-85ef-590743be0bcc tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:38.138704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1738ed6f-1674-41e2-85ef-590743be0bcc tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:38.139152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1738ed6f-1674-41e2-85ef-590743be0bcc tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:38.281816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1738ed6f-1674-41e2-85ef-590743be0bcc tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:38.289890 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1738ed6f-1674-41e2-85ef-590743be0bcc tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1316 microversion: 2.1 time: 0.165321 Aug 04 15:07:38.290546 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3436/6875] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:38 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:39.310549 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6b1e400e-424d-4098-9896-be9dc9565076 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:39.311156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6b1e400e-424d-4098-9896-be9dc9565076 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:39.318179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b1e400e-424d-4098-9896-be9dc9565076 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:39.319128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b1e400e-424d-4098-9896-be9dc9565076 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:39.319916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b1e400e-424d-4098-9896-be9dc9565076 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:39.320354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6b1e400e-424d-4098-9896-be9dc9565076 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:39.447741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6b1e400e-424d-4098-9896-be9dc9565076 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:39.455261 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6b1e400e-424d-4098-9896-be9dc9565076 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1316 microversion: 2.1 time: 0.148686 Aug 04 15:07:39.455844 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3440/6876] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:39 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:40.477688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e9cd5f8-657d-4c0b-83fb-ea5c46b55bd7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:40.478326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e9cd5f8-657d-4c0b-83fb-ea5c46b55bd7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:40.484605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e9cd5f8-657d-4c0b-83fb-ea5c46b55bd7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:40.485105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e9cd5f8-657d-4c0b-83fb-ea5c46b55bd7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:40.485877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e9cd5f8-657d-4c0b-83fb-ea5c46b55bd7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:40.486361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e9cd5f8-657d-4c0b-83fb-ea5c46b55bd7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:40.622686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6e9cd5f8-657d-4c0b-83fb-ea5c46b55bd7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:40.630467 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e9cd5f8-657d-4c0b-83fb-ea5c46b55bd7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1316 microversion: 2.1 time: 0.157447 Aug 04 15:07:40.631097 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3437/6877] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:40 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:41.651732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3f1733d5-eed9-4bd4-b479-cff5cb2d9325 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:41.652329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3f1733d5-eed9-4bd4-b479-cff5cb2d9325 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:41.659444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f1733d5-eed9-4bd4-b479-cff5cb2d9325 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:41.659896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f1733d5-eed9-4bd4-b479-cff5cb2d9325 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:41.660672 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f1733d5-eed9-4bd4-b479-cff5cb2d9325 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:41.661140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3f1733d5-eed9-4bd4-b479-cff5cb2d9325 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:41.792294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3f1733d5-eed9-4bd4-b479-cff5cb2d9325 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:41.800102 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3f1733d5-eed9-4bd4-b479-cff5cb2d9325 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1316 microversion: 2.1 time: 0.152279 Aug 04 15:07:41.800669 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3441/6878] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:41 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:42.502551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6db21089-acf3-4321-a4c9-82a94bea87ab req-daba1ccd-989b-4515-87e0-15d324913533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8ba614-c5b4-4be2-aaaa-4a0de1806d30", "name": "network-vif-plugged", "status": "completed", "tag": "c9df8146-1315-472b-a5b6-aa3476885e99"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:42.517600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6db21089-acf3-4321-a4c9-82a94bea87ab req-daba1ccd-989b-4515-87e0-15d324913533 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:42.518093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6db21089-acf3-4321-a4c9-82a94bea87ab req-daba1ccd-989b-4515-87e0-15d324913533 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:42.530046 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6db21089-acf3-4321-a4c9-82a94bea87ab req-daba1ccd-989b-4515-87e0-15d324913533 service nova] Creating event network-vif-plugged:c9df8146-1315-472b-a5b6-aa3476885e99 for instance 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 on n-h2-844627-10 Aug 04 15:07:42.535248 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6db21089-acf3-4321-a4c9-82a94bea87ab req-daba1ccd-989b-4515-87e0-15d324913533 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037527 Aug 04 15:07:42.535981 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3438/6879] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:07:42.822436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aa06c22e-3edf-4e0f-9a59-a42361462b4c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:42.823051 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aa06c22e-3edf-4e0f-9a59-a42361462b4c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:42.830025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa06c22e-3edf-4e0f-9a59-a42361462b4c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:42.830467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa06c22e-3edf-4e0f-9a59-a42361462b4c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:42.831227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa06c22e-3edf-4e0f-9a59-a42361462b4c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:42.831663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-aa06c22e-3edf-4e0f-9a59-a42361462b4c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:42.964402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aa06c22e-3edf-4e0f-9a59-a42361462b4c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:42.972232 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aa06c22e-3edf-4e0f-9a59-a42361462b4c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1316 microversion: 2.1 time: 0.154323 Aug 04 15:07:42.972799 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3442/6880] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:42 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:43.994935 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f42d829-137c-4483-b58b-b8da1f366934 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:43.995652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8f42d829-137c-4483-b58b-b8da1f366934 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:43.998059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:43.999185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:44.007712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f42d829-137c-4483-b58b-b8da1f366934 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:44.008093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f42d829-137c-4483-b58b-b8da1f366934 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:44.008992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f42d829-137c-4483-b58b-b8da1f366934 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:44.009370 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f42d829-137c-4483-b58b-b8da1f366934 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:44.158962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8f42d829-137c-4483-b58b-b8da1f366934 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:44.167150 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f42d829-137c-4483-b58b-b8da1f366934 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1506 microversion: 2.1 time: 0.177925 Aug 04 15:07:44.167756 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3439/6881] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:43 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:07:44.229880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1828483922", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "6d82db0d-9f45-4236-adec-80ea46cae7da"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:44.238820 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:44.287072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] validate_networks() for [('6d82db0d-9f45-4236-adec-80ea46cae7da', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:07:44.715588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:07:44.716008 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:07:44.716483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:07:44.716916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:07:44.717333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:07:44.727488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:44.727942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:44.728751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:44.729217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:44.747260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Getting quotas for project b627e5e46f664e21ba36cbc583de6924. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:07:44.753556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Getting quotas for user 65df928dfb63499383d1d6032ffa97e4 and project b627e5e46f664e21ba36cbc583de6924. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:07:44.767002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:07:44.775202 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:07:44.815572 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-71363ab9-96a0-4e77-9734-57a79712cb03 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589454 Aug 04 15:07:44.821768 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3443/6882] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:07:44.827151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5017a27f-78cf-40f6-903e-9cdadbb1dd91 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:44.827798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5017a27f-78cf-40f6-903e-9cdadbb1dd91 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:44.888540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5017a27f-78cf-40f6-903e-9cdadbb1dd91 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:44.895893 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5017a27f-78cf-40f6-903e-9cdadbb1dd91 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1217 microversion: 2.1 time: 0.072786 Aug 04 15:07:44.898084 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3440/6883] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:44 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:45.918617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f0f066c7-0cf3-4b00-906f-3a53c6031d41 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:45.919349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0f066c7-0cf3-4b00-906f-3a53c6031d41 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:45.927857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0f066c7-0cf3-4b00-906f-3a53c6031d41 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:45.928821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0f066c7-0cf3-4b00-906f-3a53c6031d41 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:45.930329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0f066c7-0cf3-4b00-906f-3a53c6031d41 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:45.930866 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f0f066c7-0cf3-4b00-906f-3a53c6031d41 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:46.223587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f0f066c7-0cf3-4b00-906f-3a53c6031d41 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:46.231747 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f0f066c7-0cf3-4b00-906f-3a53c6031d41 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1275 microversion: 2.1 time: 0.319779 Aug 04 15:07:46.244593 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3444/6884] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:45 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1275 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:47.251832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33515fe5-f9e2-4919-b277-0ed50ee40edf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:47.252472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-33515fe5-f9e2-4919-b277-0ed50ee40edf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:47.261183 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33515fe5-f9e2-4919-b277-0ed50ee40edf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:47.261962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33515fe5-f9e2-4919-b277-0ed50ee40edf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:47.262769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33515fe5-f9e2-4919-b277-0ed50ee40edf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:47.263257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33515fe5-f9e2-4919-b277-0ed50ee40edf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:47.480239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-33515fe5-f9e2-4919-b277-0ed50ee40edf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:47.487756 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-33515fe5-f9e2-4919-b277-0ed50ee40edf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1317 microversion: 2.1 time: 0.240188 Aug 04 15:07:47.488327 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3441/6885] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:47 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:47.572821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-124aeecf-f019-47c0-ac3b-41d8cc842d76 req-5c72d159-2f51-4ee1-a9b1-864044f7ae01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d561f4ed-7185-45f7-9a3b-57003b735643", "tag": "5e6d6255-4dd9-41a2-a1b4-ca82288dc006"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:47.583268 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-124aeecf-f019-47c0-ac3b-41d8cc842d76 req-5c72d159-2f51-4ee1-a9b1-864044f7ae01 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:47.583852 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-124aeecf-f019-47c0-ac3b-41d8cc842d76 req-5c72d159-2f51-4ee1-a9b1-864044f7ae01 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:47.595697 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-124aeecf-f019-47c0-ac3b-41d8cc842d76 req-5c72d159-2f51-4ee1-a9b1-864044f7ae01 service nova] Creating event network-changed:5e6d6255-4dd9-41a2-a1b4-ca82288dc006 for instance d561f4ed-7185-45f7-9a3b-57003b735643 on n-h1-844627-10 Aug 04 15:07:47.600744 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-124aeecf-f019-47c0-ac3b-41d8cc842d76 req-5c72d159-2f51-4ee1-a9b1-864044f7ae01 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031676 Aug 04 15:07:47.601964 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3445/6886] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:07:48.509937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-571ead90-01a3-44bd-8dd9-e59e701f0a8a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:48.510545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-571ead90-01a3-44bd-8dd9-e59e701f0a8a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:48.517597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-571ead90-01a3-44bd-8dd9-e59e701f0a8a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:48.518056 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-571ead90-01a3-44bd-8dd9-e59e701f0a8a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:48.518834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-571ead90-01a3-44bd-8dd9-e59e701f0a8a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:48.519285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-571ead90-01a3-44bd-8dd9-e59e701f0a8a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:48.654411 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-571ead90-01a3-44bd-8dd9-e59e701f0a8a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:48.661991 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-571ead90-01a3-44bd-8dd9-e59e701f0a8a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1317 microversion: 2.1 time: 0.156714 Aug 04 15:07:48.662559 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3442/6887] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:48 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:49.684698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-350a6e90-76e4-4c17-afda-fc6683ba13d0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:49.685495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-350a6e90-76e4-4c17-afda-fc6683ba13d0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:49.691671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-350a6e90-76e4-4c17-afda-fc6683ba13d0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:49.692118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-350a6e90-76e4-4c17-afda-fc6683ba13d0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:49.692900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-350a6e90-76e4-4c17-afda-fc6683ba13d0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:49.693344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-350a6e90-76e4-4c17-afda-fc6683ba13d0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:49.833719 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-350a6e90-76e4-4c17-afda-fc6683ba13d0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:49.842052 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-350a6e90-76e4-4c17-afda-fc6683ba13d0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1317 microversion: 2.1 time: 0.162978 Aug 04 15:07:49.842698 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3446/6888] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:49 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:50.863576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b1b51eb8-0620-41e4-b113-43a0f1e4b90f tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:50.864209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b1b51eb8-0620-41e4-b113-43a0f1e4b90f tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:50.871873 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1b51eb8-0620-41e4-b113-43a0f1e4b90f tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:50.872339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1b51eb8-0620-41e4-b113-43a0f1e4b90f tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:50.873160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1b51eb8-0620-41e4-b113-43a0f1e4b90f tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:50.873615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b1b51eb8-0620-41e4-b113-43a0f1e4b90f tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:51.009390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b1b51eb8-0620-41e4-b113-43a0f1e4b90f tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:51.016952 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b1b51eb8-0620-41e4-b113-43a0f1e4b90f tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1317 microversion: 2.1 time: 0.157279 Aug 04 15:07:51.017541 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3443/6889] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:50 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:07:52.038515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e5d1d95-e887-44c8-8e74-32bff53e8e62 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:52.039128 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7e5d1d95-e887-44c8-8e74-32bff53e8e62 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:52.045988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e5d1d95-e887-44c8-8e74-32bff53e8e62 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:52.046439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e5d1d95-e887-44c8-8e74-32bff53e8e62 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:52.047204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e5d1d95-e887-44c8-8e74-32bff53e8e62 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:52.047642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e5d1d95-e887-44c8-8e74-32bff53e8e62 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:52.180192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7e5d1d95-e887-44c8-8e74-32bff53e8e62 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:52.187854 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7e5d1d95-e887-44c8-8e74-32bff53e8e62 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1317 microversion: 2.1 time: 0.153186 Aug 04 15:07:52.188428 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3447/6890] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:52 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:53.210185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37479c31-2610-4272-9b4a-0c6f61c80a3d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:53.211852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-37479c31-2610-4272-9b4a-0c6f61c80a3d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:53.216711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-081caf37-360f-4498-8e00-b378e73f96bb req-27c81971-4966-4e76-b359-d28a33282048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d561f4ed-7185-45f7-9a3b-57003b735643", "name": "network-vif-plugged", "status": "completed", "tag": "5e6d6255-4dd9-41a2-a1b4-ca82288dc006"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:53.218812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37479c31-2610-4272-9b4a-0c6f61c80a3d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:53.219292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37479c31-2610-4272-9b4a-0c6f61c80a3d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:53.220094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37479c31-2610-4272-9b4a-0c6f61c80a3d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:53.220818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-37479c31-2610-4272-9b4a-0c6f61c80a3d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:53.228882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-081caf37-360f-4498-8e00-b378e73f96bb req-27c81971-4966-4e76-b359-d28a33282048 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:53.229349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-081caf37-360f-4498-8e00-b378e73f96bb req-27c81971-4966-4e76-b359-d28a33282048 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:53.241994 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-081caf37-360f-4498-8e00-b378e73f96bb req-27c81971-4966-4e76-b359-d28a33282048 service nova] Creating event network-vif-plugged:5e6d6255-4dd9-41a2-a1b4-ca82288dc006 for instance d561f4ed-7185-45f7-9a3b-57003b735643 on n-h1-844627-10 Aug 04 15:07:53.247197 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-081caf37-360f-4498-8e00-b378e73f96bb req-27c81971-4966-4e76-b359-d28a33282048 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034358 Aug 04 15:07:53.247850 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3448/6891] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:07:53.403396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-37479c31-2610-4272-9b4a-0c6f61c80a3d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:53.411969 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37479c31-2610-4272-9b4a-0c6f61c80a3d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1317 microversion: 2.1 time: 0.205992 Aug 04 15:07:53.412898 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3444/6892] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:53 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:54.433575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6d6a4b49-68a9-446f-8383-da450f0a7f47 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:54.434188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6d6a4b49-68a9-446f-8383-da450f0a7f47 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:54.441280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d6a4b49-68a9-446f-8383-da450f0a7f47 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:54.441739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d6a4b49-68a9-446f-8383-da450f0a7f47 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:54.442497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d6a4b49-68a9-446f-8383-da450f0a7f47 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:54.442933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6d6a4b49-68a9-446f-8383-da450f0a7f47 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:54.606412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6d6a4b49-68a9-446f-8383-da450f0a7f47 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:54.614174 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6d6a4b49-68a9-446f-8383-da450f0a7f47 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1317 microversion: 2.1 time: 0.185023 Aug 04 15:07:54.614781 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3449/6893] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:54 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:55.634408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-05853172-0388-4789-b63b-b8655f963c68 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:55.634957 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-05853172-0388-4789-b63b-b8655f963c68 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:55.637843 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:55.644211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05853172-0388-4789-b63b-b8655f963c68 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:55.644690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05853172-0388-4789-b63b-b8655f963c68 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:55.645518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05853172-0388-4789-b63b-b8655f963c68 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:55.645986 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-05853172-0388-4789-b63b-b8655f963c68 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:55.783120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-05853172-0388-4789-b63b-b8655f963c68 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:55.791525 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-05853172-0388-4789-b63b-b8655f963c68 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1507 microversion: 2.1 time: 0.161162 Aug 04 15:07:55.792121 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3445/6894] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:55 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:55.811859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ff464ab-295e-4c04-a8df-fc2635b893f0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:55.812573 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ff464ab-295e-4c04-a8df-fc2635b893f0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:55.814465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:55.815242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:07:55.822104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ff464ab-295e-4c04-a8df-fc2635b893f0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:55.822550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ff464ab-295e-4c04-a8df-fc2635b893f0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:55.823317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ff464ab-295e-4c04-a8df-fc2635b893f0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:55.823746 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ff464ab-295e-4c04-a8df-fc2635b893f0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:55.849251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ff464ab-295e-4c04-a8df-fc2635b893f0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:07:55.927248 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ff464ab-295e-4c04-a8df-fc2635b893f0 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 204 len: 0 microversion: 2.1 time: 0.118812 Aug 04 15:07:55.927793 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3450/6895] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:07:55 2022] DELETE /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:07:55.936194 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5af00f74-b8aa-4c51-800c-34f669e0a296 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:55.937002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5af00f74-b8aa-4c51-800c-34f669e0a296 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:55.943410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5af00f74-b8aa-4c51-800c-34f669e0a296 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:55.943881 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5af00f74-b8aa-4c51-800c-34f669e0a296 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:55.944658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5af00f74-b8aa-4c51-800c-34f669e0a296 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:55.945138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5af00f74-b8aa-4c51-800c-34f669e0a296 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:56.075402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5af00f74-b8aa-4c51-800c-34f669e0a296 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:56.083374 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5af00f74-b8aa-4c51-800c-34f669e0a296 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1513 microversion: 2.1 time: 0.151120 Aug 04 15:07:56.083940 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3446/6896] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:55 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:57.105714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2aa75616-aa91-4194-bfd9-b703277f8e6c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:57.106416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2aa75616-aa91-4194-bfd9-b703277f8e6c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:57.113516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2aa75616-aa91-4194-bfd9-b703277f8e6c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:57.113967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2aa75616-aa91-4194-bfd9-b703277f8e6c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:57.114735 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2aa75616-aa91-4194-bfd9-b703277f8e6c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:57.115171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2aa75616-aa91-4194-bfd9-b703277f8e6c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:57.261216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2aa75616-aa91-4194-bfd9-b703277f8e6c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:57.268951 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2aa75616-aa91-4194-bfd9-b703277f8e6c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1513 microversion: 2.1 time: 0.167514 Aug 04 15:07:57.269535 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3451/6897] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:57 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:57.965156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8c4559e6-5895-4949-a288-d8b87bf29312 req-a67d819b-1cc0-4855-91ca-0e74a66950a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d561f4ed-7185-45f7-9a3b-57003b735643", "name": "network-vif-deleted", "tag": "5e6d6255-4dd9-41a2-a1b4-ca82288dc006"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:57.981708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8c4559e6-5895-4949-a288-d8b87bf29312 req-a67d819b-1cc0-4855-91ca-0e74a66950a6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:57.982567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8c4559e6-5895-4949-a288-d8b87bf29312 req-a67d819b-1cc0-4855-91ca-0e74a66950a6 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:58.000780 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8c4559e6-5895-4949-a288-d8b87bf29312 req-a67d819b-1cc0-4855-91ca-0e74a66950a6 service nova] Creating event network-vif-deleted:5e6d6255-4dd9-41a2-a1b4-ca82288dc006 for instance d561f4ed-7185-45f7-9a3b-57003b735643 on n-h1-844627-10 Aug 04 15:07:58.009471 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8c4559e6-5895-4949-a288-d8b87bf29312 req-a67d819b-1cc0-4855-91ca-0e74a66950a6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049587 Aug 04 15:07:58.010377 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3447/6898] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:07:58.292081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:58.292617 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:58.299563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:58.300017 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:58.300783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:58.301256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:58.334887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:58.335336 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:58.336287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lazy-loading 'fault' on Instance uuid d561f4ed-7185-45f7-9a3b-57003b735643 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:07:58.382100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:58.390369 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bab6065f-9f01-4112-8f8a-deed78a7687c tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 200 len: 1307 microversion: 2.1 time: 0.103153 Aug 04 15:07:58.391181 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3452/6899] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:58 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:07:59.414496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:59.415140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:59.422375 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:59.422883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:59.423819 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:59.424286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:59.438366 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] HTTP exception thrown: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Request method failure captured: Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 HTTP/1.1 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-C0DwsGnv2r-ZlJ08OL-mjHrMz6sTDbnOP8f7MHJNOUMgUgvlZSDXHkpg-RaQnNZYO3-e8B7TkPeES8AbLB_7CxcAsWBnyKPHxQNI5wBj7LLGluqSCfwWfGhIJ6ytToU9Lh8BMg-21Aj0EOgP52_zzkRjeE0ZpsQMmEObNyi_W0-JQ Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}] Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 65df928dfb63499383d1d6032ffa97e4 Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd561f4ed-7185-45f7-9a3b-57003b735643'} Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:59.440019 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Returning 404 to user: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-68f67829-d486-4fac-99af-687d16c1e6fe tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 404 len: 111 microversion: 2.1 time: 0.031913 Aug 04 15:07:59.444783 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3448/6900] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:59 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:59.450734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c957c834-4cea-4554-a9d2-c2227ec190b5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:59.451346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c957c834-4cea-4554-a9d2-c2227ec190b5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:59.458287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c957c834-4cea-4554-a9d2-c2227ec190b5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:59.458734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c957c834-4cea-4554-a9d2-c2227ec190b5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:59.459498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c957c834-4cea-4554-a9d2-c2227ec190b5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:59.459934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c957c834-4cea-4554-a9d2-c2227ec190b5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:59.849359 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c957c834-4cea-4554-a9d2-c2227ec190b5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:07:59.856839 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c957c834-4cea-4554-a9d2-c2227ec190b5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1506 microversion: 2.1 time: 0.409993 Aug 04 15:07:59.857498 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3453/6901] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:59 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:07:59.877124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dca40305-0ea5-48a4-bfb8-03be139db67d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:07:59.879405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dca40305-0ea5-48a4-bfb8-03be139db67d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 915fb4da-34de-4a1b-9add-e7e99a7f1460] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:59.885434 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-dca40305-0ea5-48a4-bfb8-03be139db67d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] HTTP exception thrown: Instance 915fb4da-34de-4a1b-9add-e7e99a7f1460 could not be found. Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dca40305-0ea5-48a4-bfb8-03be139db67d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Request method failure captured: Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/915fb4da-34de-4a1b-9add-e7e99a7f1460/action HTTP/1.1 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 32 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-C0DwsGnv2r-ZlJ08OL-mjHrMz6sTDbnOP8f7MHJNOUMgUgvlZSDXHkpg-RaQnNZYO3-e8B7TkPeES8AbLB_7CxcAsWBnyKPHxQNI5wBj7LLGluqSCfwWfGhIJ6ytToU9Lh8BMg-21Aj0EOgP52_zzkRjeE0ZpsQMmEObNyi_W0-JQ Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}] Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 65df928dfb63499383d1d6032ffa97e4 Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: {"resize": {"flavorRef": "452"}} Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 915fb4da-34de-4a1b-9add-e7e99a7f1460 could not be found. Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '915fb4da-34de-4a1b-9add-e7e99a7f1460', 'body': {'resize': {'flavorRef': '452'}}} Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 915fb4da-34de-4a1b-9add-e7e99a7f1460 could not be found. Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:07:59.886983 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 915fb4da-34de-4a1b-9add-e7e99a7f1460 could not be found. Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 915fb4da-34de-4a1b-9add-e7e99a7f1460 could not be found. Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dca40305-0ea5-48a4-bfb8-03be139db67d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Returning 404 to user: Instance 915fb4da-34de-4a1b-9add-e7e99a7f1460 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dca40305-0ea5-48a4-bfb8-03be139db67d tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "POST /compute/v2.1/servers/915fb4da-34de-4a1b-9add-e7e99a7f1460/action" status: 404 len: 111 microversion: 2.1 time: 0.015255 Aug 04 15:07:59.891045 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3449/6902] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:07:59 2022] POST /compute/v2.1/servers/915fb4da-34de-4a1b-9add-e7e99a7f1460/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:07:59.896854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f7fb51e0-d7dd-4b08-9f68-bbfb2f93eb83 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:07:59.897500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f7fb51e0-d7dd-4b08-9f68-bbfb2f93eb83 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:07:59.903501 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fb51e0-d7dd-4b08-9f68-bbfb2f93eb83 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:59.903943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fb51e0-d7dd-4b08-9f68-bbfb2f93eb83 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:59.904726 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fb51e0-d7dd-4b08-9f68-bbfb2f93eb83 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:07:59.905183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f7fb51e0-d7dd-4b08-9f68-bbfb2f93eb83 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:07:59.922960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:00.038716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f7fb51e0-d7dd-4b08-9f68-bbfb2f93eb83 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:00.046961 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f7fb51e0-d7dd-4b08-9f68-bbfb2f93eb83 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1506 microversion: 2.1 time: 0.153849 Aug 04 15:08:00.047527 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3454/6903] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:07:59 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:00.069266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec1cbf82-ff9a-48e3-b9d1-7817f3b5eaf1 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:00.069931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ec1cbf82-ff9a-48e3-b9d1-7817f3b5eaf1 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:00.077379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf82-ff9a-48e3-b9d1-7817f3b5eaf1 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.077846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf82-ff9a-48e3-b9d1-7817f3b5eaf1 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.078669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf82-ff9a-48e3-b9d1-7817f3b5eaf1 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.079124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf82-ff9a-48e3-b9d1-7817f3b5eaf1 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.220925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ec1cbf82-ff9a-48e3-b9d1-7817f3b5eaf1 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:00.229487 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec1cbf82-ff9a-48e3-b9d1-7817f3b5eaf1 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1506 microversion: 2.1 time: 0.164677 Aug 04 15:08:00.230047 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3450/6904] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:00 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:00.250363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "92440453-e92d-45cd-b718-a0543c0de87b"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:08:00.252544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:00.258658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.259112 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.259888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.260332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.298851 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:00.304347 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] HTTP exception thrown: Flavor 92440453-e92d-45cd-b718-a0543c0de87b could not be found. Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Request method failure captured: Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: request: POST /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30/action HTTP/1.1 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 65 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6-C0DwsGnv2r-ZlJ08OL-mjHrMz6sTDbnOP8f7MHJNOUMgUgvlZSDXHkpg-RaQnNZYO3-e8B7TkPeES8AbLB_7CxcAsWBnyKPHxQNI5wBj7LLGluqSCfwWfGhIJ6ytToU9Lh8BMg-21Aj0EOgP52_zzkRjeE0ZpsQMmEObNyi_W0-JQ Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}] Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 65df928dfb63499383d1d6032ffa97e4 Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: {"resize": {"flavorRef": "92440453-e92d-45cd-b718-a0543c0de87b"}} Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: exception: Flavor 92440453-e92d-45cd-b718-a0543c0de87b could not be found. Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '4b8ba614-c5b4-4be2-aaaa-4a0de1806d30', 'body': {'resize': {'flavorRef': '92440453-e92d-45cd-b718-a0543c0de87b'}}} Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 15:08:00.319303 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 92440453-e92d-45cd-b718-a0543c0de87b could not be found. Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 92440453-e92d-45cd-b718-a0543c0de87b could not be found. Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 92440453-e92d-45cd-b718-a0543c0de87b could not be found. Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Returning 400 to user: Flavor 92440453-e92d-45cd-b718-a0543c0de87b could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-19ac9261-4e26-4c2b-ac8f-60c8eefdbf19 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "POST /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30/action" status: 400 len: 107 microversion: 2.1 time: 0.074525 Aug 04 15:08:00.324757 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3455/6905] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:08:00 2022] POST /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30/action => generated 107 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 15:08:00.330021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d674238-1160-41a1-b978-fcd2c1ac831b tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:00.330649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3d674238-1160-41a1-b978-fcd2c1ac831b tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:00.336795 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d674238-1160-41a1-b978-fcd2c1ac831b tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.337284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d674238-1160-41a1-b978-fcd2c1ac831b tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.338054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d674238-1160-41a1-b978-fcd2c1ac831b tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.338517 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d674238-1160-41a1-b978-fcd2c1ac831b tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.466942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3d674238-1160-41a1-b978-fcd2c1ac831b tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:00.474793 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3d674238-1160-41a1-b978-fcd2c1ac831b tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1506 microversion: 2.1 time: 0.148810 Aug 04 15:08:00.475384 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3451/6906] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:00 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:08:00.495796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc9831a6-fd34-423a-bf6b-add7bfff31bf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:00.496398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bc9831a6-fd34-423a-bf6b-add7bfff31bf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:00.504055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc9831a6-fd34-423a-bf6b-add7bfff31bf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.504453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc9831a6-fd34-423a-bf6b-add7bfff31bf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.505260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc9831a6-fd34-423a-bf6b-add7bfff31bf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.505705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc9831a6-fd34-423a-bf6b-add7bfff31bf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.636968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bc9831a6-fd34-423a-bf6b-add7bfff31bf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:00.644984 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bc9831a6-fd34-423a-bf6b-add7bfff31bf tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1506 microversion: 2.1 time: 0.153002 Aug 04 15:08:00.645552 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3456/6907] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:00 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:00.665859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c374148-1dd1-46a4-be1e-87cde807bcac tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c374148-1dd1-46a4-be1e-87cde807bcac tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Request method failure captured: Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: request: POST /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30/action HTTP/1.1 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 29 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-C0DwsGnv2r-ZlJ08OL-mjHrMz6sTDbnOP8f7MHJNOUMgUgvlZSDXHkpg-RaQnNZYO3-e8B7TkPeES8AbLB_7CxcAsWBnyKPHxQNI5wBj7LLGluqSCfwWfGhIJ6ytToU9Lh8BMg-21Aj0EOgP52_zzkRjeE0ZpsQMmEObNyi_W0-JQ Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}] Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 65df928dfb63499383d1d6032ffa97e4 Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: {"resize": {"flavorRef": ""}} Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4b8ba614-c5b4-4be2-aaaa-4a0de1806d30', 'body': {'resize': {'flavorRef': ''}}} Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise error Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi '' Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.669576 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9c374148-1dd1-46a4-be1e-87cde807bcac tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9c374148-1dd1-46a4-be1e-87cde807bcac tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "POST /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30/action" status: 400 len: 113 microversion: 2.1 time: 0.009786 Aug 04 15:08:00.673542 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3452/6908] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:08:00 2022] POST /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 15:08:00.679513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d94610be-5897-4c45-98ab-79f9d4d2a7b7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:00.680133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d94610be-5897-4c45-98ab-79f9d4d2a7b7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:00.686245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d94610be-5897-4c45-98ab-79f9d4d2a7b7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.686695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d94610be-5897-4c45-98ab-79f9d4d2a7b7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.687457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d94610be-5897-4c45-98ab-79f9d4d2a7b7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.687894 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d94610be-5897-4c45-98ab-79f9d4d2a7b7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.816311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d94610be-5897-4c45-98ab-79f9d4d2a7b7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:00.824372 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d94610be-5897-4c45-98ab-79f9d4d2a7b7 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1506 microversion: 2.1 time: 0.148696 Aug 04 15:08:00.824954 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3457/6909] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:00 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:00.848325 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:00.848835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:00.856074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.856537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.857342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.857794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.870709 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] HTTP exception thrown: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Request method failure captured: Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 HTTP/1.1 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-C0DwsGnv2r-ZlJ08OL-mjHrMz6sTDbnOP8f7MHJNOUMgUgvlZSDXHkpg-RaQnNZYO3-e8B7TkPeES8AbLB_7CxcAsWBnyKPHxQNI5wBj7LLGluqSCfwWfGhIJ6ytToU9Lh8BMg-21Aj0EOgP52_zzkRjeE0ZpsQMmEObNyi_W0-JQ Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}] Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 65df928dfb63499383d1d6032ffa97e4 Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': 'd561f4ed-7185-45f7-9a3b-57003b735643'} Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:08:00.872259 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Returning 404 to user: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-64fb04ce-7f6f-40f8-8db1-4bc45be5c527 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 404 len: 111 microversion: 2.1 time: 0.029455 Aug 04 15:08:00.875997 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3453/6910] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:08:00 2022] DELETE /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:08:00.882116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:00.883236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: d561f4ed-7185-45f7-9a3b-57003b735643] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:00.889175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.889624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.890404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.890823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.906364 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] HTTP exception thrown: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Request method failure captured: Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 HTTP/1.1 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6-C0DwsGnv2r-ZlJ08OL-mjHrMz6sTDbnOP8f7MHJNOUMgUgvlZSDXHkpg-RaQnNZYO3-e8B7TkPeES8AbLB_7CxcAsWBnyKPHxQNI5wBj7LLGluqSCfwWfGhIJ6ytToU9Lh8BMg-21Aj0EOgP52_zzkRjeE0ZpsQMmEObNyi_W0-JQ Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}] Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 65df928dfb63499383d1d6032ffa97e4 Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'd561f4ed-7185-45f7-9a3b-57003b735643'} Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:00.907884 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Returning 404 to user: Instance d561f4ed-7185-45f7-9a3b-57003b735643 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-84f36111-beaf-49f9-85ce-9a04e6e079c5 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643" status: 404 len: 111 microversion: 2.1 time: 0.031001 Aug 04 15:08:00.911799 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3458/6911] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:00 2022] GET /compute/v2.1/servers/d561f4ed-7185-45f7-9a3b-57003b735643 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:08:00.917737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c7ffd23e-dc85-4d33-a539-8f8e762508a4 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:00.918252 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c7ffd23e-dc85-4d33-a539-8f8e762508a4 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:00.924454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7ffd23e-dc85-4d33-a539-8f8e762508a4 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.924953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7ffd23e-dc85-4d33-a539-8f8e762508a4 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.925725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7ffd23e-dc85-4d33-a539-8f8e762508a4 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:00.926173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c7ffd23e-dc85-4d33-a539-8f8e762508a4 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:00.956422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c7ffd23e-dc85-4d33-a539-8f8e762508a4 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:08:01.012262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:01.043080 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c7ffd23e-dc85-4d33-a539-8f8e762508a4 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 204 len: 0 microversion: 2.1 time: 0.128771 Aug 04 15:08:01.043566 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3454/6912] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:08:00 2022] DELETE /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:08:01.051867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1c5cec02-32d4-40d7-8619-7a5fd8be8b42 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:01.052584 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1c5cec02-32d4-40d7-8619-7a5fd8be8b42 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:01.058924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c5cec02-32d4-40d7-8619-7a5fd8be8b42 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:01.059370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c5cec02-32d4-40d7-8619-7a5fd8be8b42 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:01.060176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c5cec02-32d4-40d7-8619-7a5fd8be8b42 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:01.060613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1c5cec02-32d4-40d7-8619-7a5fd8be8b42 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:01.198193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1c5cec02-32d4-40d7-8619-7a5fd8be8b42 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:01.206429 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1c5cec02-32d4-40d7-8619-7a5fd8be8b42 tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1512 microversion: 2.1 time: 0.158478 Aug 04 15:08:01.207014 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3459/6913] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:01 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:02.234764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-474969a0-247a-475e-be5c-17990d80365a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:02.235523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-474969a0-247a-475e-be5c-17990d80365a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:02.242533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-474969a0-247a-475e-be5c-17990d80365a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:02.243003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-474969a0-247a-475e-be5c-17990d80365a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:02.243789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-474969a0-247a-475e-be5c-17990d80365a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:02.244247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-474969a0-247a-475e-be5c-17990d80365a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:02.439602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-474969a0-247a-475e-be5c-17990d80365a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65df928dfb63499383d1d6032ffa97e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b627e5e46f664e21ba36cbc583de6924', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:02.454328 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-474969a0-247a-475e-be5c-17990d80365a tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 200 len: 1512 microversion: 2.1 time: 0.227449 Aug 04 15:08:02.455352 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3455/6914] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:02 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:02.884768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-6bd2d08b-40be-46fb-ad05-c5b9be5b4adf req-98ef2ec3-f8fd-4197-ac99-a0fbd1cba839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8ba614-c5b4-4be2-aaaa-4a0de1806d30", "name": "network-vif-deleted", "tag": "c9df8146-1315-472b-a5b6-aa3476885e99"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:08:02.896716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6bd2d08b-40be-46fb-ad05-c5b9be5b4adf req-98ef2ec3-f8fd-4197-ac99-a0fbd1cba839 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:02.897208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-6bd2d08b-40be-46fb-ad05-c5b9be5b4adf req-98ef2ec3-f8fd-4197-ac99-a0fbd1cba839 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:02.909746 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-6bd2d08b-40be-46fb-ad05-c5b9be5b4adf req-98ef2ec3-f8fd-4197-ac99-a0fbd1cba839 service nova] Creating event network-vif-deleted:c9df8146-1315-472b-a5b6-aa3476885e99 for instance 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 on n-h2-844627-10 Aug 04 15:08:02.915611 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-6bd2d08b-40be-46fb-ad05-c5b9be5b4adf req-98ef2ec3-f8fd-4197-ac99-a0fbd1cba839 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037716 Aug 04 15:08:02.916514 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3460/6915] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:08:03.477470 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:03.478131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] [instance: 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:03.481012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:03.487492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:03.487997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:03.488826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:03.489342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:03.505402 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] HTTP exception thrown: Instance 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 could not be found. Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Request method failure captured: Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 HTTP/1.1 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-C0DwsGnv2r-ZlJ08OL-mjHrMz6sTDbnOP8f7MHJNOUMgUgvlZSDXHkpg-RaQnNZYO3-e8B7TkPeES8AbLB_7CxcAsWBnyKPHxQNI5wBj7LLGluqSCfwWfGhIJ6ytToU9Lh8BMg-21Aj0EOgP52_zzkRjeE0ZpsQMmEObNyi_W0-JQ Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b627e5e46f664e21ba36cbc583de6924"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b627e5e46f664e21ba36cbc583de6924"}]}] Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: b627e5e46f664e21ba36cbc583de6924 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-ServersNegativeTestJSON-202559197 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 65df928dfb63499383d1d6032ffa97e4 Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-ServersNegativeTestJSON-202559197-project Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 could not be found. Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '4b8ba614-c5b4-4be2-aaaa-4a0de1806d30'} Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 could not be found. Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 could not be found. Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:08:03.507117 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 could not be found. Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] Returning 404 to user: Instance 4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-673d915e-02ca-4359-9625-09ad53c435af tempest-ServersNegativeTestJSON-202559197 tempest-ServersNegativeTestJSON-202559197-project] 10.222.0.66 "GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30" status: 404 len: 111 microversion: 2.1 time: 0.035702 Aug 04 15:08:03.511673 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3456/6916] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:03 2022] GET /compute/v2.1/servers/4b8ba614-c5b4-4be2-aaaa-4a0de1806d30 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:08:23.971877 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:08:23.972616 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:08:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:08:39.535604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:39.537091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=28 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:39.750655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-48496156-c516-4f54-9217-efe11c6a01a2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Action: 'create', calling method: .version_select at 0x7f46f2dc8700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1112602120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOIPlenDGAQ907H3eV91rMLB+QXX4YugBgAkDLAf3cG3+TQI1r1vE7QbtVh78qPtRLM8zbt9VrRs/so+dZWdurJyUnOvOkwoMaZ5nh17x8vtriu3YAcF5pSRtbtZvjdQ=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:08:39.768410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-48496156-c516-4f54-9217-efe11c6a01a2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for project 31eef56333fc4a49916b0f6300853540. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:08:39.775027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-48496156-c516-4f54-9217-efe11c6a01a2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for user eae3858f48a54096ae2cdf02b159f5d9 and project 31eef56333fc4a49916b0f6300853540. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:08:39.809984 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-48496156-c516-4f54-9217-efe11c6a01a2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.276746 Aug 04 15:08:39.810646 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3461/6917] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:08:39 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:08:39.867261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-229203037", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1112602120", "networks": [{"uuid": "56181f6c-03b7-466c-b4ac-22b8223c5781"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:08:39.884431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:39.885255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:39.930593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] validate_networks() for [('56181f6c-03b7-466c-b4ac-22b8223c5781', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:08:40.411285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:08:40.411810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:08:40.412318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:08:40.412750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:08:40.413212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:08:40.423186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:40.423665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:40.424492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:40.424998 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:40.442149 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for project 31eef56333fc4a49916b0f6300853540. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:08:40.447503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for user eae3858f48a54096ae2cdf02b159f5d9 and project 31eef56333fc4a49916b0f6300853540. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:08:40.459979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:08:40.462829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:08:40.510498 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5e8e7900-86dc-4f64-a1ee-6b0efe2310fb tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647634 Aug 04 15:08:40.511151 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3457/6918] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:08:40.522038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f03b69dd-4f6c-4bd4-8eeb-1d14cac01984 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:40.522817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f03b69dd-4f6c-4bd4-8eeb-1d14cac01984 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:40.581626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f03b69dd-4f6c-4bd4-8eeb-1d14cac01984 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:40.590898 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f03b69dd-4f6c-4bd4-8eeb-1d14cac01984 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1262 microversion: 2.1 time: 0.072730 Aug 04 15:08:40.591499 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3462/6919] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:40 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:08:41.615643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ada9c21-a077-4652-94a7-6457395df21b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:41.617836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ada9c21-a077-4652-94a7-6457395df21b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:41.625598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ada9c21-a077-4652-94a7-6457395df21b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:41.626814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ada9c21-a077-4652-94a7-6457395df21b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:41.628086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ada9c21-a077-4652-94a7-6457395df21b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:41.628817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ada9c21-a077-4652-94a7-6457395df21b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:41.736290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8ada9c21-a077-4652-94a7-6457395df21b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:41.749234 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ada9c21-a077-4652-94a7-6457395df21b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1332 microversion: 2.1 time: 0.140498 Aug 04 15:08:41.754646 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3458/6920] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:41 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1332 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:42.770002 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0bf0a98d-a13d-4dd6-89ee-5988f9b50fb0 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:42.774214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0bf0a98d-a13d-4dd6-89ee-5988f9b50fb0 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:42.783367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bf0a98d-a13d-4dd6-89ee-5988f9b50fb0 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:42.783367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bf0a98d-a13d-4dd6-89ee-5988f9b50fb0 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:42.783857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bf0a98d-a13d-4dd6-89ee-5988f9b50fb0 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:42.784356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0bf0a98d-a13d-4dd6-89ee-5988f9b50fb0 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:43.009636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0bf0a98d-a13d-4dd6-89ee-5988f9b50fb0 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:43.017386 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0bf0a98d-a13d-4dd6-89ee-5988f9b50fb0 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1362 microversion: 2.1 time: 0.251359 Aug 04 15:08:43.018092 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3463/6921] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:42 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:43.089585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-a986e94a-d442-4280-9c22-f695f4fca346 req-3adef187-8fc1-4a94-88e7-8abb613fe2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59641b10-63e5-4c69-9429-7438d2f6523e", "tag": "2e95f6e1-51dd-487d-82fd-cd692779e36a"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:08:43.102947 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a986e94a-d442-4280-9c22-f695f4fca346 req-3adef187-8fc1-4a94-88e7-8abb613fe2d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:43.103409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-a986e94a-d442-4280-9c22-f695f4fca346 req-3adef187-8fc1-4a94-88e7-8abb613fe2d1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:43.116371 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-a986e94a-d442-4280-9c22-f695f4fca346 req-3adef187-8fc1-4a94-88e7-8abb613fe2d1 service nova] Creating event network-changed:2e95f6e1-51dd-487d-82fd-cd692779e36a for instance 59641b10-63e5-4c69-9429-7438d2f6523e on n-h2-844627-10 Aug 04 15:08:43.122079 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-a986e94a-d442-4280-9c22-f695f4fca346 req-3adef187-8fc1-4a94-88e7-8abb613fe2d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037192 Aug 04 15:08:43.122680 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3459/6922] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:08:44.038489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3719df7c-7b22-439b-9875-660300a4f25f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:44.039103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3719df7c-7b22-439b-9875-660300a4f25f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:44.046177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3719df7c-7b22-439b-9875-660300a4f25f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:44.046631 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3719df7c-7b22-439b-9875-660300a4f25f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:44.047398 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3719df7c-7b22-439b-9875-660300a4f25f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:44.047845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3719df7c-7b22-439b-9875-660300a4f25f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:44.176857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3719df7c-7b22-439b-9875-660300a4f25f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:44.184974 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3719df7c-7b22-439b-9875-660300a4f25f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1362 microversion: 2.1 time: 0.150383 Aug 04 15:08:44.185543 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3464/6923] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:44 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:45.208272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ec675da9-c28f-4fb3-8594-cb7e3a62226f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:45.209031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ec675da9-c28f-4fb3-8594-cb7e3a62226f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:45.215903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec675da9-c28f-4fb3-8594-cb7e3a62226f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:45.216383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec675da9-c28f-4fb3-8594-cb7e3a62226f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:45.217196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec675da9-c28f-4fb3-8594-cb7e3a62226f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:45.217655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ec675da9-c28f-4fb3-8594-cb7e3a62226f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:45.355301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ec675da9-c28f-4fb3-8594-cb7e3a62226f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:45.362880 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ec675da9-c28f-4fb3-8594-cb7e3a62226f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1362 microversion: 2.1 time: 0.160090 Aug 04 15:08:45.363445 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3460/6924] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:45 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:46.383535 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-061692f2-26a7-44fb-b680-b70376ad1e10 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:46.384080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-061692f2-26a7-44fb-b680-b70376ad1e10 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:46.391053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-061692f2-26a7-44fb-b680-b70376ad1e10 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:46.391500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-061692f2-26a7-44fb-b680-b70376ad1e10 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:46.392262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-061692f2-26a7-44fb-b680-b70376ad1e10 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:46.392693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-061692f2-26a7-44fb-b680-b70376ad1e10 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:46.520888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-061692f2-26a7-44fb-b680-b70376ad1e10 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:46.529068 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-061692f2-26a7-44fb-b680-b70376ad1e10 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1362 microversion: 2.1 time: 0.149527 Aug 04 15:08:46.529647 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3465/6925] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:46 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:47.549687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38426b31-f773-42cc-8b98-57800f63a219 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:47.550484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-38426b31-f773-42cc-8b98-57800f63a219 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:47.557907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38426b31-f773-42cc-8b98-57800f63a219 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:47.558367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38426b31-f773-42cc-8b98-57800f63a219 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:47.559142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38426b31-f773-42cc-8b98-57800f63a219 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:47.559624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38426b31-f773-42cc-8b98-57800f63a219 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:47.695404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-38426b31-f773-42cc-8b98-57800f63a219 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:47.703059 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-38426b31-f773-42cc-8b98-57800f63a219 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1362 microversion: 2.1 time: 0.157297 Aug 04 15:08:47.703625 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3461/6926] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:47 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:48.724264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-14e337b5-26a8-4aea-973b-22536b0819a5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:48.724984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-14e337b5-26a8-4aea-973b-22536b0819a5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:48.736174 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14e337b5-26a8-4aea-973b-22536b0819a5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:48.736635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14e337b5-26a8-4aea-973b-22536b0819a5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:48.737452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14e337b5-26a8-4aea-973b-22536b0819a5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:48.737907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-14e337b5-26a8-4aea-973b-22536b0819a5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:48.828012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b7bff11b-807c-4871-867c-a9c151a95ed8 req-928afdf7-6549-4472-a36c-05241f3caedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59641b10-63e5-4c69-9429-7438d2f6523e", "name": "network-vif-plugged", "status": "completed", "tag": "2e95f6e1-51dd-487d-82fd-cd692779e36a"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:08:48.845103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b7bff11b-807c-4871-867c-a9c151a95ed8 req-928afdf7-6549-4472-a36c-05241f3caedd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:48.845476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b7bff11b-807c-4871-867c-a9c151a95ed8 req-928afdf7-6549-4472-a36c-05241f3caedd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:48.857455 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b7bff11b-807c-4871-867c-a9c151a95ed8 req-928afdf7-6549-4472-a36c-05241f3caedd service nova] Creating event network-vif-plugged:2e95f6e1-51dd-487d-82fd-cd692779e36a for instance 59641b10-63e5-4c69-9429-7438d2f6523e on n-h2-844627-10 Aug 04 15:08:48.862819 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b7bff11b-807c-4871-867c-a9c151a95ed8 req-928afdf7-6549-4472-a36c-05241f3caedd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108697 Aug 04 15:08:48.863976 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3462/6927] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:08:48.886626 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-14e337b5-26a8-4aea-973b-22536b0819a5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:48.894328 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-14e337b5-26a8-4aea-973b-22536b0819a5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1362 microversion: 2.1 time: 0.174576 Aug 04 15:08:48.894921 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3466/6928] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:48 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:49.917420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-21e7ebfe-6ae7-44fe-8d6c-3867f3df2cef tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:49.918125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-21e7ebfe-6ae7-44fe-8d6c-3867f3df2cef tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:49.924384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21e7ebfe-6ae7-44fe-8d6c-3867f3df2cef tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:49.924847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21e7ebfe-6ae7-44fe-8d6c-3867f3df2cef tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:49.925643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21e7ebfe-6ae7-44fe-8d6c-3867f3df2cef tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:49.926089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-21e7ebfe-6ae7-44fe-8d6c-3867f3df2cef tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:50.075755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-21e7ebfe-6ae7-44fe-8d6c-3867f3df2cef tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:50.083601 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-21e7ebfe-6ae7-44fe-8d6c-3867f3df2cef tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1362 microversion: 2.1 time: 0.171393 Aug 04 15:08:50.084207 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3463/6929] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:49 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:51.104777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-93bc680b-c54a-49bc-9689-3fb7d35c9422 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:51.105419 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-93bc680b-c54a-49bc-9689-3fb7d35c9422 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:51.108186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:51.113703 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93bc680b-c54a-49bc-9689-3fb7d35c9422 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:51.114151 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93bc680b-c54a-49bc-9689-3fb7d35c9422 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:51.114907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93bc680b-c54a-49bc-9689-3fb7d35c9422 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:51.115339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-93bc680b-c54a-49bc-9689-3fb7d35c9422 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:51.253069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-93bc680b-c54a-49bc-9689-3fb7d35c9422 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:51.261423 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-93bc680b-c54a-49bc-9689-3fb7d35c9422 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1554 microversion: 2.1 time: 0.160640 Aug 04 15:08:51.261998 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3467/6930] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:51 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:08:51.281968 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9e746982-fbff-434e-ac67-288f8331cb7f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:08:51.282610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9e746982-fbff-434e-ac67-288f8331cb7f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:51.284580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:51.285274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:08:51.292631 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e746982-fbff-434e-ac67-288f8331cb7f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:51.293127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e746982-fbff-434e-ac67-288f8331cb7f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:51.293907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e746982-fbff-434e-ac67-288f8331cb7f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:51.294379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e746982-fbff-434e-ac67-288f8331cb7f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:51.426326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9e746982-fbff-434e-ac67-288f8331cb7f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:08:51.434384 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9e746982-fbff-434e-ac67-288f8331cb7f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1554 microversion: 2.1 time: 0.156341 Aug 04 15:08:51.434954 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3464/6931] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:08:51 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:08:53.070288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-032af271-1775-4dba-bcc5-c055b174b726 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82576914-28be-46bc-9c66-47c0ee10da4d"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:08:53.073410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-032af271-1775-4dba-bcc5-c055b174b726 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:08:53.080438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-032af271-1775-4dba-bcc5-c055b174b726 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:53.080918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-032af271-1775-4dba-bcc5-c055b174b726 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:53.081694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-032af271-1775-4dba-bcc5-c055b174b726 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:08:53.082137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-032af271-1775-4dba-bcc5-c055b174b726 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:08:53.325824 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-032af271-1775-4dba-bcc5-c055b174b726 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "POST /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259409 Aug 04 15:08:53.326451 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3468/6932] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 15:08:53 2022] POST /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:04.023930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-763ae8a6-427b-47af-90b9-c2a0e90a286b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:04.025074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-763ae8a6-427b-47af-90b9-c2a0e90a286b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:04.027837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:04.028642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=36 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:04.035521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-763ae8a6-427b-47af-90b9-c2a0e90a286b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:04.035988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-763ae8a6-427b-47af-90b9-c2a0e90a286b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:04.036771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-763ae8a6-427b-47af-90b9-c2a0e90a286b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:04.037248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-763ae8a6-427b-47af-90b9-c2a0e90a286b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:04.116744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-763ae8a6-427b-47af-90b9-c2a0e90a286b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lazy-loading 'services' on Instance uuid 59641b10-63e5-4c69-9429-7438d2f6523e {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:09:04.188431 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-763ae8a6-427b-47af-90b9-c2a0e90a286b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments/82576914-28be-46bc-9c66-47c0ee10da4d" status: 202 len: 0 microversion: 2.1 time: 0.168216 Aug 04 15:09:04.189053 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3465/6933] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:09:04 2022] DELETE /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments/82576914-28be-46bc-9c66-47c0ee10da4d => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 15:09:04.197456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:04.198957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:04.204609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-147d8b78-ea11-479b-a2e9-8918fd2df7bc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:04.207717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-147d8b78-ea11-479b-a2e9-8918fd2df7bc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:04.219050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-147d8b78-ea11-479b-a2e9-8918fd2df7bc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:04.219676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-147d8b78-ea11-479b-a2e9-8918fd2df7bc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:04.220474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-147d8b78-ea11-479b-a2e9-8918fd2df7bc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:04.220945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-147d8b78-ea11-479b-a2e9-8918fd2df7bc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:04.254404 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-147d8b78-ea11-479b-a2e9-8918fd2df7bc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059758 Aug 04 15:09:04.254972 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3469/6934] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:04 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:05.269200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-14c4ad13-61e2-4226-a431-3081b9cd1390 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:05.271596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-14c4ad13-61e2-4226-a431-3081b9cd1390 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:05.279502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14c4ad13-61e2-4226-a431-3081b9cd1390 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:05.279982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14c4ad13-61e2-4226-a431-3081b9cd1390 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:05.280776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14c4ad13-61e2-4226-a431-3081b9cd1390 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:05.281402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-14c4ad13-61e2-4226-a431-3081b9cd1390 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:05.312173 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-14c4ad13-61e2-4226-a431-3081b9cd1390 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048181 Aug 04 15:09:05.312752 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3466/6935] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:05 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:06.326855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-574c9721-66fa-48a5-9a29-4db7b8035f06 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:06.329874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-574c9721-66fa-48a5-9a29-4db7b8035f06 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:06.339734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-574c9721-66fa-48a5-9a29-4db7b8035f06 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:06.340183 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-574c9721-66fa-48a5-9a29-4db7b8035f06 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:06.340996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-574c9721-66fa-48a5-9a29-4db7b8035f06 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:06.341463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-574c9721-66fa-48a5-9a29-4db7b8035f06 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:06.374236 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-574c9721-66fa-48a5-9a29-4db7b8035f06 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053947 Aug 04 15:09:06.379686 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3470/6936] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:06 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:07.391468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c8c7907-58c5-403f-9387-7323510db553 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:07.393745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c8c7907-58c5-403f-9387-7323510db553 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:07.401376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8c7907-58c5-403f-9387-7323510db553 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:07.401847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8c7907-58c5-403f-9387-7323510db553 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:07.402651 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8c7907-58c5-403f-9387-7323510db553 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:07.403110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8c7907-58c5-403f-9387-7323510db553 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:07.437586 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c8c7907-58c5-403f-9387-7323510db553 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052762 Aug 04 15:09:07.438220 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3467/6937] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:07 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:08.450229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-09b811a6-a758-4bc7-b5a9-e9af2f8652a1 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:08.452400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-09b811a6-a758-4bc7-b5a9-e9af2f8652a1 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:08.459455 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09b811a6-a758-4bc7-b5a9-e9af2f8652a1 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:08.459914 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09b811a6-a758-4bc7-b5a9-e9af2f8652a1 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:08.460693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09b811a6-a758-4bc7-b5a9-e9af2f8652a1 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:08.461162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09b811a6-a758-4bc7-b5a9-e9af2f8652a1 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:08.495307 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-09b811a6-a758-4bc7-b5a9-e9af2f8652a1 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049162 Aug 04 15:09:08.495899 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3471/6938] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:08 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:09.507542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-994312dc-9e08-4b75-b664-2d662e5d19e9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:09.510462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-994312dc-9e08-4b75-b664-2d662e5d19e9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:09.516752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-994312dc-9e08-4b75-b664-2d662e5d19e9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:09.517256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-994312dc-9e08-4b75-b664-2d662e5d19e9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:09.518055 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-994312dc-9e08-4b75-b664-2d662e5d19e9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:09.518514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-994312dc-9e08-4b75-b664-2d662e5d19e9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:09.549404 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-994312dc-9e08-4b75-b664-2d662e5d19e9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046080 Aug 04 15:09:09.550018 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3468/6939] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:09 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 15:09:09.561969 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:09.562509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:09.569744 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:09.570196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:09.570968 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:09.572088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:09.653838 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] HTTP exception thrown: Instance 59641b10-63e5-4c69-9429-7438d2f6523e is not attached to volume 82576914-28be-46bc-9c66-47c0ee10da4d Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Request method failure captured: Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments/82576914-28be-46bc-9c66-47c0ee10da4d HTTP/1.1 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6-Dx552bq4Jjvwh4xGxpgP0GNlvvEPjPBp1FjWkNGSX-lZYsizv7j2t1Cwf2WpW77SggoAepnbQTIeIIY6UnNXQ41AXYsEgKJnqthQZwKeH8Og6kbKs2DcJpXLdNSyq5__UOWFx6RFnrOAdYhjOfdWLM6rrF7RhhqthTrYzsrYEU0Pg Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31eef56333fc4a49916b0f6300853540"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31eef56333fc4a49916b0f6300853540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}] Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: eae3858f48a54096ae2cdf02b159f5d9 Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 59641b10-63e5-4c69-9429-7438d2f6523e is not attached to volume 82576914-28be-46bc-9c66-47c0ee10da4d Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'server_id': '59641b10-63e5-4c69-9429-7438d2f6523e', 'id': '82576914-28be-46bc-9c66-47c0ee10da4d'} Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 82576914-28be-46bc-9c66-47c0ee10da4d. Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59641b10-63e5-4c69-9429-7438d2f6523e is not attached to volume 82576914-28be-46bc-9c66-47c0ee10da4d Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:09:09.673146 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:09:09.678046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:09:09.678046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:09:09.678046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59641b10-63e5-4c69-9429-7438d2f6523e is not attached to volume 82576914-28be-46bc-9c66-47c0ee10da4d Aug 04 15:09:09.678046 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:09:09.678046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Returning 404 to user: Instance 59641b10-63e5-4c69-9429-7438d2f6523e is not attached to volume 82576914-28be-46bc-9c66-47c0ee10da4d {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:09:09.678046 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7e2b16e5-8f94-406b-9337-247f360f195d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments/82576914-28be-46bc-9c66-47c0ee10da4d" status: 404 len: 154 microversion: 2.1 time: 0.117200 Aug 04 15:09:09.678046 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3472/6940] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:09:09 2022] DELETE /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e/os-volume_attachments/82576914-28be-46bc-9c66-47c0ee10da4d => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:09:13.045440 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b996e8ca-451b-49c6-ae25-afabda8b74ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:13.045938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b996e8ca-451b-49c6-ae25-afabda8b74ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:13.052802 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b996e8ca-451b-49c6-ae25-afabda8b74ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:13.053301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b996e8ca-451b-49c6-ae25-afabda8b74ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:13.054078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b996e8ca-451b-49c6-ae25-afabda8b74ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:13.054518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b996e8ca-451b-49c6-ae25-afabda8b74ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:13.079913 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b996e8ca-451b-49c6-ae25-afabda8b74ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:09:13.167605 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b996e8ca-451b-49c6-ae25-afabda8b74ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 204 len: 0 microversion: 2.1 time: 0.125508 Aug 04 15:09:13.169304 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3469/6941] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:09:13 2022] DELETE /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:09:13.178078 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e551e4fb-3480-4532-8104-be2c7373d387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:13.178513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e551e4fb-3480-4532-8104-be2c7373d387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:13.185747 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e551e4fb-3480-4532-8104-be2c7373d387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:13.186200 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e551e4fb-3480-4532-8104-be2c7373d387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:13.187042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e551e4fb-3480-4532-8104-be2c7373d387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:13.187669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e551e4fb-3480-4532-8104-be2c7373d387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:13.325094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e551e4fb-3480-4532-8104-be2c7373d387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:13.333447 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e551e4fb-3480-4532-8104-be2c7373d387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1560 microversion: 2.1 time: 0.159593 Aug 04 15:09:13.334009 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3473/6942] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:13 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:14.356769 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-12a291d2-1112-4ab1-94d1-063acdb28222 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:14.357702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-12a291d2-1112-4ab1-94d1-063acdb28222 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:14.365047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a291d2-1112-4ab1-94d1-063acdb28222 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:14.365519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a291d2-1112-4ab1-94d1-063acdb28222 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:14.366322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a291d2-1112-4ab1-94d1-063acdb28222 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:14.366781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-12a291d2-1112-4ab1-94d1-063acdb28222 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:14.505224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-12a291d2-1112-4ab1-94d1-063acdb28222 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:14.513837 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-12a291d2-1112-4ab1-94d1-063acdb28222 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1560 microversion: 2.1 time: 0.162019 Aug 04 15:09:14.514458 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3470/6943] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:14 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:15.534869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-67a1edb0-ae02-42aa-981f-3474a7c5d86a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:15.535842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-67a1edb0-ae02-42aa-981f-3474a7c5d86a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:15.547027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67a1edb0-ae02-42aa-981f-3474a7c5d86a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:15.547487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67a1edb0-ae02-42aa-981f-3474a7c5d86a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:15.548273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67a1edb0-ae02-42aa-981f-3474a7c5d86a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:15.548710 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67a1edb0-ae02-42aa-981f-3474a7c5d86a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:15.598266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-40b76ae9-bda4-40dd-a3ce-888cf969a4f5 req-62a88b9f-4be8-461f-8df3-9cc7e8d3bb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59641b10-63e5-4c69-9429-7438d2f6523e", "name": "network-vif-deleted", "tag": "2e95f6e1-51dd-487d-82fd-cd692779e36a"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:15.610208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-40b76ae9-bda4-40dd-a3ce-888cf969a4f5 req-62a88b9f-4be8-461f-8df3-9cc7e8d3bb13 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:15.611159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-40b76ae9-bda4-40dd-a3ce-888cf969a4f5 req-62a88b9f-4be8-461f-8df3-9cc7e8d3bb13 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:15.627865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67a1edb0-ae02-42aa-981f-3474a7c5d86a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:15.629632 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-40b76ae9-bda4-40dd-a3ce-888cf969a4f5 req-62a88b9f-4be8-461f-8df3-9cc7e8d3bb13 service nova] Creating event network-vif-deleted:2e95f6e1-51dd-487d-82fd-cd692779e36a for instance 59641b10-63e5-4c69-9429-7438d2f6523e on n-h2-844627-10 Aug 04 15:09:15.635872 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-40b76ae9-bda4-40dd-a3ce-888cf969a4f5 req-62a88b9f-4be8-461f-8df3-9cc7e8d3bb13 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041988 Aug 04 15:09:15.636608 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3471/6944] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:09:15.642975 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-67a1edb0-ae02-42aa-981f-3474a7c5d86a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 200 len: 1518 microversion: 2.1 time: 0.106580 Aug 04 15:09:15.651697 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3474/6945] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:15 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 1518 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:16.659907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:16.660622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 59641b10-63e5-4c69-9429-7438d2f6523e] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:16.667750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:16.668210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:16.669003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:16.669456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:16.682556 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] HTTP exception thrown: Instance 59641b10-63e5-4c69-9429-7438d2f6523e could not be found. Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Request method failure captured: Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e HTTP/1.1 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-Dx552bq4Jjvwh4xGxpgP0GNlvvEPjPBp1FjWkNGSX-lZYsizv7j2t1Cwf2WpW77SggoAepnbQTIeIIY6UnNXQ41AXYsEgKJnqthQZwKeH8Og6kbKs2DcJpXLdNSyq5__UOWFx6RFnrOAdYhjOfdWLM6rrF7RhhqthTrYzsrYEU0Pg Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31eef56333fc4a49916b0f6300853540"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31eef56333fc4a49916b0f6300853540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}] Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: eae3858f48a54096ae2cdf02b159f5d9 Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 59641b10-63e5-4c69-9429-7438d2f6523e could not be found. Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '59641b10-63e5-4c69-9429-7438d2f6523e'} Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59641b10-63e5-4c69-9429-7438d2f6523e could not be found. Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59641b10-63e5-4c69-9429-7438d2f6523e could not be found. Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:09:16.684161 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59641b10-63e5-4c69-9429-7438d2f6523e could not be found. Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Returning 404 to user: Instance 59641b10-63e5-4c69-9429-7438d2f6523e could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9e4d7e47-78ed-4c1b-af34-75f52ea6db02 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e" status: 404 len: 111 microversion: 2.1 time: 0.029989 Aug 04 15:09:16.688627 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3472/6946] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:16 2022] GET /compute/v2.1/servers/59641b10-63e5-4c69-9429-7438d2f6523e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:09:16.694346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-45100a13-5fd3-474f-ac58-a9e0c4777b65 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '.version_select at 0x7f46f2d07160>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:16.716515 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-45100a13-5fd3-474f-ac58-a9e0c4777b65 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1112602120" status: 202 len: 0 microversion: 2.1 time: 0.025973 Aug 04 15:09:16.717158 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3475/6947] 10.222.0.66 () {58 vars in 1278 bytes} [Thu Aug 4 15:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1112602120 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:09:16.735026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cad301d6-a73e-4fcd-a4e4-67f05936c413 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Action: 'create', calling method: .version_select at 0x7f47007d7ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-455493370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkaCz39U8soHRAAE0g2mumbDkejaCvuhFZ9w4TXaqxdzagp7F6SCGAn1n1CE0LgLyuNHKd9UHBfFRwC3jzwlxSGaXH5fBPHSoDkHudfIYPtX73ZTUWQv2HtO2nrl1cyRQ=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:16.750012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cad301d6-a73e-4fcd-a4e4-67f05936c413 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for project 31eef56333fc4a49916b0f6300853540. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:09:16.755403 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cad301d6-a73e-4fcd-a4e4-67f05936c413 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for user eae3858f48a54096ae2cdf02b159f5d9 and project 31eef56333fc4a49916b0f6300853540. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:09:16.783260 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cad301d6-a73e-4fcd-a4e4-67f05936c413 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052051 Aug 04 15:09:16.783752 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3473/6948] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:09:16 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:16.834045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-368632895", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-455493370", "networks": [{"uuid": "56181f6c-03b7-466c-b4ac-22b8223c5781"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:16.889927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] validate_networks() for [('56181f6c-03b7-466c-b4ac-22b8223c5781', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:09:17.291888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:09:17.292345 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:09:17.292819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:09:17.293599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:09:17.293732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:09:17.303486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:17.303938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:17.304823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:17.305214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:17.324569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for project 31eef56333fc4a49916b0f6300853540. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:09:17.330378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for user eae3858f48a54096ae2cdf02b159f5d9 and project 31eef56333fc4a49916b0f6300853540. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:09:17.342998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:09:17.345338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:09:17.403810 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3e8a045e-d5d7-4e68-bcdd-b02a6b6b5498 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573671 Aug 04 15:09:17.404471 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3476/6949] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:09:17.416303 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8be9dd91-7677-439a-9b7c-a76969f62241 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:17.416974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8be9dd91-7677-439a-9b7c-a76969f62241 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:17.473862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8be9dd91-7677-439a-9b7c-a76969f62241 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:17.481147 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8be9dd91-7677-439a-9b7c-a76969f62241 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1261 microversion: 2.1 time: 0.069369 Aug 04 15:09:17.481728 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3474/6950] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:17 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:18.507751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f98fc01d-25c4-4249-9f89-7389337de5b7 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:18.510793 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f98fc01d-25c4-4249-9f89-7389337de5b7 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:18.520136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f98fc01d-25c4-4249-9f89-7389337de5b7 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:18.520850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f98fc01d-25c4-4249-9f89-7389337de5b7 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:18.522025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f98fc01d-25c4-4249-9f89-7389337de5b7 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:18.522740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f98fc01d-25c4-4249-9f89-7389337de5b7 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:18.603745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f98fc01d-25c4-4249-9f89-7389337de5b7 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:18.612820 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f98fc01d-25c4-4249-9f89-7389337de5b7 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1321 microversion: 2.1 time: 0.113331 Aug 04 15:09:18.613896 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3477/6951] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:18 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1321 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:19.635499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2e84cf84-f2b3-464a-83b8-a709404bcabd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:19.636200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2e84cf84-f2b3-464a-83b8-a709404bcabd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:19.643505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e84cf84-f2b3-464a-83b8-a709404bcabd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:19.643964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e84cf84-f2b3-464a-83b8-a709404bcabd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:19.644773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e84cf84-f2b3-464a-83b8-a709404bcabd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:19.645261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2e84cf84-f2b3-464a-83b8-a709404bcabd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:19.888018 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2e84cf84-f2b3-464a-83b8-a709404bcabd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:19.896028 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2e84cf84-f2b3-464a-83b8-a709404bcabd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1361 microversion: 2.1 time: 0.264951 Aug 04 15:09:19.896623 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3475/6952] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:19 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:19.980622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d0842512-e1e2-4543-99f3-d10d8d247b96 req-5ca55bd1-6b06-4a1d-b132-ecef9fe86fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2d3015-3a8e-4714-8133-c83bd3677f47", "tag": "09d27308-5558-4d64-b80f-88c4ba2b845d"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:20.013935 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d0842512-e1e2-4543-99f3-d10d8d247b96 req-5ca55bd1-6b06-4a1d-b132-ecef9fe86fdd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:20.014468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d0842512-e1e2-4543-99f3-d10d8d247b96 req-5ca55bd1-6b06-4a1d-b132-ecef9fe86fdd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:20.033703 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d0842512-e1e2-4543-99f3-d10d8d247b96 req-5ca55bd1-6b06-4a1d-b132-ecef9fe86fdd service nova] Creating event network-changed:09d27308-5558-4d64-b80f-88c4ba2b845d for instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 on n-h2-844627-10 Aug 04 15:09:20.039717 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d0842512-e1e2-4543-99f3-d10d8d247b96 req-5ca55bd1-6b06-4a1d-b132-ecef9fe86fdd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062393 Aug 04 15:09:20.040360 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3478/6953] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:20.916435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ab013d67-72cb-4ea1-82d5-f5e84946b401 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:20.917104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ab013d67-72cb-4ea1-82d5-f5e84946b401 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:20.924256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab013d67-72cb-4ea1-82d5-f5e84946b401 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:20.924723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab013d67-72cb-4ea1-82d5-f5e84946b401 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:20.925556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab013d67-72cb-4ea1-82d5-f5e84946b401 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:20.926013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ab013d67-72cb-4ea1-82d5-f5e84946b401 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:21.067419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ab013d67-72cb-4ea1-82d5-f5e84946b401 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:21.075379 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ab013d67-72cb-4ea1-82d5-f5e84946b401 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1361 microversion: 2.1 time: 0.162933 Aug 04 15:09:21.075975 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3476/6954] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:20 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:22.096495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-de3b0ac1-9a4d-4320-9712-5e91ed4d3dba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:22.097232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-de3b0ac1-9a4d-4320-9712-5e91ed4d3dba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:22.105778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de3b0ac1-9a4d-4320-9712-5e91ed4d3dba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:22.106237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de3b0ac1-9a4d-4320-9712-5e91ed4d3dba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:22.107026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de3b0ac1-9a4d-4320-9712-5e91ed4d3dba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:22.107475 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-de3b0ac1-9a4d-4320-9712-5e91ed4d3dba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:22.256950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-de3b0ac1-9a4d-4320-9712-5e91ed4d3dba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:22.267313 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-de3b0ac1-9a4d-4320-9712-5e91ed4d3dba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1361 microversion: 2.1 time: 0.174888 Aug 04 15:09:22.268114 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3479/6955] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:22 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:23.288708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a758a26b-b8a4-43ad-8c75-4cec85404494 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:23.289489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a758a26b-b8a4-43ad-8c75-4cec85404494 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:23.297596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a758a26b-b8a4-43ad-8c75-4cec85404494 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:23.298061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a758a26b-b8a4-43ad-8c75-4cec85404494 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:23.298867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a758a26b-b8a4-43ad-8c75-4cec85404494 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:23.299402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a758a26b-b8a4-43ad-8c75-4cec85404494 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:23.469841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a758a26b-b8a4-43ad-8c75-4cec85404494 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:23.478235 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a758a26b-b8a4-43ad-8c75-4cec85404494 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1361 microversion: 2.1 time: 0.193483 Aug 04 15:09:23.478855 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3477/6956] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:23 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:24.499471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-df29ff8e-8b72-4643-9978-419ca493ebf2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:24.500130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-df29ff8e-8b72-4643-9978-419ca493ebf2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:24.507541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df29ff8e-8b72-4643-9978-419ca493ebf2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:24.508000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df29ff8e-8b72-4643-9978-419ca493ebf2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:24.509397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df29ff8e-8b72-4643-9978-419ca493ebf2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:24.509849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-df29ff8e-8b72-4643-9978-419ca493ebf2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:24.653170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-df29ff8e-8b72-4643-9978-419ca493ebf2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:24.661045 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-df29ff8e-8b72-4643-9978-419ca493ebf2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1361 microversion: 2.1 time: 0.165527 Aug 04 15:09:24.661644 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3480/6957] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:24 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:24.946040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-95c1d0de-3c1b-4d42-bc1b-c5411a2e821e req-210d79e0-d1b9-48c8-9ce2-3abe891d9d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2d3015-3a8e-4714-8133-c83bd3677f47", "name": "network-vif-plugged", "status": "completed", "tag": "09d27308-5558-4d64-b80f-88c4ba2b845d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:24.956944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-95c1d0de-3c1b-4d42-bc1b-c5411a2e821e req-210d79e0-d1b9-48c8-9ce2-3abe891d9d4a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:24.957415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-95c1d0de-3c1b-4d42-bc1b-c5411a2e821e req-210d79e0-d1b9-48c8-9ce2-3abe891d9d4a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:24.969535 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-95c1d0de-3c1b-4d42-bc1b-c5411a2e821e req-210d79e0-d1b9-48c8-9ce2-3abe891d9d4a service nova] Creating event network-vif-plugged:09d27308-5558-4d64-b80f-88c4ba2b845d for instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 on n-h2-844627-10 Aug 04 15:09:24.974797 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-95c1d0de-3c1b-4d42-bc1b-c5411a2e821e req-210d79e0-d1b9-48c8-9ce2-3abe891d9d4a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032512 Aug 04 15:09:24.975569 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3478/6958] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:25.680918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-160ef1ef-0ac5-4f06-b479-87d69b2c298d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:25.681532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-160ef1ef-0ac5-4f06-b479-87d69b2c298d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:25.688543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-160ef1ef-0ac5-4f06-b479-87d69b2c298d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:25.689026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-160ef1ef-0ac5-4f06-b479-87d69b2c298d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:25.689803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-160ef1ef-0ac5-4f06-b479-87d69b2c298d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:25.690243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-160ef1ef-0ac5-4f06-b479-87d69b2c298d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:25.851324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-160ef1ef-0ac5-4f06-b479-87d69b2c298d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:25.859159 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-160ef1ef-0ac5-4f06-b479-87d69b2c298d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1361 microversion: 2.1 time: 0.182128 Aug 04 15:09:25.859738 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3481/6959] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:25 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:26.881295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9f87d861-1eb3-44ee-98bf-a380ae682b20 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:26.882185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9f87d861-1eb3-44ee-98bf-a380ae682b20 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:26.888966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f87d861-1eb3-44ee-98bf-a380ae682b20 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:26.889439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f87d861-1eb3-44ee-98bf-a380ae682b20 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:26.890239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f87d861-1eb3-44ee-98bf-a380ae682b20 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:26.890701 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9f87d861-1eb3-44ee-98bf-a380ae682b20 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:27.137024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9f87d861-1eb3-44ee-98bf-a380ae682b20 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:27.145638 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9f87d861-1eb3-44ee-98bf-a380ae682b20 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1553 microversion: 2.1 time: 0.269524 Aug 04 15:09:27.146496 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3479/6960] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:26 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:27.167478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4379786a-4b0a-4ddc-a38e-e58e7d8c72f4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:27.168240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4379786a-4b0a-4ddc-a38e-e58e7d8c72f4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:27.175333 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4379786a-4b0a-4ddc-a38e-e58e7d8c72f4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:27.175786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4379786a-4b0a-4ddc-a38e-e58e7d8c72f4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:27.176787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4379786a-4b0a-4ddc-a38e-e58e7d8c72f4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:27.177409 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4379786a-4b0a-4ddc-a38e-e58e7d8c72f4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:27.316106 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:27.337786 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:27.403143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4379786a-4b0a-4ddc-a38e-e58e7d8c72f4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:27.410985 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4379786a-4b0a-4ddc-a38e-e58e7d8c72f4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1553 microversion: 2.1 time: 0.247577 Aug 04 15:09:27.411589 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3482/6961] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:27 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:28.929851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f844cac9-1ad7-4a84-8f55-148d0fd4153c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "568a723f-a3bc-40dc-aa67-a60a3de7fe46"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:28.932723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f844cac9-1ad7-4a84-8f55-148d0fd4153c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:28.934728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:28.941127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f844cac9-1ad7-4a84-8f55-148d0fd4153c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:28.941601 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f844cac9-1ad7-4a84-8f55-148d0fd4153c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:28.942390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f844cac9-1ad7-4a84-8f55-148d0fd4153c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:28.942839 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f844cac9-1ad7-4a84-8f55-148d0fd4153c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:29.188885 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f844cac9-1ad7-4a84-8f55-148d0fd4153c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "POST /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262455 Aug 04 15:09:29.189444 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3480/6962] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 15:09:28 2022] POST /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:39.906462 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-af6ccb38-933b-47b2-8730-d9bf81ff70c2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:39.907036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-af6ccb38-933b-47b2-8730-d9bf81ff70c2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:39.909073 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:39.909915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=70 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:39.916827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af6ccb38-933b-47b2-8730-d9bf81ff70c2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:39.917312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af6ccb38-933b-47b2-8730-d9bf81ff70c2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:39.918094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af6ccb38-933b-47b2-8730-d9bf81ff70c2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:39.918537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-af6ccb38-933b-47b2-8730-d9bf81ff70c2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:39.999372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-af6ccb38-933b-47b2-8730-d9bf81ff70c2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lazy-loading 'services' on Instance uuid 5e2d3015-3a8e-4714-8133-c83bd3677f47 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:09:40.073744 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-af6ccb38-933b-47b2-8730-d9bf81ff70c2 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments/568a723f-a3bc-40dc-aa67-a60a3de7fe46" status: 202 len: 0 microversion: 2.1 time: 0.171146 Aug 04 15:09:40.074346 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3483/6963] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:09:39 2022] DELETE /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments/568a723f-a3bc-40dc-aa67-a60a3de7fe46 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:09:40.083408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f2c27293-f186-4554-a9ff-18db8992c872 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:40.085917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f2c27293-f186-4554-a9ff-18db8992c872 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:40.089412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:40.090242 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:09:40.095976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2c27293-f186-4554-a9ff-18db8992c872 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:40.096465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2c27293-f186-4554-a9ff-18db8992c872 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:40.097354 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2c27293-f186-4554-a9ff-18db8992c872 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:40.097902 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f2c27293-f186-4554-a9ff-18db8992c872 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:40.136199 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f2c27293-f186-4554-a9ff-18db8992c872 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057170 Aug 04 15:09:40.136784 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3481/6964] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:40 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:41.148797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-771866c1-f884-4646-a780-19f454f91c0d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:41.151517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-771866c1-f884-4646-a780-19f454f91c0d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:41.159146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-771866c1-f884-4646-a780-19f454f91c0d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:41.159601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-771866c1-f884-4646-a780-19f454f91c0d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:41.160410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-771866c1-f884-4646-a780-19f454f91c0d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:41.160853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-771866c1-f884-4646-a780-19f454f91c0d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:41.192369 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-771866c1-f884-4646-a780-19f454f91c0d tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048208 Aug 04 15:09:41.192969 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3484/6965] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:41 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:42.205980 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f7596f54-6e97-4834-87b7-5cbf91e191be tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:42.208383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f7596f54-6e97-4834-87b7-5cbf91e191be tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:42.216304 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7596f54-6e97-4834-87b7-5cbf91e191be tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:42.216764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7596f54-6e97-4834-87b7-5cbf91e191be tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:42.217605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7596f54-6e97-4834-87b7-5cbf91e191be tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:42.218058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f7596f54-6e97-4834-87b7-5cbf91e191be tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:42.254332 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f7596f54-6e97-4834-87b7-5cbf91e191be tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052378 Aug 04 15:09:42.254917 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3482/6966] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:42 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:43.267754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f329eac-6b85-49f1-9344-86dfafcee088 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:43.270022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f329eac-6b85-49f1-9344-86dfafcee088 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:43.280661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f329eac-6b85-49f1-9344-86dfafcee088 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:43.281306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f329eac-6b85-49f1-9344-86dfafcee088 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:43.282210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f329eac-6b85-49f1-9344-86dfafcee088 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:43.282658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f329eac-6b85-49f1-9344-86dfafcee088 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:43.319428 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f329eac-6b85-49f1-9344-86dfafcee088 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055710 Aug 04 15:09:43.320138 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3485/6967] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:43 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:09:44.331928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9033f243-831b-43ae-913d-4c035073573f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:44.334772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9033f243-831b-43ae-913d-4c035073573f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:44.342932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9033f243-831b-43ae-913d-4c035073573f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:44.343386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9033f243-831b-43ae-913d-4c035073573f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:44.344184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9033f243-831b-43ae-913d-4c035073573f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:44.344638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9033f243-831b-43ae-913d-4c035073573f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:44.379279 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9033f243-831b-43ae-913d-4c035073573f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051512 Aug 04 15:09:44.379862 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3483/6968] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:44 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:45.392235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c09a8e8b-ec3c-4c45-a024-39cd4fdd16fd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:45.394491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c09a8e8b-ec3c-4c45-a024-39cd4fdd16fd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:45.401682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c09a8e8b-ec3c-4c45-a024-39cd4fdd16fd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:45.402129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c09a8e8b-ec3c-4c45-a024-39cd4fdd16fd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:45.402916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c09a8e8b-ec3c-4c45-a024-39cd4fdd16fd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:45.403351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c09a8e8b-ec3c-4c45-a024-39cd4fdd16fd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:45.436362 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c09a8e8b-ec3c-4c45-a024-39cd4fdd16fd tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048158 Aug 04 15:09:45.436913 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3486/6969] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:09:45 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 15:09:45.448311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:45.448903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:45.455748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:45.456205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:45.457011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:45.457473 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:45.534637 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] HTTP exception thrown: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 is not attached to volume 568a723f-a3bc-40dc-aa67-a60a3de7fe46 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Request method failure captured: Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments/568a723f-a3bc-40dc-aa67-a60a3de7fe46 HTTP/1.1 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-Dx552bq4Jjvwh4xGxpgP0GNlvvEPjPBp1FjWkNGSX-lZYsizv7j2t1Cwf2WpW77SggoAepnbQTIeIIY6UnNXQ41AXYsEgKJnqthQZwKeH8Og6kbKs2DcJpXLdNSyq5__UOWFx6RFnrOAdYhjOfdWLM6rrF7RhhqthTrYzsrYEU0Pg Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31eef56333fc4a49916b0f6300853540"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31eef56333fc4a49916b0f6300853540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}] Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: eae3858f48a54096ae2cdf02b159f5d9 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 is not attached to volume 568a723f-a3bc-40dc-aa67-a60a3de7fe46 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': '5e2d3015-3a8e-4714-8133-c83bd3677f47', 'id': '568a723f-a3bc-40dc-aa67-a60a3de7fe46'} Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 568a723f-a3bc-40dc-aa67-a60a3de7fe46. Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 is not attached to volume 568a723f-a3bc-40dc-aa67-a60a3de7fe46 Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:09:45.536583 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:09:45.540655 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:09:45.540655 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:09:45.540655 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 is not attached to volume 568a723f-a3bc-40dc-aa67-a60a3de7fe46 Aug 04 15:09:45.540655 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:45.540655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Returning 404 to user: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 is not attached to volume 568a723f-a3bc-40dc-aa67-a60a3de7fe46 {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:09:45.540655 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c053d9b2-cf0d-4fac-939c-a90bb7b4c375 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments/568a723f-a3bc-40dc-aa67-a60a3de7fe46" status: 404 len: 154 microversion: 2.1 time: 0.094544 Aug 04 15:09:45.540655 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3484/6970] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:09:45 2022] DELETE /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47/os-volume_attachments/568a723f-a3bc-40dc-aa67-a60a3de7fe46 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:09:48.882464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cb95511e-df1c-4330-9f14-62d1df1c2d39 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:48.883060 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cb95511e-df1c-4330-9f14-62d1df1c2d39 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:48.890403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb95511e-df1c-4330-9f14-62d1df1c2d39 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:48.890856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb95511e-df1c-4330-9f14-62d1df1c2d39 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:48.891635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb95511e-df1c-4330-9f14-62d1df1c2d39 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:48.892071 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb95511e-df1c-4330-9f14-62d1df1c2d39 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:48.919565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cb95511e-df1c-4330-9f14-62d1df1c2d39 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:09:49.001173 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cb95511e-df1c-4330-9f14-62d1df1c2d39 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 204 len: 0 microversion: 2.1 time: 0.122142 Aug 04 15:09:49.001800 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3487/6971] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:09:48 2022] DELETE /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:09:49.011345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1c97362b-ab01-4b04-a758-22a15ed5d150 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:49.012112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1c97362b-ab01-4b04-a758-22a15ed5d150 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:49.021774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c97362b-ab01-4b04-a758-22a15ed5d150 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:49.022291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c97362b-ab01-4b04-a758-22a15ed5d150 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:49.023177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c97362b-ab01-4b04-a758-22a15ed5d150 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:49.023649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1c97362b-ab01-4b04-a758-22a15ed5d150 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:49.168069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1c97362b-ab01-4b04-a758-22a15ed5d150 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:49.176066 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1c97362b-ab01-4b04-a758-22a15ed5d150 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1559 microversion: 2.1 time: 0.169405 Aug 04 15:09:49.176643 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3485/6972] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:49 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:09:50.198378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7f17ae1e-3397-42d0-8430-cd46e9fa8239 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:50.199094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7f17ae1e-3397-42d0-8430-cd46e9fa8239 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:50.206579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f17ae1e-3397-42d0-8430-cd46e9fa8239 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:50.207179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f17ae1e-3397-42d0-8430-cd46e9fa8239 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:50.208179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f17ae1e-3397-42d0-8430-cd46e9fa8239 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:50.208611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7f17ae1e-3397-42d0-8430-cd46e9fa8239 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:50.342497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7f17ae1e-3397-42d0-8430-cd46e9fa8239 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:50.350571 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7f17ae1e-3397-42d0-8430-cd46e9fa8239 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1559 microversion: 2.1 time: 0.156503 Aug 04 15:09:50.351148 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3488/6973] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:50 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:51.030053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f93274d3-7821-4256-aa2b-cbb023de0357 req-3d0374cb-66de-46aa-8d78-4f74a876d679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2d3015-3a8e-4714-8133-c83bd3677f47", "name": "network-vif-deleted", "tag": "09d27308-5558-4d64-b80f-88c4ba2b845d"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:51.042113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f93274d3-7821-4256-aa2b-cbb023de0357 req-3d0374cb-66de-46aa-8d78-4f74a876d679 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:51.042580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f93274d3-7821-4256-aa2b-cbb023de0357 req-3d0374cb-66de-46aa-8d78-4f74a876d679 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:51.057161 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f93274d3-7821-4256-aa2b-cbb023de0357 req-3d0374cb-66de-46aa-8d78-4f74a876d679 service nova] Creating event network-vif-deleted:09d27308-5558-4d64-b80f-88c4ba2b845d for instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 on n-h2-844627-10 Aug 04 15:09:51.062659 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f93274d3-7821-4256-aa2b-cbb023de0357 req-3d0374cb-66de-46aa-8d78-4f74a876d679 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035950 Aug 04 15:09:51.063535 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3486/6974] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:51.372094 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:51.372721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:51.381496 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:51.381972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:51.382767 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:51.383388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:51.422242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:51.423025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:51.423642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lazy-loading 'fault' on Instance uuid 5e2d3015-3a8e-4714-8133-c83bd3677f47 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:09:51.472405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:51.481721 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8a2d0f63-beb4-42af-9b9f-01ec703dd338 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 200 len: 1351 microversion: 2.1 time: 0.113920 Aug 04 15:09:51.482315 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3489/6975] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:51 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:52.508178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:52.509863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 5e2d3015-3a8e-4714-8133-c83bd3677f47] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:52.517200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:52.517691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:52.518527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:52.518987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:52.532456 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] HTTP exception thrown: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 could not be found. Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Request method failure captured: Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 HTTP/1.1 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-Dx552bq4Jjvwh4xGxpgP0GNlvvEPjPBp1FjWkNGSX-lZYsizv7j2t1Cwf2WpW77SggoAepnbQTIeIIY6UnNXQ41AXYsEgKJnqthQZwKeH8Og6kbKs2DcJpXLdNSyq5__UOWFx6RFnrOAdYhjOfdWLM6rrF7RhhqthTrYzsrYEU0Pg Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31eef56333fc4a49916b0f6300853540"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31eef56333fc4a49916b0f6300853540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}] Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: eae3858f48a54096ae2cdf02b159f5d9 Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 could not be found. Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '5e2d3015-3a8e-4714-8133-c83bd3677f47'} Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 could not be found. Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 could not be found. Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:09:52.534249 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 could not be found. Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Returning 404 to user: Instance 5e2d3015-3a8e-4714-8133-c83bd3677f47 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9bd4aeda-501a-4f5f-b023-817688e5eb67 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47" status: 404 len: 111 microversion: 2.1 time: 0.032731 Aug 04 15:09:52.538250 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3487/6976] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:52 2022] GET /compute/v2.1/servers/5e2d3015-3a8e-4714-8133-c83bd3677f47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:09:52.545229 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-83b4fbdc-2fb5-401c-ae60-14314995c064 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '.version_select at 0x7f47055484c0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:52.567163 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-83b4fbdc-2fb5-401c-ae60-14314995c064 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-455493370" status: 202 len: 0 microversion: 2.1 time: 0.025819 Aug 04 15:09:52.567748 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3490/6977] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 15:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-455493370 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 15:09:52.585201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d6c292df-172b-4aa6-be14-419acce783a9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Action: 'create', calling method: .version_select at 0x7f47055df820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2065245193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyZiVLftk2YFsbmG6DLJSBmZUQn/vuVDS1pA/C1OwPV/54qLH5Rf+xl8GKnPA2c2fzRLpBuBLHsujTmPjERkGDGD5gWI9LWcUZVWslhHDijA0yxgTlINCOpMSSj0gxY9w=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:52.604721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d6c292df-172b-4aa6-be14-419acce783a9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for project 31eef56333fc4a49916b0f6300853540. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:09:52.611075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-d6c292df-172b-4aa6-be14-419acce783a9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for user eae3858f48a54096ae2cdf02b159f5d9 and project 31eef56333fc4a49916b0f6300853540. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:09:52.636361 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d6c292df-172b-4aa6-be14-419acce783a9 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055094 Aug 04 15:09:52.637011 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3488/6978] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:09:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:09:52.693613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1611173683", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2065245193", "networks": [{"uuid": "56181f6c-03b7-466c-b4ac-22b8223c5781"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:52.749196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] validate_networks() for [('56181f6c-03b7-466c-b4ac-22b8223c5781', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:09:53.131141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:09:53.131576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:09:53.132058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:09:53.132472 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:09:53.132912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:09:53.141930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:53.142388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:53.143243 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:53.143689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:53.161815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for project 31eef56333fc4a49916b0f6300853540. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:09:53.167822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Getting quotas for user eae3858f48a54096ae2cdf02b159f5d9 and project 31eef56333fc4a49916b0f6300853540. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:09:53.180137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:09:53.182483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:09:53.228901 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d418910f-567a-46bd-946f-a85c1204f444 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539174 Aug 04 15:09:53.229892 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3491/6979] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:09:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:09:53.240555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f9d42658-115e-4e64-87ce-1d98f8a66be8 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:53.241310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f9d42658-115e-4e64-87ce-1d98f8a66be8 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:53.298787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f9d42658-115e-4e64-87ce-1d98f8a66be8 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:53.306416 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f9d42658-115e-4e64-87ce-1d98f8a66be8 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1263 microversion: 2.1 time: 0.069733 Aug 04 15:09:53.307021 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3489/6980] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:53 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:54.330704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5a9a43bf-c6cc-4501-b116-de49de128503 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:54.331757 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5a9a43bf-c6cc-4501-b116-de49de128503 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:54.343168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a9a43bf-c6cc-4501-b116-de49de128503 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:54.343616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a9a43bf-c6cc-4501-b116-de49de128503 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:54.344394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a9a43bf-c6cc-4501-b116-de49de128503 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:54.344830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5a9a43bf-c6cc-4501-b116-de49de128503 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:54.418208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5a9a43bf-c6cc-4501-b116-de49de128503 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:54.426217 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5a9a43bf-c6cc-4501-b116-de49de128503 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1321 microversion: 2.1 time: 0.102281 Aug 04 15:09:54.426812 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3492/6981] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:54 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1321 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:55.448706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-442ebf1d-1d69-4acf-8625-ed866624e573 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:55.449376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-442ebf1d-1d69-4acf-8625-ed866624e573 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:55.457014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-442ebf1d-1d69-4acf-8625-ed866624e573 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:55.457559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-442ebf1d-1d69-4acf-8625-ed866624e573 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:55.459358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-442ebf1d-1d69-4acf-8625-ed866624e573 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:55.459871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-442ebf1d-1d69-4acf-8625-ed866624e573 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:55.479949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e8f68a3b-da70-4aa7-b21a-7a6e0d00791c req-30d69f98-9b05-4aaa-9b88-5868aaa67199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d13b16c-d978-4480-b073-1a94d0637857", "tag": "7c48a943-e387-4d75-86e4-9f243a6a015a"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:09:55.495738 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e8f68a3b-da70-4aa7-b21a-7a6e0d00791c req-30d69f98-9b05-4aaa-9b88-5868aaa67199 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:55.496491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e8f68a3b-da70-4aa7-b21a-7a6e0d00791c req-30d69f98-9b05-4aaa-9b88-5868aaa67199 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:55.511607 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e8f68a3b-da70-4aa7-b21a-7a6e0d00791c req-30d69f98-9b05-4aaa-9b88-5868aaa67199 service nova] Creating event network-changed:7c48a943-e387-4d75-86e4-9f243a6a015a for instance 1d13b16c-d978-4480-b073-1a94d0637857 on n-h2-844627-10 Aug 04 15:09:55.516683 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e8f68a3b-da70-4aa7-b21a-7a6e0d00791c req-30d69f98-9b05-4aaa-9b88-5868aaa67199 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045816 Aug 04 15:09:55.517590 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3493/6982] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:09:56.062638 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-442ebf1d-1d69-4acf-8625-ed866624e573 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:56.070541 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-442ebf1d-1d69-4acf-8625-ed866624e573 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1363 microversion: 2.1 time: 0.626541 Aug 04 15:09:56.071768 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3490/6983] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:55 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1363 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:57.093171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cd30227c-eea0-4a52-abde-581b8e8e9387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:57.093873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cd30227c-eea0-4a52-abde-581b8e8e9387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:57.100489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd30227c-eea0-4a52-abde-581b8e8e9387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:57.100972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd30227c-eea0-4a52-abde-581b8e8e9387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:57.101740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd30227c-eea0-4a52-abde-581b8e8e9387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:57.102684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cd30227c-eea0-4a52-abde-581b8e8e9387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:57.317456 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cd30227c-eea0-4a52-abde-581b8e8e9387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:57.325116 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cd30227c-eea0-4a52-abde-581b8e8e9387 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1363 microversion: 2.1 time: 0.237072 Aug 04 15:09:57.325700 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3494/6984] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:57 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:58.346444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7698ac94-ca69-4759-95f0-64259f649b8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:58.347085 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7698ac94-ca69-4759-95f0-64259f649b8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:58.354395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7698ac94-ca69-4759-95f0-64259f649b8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:58.354867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7698ac94-ca69-4759-95f0-64259f649b8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:58.355653 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7698ac94-ca69-4759-95f0-64259f649b8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:58.356104 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7698ac94-ca69-4759-95f0-64259f649b8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:58.498553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7698ac94-ca69-4759-95f0-64259f649b8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:58.506167 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7698ac94-ca69-4759-95f0-64259f649b8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1363 microversion: 2.1 time: 0.163637 Aug 04 15:09:58.506755 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3491/6985] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:58 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:09:59.528192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f446a0bb-82c6-4094-ab1c-d43a4cee436b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:09:59.528816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f446a0bb-82c6-4094-ab1c-d43a4cee436b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:09:59.535934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f446a0bb-82c6-4094-ab1c-d43a4cee436b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:59.536401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f446a0bb-82c6-4094-ab1c-d43a4cee436b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:59.537219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f446a0bb-82c6-4094-ab1c-d43a4cee436b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:09:59.537668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f446a0bb-82c6-4094-ab1c-d43a4cee436b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:09:59.669220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f446a0bb-82c6-4094-ab1c-d43a4cee436b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:09:59.676792 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f446a0bb-82c6-4094-ab1c-d43a4cee436b tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1363 microversion: 2.1 time: 0.153233 Aug 04 15:09:59.677394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3495/6986] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:09:59 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:00.701223 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-014fce2a-96db-497f-8b6c-4b3deb912c32 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:00.701996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-014fce2a-96db-497f-8b6c-4b3deb912c32 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:00.709014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-014fce2a-96db-497f-8b6c-4b3deb912c32 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:00.709482 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-014fce2a-96db-497f-8b6c-4b3deb912c32 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:00.710267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-014fce2a-96db-497f-8b6c-4b3deb912c32 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:00.710715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-014fce2a-96db-497f-8b6c-4b3deb912c32 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:00.841092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-014fce2a-96db-497f-8b6c-4b3deb912c32 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:10:00.849100 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-014fce2a-96db-497f-8b6c-4b3deb912c32 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1363 microversion: 2.1 time: 0.154073 Aug 04 15:10:00.849670 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3492/6987] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:00 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:01.102868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-591a32d8-b157-4d17-af21-347b419300ac req-165bb897-a76a-4989-b977-921de372da38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d13b16c-d978-4480-b073-1a94d0637857", "name": "network-vif-plugged", "status": "completed", "tag": "7c48a943-e387-4d75-86e4-9f243a6a015a"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:10:01.113760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-591a32d8-b157-4d17-af21-347b419300ac req-165bb897-a76a-4989-b977-921de372da38 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:01.114367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-591a32d8-b157-4d17-af21-347b419300ac req-165bb897-a76a-4989-b977-921de372da38 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:01.127287 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-591a32d8-b157-4d17-af21-347b419300ac req-165bb897-a76a-4989-b977-921de372da38 service nova] Creating event network-vif-plugged:7c48a943-e387-4d75-86e4-9f243a6a015a for instance 1d13b16c-d978-4480-b073-1a94d0637857 on n-h2-844627-10 Aug 04 15:10:01.132290 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-591a32d8-b157-4d17-af21-347b419300ac req-165bb897-a76a-4989-b977-921de372da38 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033663 Aug 04 15:10:01.132919 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3496/6988] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:10:01.869546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-af2b073c-851d-4411-97cb-9d61eaddb878 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:01.870357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-af2b073c-851d-4411-97cb-9d61eaddb878 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:01.877335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2b073c-851d-4411-97cb-9d61eaddb878 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:01.877793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2b073c-851d-4411-97cb-9d61eaddb878 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:01.878580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2b073c-851d-4411-97cb-9d61eaddb878 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:01.879028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-af2b073c-851d-4411-97cb-9d61eaddb878 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:02.007504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-af2b073c-851d-4411-97cb-9d61eaddb878 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:10:02.015807 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-af2b073c-851d-4411-97cb-9d61eaddb878 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1363 microversion: 2.1 time: 0.150274 Aug 04 15:10:02.016495 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3493/6989] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:01 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:03.042827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ea3df8c6-dffe-4980-b2cb-0991ddc9bab5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:03.043523 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ea3df8c6-dffe-4980-b2cb-0991ddc9bab5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:03.049984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea3df8c6-dffe-4980-b2cb-0991ddc9bab5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:03.050438 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea3df8c6-dffe-4980-b2cb-0991ddc9bab5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:03.051212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea3df8c6-dffe-4980-b2cb-0991ddc9bab5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:03.051646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ea3df8c6-dffe-4980-b2cb-0991ddc9bab5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:03.151803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:03.174564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:03.195129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ea3df8c6-dffe-4980-b2cb-0991ddc9bab5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:10:03.203473 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ea3df8c6-dffe-4980-b2cb-0991ddc9bab5 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1554 microversion: 2.1 time: 0.165841 Aug 04 15:10:03.204308 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3497/6990] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:03 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:03.225932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-152fbc6e-1358-428d-97e7-50388aefa262 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:03.227559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-152fbc6e-1358-428d-97e7-50388aefa262 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:03.234073 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-152fbc6e-1358-428d-97e7-50388aefa262 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:03.234542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-152fbc6e-1358-428d-97e7-50388aefa262 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:03.235362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-152fbc6e-1358-428d-97e7-50388aefa262 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:03.235816 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-152fbc6e-1358-428d-97e7-50388aefa262 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:03.304026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:03.374021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-152fbc6e-1358-428d-97e7-50388aefa262 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:10:03.381925 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-152fbc6e-1358-428d-97e7-50388aefa262 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1554 microversion: 2.1 time: 0.160542 Aug 04 15:10:03.382508 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3494/6991] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:03 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:04.901344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0729ea68-b25f-4c5f-a989-69c9ebe44873 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f688a47a-d607-4ca9-a400-f1d2b163939f"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:10:04.903641 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0729ea68-b25f-4c5f-a989-69c9ebe44873 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:04.910815 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0729ea68-b25f-4c5f-a989-69c9ebe44873 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:04.911270 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0729ea68-b25f-4c5f-a989-69c9ebe44873 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:04.912039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0729ea68-b25f-4c5f-a989-69c9ebe44873 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:04.912478 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0729ea68-b25f-4c5f-a989-69c9ebe44873 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:05.128638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:05.148538 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0729ea68-b25f-4c5f-a989-69c9ebe44873 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "POST /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251203 Aug 04 15:10:05.149375 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3498/6992] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 15:10:04 2022] POST /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:10:15.937895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb002b6a-d05f-46fc-a164-22955f78cd8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:15.938512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb002b6a-d05f-46fc-a164-22955f78cd8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:15.940565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:15.941338 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=64 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:15.949107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb002b6a-d05f-46fc-a164-22955f78cd8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:15.949599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb002b6a-d05f-46fc-a164-22955f78cd8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:15.950448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb002b6a-d05f-46fc-a164-22955f78cd8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:15.950900 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb002b6a-d05f-46fc-a164-22955f78cd8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:16.044418 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-cb002b6a-d05f-46fc-a164-22955f78cd8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lazy-loading 'services' on Instance uuid 1d13b16c-d978-4480-b073-1a94d0637857 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:10:16.123404 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb002b6a-d05f-46fc-a164-22955f78cd8f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments/f688a47a-d607-4ca9-a400-f1d2b163939f" status: 202 len: 0 microversion: 2.1 time: 0.189730 Aug 04 15:10:16.124012 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3495/6993] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:10:15 2022] DELETE /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments/f688a47a-d607-4ca9-a400-f1d2b163939f => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:10:16.130596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:16.131469 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:16.136832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4fa1edde-f655-4969-99c7-9f1e05fa1794 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:16.139312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4fa1edde-f655-4969-99c7-9f1e05fa1794 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:16.147720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fa1edde-f655-4969-99c7-9f1e05fa1794 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:16.148240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fa1edde-f655-4969-99c7-9f1e05fa1794 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:16.149003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fa1edde-f655-4969-99c7-9f1e05fa1794 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:16.149442 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4fa1edde-f655-4969-99c7-9f1e05fa1794 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:16.188769 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4fa1edde-f655-4969-99c7-9f1e05fa1794 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059949 Aug 04 15:10:16.189394 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3499/6994] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:10:16 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:10:17.205536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ad5c2a41-7684-4b45-aeb7-045a4587b2a3 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:17.208221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ad5c2a41-7684-4b45-aeb7-045a4587b2a3 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:17.217838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad5c2a41-7684-4b45-aeb7-045a4587b2a3 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:17.217838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad5c2a41-7684-4b45-aeb7-045a4587b2a3 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:17.218877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad5c2a41-7684-4b45-aeb7-045a4587b2a3 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:17.219328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ad5c2a41-7684-4b45-aeb7-045a4587b2a3 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:17.259443 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ad5c2a41-7684-4b45-aeb7-045a4587b2a3 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059546 Aug 04 15:10:17.260243 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3496/6995] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:10:17 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:10:18.272947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-01282793-4b6e-4890-a82d-03f5483340ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:18.275850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-01282793-4b6e-4890-a82d-03f5483340ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:18.284036 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01282793-4b6e-4890-a82d-03f5483340ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:18.284516 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01282793-4b6e-4890-a82d-03f5483340ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:18.285357 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01282793-4b6e-4890-a82d-03f5483340ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:18.285979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-01282793-4b6e-4890-a82d-03f5483340ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:18.321908 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-01282793-4b6e-4890-a82d-03f5483340ee tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053785 Aug 04 15:10:18.327044 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3500/6996] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:10:18 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:10:19.334993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c6c17dfc-015c-45ff-a8d2-8066e3e14a81 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:19.337295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c6c17dfc-015c-45ff-a8d2-8066e3e14a81 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:19.344697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfc-015c-45ff-a8d2-8066e3e14a81 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:19.345368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfc-015c-45ff-a8d2-8066e3e14a81 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:19.346181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfc-015c-45ff-a8d2-8066e3e14a81 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:19.346640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c6c17dfc-015c-45ff-a8d2-8066e3e14a81 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:19.389342 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c6c17dfc-015c-45ff-a8d2-8066e3e14a81 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057682 Aug 04 15:10:19.390752 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3497/6997] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:10:19 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:10:20.406871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ebb92775-c2bc-4658-b62a-7d91d65c0ce6 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:20.409234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ebb92775-c2bc-4658-b62a-7d91d65c0ce6 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:20.417074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebb92775-c2bc-4658-b62a-7d91d65c0ce6 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:20.417557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebb92775-c2bc-4658-b62a-7d91d65c0ce6 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:20.418372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebb92775-c2bc-4658-b62a-7d91d65c0ce6 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:20.418821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ebb92775-c2bc-4658-b62a-7d91d65c0ce6 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:20.454885 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ebb92775-c2bc-4658-b62a-7d91d65c0ce6 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052299 Aug 04 15:10:20.455481 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3501/6998] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:10:20 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:10:21.467000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f13c7c71-b28b-4922-b352-1309fc48f30f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:21.469190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f13c7c71-b28b-4922-b352-1309fc48f30f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:21.476704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f13c7c71-b28b-4922-b352-1309fc48f30f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:21.477180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f13c7c71-b28b-4922-b352-1309fc48f30f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:21.477974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f13c7c71-b28b-4922-b352-1309fc48f30f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:21.478419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f13c7c71-b28b-4922-b352-1309fc48f30f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:21.514912 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f13c7c71-b28b-4922-b352-1309fc48f30f tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051988 Aug 04 15:10:21.515499 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3498/6999] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:10:21 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 15:10:21.527138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:21.527752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:21.535252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:21.535693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:21.536470 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:21.536928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:21.625010 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] HTTP exception thrown: Instance 1d13b16c-d978-4480-b073-1a94d0637857 is not attached to volume f688a47a-d607-4ca9-a400-f1d2b163939f Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Request method failure captured: Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments/f688a47a-d607-4ca9-a400-f1d2b163939f HTTP/1.1 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6-Dx552bq4Jjvwh4xGxpgP0GNlvvEPjPBp1FjWkNGSX-lZYsizv7j2t1Cwf2WpW77SggoAepnbQTIeIIY6UnNXQ41AXYsEgKJnqthQZwKeH8Og6kbKs2DcJpXLdNSyq5__UOWFx6RFnrOAdYhjOfdWLM6rrF7RhhqthTrYzsrYEU0Pg Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31eef56333fc4a49916b0f6300853540"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31eef56333fc4a49916b0f6300853540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}] Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: eae3858f48a54096ae2cdf02b159f5d9 Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 1d13b16c-d978-4480-b073-1a94d0637857 is not attached to volume f688a47a-d607-4ca9-a400-f1d2b163939f Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'server_id': '1d13b16c-d978-4480-b073-1a94d0637857', 'id': 'f688a47a-d607-4ca9-a400-f1d2b163939f'} Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f688a47a-d607-4ca9-a400-f1d2b163939f. Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d13b16c-d978-4480-b073-1a94d0637857 is not attached to volume f688a47a-d607-4ca9-a400-f1d2b163939f Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:10:21.626826 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:10:21.630762 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:10:21.630762 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:10:21.630762 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d13b16c-d978-4480-b073-1a94d0637857 is not attached to volume f688a47a-d607-4ca9-a400-f1d2b163939f Aug 04 15:10:21.630762 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:21.630762 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Returning 404 to user: Instance 1d13b16c-d978-4480-b073-1a94d0637857 is not attached to volume f688a47a-d607-4ca9-a400-f1d2b163939f {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:10:21.630762 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-77792731-d401-422e-836a-90dcc9e688a4 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments/f688a47a-d607-4ca9-a400-f1d2b163939f" status: 404 len: 154 microversion: 2.1 time: 0.105958 Aug 04 15:10:21.630762 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3502/7000] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:10:21 2022] DELETE /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857/os-volume_attachments/f688a47a-d607-4ca9-a400-f1d2b163939f => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:10:25.021572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ebbde3f2-1073-47c8-8323-df541d69e4fc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:25.022163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ebbde3f2-1073-47c8-8323-df541d69e4fc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:25.029770 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebbde3f2-1073-47c8-8323-df541d69e4fc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:25.030243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebbde3f2-1073-47c8-8323-df541d69e4fc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:25.031059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebbde3f2-1073-47c8-8323-df541d69e4fc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:25.031525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ebbde3f2-1073-47c8-8323-df541d69e4fc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:25.061029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ebbde3f2-1073-47c8-8323-df541d69e4fc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:10:25.153349 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ebbde3f2-1073-47c8-8323-df541d69e4fc tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 204 len: 0 microversion: 2.1 time: 0.135570 Aug 04 15:10:25.154131 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3499/7001] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:10:25 2022] DELETE /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:10:25.169763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7ca28eba-9634-4008-97ec-9a68207541ba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:25.170414 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7ca28eba-9634-4008-97ec-9a68207541ba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:25.178877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ca28eba-9634-4008-97ec-9a68207541ba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:25.179371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ca28eba-9634-4008-97ec-9a68207541ba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:25.180170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ca28eba-9634-4008-97ec-9a68207541ba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:25.180614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7ca28eba-9634-4008-97ec-9a68207541ba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:25.326293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7ca28eba-9634-4008-97ec-9a68207541ba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:10:25.337047 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7ca28eba-9634-4008-97ec-9a68207541ba tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1560 microversion: 2.1 time: 0.173913 Aug 04 15:10:25.337724 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3503/7002] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:25 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:26.360209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-746944d3-412f-4410-aa81-a9f74af74a49 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:26.361001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-746944d3-412f-4410-aa81-a9f74af74a49 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:26.368964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-746944d3-412f-4410-aa81-a9f74af74a49 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:26.369435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-746944d3-412f-4410-aa81-a9f74af74a49 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:26.370232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-746944d3-412f-4410-aa81-a9f74af74a49 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:26.370688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-746944d3-412f-4410-aa81-a9f74af74a49 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:26.512513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-746944d3-412f-4410-aa81-a9f74af74a49 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:10:26.520460 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-746944d3-412f-4410-aa81-a9f74af74a49 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1560 microversion: 2.1 time: 0.165314 Aug 04 15:10:26.521079 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3500/7003] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:26 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:27.226984 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-017cc99c-95e3-40f0-96f6-d95b6eaef92c req-ef9fce8d-cfac-433f-beb6-2a2c736db3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d13b16c-d978-4480-b073-1a94d0637857", "name": "network-vif-deleted", "tag": "7c48a943-e387-4d75-86e4-9f243a6a015a"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:10:27.239184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-017cc99c-95e3-40f0-96f6-d95b6eaef92c req-ef9fce8d-cfac-433f-beb6-2a2c736db3ea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:27.239627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-017cc99c-95e3-40f0-96f6-d95b6eaef92c req-ef9fce8d-cfac-433f-beb6-2a2c736db3ea service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:27.253194 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-017cc99c-95e3-40f0-96f6-d95b6eaef92c req-ef9fce8d-cfac-433f-beb6-2a2c736db3ea service nova] Creating event network-vif-deleted:7c48a943-e387-4d75-86e4-9f243a6a015a for instance 1d13b16c-d978-4480-b073-1a94d0637857 on n-h2-844627-10 Aug 04 15:10:27.259367 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-017cc99c-95e3-40f0-96f6-d95b6eaef92c req-ef9fce8d-cfac-433f-beb6-2a2c736db3ea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035211 Aug 04 15:10:27.259987 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3504/7004] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:10:27.541546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:27.542184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:27.549918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:27.550345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:27.551150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:27.551608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:27.586781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:27.587324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:27.587762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lazy-loading 'fault' on Instance uuid 1d13b16c-d978-4480-b073-1a94d0637857 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:10:27.631896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae3858f48a54096ae2cdf02b159f5d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eef56333fc4a49916b0f6300853540', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:10:27.641857 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5d955cbd-6824-4610-ae73-56379a62390c tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 200 len: 1353 microversion: 2.1 time: 0.104340 Aug 04 15:10:27.652562 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3501/7005] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:27 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 1353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:28.668785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:28.669529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] [instance: 1d13b16c-d978-4480-b073-1a94d0637857] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:28.676661 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:28.677147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:28.677922 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:28.678369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:28.693552 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] HTTP exception thrown: Instance 1d13b16c-d978-4480-b073-1a94d0637857 could not be found. Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Request method failure captured: Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 HTTP/1.1 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6-Dx552bq4Jjvwh4xGxpgP0GNlvvEPjPBp1FjWkNGSX-lZYsizv7j2t1Cwf2WpW77SggoAepnbQTIeIIY6UnNXQ41AXYsEgKJnqthQZwKeH8Og6kbKs2DcJpXLdNSyq5__UOWFx6RFnrOAdYhjOfdWLM6rrF7RhhqthTrYzsrYEU0Pg Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31eef56333fc4a49916b0f6300853540"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31eef56333fc4a49916b0f6300853540"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31eef56333fc4a49916b0f6300853540"}]}] Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 31eef56333fc4a49916b0f6300853540 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-494218800 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: eae3858f48a54096ae2cdf02b159f5d9 Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestEncryptedCinderVolumes-494218800-project Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 1d13b16c-d978-4480-b073-1a94d0637857 could not be found. Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '1d13b16c-d978-4480-b073-1a94d0637857'} Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d13b16c-d978-4480-b073-1a94d0637857 could not be found. Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d13b16c-d978-4480-b073-1a94d0637857 could not be found. Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:10:28.695227 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d13b16c-d978-4480-b073-1a94d0637857 could not be found. Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Returning 404 to user: Instance 1d13b16c-d978-4480-b073-1a94d0637857 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5f7af28c-65d2-471e-b389-57e7e6d90e7a tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857" status: 404 len: 111 microversion: 2.1 time: 0.032705 Aug 04 15:10:28.699664 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3505/7006] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:28 2022] GET /compute/v2.1/servers/1d13b16c-d978-4480-b073-1a94d0637857 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 15:10:28.705554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8dcfe5cb-d2e2-4597-ada6-3a2b06248f68 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] Calling method '.version_select at 0x7f470559e700>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:28.725573 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8dcfe5cb-d2e2-4597-ada6-3a2b06248f68 tempest-TestEncryptedCinderVolumes-494218800 tempest-TestEncryptedCinderVolumes-494218800-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2065245193" status: 202 len: 0 microversion: 2.1 time: 0.023837 Aug 04 15:10:28.726148 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3502/7007] 10.222.0.66 () {58 vars in 1278 bytes} [Thu Aug 4 15:10:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2065245193 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:10:56.014993 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=14 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:56.015734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=34 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:56.019605 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5ccf1661-3766-4fac-a640-053994bb4d63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'create', calling method: .version_select at 0x7f46f300f310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-317016496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGqjBE6tRuS3pJIIfsIFZ3HGIsI70VMRx8xIUeaDCixc3q3jV3/bIiNfnt5PDwrbFmcRAi+j+lrHMD+Xs1pBeqN++DmFY91ZgAMHGJJUPP7BYiKLvCX8xINp1Wg0mCx/g=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:10:56.035732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5ccf1661-3766-4fac-a640-053994bb4d63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Getting quotas for project 52ccdc59c6ac4b778411600be38dc225. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:10:56.041654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-5ccf1661-3766-4fac-a640-053994bb4d63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Getting quotas for user 4d7d2f3930a449d9afe3f92540a05adc and project 52ccdc59c6ac4b778411600be38dc225. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:10:56.070620 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5ccf1661-3766-4fac-a640-053994bb4d63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056248 Aug 04 15:10:56.071230 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3506/7008] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:10:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:10:56.127492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:56.128251 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:10:56.133302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1390182965", "imageRef": "729d2920-3772-467b-9cca-b549e57e2322", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-317016496", "networks": [{"uuid": "e8dc0ce6-4704-4ab9-995f-c5c0e6d8fa98"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:10:56.187829 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] validate_networks() for [('e8dc0ce6-4704-4ab9-995f-c5c0e6d8fa98', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:10:56.583982 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:10:56.584455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:10:56.584969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:10:56.585888 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:10:56.586347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:10:56.595405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:56.595867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:56.596686 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:56.597178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:56.615100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Getting quotas for project 52ccdc59c6ac4b778411600be38dc225. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:10:56.620364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Getting quotas for user 4d7d2f3930a449d9afe3f92540a05adc and project 52ccdc59c6ac4b778411600be38dc225. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:10:56.632937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:10:56.635326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='729d2920-3772-467b-9cca-b549e57e2322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:10:56.681538 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [3813a5cc-9b16-4a30-bcfb-2208639cc63f] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:10:57.689198 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [3813a5cc-9b16-4a30-bcfb-2208639cc63f] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 41460. Aug 04 15:10:57.693393 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6fbe7bb4-c11c-4820-983f-4da808e23ece tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.567915 Aug 04 15:10:57.694065 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3503/7009] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:10:57.706544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f0593271-0574-43b1-a395-c0686732fcb7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:57.707108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f0593271-0574-43b1-a395-c0686732fcb7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:57.769042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f0593271-0574-43b1-a395-c0686732fcb7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:10:57.776384 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f0593271-0574-43b1-a395-c0686732fcb7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1258 microversion: 2.1 time: 0.074857 Aug 04 15:10:57.776987 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3507/7010] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:57 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:58.807721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ef65cbbc-12f4-4028-827a-92a9a397e98a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:58.808585 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ef65cbbc-12f4-4028-827a-92a9a397e98a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:58.817146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef65cbbc-12f4-4028-827a-92a9a397e98a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:58.817864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef65cbbc-12f4-4028-827a-92a9a397e98a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:58.818988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef65cbbc-12f4-4028-827a-92a9a397e98a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:58.819454 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ef65cbbc-12f4-4028-827a-92a9a397e98a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:58.915490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ef65cbbc-12f4-4028-827a-92a9a397e98a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:10:58.925570 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ef65cbbc-12f4-4028-827a-92a9a397e98a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1316 microversion: 2.1 time: 0.123332 Aug 04 15:10:58.926257 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3504/7011] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:58 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1316 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:10:59.947708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3efb2f39-e3ee-4a5a-a2a2-ff3cf31a6f64 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:10:59.948316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3efb2f39-e3ee-4a5a-a2a2-ff3cf31a6f64 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:10:59.956423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3efb2f39-e3ee-4a5a-a2a2-ff3cf31a6f64 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:59.956901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3efb2f39-e3ee-4a5a-a2a2-ff3cf31a6f64 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:10:59.957688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3efb2f39-e3ee-4a5a-a2a2-ff3cf31a6f64 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:10:59.958192 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3efb2f39-e3ee-4a5a-a2a2-ff3cf31a6f64 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:00.116139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3efb2f39-e3ee-4a5a-a2a2-ff3cf31a6f64 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:00.124023 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3efb2f39-e3ee-4a5a-a2a2-ff3cf31a6f64 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.180695 Aug 04 15:11:00.124620 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3508/7012] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:10:59 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:01.145571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8e223854-af9e-4572-a451-8de01fdd4d90 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:01.146351 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8e223854-af9e-4572-a451-8de01fdd4d90 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:01.158655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e223854-af9e-4572-a451-8de01fdd4d90 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:01.159459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e223854-af9e-4572-a451-8de01fdd4d90 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:01.161090 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e223854-af9e-4572-a451-8de01fdd4d90 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:01.165537 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8e223854-af9e-4572-a451-8de01fdd4d90 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:01.309430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8e223854-af9e-4572-a451-8de01fdd4d90 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:01.317539 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8e223854-af9e-4572-a451-8de01fdd4d90 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.175835 Aug 04 15:11:01.318129 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3505/7013] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:01 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:02.338582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9550bc40-fc6e-4483-bd82-d28bffdfc6ac tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:02.339227 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9550bc40-fc6e-4483-bd82-d28bffdfc6ac tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:02.345870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9550bc40-fc6e-4483-bd82-d28bffdfc6ac tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:02.346304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9550bc40-fc6e-4483-bd82-d28bffdfc6ac tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:02.347111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9550bc40-fc6e-4483-bd82-d28bffdfc6ac tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:02.347537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9550bc40-fc6e-4483-bd82-d28bffdfc6ac tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:02.494289 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9550bc40-fc6e-4483-bd82-d28bffdfc6ac tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:02.502582 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9550bc40-fc6e-4483-bd82-d28bffdfc6ac tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.167919 Aug 04 15:11:02.503532 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3509/7014] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:02 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:03.523961 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f6554320-3945-468e-8ebd-d957352bbd50 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:03.524602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f6554320-3945-468e-8ebd-d957352bbd50 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:03.532163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6554320-3945-468e-8ebd-d957352bbd50 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:03.532635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6554320-3945-468e-8ebd-d957352bbd50 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:03.533457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6554320-3945-468e-8ebd-d957352bbd50 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:03.533915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6554320-3945-468e-8ebd-d957352bbd50 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:03.699805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f6554320-3945-468e-8ebd-d957352bbd50 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:03.708070 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f6554320-3945-468e-8ebd-d957352bbd50 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.188228 Aug 04 15:11:03.708669 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3506/7015] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:03 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:04.729407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4e8993f0-8f1f-45fa-957d-e79923f39e9e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:04.730198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4e8993f0-8f1f-45fa-957d-e79923f39e9e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:04.737280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e8993f0-8f1f-45fa-957d-e79923f39e9e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:04.737743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e8993f0-8f1f-45fa-957d-e79923f39e9e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:04.738642 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e8993f0-8f1f-45fa-957d-e79923f39e9e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:04.739145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4e8993f0-8f1f-45fa-957d-e79923f39e9e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:04.885883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4e8993f0-8f1f-45fa-957d-e79923f39e9e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:04.894227 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4e8993f0-8f1f-45fa-957d-e79923f39e9e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.169009 Aug 04 15:11:04.894818 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3510/7016] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:04 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:05.918074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4d461bfb-24f9-4da9-867a-7f8a13d4a29d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:05.919712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4d461bfb-24f9-4da9-867a-7f8a13d4a29d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:05.928702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d461bfb-24f9-4da9-867a-7f8a13d4a29d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:05.929356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d461bfb-24f9-4da9-867a-7f8a13d4a29d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:05.930171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d461bfb-24f9-4da9-867a-7f8a13d4a29d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:05.930632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4d461bfb-24f9-4da9-867a-7f8a13d4a29d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:06.083809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4d461bfb-24f9-4da9-867a-7f8a13d4a29d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:06.093264 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4d461bfb-24f9-4da9-867a-7f8a13d4a29d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.181252 Aug 04 15:11:06.094706 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3507/7017] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:05 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:07.114275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33775cd6-5730-40dd-a310-554970ed0c72 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:07.114900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-33775cd6-5730-40dd-a310-554970ed0c72 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:07.122160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33775cd6-5730-40dd-a310-554970ed0c72 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:07.122611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33775cd6-5730-40dd-a310-554970ed0c72 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:07.123379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33775cd6-5730-40dd-a310-554970ed0c72 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:07.123817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33775cd6-5730-40dd-a310-554970ed0c72 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:07.263285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-33775cd6-5730-40dd-a310-554970ed0c72 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:07.270926 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-33775cd6-5730-40dd-a310-554970ed0c72 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.160599 Aug 04 15:11:07.271507 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3511/7018] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:07 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:08.292132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ccde0173-8202-4fe9-8277-e01797e22273 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:08.292944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ccde0173-8202-4fe9-8277-e01797e22273 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:08.294894 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:11:08.295556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:11:08.303152 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccde0173-8202-4fe9-8277-e01797e22273 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:08.303620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccde0173-8202-4fe9-8277-e01797e22273 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:08.304404 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccde0173-8202-4fe9-8277-e01797e22273 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:08.305513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ccde0173-8202-4fe9-8277-e01797e22273 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:08.431743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ccde0173-8202-4fe9-8277-e01797e22273 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:08.440116 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ccde0173-8202-4fe9-8277-e01797e22273 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.152224 Aug 04 15:11:08.440702 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3508/7019] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:08 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:09.460495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4553c899-837f-4bcc-b17d-3343d0fdbeaa tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:09.461191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4553c899-837f-4bcc-b17d-3343d0fdbeaa tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:09.463136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:11:09.469111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4553c899-837f-4bcc-b17d-3343d0fdbeaa tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:09.469569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4553c899-837f-4bcc-b17d-3343d0fdbeaa tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:09.470350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4553c899-837f-4bcc-b17d-3343d0fdbeaa tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:09.470797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4553c899-837f-4bcc-b17d-3343d0fdbeaa tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:09.607705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4553c899-837f-4bcc-b17d-3343d0fdbeaa tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:09.615590 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4553c899-837f-4bcc-b17d-3343d0fdbeaa tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.159225 Aug 04 15:11:09.616293 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3512/7020] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:09 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:10.638964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5bcae13f-0294-421c-a903-d0828ae36516 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:10.639586 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5bcae13f-0294-421c-a903-d0828ae36516 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:10.646100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bcae13f-0294-421c-a903-d0828ae36516 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:10.646562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bcae13f-0294-421c-a903-d0828ae36516 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:10.647347 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bcae13f-0294-421c-a903-d0828ae36516 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:10.647796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5bcae13f-0294-421c-a903-d0828ae36516 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:10.865003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5bcae13f-0294-421c-a903-d0828ae36516 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:10.873161 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5bcae13f-0294-421c-a903-d0828ae36516 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.238267 Aug 04 15:11:10.873828 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3509/7021] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:10 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:11.150778 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-9e45d120-a00d-4626-8f9f-cefabc158ee2 req-8d660ab2-4b16-4307-b6cc-94f3b3244cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefd47b4-712c-42e1-b94a-c6e8406fbb2d", "tag": "9b97b52c-9002-4e1b-a0fd-afe90605f770"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:11:11.164898 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9e45d120-a00d-4626-8f9f-cefabc158ee2 req-8d660ab2-4b16-4307-b6cc-94f3b3244cfa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:11.165618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9e45d120-a00d-4626-8f9f-cefabc158ee2 req-8d660ab2-4b16-4307-b6cc-94f3b3244cfa service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:11.177762 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9e45d120-a00d-4626-8f9f-cefabc158ee2 req-8d660ab2-4b16-4307-b6cc-94f3b3244cfa service nova] Creating event network-changed:9b97b52c-9002-4e1b-a0fd-afe90605f770 for instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d on n-h1-844627-10 Aug 04 15:11:11.184545 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-9e45d120-a00d-4626-8f9f-cefabc158ee2 req-8d660ab2-4b16-4307-b6cc-94f3b3244cfa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037692 Aug 04 15:11:11.185497 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3513/7022] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:11:11.894495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3b63f671-1c0d-4a38-9573-91cb4a676174 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:11.895037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3b63f671-1c0d-4a38-9573-91cb4a676174 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:11.903036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b63f671-1c0d-4a38-9573-91cb4a676174 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:11.903505 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b63f671-1c0d-4a38-9573-91cb4a676174 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:11.904302 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b63f671-1c0d-4a38-9573-91cb4a676174 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:11.904755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3b63f671-1c0d-4a38-9573-91cb4a676174 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:12.041069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3b63f671-1c0d-4a38-9573-91cb4a676174 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:12.048670 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3b63f671-1c0d-4a38-9573-91cb4a676174 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.158136 Aug 04 15:11:12.049286 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3510/7023] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:11 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:13.069779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-67059490-05ab-4bf5-a592-0b20513c38ef tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:13.070490 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-67059490-05ab-4bf5-a592-0b20513c38ef tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:13.077774 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67059490-05ab-4bf5-a592-0b20513c38ef tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:13.078234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67059490-05ab-4bf5-a592-0b20513c38ef tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:13.079012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67059490-05ab-4bf5-a592-0b20513c38ef tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:13.079453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-67059490-05ab-4bf5-a592-0b20513c38ef tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:13.212562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-67059490-05ab-4bf5-a592-0b20513c38ef tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:13.220377 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-67059490-05ab-4bf5-a592-0b20513c38ef tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.154854 Aug 04 15:11:13.220985 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3514/7024] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:13 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:14.241841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9284e47b-dc03-46cb-80f2-0fa4b9d7cd17 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:14.243116 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9284e47b-dc03-46cb-80f2-0fa4b9d7cd17 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:14.250300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9284e47b-dc03-46cb-80f2-0fa4b9d7cd17 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:14.250762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9284e47b-dc03-46cb-80f2-0fa4b9d7cd17 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:14.251546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9284e47b-dc03-46cb-80f2-0fa4b9d7cd17 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:14.251994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9284e47b-dc03-46cb-80f2-0fa4b9d7cd17 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:14.380662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9284e47b-dc03-46cb-80f2-0fa4b9d7cd17 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:14.388175 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9284e47b-dc03-46cb-80f2-0fa4b9d7cd17 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.150212 Aug 04 15:11:14.388744 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3511/7025] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:14 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:15.409159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-07c1aedb-8f1d-4958-857b-1849d3d77df1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:15.409807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-07c1aedb-8f1d-4958-857b-1849d3d77df1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:15.417486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07c1aedb-8f1d-4958-857b-1849d3d77df1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:15.417880 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07c1aedb-8f1d-4958-857b-1849d3d77df1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:15.418652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07c1aedb-8f1d-4958-857b-1849d3d77df1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:15.419089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-07c1aedb-8f1d-4958-857b-1849d3d77df1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:15.554088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-07c1aedb-8f1d-4958-857b-1849d3d77df1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:15.561772 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-07c1aedb-8f1d-4958-857b-1849d3d77df1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.156536 Aug 04 15:11:15.562364 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3515/7026] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:15 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:16.110458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-17db89cb-afd0-4725-ba00-a7271de87fe8 req-14e420a5-e7d3-4bfe-ab7a-57c499451f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefd47b4-712c-42e1-b94a-c6e8406fbb2d", "name": "network-vif-plugged", "status": "completed", "tag": "9b97b52c-9002-4e1b-a0fd-afe90605f770"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:11:16.123551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-17db89cb-afd0-4725-ba00-a7271de87fe8 req-14e420a5-e7d3-4bfe-ab7a-57c499451f47 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:16.124173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-17db89cb-afd0-4725-ba00-a7271de87fe8 req-14e420a5-e7d3-4bfe-ab7a-57c499451f47 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:16.137498 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-17db89cb-afd0-4725-ba00-a7271de87fe8 req-14e420a5-e7d3-4bfe-ab7a-57c499451f47 service nova] Creating event network-vif-plugged:9b97b52c-9002-4e1b-a0fd-afe90605f770 for instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d on n-h1-844627-10 Aug 04 15:11:16.142946 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-17db89cb-afd0-4725-ba00-a7271de87fe8 req-14e420a5-e7d3-4bfe-ab7a-57c499451f47 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038171 Aug 04 15:11:16.143731 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3512/7027] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:11:16.582771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-163d7dae-676f-4ef0-848e-b807114ab201 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:16.583317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-163d7dae-676f-4ef0-848e-b807114ab201 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:16.590397 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-163d7dae-676f-4ef0-848e-b807114ab201 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:16.590856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-163d7dae-676f-4ef0-848e-b807114ab201 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:16.591636 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-163d7dae-676f-4ef0-848e-b807114ab201 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:16.592084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-163d7dae-676f-4ef0-848e-b807114ab201 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:16.733410 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-163d7dae-676f-4ef0-848e-b807114ab201 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:16.740989 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-163d7dae-676f-4ef0-848e-b807114ab201 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1358 microversion: 2.1 time: 0.162218 Aug 04 15:11:16.741572 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3516/7028] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:16 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:17.763987 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d6087411-b360-491a-9499-0fe65b97f5f2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:17.764620 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d6087411-b360-491a-9499-0fe65b97f5f2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:17.773996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6087411-b360-491a-9499-0fe65b97f5f2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:17.774599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6087411-b360-491a-9499-0fe65b97f5f2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:17.775410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6087411-b360-491a-9499-0fe65b97f5f2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:17.775868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d6087411-b360-491a-9499-0fe65b97f5f2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:17.908093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d6087411-b360-491a-9499-0fe65b97f5f2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:17.916722 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d6087411-b360-491a-9499-0fe65b97f5f2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1548 microversion: 2.1 time: 0.157310 Aug 04 15:11:17.917475 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3513/7029] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:17 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:17.937114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-88977dc7-b938-45d1-a4a3-c4f5c51c0a63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:17.937733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-88977dc7-b938-45d1-a4a3-c4f5c51c0a63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:17.944832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88977dc7-b938-45d1-a4a3-c4f5c51c0a63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:17.945924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88977dc7-b938-45d1-a4a3-c4f5c51c0a63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:17.946706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88977dc7-b938-45d1-a4a3-c4f5c51c0a63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:17.947143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-88977dc7-b938-45d1-a4a3-c4f5c51c0a63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:18.077819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-88977dc7-b938-45d1-a4a3-c4f5c51c0a63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:18.085262 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-88977dc7-b938-45d1-a4a3-c4f5c51c0a63 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1548 microversion: 2.1 time: 0.152071 Aug 04 15:11:18.085835 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3517/7030] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:17 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:18.106702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b73c2f00-e1f8-4cdc-892d-f4794774e2b2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:18.111445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b73c2f00-e1f8-4cdc-892d-f4794774e2b2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:18.112227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b73c2f00-e1f8-4cdc-892d-f4794774e2b2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Searching by: {'deleted': False, 'project_id': '52ccdc59c6ac4b778411600be38dc225'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 15:11:18.118321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b73c2f00-e1f8-4cdc-892d-f4794774e2b2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:18.118783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b73c2f00-e1f8-4cdc-892d-f4794774e2b2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:18.119598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b73c2f00-e1f8-4cdc-892d-f4794774e2b2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:18.120049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b73c2f00-e1f8-4cdc-892d-f4794774e2b2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:18.143681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-b73c2f00-e1f8-4cdc-892d-f4794774e2b2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 15:11:18.171198 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b73c2f00-e1f8-4cdc-892d-f4794774e2b2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068293 Aug 04 15:11:18.171787 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3514/7031] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 15:11:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:11:18.183680 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd17dd83-a7dd-4870-83ed-64de3bd5dbeb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:18.184330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd17dd83-a7dd-4870-83ed-64de3bd5dbeb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:18.190520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd17dd83-a7dd-4870-83ed-64de3bd5dbeb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:18.190978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd17dd83-a7dd-4870-83ed-64de3bd5dbeb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:18.191810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd17dd83-a7dd-4870-83ed-64de3bd5dbeb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:18.192256 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd17dd83-a7dd-4870-83ed-64de3bd5dbeb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:18.330335 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dd17dd83-a7dd-4870-83ed-64de3bd5dbeb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:18.338811 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd17dd83-a7dd-4870-83ed-64de3bd5dbeb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1548 microversion: 2.1 time: 0.159651 Aug 04 15:11:18.339411 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3518/7032] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:18 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:19.903593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3d93c5cb-186a-4534-8b38-4336288d3d10 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "881042e9-b4d4-4cc5-b768-37a9023001fd"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:11:19.906023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3d93c5cb-186a-4534-8b38-4336288d3d10 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:19.913568 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d93c5cb-186a-4534-8b38-4336288d3d10 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:19.914661 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d93c5cb-186a-4534-8b38-4336288d3d10 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:19.915490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d93c5cb-186a-4534-8b38-4336288d3d10 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:19.915946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3d93c5cb-186a-4534-8b38-4336288d3d10 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:20.178920 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3d93c5cb-186a-4534-8b38-4336288d3d10 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279088 Aug 04 15:11:20.179681 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3515/7033] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 15:11:19 2022] POST /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:11:33.268377 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c45c13cb-b8a9-4e5a-98b7-df5f99478567 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:33.269082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c45c13cb-b8a9-4e5a-98b7-df5f99478567 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:33.271717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:11:33.272391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=62 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:11:33.279450 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c45c13cb-b8a9-4e5a-98b7-df5f99478567 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:33.279905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c45c13cb-b8a9-4e5a-98b7-df5f99478567 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:33.280689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c45c13cb-b8a9-4e5a-98b7-df5f99478567 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:33.281164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c45c13cb-b8a9-4e5a-98b7-df5f99478567 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:33.410498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c45c13cb-b8a9-4e5a-98b7-df5f99478567 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:33.418599 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c45c13cb-b8a9-4e5a-98b7-df5f99478567 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1594 microversion: 2.1 time: 0.154381 Aug 04 15:11:33.419171 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3519/7034] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:33 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:11:35.152117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:11:35.153006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:11:35.153693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:11:35.358114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-281df0dd-2c80-476c-a581-dd429383f5c5 req-e22a31a8-e7a3-4890-8684-dabeb8f33d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefd47b4-712c-42e1-b94a-c6e8406fbb2d", "tag": "9b97b52c-9002-4e1b-a0fd-afe90605f770"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:11:35.376516 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-281df0dd-2c80-476c-a581-dd429383f5c5 req-e22a31a8-e7a3-4890-8684-dabeb8f33d50 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:35.377528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-281df0dd-2c80-476c-a581-dd429383f5c5 req-e22a31a8-e7a3-4890-8684-dabeb8f33d50 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:35.391869 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-281df0dd-2c80-476c-a581-dd429383f5c5 req-e22a31a8-e7a3-4890-8684-dabeb8f33d50 service nova] Creating event network-changed:9b97b52c-9002-4e1b-a0fd-afe90605f770 for instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d on n-h1-844627-10 Aug 04 15:11:35.397151 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-281df0dd-2c80-476c-a581-dd429383f5c5 req-e22a31a8-e7a3-4890-8684-dabeb8f33d50 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247222 Aug 04 15:11:35.398554 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3516/7035] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:11:36.409787 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a707c9b-0a5b-4ec9-bed6-10a571b05857 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2060037121"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:11:36.411307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a707c9b-0a5b-4ec9-bed6-10a571b05857 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:36.420055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a707c9b-0a5b-4ec9-bed6-10a571b05857 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:36.420504 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a707c9b-0a5b-4ec9-bed6-10a571b05857 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:36.421340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a707c9b-0a5b-4ec9-bed6-10a571b05857 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:36.421816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a707c9b-0a5b-4ec9-bed6-10a571b05857 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:36.603201 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.network.security_group_api [None req-0a707c9b-0a5b-4ec9-bed6-10a571b05857 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Adding security group 840ea5c2-cc5b-42ef-9da9-3ce08f6c63fb to port 9b97b52c-9002-4e1b-a0fd-afe90605f770 Aug 04 15:11:36.949389 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a707c9b-0a5b-4ec9-bed6-10a571b05857 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/action" status: 202 len: 0 microversion: 2.1 time: 0.543546 Aug 04 15:11:36.950020 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3520/7036] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:11:36 2022] POST /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:11:36.959846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8d16a764-0dac-485b-9da6-2b4a52c74156 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:11:36.960529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-4a2536f6-2d2e-4d93-add1-e91044555d39 req-a4702291-5101-4261-a3b0-a13128ec9fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefd47b4-712c-42e1-b94a-c6e8406fbb2d", "tag": "9b97b52c-9002-4e1b-a0fd-afe90605f770"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:11:36.960730 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8d16a764-0dac-485b-9da6-2b4a52c74156 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:11:36.967739 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d16a764-0dac-485b-9da6-2b4a52c74156 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:36.968490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d16a764-0dac-485b-9da6-2b4a52c74156 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:36.969512 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d16a764-0dac-485b-9da6-2b4a52c74156 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:36.969955 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8d16a764-0dac-485b-9da6-2b4a52c74156 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:36.970369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4a2536f6-2d2e-4d93-add1-e91044555d39 req-a4702291-5101-4261-a3b0-a13128ec9fa3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:11:36.970818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4a2536f6-2d2e-4d93-add1-e91044555d39 req-a4702291-5101-4261-a3b0-a13128ec9fa3 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:11:36.986013 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-4a2536f6-2d2e-4d93-add1-e91044555d39 req-a4702291-5101-4261-a3b0-a13128ec9fa3 service nova] Creating event network-changed:9b97b52c-9002-4e1b-a0fd-afe90605f770 for instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d on n-h1-844627-10 Aug 04 15:11:36.992494 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-4a2536f6-2d2e-4d93-add1-e91044555d39 req-a4702291-5101-4261-a3b0-a13128ec9fa3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036298 Aug 04 15:11:36.994111 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3521/7037] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:11:37.284096 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8d16a764-0dac-485b-9da6-2b4a52c74156 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:11:37.294819 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8d16a764-0dac-485b-9da6-2b4a52c74156 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1760 microversion: 2.1 time: 0.339297 Aug 04 15:11:37.295526 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3517/7038] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:11:36 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1760 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:13:23.653031 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:13:23.653532 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:13:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:13:23.983960 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:13:23.984543 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:13:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:13:39.209577 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:13:39.210229 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:13:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:13:49.747572 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [-] [91e014af-af63-4f98-b00e-ab5af5ef70e1] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:13:49.748892 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04939028-e350-49aa-b822-266ad76b8ee3] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:13:49.749598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:13:49.750375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:13:49.755552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2af7ee1f-c9ea-4134-b564-e96f6737e4cb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:13:49.757940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2af7ee1f-c9ea-4134-b564-e96f6737e4cb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:13:49.766186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2af7ee1f-c9ea-4134-b564-e96f6737e4cb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:13:49.766647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2af7ee1f-c9ea-4134-b564-e96f6737e4cb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:13:49.767468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2af7ee1f-c9ea-4134-b564-e96f6737e4cb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:13:49.767911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2af7ee1f-c9ea-4134-b564-e96f6737e4cb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:13:49.854475 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2af7ee1f-c9ea-4134-b564-e96f6737e4cb tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/action" status: 202 len: 0 microversion: 2.1 time: 0.108893 Aug 04 15:13:49.855567 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3522/7039] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:13:49 2022] POST /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:13:49.862806 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 15:13:49.863994 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 15:13:49.864487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:13:49.865275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:13:49.869760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e6fac77-cafe-447d-a18c-35ac0e455a00 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:13:49.870430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e6fac77-cafe-447d-a18c-35ac0e455a00 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:13:49.878622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e6fac77-cafe-447d-a18c-35ac0e455a00 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:13:49.879086 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e6fac77-cafe-447d-a18c-35ac0e455a00 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:13:49.879867 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e6fac77-cafe-447d-a18c-35ac0e455a00 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:13:49.880313 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e6fac77-cafe-447d-a18c-35ac0e455a00 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:13:50.121250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6e6fac77-cafe-447d-a18c-35ac0e455a00 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:13:50.129848 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e6fac77-cafe-447d-a18c-35ac0e455a00 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1762 microversion: 2.1 time: 0.269142 Aug 04 15:13:50.130544 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3518/7040] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:13:49 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1762 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:13:51.154350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a8510ad-e2db-4d90-9009-0445ebdaac70 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:13:51.155479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a8510ad-e2db-4d90-9009-0445ebdaac70 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:13:51.171613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a8510ad-e2db-4d90-9009-0445ebdaac70 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:13:51.172476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a8510ad-e2db-4d90-9009-0445ebdaac70 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:13:51.173840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a8510ad-e2db-4d90-9009-0445ebdaac70 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:13:51.174189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a8510ad-e2db-4d90-9009-0445ebdaac70 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:13:51.174949 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] [91e014af-af63-4f98-b00e-ab5af5ef70e1] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 41702. Aug 04 15:13:51.175699 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] [04939028-e350-49aa-b822-266ad76b8ee3] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 41704. Aug 04 15:13:51.451219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a8510ad-e2db-4d90-9009-0445ebdaac70 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:13:51.461564 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a8510ad-e2db-4d90-9009-0445ebdaac70 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1767 microversion: 2.1 time: 0.313845 Aug 04 15:13:51.462324 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3523/7041] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:13:51 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1767 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:13:52.483912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a9969526-bb95-4455-9030-e3c9f4d9adb2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:13:52.484549 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a9969526-bb95-4455-9030-e3c9f4d9adb2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:13:52.493870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9969526-bb95-4455-9030-e3c9f4d9adb2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:13:52.494331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9969526-bb95-4455-9030-e3c9f4d9adb2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:13:52.495106 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9969526-bb95-4455-9030-e3c9f4d9adb2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:13:52.496058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a9969526-bb95-4455-9030-e3c9f4d9adb2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:13:52.500514 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 41712. Aug 04 15:13:52.503968 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 41710. Aug 04 15:13:52.641555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a9969526-bb95-4455-9030-e3c9f4d9adb2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:13:52.649614 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a9969526-bb95-4455-9030-e3c9f4d9adb2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1760 microversion: 2.1 time: 0.169681 Aug 04 15:13:52.650171 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3519/7042] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:13:52 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:03.799608 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:15:03.800219 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:15:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:15:24.590623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:24.591424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:24.596463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6dd1bbd6-3104-4b86-b6b8-283c0b2abbf2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2060037121"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:15:24.597047 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6dd1bbd6-3104-4b86-b6b8-283c0b2abbf2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:24.605215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd1bbd6-3104-4b86-b6b8-283c0b2abbf2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:24.605665 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd1bbd6-3104-4b86-b6b8-283c0b2abbf2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:24.606706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd1bbd6-3104-4b86-b6b8-283c0b2abbf2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:24.607146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6dd1bbd6-3104-4b86-b6b8-283c0b2abbf2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:24.749057 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.network.security_group_api [None req-6dd1bbd6-3104-4b86-b6b8-283c0b2abbf2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Removing security group 840ea5c2-cc5b-42ef-9da9-3ce08f6c63fb from port 9b97b52c-9002-4e1b-a0fd-afe90605f770 Aug 04 15:15:25.074914 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6dd1bbd6-3104-4b86-b6b8-283c0b2abbf2 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/action" status: 202 len: 0 microversion: 2.1 time: 0.486165 Aug 04 15:15:25.075658 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3524/7043] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:15:24 2022] POST /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:15:25.082577 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:25.084519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:25.176123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f3801f23-c8bd-46de-809d-317e32079c47 req-a050f2f9-346a-4a42-b272-08535d78612e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefd47b4-712c-42e1-b94a-c6e8406fbb2d", "tag": "9b97b52c-9002-4e1b-a0fd-afe90605f770"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:15:25.187067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f3801f23-c8bd-46de-809d-317e32079c47 req-a050f2f9-346a-4a42-b272-08535d78612e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:25.187607 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f3801f23-c8bd-46de-809d-317e32079c47 req-a050f2f9-346a-4a42-b272-08535d78612e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:25.200182 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f3801f23-c8bd-46de-809d-317e32079c47 req-a050f2f9-346a-4a42-b272-08535d78612e service nova] Creating event network-changed:9b97b52c-9002-4e1b-a0fd-afe90605f770 for instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d on n-h1-844627-10 Aug 04 15:15:25.207550 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f3801f23-c8bd-46de-809d-317e32079c47 req-a050f2f9-346a-4a42-b272-08535d78612e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127351 Aug 04 15:15:25.208254 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3520/7044] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:15:26.979372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75b71898-a853-4bf0-8f0b-2ffefe406d26 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:26.979921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75b71898-a853-4bf0-8f0b-2ffefe406d26 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:26.987111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75b71898-a853-4bf0-8f0b-2ffefe406d26 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:26.987567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75b71898-a853-4bf0-8f0b-2ffefe406d26 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:26.988367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75b71898-a853-4bf0-8f0b-2ffefe406d26 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:26.988780 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75b71898-a853-4bf0-8f0b-2ffefe406d26 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:27.079141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-75b71898-a853-4bf0-8f0b-2ffefe406d26 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lazy-loading 'services' on Instance uuid fefd47b4-712c-42e1-b94a-c6e8406fbb2d {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:15:27.163363 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75b71898-a853-4bf0-8f0b-2ffefe406d26 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments/881042e9-b4d4-4cc5-b768-37a9023001fd" status: 202 len: 0 microversion: 2.1 time: 0.188848 Aug 04 15:15:27.164149 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3525/7045] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:15:26 2022] DELETE /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments/881042e9-b4d4-4cc5-b768-37a9023001fd => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:15:27.176120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8af961b1-5e58-46f4-9379-8fa504560b60 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:27.178863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8af961b1-5e58-46f4-9379-8fa504560b60 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:27.193477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8af961b1-5e58-46f4-9379-8fa504560b60 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:27.193941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8af961b1-5e58-46f4-9379-8fa504560b60 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:27.194750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8af961b1-5e58-46f4-9379-8fa504560b60 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:27.198400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8af961b1-5e58-46f4-9379-8fa504560b60 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:27.224751 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-85f2e929-4762-4d1a-995e-feb50aa615e0 req-5c578c9d-27f1-4636-b2cb-14461274eac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefd47b4-712c-42e1-b94a-c6e8406fbb2d", "tag": "9b97b52c-9002-4e1b-a0fd-afe90605f770"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:15:27.236166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-85f2e929-4762-4d1a-995e-feb50aa615e0 req-5c578c9d-27f1-4636-b2cb-14461274eac8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:27.236625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-85f2e929-4762-4d1a-995e-feb50aa615e0 req-5c578c9d-27f1-4636-b2cb-14461274eac8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:27.242171 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8af961b1-5e58-46f4-9379-8fa504560b60 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072244 Aug 04 15:15:27.245576 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3521/7046] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:15:27 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:15:27.256807 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-85f2e929-4762-4d1a-995e-feb50aa615e0 req-5c578c9d-27f1-4636-b2cb-14461274eac8 service nova] Creating event network-changed:9b97b52c-9002-4e1b-a0fd-afe90605f770 for instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d on n-h1-844627-10 Aug 04 15:15:27.262394 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-85f2e929-4762-4d1a-995e-feb50aa615e0 req-5c578c9d-27f1-4636-b2cb-14461274eac8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041966 Aug 04 15:15:27.263371 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3526/7047] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:15:28.258264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f3c2f543-32d9-422c-baec-6782482e509e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:28.260649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f3c2f543-32d9-422c-baec-6782482e509e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:28.268327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3c2f543-32d9-422c-baec-6782482e509e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:28.268793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3c2f543-32d9-422c-baec-6782482e509e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:28.269854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3c2f543-32d9-422c-baec-6782482e509e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:28.270308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f3c2f543-32d9-422c-baec-6782482e509e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:28.310013 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f3c2f543-32d9-422c-baec-6782482e509e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055778 Aug 04 15:15:28.310632 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3522/7048] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:15:28 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:15:29.328532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5f0095d-39e5-43a1-af22-640050a6cd79 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:29.331545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d5f0095d-39e5-43a1-af22-640050a6cd79 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:29.341505 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5f0095d-39e5-43a1-af22-640050a6cd79 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:29.342305 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5f0095d-39e5-43a1-af22-640050a6cd79 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:29.343698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5f0095d-39e5-43a1-af22-640050a6cd79 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:29.344497 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5f0095d-39e5-43a1-af22-640050a6cd79 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:29.388296 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5f0095d-39e5-43a1-af22-640050a6cd79 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068758 Aug 04 15:15:29.388973 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3527/7049] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:15:29 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:15:30.400221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-45327d12-e7bd-4701-b548-10a81745df47 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:30.402615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-45327d12-e7bd-4701-b548-10a81745df47 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:30.409949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45327d12-e7bd-4701-b548-10a81745df47 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:30.410425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45327d12-e7bd-4701-b548-10a81745df47 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:30.411233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45327d12-e7bd-4701-b548-10a81745df47 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:30.411688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45327d12-e7bd-4701-b548-10a81745df47 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:30.449544 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-45327d12-e7bd-4701-b548-10a81745df47 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053232 Aug 04 15:15:30.450243 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3523/7050] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:15:30 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:15:31.465069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c859ea18-f016-4d23-97a1-69cd88ce31bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:31.468488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c859ea18-f016-4d23-97a1-69cd88ce31bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:31.477900 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c859ea18-f016-4d23-97a1-69cd88ce31bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:31.478360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c859ea18-f016-4d23-97a1-69cd88ce31bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:31.479158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c859ea18-f016-4d23-97a1-69cd88ce31bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:31.479608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c859ea18-f016-4d23-97a1-69cd88ce31bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:31.519818 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c859ea18-f016-4d23-97a1-69cd88ce31bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059257 Aug 04 15:15:31.520432 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3528/7051] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:15:31 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:15:32.532023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-40c9b3b3-700e-4ebd-899b-bd7e07e92f05 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:32.534245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-40c9b3b3-700e-4ebd-899b-bd7e07e92f05 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:32.542229 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40c9b3b3-700e-4ebd-899b-bd7e07e92f05 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:32.542694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40c9b3b3-700e-4ebd-899b-bd7e07e92f05 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:32.543475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40c9b3b3-700e-4ebd-899b-bd7e07e92f05 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:32.543945 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-40c9b3b3-700e-4ebd-899b-bd7e07e92f05 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:32.576034 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-40c9b3b3-700e-4ebd-899b-bd7e07e92f05 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047991 Aug 04 15:15:32.576642 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3524/7052] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:15:32 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 15:15:32.588582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:32.589147 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:32.595832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:32.596330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:32.597182 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:32.597668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:32.687103 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] HTTP exception thrown: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d is not attached to volume 881042e9-b4d4-4cc5-b768-37a9023001fd Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Request method failure captured: Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: request: DELETE /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments/881042e9-b4d4-4cc5-b768-37a9023001fd HTTP/1.1 Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6-FxLkKwrBmqBAoK2eSQUx8EUXknoK42003rJ6tx_Xb0zE46m5t3TOOUHfzQRY8ZNSKp3aZN-2-bH-ZO0UOUoy4Hr7uWiOaCPzi0DYV9dTLc3pWYeqzcdFqjGGIantvB2JdVXWrJgazECvlOIHgrgi-wwRMb5U5HTAjuyyl1-4MO-gk Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 52ccdc59c6ac4b778411600be38dc225 Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52ccdc59c6ac4b778411600be38dc225"}]}] Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 52ccdc59c6ac4b778411600be38dc225 Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestMinimumBasicScenario-1263360735-project Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 4d7d2f3930a449d9afe3f92540a05adc Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestMinimumBasicScenario-1263360735-project Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d is not attached to volume 881042e9-b4d4-4cc5-b768-37a9023001fd Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'server_id': 'fefd47b4-712c-42e1-b94a-c6e8406fbb2d', 'id': '881042e9-b4d4-4cc5-b768-37a9023001fd'} Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 881042e9-b4d4-4cc5-b768-37a9023001fd. Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d is not attached to volume 881042e9-b4d4-4cc5-b768-37a9023001fd Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:15:32.689042 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:15:32.694000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:15:32.694000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:15:32.694000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d is not attached to volume 881042e9-b4d4-4cc5-b768-37a9023001fd Aug 04 15:15:32.694000 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:32.694000 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Returning 404 to user: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d is not attached to volume 881042e9-b4d4-4cc5-b768-37a9023001fd {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:15:32.694000 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3170a279-f6f1-40ce-91e8-dda77000cb8d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments/881042e9-b4d4-4cc5-b768-37a9023001fd" status: 404 len: 154 microversion: 2.1 time: 0.107319 Aug 04 15:15:32.694000 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3529/7053] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:15:32 2022] DELETE /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d/os-volume_attachments/881042e9-b4d4-4cc5-b768-37a9023001fd => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:15:35.968529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0d114606-26ba-4445-b9cd-5d015eb5d798 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:35.969084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0d114606-26ba-4445-b9cd-5d015eb5d798 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:35.976283 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d114606-26ba-4445-b9cd-5d015eb5d798 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:35.976752 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d114606-26ba-4445-b9cd-5d015eb5d798 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:35.977567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d114606-26ba-4445-b9cd-5d015eb5d798 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:35.978024 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0d114606-26ba-4445-b9cd-5d015eb5d798 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:36.004735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0d114606-26ba-4445-b9cd-5d015eb5d798 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:15:36.084112 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0d114606-26ba-4445-b9cd-5d015eb5d798 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 204 len: 0 microversion: 2.1 time: 0.119035 Aug 04 15:15:36.084796 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3525/7054] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:15:35 2022] DELETE /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:15:36.093425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-58c05264-086d-4dc2-b690-1ef8c7f5db48 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:36.094081 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-58c05264-086d-4dc2-b690-1ef8c7f5db48 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:36.101040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c05264-086d-4dc2-b690-1ef8c7f5db48 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:36.101502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c05264-086d-4dc2-b690-1ef8c7f5db48 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:36.102286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c05264-086d-4dc2-b690-1ef8c7f5db48 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:36.102731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-58c05264-086d-4dc2-b690-1ef8c7f5db48 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:36.247659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-58c05264-086d-4dc2-b690-1ef8c7f5db48 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:36.256127 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-58c05264-086d-4dc2-b690-1ef8c7f5db48 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1554 microversion: 2.1 time: 0.166641 Aug 04 15:15:36.256704 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3530/7055] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:36 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:37.278129 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e92676f5-1bb6-4a32-b7ae-b298edd32e18 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:37.278890 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e92676f5-1bb6-4a32-b7ae-b298edd32e18 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:37.285977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e92676f5-1bb6-4a32-b7ae-b298edd32e18 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:37.286448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e92676f5-1bb6-4a32-b7ae-b298edd32e18 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:37.287237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e92676f5-1bb6-4a32-b7ae-b298edd32e18 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:37.287693 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e92676f5-1bb6-4a32-b7ae-b298edd32e18 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:37.425472 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e92676f5-1bb6-4a32-b7ae-b298edd32e18 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:37.433424 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e92676f5-1bb6-4a32-b7ae-b298edd32e18 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1554 microversion: 2.1 time: 0.159690 Aug 04 15:15:37.434000 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3526/7056] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:37 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:38.401648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-352356d7-00b3-489b-8051-592cb0dd08e0 req-1cd4670c-4bbe-4e32-bb85-6767214052b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefd47b4-712c-42e1-b94a-c6e8406fbb2d", "name": "network-vif-deleted", "tag": "9b97b52c-9002-4e1b-a0fd-afe90605f770"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:15:38.415118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-352356d7-00b3-489b-8051-592cb0dd08e0 req-1cd4670c-4bbe-4e32-bb85-6767214052b5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:38.415566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-352356d7-00b3-489b-8051-592cb0dd08e0 req-1cd4670c-4bbe-4e32-bb85-6767214052b5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:38.428570 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-352356d7-00b3-489b-8051-592cb0dd08e0 req-1cd4670c-4bbe-4e32-bb85-6767214052b5 service nova] Creating event network-vif-deleted:9b97b52c-9002-4e1b-a0fd-afe90605f770 for instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d on n-h1-844627-10 Aug 04 15:15:38.435357 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-352356d7-00b3-489b-8051-592cb0dd08e0 req-1cd4670c-4bbe-4e32-bb85-6767214052b5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038401 Aug 04 15:15:38.435977 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3531/7057] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:15:38.455186 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bf09e97f-31da-43a9-9872-ef24c3998aa4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:38.455830 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bf09e97f-31da-43a9-9872-ef24c3998aa4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:38.463422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf09e97f-31da-43a9-9872-ef24c3998aa4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:38.463886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf09e97f-31da-43a9-9872-ef24c3998aa4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:38.464677 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf09e97f-31da-43a9-9872-ef24c3998aa4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:38.465163 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bf09e97f-31da-43a9-9872-ef24c3998aa4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:38.539400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bf09e97f-31da-43a9-9872-ef24c3998aa4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:38.547054 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bf09e97f-31da-43a9-9872-ef24c3998aa4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 200 len: 1343 microversion: 2.1 time: 0.096644 Aug 04 15:15:38.547648 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3527/7058] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:38 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 1343 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:39.571077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:39.571779 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: fefd47b4-712c-42e1-b94a-c6e8406fbb2d] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:39.578986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:39.579435 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:39.580198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:39.580632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:39.595063 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] HTTP exception thrown: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d could not be found. Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Request method failure captured: Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d HTTP/1.1 Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6-FxLkKwrBmqBAoK2eSQUx8EUXknoK42003rJ6tx_Xb0zE46m5t3TOOUHfzQRY8ZNSKp3aZN-2-bH-ZO0UOUoy4Hr7uWiOaCPzi0DYV9dTLc3pWYeqzcdFqjGGIantvB2JdVXWrJgazECvlOIHgrgi-wwRMb5U5HTAjuyyl1-4MO-gk Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 52ccdc59c6ac4b778411600be38dc225 Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52ccdc59c6ac4b778411600be38dc225"}]}] Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 52ccdc59c6ac4b778411600be38dc225 Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestMinimumBasicScenario-1263360735-project Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 4d7d2f3930a449d9afe3f92540a05adc Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestMinimumBasicScenario-1263360735-project Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d could not be found. Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': 'fefd47b4-712c-42e1-b94a-c6e8406fbb2d'} Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d could not be found. Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d could not be found. Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:15:39.596714 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d could not be found. Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Returning 404 to user: Instance fefd47b4-712c-42e1-b94a-c6e8406fbb2d could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c06109d3-7a6d-40a9-8959-aa85f4937bf0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d" status: 404 len: 111 microversion: 2.1 time: 0.031546 Aug 04 15:15:39.601421 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3532/7059] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:39 2022] GET /compute/v2.1/servers/fefd47b4-712c-42e1-b94a-c6e8406fbb2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 15:15:39.608027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e9d9ef22-e7ae-4af6-9c6b-20515005fa1a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '.version_select at 0x7f4700f3ec10>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:39.632924 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e9d9ef22-e7ae-4af6-9c6b-20515005fa1a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-317016496" status: 202 len: 0 microversion: 2.1 time: 0.029579 Aug 04 15:15:39.633510 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3528/7060] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 15:15:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-317016496 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:15:48.713983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-76bb2203-e42b-42ce-bf6c-102d9ac71818 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'create', calling method: .version_select at 0x7f46f2f10ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2065833062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG65aqneivofpTyz6Iovj2fS+/HXOlrosrtanOaPVj2ptquxz69mBLRizqUwlZTuCql3KGxRUB1XuibvIwWdrqfPCscmBXv/y+R9ncQXdBgyVQ8AGOdS+gPsoAwbyEOyzg=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:15:48.733942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-76bb2203-e42b-42ce-bf6c-102d9ac71818 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Getting quotas for project 52ccdc59c6ac4b778411600be38dc225. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:15:48.739807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-76bb2203-e42b-42ce-bf6c-102d9ac71818 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Getting quotas for user 4d7d2f3930a449d9afe3f92540a05adc and project 52ccdc59c6ac4b778411600be38dc225. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:15:48.773875 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-76bb2203-e42b-42ce-bf6c-102d9ac71818 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.120051 Aug 04 15:15:48.774590 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3533/7061] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:15:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:15:48.824100 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:48.828977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1189482814", "imageRef": "cf42ddb9-fbf0-4be1-b78c-f13f739a4728", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2065833062", "networks": [{"uuid": "e8dc0ce6-4704-4ab9-995f-c5c0e6d8fa98"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:15:48.883887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] validate_networks() for [('e8dc0ce6-4704-4ab9-995f-c5c0e6d8fa98', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:15:49.362709 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:15:49.363154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:15:49.363648 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:15:49.364080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:15:49.364514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:15:49.374471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:49.374941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:49.375782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:49.376231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:49.394393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Getting quotas for project 52ccdc59c6ac4b778411600be38dc225. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:15:49.399784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Getting quotas for user 4d7d2f3930a449d9afe3f92540a05adc and project 52ccdc59c6ac4b778411600be38dc225. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:15:49.412707 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:15:49.415009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf42ddb9-fbf0-4be1-b78c-f13f739a4728',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:15:49.461700 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-70adee14-7067-4d6d-91bc-70db5918cbca tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639286 Aug 04 15:15:49.462385 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3529/7062] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:15:49.473392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-aaa839b9-5eaa-4a9e-afb5-0cb343b15248 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:49.474039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-aaa839b9-5eaa-4a9e-afb5-0cb343b15248 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:49.533885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-aaa839b9-5eaa-4a9e-afb5-0cb343b15248 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:49.544151 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-aaa839b9-5eaa-4a9e-afb5-0cb343b15248 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1259 microversion: 2.1 time: 0.074794 Aug 04 15:15:49.545947 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3534/7063] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:49 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:50.573635 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-748a1a18-031d-4e02-9a82-e0a0d28b382b tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:50.575141 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-748a1a18-031d-4e02-9a82-e0a0d28b382b tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:50.584558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-748a1a18-031d-4e02-9a82-e0a0d28b382b tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:50.585256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-748a1a18-031d-4e02-9a82-e0a0d28b382b tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:50.586561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-748a1a18-031d-4e02-9a82-e0a0d28b382b tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:50.587120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-748a1a18-031d-4e02-9a82-e0a0d28b382b tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:50.682629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-748a1a18-031d-4e02-9a82-e0a0d28b382b tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:50.696607 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-748a1a18-031d-4e02-9a82-e0a0d28b382b tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1319 microversion: 2.1 time: 0.126686 Aug 04 15:15:50.698040 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3530/7064] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:50 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1319 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:51.728405 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f5e5441-845a-40d7-b011-2e558b7ec8e0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:51.729401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f5e5441-845a-40d7-b011-2e558b7ec8e0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:51.731871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:51.747826 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f5e5441-845a-40d7-b011-2e558b7ec8e0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:51.752998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f5e5441-845a-40d7-b011-2e558b7ec8e0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:51.754236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f5e5441-845a-40d7-b011-2e558b7ec8e0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:51.754906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f5e5441-845a-40d7-b011-2e558b7ec8e0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:51.940394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9f5e5441-845a-40d7-b011-2e558b7ec8e0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:51.948561 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f5e5441-845a-40d7-b011-2e558b7ec8e0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.224577 Aug 04 15:15:51.949194 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3535/7065] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:51 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:52.971420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac7a9c23-fcb7-414e-b138-83e3971372e1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:52.972060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ac7a9c23-fcb7-414e-b138-83e3971372e1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:52.978681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac7a9c23-fcb7-414e-b138-83e3971372e1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:52.979151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac7a9c23-fcb7-414e-b138-83e3971372e1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:52.979942 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac7a9c23-fcb7-414e-b138-83e3971372e1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:52.980393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac7a9c23-fcb7-414e-b138-83e3971372e1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:53.127150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ac7a9c23-fcb7-414e-b138-83e3971372e1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:53.136209 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac7a9c23-fcb7-414e-b138-83e3971372e1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.169072 Aug 04 15:15:53.137579 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3531/7066] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:52 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:54.158286 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-942e616f-5083-4cc8-990b-f551b83b6ae7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:54.158913 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-942e616f-5083-4cc8-990b-f551b83b6ae7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:54.166394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-942e616f-5083-4cc8-990b-f551b83b6ae7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:54.166857 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-942e616f-5083-4cc8-990b-f551b83b6ae7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:54.167650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-942e616f-5083-4cc8-990b-f551b83b6ae7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:54.168101 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-942e616f-5083-4cc8-990b-f551b83b6ae7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:54.323427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-942e616f-5083-4cc8-990b-f551b83b6ae7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:54.331695 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-942e616f-5083-4cc8-990b-f551b83b6ae7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.177667 Aug 04 15:15:54.345714 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3536/7067] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:54 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:55.354442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2afaca47-f849-4561-8fc9-7b5fa4a1e0a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:55.356145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2afaca47-f849-4561-8fc9-7b5fa4a1e0a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:55.359665 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:55.366040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2afaca47-f849-4561-8fc9-7b5fa4a1e0a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:55.367020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2afaca47-f849-4561-8fc9-7b5fa4a1e0a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:55.368176 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2afaca47-f849-4561-8fc9-7b5fa4a1e0a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:55.368844 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2afaca47-f849-4561-8fc9-7b5fa4a1e0a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:55.518202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2afaca47-f849-4561-8fc9-7b5fa4a1e0a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:55.525171 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2afaca47-f849-4561-8fc9-7b5fa4a1e0a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.174648 Aug 04 15:15:55.525746 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3532/7068] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:55 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:56.546284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dfd6b412-28f0-4bbd-b69a-af80c49c6551 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:56.546919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dfd6b412-28f0-4bbd-b69a-af80c49c6551 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:56.551312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:56.558338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfd6b412-28f0-4bbd-b69a-af80c49c6551 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:56.558909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfd6b412-28f0-4bbd-b69a-af80c49c6551 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:56.559948 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfd6b412-28f0-4bbd-b69a-af80c49c6551 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:56.560464 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dfd6b412-28f0-4bbd-b69a-af80c49c6551 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:56.710845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dfd6b412-28f0-4bbd-b69a-af80c49c6551 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:56.718765 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dfd6b412-28f0-4bbd-b69a-af80c49c6551 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.176592 Aug 04 15:15:56.719473 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3537/7069] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:56 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:57.741644 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-999ba689-9ef0-44a0-9236-568e396791ee tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:57.742350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-999ba689-9ef0-44a0-9236-568e396791ee tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:57.749885 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-999ba689-9ef0-44a0-9236-568e396791ee tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:57.750428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-999ba689-9ef0-44a0-9236-568e396791ee tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:57.751323 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-999ba689-9ef0-44a0-9236-568e396791ee tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:57.751840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-999ba689-9ef0-44a0-9236-568e396791ee tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:57.894042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-999ba689-9ef0-44a0-9236-568e396791ee tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:57.901859 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-999ba689-9ef0-44a0-9236-568e396791ee tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.165444 Aug 04 15:15:57.902428 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3533/7070] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:57 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:58.923162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2e596757-aaf3-451a-8b05-0511db5f3a6d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:15:58.923775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2e596757-aaf3-451a-8b05-0511db5f3a6d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:15:58.930788 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e596757-aaf3-451a-8b05-0511db5f3a6d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:58.931241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e596757-aaf3-451a-8b05-0511db5f3a6d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:58.932010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e596757-aaf3-451a-8b05-0511db5f3a6d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:58.932448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2e596757-aaf3-451a-8b05-0511db5f3a6d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:59.138733 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2e596757-aaf3-451a-8b05-0511db5f3a6d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:15:59.147920 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2e596757-aaf3-451a-8b05-0511db5f3a6d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.228570 Aug 04 15:15:59.161580 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3538/7071] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:15:58 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:15:59.600153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:59.601662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:15:59.607548 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-172a1885-3efd-4146-ba7b-cdc746ae4d8b req-15301bad-751e-4229-a18b-101fc5770b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f04e53-db6c-4f57-847d-6cbb534babe4", "tag": "96172585-ab70-49d3-8cd4-b1a57e400788"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:15:59.625539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-172a1885-3efd-4146-ba7b-cdc746ae4d8b req-15301bad-751e-4229-a18b-101fc5770b11 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:15:59.626000 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-172a1885-3efd-4146-ba7b-cdc746ae4d8b req-15301bad-751e-4229-a18b-101fc5770b11 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:15:59.637375 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-172a1885-3efd-4146-ba7b-cdc746ae4d8b req-15301bad-751e-4229-a18b-101fc5770b11 service nova] Creating event network-changed:96172585-ab70-49d3-8cd4-b1a57e400788 for instance 22f04e53-db6c-4f57-847d-6cbb534babe4 on n-h2-844627-10 Aug 04 15:15:59.643078 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-172a1885-3efd-4146-ba7b-cdc746ae4d8b req-15301bad-751e-4229-a18b-101fc5770b11 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044343 Aug 04 15:15:59.643805 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3534/7072] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:16:00.168899 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-05c69a1d-d95e-4a7c-9331-28884353ebad tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:00.169515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-05c69a1d-d95e-4a7c-9331-28884353ebad tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:00.171358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:00.177557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05c69a1d-d95e-4a7c-9331-28884353ebad tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:00.178012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05c69a1d-d95e-4a7c-9331-28884353ebad tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:00.178782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05c69a1d-d95e-4a7c-9331-28884353ebad tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:00.179228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-05c69a1d-d95e-4a7c-9331-28884353ebad tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:00.306541 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-05c69a1d-d95e-4a7c-9331-28884353ebad tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:00.314609 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-05c69a1d-d95e-4a7c-9331-28884353ebad tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.149637 Aug 04 15:16:00.315186 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3539/7073] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:00 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:01.338441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b847d34c-73a1-4526-8dae-11cba1fb2238 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:01.338928 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b847d34c-73a1-4526-8dae-11cba1fb2238 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:01.345927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b847d34c-73a1-4526-8dae-11cba1fb2238 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:01.346396 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b847d34c-73a1-4526-8dae-11cba1fb2238 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:01.347210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b847d34c-73a1-4526-8dae-11cba1fb2238 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:01.347658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b847d34c-73a1-4526-8dae-11cba1fb2238 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:01.481174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b847d34c-73a1-4526-8dae-11cba1fb2238 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:01.488812 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b847d34c-73a1-4526-8dae-11cba1fb2238 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.156746 Aug 04 15:16:01.489476 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3535/7074] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:01 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:02.509648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac6e9ef8-86d3-41e8-9beb-065b460617e3 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:02.510255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac6e9ef8-86d3-41e8-9beb-065b460617e3 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:02.517458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6e9ef8-86d3-41e8-9beb-065b460617e3 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:02.517912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6e9ef8-86d3-41e8-9beb-065b460617e3 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:02.518694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6e9ef8-86d3-41e8-9beb-065b460617e3 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:02.519137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac6e9ef8-86d3-41e8-9beb-065b460617e3 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:02.656611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac6e9ef8-86d3-41e8-9beb-065b460617e3 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:02.665613 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac6e9ef8-86d3-41e8-9beb-065b460617e3 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.159819 Aug 04 15:16:02.666209 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3540/7075] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:02 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:03.688057 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84bd1b5d-91ff-489a-b9de-dba3fe2466a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:03.688713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84bd1b5d-91ff-489a-b9de-dba3fe2466a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:03.696105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84bd1b5d-91ff-489a-b9de-dba3fe2466a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:03.696589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84bd1b5d-91ff-489a-b9de-dba3fe2466a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:03.697442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84bd1b5d-91ff-489a-b9de-dba3fe2466a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:03.697864 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84bd1b5d-91ff-489a-b9de-dba3fe2466a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:03.832463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84bd1b5d-91ff-489a-b9de-dba3fe2466a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:03.840006 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84bd1b5d-91ff-489a-b9de-dba3fe2466a1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.156473 Aug 04 15:16:03.840580 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3536/7076] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:03 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:04.861023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3c48fbec-6e82-4623-ac9e-89050ac2d0d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:04.861623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3c48fbec-6e82-4623-ac9e-89050ac2d0d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:04.868599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c48fbec-6e82-4623-ac9e-89050ac2d0d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:04.869088 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c48fbec-6e82-4623-ac9e-89050ac2d0d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:04.869863 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c48fbec-6e82-4623-ac9e-89050ac2d0d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:04.870306 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3c48fbec-6e82-4623-ac9e-89050ac2d0d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:05.016443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3c48fbec-6e82-4623-ac9e-89050ac2d0d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:05.026160 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3c48fbec-6e82-4623-ac9e-89050ac2d0d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.169220 Aug 04 15:16:05.026929 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3541/7077] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:04 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:05.190311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b7fe65b8-8356-41be-ad66-48b184ec527b req-ed1dd0e1-962b-4337-a376-4963f0eb593d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f04e53-db6c-4f57-847d-6cbb534babe4", "name": "network-vif-plugged", "status": "completed", "tag": "96172585-ab70-49d3-8cd4-b1a57e400788"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:16:05.200114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b7fe65b8-8356-41be-ad66-48b184ec527b req-ed1dd0e1-962b-4337-a376-4963f0eb593d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:05.200569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b7fe65b8-8356-41be-ad66-48b184ec527b req-ed1dd0e1-962b-4337-a376-4963f0eb593d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:05.217509 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b7fe65b8-8356-41be-ad66-48b184ec527b req-ed1dd0e1-962b-4337-a376-4963f0eb593d service nova] Creating event network-vif-plugged:96172585-ab70-49d3-8cd4-b1a57e400788 for instance 22f04e53-db6c-4f57-847d-6cbb534babe4 on n-h2-844627-10 Aug 04 15:16:05.222759 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b7fe65b8-8356-41be-ad66-48b184ec527b req-ed1dd0e1-962b-4337-a376-4963f0eb593d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115199 Aug 04 15:16:05.223408 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3537/7078] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:16:06.048188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e71aea83-83bc-409f-b30a-a5fb749be971 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:06.048808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e71aea83-83bc-409f-b30a-a5fb749be971 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:06.056534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e71aea83-83bc-409f-b30a-a5fb749be971 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:06.057022 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e71aea83-83bc-409f-b30a-a5fb749be971 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:06.057859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e71aea83-83bc-409f-b30a-a5fb749be971 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:06.058299 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e71aea83-83bc-409f-b30a-a5fb749be971 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:06.222121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e71aea83-83bc-409f-b30a-a5fb749be971 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:06.230604 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e71aea83-83bc-409f-b30a-a5fb749be971 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1359 microversion: 2.1 time: 0.186359 Aug 04 15:16:06.231197 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3542/7079] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:06 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:16:07.267433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e45ae04f-14e6-4e48-9e0f-b6774a119a82 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:07.268159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e45ae04f-14e6-4e48-9e0f-b6774a119a82 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:07.274609 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e45ae04f-14e6-4e48-9e0f-b6774a119a82 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:07.275076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e45ae04f-14e6-4e48-9e0f-b6774a119a82 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:07.275858 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e45ae04f-14e6-4e48-9e0f-b6774a119a82 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:07.276315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e45ae04f-14e6-4e48-9e0f-b6774a119a82 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:07.411898 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e45ae04f-14e6-4e48-9e0f-b6774a119a82 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:07.419901 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e45ae04f-14e6-4e48-9e0f-b6774a119a82 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1549 microversion: 2.1 time: 0.157474 Aug 04 15:16:07.420411 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3538/7080] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:07 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:07.440810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-50401b38-4cbf-44ec-9ba3-febcbf62a949 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:07.441510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-50401b38-4cbf-44ec-9ba3-febcbf62a949 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:07.448659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50401b38-4cbf-44ec-9ba3-febcbf62a949 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:07.449146 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50401b38-4cbf-44ec-9ba3-febcbf62a949 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:07.449927 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50401b38-4cbf-44ec-9ba3-febcbf62a949 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:07.450368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-50401b38-4cbf-44ec-9ba3-febcbf62a949 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:07.593660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-50401b38-4cbf-44ec-9ba3-febcbf62a949 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:07.601727 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-50401b38-4cbf-44ec-9ba3-febcbf62a949 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1549 microversion: 2.1 time: 0.164890 Aug 04 15:16:07.602331 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3543/7081] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:07 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:07.621727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-25180f24-fb26-41e4-86f1-4337b44aa72e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:07.626386 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-25180f24-fb26-41e4-86f1-4337b44aa72e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:07.627182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-25180f24-fb26-41e4-86f1-4337b44aa72e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Searching by: {'deleted': False, 'project_id': '52ccdc59c6ac4b778411600be38dc225'} {{(pid=130961) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 15:16:07.632796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25180f24-fb26-41e4-86f1-4337b44aa72e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:07.633318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25180f24-fb26-41e4-86f1-4337b44aa72e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:07.634143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25180f24-fb26-41e4-86f1-4337b44aa72e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:07.634604 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-25180f24-fb26-41e4-86f1-4337b44aa72e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:07.660161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.multi_cell_list [None req-25180f24-fb26-41e4-86f1-4337b44aa72e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130961) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 15:16:07.687592 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-25180f24-fb26-41e4-86f1-4337b44aa72e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069595 Aug 04 15:16:07.688089 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3539/7082] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 15:16:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:16:07.700314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75fe3cea-1638-44fc-af84-764e321b6de6 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:07.700973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75fe3cea-1638-44fc-af84-764e321b6de6 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:07.707879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75fe3cea-1638-44fc-af84-764e321b6de6 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:07.708400 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75fe3cea-1638-44fc-af84-764e321b6de6 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:07.709156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75fe3cea-1638-44fc-af84-764e321b6de6 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:07.709594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75fe3cea-1638-44fc-af84-764e321b6de6 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:07.850988 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-75fe3cea-1638-44fc-af84-764e321b6de6 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:07.859115 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75fe3cea-1638-44fc-af84-764e321b6de6 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1549 microversion: 2.1 time: 0.162790 Aug 04 15:16:07.859695 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3544/7083] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:07 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:09.397502 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b16b1ee0-01b8-450c-91e4-571a45be9940 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17cd805b-ce3d-41dc-85e3-ebaf60bc02a9"}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:16:09.401075 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b16b1ee0-01b8-450c-91e4-571a45be9940 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:09.409150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b16b1ee0-01b8-450c-91e4-571a45be9940 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:09.409622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b16b1ee0-01b8-450c-91e4-571a45be9940 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:09.410429 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b16b1ee0-01b8-450c-91e4-571a45be9940 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:09.410884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b16b1ee0-01b8-450c-91e4-571a45be9940 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:09.662660 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b16b1ee0-01b8-450c-91e4-571a45be9940 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269423 Aug 04 15:16:09.664064 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3540/7084] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 15:16:09 2022] POST /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:16:20.477850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6d5e4b0-acb5-4983-84a9-c79005aec086 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:20.478457 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6d5e4b0-acb5-4983-84a9-c79005aec086 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:20.481532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=15 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:20.482211 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=60 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:20.488918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6d5e4b0-acb5-4983-84a9-c79005aec086 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:20.489373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6d5e4b0-acb5-4983-84a9-c79005aec086 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:20.490160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6d5e4b0-acb5-4983-84a9-c79005aec086 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:20.490594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6d5e4b0-acb5-4983-84a9-c79005aec086 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:20.648080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6d5e4b0-acb5-4983-84a9-c79005aec086 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:20.658888 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6d5e4b0-acb5-4983-84a9-c79005aec086 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1595 microversion: 2.1 time: 0.184856 Aug 04 15:16:20.659734 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3545/7085] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:20 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1595 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:22.818376 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:22.820471 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=17 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:22.822184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:22.828765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6e971231-a44b-45d7-beca-e7b9aec8e2c0 req-29d17512-7f2d-45a5-86ed-5f47db109d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f04e53-db6c-4f57-847d-6cbb534babe4", "tag": "96172585-ab70-49d3-8cd4-b1a57e400788"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:16:22.846610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6e971231-a44b-45d7-beca-e7b9aec8e2c0 req-29d17512-7f2d-45a5-86ed-5f47db109d4e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:22.846970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6e971231-a44b-45d7-beca-e7b9aec8e2c0 req-29d17512-7f2d-45a5-86ed-5f47db109d4e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:22.863947 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6e971231-a44b-45d7-beca-e7b9aec8e2c0 req-29d17512-7f2d-45a5-86ed-5f47db109d4e service nova] Creating event network-changed:96172585-ab70-49d3-8cd4-b1a57e400788 for instance 22f04e53-db6c-4f57-847d-6cbb534babe4 on n-h2-844627-10 Aug 04 15:16:22.870293 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6e971231-a44b-45d7-beca-e7b9aec8e2c0 req-29d17512-7f2d-45a5-86ed-5f47db109d4e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056392 Aug 04 15:16:22.871515 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3541/7086] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:16:24.254294 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf16a1e3-3b6f-45a5-bcd6-9f43ba473d94 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1388613851"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:16:24.255231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf16a1e3-3b6f-45a5-bcd6-9f43ba473d94 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:24.263220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf16a1e3-3b6f-45a5-bcd6-9f43ba473d94 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:24.263812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf16a1e3-3b6f-45a5-bcd6-9f43ba473d94 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:24.264974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf16a1e3-3b6f-45a5-bcd6-9f43ba473d94 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:24.265426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf16a1e3-3b6f-45a5-bcd6-9f43ba473d94 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:24.436672 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.network.security_group_api [None req-bf16a1e3-3b6f-45a5-bcd6-9f43ba473d94 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Adding security group 9f310866-97a2-4680-83bd-2c9b53041cfa to port 96172585-ab70-49d3-8cd4-b1a57e400788 Aug 04 15:16:24.811915 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf16a1e3-3b6f-45a5-bcd6-9f43ba473d94 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/action" status: 202 len: 0 microversion: 2.1 time: 0.563828 Aug 04 15:16:24.814744 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3546/7087] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:16:24 2022] POST /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 15:16:24.824561 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-72715c86-963f-4717-acd3-7c2b3af18bc9 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:24.826527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-72715c86-963f-4717-acd3-7c2b3af18bc9 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:24.835580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72715c86-963f-4717-acd3-7c2b3af18bc9 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:24.836666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72715c86-963f-4717-acd3-7c2b3af18bc9 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:24.837589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72715c86-963f-4717-acd3-7c2b3af18bc9 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:24.838047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-72715c86-963f-4717-acd3-7c2b3af18bc9 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:24.889982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ca285ae2-1904-411f-9c2e-222d3d5fe2fb req-5123cfb0-7421-48fe-bee9-cb379273d10e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f04e53-db6c-4f57-847d-6cbb534babe4", "tag": "96172585-ab70-49d3-8cd4-b1a57e400788"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:16:24.901764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ca285ae2-1904-411f-9c2e-222d3d5fe2fb req-5123cfb0-7421-48fe-bee9-cb379273d10e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:24.902207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ca285ae2-1904-411f-9c2e-222d3d5fe2fb req-5123cfb0-7421-48fe-bee9-cb379273d10e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:24.920526 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ca285ae2-1904-411f-9c2e-222d3d5fe2fb req-5123cfb0-7421-48fe-bee9-cb379273d10e service nova] Creating event network-changed:96172585-ab70-49d3-8cd4-b1a57e400788 for instance 22f04e53-db6c-4f57-847d-6cbb534babe4 on n-h2-844627-10 Aug 04 15:16:24.930260 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ca285ae2-1904-411f-9c2e-222d3d5fe2fb req-5123cfb0-7421-48fe-bee9-cb379273d10e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044081 Aug 04 15:16:24.931560 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3547/7088] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:16:25.078036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-72715c86-963f-4717-acd3-7c2b3af18bc9 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:25.090745 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-72715c86-963f-4717-acd3-7c2b3af18bc9 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1761 microversion: 2.1 time: 0.271789 Aug 04 15:16:25.092094 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3542/7089] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:24 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1761 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:40.833083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:40.833838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:40.838569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d6123ff-6a94-4a27-af43-cffd99199546 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:16:40.840911 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d6123ff-6a94-4a27-af43-cffd99199546 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:40.848251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d6123ff-6a94-4a27-af43-cffd99199546 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:40.848698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d6123ff-6a94-4a27-af43-cffd99199546 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:40.849503 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d6123ff-6a94-4a27-af43-cffd99199546 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:40.849937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d6123ff-6a94-4a27-af43-cffd99199546 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:40.925527 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d6123ff-6a94-4a27-af43-cffd99199546 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/action" status: 202 len: 0 microversion: 2.1 time: 0.095908 Aug 04 15:16:40.926383 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3548/7090] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:16:40 2022] POST /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:16:40.934979 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6e533986-bd9b-47cc-87f2-0dce2c71d539 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:40.935756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6e533986-bd9b-47cc-87f2-0dce2c71d539 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:40.938743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:40.939569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=8 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:16:40.946394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e533986-bd9b-47cc-87f2-0dce2c71d539 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:40.946394 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e533986-bd9b-47cc-87f2-0dce2c71d539 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:40.946930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e533986-bd9b-47cc-87f2-0dce2c71d539 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:40.947395 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6e533986-bd9b-47cc-87f2-0dce2c71d539 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:41.279571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6e533986-bd9b-47cc-87f2-0dce2c71d539 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:41.287912 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6e533986-bd9b-47cc-87f2-0dce2c71d539 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1753 microversion: 2.1 time: 0.356901 Aug 04 15:16:41.288494 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3543/7091] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:40 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1753 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:42.310452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7d62e273-1d23-4e9e-a30b-f5697c9c0109 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:42.311166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7d62e273-1d23-4e9e-a30b-f5697c9c0109 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:42.318108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d62e273-1d23-4e9e-a30b-f5697c9c0109 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:42.318571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d62e273-1d23-4e9e-a30b-f5697c9c0109 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:42.319374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d62e273-1d23-4e9e-a30b-f5697c9c0109 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:42.319824 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7d62e273-1d23-4e9e-a30b-f5697c9c0109 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:42.465796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7d62e273-1d23-4e9e-a30b-f5697c9c0109 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:42.473964 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7d62e273-1d23-4e9e-a30b-f5697c9c0109 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1758 microversion: 2.1 time: 0.168683 Aug 04 15:16:42.474540 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3549/7092] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:42 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:43.495809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6bf77098-85a4-44a6-af61-1d3ddbdb53bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:43.496441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6bf77098-85a4-44a6-af61-1d3ddbdb53bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:43.503813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bf77098-85a4-44a6-af61-1d3ddbdb53bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:43.504285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bf77098-85a4-44a6-af61-1d3ddbdb53bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:43.505114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bf77098-85a4-44a6-af61-1d3ddbdb53bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:43.505574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6bf77098-85a4-44a6-af61-1d3ddbdb53bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:43.662208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6bf77098-85a4-44a6-af61-1d3ddbdb53bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:43.671518 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6bf77098-85a4-44a6-af61-1d3ddbdb53bd tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1758 microversion: 2.1 time: 0.179693 Aug 04 15:16:43.672094 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3544/7093] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:43 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:44.693368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc122b45-02d3-4d1f-a773-9dff56205494 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:44.694120 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc122b45-02d3-4d1f-a773-9dff56205494 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:44.701691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc122b45-02d3-4d1f-a773-9dff56205494 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:44.702148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc122b45-02d3-4d1f-a773-9dff56205494 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:44.702929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc122b45-02d3-4d1f-a773-9dff56205494 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:44.703378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc122b45-02d3-4d1f-a773-9dff56205494 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:44.853003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc122b45-02d3-4d1f-a773-9dff56205494 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:44.861531 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc122b45-02d3-4d1f-a773-9dff56205494 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1758 microversion: 2.1 time: 0.172805 Aug 04 15:16:44.862625 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3550/7094] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:44 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:16:45.883037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7079e658-da87-4f99-a5bf-1bcf457f9323 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:45.883676 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7079e658-da87-4f99-a5bf-1bcf457f9323 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:45.890749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7079e658-da87-4f99-a5bf-1bcf457f9323 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:45.891210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7079e658-da87-4f99-a5bf-1bcf457f9323 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:45.891985 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7079e658-da87-4f99-a5bf-1bcf457f9323 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:45.892434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7079e658-da87-4f99-a5bf-1bcf457f9323 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:46.036708 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7079e658-da87-4f99-a5bf-1bcf457f9323 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:46.044838 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7079e658-da87-4f99-a5bf-1bcf457f9323 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1758 microversion: 2.1 time: 0.165815 Aug 04 15:16:46.045424 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3545/7095] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:45 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:47.066235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c2c17acd-b746-403a-9c11-45be770288ed tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:47.066861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c2c17acd-b746-403a-9c11-45be770288ed tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:47.073809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2c17acd-b746-403a-9c11-45be770288ed tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:47.074264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2c17acd-b746-403a-9c11-45be770288ed tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:47.075031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2c17acd-b746-403a-9c11-45be770288ed tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:47.075474 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c2c17acd-b746-403a-9c11-45be770288ed tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:47.230557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c2c17acd-b746-403a-9c11-45be770288ed tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:47.239303 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c2c17acd-b746-403a-9c11-45be770288ed tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1758 microversion: 2.1 time: 0.177521 Aug 04 15:16:47.239878 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3551/7096] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:47 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:48.261639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f4ed1b49-df2b-4c1f-a99b-e79faf3f00f7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:48.262272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f4ed1b49-df2b-4c1f-a99b-e79faf3f00f7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:48.269845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4ed1b49-df2b-4c1f-a99b-e79faf3f00f7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:48.270310 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4ed1b49-df2b-4c1f-a99b-e79faf3f00f7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:48.271088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4ed1b49-df2b-4c1f-a99b-e79faf3f00f7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:48.271540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f4ed1b49-df2b-4c1f-a99b-e79faf3f00f7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:48.416466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f4ed1b49-df2b-4c1f-a99b-e79faf3f00f7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:48.424582 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f4ed1b49-df2b-4c1f-a99b-e79faf3f00f7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1758 microversion: 2.1 time: 0.166909 Aug 04 15:16:48.425243 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3546/7097] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:48 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:16:49.446233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2b773589-4da2-42b6-b94f-2e5add24814d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:49.446792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2b773589-4da2-42b6-b94f-2e5add24814d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:49.453869 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b773589-4da2-42b6-b94f-2e5add24814d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:49.454356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b773589-4da2-42b6-b94f-2e5add24814d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:49.455141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b773589-4da2-42b6-b94f-2e5add24814d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:49.455589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2b773589-4da2-42b6-b94f-2e5add24814d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:49.606782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2b773589-4da2-42b6-b94f-2e5add24814d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:49.615756 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2b773589-4da2-42b6-b94f-2e5add24814d tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1758 microversion: 2.1 time: 0.173530 Aug 04 15:16:49.616335 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3552/7098] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:49 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:50.638520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-764bf576-035f-4de4-84dc-87914b2d18b7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:50.638991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-764bf576-035f-4de4-84dc-87914b2d18b7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:50.648211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-764bf576-035f-4de4-84dc-87914b2d18b7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:50.649272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-764bf576-035f-4de4-84dc-87914b2d18b7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:50.650154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-764bf576-035f-4de4-84dc-87914b2d18b7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:50.651041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-764bf576-035f-4de4-84dc-87914b2d18b7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:50.797476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-764bf576-035f-4de4-84dc-87914b2d18b7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:50.805823 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-764bf576-035f-4de4-84dc-87914b2d18b7 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1758 microversion: 2.1 time: 0.171772 Aug 04 15:16:50.806425 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3547/7099] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:50 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:51.828044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-68094d0f-85c3-42e3-ab9d-fbc34b0d9022 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:51.828659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-68094d0f-85c3-42e3-ab9d-fbc34b0d9022 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:51.835109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68094d0f-85c3-42e3-ab9d-fbc34b0d9022 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:51.835556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68094d0f-85c3-42e3-ab9d-fbc34b0d9022 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:51.836321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68094d0f-85c3-42e3-ab9d-fbc34b0d9022 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:51.836756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-68094d0f-85c3-42e3-ab9d-fbc34b0d9022 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:51.986279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-68094d0f-85c3-42e3-ab9d-fbc34b0d9022 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:51.994686 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-68094d0f-85c3-42e3-ab9d-fbc34b0d9022 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1758 microversion: 2.1 time: 0.170907 Aug 04 15:16:51.995277 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3553/7100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:51 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:16:53.015765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aad399ed-56f1-46e9-b331-7be8f7d50200 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:16:53.016405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aad399ed-56f1-46e9-b331-7be8f7d50200 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:16:53.023072 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aad399ed-56f1-46e9-b331-7be8f7d50200 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:53.023541 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aad399ed-56f1-46e9-b331-7be8f7d50200 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:53.024331 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aad399ed-56f1-46e9-b331-7be8f7d50200 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:16:53.024792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aad399ed-56f1-46e9-b331-7be8f7d50200 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:16:53.170204 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aad399ed-56f1-46e9-b331-7be8f7d50200 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:16:53.179014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aad399ed-56f1-46e9-b331-7be8f7d50200 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1761 microversion: 2.1 time: 0.167195 Aug 04 15:16:53.179590 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3548/7101] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:16:53 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:17:25.702136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-12607c90-1c25-4ea8-a4a2-97bc4368b763 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1388613851"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:17:25.702996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-12607c90-1c25-4ea8-a4a2-97bc4368b763 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:25.705908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:17:25.706659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:17:25.714300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12607c90-1c25-4ea8-a4a2-97bc4368b763 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:25.714879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12607c90-1c25-4ea8-a4a2-97bc4368b763 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:25.715808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12607c90-1c25-4ea8-a4a2-97bc4368b763 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:25.716344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12607c90-1c25-4ea8-a4a2-97bc4368b763 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:25.859688 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.network.security_group_api [None req-12607c90-1c25-4ea8-a4a2-97bc4368b763 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Removing security group 9f310866-97a2-4680-83bd-2c9b53041cfa from port 96172585-ab70-49d3-8cd4-b1a57e400788 Aug 04 15:17:26.234191 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-12607c90-1c25-4ea8-a4a2-97bc4368b763 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "POST /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/action" status: 202 len: 0 microversion: 2.1 time: 0.536975 Aug 04 15:17:26.238956 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3554/7102] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:17:25 2022] POST /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 15:17:26.248364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-72684092-80df-42a6-bf46-195f34a7e143 req-7c067813-08b9-4d79-9ace-b9bf2fa3a4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f04e53-db6c-4f57-847d-6cbb534babe4", "tag": "96172585-ab70-49d3-8cd4-b1a57e400788"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:17:26.265526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:17:26.267247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=36 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:17:26.271565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-72684092-80df-42a6-bf46-195f34a7e143 req-7c067813-08b9-4d79-9ace-b9bf2fa3a4e0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:26.272746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-72684092-80df-42a6-bf46-195f34a7e143 req-7c067813-08b9-4d79-9ace-b9bf2fa3a4e0 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:26.297271 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-72684092-80df-42a6-bf46-195f34a7e143 req-7c067813-08b9-4d79-9ace-b9bf2fa3a4e0 service nova] Creating event network-changed:96172585-ab70-49d3-8cd4-b1a57e400788 for instance 22f04e53-db6c-4f57-847d-6cbb534babe4 on n-h2-844627-10 Aug 04 15:17:26.307968 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-72684092-80df-42a6-bf46-195f34a7e143 req-7c067813-08b9-4d79-9ace-b9bf2fa3a4e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066516 Aug 04 15:17:26.309982 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3549/7103] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:17:28.399368 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-73d6c713-fe42-46c1-a65b-5e154b3b9b76 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:28.400365 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-73d6c713-fe42-46c1-a65b-5e154b3b9b76 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:28.402817 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-39059278-38a6-41d7-905e-c1eda9a8cb26 req-a5cfe590-fba0-45a1-8c9b-ceb47aea440a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f04e53-db6c-4f57-847d-6cbb534babe4", "tag": "96172585-ab70-49d3-8cd4-b1a57e400788"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:17:28.411115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73d6c713-fe42-46c1-a65b-5e154b3b9b76 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:28.412107 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73d6c713-fe42-46c1-a65b-5e154b3b9b76 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:28.413621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73d6c713-fe42-46c1-a65b-5e154b3b9b76 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:28.414695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-73d6c713-fe42-46c1-a65b-5e154b3b9b76 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:28.422160 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-39059278-38a6-41d7-905e-c1eda9a8cb26 req-a5cfe590-fba0-45a1-8c9b-ceb47aea440a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:28.422803 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-39059278-38a6-41d7-905e-c1eda9a8cb26 req-a5cfe590-fba0-45a1-8c9b-ceb47aea440a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:28.445913 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-39059278-38a6-41d7-905e-c1eda9a8cb26 req-a5cfe590-fba0-45a1-8c9b-ceb47aea440a service nova] Creating event network-changed:96172585-ab70-49d3-8cd4-b1a57e400788 for instance 22f04e53-db6c-4f57-847d-6cbb534babe4 on n-h2-844627-10 Aug 04 15:17:28.454910 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-39059278-38a6-41d7-905e-c1eda9a8cb26 req-a5cfe590-fba0-45a1-8c9b-ceb47aea440a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062596 Aug 04 15:17:28.455709 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3550/7104] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:17:28.567532 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-73d6c713-fe42-46c1-a65b-5e154b3b9b76 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lazy-loading 'services' on Instance uuid 22f04e53-db6c-4f57-847d-6cbb534babe4 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:17:28.677874 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-73d6c713-fe42-46c1-a65b-5e154b3b9b76 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "DELETE /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments/17cd805b-ce3d-41dc-85e3-ebaf60bc02a9" status: 202 len: 0 microversion: 2.1 time: 0.287997 Aug 04 15:17:28.678490 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3555/7105] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:17:28 2022] DELETE /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments/17cd805b-ce3d-41dc-85e3-ebaf60bc02a9 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:17:28.693380 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-79f8a569-257b-444b-93dc-c87d5edc90ab tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:28.696350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-79f8a569-257b-444b-93dc-c87d5edc90ab tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:28.704527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79f8a569-257b-444b-93dc-c87d5edc90ab tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:28.705486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79f8a569-257b-444b-93dc-c87d5edc90ab tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:28.706831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79f8a569-257b-444b-93dc-c87d5edc90ab tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:28.708071 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-79f8a569-257b-444b-93dc-c87d5edc90ab tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:28.797159 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-79f8a569-257b-444b-93dc-c87d5edc90ab tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110601 Aug 04 15:17:28.798952 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3551/7106] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:17:28 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:17:29.813362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cbb08068-d05f-4f63-9696-fd9b6861fc36 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:29.816162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cbb08068-d05f-4f63-9696-fd9b6861fc36 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:29.828373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbb08068-d05f-4f63-9696-fd9b6861fc36 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:29.829340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbb08068-d05f-4f63-9696-fd9b6861fc36 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:29.830808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbb08068-d05f-4f63-9696-fd9b6861fc36 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:29.831666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbb08068-d05f-4f63-9696-fd9b6861fc36 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:29.883113 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cbb08068-d05f-4f63-9696-fd9b6861fc36 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074411 Aug 04 15:17:29.883702 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3556/7107] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:17:29 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:17:30.896849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f40494cb-3fce-4d27-8b57-58a6a39b2a97 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:30.899320 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f40494cb-3fce-4d27-8b57-58a6a39b2a97 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:30.908558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f40494cb-3fce-4d27-8b57-58a6a39b2a97 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:30.909123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f40494cb-3fce-4d27-8b57-58a6a39b2a97 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:30.910105 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f40494cb-3fce-4d27-8b57-58a6a39b2a97 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:30.910610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f40494cb-3fce-4d27-8b57-58a6a39b2a97 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:30.947110 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f40494cb-3fce-4d27-8b57-58a6a39b2a97 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054904 Aug 04 15:17:30.948023 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3552/7108] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:17:30 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:17:31.960500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9119a161-deff-45c2-895b-10d60d32b447 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:31.963066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9119a161-deff-45c2-895b-10d60d32b447 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:31.970803 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9119a161-deff-45c2-895b-10d60d32b447 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:31.971257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9119a161-deff-45c2-895b-10d60d32b447 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:31.972075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9119a161-deff-45c2-895b-10d60d32b447 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:31.972522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9119a161-deff-45c2-895b-10d60d32b447 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:32.009230 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9119a161-deff-45c2-895b-10d60d32b447 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053370 Aug 04 15:17:32.009679 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3557/7109] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:17:31 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:17:33.027157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a6278bda-6e91-400b-b5f2-7894cfb863b0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:33.031434 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a6278bda-6e91-400b-b5f2-7894cfb863b0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:33.040702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6278bda-6e91-400b-b5f2-7894cfb863b0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:33.041208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6278bda-6e91-400b-b5f2-7894cfb863b0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:33.042365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6278bda-6e91-400b-b5f2-7894cfb863b0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:33.042824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a6278bda-6e91-400b-b5f2-7894cfb863b0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:33.078258 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a6278bda-6e91-400b-b5f2-7894cfb863b0 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060172 Aug 04 15:17:33.079863 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3553/7110] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:17:33 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:17:34.091515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-782f43a4-e5fe-44df-aca6-459a5852bd0e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:34.093650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-782f43a4-e5fe-44df-aca6-459a5852bd0e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:34.100838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-782f43a4-e5fe-44df-aca6-459a5852bd0e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:34.101328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-782f43a4-e5fe-44df-aca6-459a5852bd0e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:34.102137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-782f43a4-e5fe-44df-aca6-459a5852bd0e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:34.102585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-782f43a4-e5fe-44df-aca6-459a5852bd0e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:34.131595 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-782f43a4-e5fe-44df-aca6-459a5852bd0e tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044214 Aug 04 15:17:34.132163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3558/7111] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 15:17:34 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 15:17:34.142850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:34.143450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:34.151744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:34.152225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:34.153047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:34.153501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:34.234175 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] HTTP exception thrown: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 is not attached to volume 17cd805b-ce3d-41dc-85e3-ebaf60bc02a9 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Request method failure captured: Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: request: DELETE /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments/17cd805b-ce3d-41dc-85e3-ebaf60bc02a9 HTTP/1.1 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-FxLkKwrBmqBAoK2eSQUx8EUXknoK42003rJ6tx_Xb0zE46m5t3TOOUHfzQRY8ZNSKp3aZN-2-bH-ZO0UOUoy4Hr7uWiOaCPzi0DYV9dTLc3pWYeqzcdFqjGGIantvB2JdVXWrJgazECvlOIHgrgi-wwRMb5U5HTAjuyyl1-4MO-gk Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 52ccdc59c6ac4b778411600be38dc225 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52ccdc59c6ac4b778411600be38dc225"}]}] Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 52ccdc59c6ac4b778411600be38dc225 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestMinimumBasicScenario-1263360735-project Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 4d7d2f3930a449d9afe3f92540a05adc Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestMinimumBasicScenario-1263360735-project Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 is not attached to volume 17cd805b-ce3d-41dc-85e3-ebaf60bc02a9 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'server_id': '22f04e53-db6c-4f57-847d-6cbb534babe4', 'id': '17cd805b-ce3d-41dc-85e3-ebaf60bc02a9'} Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 17cd805b-ce3d-41dc-85e3-ebaf60bc02a9. Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 is not attached to volume 17cd805b-ce3d-41dc-85e3-ebaf60bc02a9 Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:17:34.236088 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:17:34.240625 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:17:34.240625 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:17:34.240625 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 is not attached to volume 17cd805b-ce3d-41dc-85e3-ebaf60bc02a9 Aug 04 15:17:34.240625 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:34.240625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Returning 404 to user: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 is not attached to volume 17cd805b-ce3d-41dc-85e3-ebaf60bc02a9 {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:17:34.240625 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c75f1f78-94cf-4a2c-ae36-5e76ea80c520 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "DELETE /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments/17cd805b-ce3d-41dc-85e3-ebaf60bc02a9" status: 404 len: 154 microversion: 2.1 time: 0.098909 Aug 04 15:17:34.240625 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3554/7112] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 15:17:34 2022] DELETE /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4/os-volume_attachments/17cd805b-ce3d-41dc-85e3-ebaf60bc02a9 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:17:37.539498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac9db11c-bdff-4a73-96ad-7783b3ee42d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:37.540031 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac9db11c-bdff-4a73-96ad-7783b3ee42d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:37.547127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac9db11c-bdff-4a73-96ad-7783b3ee42d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:37.547587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac9db11c-bdff-4a73-96ad-7783b3ee42d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:37.548355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac9db11c-bdff-4a73-96ad-7783b3ee42d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:37.548798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac9db11c-bdff-4a73-96ad-7783b3ee42d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:37.574720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac9db11c-bdff-4a73-96ad-7783b3ee42d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:17:37.659116 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac9db11c-bdff-4a73-96ad-7783b3ee42d1 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "DELETE /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 204 len: 0 microversion: 2.1 time: 0.123192 Aug 04 15:17:37.659707 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3559/7113] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:17:37 2022] DELETE /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:17:37.671857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0a245be2-e0f7-4ae2-92a3-5864f6ae409a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:37.672814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0a245be2-e0f7-4ae2-92a3-5864f6ae409a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:37.681958 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a245be2-e0f7-4ae2-92a3-5864f6ae409a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:37.682466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a245be2-e0f7-4ae2-92a3-5864f6ae409a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:37.683272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a245be2-e0f7-4ae2-92a3-5864f6ae409a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:37.683727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0a245be2-e0f7-4ae2-92a3-5864f6ae409a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:37.841853 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0a245be2-e0f7-4ae2-92a3-5864f6ae409a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:17:37.850297 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0a245be2-e0f7-4ae2-92a3-5864f6ae409a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1555 microversion: 2.1 time: 0.185415 Aug 04 15:17:37.851345 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3555/7114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:17:37 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:17:38.872215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e94d1eda-7a13-4fb1-8e89-cc7721f3a84a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:38.872950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e94d1eda-7a13-4fb1-8e89-cc7721f3a84a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:38.880550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e94d1eda-7a13-4fb1-8e89-cc7721f3a84a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:38.881023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e94d1eda-7a13-4fb1-8e89-cc7721f3a84a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:38.881794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e94d1eda-7a13-4fb1-8e89-cc7721f3a84a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:38.882228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e94d1eda-7a13-4fb1-8e89-cc7721f3a84a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:39.019959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e94d1eda-7a13-4fb1-8e89-cc7721f3a84a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:17:39.027853 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e94d1eda-7a13-4fb1-8e89-cc7721f3a84a tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1555 microversion: 2.1 time: 0.159863 Aug 04 15:17:39.028444 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3560/7115] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:17:38 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:17:39.803917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5e2a7a81-35e6-4f0e-a3ee-e696b40f2a9e req-88919ab9-78c3-4bd9-b131-4fd6b4488284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f04e53-db6c-4f57-847d-6cbb534babe4", "name": "network-vif-deleted", "tag": "96172585-ab70-49d3-8cd4-b1a57e400788"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:17:39.815566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5e2a7a81-35e6-4f0e-a3ee-e696b40f2a9e req-88919ab9-78c3-4bd9-b131-4fd6b4488284 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:39.816201 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5e2a7a81-35e6-4f0e-a3ee-e696b40f2a9e req-88919ab9-78c3-4bd9-b131-4fd6b4488284 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:39.831702 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5e2a7a81-35e6-4f0e-a3ee-e696b40f2a9e req-88919ab9-78c3-4bd9-b131-4fd6b4488284 service nova] Creating event network-vif-deleted:96172585-ab70-49d3-8cd4-b1a57e400788 for instance 22f04e53-db6c-4f57-847d-6cbb534babe4 on n-h2-844627-10 Aug 04 15:17:39.840388 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5e2a7a81-35e6-4f0e-a3ee-e696b40f2a9e req-88919ab9-78c3-4bd9-b131-4fd6b4488284 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040483 Aug 04 15:17:39.841034 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3556/7116] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:17:40.049258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:40.049853 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:40.056961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:40.057416 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:40.058196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:40.058633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:40.093203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:40.093653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:40.094116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lazy-loading 'fault' on Instance uuid 22f04e53-db6c-4f57-847d-6cbb534babe4 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:17:40.140351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d7d2f3930a449d9afe3f92540a05adc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccdc59c6ac4b778411600be38dc225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:17:40.154431 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-84b81c97-04d1-4174-9882-64cdef4bc2b4 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 200 len: 1349 microversion: 2.1 time: 0.109159 Aug 04 15:17:40.155592 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3561/7117] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:17:40 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:17:41.178298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:41.179224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] [instance: 22f04e53-db6c-4f57-847d-6cbb534babe4] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:41.186368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:41.186912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:41.187812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:41.188361 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:41.210545 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] HTTP exception thrown: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 could not be found. Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Request method failure captured: Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 HTTP/1.1 Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-FxLkKwrBmqBAoK2eSQUx8EUXknoK42003rJ6tx_Xb0zE46m5t3TOOUHfzQRY8ZNSKp3aZN-2-bH-ZO0UOUoy4Hr7uWiOaCPzi0DYV9dTLc3pWYeqzcdFqjGGIantvB2JdVXWrJgazECvlOIHgrgi-wwRMb5U5HTAjuyyl1-4MO-gk Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 52ccdc59c6ac4b778411600be38dc225 Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/52ccdc59c6ac4b778411600be38dc225"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/52ccdc59c6ac4b778411600be38dc225"}]}] Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 52ccdc59c6ac4b778411600be38dc225 Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1263360735 Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestMinimumBasicScenario-1263360735-project Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 4d7d2f3930a449d9afe3f92540a05adc Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestMinimumBasicScenario-1263360735-project Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 could not be found. Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '22f04e53-db6c-4f57-847d-6cbb534babe4'} Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 could not be found. Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 could not be found. Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:17:41.212566 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 could not be found. Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Returning 404 to user: Instance 22f04e53-db6c-4f57-847d-6cbb534babe4 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf5eb2b9-83bf-4132-a6a6-d25c72707545 tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4" status: 404 len: 111 microversion: 2.1 time: 0.041698 Aug 04 15:17:41.217455 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3557/7118] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:17:41 2022] GET /compute/v2.1/servers/22f04e53-db6c-4f57-847d-6cbb534babe4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:17:41.224050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d8f06860-d002-4553-aab7-d7ff043d31cf tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] Calling method '.version_select at 0x7f46f3cd1820>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:41.250240 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d8f06860-d002-4553-aab7-d7ff043d31cf tempest-TestMinimumBasicScenario-1263360735 tempest-TestMinimumBasicScenario-1263360735-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2065833062" status: 202 len: 0 microversion: 2.1 time: 0.030223 Aug 04 15:17:41.250833 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3562/7119] 10.222.0.66 () {58 vars in 1272 bytes} [Thu Aug 4 15:17:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2065833062 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:17:50.633324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-404b8493-ef66-4216-ae63-f031f2a78abe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: .version_select at 0x7f46f061d0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-984933744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4aIpEEkvnFDf9qff3/muuo+T8Aj+IbOpZyAr00EfqPl+duzc41YfF9tmDi7REdcOPtPFBwDS0M657P+ckedLARQY1FvM5sDhXlC6GnjxE6QdQclPGNHaO9/2IEDUxJRQ=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:17:50.650181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-404b8493-ef66-4216-ae63-f031f2a78abe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:17:50.655459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-404b8493-ef66-4216-ae63-f031f2a78abe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:17:50.680830 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-404b8493-ef66-4216-ae63-f031f2a78abe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.224697 Aug 04 15:17:50.681471 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3558/7120] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:17:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:17:56.429436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:17:56.430910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:17:56.435681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-859782743", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "1bd83a7f-3485-41df-9c73-b12313ff223a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-984933744", "security_groups": [{"name": "tempest-secgroup-smoke-2108339317"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:17:56.587536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] validate_networks() for [('1bd83a7f-3485-41df-9c73-b12313ff223a', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:17:57.180420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:17:57.180849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:17:57.181342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:17:57.181752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:17:57.182169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:17:57.192411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:57.192862 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:57.193678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:57.194113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:57.213253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:17:57.219103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:17:57.232412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:17:57.234929 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:17:57.284549 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d004f456-5ea5-49fe-bdda-ca32d903fd93 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.857244 Aug 04 15:17:57.291539 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3563/7121] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:17:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:17:57.293774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=38 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:17:57.299132 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4f115d4e-e95d-42d9-9357-d51b64fea286 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:57.299758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4f115d4e-e95d-42d9-9357-d51b64fea286 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:57.362860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4f115d4e-e95d-42d9-9357-d51b64fea286 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:17:57.371498 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4f115d4e-e95d-42d9-9357-d51b64fea286 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1265 microversion: 2.1 time: 0.078468 Aug 04 15:17:57.372098 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3559/7122] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:17:57 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:17:58.393372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1feabf8d-5aed-45f7-a356-dd0420625942 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:58.394854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1feabf8d-5aed-45f7-a356-dd0420625942 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:58.403802 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1feabf8d-5aed-45f7-a356-dd0420625942 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:58.404371 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1feabf8d-5aed-45f7-a356-dd0420625942 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:58.405284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1feabf8d-5aed-45f7-a356-dd0420625942 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:58.405821 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1feabf8d-5aed-45f7-a356-dd0420625942 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:58.543841 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1feabf8d-5aed-45f7-a356-dd0420625942 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:17:58.585745 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1feabf8d-5aed-45f7-a356-dd0420625942 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1317 microversion: 2.1 time: 0.192755 Aug 04 15:17:58.587075 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3564/7123] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:17:58 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:17:59.608857 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-84feb214-695f-4ae6-8e98-1458340ac264 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:17:59.609558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-84feb214-695f-4ae6-8e98-1458340ac264 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:17:59.613938 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:17:59.622001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84feb214-695f-4ae6-8e98-1458340ac264 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:59.622712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84feb214-695f-4ae6-8e98-1458340ac264 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:59.623642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84feb214-695f-4ae6-8e98-1458340ac264 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:17:59.624170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-84feb214-695f-4ae6-8e98-1458340ac264 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:17:59.854776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-84feb214-695f-4ae6-8e98-1458340ac264 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:17:59.863260 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-84feb214-695f-4ae6-8e98-1458340ac264 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1391 microversion: 2.1 time: 0.258289 Aug 04 15:17:59.865073 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3560/7124] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:17:59 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:00.089283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e7d247f8-1f4c-4488-a79c-2b0bdbd7035c req-23353fa7-9c06-45f2-b19c-5e39f39e46b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b22170b-b2ea-4ab7-8c64-4cf8e8816370", "tag": "878af8bf-f525-447f-bf84-21dd098dda98"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:00.102126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e7d247f8-1f4c-4488-a79c-2b0bdbd7035c req-23353fa7-9c06-45f2-b19c-5e39f39e46b8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:00.102590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e7d247f8-1f4c-4488-a79c-2b0bdbd7035c req-23353fa7-9c06-45f2-b19c-5e39f39e46b8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:00.120743 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e7d247f8-1f4c-4488-a79c-2b0bdbd7035c req-23353fa7-9c06-45f2-b19c-5e39f39e46b8 service nova] Creating event network-changed:878af8bf-f525-447f-bf84-21dd098dda98 for instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 on n-h2-844627-10 Aug 04 15:18:00.126135 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e7d247f8-1f4c-4488-a79c-2b0bdbd7035c req-23353fa7-9c06-45f2-b19c-5e39f39e46b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040658 Aug 04 15:18:00.126989 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3565/7125] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:18:00.885037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f565ba3f-5791-403f-88f7-58516ca0320e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:00.885669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f565ba3f-5791-403f-88f7-58516ca0320e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:00.893091 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f565ba3f-5791-403f-88f7-58516ca0320e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:00.893557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f565ba3f-5791-403f-88f7-58516ca0320e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:00.894355 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f565ba3f-5791-403f-88f7-58516ca0320e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:00.894805 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f565ba3f-5791-403f-88f7-58516ca0320e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:01.045379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f565ba3f-5791-403f-88f7-58516ca0320e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:01.053918 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f565ba3f-5791-403f-88f7-58516ca0320e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1391 microversion: 2.1 time: 0.173328 Aug 04 15:18:01.054504 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3561/7126] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:00 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:02.076387 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9547e20b-f9bd-48a1-84e4-6d21f3e1b7b7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:02.077264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9547e20b-f9bd-48a1-84e4-6d21f3e1b7b7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:02.084484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9547e20b-f9bd-48a1-84e4-6d21f3e1b7b7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:02.085048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9547e20b-f9bd-48a1-84e4-6d21f3e1b7b7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:02.085955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9547e20b-f9bd-48a1-84e4-6d21f3e1b7b7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:02.086453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9547e20b-f9bd-48a1-84e4-6d21f3e1b7b7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:02.289016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9547e20b-f9bd-48a1-84e4-6d21f3e1b7b7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:02.297841 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9547e20b-f9bd-48a1-84e4-6d21f3e1b7b7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1391 microversion: 2.1 time: 0.227180 Aug 04 15:18:02.298434 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3566/7127] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:02 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:03.319234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c3f989c8-bb48-4cc3-8d17-3df29eb3560f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:03.319872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c3f989c8-bb48-4cc3-8d17-3df29eb3560f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:03.327061 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3f989c8-bb48-4cc3-8d17-3df29eb3560f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:03.327536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3f989c8-bb48-4cc3-8d17-3df29eb3560f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:03.328332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3f989c8-bb48-4cc3-8d17-3df29eb3560f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:03.328798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c3f989c8-bb48-4cc3-8d17-3df29eb3560f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:03.474966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c3f989c8-bb48-4cc3-8d17-3df29eb3560f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:03.483055 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c3f989c8-bb48-4cc3-8d17-3df29eb3560f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1391 microversion: 2.1 time: 0.167698 Aug 04 15:18:03.483645 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3562/7128] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:03 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:04.505341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-18d4c08d-57d9-4805-9e01-495dcc029b64 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:04.505985 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-18d4c08d-57d9-4805-9e01-495dcc029b64 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:04.513835 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18d4c08d-57d9-4805-9e01-495dcc029b64 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:04.514281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18d4c08d-57d9-4805-9e01-495dcc029b64 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:04.514934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18d4c08d-57d9-4805-9e01-495dcc029b64 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:04.515379 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-18d4c08d-57d9-4805-9e01-495dcc029b64 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:04.650842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-18d4c08d-57d9-4805-9e01-495dcc029b64 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:04.658425 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-18d4c08d-57d9-4805-9e01-495dcc029b64 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1391 microversion: 2.1 time: 0.157974 Aug 04 15:18:04.659010 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3567/7129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:04 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:05.679905 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4a14f688-1647-4f7b-93a7-9379bd3144f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:05.680556 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4a14f688-1647-4f7b-93a7-9379bd3144f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:05.688457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a14f688-1647-4f7b-93a7-9379bd3144f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:05.689026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a14f688-1647-4f7b-93a7-9379bd3144f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:05.689959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a14f688-1647-4f7b-93a7-9379bd3144f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:05.690443 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4a14f688-1647-4f7b-93a7-9379bd3144f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:05.744493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-aaa16ad7-a2a0-4129-82bb-c689d4322c67 req-1265e17d-b983-4b9c-958b-65400afd3ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b22170b-b2ea-4ab7-8c64-4cf8e8816370", "name": "network-vif-plugged", "status": "completed", "tag": "878af8bf-f525-447f-bf84-21dd098dda98"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:05.756242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-aaa16ad7-a2a0-4129-82bb-c689d4322c67 req-1265e17d-b983-4b9c-958b-65400afd3ecc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:05.758515 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-aaa16ad7-a2a0-4129-82bb-c689d4322c67 req-1265e17d-b983-4b9c-958b-65400afd3ecc service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:05.776314 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-aaa16ad7-a2a0-4129-82bb-c689d4322c67 req-1265e17d-b983-4b9c-958b-65400afd3ecc service nova] Creating event network-vif-plugged:878af8bf-f525-447f-bf84-21dd098dda98 for instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 on n-h2-844627-10 Aug 04 15:18:05.781762 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-aaa16ad7-a2a0-4129-82bb-c689d4322c67 req-1265e17d-b983-4b9c-958b-65400afd3ecc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041083 Aug 04 15:18:05.782413 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3568/7130] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:18:05.846978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4a14f688-1647-4f7b-93a7-9379bd3144f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:05.856173 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4a14f688-1647-4f7b-93a7-9379bd3144f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1391 microversion: 2.1 time: 0.180994 Aug 04 15:18:05.856791 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3563/7131] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:05 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:18:06.950677 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c7016cce-21c1-493c-b796-8b2ab012d9d7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:06.951534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c7016cce-21c1-493c-b796-8b2ab012d9d7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:06.958500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7016cce-21c1-493c-b796-8b2ab012d9d7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:06.958956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7016cce-21c1-493c-b796-8b2ab012d9d7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:06.959923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7016cce-21c1-493c-b796-8b2ab012d9d7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:06.960402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c7016cce-21c1-493c-b796-8b2ab012d9d7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:07.133221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c7016cce-21c1-493c-b796-8b2ab012d9d7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:07.141974 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c7016cce-21c1-493c-b796-8b2ab012d9d7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1391 microversion: 2.1 time: 0.198517 Aug 04 15:18:07.144525 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3569/7132] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:06 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:08.166931 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-38e1cd5e-8145-4538-b7aa-b60fabb0bee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:08.167571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-38e1cd5e-8145-4538-b7aa-b60fabb0bee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:08.170362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:18:08.176189 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38e1cd5e-8145-4538-b7aa-b60fabb0bee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:08.177261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38e1cd5e-8145-4538-b7aa-b60fabb0bee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:08.178118 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38e1cd5e-8145-4538-b7aa-b60fabb0bee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:08.179111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-38e1cd5e-8145-4538-b7aa-b60fabb0bee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:08.320850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-38e1cd5e-8145-4538-b7aa-b60fabb0bee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:08.328758 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-38e1cd5e-8145-4538-b7aa-b60fabb0bee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1563 microversion: 2.1 time: 0.165759 Aug 04 15:18:08.329372 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3564/7133] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:08 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:08.349292 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-80d9a4b7-2aa5-4581-8878-b338a8c20d5e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:08.349961 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-80d9a4b7-2aa5-4581-8878-b338a8c20d5e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:08.351902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:18:08.352612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:18:08.359657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80d9a4b7-2aa5-4581-8878-b338a8c20d5e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:08.360108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80d9a4b7-2aa5-4581-8878-b338a8c20d5e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:08.361175 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80d9a4b7-2aa5-4581-8878-b338a8c20d5e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:08.361611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-80d9a4b7-2aa5-4581-8878-b338a8c20d5e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:08.509963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-80d9a4b7-2aa5-4581-8878-b338a8c20d5e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:08.517948 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-80d9a4b7-2aa5-4581-8878-b338a8c20d5e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1563 microversion: 2.1 time: 0.172585 Aug 04 15:18:08.518564 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3570/7134] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:08 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:10.566506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bcb0da8a-c90f-4285-8694-b8010d47564d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:10.575574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bcb0da8a-c90f-4285-8694-b8010d47564d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:10.584439 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcb0da8a-c90f-4285-8694-b8010d47564d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:10.585038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcb0da8a-c90f-4285-8694-b8010d47564d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:10.585909 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcb0da8a-c90f-4285-8694-b8010d47564d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:10.586567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bcb0da8a-c90f-4285-8694-b8010d47564d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:10.643941 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-7dc146f2-4562-44e5-9f11-423f6fb0b8ed req-2c7ad7f1-aec4-4194-a040-1b666aa57950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b22170b-b2ea-4ab7-8c64-4cf8e8816370", "tag": "878af8bf-f525-447f-bf84-21dd098dda98"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:10.656441 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7dc146f2-4562-44e5-9f11-423f6fb0b8ed req-2c7ad7f1-aec4-4194-a040-1b666aa57950 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:10.657204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-7dc146f2-4562-44e5-9f11-423f6fb0b8ed req-2c7ad7f1-aec4-4194-a040-1b666aa57950 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:10.673897 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-7dc146f2-4562-44e5-9f11-423f6fb0b8ed req-2c7ad7f1-aec4-4194-a040-1b666aa57950 service nova] Creating event network-changed:878af8bf-f525-447f-bf84-21dd098dda98 for instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 on n-h2-844627-10 Aug 04 15:18:10.681092 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-7dc146f2-4562-44e5-9f11-423f6fb0b8ed req-2c7ad7f1-aec4-4194-a040-1b666aa57950 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111981 Aug 04 15:18:10.681725 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3571/7135] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:18:10.776039 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bcb0da8a-c90f-4285-8694-b8010d47564d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:10.784201 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bcb0da8a-c90f-4285-8694-b8010d47564d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1563 microversion: 2.1 time: 0.222366 Aug 04 15:18:10.785216 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3565/7136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:10 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1563 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:24.131221 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:18:24.131938 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:18:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:18:32.045358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3258c553-e413-4a59-98fd-016f6a9d3738 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:32.047616 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3258c553-e413-4a59-98fd-016f6a9d3738 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:32.050181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:18:32.050849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=38 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:18:32.057669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3258c553-e413-4a59-98fd-016f6a9d3738 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:32.058193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3258c553-e413-4a59-98fd-016f6a9d3738 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:32.059114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3258c553-e413-4a59-98fd-016f6a9d3738 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:32.059648 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3258c553-e413-4a59-98fd-016f6a9d3738 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:32.114773 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3258c553-e413-4a59-98fd-016f6a9d3738 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action" status: 200 len: 24572 microversion: 2.1 time: 0.073718 Aug 04 15:18:32.115455 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3572/7137] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:18:32 2022] POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action => generated 24572 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:18:43.041088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6decba0d-42c9-4c99-8e40-ba980250e9ce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:43.041742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6decba0d-42c9-4c99-8e40-ba980250e9ce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:43.043907 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=11 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:18:43.044754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=36 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:18:43.050672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6decba0d-42c9-4c99-8e40-ba980250e9ce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:43.051140 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6decba0d-42c9-4c99-8e40-ba980250e9ce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:43.051946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6decba0d-42c9-4c99-8e40-ba980250e9ce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:43.052391 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6decba0d-42c9-4c99-8e40-ba980250e9ce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:43.130817 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6decba0d-42c9-4c99-8e40-ba980250e9ce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action" status: 202 len: 0 microversion: 2.1 time: 0.093339 Aug 04 15:18:43.131702 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3566/7138] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:18:43 2022] POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:18:43.144058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6a6751b-6840-46ab-9550-6dbd1e11b803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:43.144814 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6a6751b-6840-46ab-9550-6dbd1e11b803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:43.148412 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:18:43.149682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:18:43.156804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6a6751b-6840-46ab-9550-6dbd1e11b803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:43.157295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6a6751b-6840-46ab-9550-6dbd1e11b803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:43.158092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6a6751b-6840-46ab-9550-6dbd1e11b803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:43.158537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6a6751b-6840-46ab-9550-6dbd1e11b803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:43.310403 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a6a6751b-6840-46ab-9550-6dbd1e11b803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:43.319272 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6a6751b-6840-46ab-9550-6dbd1e11b803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1686 microversion: 2.1 time: 0.181772 Aug 04 15:18:43.319932 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3573/7139] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:43 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:44.343533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-96ad2ab9-78a8-4177-a977-353a9650bba7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:44.344255 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-96ad2ab9-78a8-4177-a977-353a9650bba7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:44.350615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96ad2ab9-78a8-4177-a977-353a9650bba7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:44.351078 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96ad2ab9-78a8-4177-a977-353a9650bba7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:44.351862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96ad2ab9-78a8-4177-a977-353a9650bba7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:44.352337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96ad2ab9-78a8-4177-a977-353a9650bba7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:44.485768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-96ad2ab9-78a8-4177-a977-353a9650bba7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:44.493780 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-96ad2ab9-78a8-4177-a977-353a9650bba7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1666 microversion: 2.1 time: 0.155498 Aug 04 15:18:44.494348 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3567/7140] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:44 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:45.589881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-10fbd7ac-af96-48f7-a164-c575dbc15022 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:45.592312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-10fbd7ac-af96-48f7-a164-c575dbc15022 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:45.600481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10fbd7ac-af96-48f7-a164-c575dbc15022 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:45.600955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10fbd7ac-af96-48f7-a164-c575dbc15022 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:45.601732 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10fbd7ac-af96-48f7-a164-c575dbc15022 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:45.602794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-10fbd7ac-af96-48f7-a164-c575dbc15022 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:45.654479 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-10fbd7ac-af96-48f7-a164-c575dbc15022 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action" status: 200 len: 32647 microversion: 2.1 time: 0.068888 Aug 04 15:18:45.655264 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3574/7141] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:18:45 2022] POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action => generated 32647 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:18:45.668766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fc7308b8-3002-467a-b69c-df3cd0fb48ac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:45.669477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fc7308b8-3002-467a-b69c-df3cd0fb48ac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:45.676790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc7308b8-3002-467a-b69c-df3cd0fb48ac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:45.677300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc7308b8-3002-467a-b69c-df3cd0fb48ac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:45.678099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc7308b8-3002-467a-b69c-df3cd0fb48ac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:45.678550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc7308b8-3002-467a-b69c-df3cd0fb48ac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:45.749908 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fc7308b8-3002-467a-b69c-df3cd0fb48ac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action" status: 202 len: 0 microversion: 2.1 time: 0.085452 Aug 04 15:18:45.750552 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3568/7142] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:18:45 2022] POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:18:45.759949 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f6b36d95-01ba-496f-901a-b5f90a407b7b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:45.761049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f6b36d95-01ba-496f-901a-b5f90a407b7b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:45.768551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6b36d95-01ba-496f-901a-b5f90a407b7b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:45.769162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6b36d95-01ba-496f-901a-b5f90a407b7b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:45.769954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6b36d95-01ba-496f-901a-b5f90a407b7b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:45.770392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6b36d95-01ba-496f-901a-b5f90a407b7b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:45.909889 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f6b36d95-01ba-496f-901a-b5f90a407b7b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:45.918189 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f6b36d95-01ba-496f-901a-b5f90a407b7b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1673 microversion: 2.1 time: 0.162600 Aug 04 15:18:45.918961 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3575/7143] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:45 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:46.941059 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-99c823f4-0d67-4a59-8654-29902a1884b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:46.941765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-99c823f4-0d67-4a59-8654-29902a1884b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:46.948089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99c823f4-0d67-4a59-8654-29902a1884b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:46.948552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99c823f4-0d67-4a59-8654-29902a1884b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:46.949363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99c823f4-0d67-4a59-8654-29902a1884b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:46.949810 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-99c823f4-0d67-4a59-8654-29902a1884b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:47.085996 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-99c823f4-0d67-4a59-8654-29902a1884b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:47.094086 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-99c823f4-0d67-4a59-8654-29902a1884b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1681 microversion: 2.1 time: 0.158202 Aug 04 15:18:47.094642 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3569/7144] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:46 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:47.189513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-92b8b521-d177-4c07-810b-99c44f6aed82 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:47.191792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-92b8b521-d177-4c07-810b-99c44f6aed82 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:47.199845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92b8b521-d177-4c07-810b-99c44f6aed82 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:47.200307 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92b8b521-d177-4c07-810b-99c44f6aed82 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:47.201138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92b8b521-d177-4c07-810b-99c44f6aed82 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:47.201589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-92b8b521-d177-4c07-810b-99c44f6aed82 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:47.251920 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-92b8b521-d177-4c07-810b-99c44f6aed82 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action" status: 200 len: 38433 microversion: 2.1 time: 0.066279 Aug 04 15:18:47.252995 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3576/7145] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:18:47 2022] POST /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370/action => generated 38433 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:18:48.270710 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-966130e8-c9e8-4c9e-b757-7487c9395cc0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:48.271836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-966130e8-c9e8-4c9e-b757-7487c9395cc0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:48.273330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-ceac62be-3133-42f2-8e66-30c0f7ebf476 req-cd90be60-f81b-4ad2-83e1-e592bfbac823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b22170b-b2ea-4ab7-8c64-4cf8e8816370", "tag": "878af8bf-f525-447f-bf84-21dd098dda98"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:48.279113 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966130e8-c9e8-4c9e-b757-7487c9395cc0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:48.279656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966130e8-c9e8-4c9e-b757-7487c9395cc0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:48.280452 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966130e8-c9e8-4c9e-b757-7487c9395cc0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:48.280922 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-966130e8-c9e8-4c9e-b757-7487c9395cc0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:48.286097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ceac62be-3133-42f2-8e66-30c0f7ebf476 req-cd90be60-f81b-4ad2-83e1-e592bfbac823 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:48.286554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-ceac62be-3133-42f2-8e66-30c0f7ebf476 req-cd90be60-f81b-4ad2-83e1-e592bfbac823 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:48.300169 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-ceac62be-3133-42f2-8e66-30c0f7ebf476 req-cd90be60-f81b-4ad2-83e1-e592bfbac823 service nova] Creating event network-changed:878af8bf-f525-447f-bf84-21dd098dda98 for instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 on n-h2-844627-10 Aug 04 15:18:48.306140 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-ceac62be-3133-42f2-8e66-30c0f7ebf476 req-cd90be60-f81b-4ad2-83e1-e592bfbac823 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036425 Aug 04 15:18:48.307172 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3577/7146] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:18:48.310171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-966130e8-c9e8-4c9e-b757-7487c9395cc0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:18:48.409572 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-966130e8-c9e8-4c9e-b757-7487c9395cc0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 204 len: 0 microversion: 2.1 time: 0.142643 Aug 04 15:18:48.410425 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3570/7147] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:18:48 2022] DELETE /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:18:48.420124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4669ed6a-14fe-46ec-ac0e-4a6c88771d12 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:48.420838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4669ed6a-14fe-46ec-ac0e-4a6c88771d12 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:48.427399 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4669ed6a-14fe-46ec-ac0e-4a6c88771d12 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:48.428098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4669ed6a-14fe-46ec-ac0e-4a6c88771d12 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:48.428883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4669ed6a-14fe-46ec-ac0e-4a6c88771d12 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:48.429554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4669ed6a-14fe-46ec-ac0e-4a6c88771d12 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:48.585117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4669ed6a-14fe-46ec-ac0e-4a6c88771d12 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:48.593422 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4669ed6a-14fe-46ec-ac0e-4a6c88771d12 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1687 microversion: 2.1 time: 0.177996 Aug 04 15:18:48.593993 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3578/7148] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:48 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:49.616295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52501924-b511-411b-a168-e8f59cade500 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:49.617036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-52501924-b511-411b-a168-e8f59cade500 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:49.624459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52501924-b511-411b-a168-e8f59cade500 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:49.624950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52501924-b511-411b-a168-e8f59cade500 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:49.625724 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52501924-b511-411b-a168-e8f59cade500 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:49.626173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52501924-b511-411b-a168-e8f59cade500 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:49.845642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-52501924-b511-411b-a168-e8f59cade500 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:18:49.853793 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-52501924-b511-411b-a168-e8f59cade500 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 200 len: 1687 microversion: 2.1 time: 0.242042 Aug 04 15:18:49.854446 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3571/7149] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:49 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 1687 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:18:50.417846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-9cfed893-d306-461f-982a-f9e12b128968 req-d7197bca-a159-4ede-98d6-402fc2da919f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b22170b-b2ea-4ab7-8c64-4cf8e8816370", "name": "network-vif-deleted", "tag": "878af8bf-f525-447f-bf84-21dd098dda98"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:50.430950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9cfed893-d306-461f-982a-f9e12b128968 req-d7197bca-a159-4ede-98d6-402fc2da919f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:50.431411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-9cfed893-d306-461f-982a-f9e12b128968 req-d7197bca-a159-4ede-98d6-402fc2da919f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:50.451011 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-9cfed893-d306-461f-982a-f9e12b128968 req-d7197bca-a159-4ede-98d6-402fc2da919f service nova] Creating event network-vif-deleted:878af8bf-f525-447f-bf84-21dd098dda98 for instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 on n-h2-844627-10 Aug 04 15:18:50.456538 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-9cfed893-d306-461f-982a-f9e12b128968 req-d7197bca-a159-4ede-98d6-402fc2da919f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043379 Aug 04 15:18:50.457256 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3579/7150] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:18:50.876921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:50.878219 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7b22170b-b2ea-4ab7-8c64-4cf8e8816370] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:18:50.886448 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:50.886918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:50.887737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:18:50.888195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:18:50.904318 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] HTTP exception thrown: Instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 could not be found. Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Request method failure captured: Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 HTTP/1.1 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-MdSrctgttr1U5SrenWNZF1MNvZAMBWYuBvkZyWBcdMlKnpUzm7Z071NicUy65ZzzO7N9HvZR2pNs5s6hV4p_fBK0RZlwUHCEJkDgqmnu2Jeut1ekrrTJXveQ-cTX_QJroJUgXevBcCa6Tb3g6wesziFpva-tZG7WXokf3Vn9znV0M Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31a48040328d426d8434ae9c36070d70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31a48040328d426d8434ae9c36070d70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}] Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 1056d22ae221415db1187d24ba7a1285 Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 could not be found. Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7b22170b-b2ea-4ab7-8c64-4cf8e8816370'} Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 could not be found. Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 could not be found. Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:18:50.906070 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 could not be found. Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Returning 404 to user: Instance 7b22170b-b2ea-4ab7-8c64-4cf8e8816370 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-51964d1f-c0fd-48db-9c12-847f5a79abb1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370" status: 404 len: 111 microversion: 2.1 time: 0.034717 Aug 04 15:18:50.910776 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3572/7151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:18:50 2022] GET /compute/v2.1/servers/7b22170b-b2ea-4ab7-8c64-4cf8e8816370 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 15:18:54.468769 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b07547dd-5580-4db6-8029-e1fffada3254 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '.version_select at 0x7f47000469d0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:18:54.500005 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b07547dd-5580-4db6-8029-e1fffada3254 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-984933744" status: 202 len: 0 microversion: 2.1 time: 0.036794 Aug 04 15:18:54.501058 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3580/7152] 10.222.0.66 () {58 vars in 1281 bytes} [Thu Aug 4 15:18:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-984933744 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 15:18:54.530785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-09663fd5-0cda-4642-8a3a-4f0362db9535 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: .version_select at 0x7f470044a160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-644712848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqYr8CNDW5e3QUFss+3cs82XabrZdI1mp6/WTH5xBQR7Txi7oUxr/VV6bxvCX/TIQvoEC5y5mGMzxOi29mgWGt/VQwtaMCI3pyB0z8xinty3/xRpLvHh9lVCzAYEfBm4w=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:18:54.548363 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-09663fd5-0cda-4642-8a3a-4f0362db9535 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:18:54.553840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-09663fd5-0cda-4642-8a3a-4f0362db9535 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:18:54.578615 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-09663fd5-0cda-4642-8a3a-4f0362db9535 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051666 Aug 04 15:18:54.579159 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3573/7153] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:18:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:19:00.416144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1402132369", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "3a4af518-009b-415a-a13a-431bd5f82c57"}], "key_name": "tempest-TestNetworkAdvancedServerOps-644712848", "security_groups": [{"name": "tempest-secgroup-smoke-929284090"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:19:00.437563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=30 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:19:00.714860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] validate_networks() for [('3a4af518-009b-415a-a13a-431bd5f82c57', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:19:01.180727 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:19:01.181486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:19:01.182138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:19:01.182706 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:19:01.183296 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:19:01.193320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:01.194650 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:01.196040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:01.196479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:01.215864 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:19:01.224689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:19:01.239023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:19:01.241481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:19:01.299806 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b3b23850-98f0-48fb-b091-6e86ab06b665 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.889248 Aug 04 15:19:01.300635 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3581/7154] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:19:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:19:01.310114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:19:01.314385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f662ed81-8c5c-4404-8e17-2c5ce483000f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:01.315027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f662ed81-8c5c-4404-8e17-2c5ce483000f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:01.403384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f662ed81-8c5c-4404-8e17-2c5ce483000f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:01.410469 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f662ed81-8c5c-4404-8e17-2c5ce483000f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1266 microversion: 2.1 time: 0.102163 Aug 04 15:19:01.411316 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3574/7155] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:01 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:02.435998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ab9220f7-6494-4b70-9ebb-88d1826a1177 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:02.438500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ab9220f7-6494-4b70-9ebb-88d1826a1177 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:02.446260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab9220f7-6494-4b70-9ebb-88d1826a1177 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:02.446731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab9220f7-6494-4b70-9ebb-88d1826a1177 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:02.447546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab9220f7-6494-4b70-9ebb-88d1826a1177 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:02.453980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ab9220f7-6494-4b70-9ebb-88d1826a1177 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:02.526684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ab9220f7-6494-4b70-9ebb-88d1826a1177 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:02.535308 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ab9220f7-6494-4b70-9ebb-88d1826a1177 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1336 microversion: 2.1 time: 0.105700 Aug 04 15:19:02.535902 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3582/7156] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:02 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:03.557405 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-deb7d628-62b4-40c1-a148-b536fceb146e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:03.558077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-deb7d628-62b4-40c1-a148-b536fceb146e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:03.565410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-deb7d628-62b4-40c1-a148-b536fceb146e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:03.565882 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-deb7d628-62b4-40c1-a148-b536fceb146e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:03.566704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-deb7d628-62b4-40c1-a148-b536fceb146e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:03.567159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-deb7d628-62b4-40c1-a148-b536fceb146e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:03.712138 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-deb7d628-62b4-40c1-a148-b536fceb146e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:03.720279 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-deb7d628-62b4-40c1-a148-b536fceb146e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1391 microversion: 2.1 time: 0.166613 Aug 04 15:19:03.724367 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3575/7157] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:03 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:03.804797 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-b4a30375-477d-4584-b937-8acf297799cb req-eca9a197-6847-4e81-a279-108c8898f1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85331b83-e9f9-4c6b-ac20-530c18ce8b62", "tag": "57570330-4724-4e9c-b407-f09c74211df0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:19:03.829014 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b4a30375-477d-4584-b937-8acf297799cb req-eca9a197-6847-4e81-a279-108c8898f1bd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:03.829828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-b4a30375-477d-4584-b937-8acf297799cb req-eca9a197-6847-4e81-a279-108c8898f1bd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:03.858295 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-b4a30375-477d-4584-b937-8acf297799cb req-eca9a197-6847-4e81-a279-108c8898f1bd service nova] Creating event network-changed:57570330-4724-4e9c-b407-f09c74211df0 for instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 on n-h2-844627-10 Aug 04 15:19:03.864480 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-b4a30375-477d-4584-b937-8acf297799cb req-eca9a197-6847-4e81-a279-108c8898f1bd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068611 Aug 04 15:19:03.865164 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3583/7158] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:19:04.742487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b537f59a-8aed-4508-82a6-a432616880bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:04.743123 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b537f59a-8aed-4508-82a6-a432616880bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:04.750321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b537f59a-8aed-4508-82a6-a432616880bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:04.750788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b537f59a-8aed-4508-82a6-a432616880bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:04.751569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b537f59a-8aed-4508-82a6-a432616880bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:04.752023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b537f59a-8aed-4508-82a6-a432616880bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:04.896203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b537f59a-8aed-4508-82a6-a432616880bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:04.904467 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b537f59a-8aed-4508-82a6-a432616880bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1391 microversion: 2.1 time: 0.166038 Aug 04 15:19:04.905075 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3576/7159] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:04 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:05.927425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7a4ac693-1260-489e-9861-f8036928f809 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:05.928381 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7a4ac693-1260-489e-9861-f8036928f809 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:05.935375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a4ac693-1260-489e-9861-f8036928f809 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:05.935837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a4ac693-1260-489e-9861-f8036928f809 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:05.936651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a4ac693-1260-489e-9861-f8036928f809 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:05.937134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7a4ac693-1260-489e-9861-f8036928f809 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:06.094375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7a4ac693-1260-489e-9861-f8036928f809 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:06.104227 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7a4ac693-1260-489e-9861-f8036928f809 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1391 microversion: 2.1 time: 0.181783 Aug 04 15:19:06.105426 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3584/7160] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:05 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:07.126211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dae2d69a-9861-476e-83c3-ef621bf962a4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:07.126920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dae2d69a-9861-476e-83c3-ef621bf962a4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:07.134719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dae2d69a-9861-476e-83c3-ef621bf962a4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:07.135190 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dae2d69a-9861-476e-83c3-ef621bf962a4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:07.135978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dae2d69a-9861-476e-83c3-ef621bf962a4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:07.136435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dae2d69a-9861-476e-83c3-ef621bf962a4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:07.275288 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dae2d69a-9861-476e-83c3-ef621bf962a4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:07.284113 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dae2d69a-9861-476e-83c3-ef621bf962a4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1391 microversion: 2.1 time: 0.161153 Aug 04 15:19:07.284254 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3577/7161] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:07 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:08.106384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-e3fc6ffe-0787-4c00-9e6e-77caf068e022 req-9c862c9d-fcba-4fc2-b114-766de43c283c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85331b83-e9f9-4c6b-ac20-530c18ce8b62", "name": "network-vif-plugged", "status": "completed", "tag": "57570330-4724-4e9c-b407-f09c74211df0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:19:08.117653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e3fc6ffe-0787-4c00-9e6e-77caf068e022 req-9c862c9d-fcba-4fc2-b114-766de43c283c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:08.118098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-e3fc6ffe-0787-4c00-9e6e-77caf068e022 req-9c862c9d-fcba-4fc2-b114-766de43c283c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:08.130040 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-e3fc6ffe-0787-4c00-9e6e-77caf068e022 req-9c862c9d-fcba-4fc2-b114-766de43c283c service nova] Creating event network-vif-plugged:57570330-4724-4e9c-b407-f09c74211df0 for instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 on n-h2-844627-10 Aug 04 15:19:08.135012 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-e3fc6ffe-0787-4c00-9e6e-77caf068e022 req-9c862c9d-fcba-4fc2-b114-766de43c283c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033024 Aug 04 15:19:08.135824 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3585/7162] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:19:08.303824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-abbd1f73-0be8-48ad-baac-9db4781a62fd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:08.304450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-abbd1f73-0be8-48ad-baac-9db4781a62fd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:08.311815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abbd1f73-0be8-48ad-baac-9db4781a62fd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:08.312290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abbd1f73-0be8-48ad-baac-9db4781a62fd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:08.313111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abbd1f73-0be8-48ad-baac-9db4781a62fd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:08.313573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abbd1f73-0be8-48ad-baac-9db4781a62fd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:08.457295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-abbd1f73-0be8-48ad-baac-9db4781a62fd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:08.466069 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-abbd1f73-0be8-48ad-baac-9db4781a62fd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1391 microversion: 2.1 time: 0.166033 Aug 04 15:19:08.466675 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3578/7163] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:08 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:09.488860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a4d7668c-ea0c-4a61-b691-aa4a5e850ca0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:09.489633 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a4d7668c-ea0c-4a61-b691-aa4a5e850ca0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:09.496238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4d7668c-ea0c-4a61-b691-aa4a5e850ca0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:09.496683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4d7668c-ea0c-4a61-b691-aa4a5e850ca0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:09.497509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4d7668c-ea0c-4a61-b691-aa4a5e850ca0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:09.497951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a4d7668c-ea0c-4a61-b691-aa4a5e850ca0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:09.639552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a4d7668c-ea0c-4a61-b691-aa4a5e850ca0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:09.647521 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a4d7668c-ea0c-4a61-b691-aa4a5e850ca0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1563 microversion: 2.1 time: 0.163962 Aug 04 15:19:09.648107 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3586/7164] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:09 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:09.668936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b2c539b2-c51f-4550-9f90-e96f3e7466b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:09.669818 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b2c539b2-c51f-4550-9f90-e96f3e7466b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:09.676670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2c539b2-c51f-4550-9f90-e96f3e7466b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:09.677172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2c539b2-c51f-4550-9f90-e96f3e7466b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:09.677965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2c539b2-c51f-4550-9f90-e96f3e7466b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:09.678422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b2c539b2-c51f-4550-9f90-e96f3e7466b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:09.822605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b2c539b2-c51f-4550-9f90-e96f3e7466b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:09.830334 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b2c539b2-c51f-4550-9f90-e96f3e7466b4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1563 microversion: 2.1 time: 0.165832 Aug 04 15:19:09.830899 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3579/7165] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:09 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:11.492970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eb767b84-4215-44c5-ad3d-8a2b13d28b38 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:11.493593 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eb767b84-4215-44c5-ad3d-8a2b13d28b38 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:11.494319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-846ca2e1-9788-4276-8404-dd263cdb698d req-1e753dc6-7841-4b48-b082-706f153b0be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85331b83-e9f9-4c6b-ac20-530c18ce8b62", "tag": "57570330-4724-4e9c-b407-f09c74211df0"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:19:11.501453 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:19:11.504389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:19:11.505257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:19:11.508567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-846ca2e1-9788-4276-8404-dd263cdb698d req-1e753dc6-7841-4b48-b082-706f153b0be5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:11.509067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-846ca2e1-9788-4276-8404-dd263cdb698d req-1e753dc6-7841-4b48-b082-706f153b0be5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:11.509686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb767b84-4215-44c5-ad3d-8a2b13d28b38 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:11.510145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb767b84-4215-44c5-ad3d-8a2b13d28b38 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:11.511012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb767b84-4215-44c5-ad3d-8a2b13d28b38 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:11.511471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb767b84-4215-44c5-ad3d-8a2b13d28b38 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:11.522107 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-846ca2e1-9788-4276-8404-dd263cdb698d req-1e753dc6-7841-4b48-b082-706f153b0be5 service nova] Creating event network-changed:57570330-4724-4e9c-b407-f09c74211df0 for instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 on n-h2-844627-10 Aug 04 15:19:11.528094 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-846ca2e1-9788-4276-8404-dd263cdb698d req-1e753dc6-7841-4b48-b082-706f153b0be5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037991 Aug 04 15:19:11.529061 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3580/7166] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:19:11.677005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eb767b84-4215-44c5-ad3d-8a2b13d28b38 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:11.686577 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eb767b84-4215-44c5-ad3d-8a2b13d28b38 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1563 microversion: 2.1 time: 0.198507 Aug 04 15:19:11.687397 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3587/7167] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:11 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1563 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:34.945587 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:19:34.947489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=32 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:19:34.955600 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0647414a-1c7a-4898-b001-db58992da826 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:19:34.959912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0647414a-1c7a-4898-b001-db58992da826 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:34.974021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0647414a-1c7a-4898-b001-db58992da826 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:34.974878 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0647414a-1c7a-4898-b001-db58992da826 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:34.976359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0647414a-1c7a-4898-b001-db58992da826 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:34.977268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0647414a-1c7a-4898-b001-db58992da826 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:35.058455 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0647414a-1c7a-4898-b001-db58992da826 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62/action" status: 200 len: 24573 microversion: 2.1 time: 0.116046 Aug 04 15:19:35.059380 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3581/7168] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:19:34 2022] POST /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62/action => generated 24573 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:19:41.443887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4a4956c8-8b2d-4404-9748-100e2ac8377b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:19:41.446077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4a4956c8-8b2d-4404-9748-100e2ac8377b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:41.448806 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:19:41.449599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=30 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:19:41.456546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a4956c8-8b2d-4404-9748-100e2ac8377b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:41.457032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a4956c8-8b2d-4404-9748-100e2ac8377b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:41.457817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a4956c8-8b2d-4404-9748-100e2ac8377b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:41.458254 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4a4956c8-8b2d-4404-9748-100e2ac8377b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:41.546789 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4a4956c8-8b2d-4404-9748-100e2ac8377b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62/action" status: 202 len: 0 microversion: 2.1 time: 0.108625 Aug 04 15:19:41.547467 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3588/7169] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:19:41 2022] POST /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:19:41.559469 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-015514af-c8db-44be-a1fd-ab5fbf337255 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:41.560285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-015514af-c8db-44be-a1fd-ab5fbf337255 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:41.568920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-015514af-c8db-44be-a1fd-ab5fbf337255 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:41.569365 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-015514af-c8db-44be-a1fd-ab5fbf337255 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:41.570148 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-015514af-c8db-44be-a1fd-ab5fbf337255 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:41.570597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-015514af-c8db-44be-a1fd-ab5fbf337255 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:41.730230 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-015514af-c8db-44be-a1fd-ab5fbf337255 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:41.738704 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-015514af-c8db-44be-a1fd-ab5fbf337255 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1674 microversion: 2.1 time: 0.186480 Aug 04 15:19:41.739310 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3582/7170] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:41 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:42.763615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f4ba0ccc-2f94-4a94-8625-242e35fdca83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:42.764323 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f4ba0ccc-2f94-4a94-8625-242e35fdca83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:42.771521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4ba0ccc-2f94-4a94-8625-242e35fdca83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:42.771980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4ba0ccc-2f94-4a94-8625-242e35fdca83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:42.772775 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4ba0ccc-2f94-4a94-8625-242e35fdca83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:42.773267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f4ba0ccc-2f94-4a94-8625-242e35fdca83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:42.936570 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f4ba0ccc-2f94-4a94-8625-242e35fdca83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:42.944751 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f4ba0ccc-2f94-4a94-8625-242e35fdca83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1679 microversion: 2.1 time: 0.186241 Aug 04 15:19:42.944751 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3589/7171] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:42 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:43.967588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-944ad1cf-c4ae-4497-97db-6a157a68ffd6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:43.968220 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-944ad1cf-c4ae-4497-97db-6a157a68ffd6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:43.975297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-944ad1cf-c4ae-4497-97db-6a157a68ffd6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:43.975765 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-944ad1cf-c4ae-4497-97db-6a157a68ffd6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:43.976553 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-944ad1cf-c4ae-4497-97db-6a157a68ffd6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:43.977049 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-944ad1cf-c4ae-4497-97db-6a157a68ffd6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:44.121753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-944ad1cf-c4ae-4497-97db-6a157a68ffd6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:44.129957 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-944ad1cf-c4ae-4497-97db-6a157a68ffd6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1679 microversion: 2.1 time: 0.166142 Aug 04 15:19:44.130719 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3583/7172] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:43 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:19:45.155918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bc182a2f-c503-4f64-89c4-785bd56acd35 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:45.156978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bc182a2f-c503-4f64-89c4-785bd56acd35 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:45.171832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc182a2f-c503-4f64-89c4-785bd56acd35 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:45.172282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc182a2f-c503-4f64-89c4-785bd56acd35 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:45.173113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc182a2f-c503-4f64-89c4-785bd56acd35 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:45.173555 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bc182a2f-c503-4f64-89c4-785bd56acd35 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:45.322566 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bc182a2f-c503-4f64-89c4-785bd56acd35 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:45.330480 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bc182a2f-c503-4f64-89c4-785bd56acd35 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1679 microversion: 2.1 time: 0.181734 Aug 04 15:19:45.331076 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3590/7173] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:45 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:46.356301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-77959327-b708-42e2-9c98-4924b874d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:46.356956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-77959327-b708-42e2-9c98-4924b874d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:46.365175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77959327-b708-42e2-9c98-4924b874d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:46.365641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77959327-b708-42e2-9c98-4924b874d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:46.366433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77959327-b708-42e2-9c98-4924b874d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:46.366879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-77959327-b708-42e2-9c98-4924b874d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:46.510806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-77959327-b708-42e2-9c98-4924b874d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:46.518663 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-77959327-b708-42e2-9c98-4924b874d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1679 microversion: 2.1 time: 0.166793 Aug 04 15:19:46.519260 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3584/7174] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:46 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:47.542577 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-049cc2ee-e66f-459d-97be-28de44992475 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:47.543749 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-049cc2ee-e66f-459d-97be-28de44992475 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:47.553599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-049cc2ee-e66f-459d-97be-28de44992475 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:47.554258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-049cc2ee-e66f-459d-97be-28de44992475 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:47.555417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-049cc2ee-e66f-459d-97be-28de44992475 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:47.556083 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-049cc2ee-e66f-459d-97be-28de44992475 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:47.703658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-049cc2ee-e66f-459d-97be-28de44992475 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:47.711897 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-049cc2ee-e66f-459d-97be-28de44992475 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1679 microversion: 2.1 time: 0.174364 Aug 04 15:19:47.712498 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3591/7175] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:47 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:19:48.735745 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a322cfb1-ad2c-488f-8850-643a880fd892 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:48.736349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a322cfb1-ad2c-488f-8850-643a880fd892 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:48.743719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a322cfb1-ad2c-488f-8850-643a880fd892 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:48.744178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a322cfb1-ad2c-488f-8850-643a880fd892 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:48.744978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a322cfb1-ad2c-488f-8850-643a880fd892 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:48.745433 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a322cfb1-ad2c-488f-8850-643a880fd892 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:48.893009 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a322cfb1-ad2c-488f-8850-643a880fd892 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:48.901576 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a322cfb1-ad2c-488f-8850-643a880fd892 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1679 microversion: 2.1 time: 0.169583 Aug 04 15:19:48.902278 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3585/7176] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:48 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:49.923488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5952de53-d6cc-48c3-881d-b433eb16521c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:49.924218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5952de53-d6cc-48c3-881d-b433eb16521c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:49.931388 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5952de53-d6cc-48c3-881d-b433eb16521c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:49.931840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5952de53-d6cc-48c3-881d-b433eb16521c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:49.932640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5952de53-d6cc-48c3-881d-b433eb16521c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:49.933142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5952de53-d6cc-48c3-881d-b433eb16521c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:50.082675 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5952de53-d6cc-48c3-881d-b433eb16521c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:50.091514 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5952de53-d6cc-48c3-881d-b433eb16521c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1679 microversion: 2.1 time: 0.171848 Aug 04 15:19:50.092006 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3592/7177] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:49 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:51.112110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-26a4862c-98e3-4816-92f9-21a0eef05287 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:51.112721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-26a4862c-98e3-4816-92f9-21a0eef05287 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:51.120466 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26a4862c-98e3-4816-92f9-21a0eef05287 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:51.120976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26a4862c-98e3-4816-92f9-21a0eef05287 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:51.121768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26a4862c-98e3-4816-92f9-21a0eef05287 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:51.122217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-26a4862c-98e3-4816-92f9-21a0eef05287 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:51.270993 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-26a4862c-98e3-4816-92f9-21a0eef05287 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:51.279700 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-26a4862c-98e3-4816-92f9-21a0eef05287 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1679 microversion: 2.1 time: 0.171562 Aug 04 15:19:51.280310 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3586/7178] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:51 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:52.301572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-be69930f-ceb5-4e94-bdc5-2a64645f1a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:52.302447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-be69930f-ceb5-4e94-bdc5-2a64645f1a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:52.308986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be69930f-ceb5-4e94-bdc5-2a64645f1a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:52.309467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be69930f-ceb5-4e94-bdc5-2a64645f1a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:52.310242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be69930f-ceb5-4e94-bdc5-2a64645f1a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:52.310681 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-be69930f-ceb5-4e94-bdc5-2a64645f1a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:52.508218 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-be69930f-ceb5-4e94-bdc5-2a64645f1a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:52.517180 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-be69930f-ceb5-4e94-bdc5-2a64645f1a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1679 microversion: 2.1 time: 0.219503 Aug 04 15:19:52.517787 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3593/7179] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:52 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:19:53.539177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-856ad509-7311-4d9b-8fe6-f428e70d23c1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:19:53.539799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-856ad509-7311-4d9b-8fe6-f428e70d23c1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:19:53.547342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-856ad509-7311-4d9b-8fe6-f428e70d23c1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:53.547797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-856ad509-7311-4d9b-8fe6-f428e70d23c1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:53.548567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-856ad509-7311-4d9b-8fe6-f428e70d23c1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:19:53.549053 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-856ad509-7311-4d9b-8fe6-f428e70d23c1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:19:53.693307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-856ad509-7311-4d9b-8fe6-f428e70d23c1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:19:53.700802 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-856ad509-7311-4d9b-8fe6-f428e70d23c1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1682 microversion: 2.1 time: 0.165565 Aug 04 15:19:53.701404 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3587/7180] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:19:53 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:17.900699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-018b6fb6-2c01-4fd5-8b2c-2675b04cce1e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:20:17.904624 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-018b6fb6-2c01-4fd5-8b2c-2675b04cce1e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:17.910281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=12 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:17.911527 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:17.921059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-018b6fb6-2c01-4fd5-8b2c-2675b04cce1e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:17.921867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-018b6fb6-2c01-4fd5-8b2c-2675b04cce1e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:17.923308 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-018b6fb6-2c01-4fd5-8b2c-2675b04cce1e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:17.924115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-018b6fb6-2c01-4fd5-8b2c-2675b04cce1e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:18.024249 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-018b6fb6-2c01-4fd5-8b2c-2675b04cce1e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62/action" status: 200 len: 69091 microversion: 2.1 time: 0.131527 Aug 04 15:20:18.025179 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3594/7181] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:20:17 2022] POST /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62/action => generated 69091 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:20:25.050413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c09ad680-b9c8-420a-8bdc-63fed6978d2b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:25.050941 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c09ad680-b9c8-420a-8bdc-63fed6978d2b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:25.053249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-587e9f70-6644-47c9-a369-18f864e327ad req-9d45b745-8cf3-4f81-9e64-03f8b0bec9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85331b83-e9f9-4c6b-ac20-530c18ce8b62", "tag": "57570330-4724-4e9c-b407-f09c74211df0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:20:25.053666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=14 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:25.053952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=40 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:25.061946 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c09ad680-b9c8-420a-8bdc-63fed6978d2b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:25.062691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c09ad680-b9c8-420a-8bdc-63fed6978d2b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:25.063492 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c09ad680-b9c8-420a-8bdc-63fed6978d2b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:25.064125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c09ad680-b9c8-420a-8bdc-63fed6978d2b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:25.065494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-587e9f70-6644-47c9-a369-18f864e327ad req-9d45b745-8cf3-4f81-9e64-03f8b0bec9ec service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:25.066003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-587e9f70-6644-47c9-a369-18f864e327ad req-9d45b745-8cf3-4f81-9e64-03f8b0bec9ec service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:25.079037 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-587e9f70-6644-47c9-a369-18f864e327ad req-9d45b745-8cf3-4f81-9e64-03f8b0bec9ec service nova] Creating event network-changed:57570330-4724-4e9c-b407-f09c74211df0 for instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 on n-h2-844627-10 Aug 04 15:20:25.084420 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-587e9f70-6644-47c9-a369-18f864e327ad req-9d45b745-8cf3-4f81-9e64-03f8b0bec9ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035508 Aug 04 15:20:25.085146 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3595/7182] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:20:25.093852 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c09ad680-b9c8-420a-8bdc-63fed6978d2b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:20:25.187791 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c09ad680-b9c8-420a-8bdc-63fed6978d2b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 204 len: 0 microversion: 2.1 time: 0.141296 Aug 04 15:20:25.188374 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3588/7183] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:20:25 2022] DELETE /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:20:25.198261 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc9e4fab-29ba-488d-9db9-d56946ccbb87 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:25.198996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc9e4fab-29ba-488d-9db9-d56946ccbb87 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:25.206237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc9e4fab-29ba-488d-9db9-d56946ccbb87 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:25.206692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc9e4fab-29ba-488d-9db9-d56946ccbb87 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:25.207460 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc9e4fab-29ba-488d-9db9-d56946ccbb87 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:25.207897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc9e4fab-29ba-488d-9db9-d56946ccbb87 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:25.362184 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc9e4fab-29ba-488d-9db9-d56946ccbb87 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:25.370219 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc9e4fab-29ba-488d-9db9-d56946ccbb87 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1688 microversion: 2.1 time: 0.176468 Aug 04 15:20:25.370906 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3596/7184] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:25 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:26.392824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ce2c8a49-d0e3-498e-89cf-eb65f523b1c2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:26.393580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ce2c8a49-d0e3-498e-89cf-eb65f523b1c2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:26.401014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce2c8a49-d0e3-498e-89cf-eb65f523b1c2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:26.401476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce2c8a49-d0e3-498e-89cf-eb65f523b1c2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:26.402861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce2c8a49-d0e3-498e-89cf-eb65f523b1c2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:26.403309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ce2c8a49-d0e3-498e-89cf-eb65f523b1c2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:26.541889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ce2c8a49-d0e3-498e-89cf-eb65f523b1c2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:26.549595 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ce2c8a49-d0e3-498e-89cf-eb65f523b1c2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1688 microversion: 2.1 time: 0.161108 Aug 04 15:20:26.550166 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3589/7185] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:26 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:27.182596 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-fd2606d9-4a2d-4e4c-93cf-a268f60b9097 req-6e8698e3-356f-4aac-af6f-4446a3f820f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85331b83-e9f9-4c6b-ac20-530c18ce8b62", "name": "network-vif-deleted", "tag": "57570330-4724-4e9c-b407-f09c74211df0"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:20:27.193610 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fd2606d9-4a2d-4e4c-93cf-a268f60b9097 req-6e8698e3-356f-4aac-af6f-4446a3f820f1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:27.194059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-fd2606d9-4a2d-4e4c-93cf-a268f60b9097 req-6e8698e3-356f-4aac-af6f-4446a3f820f1 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:27.207031 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-fd2606d9-4a2d-4e4c-93cf-a268f60b9097 req-6e8698e3-356f-4aac-af6f-4446a3f820f1 service nova] Creating event network-vif-deleted:57570330-4724-4e9c-b407-f09c74211df0 for instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 on n-h2-844627-10 Aug 04 15:20:27.211919 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-fd2606d9-4a2d-4e4c-93cf-a268f60b9097 req-6e8698e3-356f-4aac-af6f-4446a3f820f1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095524 Aug 04 15:20:27.212531 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3597/7186] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:20:27.573110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:27.573748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:27.580918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:27.581393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:27.582217 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:27.582668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:27.616714 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:27.617110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:27.617590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lazy-loading 'fault' on Instance uuid 85331b83-e9f9-4c6b-ac20-530c18ce8b62 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:20:27.662342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:27.670363 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-adf7562c-fe8d-4a4f-885d-3873e390522a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 200 len: 1356 microversion: 2.1 time: 0.102313 Aug 04 15:20:27.670937 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3590/7187] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:27 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:28.694172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:28.694895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 85331b83-e9f9-4c6b-ac20-530c18ce8b62] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:28.702392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:28.703037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:28.703872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:28.704309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:28.719540 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] HTTP exception thrown: Instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 could not be found. Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Request method failure captured: Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 HTTP/1.1 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6-MdSrctgttr1U5SrenWNZF1MNvZAMBWYuBvkZyWBcdMlKnpUzm7Z071NicUy65ZzzO7N9HvZR2pNs5s6hV4p_fBK0RZlwUHCEJkDgqmnu2Jeut1ekrrTJXveQ-cTX_QJroJUgXevBcCa6Tb3g6wesziFpva-tZG7WXokf3Vn9znV0M Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31a48040328d426d8434ae9c36070d70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31a48040328d426d8434ae9c36070d70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}] Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 1056d22ae221415db1187d24ba7a1285 Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 could not be found. Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '85331b83-e9f9-4c6b-ac20-530c18ce8b62'} Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 could not be found. Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 could not be found. Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:20:28.721259 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 could not be found. Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Returning 404 to user: Instance 85331b83-e9f9-4c6b-ac20-530c18ce8b62 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-19e0ef69-7cbc-473d-bc76-fab0fbe12c72 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62" status: 404 len: 111 microversion: 2.1 time: 0.034586 Aug 04 15:20:28.726052 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3598/7188] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:28 2022] GET /compute/v2.1/servers/85331b83-e9f9-4c6b-ac20-530c18ce8b62 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:20:32.139796 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4dda17c3-829d-4060-8576-178fa55b877a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '.version_select at 0x7f470044a160>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:32.169225 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4dda17c3-829d-4060-8576-178fa55b877a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-644712848" status: 202 len: 0 microversion: 2.1 time: 0.038187 Aug 04 15:20:32.170424 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3591/7189] 10.222.0.66 () {58 vars in 1281 bytes} [Thu Aug 4 15:20:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-644712848 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:20:32.200888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-56d1c5c1-4c97-46b9-af98-d5424abe5b08 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: .version_select at 0x7f47007e5700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1204730201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk+NLPgmxL842GBeQildmlp0WUREJO1a7sUEuCtQeshUn5I/luUnUZZ4+sdgId6FBdurzox80KuaY1BlpaEt2O/iy5BXVXmabpXHq8cBpDcDGNbZ+Wov0YcWjyS9LHExA=="}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:20:32.219657 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-56d1c5c1-4c97-46b9-af98-d5424abe5b08 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:20:32.225565 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-56d1c5c1-4c97-46b9-af98-d5424abe5b08 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:20:32.253163 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-56d1c5c1-4c97-46b9-af98-d5424abe5b08 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056992 Aug 04 15:20:32.253780 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3599/7190] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:20:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:20:37.848054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:37.852307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1901095329", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "b4884167-7869-46e2-b1ce-9df89cad7e4c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1204730201", "security_groups": [{"name": "tempest-secgroup-smoke-1114820023"}]}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:20:37.997859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.network.neutron [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] validate_networks() for [('b4884167-7869-46e2-b1ce-9df89cad7e4c', None, None, None, None, None)] {{(pid=130961) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:20:38.408886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:20:38.409382 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image limits 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:20:38.409889 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:20:38.410675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image pref 0:0:0 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:20:38.411278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.virt.hardware [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130961) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:20:38.422793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:38.423533 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:38.424538 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:38.425198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:38.447290 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:20:38.459893 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:20:38.477569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Going to run 1 instances... {{(pid=130961) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:20:38.481560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130961) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:20:38.534314 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-34492b98-2b82-436b-b5cb-52a6c7027f00 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688020 Aug 04 15:20:38.535596 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3592/7191] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:20:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:20:38.548731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-19c495e3-b11e-4f58-93eb-0905b3eb1e3c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:38.549693 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-19c495e3-b11e-4f58-93eb-0905b3eb1e3c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:38.631092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-19c495e3-b11e-4f58-93eb-0905b3eb1e3c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:38.641186 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-19c495e3-b11e-4f58-93eb-0905b3eb1e3c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1267 microversion: 2.1 time: 0.098391 Aug 04 15:20:38.641794 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3600/7192] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:38 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:39.665436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cf12cf8e-4fc6-4e9c-aeff-f69c30789a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:39.668081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cf12cf8e-4fc6-4e9c-aeff-f69c30789a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:39.683495 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf12cf8e-4fc6-4e9c-aeff-f69c30789a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:39.685420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf12cf8e-4fc6-4e9c-aeff-f69c30789a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:39.692362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf12cf8e-4fc6-4e9c-aeff-f69c30789a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:39.693932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cf12cf8e-4fc6-4e9c-aeff-f69c30789a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:39.770362 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cf12cf8e-4fc6-4e9c-aeff-f69c30789a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:39.780176 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cf12cf8e-4fc6-4e9c-aeff-f69c30789a21 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1337 microversion: 2.1 time: 0.121688 Aug 04 15:20:39.780761 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3593/7193] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:39 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1337 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:40.802625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d2a3a040-53a9-4197-b9bf-0ea41c76f8f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:40.803454 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d2a3a040-53a9-4197-b9bf-0ea41c76f8f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:40.806846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=16 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:40.814204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2a3a040-53a9-4197-b9bf-0ea41c76f8f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:40.814817 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2a3a040-53a9-4197-b9bf-0ea41c76f8f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:40.815639 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2a3a040-53a9-4197-b9bf-0ea41c76f8f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:40.816089 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d2a3a040-53a9-4197-b9bf-0ea41c76f8f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:41.061065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d2a3a040-53a9-4197-b9bf-0ea41c76f8f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:41.068914 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d2a3a040-53a9-4197-b9bf-0ea41c76f8f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1393 microversion: 2.1 time: 0.270671 Aug 04 15:20:41.069500 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3601/7194] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:40 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1393 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:41.176120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-91ce02b1-669a-4be0-b329-6ae97770d8cb req-8a8c5295-894f-4fa6-b863-64c2c6363dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd", "tag": "fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:20:41.187417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-91ce02b1-669a-4be0-b329-6ae97770d8cb req-8a8c5295-894f-4fa6-b863-64c2c6363dd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:41.187967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-91ce02b1-669a-4be0-b329-6ae97770d8cb req-8a8c5295-894f-4fa6-b863-64c2c6363dd4 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:41.201815 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-91ce02b1-669a-4be0-b329-6ae97770d8cb req-8a8c5295-894f-4fa6-b863-64c2c6363dd4 service nova] Creating event network-changed:fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4 for instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd on n-h2-844627-10 Aug 04 15:20:41.206892 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-91ce02b1-669a-4be0-b329-6ae97770d8cb req-8a8c5295-894f-4fa6-b863-64c2c6363dd4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034720 Aug 04 15:20:41.207697 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3594/7195] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:20:42.090284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4b7617ad-8dd1-40d1-805b-eacfa000a42f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:42.090972 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4b7617ad-8dd1-40d1-805b-eacfa000a42f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:42.099353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b7617ad-8dd1-40d1-805b-eacfa000a42f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:42.099353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b7617ad-8dd1-40d1-805b-eacfa000a42f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:42.099698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b7617ad-8dd1-40d1-805b-eacfa000a42f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:42.099918 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4b7617ad-8dd1-40d1-805b-eacfa000a42f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:42.240716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4b7617ad-8dd1-40d1-805b-eacfa000a42f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:42.249352 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4b7617ad-8dd1-40d1-805b-eacfa000a42f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1393 microversion: 2.1 time: 0.163113 Aug 04 15:20:42.249962 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3602/7196] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:42 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:43.271871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2404ffa4-d789-41f2-88e9-f5b89c98efa5 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:43.272895 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2404ffa4-d789-41f2-88e9-f5b89c98efa5 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:43.280544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2404ffa4-d789-41f2-88e9-f5b89c98efa5 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:43.281048 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2404ffa4-d789-41f2-88e9-f5b89c98efa5 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:43.281835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2404ffa4-d789-41f2-88e9-f5b89c98efa5 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:43.282292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2404ffa4-d789-41f2-88e9-f5b89c98efa5 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:43.420849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2404ffa4-d789-41f2-88e9-f5b89c98efa5 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:43.428517 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2404ffa4-d789-41f2-88e9-f5b89c98efa5 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1393 microversion: 2.1 time: 0.162021 Aug 04 15:20:43.429128 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3595/7197] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:43 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:44.450177 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6eacc291-4f65-4f73-bdf7-aa2435462f54 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:44.450717 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6eacc291-4f65-4f73-bdf7-aa2435462f54 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:44.458448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6eacc291-4f65-4f73-bdf7-aa2435462f54 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:44.458901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6eacc291-4f65-4f73-bdf7-aa2435462f54 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:44.459689 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6eacc291-4f65-4f73-bdf7-aa2435462f54 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:44.460138 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6eacc291-4f65-4f73-bdf7-aa2435462f54 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:44.610629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6eacc291-4f65-4f73-bdf7-aa2435462f54 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:44.619170 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6eacc291-4f65-4f73-bdf7-aa2435462f54 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1393 microversion: 2.1 time: 0.173475 Aug 04 15:20:44.619862 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3603/7198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:44 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:45.641879 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-752b16bf-8ee3-455f-b12d-c9744c77870b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:45.642513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-752b16bf-8ee3-455f-b12d-c9744c77870b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:45.650006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-752b16bf-8ee3-455f-b12d-c9744c77870b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:45.650478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-752b16bf-8ee3-455f-b12d-c9744c77870b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:45.651267 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-752b16bf-8ee3-455f-b12d-c9744c77870b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:45.651725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-752b16bf-8ee3-455f-b12d-c9744c77870b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:45.787590 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-752b16bf-8ee3-455f-b12d-c9744c77870b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:45.795278 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-752b16bf-8ee3-455f-b12d-c9744c77870b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1393 microversion: 2.1 time: 0.157359 Aug 04 15:20:45.795852 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3596/7199] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:45 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:46.660715 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f3843f7b-00dd-45b9-9da3-9145a280db0f req-fb53a86f-a076-47c1-aeea-324c6cdca913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd", "name": "network-vif-plugged", "status": "completed", "tag": "fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:20:46.671902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f3843f7b-00dd-45b9-9da3-9145a280db0f req-fb53a86f-a076-47c1-aeea-324c6cdca913 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:46.672350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f3843f7b-00dd-45b9-9da3-9145a280db0f req-fb53a86f-a076-47c1-aeea-324c6cdca913 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:46.684625 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f3843f7b-00dd-45b9-9da3-9145a280db0f req-fb53a86f-a076-47c1-aeea-324c6cdca913 service nova] Creating event network-vif-plugged:fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4 for instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd on n-h2-844627-10 Aug 04 15:20:46.689724 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f3843f7b-00dd-45b9-9da3-9145a280db0f req-fb53a86f-a076-47c1-aeea-324c6cdca913 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032793 Aug 04 15:20:46.690597 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3604/7200] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:20:46.816476 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b0a9b80d-92c1-45bc-8e24-92fa30d7dd2a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:46.817289 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b0a9b80d-92c1-45bc-8e24-92fa30d7dd2a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:46.824811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0a9b80d-92c1-45bc-8e24-92fa30d7dd2a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:46.825300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0a9b80d-92c1-45bc-8e24-92fa30d7dd2a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:46.826122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0a9b80d-92c1-45bc-8e24-92fa30d7dd2a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:46.826605 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0a9b80d-92c1-45bc-8e24-92fa30d7dd2a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:46.959322 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b0a9b80d-92c1-45bc-8e24-92fa30d7dd2a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:46.967839 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b0a9b80d-92c1-45bc-8e24-92fa30d7dd2a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1393 microversion: 2.1 time: 0.155460 Aug 04 15:20:46.968406 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3597/7201] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:46 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:20:47.990808 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f3910c46-0775-4558-948a-14957746cd6c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:47.991692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f3910c46-0775-4558-948a-14957746cd6c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:47.993878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:48.002599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3910c46-0775-4558-948a-14957746cd6c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:48.003055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3910c46-0775-4558-948a-14957746cd6c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:48.003847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3910c46-0775-4558-948a-14957746cd6c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:48.004295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f3910c46-0775-4558-948a-14957746cd6c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:48.147954 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f3910c46-0775-4558-948a-14957746cd6c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:48.155852 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f3910c46-0775-4558-948a-14957746cd6c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1565 microversion: 2.1 time: 0.170913 Aug 04 15:20:48.156422 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3605/7202] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:47 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:20:48.177716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2a2c226f-6871-4ad0-8803-2439b960b107 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:48.178387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2a2c226f-6871-4ad0-8803-2439b960b107 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:48.186275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a2c226f-6871-4ad0-8803-2439b960b107 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:48.186782 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a2c226f-6871-4ad0-8803-2439b960b107 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:48.187652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a2c226f-6871-4ad0-8803-2439b960b107 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:48.188127 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2a2c226f-6871-4ad0-8803-2439b960b107 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:48.321066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2a2c226f-6871-4ad0-8803-2439b960b107 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:48.329006 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2a2c226f-6871-4ad0-8803-2439b960b107 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1565 microversion: 2.1 time: 0.155432 Aug 04 15:20:48.329585 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3598/7203] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:48 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:20:50.317238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-11e6c647-dbb5-4c28-a228-bab934aee1fe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:20:50.317950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-11e6c647-dbb5-4c28-a228-bab934aee1fe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:20:50.319282 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-1cf31606-6bc9-432c-8c9b-9e74f93c7267 req-bbb16de5-c021-4a69-8738-68c7b1d4ed31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd", "tag": "fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:20:50.323698 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:50.326826 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:50.327131 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11e6c647-dbb5-4c28-a228-bab934aee1fe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:50.327827 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11e6c647-dbb5-4c28-a228-bab934aee1fe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:50.327975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:20:50.329212 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11e6c647-dbb5-4c28-a228-bab934aee1fe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:50.330030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-11e6c647-dbb5-4c28-a228-bab934aee1fe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:50.333328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1cf31606-6bc9-432c-8c9b-9e74f93c7267 req-bbb16de5-c021-4a69-8738-68c7b1d4ed31 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:20:50.333793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-1cf31606-6bc9-432c-8c9b-9e74f93c7267 req-bbb16de5-c021-4a69-8738-68c7b1d4ed31 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:20:50.346875 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-1cf31606-6bc9-432c-8c9b-9e74f93c7267 req-bbb16de5-c021-4a69-8738-68c7b1d4ed31 service nova] Creating event network-changed:fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4 for instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd on n-h2-844627-10 Aug 04 15:20:50.352089 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-1cf31606-6bc9-432c-8c9b-9e74f93c7267 req-bbb16de5-c021-4a69-8738-68c7b1d4ed31 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036631 Aug 04 15:20:50.353318 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3599/7204] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:20:50.567025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-11e6c647-dbb5-4c28-a228-bab934aee1fe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:20:50.575387 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-11e6c647-dbb5-4c28-a228-bab934aee1fe tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1565 microversion: 2.1 time: 0.261576 Aug 04 15:20:50.575967 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3606/7205] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:20:50 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1565 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:12.879591 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:21:12.880271 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=36 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:21:12.884753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cc52ea8e-b7a6-488e-9b5a-8e6fcdd3ef49 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:21:12.887040 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cc52ea8e-b7a6-488e-9b5a-8e6fcdd3ef49 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:12.894835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc52ea8e-b7a6-488e-9b5a-8e6fcdd3ef49 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:12.895297 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc52ea8e-b7a6-488e-9b5a-8e6fcdd3ef49 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:12.896076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc52ea8e-b7a6-488e-9b5a-8e6fcdd3ef49 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:12.896528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cc52ea8e-b7a6-488e-9b5a-8e6fcdd3ef49 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:12.956118 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cc52ea8e-b7a6-488e-9b5a-8e6fcdd3ef49 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd/action" status: 200 len: 24564 microversion: 2.1 time: 0.078200 Aug 04 15:21:12.956775 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3600/7206] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:21:12 2022] POST /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd/action => generated 24564 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:21:24.006720 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:21:24.009010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:24.011432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:21:24.012150 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=32 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:21:24.018701 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:24.019185 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:24.019956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:24.020392 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:24.060072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:24.067061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Old instance type m1.heat2, new instance type m1.heat {{(pid=130960) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 15:21:24.073613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:21:24.074040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:21:24.074530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:21:24.074943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:21:24.075369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:21:24.139959 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [eae4f481-b9f1-41c5-925b-c9770524eab3] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:21:25.154152 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [eae4f481-b9f1-41c5-925b-c9770524eab3] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 42774. Aug 04 15:21:25.158446 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d3d51f42-d316-4418-b082-1c8eff300476 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd/action" status: 202 len: 0 microversion: 2.1 time: 1.156220 Aug 04 15:21:25.159319 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3607/7207] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:21:24 2022] POST /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd/action => generated 0 bytes in 1158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:21:25.168269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e184f34a-a9f2-40ad-9c4f-2ec0f357ae10 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:25.169025 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e184f34a-a9f2-40ad-9c4f-2ec0f357ae10 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:25.171574 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:21:25.172243 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:21:25.179407 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e184f34a-a9f2-40ad-9c4f-2ec0f357ae10 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:25.179950 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e184f34a-a9f2-40ad-9c4f-2ec0f357ae10 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:25.180783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e184f34a-a9f2-40ad-9c4f-2ec0f357ae10 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:25.181328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e184f34a-a9f2-40ad-9c4f-2ec0f357ae10 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:25.324860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e184f34a-a9f2-40ad-9c4f-2ec0f357ae10 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:25.332776 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e184f34a-a9f2-40ad-9c4f-2ec0f357ae10 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1691 microversion: 2.1 time: 0.168867 Aug 04 15:21:25.333585 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3601/7208] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:25 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:26.355651 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-30e3b0b6-adfe-48a2-9689-6b354ccac02e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:26.356284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-30e3b0b6-adfe-48a2-9689-6b354ccac02e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:26.364476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30e3b0b6-adfe-48a2-9689-6b354ccac02e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:26.364952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30e3b0b6-adfe-48a2-9689-6b354ccac02e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:26.365982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30e3b0b6-adfe-48a2-9689-6b354ccac02e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:26.366418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-30e3b0b6-adfe-48a2-9689-6b354ccac02e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:26.505979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-30e3b0b6-adfe-48a2-9689-6b354ccac02e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:26.513879 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-30e3b0b6-adfe-48a2-9689-6b354ccac02e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1691 microversion: 2.1 time: 0.162651 Aug 04 15:21:26.514454 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3608/7209] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:26 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:27.536231 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-abe797a1-fcc7-4e59-9e5b-9a3eb8d58838 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:27.536860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-abe797a1-fcc7-4e59-9e5b-9a3eb8d58838 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:27.543896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abe797a1-fcc7-4e59-9e5b-9a3eb8d58838 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:27.544364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abe797a1-fcc7-4e59-9e5b-9a3eb8d58838 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:27.545182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abe797a1-fcc7-4e59-9e5b-9a3eb8d58838 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:27.545636 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-abe797a1-fcc7-4e59-9e5b-9a3eb8d58838 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:27.680484 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-abe797a1-fcc7-4e59-9e5b-9a3eb8d58838 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:27.688179 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-abe797a1-fcc7-4e59-9e5b-9a3eb8d58838 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.156485 Aug 04 15:21:27.688741 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3602/7210] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:27 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:21:28.710084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f6359d6e-07d9-43e0-94bc-1e78e66f80e6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:28.710756 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f6359d6e-07d9-43e0-94bc-1e78e66f80e6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:28.717800 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6359d6e-07d9-43e0-94bc-1e78e66f80e6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:28.718250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6359d6e-07d9-43e0-94bc-1e78e66f80e6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:28.719012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6359d6e-07d9-43e0-94bc-1e78e66f80e6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:28.719451 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f6359d6e-07d9-43e0-94bc-1e78e66f80e6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:28.858366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f6359d6e-07d9-43e0-94bc-1e78e66f80e6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:28.866366 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f6359d6e-07d9-43e0-94bc-1e78e66f80e6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.160870 Aug 04 15:21:28.866949 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3609/7211] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:28 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:29.887580 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-41ee29b1-0221-4168-9f28-8597276b0cf2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:29.888278 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-41ee29b1-0221-4168-9f28-8597276b0cf2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:29.896027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ee29b1-0221-4168-9f28-8597276b0cf2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:29.896501 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ee29b1-0221-4168-9f28-8597276b0cf2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:29.897318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ee29b1-0221-4168-9f28-8597276b0cf2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:29.897859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-41ee29b1-0221-4168-9f28-8597276b0cf2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:30.035639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-41ee29b1-0221-4168-9f28-8597276b0cf2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:30.043433 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-41ee29b1-0221-4168-9f28-8597276b0cf2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.159809 Aug 04 15:21:30.044018 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3603/7212] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:29 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:31.064611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-38cd072c-50f0-4484-aec2-a4a16d540ee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:31.065247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-38cd072c-50f0-4484-aec2-a4a16d540ee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:31.072240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38cd072c-50f0-4484-aec2-a4a16d540ee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:31.072694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38cd072c-50f0-4484-aec2-a4a16d540ee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:31.073492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38cd072c-50f0-4484-aec2-a4a16d540ee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:31.073939 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-38cd072c-50f0-4484-aec2-a4a16d540ee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:31.211798 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-38cd072c-50f0-4484-aec2-a4a16d540ee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:31.219531 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-38cd072c-50f0-4484-aec2-a4a16d540ee7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.158903 Aug 04 15:21:31.220104 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3610/7213] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:31 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:32.242625 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-859d5ada-3994-47cf-b081-9382cdac77ef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:32.243237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-859d5ada-3994-47cf-b081-9382cdac77ef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:32.250326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-859d5ada-3994-47cf-b081-9382cdac77ef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:32.250789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-859d5ada-3994-47cf-b081-9382cdac77ef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:32.251566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-859d5ada-3994-47cf-b081-9382cdac77ef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:32.252012 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-859d5ada-3994-47cf-b081-9382cdac77ef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:32.385706 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-859d5ada-3994-47cf-b081-9382cdac77ef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:32.393794 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-859d5ada-3994-47cf-b081-9382cdac77ef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.155277 Aug 04 15:21:32.394393 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3604/7214] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:32 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:33.415123 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7649bad9-bfe3-48a8-8e49-685363913655 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:33.415684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7649bad9-bfe3-48a8-8e49-685363913655 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:33.422553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7649bad9-bfe3-48a8-8e49-685363913655 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:33.423003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7649bad9-bfe3-48a8-8e49-685363913655 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:33.423759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7649bad9-bfe3-48a8-8e49-685363913655 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:33.424193 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7649bad9-bfe3-48a8-8e49-685363913655 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:33.559945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7649bad9-bfe3-48a8-8e49-685363913655 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:33.567925 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7649bad9-bfe3-48a8-8e49-685363913655 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.156809 Aug 04 15:21:33.568546 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3611/7215] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:33 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:34.589092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0b856149-9e86-43be-8458-a03f45086773 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:34.589723 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0b856149-9e86-43be-8458-a03f45086773 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:34.596732 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b856149-9e86-43be-8458-a03f45086773 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:34.597234 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b856149-9e86-43be-8458-a03f45086773 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:34.598099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b856149-9e86-43be-8458-a03f45086773 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:34.598557 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0b856149-9e86-43be-8458-a03f45086773 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:34.730753 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0b856149-9e86-43be-8458-a03f45086773 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:34.738256 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0b856149-9e86-43be-8458-a03f45086773 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.153123 Aug 04 15:21:34.738822 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3605/7216] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:34 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:35.760281 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cc4fcba9-f5db-4a39-bc6b-96bd244848bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:35.760978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cc4fcba9-f5db-4a39-bc6b-96bd244848bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:35.768589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc4fcba9-f5db-4a39-bc6b-96bd244848bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:35.769156 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc4fcba9-f5db-4a39-bc6b-96bd244848bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:35.770044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc4fcba9-f5db-4a39-bc6b-96bd244848bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:35.770524 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cc4fcba9-f5db-4a39-bc6b-96bd244848bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:35.993734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cc4fcba9-f5db-4a39-bc6b-96bd244848bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:36.001621 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cc4fcba9-f5db-4a39-bc6b-96bd244848bb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.245696 Aug 04 15:21:36.002216 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3612/7217] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:35 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:37.024260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9ff26262-5bb3-41c8-a211-d3e6e9f77220 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:37.024912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9ff26262-5bb3-41c8-a211-d3e6e9f77220 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:37.031988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ff26262-5bb3-41c8-a211-d3e6e9f77220 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:37.032463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ff26262-5bb3-41c8-a211-d3e6e9f77220 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:37.033274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ff26262-5bb3-41c8-a211-d3e6e9f77220 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:37.033734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9ff26262-5bb3-41c8-a211-d3e6e9f77220 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:37.167182 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9ff26262-5bb3-41c8-a211-d3e6e9f77220 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:37.175147 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9ff26262-5bb3-41c8-a211-d3e6e9f77220 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.155353 Aug 04 15:21:37.175714 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3606/7218] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:37 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:38.195956 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6a763848-7060-4b55-968e-c113b294ba60 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:38.196500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6a763848-7060-4b55-968e-c113b294ba60 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:38.203592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a763848-7060-4b55-968e-c113b294ba60 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:38.204048 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a763848-7060-4b55-968e-c113b294ba60 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:38.204819 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a763848-7060-4b55-968e-c113b294ba60 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:38.205288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6a763848-7060-4b55-968e-c113b294ba60 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:38.341745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6a763848-7060-4b55-968e-c113b294ba60 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:38.349276 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6a763848-7060-4b55-968e-c113b294ba60 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1696 microversion: 2.1 time: 0.157461 Aug 04 15:21:38.349852 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3613/7219] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:38 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:39.371180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c8c5a5cd-7131-49b5-a55b-1deaf2816917 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:39.371836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c8c5a5cd-7131-49b5-a55b-1deaf2816917 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:39.378972 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8c5a5cd-7131-49b5-a55b-1deaf2816917 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:39.379435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8c5a5cd-7131-49b5-a55b-1deaf2816917 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:39.380207 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8c5a5cd-7131-49b5-a55b-1deaf2816917 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:39.380655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c8c5a5cd-7131-49b5-a55b-1deaf2816917 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:39.570043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c8c5a5cd-7131-49b5-a55b-1deaf2816917 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:39.577702 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c8c5a5cd-7131-49b5-a55b-1deaf2816917 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1695 microversion: 2.1 time: 0.210369 Aug 04 15:21:39.584034 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3607/7220] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:39 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1695 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:39.931921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-910c188b-384a-48a2-a24b-1a86b80fd40d req-4c98d295-d3ec-4df3-860e-6570182f790c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd", "name": "network-vif-unplugged", "status": "completed", "tag": "fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:21:39.943574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-910c188b-384a-48a2-a24b-1a86b80fd40d req-4c98d295-d3ec-4df3-860e-6570182f790c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:39.944162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-910c188b-384a-48a2-a24b-1a86b80fd40d req-4c98d295-d3ec-4df3-860e-6570182f790c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:39.958343 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-910c188b-384a-48a2-a24b-1a86b80fd40d req-4c98d295-d3ec-4df3-860e-6570182f790c service nova] Creating event network-vif-unplugged:fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4 for instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd on n-h1-844627-10 Aug 04 15:21:39.964367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-910c188b-384a-48a2-a24b-1a86b80fd40d req-4c98d295-d3ec-4df3-860e-6570182f790c service nova] Instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:21:39.975301 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-910c188b-384a-48a2-a24b-1a86b80fd40d req-4c98d295-d3ec-4df3-860e-6570182f790c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048580 Aug 04 15:21:39.975917 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3614/7221] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:21:40.601504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2f1aeee0-c308-4da4-921b-3e605d00b630 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:40.602146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2f1aeee0-c308-4da4-921b-3e605d00b630 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:40.609654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f1aeee0-c308-4da4-921b-3e605d00b630 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:40.609654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f1aeee0-c308-4da4-921b-3e605d00b630 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:40.610430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f1aeee0-c308-4da4-921b-3e605d00b630 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:40.610891 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2f1aeee0-c308-4da4-921b-3e605d00b630 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:41.173157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2f1aeee0-c308-4da4-921b-3e605d00b630 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:41.181675 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2f1aeee0-c308-4da4-921b-3e605d00b630 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1695 microversion: 2.1 time: 0.584238 Aug 04 15:21:41.182263 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3608/7222] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:40 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1695 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:41.994884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-200b13be-d772-4382-ae95-d8feb4682ba2 req-f4afb5e7-d0af-4bb4-978c-5b967889e46e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd", "tag": "fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:21:42.004513 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-200b13be-d772-4382-ae95-d8feb4682ba2 req-f4afb5e7-d0af-4bb4-978c-5b967889e46e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:42.004989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-200b13be-d772-4382-ae95-d8feb4682ba2 req-f4afb5e7-d0af-4bb4-978c-5b967889e46e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:42.016982 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-200b13be-d772-4382-ae95-d8feb4682ba2 req-f4afb5e7-d0af-4bb4-978c-5b967889e46e service nova] Creating event network-changed:fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4 for instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd on n-h1-844627-10 Aug 04 15:21:42.022291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [req-200b13be-d772-4382-ae95-d8feb4682ba2 req-f4afb5e7-d0af-4bb4-978c-5b967889e46e service nova] Instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844627-10', 'n-h2-844627-10'} {{(pid=130960) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 15:21:42.035035 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-200b13be-d772-4382-ae95-d8feb4682ba2 req-f4afb5e7-d0af-4bb4-978c-5b967889e46e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043957 Aug 04 15:21:42.035035 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3615/7223] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:21:42.203028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e244ab71-f031-4f6c-b075-6033a207bc51 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:42.203692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e244ab71-f031-4f6c-b075-6033a207bc51 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:42.210793 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e244ab71-f031-4f6c-b075-6033a207bc51 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:42.211262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e244ab71-f031-4f6c-b075-6033a207bc51 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:42.212064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e244ab71-f031-4f6c-b075-6033a207bc51 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:42.212528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e244ab71-f031-4f6c-b075-6033a207bc51 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:42.517664 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e244ab71-f031-4f6c-b075-6033a207bc51 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:42.526230 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e244ab71-f031-4f6c-b075-6033a207bc51 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1693 microversion: 2.1 time: 0.327102 Aug 04 15:21:42.526962 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3609/7224] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:42 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1693 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:43.549103 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f37c2ee9-d28b-4d1e-a5e9-75a8e8da9723 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:43.549822 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f37c2ee9-d28b-4d1e-a5e9-75a8e8da9723 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:43.556695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f37c2ee9-d28b-4d1e-a5e9-75a8e8da9723 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:43.557178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f37c2ee9-d28b-4d1e-a5e9-75a8e8da9723 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:43.557950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f37c2ee9-d28b-4d1e-a5e9-75a8e8da9723 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:43.558383 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f37c2ee9-d28b-4d1e-a5e9-75a8e8da9723 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:43.694945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f37c2ee9-d28b-4d1e-a5e9-75a8e8da9723 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:43.702849 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f37c2ee9-d28b-4d1e-a5e9-75a8e8da9723 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1693 microversion: 2.1 time: 0.158881 Aug 04 15:21:43.703432 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3616/7225] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:43 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:44.724788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b7417704-6906-46cd-9753-3b07fe2fca78 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:44.726618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b7417704-6906-46cd-9753-3b07fe2fca78 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:44.733755 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7417704-6906-46cd-9753-3b07fe2fca78 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:44.734295 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7417704-6906-46cd-9753-3b07fe2fca78 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:44.735098 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7417704-6906-46cd-9753-3b07fe2fca78 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:44.735562 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b7417704-6906-46cd-9753-3b07fe2fca78 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:44.882203 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b7417704-6906-46cd-9753-3b07fe2fca78 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:44.890085 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b7417704-6906-46cd-9753-3b07fe2fca78 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1690 microversion: 2.1 time: 0.169469 Aug 04 15:21:44.890748 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3610/7226] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:44 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:44.911273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cb5ebd99-e8f2-4f20-9b04-500751afcb85 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:21:44.911818 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cb5ebd99-e8f2-4f20-9b04-500751afcb85 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:44.919625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb5ebd99-e8f2-4f20-9b04-500751afcb85 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:44.920158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb5ebd99-e8f2-4f20-9b04-500751afcb85 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:44.921619 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb5ebd99-e8f2-4f20-9b04-500751afcb85 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:44.922172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cb5ebd99-e8f2-4f20-9b04-500751afcb85 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:44.984647 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cb5ebd99-e8f2-4f20-9b04-500751afcb85 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd/action" status: 204 len: 0 microversion: 2.1 time: 0.077119 Aug 04 15:21:44.985408 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3617/7227] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:21:44 2022] POST /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:21:44.994475 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5458688b-2765-459d-b4b2-f13b944b62d4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:44.995117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5458688b-2765-459d-b4b2-f13b944b62d4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:45.001328 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5458688b-2765-459d-b4b2-f13b944b62d4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:45.001797 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5458688b-2765-459d-b4b2-f13b944b62d4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:45.002593 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5458688b-2765-459d-b4b2-f13b944b62d4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:45.003058 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5458688b-2765-459d-b4b2-f13b944b62d4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:45.229794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5458688b-2765-459d-b4b2-f13b944b62d4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:45.237559 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5458688b-2765-459d-b4b2-f13b944b62d4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1690 microversion: 2.1 time: 0.247789 Aug 04 15:21:45.238121 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3611/7228] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:44 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1690 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:45.258463 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0e63dc19-b13e-4922-b19c-da5a3e43f0f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:45.259458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0e63dc19-b13e-4922-b19c-da5a3e43f0f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:45.265916 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e63dc19-b13e-4922-b19c-da5a3e43f0f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:45.266370 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e63dc19-b13e-4922-b19c-da5a3e43f0f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:45.267148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e63dc19-b13e-4922-b19c-da5a3e43f0f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:45.267611 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e63dc19-b13e-4922-b19c-da5a3e43f0f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:45.488613 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e63dc19-b13e-4922-b19c-da5a3e43f0f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:45.497054 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0e63dc19-b13e-4922-b19c-da5a3e43f0f9 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1690 microversion: 2.1 time: 0.242819 Aug 04 15:21:45.497671 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3618/7229] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:45 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:46.522527 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-09196cbe-79c4-4e78-95d5-9719a2f42faa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:21:46.523137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-09196cbe-79c4-4e78-95d5-9719a2f42faa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:21:46.530064 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-09196cbe-79c4-4e78-95d5-9719a2f42faa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:46.530546 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-09196cbe-79c4-4e78-95d5-9719a2f42faa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:46.531318 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-09196cbe-79c4-4e78-95d5-9719a2f42faa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:46.531774 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-09196cbe-79c4-4e78-95d5-9719a2f42faa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:46.673807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-09196cbe-79c4-4e78-95d5-9719a2f42faa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:21:46.681429 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-09196cbe-79c4-4e78-95d5-9719a2f42faa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1682 microversion: 2.1 time: 0.163110 Aug 04 15:21:46.682003 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3612/7230] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:21:46 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:21:46.950810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-f3b3644e-75d8-4f54-ad35-9574dca0b353 req-71f12bcb-b348-44be-a0ed-cf8cef83176d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd", "name": "network-vif-plugged", "status": "completed", "tag": "fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:21:46.961422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f3b3644e-75d8-4f54-ad35-9574dca0b353 req-71f12bcb-b348-44be-a0ed-cf8cef83176d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:21:46.961877 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-f3b3644e-75d8-4f54-ad35-9574dca0b353 req-71f12bcb-b348-44be-a0ed-cf8cef83176d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:21:46.972987 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-f3b3644e-75d8-4f54-ad35-9574dca0b353 req-71f12bcb-b348-44be-a0ed-cf8cef83176d service nova] Creating event network-vif-plugged:fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4 for instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd on n-h1-844627-10 Aug 04 15:21:46.978369 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-f3b3644e-75d8-4f54-ad35-9574dca0b353 req-71f12bcb-b348-44be-a0ed-cf8cef83176d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089593 Aug 04 15:21:46.978958 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3619/7231] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:22:18.902329 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4fcbb351-eaee-4fc2-a663-7697923035c4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:22:18.904532 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4fcbb351-eaee-4fc2-a663-7697923035c4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:18.906687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=24 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:22:18.907496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=72 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:22:18.914184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fcbb351-eaee-4fc2-a663-7697923035c4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:18.914649 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fcbb351-eaee-4fc2-a663-7697923035c4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:18.915427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fcbb351-eaee-4fc2-a663-7697923035c4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:18.915874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4fcbb351-eaee-4fc2-a663-7697923035c4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:18.979269 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4fcbb351-eaee-4fc2-a663-7697923035c4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd/action" status: 200 len: 24579 microversion: 2.1 time: 0.081027 Aug 04 15:22:18.979915 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3613/7232] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:22:18 2022] POST /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd/action => generated 24579 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:22:36.039208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-03780a9d-4a68-4ea3-9f68-222c3741d77b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:36.040025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03780a9d-4a68-4ea3-9f68-222c3741d77b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:36.041209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-eaf0720a-c7c5-49fc-8e90-f1e14f119756 req-37377ea9-ad1d-4568-bc3e-d6933ad2d514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd", "tag": "fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:22:36.045452 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=30 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:22:36.046122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:22:36.047142 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:22:36.047915 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:22:36.051520 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03780a9d-4a68-4ea3-9f68-222c3741d77b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:36.052219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03780a9d-4a68-4ea3-9f68-222c3741d77b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:36.053445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03780a9d-4a68-4ea3-9f68-222c3741d77b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:36.053897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-03780a9d-4a68-4ea3-9f68-222c3741d77b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:36.054296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-eaf0720a-c7c5-49fc-8e90-f1e14f119756 req-37377ea9-ad1d-4568-bc3e-d6933ad2d514 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:36.054760 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-eaf0720a-c7c5-49fc-8e90-f1e14f119756 req-37377ea9-ad1d-4568-bc3e-d6933ad2d514 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:36.070756 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-eaf0720a-c7c5-49fc-8e90-f1e14f119756 req-37377ea9-ad1d-4568-bc3e-d6933ad2d514 service nova] Creating event network-changed:fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4 for instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd on n-h1-844627-10 Aug 04 15:22:36.076310 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-eaf0720a-c7c5-49fc-8e90-f1e14f119756 req-37377ea9-ad1d-4568-bc3e-d6933ad2d514 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039416 Aug 04 15:22:36.081400 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3614/7233] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:22:36.085363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-03780a9d-4a68-4ea3-9f68-222c3741d77b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:22:36.181014 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-03780a9d-4a68-4ea3-9f68-222c3741d77b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 204 len: 0 microversion: 2.1 time: 0.146399 Aug 04 15:22:36.185163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3620/7234] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:22:36 2022] DELETE /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:22:36.191494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b0263b06-9529-464a-a4f6-643e9c6d8a83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:36.192211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b0263b06-9529-464a-a4f6-643e9c6d8a83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:36.209599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0263b06-9529-464a-a4f6-643e9c6d8a83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:36.210069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0263b06-9529-464a-a4f6-643e9c6d8a83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:36.211097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0263b06-9529-464a-a4f6-643e9c6d8a83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:36.211494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b0263b06-9529-464a-a4f6-643e9c6d8a83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:36.380845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b0263b06-9529-464a-a4f6-643e9c6d8a83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:36.389534 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b0263b06-9529-464a-a4f6-643e9c6d8a83 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1688 microversion: 2.1 time: 0.202761 Aug 04 15:22:36.390492 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3615/7235] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:36 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:37.412009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-019461fb-3d80-46ff-893f-fa6f5293e2f7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:37.412716 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-019461fb-3d80-46ff-893f-fa6f5293e2f7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:37.419705 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-019461fb-3d80-46ff-893f-fa6f5293e2f7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:37.420158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-019461fb-3d80-46ff-893f-fa6f5293e2f7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:37.420957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-019461fb-3d80-46ff-893f-fa6f5293e2f7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:37.421404 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-019461fb-3d80-46ff-893f-fa6f5293e2f7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:37.635567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-019461fb-3d80-46ff-893f-fa6f5293e2f7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:37.643191 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-019461fb-3d80-46ff-893f-fa6f5293e2f7 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1688 microversion: 2.1 time: 0.235446 Aug 04 15:22:37.643766 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3621/7236] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:37 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1688 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:38.274422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f8bff7b0-6b08-4b66-a2f4-08664a03faae req-862443b8-7721-423e-aacb-b91f1a50cadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd", "name": "network-vif-deleted", "tag": "fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:22:38.286051 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f8bff7b0-6b08-4b66-a2f4-08664a03faae req-862443b8-7721-423e-aacb-b91f1a50cadd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:38.286571 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f8bff7b0-6b08-4b66-a2f4-08664a03faae req-862443b8-7721-423e-aacb-b91f1a50cadd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:38.298048 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f8bff7b0-6b08-4b66-a2f4-08664a03faae req-862443b8-7721-423e-aacb-b91f1a50cadd service nova] Creating event network-vif-deleted:fc8c3f9f-e0cc-487e-9e0d-4c1d938d27c4 for instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd on n-h1-844627-10 Aug 04 15:22:38.303177 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f8bff7b0-6b08-4b66-a2f4-08664a03faae req-862443b8-7721-423e-aacb-b91f1a50cadd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033220 Aug 04 15:22:38.303830 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3616/7237] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:22:38.670367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:38.671667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:38.679804 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:38.680653 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:38.681668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:38.682115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:38.727279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:38.727736 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:38.728201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lazy-loading 'fault' on Instance uuid 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:22:38.777578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:38.785840 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a9507db1-85ad-4a8d-89bc-9e86bbd87731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 200 len: 1357 microversion: 2.1 time: 0.125061 Aug 04 15:22:38.786353 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3622/7238] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:38 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 1357 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:39.809211 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:39.809937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:39.816308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:39.816783 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:39.817597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:39.818054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:39.833479 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] HTTP exception thrown: Instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd could not be found. Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Request method failure captured: Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd HTTP/1.1 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-MdSrctgttr1U5SrenWNZF1MNvZAMBWYuBvkZyWBcdMlKnpUzm7Z071NicUy65ZzzO7N9HvZR2pNs5s6hV4p_fBK0RZlwUHCEJkDgqmnu2Jeut1ekrrTJXveQ-cTX_QJroJUgXevBcCa6Tb3g6wesziFpva-tZG7WXokf3Vn9znV0M Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31a48040328d426d8434ae9c36070d70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31a48040328d426d8434ae9c36070d70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}] Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 1056d22ae221415db1187d24ba7a1285 Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd could not be found. Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd'} Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd could not be found. Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd could not be found. Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:22:39.835866 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd could not be found. Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Returning 404 to user: Instance 5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-31999711-284b-4cd5-b5dc-961fa6ec20eb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd" status: 404 len: 111 microversion: 2.1 time: 0.033334 Aug 04 15:22:39.840632 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3617/7239] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:39 2022] GET /compute/v2.1/servers/5d6f7bb2-b343-40ff-b6b4-e9b880f2cbbd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:22:43.197010 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f140e53a-9a9c-469d-af7c-5a59bbaa52b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '.version_select at 0x7f46f301bdc0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:43.222818 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f140e53a-9a9c-469d-af7c-5a59bbaa52b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1204730201" status: 202 len: 0 microversion: 2.1 time: 0.030385 Aug 04 15:22:43.223423 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3623/7240] 10.222.0.66 () {58 vars in 1284 bytes} [Thu Aug 4 15:22:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1204730201 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:22:43.252550 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-075575a7-5962-4225-89f2-87a7f8899f77 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: .version_select at 0x7f46f057ef70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1221227337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3aw2Z2j1zQKzBxSdOHGVkGZ0bWec9tEGYPZkIi3yrYD5q9N8u83gtvkqf3l33flJyjnIRLA7PjtOa7qxLTC3d1FUUKZW4ttMzGbicSuQSIs71IFxdrBpkeIiyYsDnu9w=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:22:43.269702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-075575a7-5962-4225-89f2-87a7f8899f77 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:22:43.276215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-075575a7-5962-4225-89f2-87a7f8899f77 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:22:43.302528 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-075575a7-5962-4225-89f2-87a7f8899f77 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053770 Aug 04 15:22:43.303651 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3618/7241] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:22:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:22:49.172004 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:22:49.176429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1730149000", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "147debd3-123d-407d-8b9f-2b8abc8b7e0e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1221227337", "security_groups": [{"name": "tempest-secgroup-smoke-950095404"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:22:49.307349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] validate_networks() for [('147debd3-123d-407d-8b9f-2b8abc8b7e0e', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:22:49.745167 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:22:49.745669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:22:49.746244 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:22:49.746713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:22:49.747137 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:22:49.757989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:49.758444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:49.759250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:49.759692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:49.779784 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:22:49.789945 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:22:49.806816 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:22:49.809353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:22:49.887086 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-12542620-4a47-4829-867c-1b6d48686114 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716739 Aug 04 15:22:49.893600 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3624/7242] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:22:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:22:49.908681 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-50f56383-9e7a-4c26-9dac-5a1149a497bc tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:49.909348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-50f56383-9e7a-4c26-9dac-5a1149a497bc tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:49.922034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:22:49.981210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-50f56383-9e7a-4c26-9dac-5a1149a497bc tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:49.990866 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-50f56383-9e7a-4c26-9dac-5a1149a497bc tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1267 microversion: 2.1 time: 0.089837 Aug 04 15:22:49.994400 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3619/7243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:49 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:22:51.013924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c1e20c8f-eb5f-43ee-a4eb-8a73973e52da tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:51.015041 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c1e20c8f-eb5f-43ee-a4eb-8a73973e52da tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:51.023509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1e20c8f-eb5f-43ee-a4eb-8a73973e52da tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:51.024287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1e20c8f-eb5f-43ee-a4eb-8a73973e52da tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:51.025104 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1e20c8f-eb5f-43ee-a4eb-8a73973e52da tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:51.025708 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c1e20c8f-eb5f-43ee-a4eb-8a73973e52da tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:51.115876 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c1e20c8f-eb5f-43ee-a4eb-8a73973e52da tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:51.124115 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c1e20c8f-eb5f-43ee-a4eb-8a73973e52da tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1337 microversion: 2.1 time: 0.114275 Aug 04 15:22:51.125111 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3625/7244] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:51 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1337 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:52.148306 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b67af9c4-5141-4c8a-af5c-007040d0deac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:52.149771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b67af9c4-5141-4c8a-af5c-007040d0deac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:52.157952 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b67af9c4-5141-4c8a-af5c-007040d0deac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:52.158674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b67af9c4-5141-4c8a-af5c-007040d0deac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:52.159831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b67af9c4-5141-4c8a-af5c-007040d0deac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:52.160458 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b67af9c4-5141-4c8a-af5c-007040d0deac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:52.415572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b67af9c4-5141-4c8a-af5c-007040d0deac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:52.423846 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b67af9c4-5141-4c8a-af5c-007040d0deac tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1392 microversion: 2.1 time: 0.281909 Aug 04 15:22:52.428261 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3620/7245] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:52 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1392 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:52.546160 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-bf719f67-e149-42f6-88e5-7859ca20624b req-16fe7392-607d-4406-b210-829e8343184d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f68fc64-1d1c-43c3-a033-a97a0c1d6257", "tag": "eba749d4-3e85-4bf3-be40-a0be199c5418"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:22:52.568129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bf719f67-e149-42f6-88e5-7859ca20624b req-16fe7392-607d-4406-b210-829e8343184d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:52.569124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-bf719f67-e149-42f6-88e5-7859ca20624b req-16fe7392-607d-4406-b210-829e8343184d service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:52.583398 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-bf719f67-e149-42f6-88e5-7859ca20624b req-16fe7392-607d-4406-b210-829e8343184d service nova] Creating event network-changed:eba749d4-3e85-4bf3-be40-a0be199c5418 for instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 on n-h2-844627-10 Aug 04 15:22:52.591480 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-bf719f67-e149-42f6-88e5-7859ca20624b req-16fe7392-607d-4406-b210-829e8343184d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048772 Aug 04 15:22:52.592768 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3626/7246] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:22:53.450336 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0c1d585a-fd81-407c-a190-d60a3dda8f66 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:53.450871 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0c1d585a-fd81-407c-a190-d60a3dda8f66 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:53.457360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c1d585a-fd81-407c-a190-d60a3dda8f66 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:53.457837 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c1d585a-fd81-407c-a190-d60a3dda8f66 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:53.458623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c1d585a-fd81-407c-a190-d60a3dda8f66 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:53.459566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0c1d585a-fd81-407c-a190-d60a3dda8f66 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:53.588811 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0c1d585a-fd81-407c-a190-d60a3dda8f66 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:53.596586 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0c1d585a-fd81-407c-a190-d60a3dda8f66 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1392 microversion: 2.1 time: 0.150293 Aug 04 15:22:53.597201 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3621/7247] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:53 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:54.620360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c4da0778-4d83-41e8-bdb6-400df8210adb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:54.621028 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c4da0778-4d83-41e8-bdb6-400df8210adb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:54.627206 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4da0778-4d83-41e8-bdb6-400df8210adb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:54.627683 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4da0778-4d83-41e8-bdb6-400df8210adb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:54.628444 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4da0778-4d83-41e8-bdb6-400df8210adb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:54.628908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c4da0778-4d83-41e8-bdb6-400df8210adb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:54.764571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c4da0778-4d83-41e8-bdb6-400df8210adb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:54.772212 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c4da0778-4d83-41e8-bdb6-400df8210adb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1392 microversion: 2.1 time: 0.157976 Aug 04 15:22:54.772790 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3627/7248] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:54 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:55.792581 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fcd0d167-a7f3-4b16-9e7f-39bc4f8669a3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:55.793225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fcd0d167-a7f3-4b16-9e7f-39bc4f8669a3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:55.800520 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcd0d167-a7f3-4b16-9e7f-39bc4f8669a3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:55.801021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcd0d167-a7f3-4b16-9e7f-39bc4f8669a3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:55.801834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcd0d167-a7f3-4b16-9e7f-39bc4f8669a3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:55.802281 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fcd0d167-a7f3-4b16-9e7f-39bc4f8669a3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:55.933159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fcd0d167-a7f3-4b16-9e7f-39bc4f8669a3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:55.940733 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fcd0d167-a7f3-4b16-9e7f-39bc4f8669a3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1392 microversion: 2.1 time: 0.152087 Aug 04 15:22:55.941331 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3622/7249] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:55 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:56.962950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-747518ab-21e1-46f8-b72e-65d921e6ac69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:56.963981 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-747518ab-21e1-46f8-b72e-65d921e6ac69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:56.974434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-747518ab-21e1-46f8-b72e-65d921e6ac69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:56.975127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-747518ab-21e1-46f8-b72e-65d921e6ac69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:56.976330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-747518ab-21e1-46f8-b72e-65d921e6ac69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:56.977066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-747518ab-21e1-46f8-b72e-65d921e6ac69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:57.111417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-747518ab-21e1-46f8-b72e-65d921e6ac69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:57.120352 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-747518ab-21e1-46f8-b72e-65d921e6ac69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1392 microversion: 2.1 time: 0.162085 Aug 04 15:22:57.120995 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3628/7250] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:56 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:57.263525 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-815d6219-0e2f-435c-9d3c-6edb959eb8b2 req-3fdb776e-ba87-495c-9037-a36e0326f4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f68fc64-1d1c-43c3-a033-a97a0c1d6257", "name": "network-vif-plugged", "status": "completed", "tag": "eba749d4-3e85-4bf3-be40-a0be199c5418"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:22:57.274988 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-815d6219-0e2f-435c-9d3c-6edb959eb8b2 req-3fdb776e-ba87-495c-9037-a36e0326f4be service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:57.275426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-815d6219-0e2f-435c-9d3c-6edb959eb8b2 req-3fdb776e-ba87-495c-9037-a36e0326f4be service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:57.286647 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-815d6219-0e2f-435c-9d3c-6edb959eb8b2 req-3fdb776e-ba87-495c-9037-a36e0326f4be service nova] Creating event network-vif-plugged:eba749d4-3e85-4bf3-be40-a0be199c5418 for instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 on n-h2-844627-10 Aug 04 15:22:57.291717 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-815d6219-0e2f-435c-9d3c-6edb959eb8b2 req-3fdb776e-ba87-495c-9037-a36e0326f4be service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031896 Aug 04 15:22:57.292306 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3623/7251] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:22:58.140768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dbef4ae2-e090-4a0a-8454-0cb93240aefd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:58.142011 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dbef4ae2-e090-4a0a-8454-0cb93240aefd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:58.149734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbef4ae2-e090-4a0a-8454-0cb93240aefd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:58.150191 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbef4ae2-e090-4a0a-8454-0cb93240aefd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:58.150977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbef4ae2-e090-4a0a-8454-0cb93240aefd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:58.151425 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dbef4ae2-e090-4a0a-8454-0cb93240aefd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:58.289282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dbef4ae2-e090-4a0a-8454-0cb93240aefd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:58.297844 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dbef4ae2-e090-4a0a-8454-0cb93240aefd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1392 microversion: 2.1 time: 0.160170 Aug 04 15:22:58.298630 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3629/7252] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:58 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:59.320250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1ca13933-0a09-4b17-b54a-4fbd00fdf23b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:59.320994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1ca13933-0a09-4b17-b54a-4fbd00fdf23b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:59.327402 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ca13933-0a09-4b17-b54a-4fbd00fdf23b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:59.327877 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ca13933-0a09-4b17-b54a-4fbd00fdf23b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:59.328662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ca13933-0a09-4b17-b54a-4fbd00fdf23b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:59.329150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1ca13933-0a09-4b17-b54a-4fbd00fdf23b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:59.470317 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1ca13933-0a09-4b17-b54a-4fbd00fdf23b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:59.478671 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1ca13933-0a09-4b17-b54a-4fbd00fdf23b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1565 microversion: 2.1 time: 0.163596 Aug 04 15:22:59.479266 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3624/7253] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:59 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:22:59.499353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-dd5209d7-26d7-4170-9c6e-e6dd525e44dd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:22:59.499996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-dd5209d7-26d7-4170-9c6e-e6dd525e44dd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:22:59.507682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd5209d7-26d7-4170-9c6e-e6dd525e44dd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:59.508142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd5209d7-26d7-4170-9c6e-e6dd525e44dd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:59.508996 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd5209d7-26d7-4170-9c6e-e6dd525e44dd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:22:59.509448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-dd5209d7-26d7-4170-9c6e-e6dd525e44dd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:22:59.648355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-dd5209d7-26d7-4170-9c6e-e6dd525e44dd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:22:59.655996 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-dd5209d7-26d7-4170-9c6e-e6dd525e44dd tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1565 microversion: 2.1 time: 0.160535 Aug 04 15:22:59.656577 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3630/7254] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:22:59 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:01.648530 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-96a8e03b-4326-47f7-b22b-6148971d7803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:01.649359 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-96a8e03b-4326-47f7-b22b-6148971d7803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:01.652634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d11967f7-eac9-48c5-a4ce-fe71f1126bef req-1bc99c10-d206-44b0-bf74-035e1d3749d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f68fc64-1d1c-43c3-a033-a97a0c1d6257", "tag": "eba749d4-3e85-4bf3-be40-a0be199c5418"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:23:01.654566 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:23:01.658050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:23:01.658241 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96a8e03b-4326-47f7-b22b-6148971d7803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:01.658639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96a8e03b-4326-47f7-b22b-6148971d7803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:01.658795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:23:01.659912 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96a8e03b-4326-47f7-b22b-6148971d7803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:01.661081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-96a8e03b-4326-47f7-b22b-6148971d7803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:01.666488 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d11967f7-eac9-48c5-a4ce-fe71f1126bef req-1bc99c10-d206-44b0-bf74-035e1d3749d8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:01.666938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d11967f7-eac9-48c5-a4ce-fe71f1126bef req-1bc99c10-d206-44b0-bf74-035e1d3749d8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:01.680694 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d11967f7-eac9-48c5-a4ce-fe71f1126bef req-1bc99c10-d206-44b0-bf74-035e1d3749d8 service nova] Creating event network-changed:eba749d4-3e85-4bf3-be40-a0be199c5418 for instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 on n-h2-844627-10 Aug 04 15:23:01.685914 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d11967f7-eac9-48c5-a4ce-fe71f1126bef req-1bc99c10-d206-44b0-bf74-035e1d3749d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038413 Aug 04 15:23:01.686533 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3631/7255] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:23:01.892343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-96a8e03b-4326-47f7-b22b-6148971d7803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:01.900705 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-96a8e03b-4326-47f7-b22b-6148971d7803 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1565 microversion: 2.1 time: 0.256061 Aug 04 15:23:01.901424 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3625/7256] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:01 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:23.162100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:23:23.162530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=36 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:23:23.166791 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0b0bd6a0-e0a7-40d6-9362-0e161a734fa4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:23:23.169133 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0b0bd6a0-e0a7-40d6-9362-0e161a734fa4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:23.177096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b0bd6a0-e0a7-40d6-9362-0e161a734fa4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:23.177544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b0bd6a0-e0a7-40d6-9362-0e161a734fa4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:23.178320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b0bd6a0-e0a7-40d6-9362-0e161a734fa4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:23.178754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0b0bd6a0-e0a7-40d6-9362-0e161a734fa4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:23.236219 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0b0bd6a0-e0a7-40d6-9362-0e161a734fa4 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action" status: 200 len: 24572 microversion: 2.1 time: 0.076420 Aug 04 15:23:23.236922 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3632/7257] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:23:23 2022] POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action => generated 24572 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:23:24.141709 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:23:24.142510 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:23:29.644639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8fd0ff15-9715-42d3-a11a-fcf4d271ca73 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:23:29.647074 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:23:29.648345 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=32 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:23:29.655115 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fd0ff15-9715-42d3-a11a-fcf4d271ca73 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:29.655572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8fd0ff15-9715-42d3-a11a-fcf4d271ca73 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:29.681784 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8fd0ff15-9715-42d3-a11a-fcf4d271ca73 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Going to try to stop instance {{(pid=130961) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 15:23:29.739766 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8fd0ff15-9715-42d3-a11a-fcf4d271ca73 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action" status: 202 len: 0 microversion: 2.1 time: 0.099163 Aug 04 15:23:29.740395 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3626/7258] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:23:29 2022] POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:23:29.750499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9b0c83f5-7b4e-4e8a-a45f-2812b90f5a4b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:29.751208 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9b0c83f5-7b4e-4e8a-a45f-2812b90f5a4b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:29.759226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b0c83f5-7b4e-4e8a-a45f-2812b90f5a4b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:29.759664 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b0c83f5-7b4e-4e8a-a45f-2812b90f5a4b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:29.760440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b0c83f5-7b4e-4e8a-a45f-2812b90f5a4b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:29.760887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9b0c83f5-7b4e-4e8a-a45f-2812b90f5a4b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:29.911947 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9b0c83f5-7b4e-4e8a-a45f-2812b90f5a4b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:29.920111 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9b0c83f5-7b4e-4e8a-a45f-2812b90f5a4b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1694 microversion: 2.1 time: 0.173883 Aug 04 15:23:29.920697 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3633/7259] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:29 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:30.944862 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c9c667c0-5135-4b42-a1fb-e779a20f2373 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:30.945510 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c9c667c0-5135-4b42-a1fb-e779a20f2373 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:30.952787 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9c667c0-5135-4b42-a1fb-e779a20f2373 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:30.953248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9c667c0-5135-4b42-a1fb-e779a20f2373 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:30.954037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9c667c0-5135-4b42-a1fb-e779a20f2373 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:30.954515 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c9c667c0-5135-4b42-a1fb-e779a20f2373 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:31.101773 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c9c667c0-5135-4b42-a1fb-e779a20f2373 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:31.110119 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c9c667c0-5135-4b42-a1fb-e779a20f2373 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1694 microversion: 2.1 time: 0.171120 Aug 04 15:23:31.110704 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3627/7260] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:30 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:32.133385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3398693b-414f-4b58-baeb-2a5c0597f369 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:32.134067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3398693b-414f-4b58-baeb-2a5c0597f369 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:32.142860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3398693b-414f-4b58-baeb-2a5c0597f369 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:32.143938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3398693b-414f-4b58-baeb-2a5c0597f369 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:32.144781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3398693b-414f-4b58-baeb-2a5c0597f369 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:32.145576 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3398693b-414f-4b58-baeb-2a5c0597f369 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:32.322092 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3398693b-414f-4b58-baeb-2a5c0597f369 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:32.330092 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3398693b-414f-4b58-baeb-2a5c0597f369 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1694 microversion: 2.1 time: 0.200449 Aug 04 15:23:32.330554 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3634/7261] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:32 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1694 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:23:33.368175 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f190c443-c949-4940-8d03-6e7d4bdc59a2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:33.368801 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f190c443-c949-4940-8d03-6e7d4bdc59a2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:33.376021 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f190c443-c949-4940-8d03-6e7d4bdc59a2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:33.376489 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f190c443-c949-4940-8d03-6e7d4bdc59a2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:33.377327 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f190c443-c949-4940-8d03-6e7d4bdc59a2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:33.377788 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f190c443-c949-4940-8d03-6e7d4bdc59a2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:33.520227 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f190c443-c949-4940-8d03-6e7d4bdc59a2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:33.528216 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f190c443-c949-4940-8d03-6e7d4bdc59a2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1694 microversion: 2.1 time: 0.163946 Aug 04 15:23:33.528809 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3628/7262] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:33 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:34.549537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b02f9b76-c5a3-4348-8c9c-45e4253558a6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:34.550341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b02f9b76-c5a3-4348-8c9c-45e4253558a6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:34.557622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b02f9b76-c5a3-4348-8c9c-45e4253558a6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:34.558074 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b02f9b76-c5a3-4348-8c9c-45e4253558a6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:34.558870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b02f9b76-c5a3-4348-8c9c-45e4253558a6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:34.559316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b02f9b76-c5a3-4348-8c9c-45e4253558a6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:34.719809 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b02f9b76-c5a3-4348-8c9c-45e4253558a6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:34.736580 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b02f9b76-c5a3-4348-8c9c-45e4253558a6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1694 microversion: 2.1 time: 0.191149 Aug 04 15:23:34.737480 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3635/7263] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:34 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:35.759063 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b6bd7848-a740-4990-81d6-ad8a040690ec tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:35.759629 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b6bd7848-a740-4990-81d6-ad8a040690ec tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:35.767218 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6bd7848-a740-4990-81d6-ad8a040690ec tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:35.767687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6bd7848-a740-4990-81d6-ad8a040690ec tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:35.768496 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6bd7848-a740-4990-81d6-ad8a040690ec tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:35.768992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b6bd7848-a740-4990-81d6-ad8a040690ec tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:35.911130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b6bd7848-a740-4990-81d6-ad8a040690ec tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:35.919343 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b6bd7848-a740-4990-81d6-ad8a040690ec tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1694 microversion: 2.1 time: 0.164269 Aug 04 15:23:35.919933 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3629/7264] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:35 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:23:36.942293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0d58797e-f94e-4059-8b99-594b9d43dc69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:36.942934 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0d58797e-f94e-4059-8b99-594b9d43dc69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:36.950685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d58797e-f94e-4059-8b99-594b9d43dc69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:36.951139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d58797e-f94e-4059-8b99-594b9d43dc69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:36.951931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d58797e-f94e-4059-8b99-594b9d43dc69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:36.952374 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0d58797e-f94e-4059-8b99-594b9d43dc69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:37.102572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0d58797e-f94e-4059-8b99-594b9d43dc69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:37.110274 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0d58797e-f94e-4059-8b99-594b9d43dc69 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1694 microversion: 2.1 time: 0.172523 Aug 04 15:23:37.111357 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3636/7265] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:36 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:38.142630 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e26f1d5e-8cf0-44c0-9dab-9dab6ac2aa8b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:38.143478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e26f1d5e-8cf0-44c0-9dab-9dab6ac2aa8b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:38.150846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e26f1d5e-8cf0-44c0-9dab-9dab6ac2aa8b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:38.151308 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e26f1d5e-8cf0-44c0-9dab-9dab6ac2aa8b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:38.152095 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e26f1d5e-8cf0-44c0-9dab-9dab6ac2aa8b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:38.152544 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e26f1d5e-8cf0-44c0-9dab-9dab6ac2aa8b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:38.378159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e26f1d5e-8cf0-44c0-9dab-9dab6ac2aa8b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:38.387096 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e26f1d5e-8cf0-44c0-9dab-9dab6ac2aa8b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1694 microversion: 2.1 time: 0.248300 Aug 04 15:23:38.388050 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3630/7266] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:38 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1694 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:39.409881 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac491123-5f68-4394-9d5a-adf6dafce4db tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:39.410499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac491123-5f68-4394-9d5a-adf6dafce4db tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:39.417729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac491123-5f68-4394-9d5a-adf6dafce4db tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:39.418129 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac491123-5f68-4394-9d5a-adf6dafce4db tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:39.418973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac491123-5f68-4394-9d5a-adf6dafce4db tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:39.419467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac491123-5f68-4394-9d5a-adf6dafce4db tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:39.549807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac491123-5f68-4394-9d5a-adf6dafce4db tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:39.557355 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac491123-5f68-4394-9d5a-adf6dafce4db tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1694 microversion: 2.1 time: 0.152133 Aug 04 15:23:39.557914 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3637/7267] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:39 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:40.579490 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f165c960-7a5f-49f8-96c5-4c03c42788cf tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:40.580038 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f165c960-7a5f-49f8-96c5-4c03c42788cf tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:40.587691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f165c960-7a5f-49f8-96c5-4c03c42788cf tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:40.588157 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f165c960-7a5f-49f8-96c5-4c03c42788cf tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:40.588964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f165c960-7a5f-49f8-96c5-4c03c42788cf tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:40.589424 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f165c960-7a5f-49f8-96c5-4c03c42788cf tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:40.729011 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f165c960-7a5f-49f8-96c5-4c03c42788cf tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:40.738582 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f165c960-7a5f-49f8-96c5-4c03c42788cf tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1671 microversion: 2.1 time: 0.163028 Aug 04 15:23:40.739266 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3631/7268] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:40 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:41.834865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c5aa76b0-a607-4c3d-9382-a132b4d23fef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:23:41.837145 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c5aa76b0-a607-4c3d-9382-a132b4d23fef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:41.848082 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5aa76b0-a607-4c3d-9382-a132b4d23fef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:41.848811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5aa76b0-a607-4c3d-9382-a132b4d23fef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:41.850058 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5aa76b0-a607-4c3d-9382-a132b4d23fef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:41.850509 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c5aa76b0-a607-4c3d-9382-a132b4d23fef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:41.906497 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c5aa76b0-a607-4c3d-9382-a132b4d23fef tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action" status: 200 len: 34966 microversion: 2.1 time: 0.075366 Aug 04 15:23:41.907381 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3638/7269] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:23:41 2022] POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action => generated 34966 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:23:41.919720 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a505160c-204b-4a92-af49-5329a2f6f39c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:23:41.926970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a505160c-204b-4a92-af49-5329a2f6f39c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:41.927442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a505160c-204b-4a92-af49-5329a2f6f39c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:41.950865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a505160c-204b-4a92-af49-5329a2f6f39c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Going to try to start instance {{(pid=130961) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 15:23:42.001923 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a505160c-204b-4a92-af49-5329a2f6f39c tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action" status: 202 len: 0 microversion: 2.1 time: 0.081090 Aug 04 15:23:42.001923 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3632/7270] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:23:41 2022] POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:23:42.012032 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6ecc76fe-ca03-407a-873a-c8dc0bede93b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:42.013350 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6ecc76fe-ca03-407a-873a-c8dc0bede93b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:42.026354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ecc76fe-ca03-407a-873a-c8dc0bede93b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:42.026879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ecc76fe-ca03-407a-873a-c8dc0bede93b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:42.027794 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ecc76fe-ca03-407a-873a-c8dc0bede93b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:42.028284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6ecc76fe-ca03-407a-873a-c8dc0bede93b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:42.261067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6ecc76fe-ca03-407a-873a-c8dc0bede93b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:42.269371 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6ecc76fe-ca03-407a-873a-c8dc0bede93b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1680 microversion: 2.1 time: 0.265564 Aug 04 15:23:42.270213 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3639/7271] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:42 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1680 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:23:43.293445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-049c87c3-c076-4d39-b4a5-e95acf5d485d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:23:43.294171 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-049c87c3-c076-4d39-b4a5-e95acf5d485d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:23:43.300624 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-049c87c3-c076-4d39-b4a5-e95acf5d485d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:43.301124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-049c87c3-c076-4d39-b4a5-e95acf5d485d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:43.301933 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-049c87c3-c076-4d39-b4a5-e95acf5d485d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:23:43.302384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-049c87c3-c076-4d39-b4a5-e95acf5d485d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:23:43.452244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-049c87c3-c076-4d39-b4a5-e95acf5d485d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:23:43.461240 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-049c87c3-c076-4d39-b4a5-e95acf5d485d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1684 microversion: 2.1 time: 0.172962 Aug 04 15:23:43.461835 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3633/7272] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:23:43 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:07.686142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b58f9264-0e88-4373-84dc-34fc13ad52a0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:24:07.688407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b58f9264-0e88-4373-84dc-34fc13ad52a0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:07.691436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=16 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:07.692118 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=44 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:07.706512 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b58f9264-0e88-4373-84dc-34fc13ad52a0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:07.706973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b58f9264-0e88-4373-84dc-34fc13ad52a0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:07.707768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b58f9264-0e88-4373-84dc-34fc13ad52a0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:07.708265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b58f9264-0e88-4373-84dc-34fc13ad52a0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:07.767434 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b58f9264-0e88-4373-84dc-34fc13ad52a0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action" status: 200 len: 59528 microversion: 2.1 time: 0.085189 Aug 04 15:24:07.768054 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3640/7273] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:24:07 2022] POST /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257/action => generated 59528 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:24:15.180264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c58b15e-c0fe-444a-9e37-d294267b949b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:15.180884 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c58b15e-c0fe-444a-9e37-d294267b949b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:15.185045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-3b4d78bc-fdbf-43b7-bccb-82fccf938ba3 req-a7963ea7-e146-4d07-abf7-a060497a2e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f68fc64-1d1c-43c3-a033-a97a0c1d6257", "tag": "eba749d4-3e85-4bf3-be40-a0be199c5418"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:24:15.187415 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=16 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:15.188158 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:15.189886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c58b15e-c0fe-444a-9e37-d294267b949b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:15.190487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c58b15e-c0fe-444a-9e37-d294267b949b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:15.191286 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c58b15e-c0fe-444a-9e37-d294267b949b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:15.191804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c58b15e-c0fe-444a-9e37-d294267b949b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:15.197897 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3b4d78bc-fdbf-43b7-bccb-82fccf938ba3 req-a7963ea7-e146-4d07-abf7-a060497a2e9c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:15.198360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-3b4d78bc-fdbf-43b7-bccb-82fccf938ba3 req-a7963ea7-e146-4d07-abf7-a060497a2e9c service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:15.211282 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-3b4d78bc-fdbf-43b7-bccb-82fccf938ba3 req-a7963ea7-e146-4d07-abf7-a060497a2e9c service nova] Creating event network-changed:eba749d4-3e85-4bf3-be40-a0be199c5418 for instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 on n-h2-844627-10 Aug 04 15:24:15.217841 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-3b4d78bc-fdbf-43b7-bccb-82fccf938ba3 req-a7963ea7-e146-4d07-abf7-a060497a2e9c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038858 Aug 04 15:24:15.221005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c58b15e-c0fe-444a-9e37-d294267b949b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Going to try to terminate instance {{(pid=130961) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:24:15.221458 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3641/7274] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:24:15.306010 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c58b15e-c0fe-444a-9e37-d294267b949b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 204 len: 0 microversion: 2.1 time: 0.129469 Aug 04 15:24:15.307324 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3634/7275] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:24:15 2022] DELETE /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:24:15.317606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-47dd50fb-3f9e-49e7-b35a-ae3a319a58ca tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:15.318316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-47dd50fb-3f9e-49e7-b35a-ae3a319a58ca tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:15.324776 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47dd50fb-3f9e-49e7-b35a-ae3a319a58ca tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:15.326682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47dd50fb-3f9e-49e7-b35a-ae3a319a58ca tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:15.327685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47dd50fb-3f9e-49e7-b35a-ae3a319a58ca tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:15.328280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-47dd50fb-3f9e-49e7-b35a-ae3a319a58ca tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:15.538692 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-47dd50fb-3f9e-49e7-b35a-ae3a319a58ca tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:15.547475 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-47dd50fb-3f9e-49e7-b35a-ae3a319a58ca tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1690 microversion: 2.1 time: 0.234736 Aug 04 15:24:15.548060 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3642/7276] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:15 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1690 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:24:16.570815 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-45a7668d-4020-47b2-b6c1-c17dfa19d7b2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:16.571535 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-45a7668d-4020-47b2-b6c1-c17dfa19d7b2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:16.579069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45a7668d-4020-47b2-b6c1-c17dfa19d7b2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:16.579534 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45a7668d-4020-47b2-b6c1-c17dfa19d7b2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:16.580341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45a7668d-4020-47b2-b6c1-c17dfa19d7b2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:16.580791 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-45a7668d-4020-47b2-b6c1-c17dfa19d7b2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:16.805026 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-45a7668d-4020-47b2-b6c1-c17dfa19d7b2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:16.813722 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-45a7668d-4020-47b2-b6c1-c17dfa19d7b2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 200 len: 1690 microversion: 2.1 time: 0.247087 Aug 04 15:24:16.814698 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3635/7277] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:16 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 1690 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:17.275883 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-dbbfc11d-e089-4e46-a9cb-90cabdc9ecdd req-c9ac196d-501e-414a-9ecf-06b4e905a1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f68fc64-1d1c-43c3-a033-a97a0c1d6257", "name": "network-vif-deleted", "tag": "eba749d4-3e85-4bf3-be40-a0be199c5418"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:24:17.289667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-dbbfc11d-e089-4e46-a9cb-90cabdc9ecdd req-c9ac196d-501e-414a-9ecf-06b4e905a1c8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:17.290201 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-dbbfc11d-e089-4e46-a9cb-90cabdc9ecdd req-c9ac196d-501e-414a-9ecf-06b4e905a1c8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:17.302735 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-dbbfc11d-e089-4e46-a9cb-90cabdc9ecdd req-c9ac196d-501e-414a-9ecf-06b4e905a1c8 service nova] Creating event network-vif-deleted:eba749d4-3e85-4bf3-be40-a0be199c5418 for instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 on n-h2-844627-10 Aug 04 15:24:17.308217 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-dbbfc11d-e089-4e46-a9cb-90cabdc9ecdd req-c9ac196d-501e-414a-9ecf-06b4e905a1c8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094038 Aug 04 15:24:17.308912 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3643/7278] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:24:17.835870 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:17.836478 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 7f68fc64-1d1c-43c3-a033-a97a0c1d6257] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:17.844050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:17.844518 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:17.845374 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:17.845831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:17.862898 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] HTTP exception thrown: Instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 could not be found. Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Request method failure captured: Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 HTTP/1.1 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-MdSrctgttr1U5SrenWNZF1MNvZAMBWYuBvkZyWBcdMlKnpUzm7Z071NicUy65ZzzO7N9HvZR2pNs5s6hV4p_fBK0RZlwUHCEJkDgqmnu2Jeut1ekrrTJXveQ-cTX_QJroJUgXevBcCa6Tb3g6wesziFpva-tZG7WXokf3Vn9znV0M Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31a48040328d426d8434ae9c36070d70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31a48040328d426d8434ae9c36070d70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}] Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 1056d22ae221415db1187d24ba7a1285 Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 could not be found. Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '7f68fc64-1d1c-43c3-a033-a97a0c1d6257'} Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 could not be found. Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 could not be found. Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:24:17.864589 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 could not be found. Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Returning 404 to user: Instance 7f68fc64-1d1c-43c3-a033-a97a0c1d6257 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-792f2cfe-8d1d-4708-b072-dfb4ce869275 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257" status: 404 len: 111 microversion: 2.1 time: 0.034135 Aug 04 15:24:17.869786 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3636/7279] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:17 2022] GET /compute/v2.1/servers/7f68fc64-1d1c-43c3-a033-a97a0c1d6257 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:24:20.932044 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7cbe3554-1a80-4a94-9845-85a0331c38d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '.version_select at 0x7f46f31903a0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:20.953282 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7cbe3554-1a80-4a94-9845-85a0331c38d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1221227337" status: 202 len: 0 microversion: 2.1 time: 0.025304 Aug 04 15:24:20.953879 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3644/7280] 10.222.0.66 () {58 vars in 1284 bytes} [Thu Aug 4 15:24:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1221227337 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:24:20.986185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-14b9b846-7694-460c-9fae-01dd2a12b940 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: .version_select at 0x7f46f057ef70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-135741763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzqny6jAuLGmlWxvwb3YoJxMlenRU+kUNw1rwg1Bntus3LoGSZyPYD27hkcS0nprqLWujdhOnpjV8q96R0uWfnuVu9R6/bcSKYcz/HEeptve1S0yziV6NNWUXopOBXuSQ=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:24:21.002225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-14b9b846-7694-460c-9fae-01dd2a12b940 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:24:21.008131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-14b9b846-7694-460c-9fae-01dd2a12b940 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:24:21.032009 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-14b9b846-7694-460c-9fae-01dd2a12b940 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049908 Aug 04 15:24:21.032546 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3637/7281] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:24:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:24:26.793166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1603393468", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "networks": [{"uuid": "6540ea88-6b42-4935-8c22-72e9118ecffe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-135741763", "security_groups": [{"name": "tempest-secgroup-smoke-2113835474"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:24:26.978759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] validate_networks() for [('6540ea88-6b42-4935-8c22-72e9118ecffe', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:24:27.296258 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=14 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:27.838283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:24:27.838887 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:24:27.839439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:24:27.839915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:24:27.840401 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:24:27.850324 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:27.850960 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:27.851950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:27.852557 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:27.873040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:24:27.879493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Getting quotas for user 1056d22ae221415db1187d24ba7a1285 and project 31a48040328d426d8434ae9c36070d70. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:24:27.894632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:24:27.897069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:24:27.950261 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-21179f9f-be05-4ee1-a1b5-83e2c4c7720d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.161769 Aug 04 15:24:27.950919 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3645/7282] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:24:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:24:27.960350 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:27.965934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d2d83bbb-8efd-4448-a6de-d358558b4574 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:27.966831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d2d83bbb-8efd-4448-a6de-d358558b4574 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:28.046208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d2d83bbb-8efd-4448-a6de-d358558b4574 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:28.054016 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d2d83bbb-8efd-4448-a6de-d358558b4574 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1266 microversion: 2.1 time: 0.095502 Aug 04 15:24:28.055137 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3638/7283] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:27 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:29.077646 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6f62aad1-624e-437d-b065-414d397894d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:29.079301 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6f62aad1-624e-437d-b065-414d397894d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:29.086915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f62aad1-624e-437d-b065-414d397894d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:29.088724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f62aad1-624e-437d-b065-414d397894d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:29.089790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f62aad1-624e-437d-b065-414d397894d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:29.090443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6f62aad1-624e-437d-b065-414d397894d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:29.177594 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6f62aad1-624e-437d-b065-414d397894d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:29.187147 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6f62aad1-624e-437d-b065-414d397894d1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1336 microversion: 2.1 time: 0.115760 Aug 04 15:24:29.187988 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3646/7284] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:29 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:30.213738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-85e566cd-755d-4c27-8a1b-a11bd626d18d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:30.215254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-85e566cd-755d-4c27-8a1b-a11bd626d18d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:30.225507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85e566cd-755d-4c27-8a1b-a11bd626d18d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:30.226343 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85e566cd-755d-4c27-8a1b-a11bd626d18d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:30.227449 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85e566cd-755d-4c27-8a1b-a11bd626d18d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:30.228077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-85e566cd-755d-4c27-8a1b-a11bd626d18d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:30.425464 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-85e566cd-755d-4c27-8a1b-a11bd626d18d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:30.434410 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-85e566cd-755d-4c27-8a1b-a11bd626d18d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1392 microversion: 2.1 time: 0.226516 Aug 04 15:24:30.435039 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3639/7285] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:30 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:30.733552 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-8cd0c607-528e-4930-82a6-09d69cbf01d2 req-9db94552-7c3e-44ec-aeae-4218595a20eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fdb3bf-f676-40bc-b3db-bcb9aabcb595", "tag": "4dd5d166-ddfe-42ae-b780-64e718029e78"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:24:30.746578 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8cd0c607-528e-4930-82a6-09d69cbf01d2 req-9db94552-7c3e-44ec-aeae-4218595a20eb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:30.747025 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-8cd0c607-528e-4930-82a6-09d69cbf01d2 req-9db94552-7c3e-44ec-aeae-4218595a20eb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:30.758761 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-8cd0c607-528e-4930-82a6-09d69cbf01d2 req-9db94552-7c3e-44ec-aeae-4218595a20eb service nova] Creating event network-changed:4dd5d166-ddfe-42ae-b780-64e718029e78 for instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 on n-h2-844627-10 Aug 04 15:24:30.764950 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-8cd0c607-528e-4930-82a6-09d69cbf01d2 req-9db94552-7c3e-44ec-aeae-4218595a20eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037755 Aug 04 15:24:30.766010 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3647/7286] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:24:31.455964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6c05e98a-4af7-46f4-b4fb-9b40a33361b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:31.456621 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6c05e98a-4af7-46f4-b4fb-9b40a33361b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:31.464065 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c05e98a-4af7-46f4-b4fb-9b40a33361b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:31.464291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c05e98a-4af7-46f4-b4fb-9b40a33361b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:31.465109 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c05e98a-4af7-46f4-b4fb-9b40a33361b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:31.465573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6c05e98a-4af7-46f4-b4fb-9b40a33361b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:31.602927 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6c05e98a-4af7-46f4-b4fb-9b40a33361b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:31.611687 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6c05e98a-4af7-46f4-b4fb-9b40a33361b6 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1392 microversion: 2.1 time: 0.159728 Aug 04 15:24:31.612188 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3640/7287] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:31 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:32.634328 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5efcac26-e159-469c-ad84-d8bb49fed731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:32.636668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5efcac26-e159-469c-ad84-d8bb49fed731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:32.643884 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5efcac26-e159-469c-ad84-d8bb49fed731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:32.644363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5efcac26-e159-469c-ad84-d8bb49fed731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:32.645188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5efcac26-e159-469c-ad84-d8bb49fed731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:32.645638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5efcac26-e159-469c-ad84-d8bb49fed731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:32.782586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-5efcac26-e159-469c-ad84-d8bb49fed731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:32.790452 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5efcac26-e159-469c-ad84-d8bb49fed731 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1392 microversion: 2.1 time: 0.161293 Aug 04 15:24:32.791031 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3648/7288] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:32 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:33.813352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a57474e4-d9a5-4e30-977c-3106d97ce06f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:33.814107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a57474e4-d9a5-4e30-977c-3106d97ce06f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:33.821937 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a57474e4-d9a5-4e30-977c-3106d97ce06f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:33.822463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a57474e4-d9a5-4e30-977c-3106d97ce06f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:33.823269 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a57474e4-d9a5-4e30-977c-3106d97ce06f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:33.823726 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a57474e4-d9a5-4e30-977c-3106d97ce06f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:33.964128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a57474e4-d9a5-4e30-977c-3106d97ce06f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:33.971884 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a57474e4-d9a5-4e30-977c-3106d97ce06f tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1392 microversion: 2.1 time: 0.164833 Aug 04 15:24:33.972482 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3641/7289] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:33 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:34.993445 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-faf69bfe-701b-4965-a597-abd256a5731d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:34.994091 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-faf69bfe-701b-4965-a597-abd256a5731d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:35.001260 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faf69bfe-701b-4965-a597-abd256a5731d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:35.001714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faf69bfe-701b-4965-a597-abd256a5731d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:35.002489 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faf69bfe-701b-4965-a597-abd256a5731d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:35.002931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-faf69bfe-701b-4965-a597-abd256a5731d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:35.139842 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-faf69bfe-701b-4965-a597-abd256a5731d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:35.147544 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-faf69bfe-701b-4965-a597-abd256a5731d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1392 microversion: 2.1 time: 0.158000 Aug 04 15:24:35.148117 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3649/7290] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:34 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:35.769743 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-3a9d33ff-25a0-4b70-95d0-6c81f190a9c8 req-0fe76c13-9c21-421d-bb97-3ab0ba28e409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fdb3bf-f676-40bc-b3db-bcb9aabcb595", "name": "network-vif-plugged", "status": "completed", "tag": "4dd5d166-ddfe-42ae-b780-64e718029e78"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:24:35.782441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3a9d33ff-25a0-4b70-95d0-6c81f190a9c8 req-0fe76c13-9c21-421d-bb97-3ab0ba28e409 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:35.782971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-3a9d33ff-25a0-4b70-95d0-6c81f190a9c8 req-0fe76c13-9c21-421d-bb97-3ab0ba28e409 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:35.795310 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-3a9d33ff-25a0-4b70-95d0-6c81f190a9c8 req-0fe76c13-9c21-421d-bb97-3ab0ba28e409 service nova] Creating event network-vif-plugged:4dd5d166-ddfe-42ae-b780-64e718029e78 for instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 on n-h2-844627-10 Aug 04 15:24:35.800756 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-3a9d33ff-25a0-4b70-95d0-6c81f190a9c8 req-0fe76c13-9c21-421d-bb97-3ab0ba28e409 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037251 Aug 04 15:24:35.801427 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3642/7291] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:24:36.168591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e14e2f56-7257-4b79-8453-9c958258d0b1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:36.169224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e14e2f56-7257-4b79-8453-9c958258d0b1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:36.176221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e14e2f56-7257-4b79-8453-9c958258d0b1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:36.176669 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e14e2f56-7257-4b79-8453-9c958258d0b1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:36.177466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e14e2f56-7257-4b79-8453-9c958258d0b1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:36.177906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e14e2f56-7257-4b79-8453-9c958258d0b1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:36.332623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e14e2f56-7257-4b79-8453-9c958258d0b1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:36.340568 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e14e2f56-7257-4b79-8453-9c958258d0b1 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1392 microversion: 2.1 time: 0.176537 Aug 04 15:24:36.341197 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3650/7292] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:36 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:37.363092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-057d91cc-00f7-4581-8ec4-7393f2b3704d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:37.363812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-057d91cc-00f7-4581-8ec4-7393f2b3704d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:37.370874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-057d91cc-00f7-4581-8ec4-7393f2b3704d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:37.371335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-057d91cc-00f7-4581-8ec4-7393f2b3704d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:37.372125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-057d91cc-00f7-4581-8ec4-7393f2b3704d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:37.372583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-057d91cc-00f7-4581-8ec4-7393f2b3704d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:37.510237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-057d91cc-00f7-4581-8ec4-7393f2b3704d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:37.517831 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-057d91cc-00f7-4581-8ec4-7393f2b3704d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1564 microversion: 2.1 time: 0.159861 Aug 04 15:24:37.518578 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3643/7293] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:37 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:37.539159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-659211aa-a2c7-4e99-ac93-2029f9f0130d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:37.539771 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-659211aa-a2c7-4e99-ac93-2029f9f0130d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:37.547621 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-659211aa-a2c7-4e99-ac93-2029f9f0130d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:37.548077 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-659211aa-a2c7-4e99-ac93-2029f9f0130d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:37.548860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-659211aa-a2c7-4e99-ac93-2029f9f0130d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:37.549319 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-659211aa-a2c7-4e99-ac93-2029f9f0130d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:37.691355 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-659211aa-a2c7-4e99-ac93-2029f9f0130d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:37.699032 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-659211aa-a2c7-4e99-ac93-2029f9f0130d tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1564 microversion: 2.1 time: 0.164676 Aug 04 15:24:37.699621 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3651/7294] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:37 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:24:39.398699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9be30228-8989-4763-ad62-f4e98bd46dce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:24:39.400273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9be30228-8989-4763-ad62-f4e98bd46dce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:24:39.402737 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a90a9dd7-36cf-4733-9ab1-bd062f7a01ad req-020e4a6f-651b-4de2-8d55-5db6ab7db8fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fdb3bf-f676-40bc-b3db-bcb9aabcb595", "tag": "4dd5d166-ddfe-42ae-b780-64e718029e78"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:24:39.406423 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:39.409921 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:39.412380 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:39.412662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9be30228-8989-4763-ad62-f4e98bd46dce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:39.412662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9be30228-8989-4763-ad62-f4e98bd46dce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:39.413529 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9be30228-8989-4763-ad62-f4e98bd46dce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:39.414137 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9be30228-8989-4763-ad62-f4e98bd46dce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:39.415612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:24:39.423511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a90a9dd7-36cf-4733-9ab1-bd062f7a01ad req-020e4a6f-651b-4de2-8d55-5db6ab7db8fd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:24:39.424220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a90a9dd7-36cf-4733-9ab1-bd062f7a01ad req-020e4a6f-651b-4de2-8d55-5db6ab7db8fd service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:24:39.438722 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-a90a9dd7-36cf-4733-9ab1-bd062f7a01ad req-020e4a6f-651b-4de2-8d55-5db6ab7db8fd service nova] Creating event network-changed:4dd5d166-ddfe-42ae-b780-64e718029e78 for instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 on n-h2-844627-10 Aug 04 15:24:39.444852 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a90a9dd7-36cf-4733-9ab1-bd062f7a01ad req-020e4a6f-651b-4de2-8d55-5db6ab7db8fd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046006 Aug 04 15:24:39.445601 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3652/7295] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:24:39.583654 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9be30228-8989-4763-ad62-f4e98bd46dce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:24:39.592270 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9be30228-8989-4763-ad62-f4e98bd46dce tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1564 microversion: 2.1 time: 0.197446 Aug 04 15:24:39.592900 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3644/7296] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:24:39 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1564 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:00.841743 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-665a9f06-689a-42ab-a0bc-e4caea76a4cb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:00.844030 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-665a9f06-689a-42ab-a0bc-e4caea76a4cb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:00.846652 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=36 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:00.852544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-665a9f06-689a-42ab-a0bc-e4caea76a4cb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:00.853343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-665a9f06-689a-42ab-a0bc-e4caea76a4cb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:00.854114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-665a9f06-689a-42ab-a0bc-e4caea76a4cb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:00.854554 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-665a9f06-689a-42ab-a0bc-e4caea76a4cb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:00.904953 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-665a9f06-689a-42ab-a0bc-e4caea76a4cb tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action" status: 200 len: 24571 microversion: 2.1 time: 0.068172 Aug 04 15:25:00.905602 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3653/7297] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:25:00 2022] POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action => generated 24571 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:25:11.913976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb647a20-9ebd-4794-8603-cf0c2f31371e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:11.914598 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb647a20-9ebd-4794-8603-cf0c2f31371e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:11.917165 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:11.917892 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=32 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:11.924143 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb647a20-9ebd-4794-8603-cf0c2f31371e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:11.924608 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb647a20-9ebd-4794-8603-cf0c2f31371e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:11.925428 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb647a20-9ebd-4794-8603-cf0c2f31371e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:11.925859 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb647a20-9ebd-4794-8603-cf0c2f31371e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:11.949003 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.objects.instance [None req-cb647a20-9ebd-4794-8603-cf0c2f31371e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lazy-loading 'flavor' on Instance uuid 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 {{(pid=130961) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:25:12.016337 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb647a20-9ebd-4794-8603-cf0c2f31371e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action" status: 202 len: 0 microversion: 2.1 time: 0.106330 Aug 04 15:25:12.017032 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3645/7298] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:25:11 2022] POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:25:12.027422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fb52e85e-409a-49a1-9b73-8f4cf8b3d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:12.028269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fb52e85e-409a-49a1-9b73-8f4cf8b3d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:12.033282 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:12.034215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=4 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:12.042080 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb52e85e-409a-49a1-9b73-8f4cf8b3d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:12.042543 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb52e85e-409a-49a1-9b73-8f4cf8b3d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:12.043327 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb52e85e-409a-49a1-9b73-8f4cf8b3d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:12.043773 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fb52e85e-409a-49a1-9b73-8f4cf8b3d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:12.177649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fb52e85e-409a-49a1-9b73-8f4cf8b3d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:12.186322 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fb52e85e-409a-49a1-9b73-8f4cf8b3d0f2 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1691 microversion: 2.1 time: 0.163996 Aug 04 15:25:12.186904 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3654/7299] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:12 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:13.209420 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-aeda9a62-8d8e-45a0-bfcc-e16badd9daa3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:13.210136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-aeda9a62-8d8e-45a0-bfcc-e16badd9daa3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:13.216456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aeda9a62-8d8e-45a0-bfcc-e16badd9daa3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:13.216953 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aeda9a62-8d8e-45a0-bfcc-e16badd9daa3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:13.217733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aeda9a62-8d8e-45a0-bfcc-e16badd9daa3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:13.218184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-aeda9a62-8d8e-45a0-bfcc-e16badd9daa3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:13.355610 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-aeda9a62-8d8e-45a0-bfcc-e16badd9daa3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:13.363278 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-aeda9a62-8d8e-45a0-bfcc-e16badd9daa3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1674 microversion: 2.1 time: 0.159021 Aug 04 15:25:13.367269 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3646/7300] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:13 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:14.459161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6f076c3-d2db-4525-b455-5c29804b8e3e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:14.461356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6f076c3-d2db-4525-b455-5c29804b8e3e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:14.470443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6f076c3-d2db-4525-b455-5c29804b8e3e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:14.470906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6f076c3-d2db-4525-b455-5c29804b8e3e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:14.471695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6f076c3-d2db-4525-b455-5c29804b8e3e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:14.472143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6f076c3-d2db-4525-b455-5c29804b8e3e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:14.523601 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6f076c3-d2db-4525-b455-5c29804b8e3e tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action" status: 200 len: 38382 microversion: 2.1 time: 0.068339 Aug 04 15:25:14.524263 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3655/7301] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:25:14 2022] POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action => generated 38382 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:25:14.536275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e4364794-e282-4635-93ad-ecb27ceeb58b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:14.536846 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e4364794-e282-4635-93ad-ecb27ceeb58b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:14.544800 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4364794-e282-4635-93ad-ecb27ceeb58b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:14.545311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4364794-e282-4635-93ad-ecb27ceeb58b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:14.546103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4364794-e282-4635-93ad-ecb27ceeb58b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:14.546565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e4364794-e282-4635-93ad-ecb27ceeb58b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:14.622081 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e4364794-e282-4635-93ad-ecb27ceeb58b tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action" status: 202 len: 0 microversion: 2.1 time: 0.089490 Aug 04 15:25:14.622722 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3647/7302] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:25:14 2022] POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:25:14.631760 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d6c69cf7-11f8-4b15-a5b1-f8559ced7c43 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:14.632660 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d6c69cf7-11f8-4b15-a5b1-f8559ced7c43 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:14.641695 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6c69cf7-11f8-4b15-a5b1-f8559ced7c43 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:14.642180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6c69cf7-11f8-4b15-a5b1-f8559ced7c43 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:14.642980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6c69cf7-11f8-4b15-a5b1-f8559ced7c43 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:14.643431 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d6c69cf7-11f8-4b15-a5b1-f8559ced7c43 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:14.823748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d6c69cf7-11f8-4b15-a5b1-f8559ced7c43 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:14.832071 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d6c69cf7-11f8-4b15-a5b1-f8559ced7c43 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1680 microversion: 2.1 time: 0.204592 Aug 04 15:25:14.832772 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3656/7303] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:14 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:25:15.858150 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d5ef8a49-5da5-4d70-b121-ebfde0f24e3a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:15.858869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d5ef8a49-5da5-4d70-b121-ebfde0f24e3a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:15.865507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5ef8a49-5da5-4d70-b121-ebfde0f24e3a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:15.865971 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5ef8a49-5da5-4d70-b121-ebfde0f24e3a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:15.866758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5ef8a49-5da5-4d70-b121-ebfde0f24e3a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:15.867209 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-d5ef8a49-5da5-4d70-b121-ebfde0f24e3a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:16.005960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d5ef8a49-5da5-4d70-b121-ebfde0f24e3a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:16.017509 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d5ef8a49-5da5-4d70-b121-ebfde0f24e3a tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1680 microversion: 2.1 time: 0.164016 Aug 04 15:25:16.019457 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3648/7304] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:15 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:17.049668 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2f19ce28-f985-470f-b2fd-84c6019eff67 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:17.050290 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2f19ce28-f985-470f-b2fd-84c6019eff67 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:17.058170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f19ce28-f985-470f-b2fd-84c6019eff67 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:17.058630 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f19ce28-f985-470f-b2fd-84c6019eff67 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:17.059415 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f19ce28-f985-470f-b2fd-84c6019eff67 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:17.060003 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2f19ce28-f985-470f-b2fd-84c6019eff67 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:17.194874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2f19ce28-f985-470f-b2fd-84c6019eff67 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:17.203330 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2f19ce28-f985-470f-b2fd-84c6019eff67 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1683 microversion: 2.1 time: 0.157614 Aug 04 15:25:17.203908 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3657/7305] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:17 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:17.300236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-205c8985-474c-47fe-a23c-aa76017fc6ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:17.302514 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-205c8985-474c-47fe-a23c-aa76017fc6ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:17.310301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-205c8985-474c-47fe-a23c-aa76017fc6ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:17.310766 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-205c8985-474c-47fe-a23c-aa76017fc6ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:17.311569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-205c8985-474c-47fe-a23c-aa76017fc6ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:17.312015 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-205c8985-474c-47fe-a23c-aa76017fc6ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:17.353833 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-205c8985-474c-47fe-a23c-aa76017fc6ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action" status: 200 len: 38382 microversion: 2.1 time: 0.057325 Aug 04 15:25:17.354486 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3649/7306] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:25:17 2022] POST /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595/action => generated 38382 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 15:25:18.392023 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75dcfd38-c211-4d41-a37f-247fc1e2e3aa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:18.392861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75dcfd38-c211-4d41-a37f-247fc1e2e3aa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:18.394513 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-36045963-dccd-4317-a836-5cb397a95d6f req-95b239ad-b100-408a-834c-da9139c2663e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fdb3bf-f676-40bc-b3db-bcb9aabcb595", "tag": "4dd5d166-ddfe-42ae-b780-64e718029e78"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:18.400790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75dcfd38-c211-4d41-a37f-247fc1e2e3aa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:18.401571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75dcfd38-c211-4d41-a37f-247fc1e2e3aa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:18.402358 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75dcfd38-c211-4d41-a37f-247fc1e2e3aa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:18.403033 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75dcfd38-c211-4d41-a37f-247fc1e2e3aa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:18.407259 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-36045963-dccd-4317-a836-5cb397a95d6f req-95b239ad-b100-408a-834c-da9139c2663e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:18.407804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-36045963-dccd-4317-a836-5cb397a95d6f req-95b239ad-b100-408a-834c-da9139c2663e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:18.420190 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-36045963-dccd-4317-a836-5cb397a95d6f req-95b239ad-b100-408a-834c-da9139c2663e service nova] Creating event network-changed:4dd5d166-ddfe-42ae-b780-64e718029e78 for instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 on n-h2-844627-10 Aug 04 15:25:18.425336 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-36045963-dccd-4317-a836-5cb397a95d6f req-95b239ad-b100-408a-834c-da9139c2663e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034817 Aug 04 15:25:18.426526 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3650/7307] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:25:18.434868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75dcfd38-c211-4d41-a37f-247fc1e2e3aa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:25:18.528762 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75dcfd38-c211-4d41-a37f-247fc1e2e3aa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 204 len: 0 microversion: 2.1 time: 0.140708 Aug 04 15:25:18.529819 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3658/7308] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:25:18 2022] DELETE /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:25:18.540120 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-06f89a04-0ab8-4f9a-99c9-dc02a0d0d3e0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:18.540850 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-06f89a04-0ab8-4f9a-99c9-dc02a0d0d3e0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:18.548523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-06f89a04-0ab8-4f9a-99c9-dc02a0d0d3e0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:18.549284 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-06f89a04-0ab8-4f9a-99c9-dc02a0d0d3e0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:18.550250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-06f89a04-0ab8-4f9a-99c9-dc02a0d0d3e0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:18.550861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-06f89a04-0ab8-4f9a-99c9-dc02a0d0d3e0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:18.697111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-06f89a04-0ab8-4f9a-99c9-dc02a0d0d3e0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:18.705010 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-06f89a04-0ab8-4f9a-99c9-dc02a0d0d3e0 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1689 microversion: 2.1 time: 0.170219 Aug 04 15:25:18.719818 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3651/7309] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:18 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:19.729223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b852e095-cbd5-4571-ad1c-224ca3536cfa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:19.729940 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b852e095-cbd5-4571-ad1c-224ca3536cfa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:19.736943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b852e095-cbd5-4571-ad1c-224ca3536cfa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:19.737433 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b852e095-cbd5-4571-ad1c-224ca3536cfa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:19.738210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b852e095-cbd5-4571-ad1c-224ca3536cfa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:19.738658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b852e095-cbd5-4571-ad1c-224ca3536cfa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:19.888070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b852e095-cbd5-4571-ad1c-224ca3536cfa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:19.897414 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b852e095-cbd5-4571-ad1c-224ca3536cfa tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1689 microversion: 2.1 time: 0.172119 Aug 04 15:25:19.897414 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3659/7310] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:19 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:20.547960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-7ff268eb-c6df-4b23-b4a8-5d0782658bec req-a9554110-e919-428d-aa89-6a093486667e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fdb3bf-f676-40bc-b3db-bcb9aabcb595", "name": "network-vif-deleted", "tag": "4dd5d166-ddfe-42ae-b780-64e718029e78"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:20.561715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7ff268eb-c6df-4b23-b4a8-5d0782658bec req-a9554110-e919-428d-aa89-6a093486667e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:20.562088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-7ff268eb-c6df-4b23-b4a8-5d0782658bec req-a9554110-e919-428d-aa89-6a093486667e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:20.576056 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-7ff268eb-c6df-4b23-b4a8-5d0782658bec req-a9554110-e919-428d-aa89-6a093486667e service nova] Creating event network-vif-deleted:4dd5d166-ddfe-42ae-b780-64e718029e78 for instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 on n-h2-844627-10 Aug 04 15:25:20.581755 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-7ff268eb-c6df-4b23-b4a8-5d0782658bec req-a9554110-e919-428d-aa89-6a093486667e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037732 Aug 04 15:25:20.582367 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3652/7311] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:25:20.919536 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:20.920521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:20.930678 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:20.931130 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:20.931931 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:20.932375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:20.972721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:20.973481 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:20.973942 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lazy-loading 'fault' on Instance uuid 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:25:21.022338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1056d22ae221415db1187d24ba7a1285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31a48040328d426d8434ae9c36070d70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:21.030747 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ae56fb72-b02f-456f-8ae6-f1d12c1ed3ab tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 200 len: 1356 microversion: 2.1 time: 0.116058 Aug 04 15:25:21.031336 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3660/7312] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:20 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 1356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:22.054713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:22.056002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] [instance: 37fdb3bf-f676-40bc-b3db-bcb9aabcb595] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:22.062779 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:22.063173 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:22.063966 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:22.064419 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:22.078140 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] HTTP exception thrown: Instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 could not be found. Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Request method failure captured: Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 HTTP/1.1 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-MdSrctgttr1U5SrenWNZF1MNvZAMBWYuBvkZyWBcdMlKnpUzm7Z071NicUy65ZzzO7N9HvZR2pNs5s6hV4p_fBK0RZlwUHCEJkDgqmnu2Jeut1ekrrTJXveQ-cTX_QJroJUgXevBcCa6Tb3g6wesziFpva-tZG7WXokf3Vn9znV0M Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31a48040328d426d8434ae9c36070d70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31a48040328d426d8434ae9c36070d70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31a48040328d426d8434ae9c36070d70"}]}] Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: 31a48040328d426d8434ae9c36070d70 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2145346668 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 1056d22ae221415db1187d24ba7a1285 Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2145346668-project Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 could not be found. Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '37fdb3bf-f676-40bc-b3db-bcb9aabcb595'} Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 could not be found. Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 could not be found. Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:25:22.079809 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 could not be found. Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Returning 404 to user: Instance 37fdb3bf-f676-40bc-b3db-bcb9aabcb595 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cb7d0f62-dabc-4fbb-9a78-824c71357389 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595" status: 404 len: 111 microversion: 2.1 time: 0.031975 Aug 04 15:25:22.085020 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3653/7313] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:22 2022] GET /compute/v2.1/servers/37fdb3bf-f676-40bc-b3db-bcb9aabcb595 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:25:25.773224 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-02d146de-c753-4a3c-aaca-e062e0f7cab3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] Calling method '.version_select at 0x7f47000ffca0>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:25.796843 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-02d146de-c753-4a3c-aaca-e062e0f7cab3 tempest-TestNetworkAdvancedServerOps-2145346668 tempest-TestNetworkAdvancedServerOps-2145346668-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-135741763" status: 202 len: 0 microversion: 2.1 time: 0.027669 Aug 04 15:25:25.797539 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3661/7314] 10.222.0.66 () {58 vars in 1281 bytes} [Thu Aug 4 15:25:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-135741763 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:25:38.124688 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=18 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:38.126372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:38.350970 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-37d55ccf-cdaf-4d3c-ab4d-6938692ff1b6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Action: 'create', calling method: .version_select at 0x7f46f056ff70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1513623217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTogD7zsiwOBWPKodP1VKgrw29L6FzSJqz0gnRufvz5upl7QKM2bY0VwVKP+ahROD4+MrN8CXtwAOQ1cBhnqBYzoQlEWGo97vvsa08mPqdm3yQkown1xblUJSdr7sdvyw=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:38.396254 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-37d55ccf-cdaf-4d3c-ab4d-6938692ff1b6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Getting quotas for project c1083843dc73426bbc2179924015b9a4. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:25:38.402925 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-37d55ccf-cdaf-4d3c-ab4d-6938692ff1b6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Getting quotas for user 46d19252493843eda0044da0f9a59c23 and project c1083843dc73426bbc2179924015b9a4. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:25:38.437903 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-37d55ccf-cdaf-4d3c-ab4d-6938692ff1b6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.333435 Aug 04 15:25:38.445777 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3654/7315] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:25:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:25:39.608951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:39.609854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:39.614349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1300226189", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1513623217", "security_groups": [{"name": "tempest-secgroup-smoke-1531723580"}], "networks": [{"uuid": "93c7a058-5582-4104-abaa-b537efe24495"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:39.740019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] validate_networks() for [('93c7a058-5582-4104-abaa-b537efe24495', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:25:40.138439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:25:40.138867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:25:40.139349 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:25:40.139764 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:25:40.140180 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:25:40.150723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:40.151423 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:40.152249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:40.152729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:40.176663 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Getting quotas for project c1083843dc73426bbc2179924015b9a4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:25:40.183494 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Getting quotas for user 46d19252493843eda0044da0f9a59c23 and project c1083843dc73426bbc2179924015b9a4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:25:40.201730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:25:40.204072 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:25:40.254132 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-762b15aa-f53f-46f0-978b-3c7e8c092cbc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.647118 Aug 04 15:25:40.254789 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3662/7316] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:25:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:25:40.266835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0ef998b0-3a35-485d-810a-df9b281eacbb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:40.268102 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0ef998b0-3a35-485d-810a-df9b281eacbb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:40.331790 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0ef998b0-3a35-485d-810a-df9b281eacbb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:40.338810 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0ef998b0-3a35-485d-810a-df9b281eacbb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1247 microversion: 2.1 time: 0.076864 Aug 04 15:25:40.339621 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3655/7317] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:40 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1247 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:25:41.361148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6c9704e3-0622-4ed7-892d-dd93f961bce3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:41.362237 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6c9704e3-0622-4ed7-892d-dd93f961bce3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:41.373986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c9704e3-0622-4ed7-892d-dd93f961bce3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:41.374837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c9704e3-0622-4ed7-892d-dd93f961bce3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:41.375850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c9704e3-0622-4ed7-892d-dd93f961bce3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:41.376546 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6c9704e3-0622-4ed7-892d-dd93f961bce3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:41.474283 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6c9704e3-0622-4ed7-892d-dd93f961bce3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:41.488781 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6c9704e3-0622-4ed7-892d-dd93f961bce3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1307 microversion: 2.1 time: 0.132597 Aug 04 15:25:41.502466 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3663/7318] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:41 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:42.514675 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-56883b07-2912-495d-adc1-d4a5ea79d907 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:42.515324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-56883b07-2912-495d-adc1-d4a5ea79d907 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:42.523367 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56883b07-2912-495d-adc1-d4a5ea79d907 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:42.523832 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56883b07-2912-495d-adc1-d4a5ea79d907 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:42.524639 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56883b07-2912-495d-adc1-d4a5ea79d907 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:42.525436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-56883b07-2912-495d-adc1-d4a5ea79d907 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:42.790742 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-56883b07-2912-495d-adc1-d4a5ea79d907 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:42.809581 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-56883b07-2912-495d-adc1-d4a5ea79d907 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1373 microversion: 2.1 time: 0.298584 Aug 04 15:25:42.810177 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3656/7319] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:42 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1373 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:43.461638 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-4e36cc5d-eb26-4461-829c-d616a3629e4f req-61fe829d-681b-4b16-a543-183222bb4a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea", "tag": "2f701fbf-5a51-4900-893c-c79c2e8c0583"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:43.474796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4e36cc5d-eb26-4461-829c-d616a3629e4f req-61fe829d-681b-4b16-a543-183222bb4a62 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:43.475264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4e36cc5d-eb26-4461-829c-d616a3629e4f req-61fe829d-681b-4b16-a543-183222bb4a62 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:43.488084 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-4e36cc5d-eb26-4461-829c-d616a3629e4f req-61fe829d-681b-4b16-a543-183222bb4a62 service nova] Creating event network-changed:2f701fbf-5a51-4900-893c-c79c2e8c0583 for instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea on n-h2-844627-10 Aug 04 15:25:43.494764 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-4e36cc5d-eb26-4461-829c-d616a3629e4f req-61fe829d-681b-4b16-a543-183222bb4a62 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108050 Aug 04 15:25:43.495228 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3664/7320] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:25:43.832973 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-fc47b090-d024-4d1b-b4e1-84269b75837e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:43.833768 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-fc47b090-d024-4d1b-b4e1-84269b75837e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:43.842666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc47b090-d024-4d1b-b4e1-84269b75837e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:43.843179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc47b090-d024-4d1b-b4e1-84269b75837e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:43.843680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc47b090-d024-4d1b-b4e1-84269b75837e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:43.844162 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-fc47b090-d024-4d1b-b4e1-84269b75837e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:43.991144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-fc47b090-d024-4d1b-b4e1-84269b75837e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:43.998959 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-fc47b090-d024-4d1b-b4e1-84269b75837e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1373 microversion: 2.1 time: 0.170695 Aug 04 15:25:43.999538 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3657/7321] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:43 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:45.023502 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-23883233-2337-4a61-b981-1bfcefd181cb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:45.024599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-23883233-2337-4a61-b981-1bfcefd181cb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:45.034210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23883233-2337-4a61-b981-1bfcefd181cb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:45.034748 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23883233-2337-4a61-b981-1bfcefd181cb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:45.036084 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23883233-2337-4a61-b981-1bfcefd181cb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:45.036837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-23883233-2337-4a61-b981-1bfcefd181cb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:45.235140 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-23883233-2337-4a61-b981-1bfcefd181cb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:45.244065 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-23883233-2337-4a61-b981-1bfcefd181cb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1373 microversion: 2.1 time: 0.227133 Aug 04 15:25:45.244680 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3665/7322] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:45 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:46.268936 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5f90d8e7-e43e-499e-a3fd-63e8ab270d68 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:46.269899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5f90d8e7-e43e-499e-a3fd-63e8ab270d68 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:46.281981 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f90d8e7-e43e-499e-a3fd-63e8ab270d68 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:46.282903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f90d8e7-e43e-499e-a3fd-63e8ab270d68 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:46.284379 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f90d8e7-e43e-499e-a3fd-63e8ab270d68 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:46.285210 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5f90d8e7-e43e-499e-a3fd-63e8ab270d68 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:46.455658 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5f90d8e7-e43e-499e-a3fd-63e8ab270d68 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:46.468086 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5f90d8e7-e43e-499e-a3fd-63e8ab270d68 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1373 microversion: 2.1 time: 0.205209 Aug 04 15:25:46.469491 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3658/7323] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:46 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1373 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:47.492569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-2a8940cf-0bd6-4284-b4cf-244db9fb543c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:47.493330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-2a8940cf-0bd6-4284-b4cf-244db9fb543c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:47.500838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a8940cf-0bd6-4284-b4cf-244db9fb543c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:47.501339 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a8940cf-0bd6-4284-b4cf-244db9fb543c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:47.502169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a8940cf-0bd6-4284-b4cf-244db9fb543c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:47.502620 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-2a8940cf-0bd6-4284-b4cf-244db9fb543c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:47.651992 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-2a8940cf-0bd6-4284-b4cf-244db9fb543c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:47.662160 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-2a8940cf-0bd6-4284-b4cf-244db9fb543c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1373 microversion: 2.1 time: 0.173531 Aug 04 15:25:47.662971 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3666/7324] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:47 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:48.083674 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-afaaee57-7177-4454-a114-61ba940a1474 req-05504fa9-310f-4281-8f98-bf0032d6537a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea", "name": "network-vif-plugged", "status": "completed", "tag": "2f701fbf-5a51-4900-893c-c79c2e8c0583"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:48.103734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-afaaee57-7177-4454-a114-61ba940a1474 req-05504fa9-310f-4281-8f98-bf0032d6537a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:48.104202 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-afaaee57-7177-4454-a114-61ba940a1474 req-05504fa9-310f-4281-8f98-bf0032d6537a service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:48.116788 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-afaaee57-7177-4454-a114-61ba940a1474 req-05504fa9-310f-4281-8f98-bf0032d6537a service nova] Creating event network-vif-plugged:2f701fbf-5a51-4900-893c-c79c2e8c0583 for instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea on n-h2-844627-10 Aug 04 15:25:48.121977 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-afaaee57-7177-4454-a114-61ba940a1474 req-05504fa9-310f-4281-8f98-bf0032d6537a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043308 Aug 04 15:25:48.122586 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3659/7325] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:25:48.686682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a75480e3-c162-4902-b230-95766115b06c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:48.687300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a75480e3-c162-4902-b230-95766115b06c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:48.695447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a75480e3-c162-4902-b230-95766115b06c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:48.695905 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a75480e3-c162-4902-b230-95766115b06c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:48.696696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a75480e3-c162-4902-b230-95766115b06c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:48.697169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a75480e3-c162-4902-b230-95766115b06c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:48.836113 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a75480e3-c162-4902-b230-95766115b06c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:48.843862 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a75480e3-c162-4902-b230-95766115b06c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1373 microversion: 2.1 time: 0.161120 Aug 04 15:25:48.844451 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3667/7326] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:48 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:49.866794 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-814f1ca7-a5ba-4b81-91da-95f730de1db9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:49.867521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-814f1ca7-a5ba-4b81-91da-95f730de1db9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:49.874750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-814f1ca7-a5ba-4b81-91da-95f730de1db9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:49.875221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-814f1ca7-a5ba-4b81-91da-95f730de1db9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:49.876028 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-814f1ca7-a5ba-4b81-91da-95f730de1db9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:49.876569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-814f1ca7-a5ba-4b81-91da-95f730de1db9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:50.025834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-814f1ca7-a5ba-4b81-91da-95f730de1db9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:50.033650 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-814f1ca7-a5ba-4b81-91da-95f730de1db9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1558 microversion: 2.1 time: 0.172091 Aug 04 15:25:50.034476 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3660/7327] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:49 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:50.054432 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-792a562a-d940-475e-a650-8c3395265bba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:25:50.055049 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-792a562a-d940-475e-a650-8c3395265bba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:25:50.062284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-792a562a-d940-475e-a650-8c3395265bba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:50.062730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-792a562a-d940-475e-a650-8c3395265bba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:50.063531 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-792a562a-d940-475e-a650-8c3395265bba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:50.063966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-792a562a-d940-475e-a650-8c3395265bba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:50.167005 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:50.195330 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:50.202170 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-792a562a-d940-475e-a650-8c3395265bba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:25:50.209997 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-792a562a-d940-475e-a650-8c3395265bba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1558 microversion: 2.1 time: 0.159396 Aug 04 15:25:50.210605 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3668/7328] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:25:50 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:25:52.039457 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-07c53d06-0ce7-432a-8052-af91ceb2219e req-66d9181d-6689-461f-a775-11fbb4dda4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea", "tag": "2f701fbf-5a51-4900-893c-c79c2e8c0583"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:25:52.047904 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:25:52.052657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-07c53d06-0ce7-432a-8052-af91ceb2219e req-66d9181d-6689-461f-a775-11fbb4dda4ef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:25:52.052965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-07c53d06-0ce7-432a-8052-af91ceb2219e req-66d9181d-6689-461f-a775-11fbb4dda4ef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:25:52.065586 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-07c53d06-0ce7-432a-8052-af91ceb2219e req-66d9181d-6689-461f-a775-11fbb4dda4ef service nova] Creating event network-changed:2f701fbf-5a51-4900-893c-c79c2e8c0583 for instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea on n-h2-844627-10 Aug 04 15:25:52.071109 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-07c53d06-0ce7-432a-8052-af91ceb2219e req-66d9181d-6689-461f-a775-11fbb4dda4ef service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036050 Aug 04 15:25:52.071725 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3661/7329] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:26:44.152252 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:26:44.152987 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:27:47.767125 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:27:47.767989 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=34 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:27:47.772402 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5b1c2057-669d-42f3-804e-7058e004eeb6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:27:47.773019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5b1c2057-669d-42f3-804e-7058e004eeb6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:47.780930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b1c2057-669d-42f3-804e-7058e004eeb6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:47.781491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b1c2057-669d-42f3-804e-7058e004eeb6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:47.782262 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b1c2057-669d-42f3-804e-7058e004eeb6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:47.782694 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5b1c2057-669d-42f3-804e-7058e004eeb6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:47.809656 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-5b1c2057-669d-42f3-804e-7058e004eeb6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lazy-loading 'flavor' on Instance uuid 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:27:47.998214 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5b1c2057-669d-42f3-804e-7058e004eeb6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "POST /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea/action" status: 202 len: 0 microversion: 2.1 time: 0.233255 Aug 04 15:27:47.998843 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3669/7330] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:27:47 2022] POST /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 15:27:48.006540 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:27:48.007339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=28 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:27:48.011545 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-81a0d81d-ddb8-4b48-8127-4e513651f824 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:48.012275 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-81a0d81d-ddb8-4b48-8127-4e513651f824 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:48.021092 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81a0d81d-ddb8-4b48-8127-4e513651f824 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:48.021425 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81a0d81d-ddb8-4b48-8127-4e513651f824 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:48.022316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81a0d81d-ddb8-4b48-8127-4e513651f824 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:48.022772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-81a0d81d-ddb8-4b48-8127-4e513651f824 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:48.219746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-81a0d81d-ddb8-4b48-8127-4e513651f824 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:48.227279 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-81a0d81d-ddb8-4b48-8127-4e513651f824 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.223128 Aug 04 15:27:48.227846 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3662/7331] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:48 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:49.251288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c476c766-9ae9-4853-9320-8ad39fc92ec5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:49.252065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c476c766-9ae9-4853-9320-8ad39fc92ec5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:49.259679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c476c766-9ae9-4853-9320-8ad39fc92ec5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:49.260127 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c476c766-9ae9-4853-9320-8ad39fc92ec5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:49.260912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c476c766-9ae9-4853-9320-8ad39fc92ec5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:49.261360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c476c766-9ae9-4853-9320-8ad39fc92ec5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:49.393210 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c476c766-9ae9-4853-9320-8ad39fc92ec5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:49.400924 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c476c766-9ae9-4853-9320-8ad39fc92ec5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.155548 Aug 04 15:27:49.401514 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3670/7332] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:49 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:50.422233 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7e26e1cc-7491-43cb-9a92-e74a08e84050 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:50.422798 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7e26e1cc-7491-43cb-9a92-e74a08e84050 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:50.430279 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e26e1cc-7491-43cb-9a92-e74a08e84050 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:50.430749 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e26e1cc-7491-43cb-9a92-e74a08e84050 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:50.431539 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e26e1cc-7491-43cb-9a92-e74a08e84050 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:50.431995 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7e26e1cc-7491-43cb-9a92-e74a08e84050 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:50.561920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7e26e1cc-7491-43cb-9a92-e74a08e84050 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:50.569387 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7e26e1cc-7491-43cb-9a92-e74a08e84050 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.151195 Aug 04 15:27:50.569943 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3663/7333] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:50 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:51.591238 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7acd725a-2dda-4c83-b9a5-92445ff823e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:51.591871 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7acd725a-2dda-4c83-b9a5-92445ff823e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:51.598855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7acd725a-2dda-4c83-b9a5-92445ff823e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:51.599309 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7acd725a-2dda-4c83-b9a5-92445ff823e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:51.600075 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7acd725a-2dda-4c83-b9a5-92445ff823e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:51.600521 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7acd725a-2dda-4c83-b9a5-92445ff823e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:51.737606 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7acd725a-2dda-4c83-b9a5-92445ff823e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:51.745250 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7acd725a-2dda-4c83-b9a5-92445ff823e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.157949 Aug 04 15:27:51.745837 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3671/7334] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:51 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:52.766070 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-301a50a3-a0b8-4682-a1a1-72d02f0f9391 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:52.766715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-301a50a3-a0b8-4682-a1a1-72d02f0f9391 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:52.773618 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-301a50a3-a0b8-4682-a1a1-72d02f0f9391 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:52.774084 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-301a50a3-a0b8-4682-a1a1-72d02f0f9391 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:52.774897 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-301a50a3-a0b8-4682-a1a1-72d02f0f9391 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:52.775349 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-301a50a3-a0b8-4682-a1a1-72d02f0f9391 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:52.909824 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-301a50a3-a0b8-4682-a1a1-72d02f0f9391 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:52.917458 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-301a50a3-a0b8-4682-a1a1-72d02f0f9391 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.155749 Aug 04 15:27:52.918016 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3664/7335] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:52 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:53.938300 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3fd0255f-db55-4cee-8fd5-e851b06d650a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:53.938902 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3fd0255f-db55-4cee-8fd5-e851b06d650a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:53.946168 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fd0255f-db55-4cee-8fd5-e851b06d650a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:53.946609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fd0255f-db55-4cee-8fd5-e851b06d650a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:53.947407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fd0255f-db55-4cee-8fd5-e851b06d650a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:53.947843 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3fd0255f-db55-4cee-8fd5-e851b06d650a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:54.082265 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3fd0255f-db55-4cee-8fd5-e851b06d650a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:54.089992 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3fd0255f-db55-4cee-8fd5-e851b06d650a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.155783 Aug 04 15:27:54.090559 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3672/7336] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:53 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:55.112047 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ae4e57d4-482a-4110-bf03-ea7b5fa3cd23 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:55.112670 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ae4e57d4-482a-4110-bf03-ea7b5fa3cd23 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:55.119623 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae4e57d4-482a-4110-bf03-ea7b5fa3cd23 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:55.120081 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae4e57d4-482a-4110-bf03-ea7b5fa3cd23 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:55.120848 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae4e57d4-482a-4110-bf03-ea7b5fa3cd23 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:55.121312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ae4e57d4-482a-4110-bf03-ea7b5fa3cd23 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:55.255348 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ae4e57d4-482a-4110-bf03-ea7b5fa3cd23 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:55.262797 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ae4e57d4-482a-4110-bf03-ea7b5fa3cd23 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.155123 Aug 04 15:27:55.263347 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3665/7337] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:55 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:56.284250 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7208a128-22c4-495e-912a-d1304e0498ba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:56.285001 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7208a128-22c4-495e-912a-d1304e0498ba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:56.291888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7208a128-22c4-495e-912a-d1304e0498ba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:56.292332 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7208a128-22c4-495e-912a-d1304e0498ba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:56.293141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7208a128-22c4-495e-912a-d1304e0498ba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:56.293581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7208a128-22c4-495e-912a-d1304e0498ba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:56.425021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7208a128-22c4-495e-912a-d1304e0498ba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:56.432931 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7208a128-22c4-495e-912a-d1304e0498ba tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.152757 Aug 04 15:27:56.433507 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3673/7338] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:56 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:57.455642 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-52721c80-e1f2-48e2-a37e-fd3c70bec732 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:57.456180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-52721c80-e1f2-48e2-a37e-fd3c70bec732 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:57.463437 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52721c80-e1f2-48e2-a37e-fd3c70bec732 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:57.463899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52721c80-e1f2-48e2-a37e-fd3c70bec732 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:57.464680 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52721c80-e1f2-48e2-a37e-fd3c70bec732 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:57.465161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-52721c80-e1f2-48e2-a37e-fd3c70bec732 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:57.601578 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-52721c80-e1f2-48e2-a37e-fd3c70bec732 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:57.609847 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-52721c80-e1f2-48e2-a37e-fd3c70bec732 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.158194 Aug 04 15:27:57.610420 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3666/7339] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:57 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:58.631471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cbd5276a-c0bf-4391-a729-b18c92cb9ef0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:58.632096 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cbd5276a-c0bf-4391-a729-b18c92cb9ef0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:58.639952 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbd5276a-c0bf-4391-a729-b18c92cb9ef0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:58.640342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbd5276a-c0bf-4391-a729-b18c92cb9ef0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:58.641143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbd5276a-c0bf-4391-a729-b18c92cb9ef0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:58.641587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbd5276a-c0bf-4391-a729-b18c92cb9ef0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:58.775930 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cbd5276a-c0bf-4391-a729-b18c92cb9ef0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:58.783885 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cbd5276a-c0bf-4391-a729-b18c92cb9ef0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1704 microversion: 2.1 time: 0.156440 Aug 04 15:27:58.784669 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3674/7340] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:58 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1704 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:27:59.806311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-13ebd298-fb09-4c8b-8467-b1a61a6cea1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:27:59.807004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-13ebd298-fb09-4c8b-8467-b1a61a6cea1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:27:59.814504 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13ebd298-fb09-4c8b-8467-b1a61a6cea1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:59.814960 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13ebd298-fb09-4c8b-8467-b1a61a6cea1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:59.815737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13ebd298-fb09-4c8b-8467-b1a61a6cea1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:27:59.816177 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-13ebd298-fb09-4c8b-8467-b1a61a6cea1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:27:59.957256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-13ebd298-fb09-4c8b-8467-b1a61a6cea1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:27:59.965796 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-13ebd298-fb09-4c8b-8467-b1a61a6cea1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1704 microversion: 2.1 time: 0.163401 Aug 04 15:27:59.966373 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3667/7341] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:27:59 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1704 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:00.893169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-194caada-7394-446e-9767-bcc326ad0c17 req-011fa6d1-1326-4261-a8ad-2d9fb7117acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea", "name": "network-vif-plugged", "status": "completed", "tag": "2f701fbf-5a51-4900-893c-c79c2e8c0583"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:28:00.903647 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-194caada-7394-446e-9767-bcc326ad0c17 req-011fa6d1-1326-4261-a8ad-2d9fb7117acb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:00.904216 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-194caada-7394-446e-9767-bcc326ad0c17 req-011fa6d1-1326-4261-a8ad-2d9fb7117acb service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:00.916026 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-194caada-7394-446e-9767-bcc326ad0c17 req-011fa6d1-1326-4261-a8ad-2d9fb7117acb service nova] Creating event network-vif-plugged:2f701fbf-5a51-4900-893c-c79c2e8c0583 for instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea on n-h2-844627-10 Aug 04 15:28:00.923299 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-194caada-7394-446e-9767-bcc326ad0c17 req-011fa6d1-1326-4261-a8ad-2d9fb7117acb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126048 Aug 04 15:28:00.924731 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3675/7342] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:28:00.986679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-156dae0f-0b7c-4c83-9f36-b2df5731e70a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:00.987312 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-156dae0f-0b7c-4c83-9f36-b2df5731e70a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:00.994761 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156dae0f-0b7c-4c83-9f36-b2df5731e70a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:00.995261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156dae0f-0b7c-4c83-9f36-b2df5731e70a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:00.996111 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156dae0f-0b7c-4c83-9f36-b2df5731e70a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:00.996573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-156dae0f-0b7c-4c83-9f36-b2df5731e70a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:01.147368 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-156dae0f-0b7c-4c83-9f36-b2df5731e70a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:01.159217 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-156dae0f-0b7c-4c83-9f36-b2df5731e70a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1699 microversion: 2.1 time: 0.176228 Aug 04 15:28:01.160193 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3668/7343] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:00 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1699 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:02.188568 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a2e50911-ae39-4de8-b5aa-17d54227b4c6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:02.189311 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a2e50911-ae39-4de8-b5aa-17d54227b4c6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:02.196234 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2e50911-ae39-4de8-b5aa-17d54227b4c6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:02.196998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2e50911-ae39-4de8-b5aa-17d54227b4c6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:02.198172 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2e50911-ae39-4de8-b5aa-17d54227b4c6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:02.198629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a2e50911-ae39-4de8-b5aa-17d54227b4c6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:02.354730 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a2e50911-ae39-4de8-b5aa-17d54227b4c6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:02.362929 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a2e50911-ae39-4de8-b5aa-17d54227b4c6 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1699 microversion: 2.1 time: 0.183389 Aug 04 15:28:02.368932 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3676/7344] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:02 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1699 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:03.387552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3c273f48-a099-4dd6-9cbd-408318cb4782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:03.388180 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3c273f48-a099-4dd6-9cbd-408318cb4782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:03.395835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c273f48-a099-4dd6-9cbd-408318cb4782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:03.395835 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c273f48-a099-4dd6-9cbd-408318cb4782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:03.396588 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c273f48-a099-4dd6-9cbd-408318cb4782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:03.397067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3c273f48-a099-4dd6-9cbd-408318cb4782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:03.909168 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3c273f48-a099-4dd6-9cbd-408318cb4782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:03.920114 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3c273f48-a099-4dd6-9cbd-408318cb4782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1699 microversion: 2.1 time: 0.536512 Aug 04 15:28:03.930175 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3669/7345] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:03 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1699 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:04.944363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-09fd52b1-1807-409f-be4c-085b5ddc36fb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:04.945055 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-09fd52b1-1807-409f-be4c-085b5ddc36fb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:04.953424 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09fd52b1-1807-409f-be4c-085b5ddc36fb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:04.955045 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09fd52b1-1807-409f-be4c-085b5ddc36fb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:04.957506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09fd52b1-1807-409f-be4c-085b5ddc36fb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:04.958052 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-09fd52b1-1807-409f-be4c-085b5ddc36fb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:05.106870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-09fd52b1-1807-409f-be4c-085b5ddc36fb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:05.116319 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-09fd52b1-1807-409f-be4c-085b5ddc36fb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1699 microversion: 2.1 time: 0.175822 Aug 04 15:28:05.129709 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3677/7346] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:04 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1699 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:06.139921 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-20e39a24-4545-405a-915f-bba293bca4d2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:06.151754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-20e39a24-4545-405a-915f-bba293bca4d2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:06.167427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e39a24-4545-405a-915f-bba293bca4d2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:06.168245 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e39a24-4545-405a-915f-bba293bca4d2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:06.169307 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e39a24-4545-405a-915f-bba293bca4d2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:06.170775 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-20e39a24-4545-405a-915f-bba293bca4d2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:06.336128 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-20e39a24-4545-405a-915f-bba293bca4d2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:06.346003 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-20e39a24-4545-405a-915f-bba293bca4d2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1699 microversion: 2.1 time: 0.209964 Aug 04 15:28:06.352981 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3670/7347] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:06 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1699 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:07.367839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d558403-d5be-498c-91b3-bb0e50891298 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:07.368562 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d558403-d5be-498c-91b3-bb0e50891298 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:07.380344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d558403-d5be-498c-91b3-bb0e50891298 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:07.380812 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d558403-d5be-498c-91b3-bb0e50891298 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:07.381807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d558403-d5be-498c-91b3-bb0e50891298 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:07.382267 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d558403-d5be-498c-91b3-bb0e50891298 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:07.555589 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d558403-d5be-498c-91b3-bb0e50891298 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:07.567112 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d558403-d5be-498c-91b3-bb0e50891298 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1699 microversion: 2.1 time: 0.202896 Aug 04 15:28:07.582915 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3678/7348] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:07 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1699 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:08.593224 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5b63948e-0c04-41d7-a7a8-cddb63f59f35 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:08.594237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5b63948e-0c04-41d7-a7a8-cddb63f59f35 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:08.604565 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b63948e-0c04-41d7-a7a8-cddb63f59f35 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:08.605316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b63948e-0c04-41d7-a7a8-cddb63f59f35 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:08.606543 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b63948e-0c04-41d7-a7a8-cddb63f59f35 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:08.607261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5b63948e-0c04-41d7-a7a8-cddb63f59f35 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:08.779845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5b63948e-0c04-41d7-a7a8-cddb63f59f35 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:08.789062 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5b63948e-0c04-41d7-a7a8-cddb63f59f35 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1699 microversion: 2.1 time: 0.202358 Aug 04 15:28:08.789968 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3671/7349] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:08 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1699 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:09.809508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9a6cf51d-db3d-4679-9c1b-9dbb4a8f2db7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:09.810148 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9a6cf51d-db3d-4679-9c1b-9dbb4a8f2db7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:09.817317 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a6cf51d-db3d-4679-9c1b-9dbb4a8f2db7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:09.817772 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a6cf51d-db3d-4679-9c1b-9dbb4a8f2db7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:09.818572 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a6cf51d-db3d-4679-9c1b-9dbb4a8f2db7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:09.819016 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a6cf51d-db3d-4679-9c1b-9dbb4a8f2db7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:09.964331 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9a6cf51d-db3d-4679-9c1b-9dbb4a8f2db7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:09.972838 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9a6cf51d-db3d-4679-9c1b-9dbb4a8f2db7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1699 microversion: 2.1 time: 0.167227 Aug 04 15:28:09.973490 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3679/7350] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:09 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1699 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:11.002503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-528a4728-23ce-48e7-a684-2c2a8c34bf2b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:11.003130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-528a4728-23ce-48e7-a684-2c2a8c34bf2b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:11.009321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-528a4728-23ce-48e7-a684-2c2a8c34bf2b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:11.009785 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-528a4728-23ce-48e7-a684-2c2a8c34bf2b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:11.010559 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-528a4728-23ce-48e7-a684-2c2a8c34bf2b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:11.011006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-528a4728-23ce-48e7-a684-2c2a8c34bf2b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:11.156248 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-528a4728-23ce-48e7-a684-2c2a8c34bf2b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:11.165961 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-528a4728-23ce-48e7-a684-2c2a8c34bf2b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1681 microversion: 2.1 time: 0.168192 Aug 04 15:28:11.166538 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3672/7351] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:10 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:12.189240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ad8ae10e-f58c-40b7-9c82-c2b1099bdeab tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:12.189867 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ad8ae10e-f58c-40b7-9c82-c2b1099bdeab tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:12.196937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad8ae10e-f58c-40b7-9c82-c2b1099bdeab tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:12.197395 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad8ae10e-f58c-40b7-9c82-c2b1099bdeab tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:12.198162 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad8ae10e-f58c-40b7-9c82-c2b1099bdeab tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:12.198597 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ad8ae10e-f58c-40b7-9c82-c2b1099bdeab tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:12.339973 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ad8ae10e-f58c-40b7-9c82-c2b1099bdeab tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:12.348190 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ad8ae10e-f58c-40b7-9c82-c2b1099bdeab tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1684 microversion: 2.1 time: 0.164307 Aug 04 15:28:12.348764 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3680/7352] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:12 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:12.368431 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8146d69e-d773-4ca6-bf7a-58235d35be00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:28:12.369151 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8146d69e-d773-4ca6-bf7a-58235d35be00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:12.375978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8146d69e-d773-4ca6-bf7a-58235d35be00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:12.376436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8146d69e-d773-4ca6-bf7a-58235d35be00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:12.377235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8146d69e-d773-4ca6-bf7a-58235d35be00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:12.377679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8146d69e-d773-4ca6-bf7a-58235d35be00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:12.483316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8146d69e-d773-4ca6-bf7a-58235d35be00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130961) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 15:28:12.549821 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8146d69e-d773-4ca6-bf7a-58235d35be00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "POST /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea/action" status: 202 len: 0 microversion: 2.1 time: 0.185166 Aug 04 15:28:12.553484 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3673/7353] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:28:12 2022] POST /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 15:28:12.558583 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1d78e178-5f95-45af-a790-7483c2468b57 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:12.559219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1d78e178-5f95-45af-a790-7483c2468b57 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:12.566007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d78e178-5f95-45af-a790-7483c2468b57 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:12.566476 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d78e178-5f95-45af-a790-7483c2468b57 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:12.567247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d78e178-5f95-45af-a790-7483c2468b57 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:12.567690 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1d78e178-5f95-45af-a790-7483c2468b57 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:12.706938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1d78e178-5f95-45af-a790-7483c2468b57 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:12.714799 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1d78e178-5f95-45af-a790-7483c2468b57 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1632 microversion: 2.1 time: 0.160182 Aug 04 15:28:12.715371 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3681/7354] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:12 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1632 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:13.736522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2248b863-ed04-4c62-9c5d-ef212d238981 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:13.737179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2248b863-ed04-4c62-9c5d-ef212d238981 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:13.743445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2248b863-ed04-4c62-9c5d-ef212d238981 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:13.743910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2248b863-ed04-4c62-9c5d-ef212d238981 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:13.744684 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2248b863-ed04-4c62-9c5d-ef212d238981 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:13.745179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2248b863-ed04-4c62-9c5d-ef212d238981 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:13.944930 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2248b863-ed04-4c62-9c5d-ef212d238981 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:13.953741 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2248b863-ed04-4c62-9c5d-ef212d238981 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.221942 Aug 04 15:28:13.954322 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3674/7355] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:13 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:28:14.906427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-0b327aa9-1600-4aa0-8ff8-e25c681b0a40 req-f90396b1-7376-4374-b493-2ab643f87518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea", "name": "network-vif-unplugged", "status": "completed", "tag": "2f701fbf-5a51-4900-893c-c79c2e8c0583"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:28:14.924169 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0b327aa9-1600-4aa0-8ff8-e25c681b0a40 req-f90396b1-7376-4374-b493-2ab643f87518 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:14.925132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-0b327aa9-1600-4aa0-8ff8-e25c681b0a40 req-f90396b1-7376-4374-b493-2ab643f87518 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:14.942297 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-0b327aa9-1600-4aa0-8ff8-e25c681b0a40 req-f90396b1-7376-4374-b493-2ab643f87518 service nova] Creating event network-vif-unplugged:2f701fbf-5a51-4900-893c-c79c2e8c0583 for instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea on n-h2-844627-10 Aug 04 15:28:14.948510 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-0b327aa9-1600-4aa0-8ff8-e25c681b0a40 req-f90396b1-7376-4374-b493-2ab643f87518 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054496 Aug 04 15:28:14.949718 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3682/7356] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:28:14.977597 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1e73ea75-e0dd-49b5-80bc-4651ae741d99 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:14.979043 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1e73ea75-e0dd-49b5-80bc-4651ae741d99 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:14.987959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e73ea75-e0dd-49b5-80bc-4651ae741d99 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:14.989099 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e73ea75-e0dd-49b5-80bc-4651ae741d99 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:14.990274 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e73ea75-e0dd-49b5-80bc-4651ae741d99 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:14.991017 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1e73ea75-e0dd-49b5-80bc-4651ae741d99 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:15.172799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-1e73ea75-e0dd-49b5-80bc-4651ae741d99 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:15.181111 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1e73ea75-e0dd-49b5-80bc-4651ae741d99 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.207353 Aug 04 15:28:15.182562 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3675/7357] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:14 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:16.204312 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-75482fba-e6a6-47d0-8c39-f3a31f973f2e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:16.205346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-75482fba-e6a6-47d0-8c39-f3a31f973f2e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:16.213728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75482fba-e6a6-47d0-8c39-f3a31f973f2e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:16.214187 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75482fba-e6a6-47d0-8c39-f3a31f973f2e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:16.215121 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75482fba-e6a6-47d0-8c39-f3a31f973f2e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:16.216609 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-75482fba-e6a6-47d0-8c39-f3a31f973f2e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:16.364745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-75482fba-e6a6-47d0-8c39-f3a31f973f2e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:16.372983 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-75482fba-e6a6-47d0-8c39-f3a31f973f2e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.172959 Aug 04 15:28:16.373952 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3683/7358] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:16 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:17.396847 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6a992b9b-3bd6-4df5-97e4-374e158b3440 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:17.397804 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6a992b9b-3bd6-4df5-97e4-374e158b3440 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:17.405346 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a992b9b-3bd6-4df5-97e4-374e158b3440 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:17.405831 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a992b9b-3bd6-4df5-97e4-374e158b3440 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:17.406717 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a992b9b-3bd6-4df5-97e4-374e158b3440 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:17.407174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6a992b9b-3bd6-4df5-97e4-374e158b3440 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:17.548856 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6a992b9b-3bd6-4df5-97e4-374e158b3440 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:17.557639 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6a992b9b-3bd6-4df5-97e4-374e158b3440 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.165621 Aug 04 15:28:17.558233 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3676/7359] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:17 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:18.579122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8651b8a2-e78a-46bc-ac72-ac2d00c93c66 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:18.579731 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8651b8a2-e78a-46bc-ac72-ac2d00c93c66 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:18.582575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=31 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:28:18.588500 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8651b8a2-e78a-46bc-ac72-ac2d00c93c66 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:18.588978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8651b8a2-e78a-46bc-ac72-ac2d00c93c66 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:18.590040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8651b8a2-e78a-46bc-ac72-ac2d00c93c66 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:18.590203 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8651b8a2-e78a-46bc-ac72-ac2d00c93c66 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:18.594448 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:28:18.746792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8651b8a2-e78a-46bc-ac72-ac2d00c93c66 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:18.754448 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8651b8a2-e78a-46bc-ac72-ac2d00c93c66 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.179404 Aug 04 15:28:18.755179 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3684/7360] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:18 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:19.777750 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-87455091-1b11-454e-9277-d328df22f290 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:19.779031 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-87455091-1b11-454e-9277-d328df22f290 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:19.780944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:28:19.786494 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87455091-1b11-454e-9277-d328df22f290 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:19.786956 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87455091-1b11-454e-9277-d328df22f290 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:19.787764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87455091-1b11-454e-9277-d328df22f290 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:19.788215 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-87455091-1b11-454e-9277-d328df22f290 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:19.791698 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:28:19.934883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-87455091-1b11-454e-9277-d328df22f290 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:19.942661 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-87455091-1b11-454e-9277-d328df22f290 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.169728 Aug 04 15:28:19.943321 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3677/7361] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:19 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:28:20.965796 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9d2d55e7-7eda-477b-905d-98131de54d94 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:20.966865 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9d2d55e7-7eda-477b-905d-98131de54d94 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:20.975274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d2d55e7-7eda-477b-905d-98131de54d94 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:20.976599 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d2d55e7-7eda-477b-905d-98131de54d94 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:20.977840 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d2d55e7-7eda-477b-905d-98131de54d94 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:20.978373 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9d2d55e7-7eda-477b-905d-98131de54d94 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:21.141627 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9d2d55e7-7eda-477b-905d-98131de54d94 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:21.151038 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9d2d55e7-7eda-477b-905d-98131de54d94 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.189836 Aug 04 15:28:21.164047 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3685/7362] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:20 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:22.175863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9923f362-8be9-412b-a29e-0f4734a65953 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:22.176812 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9923f362-8be9-412b-a29e-0f4734a65953 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:22.185468 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9923f362-8be9-412b-a29e-0f4734a65953 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:22.185932 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9923f362-8be9-412b-a29e-0f4734a65953 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:22.186758 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9923f362-8be9-412b-a29e-0f4734a65953 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:22.187206 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9923f362-8be9-412b-a29e-0f4734a65953 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:22.326311 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9923f362-8be9-412b-a29e-0f4734a65953 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:22.334796 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9923f362-8be9-412b-a29e-0f4734a65953 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.163100 Aug 04 15:28:22.335414 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3678/7363] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:22 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:23.358171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-3366cbcd-795c-40a1-8d7e-05684f4bb074 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:23.358795 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-3366cbcd-795c-40a1-8d7e-05684f4bb074 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:23.365551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3366cbcd-795c-40a1-8d7e-05684f4bb074 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:23.366013 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3366cbcd-795c-40a1-8d7e-05684f4bb074 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:23.367195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3366cbcd-795c-40a1-8d7e-05684f4bb074 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:23.367649 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-3366cbcd-795c-40a1-8d7e-05684f4bb074 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:23.516221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-3366cbcd-795c-40a1-8d7e-05684f4bb074 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:23.524221 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-3366cbcd-795c-40a1-8d7e-05684f4bb074 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.171258 Aug 04 15:28:23.524820 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3686/7364] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:23 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:24.003311 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:28:24.003933 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:28:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:28:24.546016 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-04b4b687-b23b-452a-a842-843c654d294c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:24.546655 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-04b4b687-b23b-452a-a842-843c654d294c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:24.553521 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04b4b687-b23b-452a-a842-843c654d294c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:24.553994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04b4b687-b23b-452a-a842-843c654d294c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:24.554813 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04b4b687-b23b-452a-a842-843c654d294c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:24.555266 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-04b4b687-b23b-452a-a842-843c654d294c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:24.703296 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-04b4b687-b23b-452a-a842-843c654d294c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:24.711349 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-04b4b687-b23b-452a-a842-843c654d294c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1690 microversion: 2.1 time: 0.169356 Aug 04 15:28:24.712292 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3679/7365] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:24 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:25.734953 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ac8aa0bb-120e-4a7f-b514-56be391a458c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:28:25.735582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ac8aa0bb-120e-4a7f-b514-56be391a458c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:28:25.743021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac8aa0bb-120e-4a7f-b514-56be391a458c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:25.743510 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac8aa0bb-120e-4a7f-b514-56be391a458c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:25.744291 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac8aa0bb-120e-4a7f-b514-56be391a458c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:25.744739 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ac8aa0bb-120e-4a7f-b514-56be391a458c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:25.892257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ac8aa0bb-120e-4a7f-b514-56be391a458c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:28:25.899968 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ac8aa0bb-120e-4a7f-b514-56be391a458c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1677 microversion: 2.1 time: 0.169007 Aug 04 15:28:25.900554 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3687/7366] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:28:25 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:28:26.928697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-24bf8cae-8251-45eb-8d8b-9f0d23b1aab0 req-02a82710-f7ef-49f5-892c-6d7f437c6bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea", "name": "network-vif-plugged", "status": "completed", "tag": "2f701fbf-5a51-4900-893c-c79c2e8c0583"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:28:26.940570 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-24bf8cae-8251-45eb-8d8b-9f0d23b1aab0 req-02a82710-f7ef-49f5-892c-6d7f437c6bd2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:28:26.941062 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-24bf8cae-8251-45eb-8d8b-9f0d23b1aab0 req-02a82710-f7ef-49f5-892c-6d7f437c6bd2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:28:26.955427 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-24bf8cae-8251-45eb-8d8b-9f0d23b1aab0 req-02a82710-f7ef-49f5-892c-6d7f437c6bd2 service nova] Creating event network-vif-plugged:2f701fbf-5a51-4900-893c-c79c2e8c0583 for instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea on n-h2-844627-10 Aug 04 15:28:26.963131 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-24bf8cae-8251-45eb-8d8b-9f0d23b1aab0 req-02a82710-f7ef-49f5-892c-6d7f437c6bd2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040590 Aug 04 15:28:26.964238 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3680/7367] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:29:39.018369 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=7 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:29:39.019983 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=23 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:29:39.025012 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-603d7a08-163e-4bcf-a362-d8414489b8e3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:29:39.025212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=7 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:29:39.025658 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-603d7a08-163e-4bcf-a362-d8414489b8e3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:29:39.026273 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=19 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:29:39.031300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-198a45e2-e2bc-42cd-98a4-136e8e76cff5 req-5a43b145-022e-423b-9a57-f17cc43d8bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea", "tag": "2f701fbf-5a51-4900-893c-c79c2e8c0583"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:29:39.033932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-603d7a08-163e-4bcf-a362-d8414489b8e3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:39.034408 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-603d7a08-163e-4bcf-a362-d8414489b8e3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:39.035394 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-603d7a08-163e-4bcf-a362-d8414489b8e3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:39.035829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-603d7a08-163e-4bcf-a362-d8414489b8e3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:39.043087 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-198a45e2-e2bc-42cd-98a4-136e8e76cff5 req-5a43b145-022e-423b-9a57-f17cc43d8bfe service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:39.043657 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-198a45e2-e2bc-42cd-98a4-136e8e76cff5 req-5a43b145-022e-423b-9a57-f17cc43d8bfe service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:39.055504 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-198a45e2-e2bc-42cd-98a4-136e8e76cff5 req-5a43b145-022e-423b-9a57-f17cc43d8bfe service nova] Creating event network-changed:2f701fbf-5a51-4900-893c-c79c2e8c0583 for instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea on n-h2-844627-10 Aug 04 15:29:39.061403 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-198a45e2-e2bc-42cd-98a4-136e8e76cff5 req-5a43b145-022e-423b-9a57-f17cc43d8bfe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039932 Aug 04 15:29:39.062368 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3681/7368] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:29:39.063304 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-603d7a08-163e-4bcf-a362-d8414489b8e3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:29:39.170219 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-603d7a08-163e-4bcf-a362-d8414489b8e3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 204 len: 0 microversion: 2.1 time: 0.152951 Aug 04 15:29:39.171414 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3688/7369] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:29:39 2022] DELETE /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:29:39.181920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b227a47c-0122-48b9-a19d-a8e78481b98f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:29:39.182647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b227a47c-0122-48b9-a19d-a8e78481b98f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:29:39.194341 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b227a47c-0122-48b9-a19d-a8e78481b98f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:39.195008 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b227a47c-0122-48b9-a19d-a8e78481b98f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:39.196519 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b227a47c-0122-48b9-a19d-a8e78481b98f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:39.197974 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b227a47c-0122-48b9-a19d-a8e78481b98f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:39.352154 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b227a47c-0122-48b9-a19d-a8e78481b98f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:29:39.360914 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b227a47c-0122-48b9-a19d-a8e78481b98f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.183966 Aug 04 15:29:39.361506 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3682/7370] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:29:39 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:29:40.384833 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bf8658b1-57e3-4f15-bf42-eb706e4c6a31 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:29:40.385590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bf8658b1-57e3-4f15-bf42-eb706e4c6a31 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:29:40.393228 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf8658b1-57e3-4f15-bf42-eb706e4c6a31 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:40.393684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf8658b1-57e3-4f15-bf42-eb706e4c6a31 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:40.394479 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf8658b1-57e3-4f15-bf42-eb706e4c6a31 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:40.394923 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bf8658b1-57e3-4f15-bf42-eb706e4c6a31 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:40.685329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bf8658b1-57e3-4f15-bf42-eb706e4c6a31 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:29:40.693092 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bf8658b1-57e3-4f15-bf42-eb706e4c6a31 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1683 microversion: 2.1 time: 0.313411 Aug 04 15:29:40.693684 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3689/7371] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:29:40 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1683 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:29:41.362258 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-798f2d60-ba30-4d47-95cf-6df1f214430f req-6192bdf9-128a-4463-8759-025f11811ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea", "name": "network-vif-deleted", "tag": "2f701fbf-5a51-4900-893c-c79c2e8c0583"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:29:41.372079 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-798f2d60-ba30-4d47-95cf-6df1f214430f req-6192bdf9-128a-4463-8759-025f11811ec7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:41.372542 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-798f2d60-ba30-4d47-95cf-6df1f214430f req-6192bdf9-128a-4463-8759-025f11811ec7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:41.385112 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-798f2d60-ba30-4d47-95cf-6df1f214430f req-6192bdf9-128a-4463-8759-025f11811ec7 service nova] Creating event network-vif-deleted:2f701fbf-5a51-4900-893c-c79c2e8c0583 for instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea on n-h2-844627-10 Aug 04 15:29:41.390094 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-798f2d60-ba30-4d47-95cf-6df1f214430f req-6192bdf9-128a-4463-8759-025f11811ec7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099232 Aug 04 15:29:41.390701 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3683/7372] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:29:41.717136 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:29:41.717859 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:29:41.725673 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:41.726245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:41.727007 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:41.727544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:41.763963 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:41.764420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:41.764908 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lazy-loading 'fault' on Instance uuid 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:29:41.813586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:29:41.820795 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1534874e-6e8c-425c-ae2c-5e4515e94344 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 200 len: 1337 microversion: 2.1 time: 0.108302 Aug 04 15:29:41.821430 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3690/7373] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:29:41 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 1337 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:29:42.844899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:29:42.845627 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:29:42.851965 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:42.852441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:42.853914 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:42.854369 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:42.867932 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] HTTP exception thrown: Instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea could not be found. Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Request method failure captured: Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea HTTP/1.1 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-Ts2QGZSiJXBxbAsemA2ZIZ5vXgRij3MfWM8620q4f418YEYYmysWLRphqhxSw97fsUHtyaAtdbQIg6bZK_b9MYqLtbkC6Bo23IRwr00ngeGLO0CwDBcmBjCeNl-dwdMw3-Iph04UbNY6zaWU-JeUBfW-25PdUWLqHxoKlrBA9ODPM Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c1083843dc73426bbc2179924015b9a4 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestShelveInstance-260921611 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1083843dc73426bbc2179924015b9a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c1083843dc73426bbc2179924015b9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c1083843dc73426bbc2179924015b9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1083843dc73426bbc2179924015b9a4"}]}] Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestShelveInstance-260921611 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c1083843dc73426bbc2179924015b9a4 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestShelveInstance-260921611 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestShelveInstance-260921611-project Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 46d19252493843eda0044da0f9a59c23 Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestShelveInstance-260921611-project Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea could not be found. Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea'} Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea could not be found. Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea could not be found. Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:29:42.869691 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea could not be found. Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Returning 404 to user: Instance 8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-55bb8ccc-4584-4557-95ce-f775c693a79b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea" status: 404 len: 111 microversion: 2.1 time: 0.031407 Aug 04 15:29:42.874263 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3684/7374] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:29:42 2022] GET /compute/v2.1/servers/8f750da1-3697-4e2a-b0fb-ba6a7e5b49ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:29:43.035928 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-26d60755-8101-4a66-bfa4-cd24f7f420a2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '.version_select at 0x7f46f3ba7a60>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:29:43.057644 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-26d60755-8101-4a66-bfa4-cd24f7f420a2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1513623217" status: 202 len: 0 microversion: 2.1 time: 0.025641 Aug 04 15:29:43.058449 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3691/7375] 10.222.0.66 () {58 vars in 1254 bytes} [Thu Aug 4 15:29:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1513623217 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:29:43.080486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cbb86a00-50ed-4fae-a370-8002870fd4c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Action: 'create', calling method: .version_select at 0x7f46f0583c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1961004635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGY0M52H2uZITKRDuaNDzQHbYYK5NnnYgXXtJoSB/9DL93Fv4cULe7Y9Q2p2AYhtHEcNdUSBRiu8mxDEkKJf2UJCN36F2FoPX5sVERvVSOCpD6u1NowGXA9wCqI9/ONJPg=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:29:43.096841 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cbb86a00-50ed-4fae-a370-8002870fd4c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Getting quotas for project c1083843dc73426bbc2179924015b9a4. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:29:43.103412 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-cbb86a00-50ed-4fae-a370-8002870fd4c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Getting quotas for user 46d19252493843eda0044da0f9a59c23 and project c1083843dc73426bbc2179924015b9a4. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:29:43.131538 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cbb86a00-50ed-4fae-a370-8002870fd4c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.055217 Aug 04 15:29:43.132111 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3685/7376] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:29:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:29:59.359378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:29:59.360329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:29:59.368571 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-429554148", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1961004635", "security_groups": [{"name": "tempest-secgroup-smoke-1091658063"}], "networks": [{"uuid": "93c7a058-5582-4104-abaa-b537efe24495"}], "block_device_mapping_v2": [{"uuid": "8a67c648-ee20-44dc-8efd-3971665300a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:29:59.485468 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] validate_networks() for [('93c7a058-5582-4104-abaa-b537efe24495', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:29:59.902574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:29:59.903026 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:29:59.903551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:29:59.903959 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:29:59.904372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:29:59.913264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:59.913659 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:59.914461 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:29:59.914901 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:29:59.932114 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Getting quotas for project c1083843dc73426bbc2179924015b9a4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:29:59.937326 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Getting quotas for user 46d19252493843eda0044da0f9a59c23 and project c1083843dc73426bbc2179924015b9a4. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:29:59.997493 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:29:59.999591 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a67c648-ee20-44dc-8efd-3971665300a2',volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:30:00.127485 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62b62a8f-4fc4-4ccd-ad1f-a871bee9fab5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769831 Aug 04 15:30:00.128163 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3692/7377] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:29:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:30:00.138035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:30:00.139239 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=4 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:30:00.140133 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:30:00.144741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-cdd11b39-aecc-4a07-8df6-fbdc05f12548 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:00.145414 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-cdd11b39-aecc-4a07-8df6-fbdc05f12548 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:00.206834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-cdd11b39-aecc-4a07-8df6-fbdc05f12548 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:00.213685 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-cdd11b39-aecc-4a07-8df6-fbdc05f12548 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1088 microversion: 2.1 time: 0.077910 Aug 04 15:30:00.214806 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3686/7378] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:00 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:01.235263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-bd18331f-0512-4cfa-8030-2fe45d9ebf55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:01.235856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-bd18331f-0512-4cfa-8030-2fe45d9ebf55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:01.243443 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd18331f-0512-4cfa-8030-2fe45d9ebf55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:01.243892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd18331f-0512-4cfa-8030-2fe45d9ebf55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:01.244950 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd18331f-0512-4cfa-8030-2fe45d9ebf55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:01.245391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-bd18331f-0512-4cfa-8030-2fe45d9ebf55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:01.315066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-bd18331f-0512-4cfa-8030-2fe45d9ebf55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:01.324148 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-bd18331f-0512-4cfa-8030-2fe45d9ebf55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1204 microversion: 2.1 time: 0.092512 Aug 04 15:30:01.324965 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3693/7379] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:01 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:02.346918 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-b482d5b7-fb99-41e6-8cb6-72a2b6b5e7c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:02.347863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-b482d5b7-fb99-41e6-8cb6-72a2b6b5e7c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:02.367159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b482d5b7-fb99-41e6-8cb6-72a2b6b5e7c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:02.368236 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b482d5b7-fb99-41e6-8cb6-72a2b6b5e7c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:02.370978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b482d5b7-fb99-41e6-8cb6-72a2b6b5e7c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:02.371869 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-b482d5b7-fb99-41e6-8cb6-72a2b6b5e7c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:02.530596 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-b482d5b7-fb99-41e6-8cb6-72a2b6b5e7c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:02.542017 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-b482d5b7-fb99-41e6-8cb6-72a2b6b5e7c9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1272 microversion: 2.1 time: 0.197810 Aug 04 15:30:02.542711 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3687/7380] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:02 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:30:02.914569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-d5bcd78d-d21d-4085-8231-9612f21bad03 req-b952f4fe-ce04-4f97-a637-973c7c3a9f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4159f7-69d4-48f8-89a9-5fb21e734a61", "tag": "0965c909-841d-45ee-a09a-d959ec4765b5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:30:02.927544 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d5bcd78d-d21d-4085-8231-9612f21bad03 req-b952f4fe-ce04-4f97-a637-973c7c3a9f80 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:02.928164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-d5bcd78d-d21d-4085-8231-9612f21bad03 req-b952f4fe-ce04-4f97-a637-973c7c3a9f80 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:02.941033 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-d5bcd78d-d21d-4085-8231-9612f21bad03 req-b952f4fe-ce04-4f97-a637-973c7c3a9f80 service nova] Creating event network-changed:0965c909-841d-45ee-a09a-d959ec4765b5 for instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 on n-h2-844627-10 Aug 04 15:30:02.947470 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-d5bcd78d-d21d-4085-8231-9612f21bad03 req-b952f4fe-ce04-4f97-a637-973c7c3a9f80 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041852 Aug 04 15:30:02.948331 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3694/7381] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:30:03.561400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a442942f-abc0-4a63-bfc4-58e57c5e5bff tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:03.562668 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a442942f-abc0-4a63-bfc4-58e57c5e5bff tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:03.570260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a442942f-abc0-4a63-bfc4-58e57c5e5bff tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:03.570883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a442942f-abc0-4a63-bfc4-58e57c5e5bff tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:03.571673 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a442942f-abc0-4a63-bfc4-58e57c5e5bff tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:03.572125 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a442942f-abc0-4a63-bfc4-58e57c5e5bff tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:03.719450 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a442942f-abc0-4a63-bfc4-58e57c5e5bff tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:03.730319 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a442942f-abc0-4a63-bfc4-58e57c5e5bff tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1272 microversion: 2.1 time: 0.172722 Aug 04 15:30:03.743949 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3688/7382] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:03 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:04.752625 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-62bc66c2-1993-412d-8191-76e8b2a8f884 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:04.753831 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-62bc66c2-1993-412d-8191-76e8b2a8f884 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:04.762221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62bc66c2-1993-412d-8191-76e8b2a8f884 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:04.762685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62bc66c2-1993-412d-8191-76e8b2a8f884 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:04.763467 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62bc66c2-1993-412d-8191-76e8b2a8f884 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:04.763909 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-62bc66c2-1993-412d-8191-76e8b2a8f884 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:04.903850 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-62bc66c2-1993-412d-8191-76e8b2a8f884 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:04.911800 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-62bc66c2-1993-412d-8191-76e8b2a8f884 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1272 microversion: 2.1 time: 0.164136 Aug 04 15:30:04.912376 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3695/7383] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:04 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:05.933547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-24d17d14-ea4a-4d63-9c14-c9d7ade3079c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:05.934213 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-24d17d14-ea4a-4d63-9c14-c9d7ade3079c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:05.941647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24d17d14-ea4a-4d63-9c14-c9d7ade3079c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:05.942112 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24d17d14-ea4a-4d63-9c14-c9d7ade3079c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:05.943035 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24d17d14-ea4a-4d63-9c14-c9d7ade3079c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:05.943467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-24d17d14-ea4a-4d63-9c14-c9d7ade3079c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:06.360949 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-24d17d14-ea4a-4d63-9c14-c9d7ade3079c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:06.369287 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-24d17d14-ea4a-4d63-9c14-c9d7ade3079c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1272 microversion: 2.1 time: 0.440228 Aug 04 15:30:06.369864 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3689/7384] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:05 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1272 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:07.390115 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-87918a32-0f7c-4959-9a1e-c30ff5359250 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:07.390729 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-87918a32-0f7c-4959-9a1e-c30ff5359250 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:07.398313 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87918a32-0f7c-4959-9a1e-c30ff5359250 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:07.398768 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87918a32-0f7c-4959-9a1e-c30ff5359250 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:07.399538 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87918a32-0f7c-4959-9a1e-c30ff5359250 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:07.399982 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-87918a32-0f7c-4959-9a1e-c30ff5359250 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:07.534217 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-87918a32-0f7c-4959-9a1e-c30ff5359250 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:07.541875 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-87918a32-0f7c-4959-9a1e-c30ff5359250 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.155706 Aug 04 15:30:07.542458 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3696/7385] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:07 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:08.562823 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f99ea530-aa8d-40ad-abb6-1cb58cd13b92 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:08.563461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f99ea530-aa8d-40ad-abb6-1cb58cd13b92 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:08.570923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f99ea530-aa8d-40ad-abb6-1cb58cd13b92 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:08.571393 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f99ea530-aa8d-40ad-abb6-1cb58cd13b92 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:08.572179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f99ea530-aa8d-40ad-abb6-1cb58cd13b92 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:08.572634 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f99ea530-aa8d-40ad-abb6-1cb58cd13b92 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:08.702672 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f99ea530-aa8d-40ad-abb6-1cb58cd13b92 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:08.711367 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f99ea530-aa8d-40ad-abb6-1cb58cd13b92 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.152282 Aug 04 15:30:08.711971 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3690/7386] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:08 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:09.732247 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b442fd3f-1156-481c-9873-12a1bf91fa00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:09.732836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b442fd3f-1156-481c-9873-12a1bf91fa00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:09.739714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b442fd3f-1156-481c-9873-12a1bf91fa00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:09.740159 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b442fd3f-1156-481c-9873-12a1bf91fa00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:09.741440 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b442fd3f-1156-481c-9873-12a1bf91fa00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:09.741879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b442fd3f-1156-481c-9873-12a1bf91fa00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:09.877181 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b442fd3f-1156-481c-9873-12a1bf91fa00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:09.885466 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b442fd3f-1156-481c-9873-12a1bf91fa00 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.157130 Aug 04 15:30:09.886036 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3697/7387] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:09 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:10.906093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-180f4c5a-d62c-469f-895c-a2de7d21f5b9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:10.906728 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-180f4c5a-d62c-469f-895c-a2de7d21f5b9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:10.909602 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:30:10.915606 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-180f4c5a-d62c-469f-895c-a2de7d21f5b9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:10.916080 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-180f4c5a-d62c-469f-895c-a2de7d21f5b9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:10.916887 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-180f4c5a-d62c-469f-895c-a2de7d21f5b9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:10.917339 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-180f4c5a-d62c-469f-895c-a2de7d21f5b9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:11.047479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-180f4c5a-d62c-469f-895c-a2de7d21f5b9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:11.055686 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-180f4c5a-d62c-469f-895c-a2de7d21f5b9 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.153488 Aug 04 15:30:11.056247 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3691/7388] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:10 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:12.076143 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9a245773-4c34-438b-8887-e665de56f5f4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:12.076745 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9a245773-4c34-438b-8887-e665de56f5f4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:12.078977 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:30:12.079640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:30:12.086491 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a245773-4c34-438b-8887-e665de56f5f4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:12.086938 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a245773-4c34-438b-8887-e665de56f5f4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:12.087699 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a245773-4c34-438b-8887-e665de56f5f4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:12.088134 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9a245773-4c34-438b-8887-e665de56f5f4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:12.223560 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9a245773-4c34-438b-8887-e665de56f5f4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:12.231285 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9a245773-4c34-438b-8887-e665de56f5f4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.158996 Aug 04 15:30:12.231875 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3698/7389] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:12 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:13.251920 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-4ff691aa-bdea-49cc-b162-7e8a151ea7c3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:13.252558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-4ff691aa-bdea-49cc-b162-7e8a151ea7c3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:13.259989 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ff691aa-bdea-49cc-b162-7e8a151ea7c3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:13.260459 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ff691aa-bdea-49cc-b162-7e8a151ea7c3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:13.261291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ff691aa-bdea-49cc-b162-7e8a151ea7c3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:13.261744 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-4ff691aa-bdea-49cc-b162-7e8a151ea7c3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:13.396652 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-4ff691aa-bdea-49cc-b162-7e8a151ea7c3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:13.404986 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-4ff691aa-bdea-49cc-b162-7e8a151ea7c3 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.156962 Aug 04 15:30:13.405546 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3692/7390] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:13 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:14.425204 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d0c5cf39-4cb2-4fd3-9fac-c8245954c213 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:14.425755 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d0c5cf39-4cb2-4fd3-9fac-c8245954c213 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:14.433158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0c5cf39-4cb2-4fd3-9fac-c8245954c213 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:14.433612 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0c5cf39-4cb2-4fd3-9fac-c8245954c213 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:14.434389 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0c5cf39-4cb2-4fd3-9fac-c8245954c213 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:14.434832 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d0c5cf39-4cb2-4fd3-9fac-c8245954c213 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:14.568220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d0c5cf39-4cb2-4fd3-9fac-c8245954c213 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:14.576962 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d0c5cf39-4cb2-4fd3-9fac-c8245954c213 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.155501 Aug 04 15:30:14.577553 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3699/7391] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:14 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:15.598076 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-9331a53d-0f05-4c9a-bde7-ddefc62351c5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:15.598716 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-9331a53d-0f05-4c9a-bde7-ddefc62351c5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:15.607615 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9331a53d-0f05-4c9a-bde7-ddefc62351c5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:15.608089 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9331a53d-0f05-4c9a-bde7-ddefc62351c5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:15.608901 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9331a53d-0f05-4c9a-bde7-ddefc62351c5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:15.609366 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-9331a53d-0f05-4c9a-bde7-ddefc62351c5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:15.746754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-9331a53d-0f05-4c9a-bde7-ddefc62351c5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:15.754794 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-9331a53d-0f05-4c9a-bde7-ddefc62351c5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.160539 Aug 04 15:30:15.755374 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3693/7392] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:15 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:16.775970 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-1a8567ee-1af2-463d-addf-ceca5fdeabed tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:16.776579 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-1a8567ee-1af2-463d-addf-ceca5fdeabed tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:16.783855 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a8567ee-1af2-463d-addf-ceca5fdeabed tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:16.784310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a8567ee-1af2-463d-addf-ceca5fdeabed tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:16.785139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a8567ee-1af2-463d-addf-ceca5fdeabed tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:16.785587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-1a8567ee-1af2-463d-addf-ceca5fdeabed tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:16.916321 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-1a8567ee-1af2-463d-addf-ceca5fdeabed tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:16.923862 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-1a8567ee-1af2-463d-addf-ceca5fdeabed tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.151849 Aug 04 15:30:16.924447 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3700/7393] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:16 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:30:17.405838 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-8360a820-2dcb-4290-ad51-ec59bd0f2203 req-4662102e-9c1d-4ad8-bc35-bc9750f4d651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4159f7-69d4-48f8-89a9-5fb21e734a61", "name": "network-vif-plugged", "status": "completed", "tag": "0965c909-841d-45ee-a09a-d959ec4765b5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:30:17.417309 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8360a820-2dcb-4290-ad51-ec59bd0f2203 req-4662102e-9c1d-4ad8-bc35-bc9750f4d651 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:17.417757 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-8360a820-2dcb-4290-ad51-ec59bd0f2203 req-4662102e-9c1d-4ad8-bc35-bc9750f4d651 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:17.429216 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-8360a820-2dcb-4290-ad51-ec59bd0f2203 req-4662102e-9c1d-4ad8-bc35-bc9750f4d651 service nova] Creating event network-vif-plugged:0965c909-841d-45ee-a09a-d959ec4765b5 for instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 on n-h2-844627-10 Aug 04 15:30:17.434227 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-8360a820-2dcb-4290-ad51-ec59bd0f2203 req-4662102e-9c1d-4ad8-bc35-bc9750f4d651 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032439 Aug 04 15:30:17.434842 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3694/7394] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:30:17.944712 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b8e9a60e-775f-4de5-a6fc-b0f99d08c246 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:17.945582 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b8e9a60e-775f-4de5-a6fc-b0f99d08c246 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:17.953037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8e9a60e-775f-4de5-a6fc-b0f99d08c246 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:17.953487 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8e9a60e-775f-4de5-a6fc-b0f99d08c246 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:17.954251 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8e9a60e-775f-4de5-a6fc-b0f99d08c246 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:17.954682 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b8e9a60e-775f-4de5-a6fc-b0f99d08c246 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:18.089198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b8e9a60e-775f-4de5-a6fc-b0f99d08c246 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:18.097171 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b8e9a60e-775f-4de5-a6fc-b0f99d08c246 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1260 microversion: 2.1 time: 0.156556 Aug 04 15:30:18.097853 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3701/7395] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:17 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:19.118926 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8ecf999e-54f0-41d8-a011-86838507b5c7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:19.119669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8ecf999e-54f0-41d8-a011-86838507b5c7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:19.126013 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ecf999e-54f0-41d8-a011-86838507b5c7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:19.126483 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ecf999e-54f0-41d8-a011-86838507b5c7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:19.127260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ecf999e-54f0-41d8-a011-86838507b5c7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:19.127719 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8ecf999e-54f0-41d8-a011-86838507b5c7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:19.258977 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8ecf999e-54f0-41d8-a011-86838507b5c7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:19.266561 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8ecf999e-54f0-41d8-a011-86838507b5c7 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1444 microversion: 2.1 time: 0.152781 Aug 04 15:30:19.267119 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3695/7396] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:19 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:19.287190 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-db950aa5-80a8-4dc7-bdaf-e9c0ca3e08d0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:30:19.287811 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-db950aa5-80a8-4dc7-bdaf-e9c0ca3e08d0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:30:19.294790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db950aa5-80a8-4dc7-bdaf-e9c0ca3e08d0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:19.295248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db950aa5-80a8-4dc7-bdaf-e9c0ca3e08d0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:19.296021 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db950aa5-80a8-4dc7-bdaf-e9c0ca3e08d0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:19.296465 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-db950aa5-80a8-4dc7-bdaf-e9c0ca3e08d0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:19.427839 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-db950aa5-80a8-4dc7-bdaf-e9c0ca3e08d0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:30:19.435967 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-db950aa5-80a8-4dc7-bdaf-e9c0ca3e08d0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1444 microversion: 2.1 time: 0.152646 Aug 04 15:30:19.436547 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3702/7397] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:30:19 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:30:21.072178 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f54f1f7c-4a22-4f8a-a04a-a124ec899f57 req-36f4ad6c-cd4b-4b1e-982c-501e666a3a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4159f7-69d4-48f8-89a9-5fb21e734a61", "tag": "0965c909-841d-45ee-a09a-d959ec4765b5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:30:21.082880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f54f1f7c-4a22-4f8a-a04a-a124ec899f57 req-36f4ad6c-cd4b-4b1e-982c-501e666a3a18 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:30:21.083326 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f54f1f7c-4a22-4f8a-a04a-a124ec899f57 req-36f4ad6c-cd4b-4b1e-982c-501e666a3a18 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:30:21.097136 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f54f1f7c-4a22-4f8a-a04a-a124ec899f57 req-36f4ad6c-cd4b-4b1e-982c-501e666a3a18 service nova] Creating event network-changed:0965c909-841d-45ee-a09a-d959ec4765b5 for instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 on n-h2-844627-10 Aug 04 15:30:21.102131 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f54f1f7c-4a22-4f8a-a04a-a124ec899f57 req-36f4ad6c-cd4b-4b1e-982c-501e666a3a18 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034222 Aug 04 15:30:21.102974 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3696/7398] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:32:18.646354 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04939028-e350-49aa-b822-266ad76b8ee3] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 15:32:18.647310 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [-] [91e014af-af63-4f98-b00e-ab5af5ef70e1] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 15:32:18.648116 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:32:18.648854 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=58 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:32:18.714298 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-83498512-0a62-43ab-a1ea-3110226188b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:32:18.714879 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-83498512-0a62-43ab-a1ea-3110226188b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:18.721176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83498512-0a62-43ab-a1ea-3110226188b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:18.721634 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83498512-0a62-43ab-a1ea-3110226188b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:18.722407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83498512-0a62-43ab-a1ea-3110226188b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:18.722849 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-83498512-0a62-43ab-a1ea-3110226188b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:18.747320 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-83498512-0a62-43ab-a1ea-3110226188b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lazy-loading 'flavor' on Instance uuid 0e4159f7-69d4-48f8-89a9-5fb21e734a61 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:32:18.821446 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-83498512-0a62-43ab-a1ea-3110226188b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "POST /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61/action" status: 202 len: 0 microversion: 2.1 time: 0.176764 Aug 04 15:32:18.822106 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3703/7399] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:32:18 2022] POST /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:32:18.828767 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:32:18.829577 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:32:18.830181 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=24 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:32:18.830934 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=52 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:32:18.835712 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-bab9fc42-e090-425a-9123-887bf4b0e113 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:18.836444 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-bab9fc42-e090-425a-9123-887bf4b0e113 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:18.843696 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bab9fc42-e090-425a-9123-887bf4b0e113 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:18.844291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bab9fc42-e090-425a-9123-887bf4b0e113 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:18.845110 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bab9fc42-e090-425a-9123-887bf4b0e113 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:18.845567 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-bab9fc42-e090-425a-9123-887bf4b0e113 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:18.986828 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-bab9fc42-e090-425a-9123-887bf4b0e113 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:18.994808 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-bab9fc42-e090-425a-9123-887bf4b0e113 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.168089 Aug 04 15:32:18.995368 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3697/7400] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:18 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:20.018506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-452c43f9-2a20-4fd7-806e-ed41da810e17 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:20.019214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-452c43f9-2a20-4fd7-806e-ed41da810e17 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:20.029100 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-452c43f9-2a20-4fd7-806e-ed41da810e17 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:20.029556 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-452c43f9-2a20-4fd7-806e-ed41da810e17 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:20.030367 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-452c43f9-2a20-4fd7-806e-ed41da810e17 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:20.030810 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-452c43f9-2a20-4fd7-806e-ed41da810e17 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:20.036083 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] [91e014af-af63-4f98-b00e-ab5af5ef70e1] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44010. Aug 04 15:32:20.039194 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] [04939028-e350-49aa-b822-266ad76b8ee3] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44008. Aug 04 15:32:20.173066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-452c43f9-2a20-4fd7-806e-ed41da810e17 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:20.182084 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-452c43f9-2a20-4fd7-806e-ed41da810e17 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.170172 Aug 04 15:32:20.182643 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3704/7401] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:20 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:21.202944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2c8f737a-c131-4008-bbac-4e9a964809b1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:21.203583 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2c8f737a-c131-4008-bbac-4e9a964809b1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:21.212560 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8f737a-c131-4008-bbac-4e9a964809b1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:21.213069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8f737a-c131-4008-bbac-4e9a964809b1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:21.213860 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8f737a-c131-4008-bbac-4e9a964809b1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:21.214319 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2c8f737a-c131-4008-bbac-4e9a964809b1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:21.220960 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44014. Aug 04 15:32:21.221682 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44016. Aug 04 15:32:21.352001 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2c8f737a-c131-4008-bbac-4e9a964809b1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:21.359707 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2c8f737a-c131-4008-bbac-4e9a964809b1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.160784 Aug 04 15:32:21.360271 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3698/7402] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:21 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:22.381807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-fafc5e8a-e700-4d18-9958-deb868243b30 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:22.382385 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-fafc5e8a-e700-4d18-9958-deb868243b30 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:22.389459 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fafc5e8a-e700-4d18-9958-deb868243b30 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:22.389919 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fafc5e8a-e700-4d18-9958-deb868243b30 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:22.390696 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fafc5e8a-e700-4d18-9958-deb868243b30 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:22.391142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-fafc5e8a-e700-4d18-9958-deb868243b30 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:22.535962 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-fafc5e8a-e700-4d18-9958-deb868243b30 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:22.543707 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-fafc5e8a-e700-4d18-9958-deb868243b30 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.166597 Aug 04 15:32:22.544278 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3705/7403] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:22 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:23.563690 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f6ecb949-1e39-4334-ab78-833da640b782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:23.564357 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f6ecb949-1e39-4334-ab78-833da640b782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:23.572301 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6ecb949-1e39-4334-ab78-833da640b782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:23.572764 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6ecb949-1e39-4334-ab78-833da640b782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:23.573589 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6ecb949-1e39-4334-ab78-833da640b782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:23.574042 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f6ecb949-1e39-4334-ab78-833da640b782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:23.708499 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f6ecb949-1e39-4334-ab78-833da640b782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:23.716267 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f6ecb949-1e39-4334-ab78-833da640b782 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.156497 Aug 04 15:32:23.716848 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3699/7404] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:23 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:24.737615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0e13fea7-4cc1-4b4f-9036-c2e1e06a4aac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:24.738896 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0e13fea7-4cc1-4b4f-9036-c2e1e06a4aac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:24.746207 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e13fea7-4cc1-4b4f-9036-c2e1e06a4aac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:24.746662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e13fea7-4cc1-4b4f-9036-c2e1e06a4aac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:24.747446 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e13fea7-4cc1-4b4f-9036-c2e1e06a4aac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:24.747891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0e13fea7-4cc1-4b4f-9036-c2e1e06a4aac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:24.882957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0e13fea7-4cc1-4b4f-9036-c2e1e06a4aac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:24.890876 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0e13fea7-4cc1-4b4f-9036-c2e1e06a4aac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.157316 Aug 04 15:32:24.891460 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3706/7405] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:24 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:25.913244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-07afbb4e-6744-4d9d-a8d8-d22d0901622d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:25.913865 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-07afbb4e-6744-4d9d-a8d8-d22d0901622d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:25.920917 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07afbb4e-6744-4d9d-a8d8-d22d0901622d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:25.921390 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07afbb4e-6744-4d9d-a8d8-d22d0901622d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:25.922172 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07afbb4e-6744-4d9d-a8d8-d22d0901622d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:25.922628 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07afbb4e-6744-4d9d-a8d8-d22d0901622d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:26.051978 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-07afbb4e-6744-4d9d-a8d8-d22d0901622d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:26.059622 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-07afbb4e-6744-4d9d-a8d8-d22d0901622d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.151007 Aug 04 15:32:26.060195 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3700/7406] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:25 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:27.081341 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-c502393e-a823-4954-9ce5-620006dc2885 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:27.081967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-c502393e-a823-4954-9ce5-620006dc2885 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:27.089139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c502393e-a823-4954-9ce5-620006dc2885 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:27.089598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c502393e-a823-4954-9ce5-620006dc2885 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:27.090375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c502393e-a823-4954-9ce5-620006dc2885 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:27.090848 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-c502393e-a823-4954-9ce5-620006dc2885 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:27.227763 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-c502393e-a823-4954-9ce5-620006dc2885 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:27.235486 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-c502393e-a823-4954-9ce5-620006dc2885 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.157998 Aug 04 15:32:27.236067 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3707/7407] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:27 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:28.256666 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8f367633-1f24-4230-bd27-15d5fdb9f27e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:28.257298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8f367633-1f24-4230-bd27-15d5fdb9f27e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:28.264298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f367633-1f24-4230-bd27-15d5fdb9f27e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:28.264756 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f367633-1f24-4230-bd27-15d5fdb9f27e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:28.265569 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f367633-1f24-4230-bd27-15d5fdb9f27e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:28.266022 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8f367633-1f24-4230-bd27-15d5fdb9f27e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:28.399232 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8f367633-1f24-4230-bd27-15d5fdb9f27e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:28.407094 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8f367633-1f24-4230-bd27-15d5fdb9f27e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.154348 Aug 04 15:32:28.407662 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3701/7408] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:28 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:29.429246 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e6d0a9f9-1d08-467a-aa31-675eb130baa5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:29.430043 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e6d0a9f9-1d08-467a-aa31-675eb130baa5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:29.437721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6d0a9f9-1d08-467a-aa31-675eb130baa5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:29.438269 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6d0a9f9-1d08-467a-aa31-675eb130baa5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:29.439139 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6d0a9f9-1d08-467a-aa31-675eb130baa5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:29.439581 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e6d0a9f9-1d08-467a-aa31-675eb130baa5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:29.585040 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e6d0a9f9-1d08-467a-aa31-675eb130baa5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:29.592852 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e6d0a9f9-1d08-467a-aa31-675eb130baa5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.168197 Aug 04 15:32:29.593467 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3708/7409] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:29 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:30.614392 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c53abdb5-3437-4a47-b407-73972c763c1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:30.615034 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c53abdb5-3437-4a47-b407-73972c763c1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:30.622781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c53abdb5-3437-4a47-b407-73972c763c1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:30.623256 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c53abdb5-3437-4a47-b407-73972c763c1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:30.624066 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c53abdb5-3437-4a47-b407-73972c763c1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:30.624528 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c53abdb5-3437-4a47-b407-73972c763c1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:30.767738 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c53abdb5-3437-4a47-b407-73972c763c1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:30.776601 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c53abdb5-3437-4a47-b407-73972c763c1d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.166287 Aug 04 15:32:30.777252 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3702/7410] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:30 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:31.798066 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-eb973309-bb48-4b76-902c-15f286a07dcb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:31.798723 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-eb973309-bb48-4b76-902c-15f286a07dcb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:31.806325 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb973309-bb48-4b76-902c-15f286a07dcb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:31.806792 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb973309-bb48-4b76-902c-15f286a07dcb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:31.807587 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb973309-bb48-4b76-902c-15f286a07dcb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:31.808038 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-eb973309-bb48-4b76-902c-15f286a07dcb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:31.967878 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-eb973309-bb48-4b76-902c-15f286a07dcb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:31.976782 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-eb973309-bb48-4b76-902c-15f286a07dcb tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.182739 Aug 04 15:32:31.977511 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3709/7411] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:31 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:33.000335 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-dbaf9c48-1ff0-4cc2-acd2-1e8cd493eb53 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:33.001124 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-dbaf9c48-1ff0-4cc2-acd2-1e8cd493eb53 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:33.008409 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbaf9c48-1ff0-4cc2-acd2-1e8cd493eb53 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:33.008975 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbaf9c48-1ff0-4cc2-acd2-1e8cd493eb53 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:33.009699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbaf9c48-1ff0-4cc2-acd2-1e8cd493eb53 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:33.010159 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-dbaf9c48-1ff0-4cc2-acd2-1e8cd493eb53 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:33.495876 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-dbaf9c48-1ff0-4cc2-acd2-1e8cd493eb53 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:33.503431 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-dbaf9c48-1ff0-4cc2-acd2-1e8cd493eb53 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1570 microversion: 2.1 time: 0.508162 Aug 04 15:32:33.503996 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3703/7412] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:32 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1570 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:33.524439 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9aab66ff-7e04-4f53-81c6-48b1bd43822b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:32:33.525070 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9aab66ff-7e04-4f53-81c6-48b1bd43822b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:33.531943 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9aab66ff-7e04-4f53-81c6-48b1bd43822b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:33.532391 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9aab66ff-7e04-4f53-81c6-48b1bd43822b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:33.533186 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9aab66ff-7e04-4f53-81c6-48b1bd43822b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:33.533644 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9aab66ff-7e04-4f53-81c6-48b1bd43822b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:33.576888 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9aab66ff-7e04-4f53-81c6-48b1bd43822b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130960) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 15:32:33.639873 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9aab66ff-7e04-4f53-81c6-48b1bd43822b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "POST /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61/action" status: 202 len: 0 microversion: 2.1 time: 0.119994 Aug 04 15:32:33.640642 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3710/7413] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:32:33 2022] POST /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:32:33.649442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8674f87d-3cab-4c1f-8136-6b926e32a43c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:33.650195 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8674f87d-3cab-4c1f-8136-6b926e32a43c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:33.656410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8674f87d-3cab-4c1f-8136-6b926e32a43c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:33.656910 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8674f87d-3cab-4c1f-8136-6b926e32a43c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:33.657715 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8674f87d-3cab-4c1f-8136-6b926e32a43c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:33.658170 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8674f87d-3cab-4c1f-8136-6b926e32a43c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:33.797558 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8674f87d-3cab-4c1f-8136-6b926e32a43c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:33.805742 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8674f87d-3cab-4c1f-8136-6b926e32a43c tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1518 microversion: 2.1 time: 0.160809 Aug 04 15:32:33.806339 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3704/7414] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:33 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:32:34.046920 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-a5e5ded3-87cd-4ce4-8e5b-2b15e905047c req-8e7c4cc9-75fa-4924-b74c-e9e643972e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4159f7-69d4-48f8-89a9-5fb21e734a61", "name": "network-vif-unplugged", "status": "completed", "tag": "0965c909-841d-45ee-a09a-d959ec4765b5"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:32:34.058019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a5e5ded3-87cd-4ce4-8e5b-2b15e905047c req-8e7c4cc9-75fa-4924-b74c-e9e643972e7e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:34.058484 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-a5e5ded3-87cd-4ce4-8e5b-2b15e905047c req-8e7c4cc9-75fa-4924-b74c-e9e643972e7e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:34.071979 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.compute.server_external_events [req-a5e5ded3-87cd-4ce4-8e5b-2b15e905047c req-8e7c4cc9-75fa-4924-b74c-e9e643972e7e service nova] Unable to find a host for instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61. Dropping event network-vif-unplugged {{(pid=130960) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 15:32:34.072965 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-a5e5ded3-87cd-4ce4-8e5b-2b15e905047c req-8e7c4cc9-75fa-4924-b74c-e9e643972e7e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030004 Aug 04 15:32:34.073651 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3711/7415] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 15:32:34.827169 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-07615c0f-0f20-4b24-b9c0-94b6fc0f506b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:34.827999 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-07615c0f-0f20-4b24-b9c0-94b6fc0f506b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:34.835228 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07615c0f-0f20-4b24-b9c0-94b6fc0f506b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:34.835702 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07615c0f-0f20-4b24-b9c0-94b6fc0f506b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:34.836611 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07615c0f-0f20-4b24-b9c0-94b6fc0f506b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:34.837200 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-07615c0f-0f20-4b24-b9c0-94b6fc0f506b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:34.986083 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-07615c0f-0f20-4b24-b9c0-94b6fc0f506b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:34.995079 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-07615c0f-0f20-4b24-b9c0-94b6fc0f506b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1520 microversion: 2.1 time: 0.171789 Aug 04 15:32:34.995672 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3705/7416] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:34 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:36.022065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9f9e2e04-49b6-4a50-8249-dfc49a9d9883 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:36.022932 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9f9e2e04-49b6-4a50-8249-dfc49a9d9883 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:36.030142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f9e2e04-49b6-4a50-8249-dfc49a9d9883 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:36.030600 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f9e2e04-49b6-4a50-8249-dfc49a9d9883 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:36.031384 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f9e2e04-49b6-4a50-8249-dfc49a9d9883 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:36.031830 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9f9e2e04-49b6-4a50-8249-dfc49a9d9883 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:36.190688 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9f9e2e04-49b6-4a50-8249-dfc49a9d9883 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:36.199838 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9f9e2e04-49b6-4a50-8249-dfc49a9d9883 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1520 microversion: 2.1 time: 0.182344 Aug 04 15:32:36.200441 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3712/7417] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:36 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:37.221713 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-58b92330-02a9-4708-adc7-e544735a1877 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:37.222383 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-58b92330-02a9-4708-adc7-e544735a1877 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:37.230573 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58b92330-02a9-4708-adc7-e544735a1877 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:37.231041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58b92330-02a9-4708-adc7-e544735a1877 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:37.231845 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58b92330-02a9-4708-adc7-e544735a1877 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:37.232300 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-58b92330-02a9-4708-adc7-e544735a1877 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:37.403840 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-58b92330-02a9-4708-adc7-e544735a1877 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:37.417256 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-58b92330-02a9-4708-adc7-e544735a1877 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1520 microversion: 2.1 time: 0.199324 Aug 04 15:32:37.417771 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3706/7418] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:37 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:38.439050 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a0a4182b-3f02-4c04-95f5-f20e095b50cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:38.439728 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a0a4182b-3f02-4c04-95f5-f20e095b50cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:38.447704 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0a4182b-3f02-4c04-95f5-f20e095b50cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:38.448161 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0a4182b-3f02-4c04-95f5-f20e095b50cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:38.449061 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0a4182b-3f02-4c04-95f5-f20e095b50cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:38.449517 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a0a4182b-3f02-4c04-95f5-f20e095b50cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:38.603508 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-a0a4182b-3f02-4c04-95f5-f20e095b50cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:38.611580 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a0a4182b-3f02-4c04-95f5-f20e095b50cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1520 microversion: 2.1 time: 0.176708 Aug 04 15:32:38.612331 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3713/7419] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:38 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:39.633685 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2d9c8830-e0b6-4282-8070-8f7f77422219 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:39.634324 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2d9c8830-e0b6-4282-8070-8f7f77422219 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:39.641547 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d9c8830-e0b6-4282-8070-8f7f77422219 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:39.642029 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d9c8830-e0b6-4282-8070-8f7f77422219 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:39.642807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d9c8830-e0b6-4282-8070-8f7f77422219 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:39.643260 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2d9c8830-e0b6-4282-8070-8f7f77422219 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:39.789272 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2d9c8830-e0b6-4282-8070-8f7f77422219 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:39.797757 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2d9c8830-e0b6-4282-8070-8f7f77422219 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.168641 Aug 04 15:32:39.798440 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3707/7420] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:39 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:40.820608 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-9319f2b4-717c-45e1-a280-7c9f12b6c03e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:40.821295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-9319f2b4-717c-45e1-a280-7c9f12b6c03e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:40.828601 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9319f2b4-717c-45e1-a280-7c9f12b6c03e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:40.829098 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9319f2b4-717c-45e1-a280-7c9f12b6c03e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:40.829892 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9319f2b4-717c-45e1-a280-7c9f12b6c03e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:40.830334 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-9319f2b4-717c-45e1-a280-7c9f12b6c03e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:40.987936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-9319f2b4-717c-45e1-a280-7c9f12b6c03e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:40.996188 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-9319f2b4-717c-45e1-a280-7c9f12b6c03e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.180359 Aug 04 15:32:40.996896 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3714/7421] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:40 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:41.076722 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-e64f932e-1453-410c-88a3-ba23ae6a7076 req-2a300d2f-9ceb-4591-acc0-b9059b8eed96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4159f7-69d4-48f8-89a9-5fb21e734a61", "tag": "0965c909-841d-45ee-a09a-d959ec4765b5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:32:41.096456 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e64f932e-1453-410c-88a3-ba23ae6a7076 req-2a300d2f-9ceb-4591-acc0-b9059b8eed96 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:41.098238 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-e64f932e-1453-410c-88a3-ba23ae6a7076 req-2a300d2f-9ceb-4591-acc0-b9059b8eed96 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:41.110402 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-e64f932e-1453-410c-88a3-ba23ae6a7076 req-2a300d2f-9ceb-4591-acc0-b9059b8eed96 service nova] Creating event network-changed:0965c909-841d-45ee-a09a-d959ec4765b5 for instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 on n-h1-844627-10 Aug 04 15:32:41.114181 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [req-e64f932e-1453-410c-88a3-ba23ae6a7076 req-2a300d2f-9ceb-4591-acc0-b9059b8eed96 service nova] [f67e0bf6-4f81-42fe-bdd3-1b819d2f8355] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:32:42.019586 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-812fd6e2-a069-4cb0-b89c-633c9153a1d8 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:42.020214 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-812fd6e2-a069-4cb0-b89c-633c9153a1d8 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:42.027838 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-812fd6e2-a069-4cb0-b89c-633c9153a1d8 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:42.028295 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-812fd6e2-a069-4cb0-b89c-633c9153a1d8 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:42.029117 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-812fd6e2-a069-4cb0-b89c-633c9153a1d8 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:42.029575 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-812fd6e2-a069-4cb0-b89c-633c9153a1d8 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:42.124833 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [req-e64f932e-1453-410c-88a3-ba23ae6a7076 req-2a300d2f-9ceb-4591-acc0-b9059b8eed96 service nova] [f67e0bf6-4f81-42fe-bdd3-1b819d2f8355] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44074. Aug 04 15:32:42.131450 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-e64f932e-1453-410c-88a3-ba23ae6a7076 req-2a300d2f-9ceb-4591-acc0-b9059b8eed96 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.058862 Aug 04 15:32:42.132614 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3708/7422] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:32:42.191154 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-812fd6e2-a069-4cb0-b89c-633c9153a1d8 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:42.200425 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-812fd6e2-a069-4cb0-b89c-633c9153a1d8 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.184623 Aug 04 15:32:42.201151 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3715/7423] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:42 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:32:43.226551 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5aecf1bc-ea61-48bf-81c9-c11b7dc76728 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:43.227734 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-5aecf1bc-ea61-48bf-81c9-c11b7dc76728 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:43.237554 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5aecf1bc-ea61-48bf-81c9-c11b7dc76728 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:43.238851 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5aecf1bc-ea61-48bf-81c9-c11b7dc76728 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:43.239886 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5aecf1bc-ea61-48bf-81c9-c11b7dc76728 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:43.240445 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-5aecf1bc-ea61-48bf-81c9-c11b7dc76728 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:43.410836 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-5aecf1bc-ea61-48bf-81c9-c11b7dc76728 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:43.419159 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5aecf1bc-ea61-48bf-81c9-c11b7dc76728 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.199609 Aug 04 15:32:43.419770 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3709/7424] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:43 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:32:44.444329 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a2682c4-0ba6-4e1f-a967-0b769c1eebc5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:44.444974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a2682c4-0ba6-4e1f-a967-0b769c1eebc5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:44.452507 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a2682c4-0ba6-4e1f-a967-0b769c1eebc5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:44.452980 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a2682c4-0ba6-4e1f-a967-0b769c1eebc5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:44.453789 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a2682c4-0ba6-4e1f-a967-0b769c1eebc5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:44.454225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a2682c4-0ba6-4e1f-a967-0b769c1eebc5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:44.598347 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a2682c4-0ba6-4e1f-a967-0b769c1eebc5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:44.606445 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a2682c4-0ba6-4e1f-a967-0b769c1eebc5 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.166237 Aug 04 15:32:44.607042 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3716/7425] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:44 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:45.627134 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-352f532b-8b48-4cc0-8960-bced8745d8ca tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:45.628103 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-352f532b-8b48-4cc0-8960-bced8745d8ca tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:45.636441 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-352f532b-8b48-4cc0-8960-bced8745d8ca tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:45.637023 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-352f532b-8b48-4cc0-8960-bced8745d8ca tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:45.638052 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-352f532b-8b48-4cc0-8960-bced8745d8ca tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:45.638594 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-352f532b-8b48-4cc0-8960-bced8745d8ca tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:45.781962 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-352f532b-8b48-4cc0-8960-bced8745d8ca tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:45.790072 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-352f532b-8b48-4cc0-8960-bced8745d8ca tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.166945 Aug 04 15:32:45.790702 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3710/7426] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:45 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 15:32:46.812105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-33b4427c-1c62-4437-84b8-42126f9e5137 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:46.812752 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-33b4427c-1c62-4437-84b8-42126f9e5137 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:46.821141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33b4427c-1c62-4437-84b8-42126f9e5137 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:46.821585 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33b4427c-1c62-4437-84b8-42126f9e5137 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:46.822375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33b4427c-1c62-4437-84b8-42126f9e5137 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:46.822807 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-33b4427c-1c62-4437-84b8-42126f9e5137 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:46.827458 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:32:46.984275 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-33b4427c-1c62-4437-84b8-42126f9e5137 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:46.998058 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-33b4427c-1c62-4437-84b8-42126f9e5137 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.190013 Aug 04 15:32:46.998670 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3717/7427] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:46 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:48.019656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-30124654-2d6c-445a-baef-6084620465cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:48.020264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-30124654-2d6c-445a-baef-6084620465cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:48.027486 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30124654-2d6c-445a-baef-6084620465cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:48.027944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30124654-2d6c-445a-baef-6084620465cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:48.028733 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30124654-2d6c-445a-baef-6084620465cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:48.029212 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-30124654-2d6c-445a-baef-6084620465cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:48.216344 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-30124654-2d6c-445a-baef-6084620465cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:48.229621 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-30124654-2d6c-445a-baef-6084620465cc tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.213865 Aug 04 15:32:48.230354 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3711/7428] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:48 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:49.252272 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-207731d3-5364-4ace-adb0-8ce5a2df0c7f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:49.252893 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-207731d3-5364-4ace-adb0-8ce5a2df0c7f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:49.255545 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:32:49.261685 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-207731d3-5364-4ace-adb0-8ce5a2df0c7f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:49.262195 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-207731d3-5364-4ace-adb0-8ce5a2df0c7f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:49.262966 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-207731d3-5364-4ace-adb0-8ce5a2df0c7f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:49.263434 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-207731d3-5364-4ace-adb0-8ce5a2df0c7f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:49.403241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-207731d3-5364-4ace-adb0-8ce5a2df0c7f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:49.411824 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-207731d3-5364-4ace-adb0-8ce5a2df0c7f tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.163323 Aug 04 15:32:49.412300 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3718/7429] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:49 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:50.433807 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-48271367-cb75-4b41-949b-fa204f040d55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:50.434358 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-48271367-cb75-4b41-949b-fa204f040d55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:50.437153 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=31 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:32:50.442924 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-48271367-cb75-4b41-949b-fa204f040d55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:50.443387 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-48271367-cb75-4b41-949b-fa204f040d55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:50.444436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-48271367-cb75-4b41-949b-fa204f040d55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:50.444896 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-48271367-cb75-4b41-949b-fa204f040d55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:50.449184 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=87 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:32:50.578005 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-48271367-cb75-4b41-949b-fa204f040d55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:50.586192 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-48271367-cb75-4b41-949b-fa204f040d55 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.156459 Aug 04 15:32:50.586767 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3712/7430] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:50 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:51.608220 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-51783f9e-5070-496e-874a-a122efc582e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:51.608847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-51783f9e-5070-496e-874a-a122efc582e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:51.616351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51783f9e-5070-496e-874a-a122efc582e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:51.616978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51783f9e-5070-496e-874a-a122efc582e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:51.617882 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51783f9e-5070-496e-874a-a122efc582e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:51.618338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-51783f9e-5070-496e-874a-a122efc582e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:51.762912 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-51783f9e-5070-496e-874a-a122efc582e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:51.777179 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ec54a1f9-7323-4a50-8253-e3fbb66f3797 req-6c415f52-a569-47dc-b758-84360cb54e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4159f7-69d4-48f8-89a9-5fb21e734a61", "name": "network-vif-plugged", "status": "completed", "tag": "0965c909-841d-45ee-a09a-d959ec4765b5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:32:51.784608 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-51783f9e-5070-496e-874a-a122efc582e4 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.167518 Aug 04 15:32:51.785419 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3719/7431] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:51 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:51.792114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ec54a1f9-7323-4a50-8253-e3fbb66f3797 req-6c415f52-a569-47dc-b758-84360cb54e2e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:51.793033 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ec54a1f9-7323-4a50-8253-e3fbb66f3797 req-6c415f52-a569-47dc-b758-84360cb54e2e service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:51.808586 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ec54a1f9-7323-4a50-8253-e3fbb66f3797 req-6c415f52-a569-47dc-b758-84360cb54e2e service nova] Creating event network-vif-plugged:0965c909-841d-45ee-a09a-d959ec4765b5 for instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 on n-h1-844627-10 Aug 04 15:32:51.819650 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ec54a1f9-7323-4a50-8253-e3fbb66f3797 req-6c415f52-a569-47dc-b758-84360cb54e2e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041182 Aug 04 15:32:51.819650 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3713/7432] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:32:52.808189 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cbcfdf26-4e1d-47f5-9b53-64b98da126e0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:52.808834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cbcfdf26-4e1d-47f5-9b53-64b98da126e0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:52.816427 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbcfdf26-4e1d-47f5-9b53-64b98da126e0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:52.817009 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbcfdf26-4e1d-47f5-9b53-64b98da126e0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:52.817662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbcfdf26-4e1d-47f5-9b53-64b98da126e0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:52.818097 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cbcfdf26-4e1d-47f5-9b53-64b98da126e0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:52.952429 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cbcfdf26-4e1d-47f5-9b53-64b98da126e0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:52.962205 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cbcfdf26-4e1d-47f5-9b53-64b98da126e0 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1576 microversion: 2.1 time: 0.158788 Aug 04 15:32:52.963121 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3720/7433] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:52 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:32:53.984332 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-0924a0a9-ee6c-498e-a74f-8a94c85c296e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:32:53.985093 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-0924a0a9-ee6c-498e-a74f-8a94c85c296e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:32:53.993292 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0924a0a9-ee6c-498e-a74f-8a94c85c296e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:53.993616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0924a0a9-ee6c-498e-a74f-8a94c85c296e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:53.994410 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0924a0a9-ee6c-498e-a74f-8a94c85c296e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:32:53.994874 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-0924a0a9-ee6c-498e-a74f-8a94c85c296e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:32:54.150077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-0924a0a9-ee6c-498e-a74f-8a94c85c296e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:32:54.158070 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-0924a0a9-ee6c-498e-a74f-8a94c85c296e tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1563 microversion: 2.1 time: 0.177994 Aug 04 15:32:54.158643 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3714/7434] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:32:53 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:33:24.170659 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:33:24.171275 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:33:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:34:07.592264 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=5 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:34:07.593873 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=22 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:34:07.598117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-5e540393-803e-4643-91f4-829751126128 req-11675a78-da42-4fea-b7b9-2e767cbc140f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4159f7-69d4-48f8-89a9-5fb21e734a61", "tag": "0965c909-841d-45ee-a09a-d959ec4765b5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:34:07.598602 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-5d67feb6-de88-4b44-a76f-10dbf9d011c1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:07.598847 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d67feb6-de88-4b44-a76f-10dbf9d011c1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:07.603943 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=5 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:34:07.605054 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=13 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:34:07.606618 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d67feb6-de88-4b44-a76f-10dbf9d011c1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:07.607215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d67feb6-de88-4b44-a76f-10dbf9d011c1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:07.608126 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d67feb6-de88-4b44-a76f-10dbf9d011c1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:07.608707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-5d67feb6-de88-4b44-a76f-10dbf9d011c1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:07.613196 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5e540393-803e-4643-91f4-829751126128 req-11675a78-da42-4fea-b7b9-2e767cbc140f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:07.613736 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-5e540393-803e-4643-91f4-829751126128 req-11675a78-da42-4fea-b7b9-2e767cbc140f service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:07.627480 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-5e540393-803e-4643-91f4-829751126128 req-11675a78-da42-4fea-b7b9-2e767cbc140f service nova] Creating event network-changed:0965c909-841d-45ee-a09a-d959ec4765b5 for instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 on n-h1-844627-10 Aug 04 15:34:07.633500 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-5e540393-803e-4643-91f4-829751126128 req-11675a78-da42-4fea-b7b9-2e767cbc140f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040774 Aug 04 15:34:07.634191 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3715/7435] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:34:07.636632 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-5d67feb6-de88-4b44-a76f-10dbf9d011c1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:34:07.731906 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-5d67feb6-de88-4b44-a76f-10dbf9d011c1 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 204 len: 0 microversion: 2.1 time: 0.140702 Aug 04 15:34:07.732926 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3721/7436] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:34:07 2022] DELETE /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:34:07.742641 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-2b656157-394c-4427-9d6b-be66353b07ac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:07.743479 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-2b656157-394c-4427-9d6b-be66353b07ac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:07.751185 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b656157-394c-4427-9d6b-be66353b07ac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:07.751863 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b656157-394c-4427-9d6b-be66353b07ac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:07.752687 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b656157-394c-4427-9d6b-be66353b07ac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:07.753237 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-2b656157-394c-4427-9d6b-be66353b07ac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:07.893004 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-2b656157-394c-4427-9d6b-be66353b07ac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:07.900827 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-2b656157-394c-4427-9d6b-be66353b07ac tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.162835 Aug 04 15:34:07.901422 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3716/7437] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:07 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:08.921846 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-372c39f5-e114-4673-a03c-f4a32a074830 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:08.922588 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-372c39f5-e114-4673-a03c-f4a32a074830 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:08.930069 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-372c39f5-e114-4673-a03c-f4a32a074830 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:08.930511 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-372c39f5-e114-4673-a03c-f4a32a074830 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:08.931274 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-372c39f5-e114-4673-a03c-f4a32a074830 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:08.931707 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-372c39f5-e114-4673-a03c-f4a32a074830 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:09.077346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-372c39f5-e114-4673-a03c-f4a32a074830 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:09.085794 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-372c39f5-e114-4673-a03c-f4a32a074830 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1569 microversion: 2.1 time: 0.168214 Aug 04 15:34:09.086403 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3722/7438] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:08 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:10.007643 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-de4f4d36-0ba2-4b03-82dc-72fc6828585b req-d0befc2e-90e0-4265-b35b-0de9a617a5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4159f7-69d4-48f8-89a9-5fb21e734a61", "name": "network-vif-deleted", "tag": "0965c909-841d-45ee-a09a-d959ec4765b5"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:34:10.018948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-de4f4d36-0ba2-4b03-82dc-72fc6828585b req-d0befc2e-90e0-4265-b35b-0de9a617a5f7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:10.019406 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-de4f4d36-0ba2-4b03-82dc-72fc6828585b req-d0befc2e-90e0-4265-b35b-0de9a617a5f7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:10.031348 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-de4f4d36-0ba2-4b03-82dc-72fc6828585b req-d0befc2e-90e0-4265-b35b-0de9a617a5f7 service nova] Creating event network-vif-deleted:0965c909-841d-45ee-a09a-d959ec4765b5 for instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 on n-h1-844627-10 Aug 04 15:34:10.036848 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-de4f4d36-0ba2-4b03-82dc-72fc6828585b req-d0befc2e-90e0-4265-b35b-0de9a617a5f7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032842 Aug 04 15:34:10.037565 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3717/7439] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:34:10.107067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-6752a3ac-03a0-425a-bab2-523e09713d83 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:10.107684 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-6752a3ac-03a0-425a-bab2-523e09713d83 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:10.115027 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6752a3ac-03a0-425a-bab2-523e09713d83 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:10.115477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6752a3ac-03a0-425a-bab2-523e09713d83 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:10.116248 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6752a3ac-03a0-425a-bab2-523e09713d83 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:10.116679 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-6752a3ac-03a0-425a-bab2-523e09713d83 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:10.186287 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-6752a3ac-03a0-425a-bab2-523e09713d83 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:10.194323 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-6752a3ac-03a0-425a-bab2-523e09713d83 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1219 microversion: 2.1 time: 0.091311 Aug 04 15:34:10.194900 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3723/7440] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:10 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:11.216364 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6953f3c5-bd7d-4631-bfd3-ba8c29c1f3b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:11.217114 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6953f3c5-bd7d-4631-bfd3-ba8c29c1f3b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:11.223704 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6953f3c5-bd7d-4631-bfd3-ba8c29c1f3b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:11.224161 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6953f3c5-bd7d-4631-bfd3-ba8c29c1f3b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:11.224959 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6953f3c5-bd7d-4631-bfd3-ba8c29c1f3b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:11.225413 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-6953f3c5-bd7d-4631-bfd3-ba8c29c1f3b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:11.288789 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6953f3c5-bd7d-4631-bfd3-ba8c29c1f3b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:11.297509 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6953f3c5-bd7d-4631-bfd3-ba8c29c1f3b2 tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1219 microversion: 2.1 time: 0.086283 Aug 04 15:34:11.298185 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3718/7441] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:11 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:12.320158 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b34341d8-1af0-4fd0-918b-3fd9c64e78db tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:12.320861 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b34341d8-1af0-4fd0-918b-3fd9c64e78db tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:12.329885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b34341d8-1af0-4fd0-918b-3fd9c64e78db tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:12.330495 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b34341d8-1af0-4fd0-918b-3fd9c64e78db tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:12.331252 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b34341d8-1af0-4fd0-918b-3fd9c64e78db tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:12.331734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b34341d8-1af0-4fd0-918b-3fd9c64e78db tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:12.411020 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b34341d8-1af0-4fd0-918b-3fd9c64e78db tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:12.420522 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b34341d8-1af0-4fd0-918b-3fd9c64e78db tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1219 microversion: 2.1 time: 0.105546 Aug 04 15:34:12.421294 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3724/7442] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:12 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:13.441619 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7a4b0f80-9ec1-4ce0-be9d-e3c785bf266b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:13.442156 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7a4b0f80-9ec1-4ce0-be9d-e3c785bf266b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:13.449246 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a4b0f80-9ec1-4ce0-be9d-e3c785bf266b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:13.449725 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a4b0f80-9ec1-4ce0-be9d-e3c785bf266b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:13.450526 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a4b0f80-9ec1-4ce0-be9d-e3c785bf266b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:13.450992 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7a4b0f80-9ec1-4ce0-be9d-e3c785bf266b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:13.516422 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7a4b0f80-9ec1-4ce0-be9d-e3c785bf266b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:13.523912 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7a4b0f80-9ec1-4ce0-be9d-e3c785bf266b tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1219 microversion: 2.1 time: 0.086597 Aug 04 15:34:13.524485 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3719/7443] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:13 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:14.545164 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:14.545828 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:14.552860 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:14.553342 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:14.554124 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:14.554567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:14.588354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:14.588614 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:14.588995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.objects.instance [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lazy-loading 'fault' on Instance uuid 0e4159f7-69d4-48f8-89a9-5fb21e734a61 {{(pid=130960) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 15:34:14.634039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d19252493843eda0044da0f9a59c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1083843dc73426bbc2179924015b9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:14.644178 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-b48fc5b3-131c-4231-8146-48a2c786b07d tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 200 len: 1224 microversion: 2.1 time: 0.102862 Aug 04 15:34:14.652925 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3725/7444] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:14 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:15.666747 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:15.667384 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] [instance: 0e4159f7-69d4-48f8-89a9-5fb21e734a61] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:15.675616 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:15.676077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:15.676883 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:15.677337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:15.691038 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] HTTP exception thrown: Instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 could not be found. Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Request method failure captured: Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 HTTP/1.1 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-Ts2QGZSiJXBxbAsemA2ZIZ5vXgRij3MfWM8620q4f418YEYYmysWLRphqhxSw97fsUHtyaAtdbQIg6bZK_b9MYqLtbkC6Bo23IRwr00ngeGLO0CwDBcmBjCeNl-dwdMw3-Iph04UbNY6zaWU-JeUBfW-25PdUWLqHxoKlrBA9ODPM Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: c1083843dc73426bbc2179924015b9a4 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestShelveInstance-260921611 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1083843dc73426bbc2179924015b9a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c1083843dc73426bbc2179924015b9a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c1083843dc73426bbc2179924015b9a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c1083843dc73426bbc2179924015b9a4"}]}] Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestShelveInstance-260921611 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: c1083843dc73426bbc2179924015b9a4 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestShelveInstance-260921611 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestShelveInstance-260921611-project Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 46d19252493843eda0044da0f9a59c23 Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestShelveInstance-260921611-project Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 could not be found. Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '0e4159f7-69d4-48f8-89a9-5fb21e734a61'} Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 could not be found. Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 could not be found. Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:34:15.692741 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 could not be found. Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Returning 404 to user: Instance 0e4159f7-69d4-48f8-89a9-5fb21e734a61 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-1992f54d-4c55-4f44-85f0-f06a852c4a9a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61" status: 404 len: 111 microversion: 2.1 time: 0.031427 Aug 04 15:34:15.700948 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3720/7445] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:15 2022] GET /compute/v2.1/servers/0e4159f7-69d4-48f8-89a9-5fb21e734a61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:34:15.867590 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca1ada5e-84d2-4bf6-bc3f-2c3e1797f42a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] Calling method '.version_select at 0x7f46f2ebb790>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:15.899668 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca1ada5e-84d2-4bf6-bc3f-2c3e1797f42a tempest-TestShelveInstance-260921611 tempest-TestShelveInstance-260921611-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1961004635" status: 202 len: 0 microversion: 2.1 time: 0.036071 Aug 04 15:34:15.900133 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3726/7446] 10.222.0.66 () {58 vars in 1254 bytes} [Thu Aug 4 15:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1961004635 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:34:33.819451 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=12 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:34:33.821060 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=24 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:34:33.998208 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-5cd7ac32-3b8e-43fb-8adc-fba82848ed44 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Action: 'create', calling method: .version_select at 0x7f46f05764c0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-105708298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPCh9XHnq2o0jHGVjxYCisuXYRpan2MkSxdY9lMjMJb5Q57KO2Z8i7ZxKHqnrOINMEdzM4WNT9zwYsT+Mxz5rQMxuZdRNKuIW/uIY9IXaeYtV23XhLalJLQjHnGu6X5BA=="}} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:34:34.014117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5cd7ac32-3b8e-43fb-8adc-fba82848ed44 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Getting quotas for project bce30b31044e4994b985329f0b5041ce. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:34:34.019377 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.quota [None req-5cd7ac32-3b8e-43fb-8adc-fba82848ed44 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Getting quotas for user 43764e5a4f9b4cadab6e9831a66f6b06 and project bce30b31044e4994b985329f0b5041ce. Resources: {'key_pairs'} {{(pid=130961) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:34:34.033068 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5cd7ac32-3b8e-43fb-8adc-fba82848ed44 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [c3f3337f-5e3e-4dc2-90e4-1955cee99059] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:34:35.041149 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [None req-5cd7ac32-3b8e-43fb-8adc-fba82848ed44 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [c3f3337f-5e3e-4dc2-90e4-1955cee99059] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44244. Aug 04 15:34:35.058326 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-5cd7ac32-3b8e-43fb-8adc-fba82848ed44 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.244523 Aug 04 15:34:35.058926 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3721/7447] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 15:34:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:34:36.129872 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:34:36.130714 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:34:36.135354 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-119544473", "imageRef": "bd2a109f-56ba-4543-91dd-d0a2429000b9", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-105708298", "security_groups": [{"name": "tempest-secgroup-smoke-1779230033"}], "networks": [{"uuid": "bd15a293-62b4-4cb8-bd2b-e102ceb127c3"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:34:36.250564 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] validate_networks() for [('bd15a293-62b4-4cb8-bd2b-e102ceb127c3', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:34:36.651111 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:34:36.651569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:34:36.652065 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:34:36.652473 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:34:36.652936 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:34:36.661997 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:36.662447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:36.663233 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:36.663868 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:36.687257 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Getting quotas for project bce30b31044e4994b985329f0b5041ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:34:36.693783 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Getting quotas for user 43764e5a4f9b4cadab6e9831a66f6b06 and project bce30b31044e4994b985329f0b5041ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:34:36.717171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:34:36.719483 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd2a109f-56ba-4543-91dd-d0a2429000b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:34:36.769342 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-296193bd-7d23-40b2-a75a-d76847dc2743 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.641157 Aug 04 15:34:36.770021 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3727/7448] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:34:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:34:36.780963 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-6fabc1a0-3d9e-4425-b71d-016aca0ede7a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:36.786814 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-6fabc1a0-3d9e-4425-b71d-016aca0ede7a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:36.850385 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-6fabc1a0-3d9e-4425-b71d-016aca0ede7a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:36.858643 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-6fabc1a0-3d9e-4425-b71d-016aca0ede7a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1247 microversion: 2.1 time: 0.081619 Aug 04 15:34:36.859476 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3722/7449] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:36 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:37.879563 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8d0005c6-defe-411d-ae41-636418406a16 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:37.880366 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8d0005c6-defe-411d-ae41-636418406a16 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:37.890924 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d0005c6-defe-411d-ae41-636418406a16 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:37.893477 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d0005c6-defe-411d-ae41-636418406a16 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:37.894547 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d0005c6-defe-411d-ae41-636418406a16 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:37.895242 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8d0005c6-defe-411d-ae41-636418406a16 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:37.972595 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8d0005c6-defe-411d-ae41-636418406a16 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:37.983524 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8d0005c6-defe-411d-ae41-636418406a16 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1307 microversion: 2.1 time: 0.106011 Aug 04 15:34:37.984943 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3728/7450] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:37 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:39.007342 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f744972e-348e-4f2d-8f52-1360ecfe69cf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:39.007969 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f744972e-348e-4f2d-8f52-1360ecfe69cf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:39.016268 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f744972e-348e-4f2d-8f52-1360ecfe69cf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:39.016834 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f744972e-348e-4f2d-8f52-1360ecfe69cf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:39.017762 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f744972e-348e-4f2d-8f52-1360ecfe69cf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:39.018298 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f744972e-348e-4f2d-8f52-1360ecfe69cf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:39.165249 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f744972e-348e-4f2d-8f52-1360ecfe69cf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:39.172898 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f744972e-348e-4f2d-8f52-1360ecfe69cf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1373 microversion: 2.1 time: 0.169430 Aug 04 15:34:39.185034 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3723/7451] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:39 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:39.386053 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-4dab0fc3-a8ab-44ee-9777-2c1e1098cdec req-05b64e93-c2c7-446d-b81b-ed1895488f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579df603-ab67-43dd-ae3d-a37cfcea1aa7", "tag": "a00cdd99-5015-4206-9abf-2ff50a6f941c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:34:39.398785 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4dab0fc3-a8ab-44ee-9777-2c1e1098cdec req-05b64e93-c2c7-446d-b81b-ed1895488f27 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:39.399418 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-4dab0fc3-a8ab-44ee-9777-2c1e1098cdec req-05b64e93-c2c7-446d-b81b-ed1895488f27 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:39.413875 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-4dab0fc3-a8ab-44ee-9777-2c1e1098cdec req-05b64e93-c2c7-446d-b81b-ed1895488f27 service nova] Creating event network-changed:a00cdd99-5015-4206-9abf-2ff50a6f941c for instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 on n-h2-844627-10 Aug 04 15:34:39.419582 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-4dab0fc3-a8ab-44ee-9777-2c1e1098cdec req-05b64e93-c2c7-446d-b81b-ed1895488f27 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038540 Aug 04 15:34:39.420321 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3729/7452] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:34:40.194854 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-7537bf4a-ee46-4a2b-b739-5bad2e436844 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:40.195487 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-7537bf4a-ee46-4a2b-b739-5bad2e436844 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:40.203036 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7537bf4a-ee46-4a2b-b739-5bad2e436844 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:40.203508 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7537bf4a-ee46-4a2b-b739-5bad2e436844 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:40.204293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7537bf4a-ee46-4a2b-b739-5bad2e436844 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:40.204748 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-7537bf4a-ee46-4a2b-b739-5bad2e436844 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:40.341442 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-7537bf4a-ee46-4a2b-b739-5bad2e436844 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:40.349053 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-7537bf4a-ee46-4a2b-b739-5bad2e436844 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1373 microversion: 2.1 time: 0.158166 Aug 04 15:34:40.349627 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3724/7453] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:40 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:41.371777 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8183df8b-ed0f-4d9b-99e3-392dfc77758b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:41.372420 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8183df8b-ed0f-4d9b-99e3-392dfc77758b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:41.378829 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8183df8b-ed0f-4d9b-99e3-392dfc77758b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:41.379280 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8183df8b-ed0f-4d9b-99e3-392dfc77758b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:41.380067 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8183df8b-ed0f-4d9b-99e3-392dfc77758b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:41.380506 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8183df8b-ed0f-4d9b-99e3-392dfc77758b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:41.615166 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-8183df8b-ed0f-4d9b-99e3-392dfc77758b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:41.623213 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8183df8b-ed0f-4d9b-99e3-392dfc77758b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1373 microversion: 2.1 time: 0.257215 Aug 04 15:34:41.623744 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3730/7454] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:41 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:42.644682 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-be3b3004-4ecc-4a06-ba34-92016ee0f113 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:42.645432 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-be3b3004-4ecc-4a06-ba34-92016ee0f113 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:42.652771 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be3b3004-4ecc-4a06-ba34-92016ee0f113 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:42.653205 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be3b3004-4ecc-4a06-ba34-92016ee0f113 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:42.654027 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be3b3004-4ecc-4a06-ba34-92016ee0f113 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:42.654503 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-be3b3004-4ecc-4a06-ba34-92016ee0f113 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:42.805130 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-be3b3004-4ecc-4a06-ba34-92016ee0f113 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:42.817986 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-be3b3004-4ecc-4a06-ba34-92016ee0f113 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1373 microversion: 2.1 time: 0.177007 Aug 04 15:34:42.818571 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3725/7455] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:42 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:43.840790 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-391fb63d-e25d-40b3-b982-c6b1a1d6bd8b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:43.841422 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-391fb63d-e25d-40b3-b982-c6b1a1d6bd8b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:43.848598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-391fb63d-e25d-40b3-b982-c6b1a1d6bd8b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:43.849109 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-391fb63d-e25d-40b3-b982-c6b1a1d6bd8b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:43.849925 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-391fb63d-e25d-40b3-b982-c6b1a1d6bd8b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:43.850375 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-391fb63d-e25d-40b3-b982-c6b1a1d6bd8b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:43.983637 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-391fb63d-e25d-40b3-b982-c6b1a1d6bd8b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:43.991121 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-391fb63d-e25d-40b3-b982-c6b1a1d6bd8b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1373 microversion: 2.1 time: 0.154223 Aug 04 15:34:43.991705 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3731/7456] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:43 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:44.792727 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-2db635a1-f2ee-472e-b333-5ead8e6c2c05 req-8aca7682-8082-4a4a-aa51-9d2b892a03b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579df603-ab67-43dd-ae3d-a37cfcea1aa7", "name": "network-vif-plugged", "status": "completed", "tag": "a00cdd99-5015-4206-9abf-2ff50a6f941c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:34:44.803285 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2db635a1-f2ee-472e-b333-5ead8e6c2c05 req-8aca7682-8082-4a4a-aa51-9d2b892a03b2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:44.803903 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-2db635a1-f2ee-472e-b333-5ead8e6c2c05 req-8aca7682-8082-4a4a-aa51-9d2b892a03b2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:44.816314 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-2db635a1-f2ee-472e-b333-5ead8e6c2c05 req-8aca7682-8082-4a4a-aa51-9d2b892a03b2 service nova] Creating event network-vif-plugged:a00cdd99-5015-4206-9abf-2ff50a6f941c for instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 on n-h2-844627-10 Aug 04 15:34:44.821543 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-2db635a1-f2ee-472e-b333-5ead8e6c2c05 req-8aca7682-8082-4a4a-aa51-9d2b892a03b2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098128 Aug 04 15:34:44.822073 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3726/7457] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:34:45.011068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-4d8d5d67-9ba5-4fd0-be44-63af7f8adfb0 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:45.011686 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-4d8d5d67-9ba5-4fd0-be44-63af7f8adfb0 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:45.018592 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d8d5d67-9ba5-4fd0-be44-63af7f8adfb0 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:45.019046 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d8d5d67-9ba5-4fd0-be44-63af7f8adfb0 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:45.019813 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d8d5d67-9ba5-4fd0-be44-63af7f8adfb0 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:45.020253 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-4d8d5d67-9ba5-4fd0-be44-63af7f8adfb0 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:45.153569 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-4d8d5d67-9ba5-4fd0-be44-63af7f8adfb0 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:45.161999 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-4d8d5d67-9ba5-4fd0-be44-63af7f8adfb0 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1373 microversion: 2.1 time: 0.154327 Aug 04 15:34:45.162220 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3732/7458] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:45 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:46.184463 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-e65e837f-e2e7-4b78-817e-b21a71e1740f tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:46.185225 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-e65e837f-e2e7-4b78-817e-b21a71e1740f tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:46.191964 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e65e837f-e2e7-4b78-817e-b21a71e1740f tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:46.192430 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e65e837f-e2e7-4b78-817e-b21a71e1740f tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:46.193321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e65e837f-e2e7-4b78-817e-b21a71e1740f tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:46.193777 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-e65e837f-e2e7-4b78-817e-b21a71e1740f tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:46.336435 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-e65e837f-e2e7-4b78-817e-b21a71e1740f tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:46.344900 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-e65e837f-e2e7-4b78-817e-b21a71e1740f tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1557 microversion: 2.1 time: 0.165839 Aug 04 15:34:46.345520 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3727/7459] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:46 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:46.366542 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5dc44e4-93d9-46ee-b8be-dac8ad05b4a3 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:34:46.367157 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d5dc44e4-93d9-46ee-b8be-dac8ad05b4a3 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:34:46.374671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5dc44e4-93d9-46ee-b8be-dac8ad05b4a3 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:46.375122 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5dc44e4-93d9-46ee-b8be-dac8ad05b4a3 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:46.375891 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5dc44e4-93d9-46ee-b8be-dac8ad05b4a3 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:46.376362 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5dc44e4-93d9-46ee-b8be-dac8ad05b4a3 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:46.506132 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d5dc44e4-93d9-46ee-b8be-dac8ad05b4a3 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:34:46.513728 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5dc44e4-93d9-46ee-b8be-dac8ad05b4a3 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1557 microversion: 2.1 time: 0.151082 Aug 04 15:34:46.514304 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3733/7460] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:34:46 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:34:48.192776 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=6 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:34:48.251337 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-f5a3eee4-db31-498d-bd16-69889c0cd173 req-c5b7b40d-3a42-4e63-b137-0a5f3abbbd66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579df603-ab67-43dd-ae3d-a37cfcea1aa7", "tag": "a00cdd99-5015-4206-9abf-2ff50a6f941c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:34:48.261291 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f5a3eee4-db31-498d-bd16-69889c0cd173 req-c5b7b40d-3a42-4e63-b137-0a5f3abbbd66 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:34:48.261792 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-f5a3eee4-db31-498d-bd16-69889c0cd173 req-c5b7b40d-3a42-4e63-b137-0a5f3abbbd66 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:34:48.273857 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-f5a3eee4-db31-498d-bd16-69889c0cd173 req-c5b7b40d-3a42-4e63-b137-0a5f3abbbd66 service nova] Creating event network-changed:a00cdd99-5015-4206-9abf-2ff50a6f941c for instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 on n-h2-844627-10 Aug 04 15:34:48.278970 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-f5a3eee4-db31-498d-bd16-69889c0cd173 req-c5b7b40d-3a42-4e63-b137-0a5f3abbbd66 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090971 Aug 04 15:34:48.279764 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3728/7461] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:36:43.681410 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:36:43.682048 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:36:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:36:43.880196 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04939028-e350-49aa-b822-266ad76b8ee3] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 15:36:43.881217 n-d-844627-10 devstack@n-api.service[130960]: ERROR oslo.messaging._drivers.impl_rabbit [-] [91e014af-af63-4f98-b00e-ab5af5ef70e1] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 15:36:43.881823 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:36:43.882580 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:36:43.883314 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:36:43.883933 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=34 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:36:43.888346 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d827f9e5-23fe-4c99-8a39-4e74550607da tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-633418895"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:36:43.890662 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d827f9e5-23fe-4c99-8a39-4e74550607da tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:36:43.899906 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d827f9e5-23fe-4c99-8a39-4e74550607da tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:36:43.900351 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d827f9e5-23fe-4c99-8a39-4e74550607da tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:36:43.901142 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d827f9e5-23fe-4c99-8a39-4e74550607da tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:36:43.901574 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d827f9e5-23fe-4c99-8a39-4e74550607da tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:36:44.099085 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d827f9e5-23fe-4c99-8a39-4e74550607da tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "POST /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7/action" status: 202 len: 0 microversion: 2.1 time: 0.220510 Aug 04 15:36:44.100326 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3734/7462] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:36:43 2022] POST /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 15:36:44.179329 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:36:44.180223 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:36:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:36:49.410691 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:36:49.412136 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:36:49.412692 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:36:49.413497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=28 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:36:49.418576 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-93c4c8ab-7042-46b8-8256-db82b1ca2a6f req-7afe4637-18d9-417c-95bd-2c1d450b6bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579df603-ab67-43dd-ae3d-a37cfcea1aa7", "name": "network-vif-plugged", "status": "completed", "tag": "a00cdd99-5015-4206-9abf-2ff50a6f941c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:36:49.436622 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-93c4c8ab-7042-46b8-8256-db82b1ca2a6f req-7afe4637-18d9-417c-95bd-2c1d450b6bb7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:36:49.437400 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-93c4c8ab-7042-46b8-8256-db82b1ca2a6f req-7afe4637-18d9-417c-95bd-2c1d450b6bb7 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:36:49.455284 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-93c4c8ab-7042-46b8-8256-db82b1ca2a6f req-7afe4637-18d9-417c-95bd-2c1d450b6bb7 service nova] Creating event network-vif-plugged:a00cdd99-5015-4206-9abf-2ff50a6f941c for instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 on n-h2-844627-10 Aug 04 15:36:49.461553 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-93c4c8ab-7042-46b8-8256-db82b1ca2a6f req-7afe4637-18d9-417c-95bd-2c1d450b6bb7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052438 Aug 04 15:36:49.464763 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3729/7463] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:36:57.658436 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:36:57.659219 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:36:57.664713 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1306692790", "imageRef": "0ae73229-db43-49ed-8cb5-b5d959d8fc64", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-105708298", "security_groups": [{"name": "tempest-secgroup-smoke-1779230033"}], "networks": [{"uuid": "bd15a293-62b4-4cb8-bd2b-e102ceb127c3"}]}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:36:57.690799 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] [04939028-e350-49aa-b822-266ad76b8ee3] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44508. Aug 04 15:36:57.692615 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] [91e014af-af63-4f98-b00e-ab5af5ef70e1] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44510. Aug 04 15:36:57.779998 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.network.neutron [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] validate_networks() for [('bd15a293-62b4-4cb8-bd2b-e102ceb127c3', None, None, None, None, None)] {{(pid=130960) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 15:36:58.202623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Flavor limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 15:36:58.203059 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Image limits 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 15:36:58.203550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Flavor pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 15:36:58.203955 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Image pref 0:0:0 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 15:36:58.204372 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.virt.hardware [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130960) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 15:36:58.213485 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:36:58.213937 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:36:58.214740 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:36:58.215179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:36:58.232255 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Getting quotas for project bce30b31044e4994b985329f0b5041ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 15:36:58.237551 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.quota [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Getting quotas for user 43764e5a4f9b4cadab6e9831a66f6b06 and project bce30b31044e4994b985329f0b5041ce. Resources: {'ram', 'cores', 'instances'} {{(pid=130960) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 15:36:58.253241 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Going to run 1 instances... {{(pid=130960) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 15:36:58.255721 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ae73229-db43-49ed-8cb5-b5d959d8fc64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130960) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 15:36:58.302793 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8a9c411c-1aca-4597-86db-8f54750ba122 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.646065 Aug 04 15:36:58.304827 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3735/7464] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 15:36:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 15:36:58.325136 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-d1f204ed-4bb1-43d8-b3f8-4ba5ec2af588 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:36:58.326523 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-d1f204ed-4bb1-43d8-b3f8-4ba5ec2af588 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:36:58.338401 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44526. Aug 04 15:36:58.347034 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44528. Aug 04 15:36:58.394122 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-d1f204ed-4bb1-43d8-b3f8-4ba5ec2af588 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:36:58.401916 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-d1f204ed-4bb1-43d8-b3f8-4ba5ec2af588 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1248 microversion: 2.1 time: 0.086523 Aug 04 15:36:58.402459 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3730/7465] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:36:58 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:36:59.424917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-f8c283e6-ea8d-48c3-9247-41c51b0a135c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:36:59.425498 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-f8c283e6-ea8d-48c3-9247-41c51b0a135c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:36:59.438874 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8c283e6-ea8d-48c3-9247-41c51b0a135c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:36:59.439293 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8c283e6-ea8d-48c3-9247-41c51b0a135c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:36:59.440273 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8c283e6-ea8d-48c3-9247-41c51b0a135c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:36:59.440741 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-f8c283e6-ea8d-48c3-9247-41c51b0a135c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:36:59.523856 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-f8c283e6-ea8d-48c3-9247-41c51b0a135c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:36:59.533360 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-f8c283e6-ea8d-48c3-9247-41c51b0a135c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1318 microversion: 2.1 time: 0.114076 Aug 04 15:36:59.534073 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3736/7466] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:36:59 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1318 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:00.556315 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-c75d5e27-0add-429c-9eed-48b88de184c7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:00.557923 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-c75d5e27-0add-429c-9eed-48b88de184c7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:00.565603 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:37:00.569293 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c75d5e27-0add-429c-9eed-48b88de184c7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:00.569849 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c75d5e27-0add-429c-9eed-48b88de184c7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:00.570735 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c75d5e27-0add-429c-9eed-48b88de184c7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:00.571446 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-c75d5e27-0add-429c-9eed-48b88de184c7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:00.753247 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-c75d5e27-0add-429c-9eed-48b88de184c7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:00.766502 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-c75d5e27-0add-429c-9eed-48b88de184c7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.215461 Aug 04 15:37:00.767085 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3731/7467] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:00 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:01.369974 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [req-12c8dd1f-3d27-4360-b2a5-0c758ee3d094 req-9c7e6844-50fa-4625-b2ec-a19b4a4d7dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579df603-ab67-43dd-ae3d-a37cfcea1aa7", "name": "network-vif-unplugged", "status": "completed", "tag": "a00cdd99-5015-4206-9abf-2ff50a6f941c"}]} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:37:01.387598 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-12c8dd1f-3d27-4360-b2a5-0c758ee3d094 req-9c7e6844-50fa-4625-b2ec-a19b4a4d7dc8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:01.388499 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [req-12c8dd1f-3d27-4360-b2a5-0c758ee3d094 req-9c7e6844-50fa-4625-b2ec-a19b4a4d7dc8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:01.406592 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.compute.server_external_events [req-12c8dd1f-3d27-4360-b2a5-0c758ee3d094 req-9c7e6844-50fa-4625-b2ec-a19b4a4d7dc8 service nova] Creating event network-vif-unplugged:a00cdd99-5015-4206-9abf-2ff50a6f941c for instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 on n-h2-844627-10 Aug 04 15:37:01.413335 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [req-12c8dd1f-3d27-4360-b2a5-0c758ee3d094 req-9c7e6844-50fa-4625-b2ec-a19b4a4d7dc8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047112 Aug 04 15:37:01.414905 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3737/7468] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:37:01.787880 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-8980adf1-ffd4-4dd4-84b0-34a1ac69b5fe tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:01.788552 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-8980adf1-ffd4-4dd4-84b0-34a1ac69b5fe tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:01.796174 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8980adf1-ffd4-4dd4-84b0-34a1ac69b5fe tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:01.796948 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8980adf1-ffd4-4dd4-84b0-34a1ac69b5fe tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:01.797855 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8980adf1-ffd4-4dd4-84b0-34a1ac69b5fe tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:01.798436 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-8980adf1-ffd4-4dd4-84b0-34a1ac69b5fe tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:01.946997 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-8980adf1-ffd4-4dd4-84b0-34a1ac69b5fe tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:01.955504 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-8980adf1-ffd4-4dd4-84b0-34a1ac69b5fe tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.171587 Aug 04 15:37:01.968901 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3732/7469] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:01 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:02.978655 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-713be056-c55b-40fb-aafe-9f45bd6c5772 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:02.979640 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-713be056-c55b-40fb-aafe-9f45bd6c5772 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:02.987236 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-713be056-c55b-40fb-aafe-9f45bd6c5772 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:02.987691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-713be056-c55b-40fb-aafe-9f45bd6c5772 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:02.988529 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-713be056-c55b-40fb-aafe-9f45bd6c5772 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:02.989037 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-713be056-c55b-40fb-aafe-9f45bd6c5772 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:03.142310 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-713be056-c55b-40fb-aafe-9f45bd6c5772 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:03.153125 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-713be056-c55b-40fb-aafe-9f45bd6c5772 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.178255 Aug 04 15:37:03.154258 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3738/7470] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:02 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:04.175754 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-3e7af69b-50b8-4b59-9f67-589dc572b33d tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:04.176467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-3e7af69b-50b8-4b59-9f67-589dc572b33d tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:04.183868 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e7af69b-50b8-4b59-9f67-589dc572b33d tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:04.184427 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e7af69b-50b8-4b59-9f67-589dc572b33d tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:04.185994 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e7af69b-50b8-4b59-9f67-589dc572b33d tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:04.186198 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-3e7af69b-50b8-4b59-9f67-589dc572b33d tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:04.706408 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-3e7af69b-50b8-4b59-9f67-589dc572b33d tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:04.714899 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-3e7af69b-50b8-4b59-9f67-589dc572b33d tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.543133 Aug 04 15:37:04.715725 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3733/7471] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:04 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:05.735734 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7edef591-1fc6-475f-b701-5831b207beb7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:05.736353 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7edef591-1fc6-475f-b701-5831b207beb7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:05.749285 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7edef591-1fc6-475f-b701-5831b207beb7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:05.750407 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7edef591-1fc6-475f-b701-5831b207beb7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:05.750553 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7edef591-1fc6-475f-b701-5831b207beb7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:05.750967 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7edef591-1fc6-475f-b701-5831b207beb7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:05.906378 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7edef591-1fc6-475f-b701-5831b207beb7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:05.915343 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7edef591-1fc6-475f-b701-5831b207beb7 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.183306 Aug 04 15:37:05.928813 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3739/7472] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:05 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:06.936264 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-888b7436-16d6-4fcc-9ea0-82076bd25af9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:06.937954 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-888b7436-16d6-4fcc-9ea0-82076bd25af9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:06.946088 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-888b7436-16d6-4fcc-9ea0-82076bd25af9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:06.946929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-888b7436-16d6-4fcc-9ea0-82076bd25af9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:06.948006 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-888b7436-16d6-4fcc-9ea0-82076bd25af9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:06.948669 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-888b7436-16d6-4fcc-9ea0-82076bd25af9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:07.128694 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-888b7436-16d6-4fcc-9ea0-82076bd25af9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:07.138297 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-888b7436-16d6-4fcc-9ea0-82076bd25af9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.206362 Aug 04 15:37:07.140462 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3734/7473] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:06 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:08.160781 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-553e9580-2056-4364-92eb-2bd041b69cbf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:08.161986 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-553e9580-2056-4364-92eb-2bd041b69cbf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:08.169221 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-553e9580-2056-4364-92eb-2bd041b69cbf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:08.169671 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-553e9580-2056-4364-92eb-2bd041b69cbf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:08.170437 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-553e9580-2056-4364-92eb-2bd041b69cbf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:08.170999 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-553e9580-2056-4364-92eb-2bd041b69cbf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:08.222344 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:37:08.245453 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell0:SELECT=6 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:37:08.311915 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-553e9580-2056-4364-92eb-2bd041b69cbf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:08.320499 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-553e9580-2056-4364-92eb-2bd041b69cbf tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.163639 Aug 04 15:37:08.321106 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3740/7474] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:08 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:09.341799 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f05940c7-473e-4c6e-85ba-1aef8afc6bce tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:09.342426 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f05940c7-473e-4c6e-85ba-1aef8afc6bce tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:09.345146 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell0:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:37:09.350633 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f05940c7-473e-4c6e-85ba-1aef8afc6bce tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:09.351107 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f05940c7-473e-4c6e-85ba-1aef8afc6bce tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:09.351899 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f05940c7-473e-4c6e-85ba-1aef8afc6bce tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:09.352360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f05940c7-473e-4c6e-85ba-1aef8afc6bce tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:09.485221 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f05940c7-473e-4c6e-85ba-1aef8afc6bce tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:09.493426 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f05940c7-473e-4c6e-85ba-1aef8afc6bce tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.155578 Aug 04 15:37:09.493993 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3735/7475] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:09 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:10.514245 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d8582c71-c27d-4870-8127-1453ec517d83 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:10.514885 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d8582c71-c27d-4870-8127-1453ec517d83 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:10.521890 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8582c71-c27d-4870-8127-1453ec517d83 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:10.522340 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8582c71-c27d-4870-8127-1453ec517d83 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:10.523105 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8582c71-c27d-4870-8127-1453ec517d83 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:10.523537 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d8582c71-c27d-4870-8127-1453ec517d83 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:10.664406 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d8582c71-c27d-4870-8127-1453ec517d83 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:10.672194 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d8582c71-c27d-4870-8127-1453ec517d83 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.161888 Aug 04 15:37:10.672803 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3741/7476] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:10 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:10.895497 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-0b589bc7-cc2b-4a35-a3bc-4d2c24c91713 req-c6509b96-6dc8-4b56-bec3-5974eee99343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3b9ac7-1978-4f39-a647-011a649e9633", "tag": "28c848fa-125f-40e1-9387-34f4ca11c248"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:37:10.907759 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0b589bc7-cc2b-4a35-a3bc-4d2c24c91713 req-c6509b96-6dc8-4b56-bec3-5974eee99343 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:10.908321 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-0b589bc7-cc2b-4a35-a3bc-4d2c24c91713 req-c6509b96-6dc8-4b56-bec3-5974eee99343 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:10.927944 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-0b589bc7-cc2b-4a35-a3bc-4d2c24c91713 req-c6509b96-6dc8-4b56-bec3-5974eee99343 service nova] Creating event network-changed:28c848fa-125f-40e1-9387-34f4ca11c248 for instance 1f3b9ac7-1978-4f39-a647-011a649e9633 on n-h1-844627-10 Aug 04 15:37:10.934592 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-0b589bc7-cc2b-4a35-a3bc-4d2c24c91713 req-c6509b96-6dc8-4b56-bec3-5974eee99343 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042778 Aug 04 15:37:10.935637 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3736/7477] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:37:11.695057 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-42c8d348-aacd-4d82-aad1-17baade69c9c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:11.695604 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-42c8d348-aacd-4d82-aad1-17baade69c9c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:11.702724 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42c8d348-aacd-4d82-aad1-17baade69c9c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:11.703176 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42c8d348-aacd-4d82-aad1-17baade69c9c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:11.704249 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42c8d348-aacd-4d82-aad1-17baade69c9c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:11.704691 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-42c8d348-aacd-4d82-aad1-17baade69c9c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:11.839895 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-42c8d348-aacd-4d82-aad1-17baade69c9c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:11.847960 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-42c8d348-aacd-4d82-aad1-17baade69c9c tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.157377 Aug 04 15:37:11.848826 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3742/7478] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:11 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:12.874388 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-083b70a1-4302-41fb-9fd6-10efa31d7046 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:12.875144 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-083b70a1-4302-41fb-9fd6-10efa31d7046 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:12.881599 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-083b70a1-4302-41fb-9fd6-10efa31d7046 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:12.882069 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-083b70a1-4302-41fb-9fd6-10efa31d7046 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:12.882861 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-083b70a1-4302-41fb-9fd6-10efa31d7046 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:12.883316 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-083b70a1-4302-41fb-9fd6-10efa31d7046 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:13.021872 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-083b70a1-4302-41fb-9fd6-10efa31d7046 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:13.029433 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-083b70a1-4302-41fb-9fd6-10efa31d7046 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.161820 Aug 04 15:37:13.030006 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3737/7479] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:12 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:14.050907 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-0a496c36-3d7c-4133-b2fa-5290636bbe33 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:14.052141 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-0a496c36-3d7c-4133-b2fa-5290636bbe33 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:14.059108 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a496c36-3d7c-4133-b2fa-5290636bbe33 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:14.059567 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a496c36-3d7c-4133-b2fa-5290636bbe33 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:14.060615 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a496c36-3d7c-4133-b2fa-5290636bbe33 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:14.061090 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-0a496c36-3d7c-4133-b2fa-5290636bbe33 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:14.191171 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-0a496c36-3d7c-4133-b2fa-5290636bbe33 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:14.198784 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-0a496c36-3d7c-4133-b2fa-5290636bbe33 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.151841 Aug 04 15:37:14.199363 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3743/7480] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:14 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:15.219916 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-a1f0b0a3-4146-4125-a1a7-f77709ac471b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:15.220555 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-a1f0b0a3-4146-4125-a1a7-f77709ac471b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:15.227944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1f0b0a3-4146-4125-a1a7-f77709ac471b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:15.228417 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1f0b0a3-4146-4125-a1a7-f77709ac471b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:15.229257 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1f0b0a3-4146-4125-a1a7-f77709ac471b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:15.229721 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-a1f0b0a3-4146-4125-a1a7-f77709ac471b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:15.367781 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-a1f0b0a3-4146-4125-a1a7-f77709ac471b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:15.375329 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-a1f0b0a3-4146-4125-a1a7-f77709ac471b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.159431 Aug 04 15:37:15.375889 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3738/7481] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:15 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:16.397343 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-e699dae9-dc6a-4bb7-b7bc-3b22104838bc tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:16.397951 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-e699dae9-dc6a-4bb7-b7bc-3b22104838bc tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:16.404957 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e699dae9-dc6a-4bb7-b7bc-3b22104838bc tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:16.405411 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e699dae9-dc6a-4bb7-b7bc-3b22104838bc tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:16.406179 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e699dae9-dc6a-4bb7-b7bc-3b22104838bc tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:16.406622 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-e699dae9-dc6a-4bb7-b7bc-3b22104838bc tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:16.540667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-e699dae9-dc6a-4bb7-b7bc-3b22104838bc tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:16.548217 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-e699dae9-dc6a-4bb7-b7bc-3b22104838bc tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.155419 Aug 04 15:37:16.548788 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3744/7482] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:16 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:16.970077 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-b5df6615-2393-4971-a0c5-dfe4f22f7ef6 req-9839df96-c900-4f3a-9bf3-3cacfbc900e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3b9ac7-1978-4f39-a647-011a649e9633", "name": "network-vif-plugged", "status": "completed", "tag": "28c848fa-125f-40e1-9387-34f4ca11c248"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:37:16.981465 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b5df6615-2393-4971-a0c5-dfe4f22f7ef6 req-9839df96-c900-4f3a-9bf3-3cacfbc900e2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:16.981944 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-b5df6615-2393-4971-a0c5-dfe4f22f7ef6 req-9839df96-c900-4f3a-9bf3-3cacfbc900e2 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:16.994154 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-b5df6615-2393-4971-a0c5-dfe4f22f7ef6 req-9839df96-c900-4f3a-9bf3-3cacfbc900e2 service nova] Creating event network-vif-plugged:28c848fa-125f-40e1-9387-34f4ca11c248 for instance 1f3b9ac7-1978-4f39-a647-011a649e9633 on n-h1-844627-10 Aug 04 15:37:16.999489 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-b5df6615-2393-4971-a0c5-dfe4f22f7ef6 req-9839df96-c900-4f3a-9bf3-3cacfbc900e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033146 Aug 04 15:37:17.000752 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3739/7483] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:37:17.569676 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-cfa73847-dc77-4ead-a2ff-db1928b685c9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:17.570215 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-cfa73847-dc77-4ead-a2ff-db1928b685c9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:17.577315 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cfa73847-dc77-4ead-a2ff-db1928b685c9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:17.577770 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cfa73847-dc77-4ead-a2ff-db1928b685c9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:17.578550 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cfa73847-dc77-4ead-a2ff-db1928b685c9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:17.578995 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-cfa73847-dc77-4ead-a2ff-db1928b685c9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:17.711338 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-cfa73847-dc77-4ead-a2ff-db1928b685c9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:17.718971 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-cfa73847-dc77-4ead-a2ff-db1928b685c9 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1374 microversion: 2.1 time: 0.153274 Aug 04 15:37:17.719550 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3745/7484] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:17 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:18.741372 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-f024aace-817a-487d-8586-9b4968407dbb tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:18.742097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-f024aace-817a-487d-8586-9b4968407dbb tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:18.748461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f024aace-817a-487d-8586-9b4968407dbb tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:18.748976 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f024aace-817a-487d-8586-9b4968407dbb tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:18.749772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f024aace-817a-487d-8586-9b4968407dbb tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:18.750226 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-f024aace-817a-487d-8586-9b4968407dbb tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:18.892262 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-f024aace-817a-487d-8586-9b4968407dbb tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:18.899986 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-f024aace-817a-487d-8586-9b4968407dbb tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1559 microversion: 2.1 time: 0.164438 Aug 04 15:37:18.900602 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3740/7485] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:18 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:18.921225 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d4a3b41b-4fb8-43bd-b17c-34becd33af13 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:37:18.921836 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d4a3b41b-4fb8-43bd-b17c-34becd33af13 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:37:18.929426 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4a3b41b-4fb8-43bd-b17c-34becd33af13 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:18.929870 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4a3b41b-4fb8-43bd-b17c-34becd33af13 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:18.930635 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4a3b41b-4fb8-43bd-b17c-34becd33af13 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:18.931068 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d4a3b41b-4fb8-43bd-b17c-34becd33af13 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:19.074223 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-d4a3b41b-4fb8-43bd-b17c-34becd33af13 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:37:19.081921 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d4a3b41b-4fb8-43bd-b17c-34becd33af13 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1559 microversion: 2.1 time: 0.164715 Aug 04 15:37:19.082483 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3746/7486] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:37:18 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:37:20.757244 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-aedc1b98-b1de-4a20-908a-768102629403 req-bf687554-a1bb-46eb-8dbb-d9166eb0cfa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3b9ac7-1978-4f39-a647-011a649e9633", "tag": "28c848fa-125f-40e1-9387-34f4ca11c248"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:37:20.762461 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=27 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:37:20.768640 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-aedc1b98-b1de-4a20-908a-768102629403 req-bf687554-a1bb-46eb-8dbb-d9166eb0cfa5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:37:20.769131 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-aedc1b98-b1de-4a20-908a-768102629403 req-bf687554-a1bb-46eb-8dbb-d9166eb0cfa5 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:37:20.780486 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-aedc1b98-b1de-4a20-908a-768102629403 req-bf687554-a1bb-46eb-8dbb-d9166eb0cfa5 service nova] Creating event network-changed:28c848fa-125f-40e1-9387-34f4ca11c248 for instance 1f3b9ac7-1978-4f39-a647-011a649e9633 on n-h1-844627-10 Aug 04 15:37:20.785668 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-aedc1b98-b1de-4a20-908a-768102629403 req-bf687554-a1bb-46eb-8dbb-d9166eb0cfa5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098736 Aug 04 15:37:20.786760 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3741/7487] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:39:20.028530 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:39:20.029316 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=64 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:39:20.033834 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-d5a0cc6c-d896-4cf2-b5be-624d3b1f427a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-649586482"}} {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:39:20.036188 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-d5a0cc6c-d896-4cf2-b5be-624d3b1f427a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:20.044196 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5a0cc6c-d896-4cf2-b5be-624d3b1f427a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:20.044654 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5a0cc6c-d896-4cf2-b5be-624d3b1f427a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:20.045466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5a0cc6c-d896-4cf2-b5be-624d3b1f427a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:20.045910 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-d5a0cc6c-d896-4cf2-b5be-624d3b1f427a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:20.238891 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-d5a0cc6c-d896-4cf2-b5be-624d3b1f427a tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "POST /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633/action" status: 202 len: 0 microversion: 2.1 time: 0.212071 Aug 04 15:39:20.239569 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3747/7488] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 15:39:20 2022] POST /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 15:39:27.504506 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 15:39:27.506210 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 15:39:27.506806 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=1 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:39:27.507746 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=54 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:39:27.512352 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-ff77d7a0-d573-42bc-82b6-1cd7c55947ee req-63db31c4-536c-456a-aaef-f8b84ea3a755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3b9ac7-1978-4f39-a647-011a649e9633", "name": "network-vif-plugged", "status": "completed", "tag": "28c848fa-125f-40e1-9387-34f4ca11c248"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:39:27.524067 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ff77d7a0-d573-42bc-82b6-1cd7c55947ee req-63db31c4-536c-456a-aaef-f8b84ea3a755 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:27.524536 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-ff77d7a0-d573-42bc-82b6-1cd7c55947ee req-63db31c4-536c-456a-aaef-f8b84ea3a755 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:27.536481 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-ff77d7a0-d573-42bc-82b6-1cd7c55947ee req-63db31c4-536c-456a-aaef-f8b84ea3a755 service nova] Creating event network-vif-plugged:28c848fa-125f-40e1-9387-34f4ca11c248 for instance 1f3b9ac7-1978-4f39-a647-011a649e9633 on n-h1-844627-10 Aug 04 15:39:27.542712 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-ff77d7a0-d573-42bc-82b6-1cd7c55947ee req-63db31c4-536c-456a-aaef-f8b84ea3a755 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040527 Aug 04 15:39:27.543457 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3742/7489] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:39:40.203492 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_api:SELECT=2 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:39:40.204263 n-d-844627-10 devstack@n-api.service[130960]: DEBUG dbcounter [-] [130960] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130960) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:39:40.208697 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-99ee5a1c-33ae-448e-a307-32b26a046eca req-b6845bc7-d920-4f0c-91c6-c2e6ca6c82a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3b9ac7-1978-4f39-a647-011a649e9633", "tag": "28c848fa-125f-40e1-9387-34f4ca11c248"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:39:40.209232 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-077ecd23-f808-461b-9481-c50807f6f7d5 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:40.209629 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-077ecd23-f808-461b-9481-c50807f6f7d5 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:40.217506 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_api:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:39:40.218261 n-d-844627-10 devstack@n-api.service[130961]: DEBUG dbcounter [-] [130961] Writing DB stats nova_cell1:SELECT=2 {{(pid=130961) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 15:39:40.223163 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-077ecd23-f808-461b-9481-c50807f6f7d5 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:40.223837 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-077ecd23-f808-461b-9481-c50807f6f7d5 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:40.224782 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-077ecd23-f808-461b-9481-c50807f6f7d5 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:40.225390 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-077ecd23-f808-461b-9481-c50807f6f7d5 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:40.230572 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-99ee5a1c-33ae-448e-a307-32b26a046eca req-b6845bc7-d920-4f0c-91c6-c2e6ca6c82a8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:40.231037 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-99ee5a1c-33ae-448e-a307-32b26a046eca req-b6845bc7-d920-4f0c-91c6-c2e6ca6c82a8 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:40.245713 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bedb294-8650-42e3-b2f4-0dd7e2cdf8cc] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44854. Aug 04 15:39:40.249972 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-99ee5a1c-33ae-448e-a307-32b26a046eca req-b6845bc7-d920-4f0c-91c6-c2e6ca6c82a8 service nova] Creating event network-changed:28c848fa-125f-40e1-9387-34f4ca11c248 for instance 1f3b9ac7-1978-4f39-a647-011a649e9633 on n-h1-844627-10 Aug 04 15:39:40.253921 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaebe21b-70c1-4fe0-9b29-03c48d7844d6] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44856. Aug 04 15:39:40.254231 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-077ecd23-f808-461b-9481-c50807f6f7d5 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:39:40.255733 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-99ee5a1c-33ae-448e-a307-32b26a046eca req-b6845bc7-d920-4f0c-91c6-c2e6ca6c82a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051483 Aug 04 15:39:40.256389 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3743/7490] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 15:39:40.344919 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-077ecd23-f808-461b-9481-c50807f6f7d5 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 204 len: 0 microversion: 2.1 time: 0.143267 Aug 04 15:39:40.345511 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3748/7491] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:39:40 2022] DELETE /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:39:40.354094 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-60f81148-d30d-4b50-8f5e-6e43ecb9fe41 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:40.355097 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-60f81148-d30d-4b50-8f5e-6e43ecb9fe41 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:40.362050 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60f81148-d30d-4b50-8f5e-6e43ecb9fe41 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:40.362737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60f81148-d30d-4b50-8f5e-6e43ecb9fe41 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:40.363737 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60f81148-d30d-4b50-8f5e-6e43ecb9fe41 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:40.364192 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-60f81148-d30d-4b50-8f5e-6e43ecb9fe41 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:40.650731 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-60f81148-d30d-4b50-8f5e-6e43ecb9fe41 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:39:40.658441 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-60f81148-d30d-4b50-8f5e-6e43ecb9fe41 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1684 microversion: 2.1 time: 0.308588 Aug 04 15:39:40.659018 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3744/7492] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:39:40 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1684 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:39:41.680540 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ca284421-9128-41ff-987d-b48994882606 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:41.681279 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ca284421-9128-41ff-987d-b48994882606 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:41.689522 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca284421-9128-41ff-987d-b48994882606 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:41.689978 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca284421-9128-41ff-987d-b48994882606 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:41.690754 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca284421-9128-41ff-987d-b48994882606 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:41.691198 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ca284421-9128-41ff-987d-b48994882606 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:41.879288 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ca284421-9128-41ff-987d-b48994882606 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:39:41.886991 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ca284421-9128-41ff-987d-b48994882606 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1684 microversion: 2.1 time: 0.210678 Aug 04 15:39:41.887579 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3749/7493] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:39:41 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1684 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:39:42.861699 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6f9a7589-aaaf-46e9-aa00-1be8385215b3 req-3bf54e2e-5c23-40f9-9571-88b73e337116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3b9ac7-1978-4f39-a647-011a649e9633", "name": "network-vif-deleted", "tag": "28c848fa-125f-40e1-9387-34f4ca11c248"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:39:42.875145 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6f9a7589-aaaf-46e9-aa00-1be8385215b3 req-3bf54e2e-5c23-40f9-9571-88b73e337116 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:42.875662 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6f9a7589-aaaf-46e9-aa00-1be8385215b3 req-3bf54e2e-5c23-40f9-9571-88b73e337116 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:42.888725 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6f9a7589-aaaf-46e9-aa00-1be8385215b3 req-3bf54e2e-5c23-40f9-9571-88b73e337116 service nova] Creating event network-vif-deleted:28c848fa-125f-40e1-9387-34f4ca11c248 for instance 1f3b9ac7-1978-4f39-a647-011a649e9633 on n-h1-844627-10 Aug 04 15:39:42.893946 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6f9a7589-aaaf-46e9-aa00-1be8385215b3 req-3bf54e2e-5c23-40f9-9571-88b73e337116 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035937 Aug 04 15:39:42.894536 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3745/7494] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:39:42.907845 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-ba8c2092-f476-4c69-ac7d-c50cdf681fd2 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:42.908486 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-ba8c2092-f476-4c69-ac7d-c50cdf681fd2 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:42.915711 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba8c2092-f476-4c69-ac7d-c50cdf681fd2 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:42.916226 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba8c2092-f476-4c69-ac7d-c50cdf681fd2 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:42.917035 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba8c2092-f476-4c69-ac7d-c50cdf681fd2 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:42.917466 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-ba8c2092-f476-4c69-ac7d-c50cdf681fd2 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:42.984759 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-ba8c2092-f476-4c69-ac7d-c50cdf681fd2 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:39:42.993233 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-ba8c2092-f476-4c69-ac7d-c50cdf681fd2 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 200 len: 1333 microversion: 2.1 time: 0.089366 Aug 04 15:39:42.993819 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3750/7495] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:39:42 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:39:44.015967 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:44.016679 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 1f3b9ac7-1978-4f39-a647-011a649e9633] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:44.023002 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:44.023467 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:44.024235 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:44.024683 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:44.038361 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.wsgi [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] HTTP exception thrown: Instance 1f3b9ac7-1978-4f39-a647-011a649e9633 could not be found. Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Request method failure captured: Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: request: GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 HTTP/1.1 Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: Accept: application/json Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: Accept-Encoding: identity Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: Connection: close Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: Content-Length: 0 Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: Content-Type: application/json Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: Host: 10.222.0.66 Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: Openstack-System-Scope: None Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: User-Agent: python-urllib3/1.26.11 Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Auth-Token: gAAAAABi6-cExKSS6aiGEU7lHQJ_YnyA63IFxD9wUSD9Psdu4dNQzKKOSipE5q9dbXViKv9E68KZHyehEY4TBp75ZF0YPCYTEWMiTtykLVwl3tCaBEvcjDqF2eCBIFH6o_Bks8Fl10ZuSyvlDwA4tcbuFVvsTEEz2IsJ6V0BEcXAO-LDuqW0E60 Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Id: None Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Domain-Name: None Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Identity-Status: Confirmed Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Is-Admin-Project: True Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Id: default Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Domain-Name: Default Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Id: bce30b31044e4994b985329f0b5041ce Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Project-Name: tempest-TestSnapshotPattern-39647205 Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Role: reader,member Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Roles: reader,member Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bce30b31044e4994b985329f0b5041ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bce30b31044e4994b985329f0b5041ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bce30b31044e4994b985329f0b5041ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bce30b31044e4994b985329f0b5041ce"}]}] Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant: tempest-TestSnapshotPattern-39647205 Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Id: bce30b31044e4994b985329f0b5041ce Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-Tenant-Name: tempest-TestSnapshotPattern-39647205 Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-User: tempest-TestSnapshotPattern-39647205-project Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Id: default Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-User-Domain-Name: Default Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-User-Id: 43764e5a4f9b4cadab6e9831a66f6b06 Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: X-User-Name: tempest-TestSnapshotPattern-39647205-project Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: method: > Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: exception: Instance 1f3b9ac7-1978-4f39-a647-011a649e9633 could not be found. Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: action_args: {'id': '1f3b9ac7-1978-4f39-a647-011a649e9633'} Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3b9ac7-1978-4f39-a647-011a649e9633 could not be found. Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3b9ac7-1978-4f39-a647-011a649e9633 could not be found. Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:39:44.039991 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3b9ac7-1978-4f39-a647-011a649e9633 could not be found. Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: ERROR nova.api.openstack.wsgi Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Returning 404 to user: Instance 1f3b9ac7-1978-4f39-a647-011a649e9633 could not be found. {{(pid=130961) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-33f3e36f-385a-4e39-9313-3164c19388fa tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633" status: 404 len: 111 microversion: 2.1 time: 0.030641 Aug 04 15:39:44.046014 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3746/7496] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:39:44 2022] GET /compute/v2.1/servers/1f3b9ac7-1978-4f39-a647-011a649e9633 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:39:45.714363 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-8aaa8dec-5adb-404a-abad-cd364a239879 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:45.715417 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8aaa8dec-5adb-404a-abad-cd364a239879 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:45.717250 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-38c7d22a-05b0-4c40-9d0f-6541beaefe8a req-1f26285f-5aa9-4e40-9317-f709958f95ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579df603-ab67-43dd-ae3d-a37cfcea1aa7", "tag": "a00cdd99-5015-4206-9abf-2ff50a6f941c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:39:45.722178 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8aaa8dec-5adb-404a-abad-cd364a239879 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:45.722926 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8aaa8dec-5adb-404a-abad-cd364a239879 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:45.723623 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8aaa8dec-5adb-404a-abad-cd364a239879 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:45.724284 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-8aaa8dec-5adb-404a-abad-cd364a239879 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:45.729462 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-38c7d22a-05b0-4c40-9d0f-6541beaefe8a req-1f26285f-5aa9-4e40-9317-f709958f95ef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:45.729929 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-38c7d22a-05b0-4c40-9d0f-6541beaefe8a req-1f26285f-5aa9-4e40-9317-f709958f95ef service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:45.742009 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-38c7d22a-05b0-4c40-9d0f-6541beaefe8a req-1f26285f-5aa9-4e40-9317-f709958f95ef service nova] Creating event network-changed:a00cdd99-5015-4206-9abf-2ff50a6f941c for instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 on n-h2-844627-10 Aug 04 15:39:45.748646 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-38c7d22a-05b0-4c40-9d0f-6541beaefe8a req-1f26285f-5aa9-4e40-9317-f709958f95ef service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035494 Aug 04 15:39:45.749662 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3747/7497] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:39:45.751360 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-8aaa8dec-5adb-404a-abad-cd364a239879 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Going to try to terminate instance {{(pid=130960) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 15:39:45.841534 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-8aaa8dec-5adb-404a-abad-cd364a239879 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "DELETE /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 204 len: 0 microversion: 2.1 time: 0.131083 Aug 04 15:39:45.842145 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3751/7498] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 15:39:45 2022] DELETE /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 15:39:45.851647 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-ac91f679-5e17-40e8-ae13-cfd997ce0055 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:45.852360 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.compute.api [None req-ac91f679-5e17-40e8-ae13-cfd997ce0055 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130961) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:45.861356 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac91f679-5e17-40e8-ae13-cfd997ce0055 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:45.861833 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac91f679-5e17-40e8-ae13-cfd997ce0055 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:45.862656 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac91f679-5e17-40e8-ae13-cfd997ce0055 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:45.863117 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [None req-ac91f679-5e17-40e8-ae13-cfd997ce0055 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:46.008522 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.policy [None req-ac91f679-5e17-40e8-ae13-cfd997ce0055 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130961) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:39:46.017558 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-ac91f679-5e17-40e8-ae13-cfd997ce0055 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1681 microversion: 2.1 time: 0.170268 Aug 04 15:39:46.018156 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3748/7499] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:39:45 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:39:47.041240 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-7b49b105-6075-4706-959e-c1f97d0ed296 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:47.041958 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-7b49b105-6075-4706-959e-c1f97d0ed296 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:47.050039 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b49b105-6075-4706-959e-c1f97d0ed296 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:47.050667 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b49b105-6075-4706-959e-c1f97d0ed296 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:47.051447 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b49b105-6075-4706-959e-c1f97d0ed296 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:47.051917 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-7b49b105-6075-4706-959e-c1f97d0ed296 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:47.119413 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.policy [None req-7b49b105-6075-4706-959e-c1f97d0ed296 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43764e5a4f9b4cadab6e9831a66f6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bce30b31044e4994b985329f0b5041ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130960) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 15:39:47.127563 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-7b49b105-6075-4706-959e-c1f97d0ed296 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 200 len: 1332 microversion: 2.1 time: 0.091243 Aug 04 15:39:47.128392 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3752/7500] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:39:47 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 15:39:47.764477 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [req-6b8ba008-8543-4965-aa9b-e43f1ac32c5c req-cedcf33a-c238-410e-9d86-8c441782a054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579df603-ab67-43dd-ae3d-a37cfcea1aa7", "name": "network-vif-deleted", "tag": "a00cdd99-5015-4206-9abf-2ff50a6f941c"}]} {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 15:39:47.775041 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6b8ba008-8543-4965-aa9b-e43f1ac32c5c req-cedcf33a-c238-410e-9d86-8c441782a054 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:47.775507 n-d-844627-10 devstack@n-api.service[130961]: DEBUG oslo_concurrency.lockutils [req-6b8ba008-8543-4965-aa9b-e43f1ac32c5c req-cedcf33a-c238-410e-9d86-8c441782a054 service nova] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130961) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:47.788828 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.compute.server_external_events [req-6b8ba008-8543-4965-aa9b-e43f1ac32c5c req-cedcf33a-c238-410e-9d86-8c441782a054 service nova] Creating event network-vif-deleted:a00cdd99-5015-4206-9abf-2ff50a6f941c for instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 on n-h2-844627-10 Aug 04 15:39:47.794324 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [req-6b8ba008-8543-4965-aa9b-e43f1ac32c5c req-cedcf33a-c238-410e-9d86-8c441782a054 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034211 Aug 04 15:39:47.794934 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3749/7501] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 15:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 15:39:48.149534 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '>' {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:48.150144 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.compute.api [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [instance: 579df603-ab67-43dd-ae3d-a37cfcea1aa7] Fetching instance by UUID {{(pid=130960) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 15:39:48.157019 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:48.157471 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:48.158235 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 15:39:48.158666 n-d-844627-10 devstack@n-api.service[130960]: DEBUG oslo_concurrency.lockutils [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Lock "bcbf8c79-9a07-4e65-bf7e-ab53299315fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130960) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 15:39:48.176363 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.wsgi [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] HTTP exception thrown: Instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 could not be found. Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Request method failure captured: Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: request: GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 HTTP/1.1 Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: Accept: application/json Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: Accept-Encoding: identity Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: Connection: close Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: Content-Length: 0 Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: Content-Type: application/json Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: Host: 10.222.0.66 Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: Openstack-System-Scope: None Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: User-Agent: python-urllib3/1.26.11 Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Auth-Token: gAAAAABi6-cExKSS6aiGEU7lHQJ_YnyA63IFxD9wUSD9Psdu4dNQzKKOSipE5q9dbXViKv9E68KZHyehEY4TBp75ZF0YPCYTEWMiTtykLVwl3tCaBEvcjDqF2eCBIFH6o_Bks8Fl10ZuSyvlDwA4tcbuFVvsTEEz2IsJ6V0BEcXAO-LDuqW0E60 Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Id: None Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Domain-Name: None Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Identity-Status: Confirmed Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Is-Admin-Project: True Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Id: default Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Domain-Name: Default Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Id: bce30b31044e4994b985329f0b5041ce Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Project-Name: tempest-TestSnapshotPattern-39647205 Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Role: reader,member Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Roles: reader,member Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bce30b31044e4994b985329f0b5041ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bce30b31044e4994b985329f0b5041ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bce30b31044e4994b985329f0b5041ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bce30b31044e4994b985329f0b5041ce"}]}] Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant: tempest-TestSnapshotPattern-39647205 Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Id: bce30b31044e4994b985329f0b5041ce Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-Tenant-Name: tempest-TestSnapshotPattern-39647205 Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-User: tempest-TestSnapshotPattern-39647205-project Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Id: default Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-User-Domain-Name: Default Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-User-Id: 43764e5a4f9b4cadab6e9831a66f6b06 Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: X-User-Name: tempest-TestSnapshotPattern-39647205-project Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: method: > Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: exception: Instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 could not be found. Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: action_args: {'id': '579df603-ab67-43dd-ae3d-a37cfcea1aa7'} Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: {{(pid=130960) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 could not be found. Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 could not be found. Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 15:39:48.178062 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 could not be found. Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: ERROR nova.api.openstack.wsgi Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: DEBUG nova.api.openstack.wsgi [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Returning 404 to user: Instance 579df603-ab67-43dd-ae3d-a37cfcea1aa7 could not be found. {{(pid=130960) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: INFO nova.api.openstack.requestlog [None req-a6085385-a2e6-4fb6-8cd2-e11fd326be25 tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7" status: 404 len: 111 microversion: 2.1 time: 0.033973 Aug 04 15:39:48.183356 n-d-844627-10 devstack@n-api.service[130960]: [pid: 130960|app: 0|req: 3753/7502] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 15:39:48 2022] GET /compute/v2.1/servers/579df603-ab67-43dd-ae3d-a37cfcea1aa7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 15:39:48.346772 n-d-844627-10 devstack@n-api.service[130961]: DEBUG nova.api.openstack.wsgi [None req-900344c6-8bfc-41da-8f3d-de904bce414b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] Calling method '.version_select at 0x7f46f338d820>' {{(pid=130961) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 15:39:48.353202 n-d-844627-10 devstack@n-api.service[130961]: ERROR oslo.messaging._drivers.impl_rabbit [None req-900344c6-8bfc-41da-8f3d-de904bce414b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [c3f3337f-5e3e-4dc2-90e4-1955cee99059] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 15:39:49.360849 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [None req-900344c6-8bfc-41da-8f3d-de904bce414b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] [c3f3337f-5e3e-4dc2-90e4-1955cee99059] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44932. Aug 04 15:39:49.378913 n-d-844627-10 devstack@n-api.service[130961]: INFO nova.api.openstack.requestlog [None req-900344c6-8bfc-41da-8f3d-de904bce414b tempest-TestSnapshotPattern-39647205 tempest-TestSnapshotPattern-39647205-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-105708298" status: 202 len: 0 microversion: 2.1 time: 1.036817 Aug 04 15:39:49.379504 n-d-844627-10 devstack@n-api.service[130961]: [pid: 130961|app: 0|req: 3750/7503] 10.222.0.66 () {58 vars in 1254 bytes} [Thu Aug 4 15:39:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-105708298 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 15:40:03.689926 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:40:03.690548 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:40:03.830568 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:40:03.830792 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:40:04.187483 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:40:04.187914 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:40:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:42:11.829409 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:42:11.830080 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:42:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:43:23.697539 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:43:23.698378 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:43:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:43:23.838499 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:43:23.838731 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:43:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:43:24.195523 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:43:24.196086 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:43:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:45:04.026634 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:45:04.027371 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:45:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:45:19.246027 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:45:19.246785 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:45:31.837818 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:45:31.838417 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:46:43.705804 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:46:43.706535 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:46:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:46:43.848346 n-d-844627-10 devstack@n-api.service[130960]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:46:43.848579 n-d-844627-10 devstack@n-api.service[130960]: Thu Aug 4 15:46:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:46:44.203774 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:46:44.204222 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:48:24.035446 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:48:24.036245 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:48:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 15:48:39.254837 n-d-844627-10 devstack@n-api.service[130961]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 15:48:39.255469 n-d-844627-10 devstack@n-api.service[130961]: Thu Aug 4 15:48:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!